After almost 20 years, GPU benchmarking is moving past FPS

A Guy

Righteous Dude
Guru
VIP
SF Team
Local time
2:57 PM
Messages
33,044
Location
Bay Area
In gaming, frame rate — measured in frames per second, or fps– is king. That’s been true for the 12 years I’ve been reviewing computer hardware and then some. Frames per second has ruled the roost, virtually unchallenged. Some sites now incorporate minimum frame rates or display the frame rate at each second to give gamers a better sense of what the range is — but the metric hasn’t really changed. We’re still talking about the number of frames produced in one second.

Now, that’s changing. It started in September, 2011, when Scott Wasson over at Tech Report decided to dive into what was happening inside the second. I’ll let him explain why: “The fundamental problem is that, in terms of both computer time and human visual perception, one second is a very long time. Averaging results over a single second can obscure some big and important performance differences between systems.”

Source

A Guy
 

My Computer My Computer

At a glance

Windows 10 Home x64INTEL Core i5-750 Quad-Core 3.37GHzHyperX Fury Black Series 8GB (2 x 4GB) 1866MhzEVGA GeForce GTX 750 Superclocked 1GB 128-Bit...
Computer type
PC/Desktop
OS
Windows 10 Home x64
CPU
INTEL Core i5-750 Quad-Core 3.37GHz
Motherboard
ASUS P7P55D
Memory
HyperX Fury Black Series 8GB (2 x 4GB) 1866Mhz
Graphics Card(s)
EVGA GeForce GTX 750 Superclocked 1GB 128-Bit GDDR5
Monitor(s) Displays
LG 32MA68HY 32" IPS
Screen Resolution
1920 x 1080
Hard Drives
Samsung 840 Evo 120GB, SEAGATE 500GB Barracuda® 7200.12, SATA 3 Gb/s, 7200 RPM, 16MB cache
PSU
ANTEC TruePower New TP-550, 80 PLUS, 550W
Case
ANTEC Three Hundred Illusion
Cooling
COOLER MASTER Hyper 212 Plus, 4 x 120mm 1 x 140mm Noctua's
Internet Speed
85 + Mbps
Antivirus
Avast
Browser
Vivaldi
FCAT sounds more like what you'd use to benchmark the internet.

...I'll show myself out now.
 

My Computer My Computer

At a glance

Windows 7 Ultimate x64 SP1Intel Core i7 2700K @ 3.5GHz (TurboBoost disa...16GB (4x4GB) Kingston HyperX DDR3 1600MHz @ 1...Nvidia EVGA GeForce GTX 1060 6GB
Computer type
PC/Desktop
Computer Manufacturer/Model Number
N/A (custom-built)
OS
Windows 7 Ultimate x64 SP1
CPU
Intel Core i7 2700K @ 3.5GHz (TurboBoost disabled)
Motherboard
ASUS P8Z68-V/GEN3
Memory
16GB (4x4GB) Kingston HyperX DDR3 1600MHz @ 1333MHz
Graphics Card(s)
Nvidia EVGA GeForce GTX 1060 6GB
Sound Card
Realtek High Definition Audio (motherboard integrated)
Monitor(s) Displays
NEC Multisync EX231W
Screen Resolution
1920x1080 @ 60Hz via DVI-D
Hard Drives
2x Western Digital 1TB SATA3 Caviar Black Internal HDD // 1x WD 500GB USB 3.0 "My Passport Essential" External HDD // 1x WD 1TB USB 3.0 "My Passport Essential" External HDD // 2x WD 2TB USB 3.0 "My Passport Essential" External HDD
PSU
Corsair Professional Series Gold AX850
Case
Antec 300
Cooling
Air-cooling
Keyboard
Steelseries 6Gv2
Mouse
Steelseries Sensei RAW Glossy, Logitech M500
Internet Speed
DSL (AT&T)
Antivirus
Microsoft Security Essentials
Browser
Pale Moon, Mozilla Firefox 12, Opera 12, Chromium, IE9
Other Info
Virtual Machines (VirtualBox):
* Japanese Windows XP Professional SP3
* Japanese Windows 7 Professional SP1
That's why the ATI jittering problem went unfixed for so long. FPS were high, so it didn't really measure how uneven the frame rate was.
 

My Computer My Computer

At a glance

Windows 8 Pro (32-bit)1.83GHz Intel Core Duo2GB 667MHz DDR2 SDRAM (PC2-5300) (upgrade)ATI Radeon X1600 with 128MB GDDR3 memory
Computer type
PC/Desktop
Computer Manufacturer/Model Number
Apple 17" iMac MA199LL (Early 2006)
OS
Windows 8 Pro (32-bit)
CPU
1.83GHz Intel Core Duo
Memory
2GB 667MHz DDR2 SDRAM (PC2-5300) (upgrade)
Graphics Card(s)
ATI Radeon X1600 with 128MB GDDR3 memory
Monitor(s) Displays
17-inch TFT active-matrix LCD, millions of colors
Screen Resolution
1440 x 900
Hard Drives
Hitachi 320GB HDT721032SLA360 7200RPM SATA II (upgrade)
Keyboard
Microsoft Wired Keyboard 600
Mouse
Microsoft Basic Optical Mouse v2.0
Internet Speed
4 Mbps
Antivirus
Microsoft Security Essentials
Browser
Google Chrome
Other Info
WEI:
Base Score: 3.9 Processor: 4.4 Memory 4.7
Graphics: 3.9 Gaming Graphics: 4.1 Primary HD: 5.9
It's one of the reasons I ditched my 5970 and went to a single 580 back in the day. Traded raw for smooth.

Raw fps really counts for nothing when it's jittery. It'd rather 30 smooth than 60 jerky.
 

My Computer My Computer

At a glance

8 Pro x64i7 3770K 4.6GHz16GB G.Skill Trident X 2666mhzx2 EVGA 780 Ti Superclocked SLI
Computer type
PC/Desktop
Computer Manufacturer/Model Number
Systems by SmartEyeball
OS
8 Pro x64
CPU
i7 3770K 4.6GHz
Motherboard
ASUS P8Z77 WS
Memory
16GB G.Skill Trident X 2666mhz
Graphics Card(s)
x2 EVGA 780 Ti Superclocked SLI
Sound Card
SB X-FI Surround 5.1 PRO USB / ATH-AD900 Headphones
Monitor(s) Displays
x3 Dell U2410 / 58" Samsung
Screen Resolution
5760*1200/ 1920*1200
Hard Drives
2x Intel 520 240GB (RAID 0) * 2x WD Caviar Blacks 2TB (RAID 0) * 2TB WD Caviar Black * Sony Optirac DVD
PSU
Silverstone Strider Evolution 1200W
Case
Thermaltake Level 10 GT Snow Edition
Cooling
Noctua NH-D14
Keyboard
Topre Realforce // Ducky Shine MX Black // Filco Ninja TKL
Mouse
Thermaltake Theron (Highly Recommended) + Razer Imperator
Antivirus
MSE
Browser
IE, FF, WaterFox
Other Info
GT Extreme V2 Sim Racing Cockpit + 40" LCD and K/B Mouse stand ▼
Fanatec CSR Elite Wheel + Clubsport V1 Pedals + CSR shifter/7G-H ▼Saitek X52 Pro ▼ TrackIR 5 Pro
Buttkicker v2 Seat Rumbler with Dedicated 5.1 and Sub Woofer attached to frame ▼
=
Bloody Big Grin
I'm with smartyeyeball on this, frame rate means nothing if there is jitter, my single 580 is still smooth as glass playing Crysis 3 high settings.
 

My Computer My Computer

At a glance

Windows 7 Ult, Windows 8.1 Pro,Q9650-4.275GHz, E8600 4.5GHz, E6750-3.8GHzG.Skill PC2 9600 1200Mhz 5 5 5 15 2TGTX480
Computer type
PC/Desktop
Computer Manufacturer/Model Number
Home built
OS
Windows 7 Ult, Windows 8.1 Pro,
CPU
Q9650-4.275GHz, E8600 4.5GHz, E6750-3.8GHz
Motherboard
Evga 780i FTW
Memory
G.Skill PC2 9600 1200Mhz 5 5 5 15 2T
Graphics Card(s)
GTX480
Sound Card
Asus Xonar D2
Monitor(s) Displays
HannsG
Screen Resolution
1680X1050
Hard Drives
GSkill Phoenix Pro 120GB SSD
PSU
ThermalTake Toughpower 1000Watt modular
Case
ThermalTake XaserV
Cooling
Xigmatek S1283
Keyboard
Logitech G15
Mouse
Logitech G9
Internet Speed
T1
Back
Top