Benching Methodology

Benchmarking Methodology

Test Configuration – Hardware

  • Intel Core i9-9900K (Hyper-Threading/Turbo boost on; stock settings)
  • Gigabyte Z390 AORUS PRO motherboard (Intel Z390 chipset, v.F9 BIOS)
  • Kingston HyperX Predator 32GB DDR4 (2×16GB, dual-channel at 3333 MHz CL16)
  • Gigabyte AORUS GeForce RTX 3080 MASTER 10GB (rev. 1.0); v.F2 VBIOS, stock clocks
  • Samsung 500GB SSD 960 EVO NVMe M.2
  • Corsair RM750x, 750W 80PLUS Gold power supply unit
  • ASUS ROG Swift PG279Q 27″ IPS 2560 x 1440 165Hz 4ms G-Sync Monitor (G-Sync off, Fixed Refresh Rate on)

Test Configuration – Software

  • NVIDIA GeForce 461.40 drivers; ‘high-quality’ and ‘prefer maximum performance’; fixed refresh rate (globally).
  • V-Sync application controlled in the control panel, V-Sync off in-game.
  • AA and AF controlled by the application, set according to video quality game presets
  • Windows 10 64-bit Pro edition, latest updates v20H2, High-performance power plan, Game Mode, Game DVR & Game Bar features off.
  • GIGABYTE tools not installed.
  • Latest DirectX
  • CapFrameX (CX), the latest version
  • RivaTuner Statistics Server (RTSS), latest version

Custom Scene Benchmark-related

  • We use two different custom scenes to benchmark the game’s graphics performance in single-reality and dual-reality scenarios:
    • Single-reality: First three rooms walk-through (recording time, 41 seconds).
    • Dual-reality (split-screen): Corridor to Dayroom walk-through (recording time, 41 seconds).

Frametimes Capture & Analysis tool-related

  • CapFrameX is used for capturing and analyzing the relevant performance numbers obtained from each recorded custom benchmark scene.
  • Consecutive runs until detecting 3 valid runs (no outliers) that can be aggregated by CapFrameX using the following method:
    • ‘Aggregate excluding outliers’:
      • Outlier metric: Third, P0.2 (0.2% FPS percentile).
      • Outlier percentage: 3% (the % the FPS of an entry can differ from the median of all entries before counting as an outlier).
  • We compare and value the results and aggregated records in terms of performance gain/loss, by looking at the following metrics:
    • Avg FPS
    • P1/P0.2/0.1% Low integral FPS
    • Adaptive STDEV (the standard deviation of values compared to moving average) as an additional or alternative criterion when valuing frame times consistency.

Let’s head to our performance charts.

Contents

LEAVE A REPLY

Please enter your comment!
Please enter your name here