News from February 2017

New VRMark and Servermark benchmark tests for 2017

February 27, 2017

We're attending two of the year's biggest industry events this week. Mobile World Congress, a huge show focused on all things mobile, takes place in the beautiful city of Barcelona. The Game Developers Conference, in San Francisco, is the place to go to learn about the latest developments in game design and technology. We have teams at both shows giving demos of some of the new benchmarks we're currently working on. Read on to find out more.

VRMark Cyan Room - a new DirectX 12 benchmark for VR

VRMark Cyan Room VR benchmark test

VRMark Cyan Room, currently in development, is a new DirectX 12 benchmark test for Windows PCs. Sitting between the Orange and Blue Rooms, the Cyan Room benchmark shows how using an API with less overhead helps developers create impressive VR experiences on modest PC systems. As with the existing VRMark tests, you can run the Cyan Room benchmark on your monitor or on a VR headset. Run the benchmark to measure performance or try Experience mode with an HMD to judge a system's rendering quality with your own eyes.


New VRMark benchmarks for mobile VR

VRMark benchmarks for mobile VR devices

Mobile VR offers an affordable entry point for virtual reality, but differences in device performance and a rapidly evolving ecosystem present significant challenges. That’s why VRMark will soon add new benchmark tests designed specifically for mobile VR platforms.

The new tests cover a range of existing and emerging device standards such as Google Daydream, Google Cardboard, and Samsung Gear VR. Two test modes let you measure a device's peak performance as well as its ability to run VR for longer periods without overheating, degrading performance or consuming an excessive amount of battery.


Comprehensive VR latency testing

VRMark OptoFidelity VR latency testing

In virtual reality, low latency is essential for user comfort. Poor performance affects the quality of the VR experience. It can even cause motion sickness and nausea.

Futuremark has partnered with OptoFidelity, a globally recognized pioneer in robot-assisted testing and quality assurance, to provide manufacturers with an advanced VR latency testing platform. The platform offers end-to-end testing of VR equipment while measuring key VR performance indicators such as motion-to-photon latency, pixel persistence, and frame jitter. The solution works with PCs and mobile devices and can be applied to both VR and AR systems.



Servermark benchmark test for IT professionals

Servermark is a new benchmark suite for testing server performance for a range of common uses. At GDC and MWC, we're showing previews of two Servermark benchmark tests.

Servermark VDI is a benchmark for evaluating servers used for Virtual Desktop Infrastructure. It enables you to determine the number of virtual desktops a server can support at a set performance level or the level of performance that can be achieved with a set number of clients.

Servermark Media Transcode is a benchmark for testing the performance of media servers. It helps you determine the maximum number of concurrent video streams a server can deliver with a specified codec, resolution and quality.


Futuremark at GDC

You’ll find us on Futuremark stand 142 from March 1 to March 3.

Futuremark at MWC

At Mobile World Congress, we’ll be showcasing VRMark and Servermark in Hall 7 on the UL stand, which is labeled 7K40 on the floor plan from February 27 to March 2. If you are interested in the VR latency testing, please visit the OptoFidelity stand, 5C43, in Hall 5.

Futuremark and OptoFidelity partner to create VR latency test

February 22, 2017

Next week, at Mobile World Congress and GDC, Futuremark and OptoFidelity will be jointly showing a comprehensive new VR latency testing platform for HMDs and mobile devices. 

The platform, which combines Futuremark's expertise in benchmarking software with OptoFidelity's expertise in robotics, measurement technology, automation, and hardware, will be on display at Mobile World Congress from February 27 to March 2 on stand 5C43 in Hall 5 and at GDC from March 1 to March 3 on stand 142.

In virtual reality, low latency is essential for user comfort. Poor performance affects the quality of the VR experience. It can even cause motion sickness and nausea.

The VR latency testing platform developed by Futuremark and OptoFidelity offers end-to-end testing of VR equipment. It measures key VR performance indicators such as motion-to-photon latency, pixel persistence, and frame jitter. The universal design of the platform means it works with PCs and mobile devices and can be applied to both virtual reality and augmented reality systems.

The platform pairs VRMark, the virtual reality benchmarking suite from Futuremark, with OptoFidelity's VR Multimeter HMD solution. One of the key test cases measures motion-to-photon latency in a 3D rendering scenario. The test exerts full control over the VR pipeline to quantify the impact of CPU and GPU performance for VR applications. The benchmark analyses each frame to reveal the sources of latency, showing time spent in the 3D engine, the VR API, and the GPU. With detailed reporting, you can study late frames and the effects of timewarp. Configurable settings help you evaluate latency under different CPU and GPU load conditions.

VRMark Blue Room Benchmark

Screenshot: VRMark, the virtual reality benchmark

The test platform uses OptoFidelity's VR Multimeter HMD solution. It is an end-to-end, non-intrusive solution that measures the true performance of VR headsets and hardware. With the OptoFidelity VR Multimeter HMD, you can objectively analyze key indicators of VR performance such as motion-to-photon latency, display persistence, and frame jitter. You can even measure audio to video synchronization and motion-to-audio-latency.

OptoFidelity VR Multimeter HMD

Photo: OptoFidelity VR Multimeter HMD

The solution offers two hardware designs, one for full HMD testing, and another for mobile device VR testing. With additional modules, the platform can also test AR solutions. The platform hardware features high-accuracy mechanics that allow precise motion control and a high level of repeatability in testing. Test sequences can be fully automated for continuous integration testing.

Why VR latency matters

A key strength of the test platform is the ability to make true end-to-end performance measurements of the motion-to-photon latency of VR equipment. Motion-to-photon latency is the time needed for movement of a VR headset to be fully perceived on the headset's display. 

Low motion-to-photon latency (< 20ms) is necessary to create the feeling of presence, the feeling that you are actually in the virtual world. High motion-to-photon latency results in a poor virtual reality experience. When the screen lags behind the user's movement, it can result in disorientation, motion sickness, and nausea. 

To provide the best VR experience for the user, every component in the motion-to-photon pipeline needs to be optimized. That's why measuring motion-to-photon latency is superior to testing application-to-photon latency, which misses the important effects of delays caused by the tracker/gyroscope and issues in communication between the tracker/gyroscope and the VR application.

Comprehensive measurements and reporting

The solution enables end-to-end measurements of key VR performance indicators. 

  • Motion-to-photon latency
  • Pixel persistence
  • Frame Jerkiness and jitter
  • Dropped and duplicated frames
  • Left versus right eye frame delay
  • Audio/Video synchronization
  • Motion-to-Audio Latency
  • Frame time breakdown identifying key pipeline events
  • Study late frames and the effects of timewarp
  • Evaluate latency under different load conditions

Combining Futuremark's benchmarking knowledge with OptoFidelity's hardware know-how, the VR latency testing platform is the perfect tool for R&D design verification and certification, test laboratory use, and competitor analysis. It produces reliable and repeatable results quickly and with minimal setup time. You can transfer all measurement data into your own test software and design database for complete analysis, or save and download results to your computer. Testing is easily automated with an API option, which enables the platform to be used as part of a continuous integration process.

See it at Mobile World Congress and GDC

Companies and organizations interested in VR latency testing are invited to see the solution in action at Mobile World Congress on stand 5C43 in Hall 5 from February 27 to March 2 and at GDC on stand 142 from March 1-3. Those unable to attend either show are welcome to contact us directly for further details.



UL and the UL logo are trademarks of UL LLC © 2018 All Rights Reserved.  |   Privacy Policy  |  Cookie Policy  |  Terms and conditions