PerformanceTest 10 Version History


V10.1 Build 1000 - 23rd/February/2021

  • Initial release for Windows ARM support. All CPU, 2D, Memory and Disk tests have been natively compiled to run on Windows ARM.
    For 3D tests, due to limited support for some older DX9 and DX10 helper libraries these tests have not been converted and will not be run in the Windows ARM version of PerformanceTest.
    The DX11 test will be run in x86 emulated mode, again due to limited support for some of the DirectX libraries used for them. The DX12 test has been compiled to run natively.
    For the 3D GPU compute tests, the Nbody gravity, Mandelbrot and Qjulia4D have been compiled to run natively on Windows ARM. The OpenCL test cannot be run on Windows ARM.
  • Score display, due to incredibly slow values for some 2D/3D results on Microsoft Surface ARM systems, now when a score is less than 10 the score will be displayed to 1 decimal place.
  • Started filtering "with" out of some CPU names when dynamically creating a Radeon graphics card name (eg Radeon Graphics Ryzen 9 4900HS)
  • Baseline custom colours, changed the default yellow to a darker shade for better readability of white text when it is drawn over the graph
  • Fixed a crash that could occur in the disk test

V10.0 Build 1011 - 29th/January/2021

  • Stopped user interface resizing when 3D tests were running, sometimes during the start of DX10 test a resize message would get sent to PT which would fail and display a "Could not reset the Direct3D device" error
  • Fixed an issue where is a drive tested was bitlocker encrypted then PerformanceTest might not match the partitions to the physical disk and display "Unknown drive"
  • Fixed a possible crash when viewing graphs
  • Temperature collection, added support for Intel Tiger Lake chipsets
  • Temperature collection, initial support for AMD Ryzen 5000 Series (Family 19h) CPU info and temperatures
  • Temperature collection, support for CPU groups when retrieving per-core temperatures for Intel chipsets
  • System information, Decreased timeout from 5 seconds to 1 when collection SMART information when waiting for scsi commands to timeout (decrease amount of time spent detecting temp sources and reading smart info when USB drives are attached)

V10.0 Build 1010 - 12th/October/2020

  • Fixed an issue generating as 2D mark in windows 7 (due to not being able to run PDF and SVG tests)
  • Fixed a possible crash when loading advanced test result graphs
  • Fixed a crash that could occur when resizing the user interface when no baselines were selected
  • Disabled old DirectWrite code path for fonts and text test as it could crash when it tries to fall back to it (eg when a default Microsoft VGA driver is installed)

V10.0 Build 1009 - 9th/September/2020

  • Updated internal YAML library used for baselines and test results
  • Baselines, fixed an issue where there were two instances of b48BitAddressSupported in the SMART info which would break YAML parsing
  • Baselines, fixed an issue where there were two instances of iComputeUnits in the video card info which would break YAML parsing
  • Baseline chart user interface, increased size of chart buttons
  • Baseline chart user interface, move gauge/distribution chart buttons to bottom right of chart
  • System Information, added support for NVMe drives behind USB-NVMe bridge (eg JMicron JMS583, Realtek RTL9210, ASMedia ASM2362)
  • System Information, added naming support for AMD Ryzen 5/7/9 4000 series integrated graphics
  • System Information, fixed a security issue with DirectIO device driver that runs as part of system information collection. Hypothetical exploit was possible that allowed user to bypass operating system restrictions & install arbitrary software. But user would already need to be the elevated Admin user on the local machine to take advantage of exploit. So overall additional risk is low. No usage of this exploit has been seen in the field. New DirectIO version is V13.0

V10.0 Build 1008 - 6th/August/2020

  • System Information, fixed a security issue with DirectIO device driver that runs as part of system information collection. new DirectIO version is V12.4
  • Advanced Disk Test, added 16MB, 32MB, 16GB and 32GB options to test file sizes
  • Increased main window default size slightly to show all elements correctly

V10.0 Build 1007 - 1st/July/2020

  • Advanced memory test, Fixed graphing button not being disabled for latency test in some instances (no graphs available for latency test)
  • Memory test, Database operations, limited max amount of test threads to 32 for this test due to timeouts
  • 2D Test, Direct2D, fixed a possible situation where the test could return a 0 score when not running at the default resolution
  • 2D Test, Direct2D, fixed a penalty calculation error that could result in a score of 0
  • PDF Test, fixed a bug that was preventing the test running on windows 8.1
  • PDF Test, fixed a bug where the PDF test was attempting to run in windows 8 while the minimum supported was 8.1
  • Allowed 2D mark to be generated if missing 1 test (eg windows 8.1 but still failing to run the SVG test)
  • Stopped 2D tests setting flag for no DX11 support, windows 8.1 systems with Dx11 support may still fail the SVG test
  • Fixed crash that could occur in primes test when run on a single core single threaded CPU
  • Fixed a BSOD on startup when running using QEMU

V10.0 Build 1006 - 23rd/April/2020

  • Fixed a BSOD when running in an Amazon EC2 instance
  • Changed cross platform mark to use the best result out of the normal primes test and a primes test limited to physical cores

V10.0 Build 1005 - 17th/April/2020

  • Save as text, added an option to include system information when exporting to tab and semi-colon format text.
  • 2D Tests - Fonts and text, fixed a possible crash when the test setup fails.
  • Added encryption sub test results (AES, SHA256, ECDSA) to baseline file.
  • Cross platform mark, made some changes so a second primes test is run that is restricted to only physical cores and this score is what is used for the cross platform mark.
  • No longer generating a cross platform mark for old (V9/V8) baselines when they are loaded due to the above changes.

V10.0 Build 1004 - 16th/March/2020

  • CPU Test - Compression test, made some changes to increase speed of compression test. The test compresses random data. But it was observed that the generation of random data was taking a large portion of the test execution time. Investigation showed recent Windows patches slowed down the performance of the standard Rand() function. Microsoft are also discouraging its use for other reasons. So we switched to using std::minstd_rand. The test now spends more time compressing data and less time creating random test data.
  • CPU Test - Single thread test, due to changes in the compression test the single thread test will now be slightly higher as the compression test is part of the single threaded test. This also goes some way to addressing concerns that some AMD CPUs were performing below expectations in the single threaded test. (minstd_rand is slightly faster on some AMD chips than Rand)
  • CPU Mark - due to compression and single threaded test changes the CPU mark has been rebalanced for these changes. The single thread test is now weighted slightly more than the other tests.
  • Advanced Network test - Fixed a bug preventing the TCP server thread starting correctly so the TCP test would stop after a few seconds. This was due to a bug in the RIO support implmentation.

V10.0 Build 1003 - 13th/March/2020

  • Histogram charts, fixed some issue loading V10 charts, fixed some missing charts for new tests.
  • Baseline manager, fixed a crash that could occur when there were no CPU/GPU model names loaded from the chart data
  • Started adding PT8 or PT9 flags to all old V8 and V9 baselines when an individual test result is displayed
  • Install to USB, fixed a missing subfolder from the media folder that was not being copied to the USB correctly

V10.0 Build 1002 - 9th/March/2020

  • CPU tests, Single Threaded, started scaling single threaded score down to be closer to PT9 for better comparability with older results.
  • 2D Tests, 2D Image Rendering, changed score displayed to thousand images/sec instead of images/sec for better readability.
  • Fixed drag and drop on main window of loading of baselines not working
  • Fixed an issue for the test status window, when running a single CPU test it was not correctly displaying the test that was running

V10.0 Build 1001 - 5th/March/2020

  • Score rebalancing
    • Due to the large amount of changes made to the 2D/3D/CPU/Disk tests all the calculated mark values have been rebalanced and scaled to be similar (but not exactly the same) to that of PerformanceTest 9.
    • Individual test scores have not been scaled so a direct comparison cannot be made in many cases between version 9 and version 10.
  • Windows Support
    • No longer supporting Windows versions older than Vista.
  • Compiler updates
    • We have switched from using Visual Studio 2013 (for V9) to Visual Studio 2019 for V10. Newer compiler versions typically bring improved code optimisation and use of newer CPU instructions.
  • CPU Tests
    • Enabled compiler optimisations for the CPU tests that had previously been disabled. This has resulted in better performance on newer CPUs when compared to older ones.
    • Compression Test, replace with a new version that uses the Cypto++ Gzip library. Previous versions of PerformanceTest were using a Adaptive encoding algorithm, which gave good compression rates on text, but was't in common use. Zip is the defacto standard for real world data compression.
    • Encryption test, removed Salsa and TwoFish from the sub tests that are run and replaced them with an ECDSA (Elliptic Curve Digital Signature Algorithm) sub test. Previously PerformanceTest V9 had 4 sub-tests. These were, TwoFish, AES, Salsa20 & SHA256. Now we have three sub-tests. AES, ECDSA & SHA256. These are all algorithms that are heavily used in the real world.
    • Extended Instructions (SSE), added an AVX512 test (when available). AVX512 are a new set of CPU instructions that are in newer CPUs.
    • Extended Instructions (SSE), fixed a pointer math issue in the test that was referencing incorrect memory locations. Accessing the correct data helped with data alignment and improved test throughput.
    • Extended Instructions (SSE), made some changes to the SSE/AVX/FMA tests for how the results are retrieved and stored for next calculation loop (using _mm_storeu_ps and mm256_storeu_ps).
    • Extended Instructions (SSE), removed custom aligned vector/matrix class and switched to standard vector/matrix class. Changed how matrix data is loaded before test (using _mm256_broadcast_ps).
    • Integer Math, made some changes to add better support for out of order execution. This makes the algorithm less linear and gives modern CPUs the change to get more calculations done in parallel.
    • Added a Cross-platform mark to the CPU test, made up of the Integer, Floating point, sorting and prime test scores. This will be calculated when loading a V9 baseline in V10 if the required scores are available. This cross platform score is not used when generating the overall CPU mark as it based on previously run tests. We envisage that we'll use these results in the future for cross platform comparisons (x86 PCs vs ARM based mobile devices).
    • Physics test, updated Bullet physics engine to version 2.88. Previously we were using 2.83.
  • 2D Tests
    • Added a new SVG (Scalable Vector Graphics) image rendering test that will open and display several SVG images.
    • Added a new “PDF Render” test that will open a PDF and scroll through the available pages.
    • Changed default test size to 1920 x 1080. This should place more load on the video card than was previously the case so frame rates are lower across the board compared to V9. Tests will scale down in size to 1024x768 and a penalty will be applied and will not run at lower resolutions than this.
    • Direct 2D, increased amount of objects displayed during test.
    • Windows Interface test, increased size of dialog and number of controls on dialog.
    • Image Filters and Image Rendering, added DX11 versions of this test. Results are a combination of old and new tests.
    • Due to these updates scores and the 2D mark value in older versions of Windows (eg Windows 7) will be far lower as it isn't possible to scale meaningfully when multiple tests can't be run.
    • Complex vectors, removed this test as it has been replaced by the new SVG test and is no longer relevant
    • Direct2D SVG Test, changed test for better consistency over different test lengths. Less image are part of the test but each one will be displayed at least once. Due to more complex images being displayed the test results will be lower than in the initial release.
  • 3D Tests
    • DX9, changed default resolution to 1920x1080, test will be scaled down and a penalty applied if it cannot be run at this resolution.
    • DX9, increased default Anti Aliasing level to 8, changed skybox and number of objects in scene. This was done with the aim of making the test less CPU bound.
    • DX10, increased default resolution to 1920x1080, test will be scaled down and a penalty applied if it cannot be run at this resolution. This adds load to the video card.
    • DX10, increased number of islands and meteors during test.
    • DX10, fixed a bug when enumerating display modes for the DX10 test where no compatible card would be found if there was a large amount (>500) of display modes.
    • GPU Compute, replaced the Bittonic sort test with an NBody Gravity test. Nobody knew what a Bittonic sort was or how it applied to the real world. NBody simulations on the other hand are a fairly common scientific application and they make a good visual impact.
    • GPU Compute, increased default size for sub tests to 1920x1080.
    • GPU Compute, OpenCL test, made some changes to particle size and variables used for calculations so more is happening during the test.
    • GPU Compute, Mandelbrot test, increased number of iterations 10x to slow down the test execution.
    • Started allowing ”Microsoft RemoteFX Graphics Device” for 3D support on some VMs.
  • Memory Tests
    • Increased amount of memory that non-cached tests use to 512MB of RAM (up from 256MB).
    • Database Operations, changed to use an in memory sqlite3 database based on SQLite 3.31.1. Will run for maximum available physical cores and use at least 128MB RAM per thread.
    • Threaded, changed to run a range of threads up the maximum available (eg 2, 4, 8, 16 or 3, 6, 12 depending on available core count) and use highest score. Amount of RAM used will depend on number of threads, <= 16 threads 512 MB, <=64 threads 1 GB, > 64 threads 2 GB.
    • Threaded and Database operations, added support for processor groups and thread affinity.
    • Latency test, now will take measurements based on 16KB, 64KB and 8MB ranges (previously was just 64KB) and use the average value of the three tests for the score. This will give a broader range of samples and will result in higher latency figures than PT9.
  • Disk tests
    • Changed name of “Random Seek” test to “32KQD20” to better represent the test (using 32K block size with a queue depth of 20).
    • Added a new “4KQD1” test (using 4k block size with a queue depth of 1).
    • Increased test files size to 400MB for write test, 800MB for read test (traditional hard drive). If drive is an SSD then it is 1GB for write test and 2GB for read test.
    • Removed the CD test
  • Advanced Physics Test
    • Added option to allow resolution to be selected.
    • Updated Bullet physics engine to version 2.88. Previously was using 2.83.
    • Added message check on exit to stop "not responding" when closing while using a large number of objects.
  • Advanced Network Test
    • Added threading, Windows RIO (Registered Input/Output API Extensions) sockets option. These changes were made to achieve higher throughput & lower latency, particularly on 10Gb+ networks. You should now be able to really push the limits of your networking gear with these changes.
  • Advanced Disk Test
    • Made some changes to try and stop crashes during the advanced disk IOPS test when the hard drive is failing/responding abnormally.
    • Added temperature collection to test results. Can now choose to display the temperature or the latency heat map when displaying a graph. This has become important as some SSDs throttle down their speed under high temperatures.
  • Advanced Memory Test
      Added "Threaded" test option to advanced memory test, currently will run the threaded memory test starting with 1 thread up to (Cores * Threads per core) threads. Each test loop is repeated 3 times and the best result stored.
    • Now opens graph automatically at end of testing.
    • Updated latency test to use same settings as standard test, running random range latency test for 16KB, 64Kb and 8MB ranges and then averaging the results.
  • NEW Advanced CPU Test
    • Added an advanced CPU test, this allows individual CPU tests to be run from 1 thread up to a specified number of threads and then the results graphed.
  • NEW Advanced Internet Speed test
    • Added an implementation of M-Labs ( internet speed test that will connect to their servers, performance a 10 second upload test, a 10 second download test and then display the results from that test.
  • Baseline management
    • Re-enabled choosing of colours for loaded baselines, this will only affect the bar graph colour of the baseline and the text colour will not change.
  • Localisation
    • Added a section in the installer to allow selection of a supported language, on install first launch PT will now choose that language by default.
  • Reporting
    • Added percentile options to exported text, formatted text and HTML reports.
  • Baseline Management
    • Added a way of tracking submitted baselines and displaying them in the advanced baseline management dialog under the “Uploaded” tab.
  • Scripting
    • Added SETRERUNRESULT to toggle re-run config setting. Choose between keeping BEST and NEW result when re running tests.
    • Added HIDEBASELINES option to only add current computer results to exported results files.
    • Added CPU_RUNTEST and ACPU_SETEXPORT commands for scripting the advanced CPU test.
    • Changed "Result Date" to be local time instead of UTC for consistency (windows install time was already local time).
    • HTML report output, fixed a bug where the Unicode BOM was not being correctly written to the start of the file if the file was opened in append mode and didn't already exist.
    • Removed 2 extra line breaks being added at end of records for REPORTSUMMARYCSV command.
  • Misc
    • Chart display, added percentage difference to baselines when a score the "this computer" is available. Also added option in the preferences to enable/disable.
    • Fixed an incorrect error message in the advanced drive performance test when a selected disk did not have enough free space.
    • Fixed a bug when saving results to an image, the scrollbar width was being applied and causing some result to be hidden.
    • Added a gray rectangle to custom list view header so the boundary that can be used to resize the columns is highlighted
    • System information, Changed ram details in baseline system info to display in GB.
    • Now displaying "Baseline #X" instead of just "#X" on system information window for loaded baselines.
    • Report exports, added BIOS version and hard drive size as a separate field to the exported report system information.
    • User Interface, Made back/prev/next buttons in 3D component info view slightly lighter so they stand out more.
    • No longer displaying PNP ID on Video card system info display.
    • Fixed some preferences dialog alignments.
    • CSV export, fixed an issue where multiple "unknown disk" entries could be output and change column ordering.
    • Fixed baseline display link after submission still showing V9 and not new V10 link.
    • Excluded the "Cross platform mark" from the status window display when running all CPU tests (as this is calculated after all test have been run rather than a separate test).

V10.1 Build 1000 - 3rd/March/2021

  • First stable release of Linux and Mac version of PerformanceTest CPU test suite
  • CPU tests and scores finalized

V10.0 (Beta) Build 1002 - 16th/February/2021

  • Initial release of Mac version with support for both x86 and ARM CPU's
  • Fixed some minor display errors
  • Fixed error that could cause encryption test to fail on some machines

V10.0 (Beta) Build 1001 - 29th/January/2021

  • Initial beta release of PerformanceTest for Linux systems as a command line utility
  • Support for both x86 and ARM CPU's (ARMv7 and ARMv8)
  • Only CPU tests available, remaining tests still in development.
  • Results and scores are preliminary and subject to change

V10.0 Build 1001 - 9th/February/2021

  • PerformanceTest Mobile V10 released for iOS
  • Fixed crashing on x86 Chromebooks during CPU encryption test

V10.0 Build 1000 - 29th/January/2021

  • PerformanceTest Mobile V10 (yes, we skipped some version numbers) has been updated to run the same CPU tests as the desktop PerformanceTest V10 software
  • The CPU Rating* (i.e. CPU Mark) can now be used to compare directly with other CPUs on website
  • *Note: ONLY CPU Tests are comparable cross-platform to other versions of PerformanceTest 10
  • Work on porting other test suites for cross-platform comparability is ongoing

Legacy Version History

Update history for PerformanceTest Windows versions 1 to 9 is available here: Legacy Windows Version History