When the Samsung Galaxy S4 was released, Ars Technica reported that Samsung were inflating the benchmark scores on the device, and now apparently it is happening again on the Samsung Galaxy Note 3.
According to Ars Technica, Samsung is artificially boosting the US Samsung Galaxy Note 3 benchmarks scores. This is apparently done with a high power CPU mode that is activated when certain benchmarking apps are used on the device. This practice has raised concerns among tech enthusiasts and consumers alike, as it can mislead users about the actual performance capabilities of the device.
After a good bit of sleuthing, we can confidently say that Samsung appears to be artificially boosting the US Note 3’s benchmark scores with a special, high-power CPU mode that kicks in when the device runs a large number of popular benchmarking apps. Samsung did something similar with the international Galaxy S 4’s GPU, but this is the first time we’ve seen the boost on a US device.
Understanding Benchmark Manipulation
Benchmark scores are often used by consumers to compare the performance of different devices. These scores are generated by running specific applications that test various aspects of a device’s hardware, such as its CPU, GPU, and memory. Higher scores generally indicate better performance. However, if a manufacturer artificially inflates these scores, it can give a false impression of the device’s capabilities.
In the case of the Samsung Galaxy Note 3, the high power CPU mode that boosts benchmark scores does not reflect the device’s performance during regular use. This means that while the Note 3 may appear to outperform other devices in benchmark tests, its real-world performance may not be as impressive.
The guys from Ars Technica managed to disable this high power CPU mode on the Note 3, and you can see the difference between the enabled and disabled mode in the benchmark below.
Implications for Consumers and the Industry
The practice of inflating benchmark scores has several implications. For consumers, it can lead to misguided purchasing decisions. A device that appears to be the best performer based on benchmark scores may not deliver the expected performance in everyday tasks. This can result in dissatisfaction and a lack of trust in the manufacturer.
For the industry, such practices can undermine the credibility of benchmarking as a tool for evaluating device performance. If consumers and reviewers cannot trust benchmark scores, they may turn to other, less standardized methods of comparison. This could make it more difficult for manufacturers to demonstrate the advantages of their devices.
Samsung is not the only company that has been accused of manipulating benchmark scores. Other manufacturers have also been caught engaging in similar practices. This suggests that the issue is widespread and may require industry-wide solutions. One possible approach is for benchmarking organizations to develop more sophisticated tests that are harder to manipulate. Another is for manufacturers to commit to greater transparency in how they achieve their benchmark scores.
You can find out more details over at Ars Technica, it will be interesting to see what Samsung has to say about this. The company has previously defended its practices by arguing that the high power modes are designed to ensure the best possible performance during demanding tasks. However, this explanation may not satisfy all consumers and industry observers.
Source Ars Technica
Latest Geeky Gadgets Deals
Disclosure: Some of our articles include affiliate links. If you buy something through one of these links, Geeky Gadgets may earn an affiliate commission. Learn about our Disclosure Policy.