Benchmarking is gaining popularity these days with leaks of benchmarking results of popular phones and
it has also become an add on for an argument when its between two phones and has boosted up one's confidence while buying a phone if that device performs better in benchmarking.
some go by numbers, while some ignore these results.
What Exactly Is Benchmark Results?
Benchmarking is a gauge to measure the performance of "something" and hence comparing the results with other "things" falling in the same category.These "things" might be anything, It can be a company's output/performance, Petroleum quality, Computer speed and similarly phones.Since phones now are a powerhouse and there is plethora of possibilities that one can do today with a phone, Benchmarking of such phones is natural as user is curious to know how their phone performs against the competiton.
Summarizing, Benchmarking is a standardized tool to measure performance of similar things.
How Does Benchmarking Work?
A device is subjected to a number of process/tasks which are universal and thus the result is declared based on how well the device performs while performing the same. These tasks differ from the tasks you perform on the device daily. There are a number of process that will be performed but some notable processes are raw processor speed, storage access speeds, level of detail, FPS (Frame Per Second), 3D performance and number of polygons that can be drawn in a second.
Is Cheating Possible In Benchmarking?
its natural for a human being to cheat! and some people do cheat so that their device gives a better benchmarking result. its obvious isn't it? when people are gullible about benchmarking and how it works manufactures tend to sell their product by cheating on these results and potraying that their device is x% faster than the other device.
How To Cheat/Inflate The Benchmarking Results?
By rooting and installing custom ROMs or jailbreaking (iOS). Also by increasing memory space, RAM etc.
Sometimes manufacturers overclock the CPU , i.e overclocking a 1.5GHz CPU to run at 1.9 GHz.
So its obvious that the results shown while benchmarking the device is more when the CPU runs at 1.9 GHz than 1.5 GHz. Results depend on number of other factors like cache size, OS running etc
Ars Technica reported that Samsung had written a specific code which was in the file "DVFShelper.java" into the galaxy note 3 which contained a list of benchmarking apps and hence boosting the performance by 20%. This is one of the many marketing "strategies" of Samsung.
Is Benchmarking A Constant Number?
As you can clearly see from the picture, when i ran a AnTuTu benchmark on my HTC one it put up a result of 19170. But in the global rankings the same HTC one is given a better rank. Hence proving benchmarking results are not at all a constant. For instance a freshly rebooted phone performs better compared to a phone which is not rebooted in a long time.
There are several apps to get the job done. Some are OS specific while some are universal/cross platform.
Here is a list of few notable apps.
For Android devices
1) Quandrant standard edition
2) AnTuTu benchmark
3) Vellamo
4) Neocore
Cross platform apps ( iOS and Android )
1) Linpack
2) Geekbench 2
3) SunSpider
4) 3DMark
Concluding, Benchamarking results are not completely reliable but if it is performed several times with different apps and comparing it with phones of same specification then by averaging the results we can get an idea as to how our device performs with the competition.
it has also become an add on for an argument when its between two phones and has boosted up one's confidence while buying a phone if that device performs better in benchmarking.
some go by numbers, while some ignore these results.
What Exactly Is Benchmark Results?
Benchmarking is a gauge to measure the performance of "something" and hence comparing the results with other "things" falling in the same category.These "things" might be anything, It can be a company's output/performance, Petroleum quality, Computer speed and similarly phones.Since phones now are a powerhouse and there is plethora of possibilities that one can do today with a phone, Benchmarking of such phones is natural as user is curious to know how their phone performs against the competiton.
Summarizing, Benchmarking is a standardized tool to measure performance of similar things.
 |
| Quandrant Standard Edition |
How Does Benchmarking Work?
A device is subjected to a number of process/tasks which are universal and thus the result is declared based on how well the device performs while performing the same. These tasks differ from the tasks you perform on the device daily. There are a number of process that will be performed but some notable processes are raw processor speed, storage access speeds, level of detail, FPS (Frame Per Second), 3D performance and number of polygons that can be drawn in a second.
Is Cheating Possible In Benchmarking?
its natural for a human being to cheat! and some people do cheat so that their device gives a better benchmarking result. its obvious isn't it? when people are gullible about benchmarking and how it works manufactures tend to sell their product by cheating on these results and potraying that their device is x% faster than the other device.
How To Cheat/Inflate The Benchmarking Results?
By rooting and installing custom ROMs or jailbreaking (iOS). Also by increasing memory space, RAM etc.
Sometimes manufacturers overclock the CPU , i.e overclocking a 1.5GHz CPU to run at 1.9 GHz.
So its obvious that the results shown while benchmarking the device is more when the CPU runs at 1.9 GHz than 1.5 GHz. Results depend on number of other factors like cache size, OS running etc
Ars Technica reported that Samsung had written a specific code which was in the file "DVFShelper.java" into the galaxy note 3 which contained a list of benchmarking apps and hence boosting the performance by 20%. This is one of the many marketing "strategies" of Samsung.
Is Benchmarking A Constant Number?
 |
| HTC one benchmark result |
As you can clearly see from the picture, when i ran a AnTuTu benchmark on my HTC one it put up a result of 19170. But in the global rankings the same HTC one is given a better rank. Hence proving benchmarking results are not at all a constant. For instance a freshly rebooted phone performs better compared to a phone which is not rebooted in a long time.
How To Benchmark A Phone?
There are several apps to get the job done. Some are OS specific while some are universal/cross platform.
 |
| AnTuTu Benchmark |
For Android devices
1) Quandrant standard edition
2) AnTuTu benchmark
3) Vellamo
4) Neocore
Cross platform apps ( iOS and Android )
1) Linpack
2) Geekbench 2
3) SunSpider
4) 3DMark
 |
| Vellamo Mobile Benchmark |
Concluding, Benchamarking results are not completely reliable but if it is performed several times with different apps and comparing it with phones of same specification then by averaging the results we can get an idea as to how our device performs with the competition.
No comments:
Post a Comment