Droid ROM Benchmarks *UPDATED 3/22*

[roland0fgilead]

Note: I originally posted this thread on DroidMod.org on 3/20. It would have been posted simultaneously on DroidMod, DroidForums and Alldroid, but account problems have prevented me from posting it here until now.

*UPDATE 3/22*
# Updated benchmarks for Ultimate Droid and CyanogenMod
# Fixed formatting and color code errors

At the suggestion of a few users in the DroidMod IRC channel, I have decided to run
a series of benchmarks on the more popular Droid ROM builds making the rounds these
days. I will try to be as comprehensive as possible with these benchmarks. All ROMs
will be tested with CPU Benchmark, Linpack and SetCPU. They will be tested AS-IS
with default settings and kernels at STOCK SPEED with no added applications (aside
from the benchmarking software of course). After a 5-minute wait after each boot, I
shall run a series of benchmarks with each program at regular intervals of 30
seconds for 2.5 minutes. ROMS being tested include:

ChevyNo1's Simply Stunning 2.0.3
blackdroid's Ultimate Droid v7.8
Koush's CyanogenMod port 5.0.4.2
Pete's Bugless Beast 0.9
AdamZ's Smoked Glass 6.0
DroidMod 1.0 (Default kernel set to 600MHz, closest setting to stock)

ChevyNo1's Simply Stunning 2.0.3
CPU Benchmark:
Test 1 - 2022ms
Test 2 - 1745ms
Test 3 - 1871ms
Test 4 - 1851ms
Test 5 - 2148ms
Average - 1927.4ms

Linpack:
Test 1 - 4.541 MFLOPS
Test 2 - 4.627 MFLOPS
Test 3 - 4.496 MFLOPS
Test 4 - 4.398 MFLOPS
Test 5 - 4.572 MFLOPS
Average - 4.5268 MFLOPS

SetCPU:
Test 1 - 1488ms
Test 2 - 1427ms
Test 3 - 1440ms
Test 4 - 1425ms
Test 5 - 1450ms
Average - 1466ms

blackdroid's Ultimate Droid 8.0
CPU Benchmark:
Test 1 - 1790ms
Test 2 - 1859ms
Test 3 - 1822ms
Test 4 - 1813ms
Test 5 - 1818ms
Average - 1820.4ms

Linpack:
Test 1 - 4.679 MFLOPS
Test 2 - 4.695 MFLOPS
Test 3 - 4.687 MFLOPS
Test 4 - 4.691 MFLOPS
Test 5 - 4.687 MFLOPS
Average - 4.6878 MFLOPS

SetCPU:
Test 1 - 1454ms
Test 2 - 1439ms
Test 3 - 1420ms
Test 4 - 1414ms
Test 5 - 1413ms
Average - 1428ms

Koush's CyanogenMod port 5.0.5
CPU Benchmark:
Test 1 - 2169ms
Test 2 - 2060ms
Test 3 - 2028ms
Test 4 - 2015ms
Test 5 - 2009ms
Average - 2056.2ms

Linpack:
Test 1 - 4.383 MFLOPS
Test 2 - 4.366 MFLOPS
Test 3 - 4.089 MFLOPS
Test 4 - 4.576 MFLOPS
Test 5 - 4.572 MFLOPS
Average - 4.3972 MFLOPS

SetCPU:
Test 1 - 1434ms
Test 2 - 1422ms
Test 3 - 1439ms
Test 4 - 1418ms
Test 5 - 1417ms
Average - 1426ms

Pete's Bugless Beast v0.9
CPU Benchmark:
Test 1 - 1698ms
Test 2 - 2058ms
Test 3 - 1988ms
Test 4 - 1965ms
Test 5 - 1957ms
Average - 1933.2ms

Linpack:
Test 1 - 4.511 MFLOPS
Test 2 - 4.584 MFLOPS
Test 3 - 4.667 MFLOPS
Test 4 - 4.615 MFLOPS
Test 5 - 4.687 MFLOPS
Average - 4.6125 MFLOPS

SetCPU:
Test 1 - 1447ms
Test 2 - 1423ms
Test 3 - 1427ms
Test 4 - 1412ms
Test 5 - 1413ms
Average - 1424.4ms

AdamZ's Smoked Glass 6.0
CPU Benchmark:
Test 1 - 1972ms
Test 2 - 1902ms
Test 3 - 1897ms
Test 4 - 1876ms
Test 5 - 1874ms
Average - 1904.2ms

Linpack:
Test 1 - 4.526 MFLOPS
Test 2 - 4.687 MFLOPS
Test 3 - 4.675 MFLOPS
Test 4 - 4.667 MFLOPS
Test 5 - 4.615 MFLOPS
Average - 4.634 MFLOPS

SetCPU:
Test 1 - 1418ms
Test 2 - 1419ms
Test 3 - 1434ms
Test 4 - 1432ms
Test 5 - 1416ms
Average - 1423.8ms

DroidMod 1.0
CPU Benchmark:
Test 1 - 1973ms
Test 2 - 1944ms
Test 3 - 1885ms
Test 4 - 1857ms
Test 5 - 1837ms
Average - 1899.2ms

Linpack:
Test 1 - 5.017 MFLOPS
Test 2 - 4.803 MFLOPS
Test 3 - 4.921 MFLOPS
Test 4 - 5.022 MFLOPS
Test 5 - 4.975 MFLOPS
Average - 4.9476 MFLOPS

SetCPU:
Test 1 - 1304ms
Test 2 - 1277ms
Test 3 - 1277ms
Test 4 - 1285ms
Test 5 - 1299ms
Average - 1288.4ms

[pthance]

Nice work man, glad to see you have branched off to multiple forums, especially to my original forum home (here)! This place rocks dude, people here are awesome and always helpful.

[woodyman]

would you mine testing mine..?

[bomber889]

DroidMod 1.0 is 2.0.1 based right? So it does not work with 2.1?

[pthance]

Lol I'm so proud of my woody! Sorry....had to say it. Woodyman, congrats on getting your own section in the forum, definitely nice to see your work is catching on. Hope he tests yours out and adds it soon. Just so you know, the discussion on irc about this happened just before your ROMs started gaining a following. He had decided to do the major ROMs that were out there, but I'm betting roland0fgilead will get to yours soon enough .

[woodyman]

i understand and thanks man, im glad to see im still in your SIG... lol, and to think all that started with [sholes] droidmod.. lol..

thanks man

[roland0fgilead]

Don't worry Woody, I'll get around to testing yours soon enough.
I'll have a good bit of free time tomorrow, so I just might take care of it then.

[A.Brooks]

So, in layman's terms, this all equates to what?

[pthance]

So, in layman's terms, this all equates to what?

He used three seperate applications for speed testing the kernels. With Linpack you want higher numbers in the MFLOPS (Millions of Floating Operations Per second). With the other two (SetCpu and CPU Benchmark) you prefer lower numbers as a better score (like in golf). He did five tests per application and averaged out the results on each. He did this with the most popular ROMs at the time of test. Basically he was providing a set of data for those who want to make educated decisions as to which ROM to choose from IF speed was the desired outcome.

[pandroid]

edit: i was bored so i made a graph, easier on the eyes.

order, top down, is approximately slowest to fastest overall



in cyanogenmod's defense, it is a port. but i loved that rom back when i had g1