PROJECTS: E3 Hardware - Tillman: Benchmarks
Overview
Note that these benchmarks are not really all that useful for determining the relative speed of older or exotic hardware. Aside from all the ``regular'' problems that benchmarking runs into, older machines are often run in a non-standard configuration. Portions of the hardware (especially disks) are often non-original, the software is almost certainly non-original and non-optimized for the platform, and the workload is rarely similar to what was originally intended.
In spite of those problems, I decided to provide the following benchmarks. While they can't be regarded as accurate, they do give a ``feel'' for what the machine performs like in it's current state.
Things to do
There's some things I'd like to do in my copious spare time:
- Redo the benchmarks with multiple runs, and use averaged values instead of ``one of'' values
- Expand the tables to include other interesting machines I have
- Add new benchmarks (like Xperf for platforms where that makes sense)
- HTML::Mason'ize these tables so that they auto-generated from static data files rather than being maintained by hand
OpenSSL
This benchmark is simply a selected portion of the output of openssl speed, a benchmark built into OpenSSL. Where available, some information is presented on the hardware and software in use at the time the benchmark was taken.
| RSA | DSA | ||||||||||||
| Sign/second | Verify/second | Sign/second | Verify/second | ||||||||||
| 512 | 1024 | 2048 | 4096 | 512 | 1024 | 2048 | 4096 | 512 | 1024 | 2048 | 512 | 1024 | 2048 |
| Athena (Generic Intel, 256MiB RAM, 900Mhz Celeron, FreeBSD -stable Apr 15/04 and OpenSSL 0.9.7d) | |||||||||||||
| 557.4 | 120.2 | 20.9 | 3.2 | 6211.2 | 2315.1 | 719.5 | 209.4 | 703.2 | 252.0 | 76.6 | 587.3 | 208.9 | 64.2 |
| Thoth (Compaq Proliant 1600, 256MiB RAM, 600 MHz Pentium III, FreeBSD 5.3-RELEASE and OpenSSL 0.9.7d) | |||||||||||||
| 355.0 | 79.4 | 14.0 | 2.1 | 3499.6 | 1393.1 | 458.1 | 137.1 | 457.0 | 165.3 | 51.0 | 379.8 | 132.9 | 41.8 |
| Coyote (Generic Intel, 128MiB RAM, 400Mhz Celeron, FreeBSD -stable Apr 15/04 and OpenSSL 0.9.7d) | |||||||||||||
| 139.5 | 26.1 | 4.2 | 0.6 | 1547.0 | 502.6 | 151.8 | 43.9 | 159.9 | 50.7 | 15.6 | 129.4 | 40.7 | 12.7 |
| Caliban (Sun Ultra 5, 384MiB RAM, 360Mhz CPU, FreeBSD -current Apr 16/04 and OpenSSL 0.9.7d) | |||||||||||||
| 104.6 | 19.3 | 3.1 | 0.5 | 1031.1 | 344.5 | 103.2 | 28.8 | 117.4 | 36.8 | 10.9 | 95.5 | 29.2 | 8.7 |
| Pluto (Generic Intel, 64MiB RAM, 200Mhz Pentium, FreeBSD -stable Apr 15/04 and OpenSSL 0.9.7d) | |||||||||||||
| 57.9 | 10.8 | 1.7 | 0.3 | 625.4 | 203.6 | 60.4 | 17.3 | 65.9 | 21.2 | 6.3 | 53.1 | 17.1 | 5.1 |
| Lapis Lazuli (SGI O2, 256MiB RAM, 180Mhz R5000 CPU, NetBSD -current Mar 26/04 and OpenSSL 0.9.7c) | |||||||||||||
| 25.1 | 5.6 | 0.9 | 0.1 | 274.9 | 100.8 | 30.2 | 8.3 | 35.0 | 11.6 | 3.3 | 29.6 | 9.4 | 2.7 |
| Surya (Sun Sparcstation 20, dual Hypersparc 125 512KiB cache, 224MiB RAM NetBSD 2.0 and OpenSSL 0.9.7d) | |||||||||||||
| 10.2 | 1.7 | 0.2 | 0.0 | 104.6 | 29.8 | 8.1 | 2.2 | 10.8 | 3.1 | 0.9 | 8.7 | 2.5 | 0.7 |
| Ares (Sun Sparcstation 20, dual 50Mhz CPUs, 64MiB RAM NetBSD 2.0.2 and OpenSSL 0.9.7d) | |||||||||||||
| 6.1 | 1.0 | 0.1 | 0.0 | 60.7 | 17.6 | 4.8 | 1.3 | 6.4 | 1.8 | 0.5 | 5.1 | 1.5 | 0.4 |
| Angerona (DEC VAXStation 4000/60, 16MiB RAM NetBSD 2.0-BETA and OpenSSL 0.9.6d) | |||||||||||||
| 4.2 | 0.8 | 0.1 | 0.0 | 44.3 | 15.0 | 4.5 | 1.3 | 4.9 | 1.6 | 0.5 | 4.0 | 1.3 | 0.4 |
| Firbolg (DECStation 5000/25, 40MiB RAM, 25Mhz R3000 CPU, NetBSD 1.6.1 and OpenSSL 0.9.6g) | |||||||||||||
| 2.9 | 0.5 | 0.1 | n/a | 31.3 | 9.3 | 2.6 | n/a | 3.1 | 1.0 | 0.3 | 2.5 | 0.8 | 0.2 |
| 512 | 1024 | 2048 | 4096 | 512 | 1024 | 2048 | 4096 | 512 | 1024 | 2048 | 512 | 1024 | 2048 |
| Sign/second | Verify/second | Sign/second | Verify/second | ||||||||||
| RSA | DSA | ||||||||||||
Bonnie++
This benchmark tests the filesystem in a variety of usage patterns. It attempts to avoid measuring the speed of the file cache in RAM by sizing the tests to overwhelm any caching. bonnie++ is in general a much better disk I/O benchmark than something like hdparm.
The benchmark table is really too wide for the design of this web site (or for easy printing). However, it's easier to visually compare results in this format and so I've decided to leave it as is.
Note that especially the ``per character'' results appear to be have different meanings between bonnie++ versions 1.01 and 1.93c. I plan on investigating that sometime.
All bonnie++ runs ran as the root user and used the automatic test sizing rather than explicitedly setting a test size. There are likely some anomalous results -- in most cases I didn't make multiple runs and average the results like I should have.
| Sequential Output | Sequential Input | Random | Sequential Create | Random Create | |||||||||||||||||||
| Char | Block | Rewrite | Char | Block | Seeks | Create | Read | Delete | Create | Read | Delete | ||||||||||||
| K/s | %C | K/s | %C | K/s | %C | K/s | %C | K/s | %C | /sec | %C | /sec | %C | /sec | %C | /sec | %C | /sec | %C | /sec | %C | /sec | %C |
| Thoth (Compaq Proliant 1600, Pentium III 600, on-board Ultra2 LVD SCSI RAID (dual 18.2 7200RPM drives in a hardware mirror), FreeBSD 5.3-RELEASE and bonnie++ 1.93c) | |||||||||||||||||||||||
| 47 | 98 | 12744 | 22 | 6269 | 10 | 174 | 97 | 21749 | 17 | 224 | 18 | 3621 | 45 | 8637 | 51 | 12227 | 88 | 4793 | 56 | 20769 | 76 | 13284 | 73 |
| Thoth (Compaq Proliant 1600, Pentium III 600, on-board Ultra2 LVD SCSI RAID (dual 18.2 7200RPM drives in a hardware mirror), FreeBSD 5.3-RELEASE and bonnie++ 1.93c) -- broken mirror | |||||||||||||||||||||||
| 46 | 99 | 13500 | 24 | 5890 | 10 | 158 | 98 | 19786 | 16 | 284 | 24 | 5793 | 81 | 13306 | 91 | 12288 | 98 | 4781 | 61 | 24921 | 97 | 16537 | 94 |
| Coyote (Generic x86, on-board 8063MiB Maxtor 90845D4 UDMA33, FreeBSD -stable Apr 15/04 and bonnie++ 1.93c) | |||||||||||||||||||||||
| 51 | 97 | 9612 | 19 | 4569 | 12 | 111 | 97 | 9617 | 10 | 73.4 | 8 | 5873 | 88 | 14488 | 72 | 8857 | 95 | 5694 | 82 | 16214 | 86 | 6396 | 86 |
| Lapsi Lazuli (SGI O2, sled-mounted Seagate 18GiB SCA SCSI Barracuda , NetBSD -current Mar 26/04 and bonnie++ 1.03) | |||||||||||||||||||||||
| 3619 | 62 | 3786 | 37 | 1462 | 14 | 3636 | 89 | 3653 | 18 | 130.1 | 9 | 64 | 36 | 8600 | 99 | 159 | 11 | 64 | 36 | 223 | 99 | 128 | 31 |
| Lapsi Lazuli (SGI O2, sled-mounted Seagate 18GiB SCA SCSI Barracuda , NetBSD -current Mar 26/04 and bonnie++ 1.03) | |||||||||||||||||||||||
| 5351 | 94 | 7367 | 39 | 2572 | 24 | 3778 | 92 | 7696 | 40 | 70.1 | 7 | 47 | 27 | 6264 | 99 | 119 | 9 | 47 | 27 | 216 | 99 | 124 | 31 |
| Ares (Sun SparcStation 20, dual 50MHz CPUs, SEAGATE ST34520N SCSI, NetBSD 2.0.2 and bonnie++ 1.03) | |||||||||||||||||||||||
| 1728 | 94 | 4600 | 46 | 2014 | 35 | 1433 | 95 | 5216 | 51 | 61.4 | 12 | 38 | 52 | 2722 | 99 | 115 | 17 | 39 | 52 | 96 | 99 | 95 | 50 |
| Caliban (Sun Ultra 5, onboard Seagate ST38410A IDE, FreeBSD -current Apr 16/04 and bonnie++ 1.93c) | |||||||||||||||||||||||
| 14 | 93 | 7439 | 24 | 2253 | 8 | 33 | 94 | 4255 | 8 | 120.2 | 20 | 921 | 44 | 4670 | 84 | 4197 | 90 | 1129 | 48 | 5711 | 85 | 4941 | 93 |
| Firbolg (DECStation 5000/25, external Sun enclosure with a SCSI 1.3GiB Seagate ST41600N, NetBSD 1.6.1 and bonnie++ 1.01) | |||||||||||||||||||||||
| 673 | 95 | 2588 | 82 | 1084 | 65 | 540 | 96 | 2469 | 80 | 37.5 | 16 | 16 | 71 | 1067 | 91 | 86 | 34 | 16 | 71 | 27 | 95 | 38 | 60 |
| Firbolg (DECStation 5000/25, onboard non-original SCSI 2GiB Seagate ST31230N, NetBSD 1.6.1 and bonnie++ 1.01) | |||||||||||||||||||||||
| 686 | 95 | 2107 | 63 | 971 | 58 | 552 | 96 | 2581 | 81 | 31.9 | 13 | 14 | 60 | 1045 | 92 | 85 | 31 | 14 | 59 | 27 | 94 | 28 | 43 |
| K/s | %C | K/s | %C | K/s | %C | K/s | %C | K/s | %C | /sec | %C | /sec | %C | /sec | %C | /sec | %C | /sec | %C | /sec | %C | /sec | %C |
| Char | Block | Rewrite | Char | Block | Seeks | Create | Read | Delete | Create | Read | Delete | ||||||||||||
| Sequential Output | Sequential Input | Random | Sequential Create | Random Create | |||||||||||||||||||
