wiki:LimulusBenchmarks

Version 4 (modified by admin, 11 years ago) (diff)

various clean ups

Various Limulus Benchmarks

HPL Performance

Hadoop

Presented a tutorial on  Hadoop recently and used my original Limulus to demonstrate a four node Hadoop cluster. Some of the hardware is actually quite old. The nodes have a single dual core E6550, with 4 GB RAM and a 64MB SSD. The head node has a quad-core Sandy Bridge (i5-2400S) with 4 GB RAM, 64MB SSD, and .5 TB of RAID1. Connections were using the mediocre consumer based Realtek GigE Ethernet controllers on the nodes. Overall it worked well. I plan on making a Hadoop VNFS so that it is possible to boot the nodes into Hadoop. Used the  Hortonworks HDP for the Hadoop install. The following are results of the TestDFSIO benchmark (tests the Hadoop File System)

----- TestDFSIO ----- : write
           Date & time: Wed Feb 06 22:23:24 EST 2013
       Number of files: 10
Total MBytes processed: 10000
     Throughput mb/sec: 9.684751649071087
Average IO rate mb/sec: 9.751626968383789
 IO rate std deviation: 0.8502143053358981
    Test exec time sec: 141.977

----- TestDFSIO ----- : read
           Date & time: Wed Feb 06 22:26:34 EST 2013
       Number of files: 10
Total MBytes processed: 10000
     Throughput mb/sec: 44.49229838314988
Average IO rate mb/sec: 51.67889404296875
 IO rate std deviation: 23.5285090607248
    Test exec time sec: 58.388