| | 1 | == Various Limulus Benchmarks == |
| | 2 | |
| | 3 | |
| | 4 | |
| | 5 | === Hadoop === |
| | 6 | |
| | 7 | Presentd a tutorial on http://hadoop.apache.org/ Hadoop recently and used my original Limulus to demonstrated a four node Hadoop cluster. |
| | 8 | Some of the hardware is actually quite old. The nodes have a single dual core E6550, with 4 GB RAM, with 64MB SSD. The head node was a quad-core SandyBridge (i5-2400S) with 4 GB RAM, 64MB SSD and .5 TB of RAID. Connections were using the crappy consumer based Realtek GigE Ethernet controllers on the nodes. Overalll it worked well. I plan on making a Hadoop VNFS so sthat it is poosibel to boot the nodes into Hadoop. Usded the http://hortonworks.com/products Hortopnworks HDP for the Hadoop install /hortonworksdataplatform/ |
| | 9 | |
| | 10 | ----- TestDFSIO ----- : write |
| | 11 | Date & time: Wed Feb 06 22:23:24 EST 2013 |
| | 12 | Number of files: 10 |
| | 13 | Total MBytes processed: 10000 |
| | 14 | Throughput mb/sec: 9.684751649071087 |
| | 15 | Average IO rate mb/sec: 9.751626968383789 |
| | 16 | IO rate std deviation: 0.8502143053358981 |
| | 17 | Test exec time sec: 141.977 |
| | 18 | |
| | 19 | ----- TestDFSIO ----- : read |
| | 20 | Date & time: Wed Feb 06 22:26:34 EST 2013 |
| | 21 | Number of files: 10 |
| | 22 | Total MBytes processed: 10000 |
| | 23 | Throughput mb/sec: 44.49229838314988 |
| | 24 | Average IO rate mb/sec: 51.67889404296875 |
| | 25 | IO rate std deviation: 23.5285090607248 |
| | 26 | Test exec time sec: 58.388 |