Experiments
From New Wiki
In this page we report a series of test performed using TPC-C, testing the effectiveness of larger Bufferpool, O_DIRECT, and the multitenancy characteristics of MySQL
TPC-C Hardware resource utilization (max speed, finding the limit)
For this test we used a slightly modified version of BenchmarkSQL. The TPC-C is scaled to 10 warehouses, and we have 20 simulated terminals. The goal of the following tests it to analyze HW resource utilization of a typical OLTP application, and to provide an initial feeling of how good/bad is to run OLTP application in multi-tenancy.
The monitoring is performed using an enhanced version of DSTAT, and the rendering are obtained via gnuplot scripts.
Running 1 TPC-C workloads on 1 MySQL DBMS (476MB buffer-pool, O_DIRECT)
The image shows the utilization of system resources:
- 1 TPC-C workloads running on the 1 MySQL DBMSs
- scaled to 10 warehouses and 20 terminals
- the 1 MySQL instance is in version 5.4 with 476MB of buffer-pool
- farm6: 2 x Dualcore Xeon, 2GB RAM, 1 x 7200 RPM SATA drive
| Error creating thumbnail: convert: unable to open image `/home1/curinous/public_html/relationalcloud/images/9/9c/1tpcc-1mysql-classic2-500mb.png': @ error/blob.c/OpenBlob/2517. convert: unable to open file `/home1/curinous/public_html/relationalcloud/images/9/9c/1tpcc-1mysql-classic2-500mb.png' @ error/png.c/ReadPNGImage/3137. convert: missing an image filename `/home1/curinous/public_html/relationalcloud/images/thumb/9/9c/1tpcc-1mysql-classic2-500mb.png/600px-1tpcc-1mysql-classic2-500mb.png' @ error/convert.c/ConvertImageCommand/2953. |
And some innodb internal statistics:
| Error creating thumbnail: convert: unable to open image `/home1/curinous/public_html/relationalcloud/images/a/a7/1tpcc-1mysql-innodb-500mb.png': @ error/blob.c/OpenBlob/2517. convert: unable to open file `/home1/curinous/public_html/relationalcloud/images/a/a7/1tpcc-1mysql-innodb-500mb.png' @ error/png.c/ReadPNGImage/3137. convert: missing an image filename `/home1/curinous/public_html/relationalcloud/images/thumb/a/a7/1tpcc-1mysql-innodb-500mb.png/600px-1tpcc-1mysql-innodb-500mb.png' @ error/convert.c/ConvertImageCommand/2953. |
Running 1 TPC-C workloads on 1 MySQL DBMS (953MB buffer-pool, O_DIRECT)
The image shows the utilization of system resources:
- 1 TPC-C workloads running on the 1 MySQL DBMSs
- scaled to 10 warehouses and 20 terminals
- the 1 MySQL instance is in version 5.4 with 953MB of buffer-pool
- farm6: 2 x Dualcore Xeon, 2GB RAM, 1 x 7200 RPM SATA drive
| Error creating thumbnail: convert: unable to open image `/home1/curinous/public_html/relationalcloud/images/6/65/1tpcc-1mysql-classic2-1000mb.png': @ error/blob.c/OpenBlob/2517. convert: unable to open file `/home1/curinous/public_html/relationalcloud/images/6/65/1tpcc-1mysql-classic2-1000mb.png' @ error/png.c/ReadPNGImage/3137. convert: missing an image filename `/home1/curinous/public_html/relationalcloud/images/thumb/6/65/1tpcc-1mysql-classic2-1000mb.png/600px-1tpcc-1mysql-classic2-1000mb.png' @ error/convert.c/ConvertImageCommand/2953. |
And some innodb internal statistics:
| Error creating thumbnail: convert: unable to open image `/home1/curinous/public_html/relationalcloud/images/3/35/1tpcc-1mysql-innodb-1000mb.png': @ error/blob.c/OpenBlob/2517. convert: unable to open file `/home1/curinous/public_html/relationalcloud/images/3/35/1tpcc-1mysql-innodb-1000mb.png' @ error/png.c/ReadPNGImage/3137. convert: missing an image filename `/home1/curinous/public_html/relationalcloud/images/thumb/3/35/1tpcc-1mysql-innodb-1000mb.png/600px-1tpcc-1mysql-innodb-1000mb.png' @ error/convert.c/ConvertImageCommand/2953. |
Running 2 independent TPC-C workloads on 1 MySQL DBMS (953MB buffer pool)
The image shows the utilization of system resourcers:
- 1 TPC-C workload running alone on the MySQL DBMS
- a second independent TPC-C (different schema) running on the same machine
- both are scaled to 10 warehouses and 20 terminals
- MySQL 5.4 with 953MB of bufferpool total
- farm6: 2 x Dualcore Xeon, 2GB RAM, 1 x 7200 RPM SATA drive
- Average throughput for a single TPC-C is 3668.5050 tpmC for the stable phave (400sec-800sec)
- Average total throughput for both workload is 1275.6600 tpmC for the stable phase (1500sec-2000sec)
Interesting observations:
- as soon as the second TPC-C fires up (about 1000secs into the experiment) the performance (both individual and global) decreases incredibly, due to disk contention.
- high number of disk seeks reduces effectiveness of DISK I/O
| Error creating thumbnail: convert: unable to open image `/home1/curinous/public_html/relationalcloud/images/b/bd/2tppc-1mysql-farm6.png': @ error/blob.c/OpenBlob/2517. convert: unable to open file `/home1/curinous/public_html/relationalcloud/images/b/bd/2tppc-1mysql-farm6.png' @ error/png.c/ReadPNGImage/3137. convert: missing an image filename `/home1/curinous/public_html/relationalcloud/images/thumb/b/bd/2tppc-1mysql-farm6.png/600px-2tppc-1mysql-farm6.png' @ error/convert.c/ConvertImageCommand/2953. |
And some innodb internal statistics:
| Error creating thumbnail: convert: unable to open image `/home1/curinous/public_html/relationalcloud/images/7/7f/2tpcc-1mysql-innodb.png': @ error/blob.c/OpenBlob/2517. convert: unable to open file `/home1/curinous/public_html/relationalcloud/images/7/7f/2tpcc-1mysql-innodb.png' @ error/png.c/ReadPNGImage/3137. convert: missing an image filename `/home1/curinous/public_html/relationalcloud/images/thumb/7/7f/2tpcc-1mysql-innodb.png/600px-2tpcc-1mysql-innodb.png' @ error/convert.c/ConvertImageCommand/2953. |
Running 2 TPC-C workloads on 1 MySQL DBMS (953MB buffer-pool, O_DIRECT)
The image shows the utilization of system resources:
- 2 TPC-C workloads running on the 1 MySQL DBMSs
- each scaled to 10 warehouses and 20 terminals
- the 1 MySQL instance is in version 5.4 with 953MB of buffer-pool
- farm6: 2 x Dualcore Xeon, 2GB RAM, 1 x 7200 RPM SATA drive
| Error creating thumbnail: convert: unable to open image `/home1/curinous/public_html/relationalcloud/images/7/7c/2tpcc-1mysql-classic2-1000mb.png': @ error/blob.c/OpenBlob/2517. convert: unable to open file `/home1/curinous/public_html/relationalcloud/images/7/7c/2tpcc-1mysql-classic2-1000mb.png' @ error/png.c/ReadPNGImage/3137. convert: missing an image filename `/home1/curinous/public_html/relationalcloud/images/thumb/7/7c/2tpcc-1mysql-classic2-1000mb.png/600px-2tpcc-1mysql-classic2-1000mb.png' @ error/convert.c/ConvertImageCommand/2953. |
And some innodb internal statistics:
| Error creating thumbnail: convert: unable to open image `/home1/curinous/public_html/relationalcloud/images/c/c4/2tpcc-1mysql-innodb-1000mb.png': @ error/blob.c/OpenBlob/2517. convert: unable to open file `/home1/curinous/public_html/relationalcloud/images/c/c4/2tpcc-1mysql-innodb-1000mb.png' @ error/png.c/ReadPNGImage/3137. convert: missing an image filename `/home1/curinous/public_html/relationalcloud/images/thumb/c/c4/2tpcc-1mysql-innodb-1000mb.png/600px-2tpcc-1mysql-innodb-1000mb.png' @ error/convert.c/ConvertImageCommand/2953. |
Running 2 independent TPC-C workloads on 2 MySQL DBMS (each 488MB bufferl pool)
The image shows the utilization of system resources:
- 2 TPC-C workloads running on the 2 MySQL DBMSs
- both are scaled to 10 warehouses and 20 terminals
- the 2 MySQL instances are in version 5.4 with 488MB of buffer-pool each
- farm6: 2 x Dualcore Xeon, 2GB RAM, 1 x 7200 RPM SATA drive
- Average total throughput is 1376.7840 tpmC for the stable phase (1500sec-2000sec), and improvement of 7.9% w.r.t. to the 1-mhysql experiment.
| Error creating thumbnail: convert: unable to open image `/home1/curinous/public_html/relationalcloud/images/2/25/2tpcc-2mysql.png': @ error/blob.c/OpenBlob/2517. convert: unable to open file `/home1/curinous/public_html/relationalcloud/images/2/25/2tpcc-2mysql.png' @ error/png.c/ReadPNGImage/3137. convert: missing an image filename `/home1/curinous/public_html/relationalcloud/images/thumb/2/25/2tpcc-2mysql.png/600px-2tpcc-2mysql.png' @ error/convert.c/ConvertImageCommand/2953. |
And some innodb internal statistics:
| Error creating thumbnail: convert: unable to open image `/home1/curinous/public_html/relationalcloud/images/4/4e/2tpcc-2mysql-innodb.png': @ error/blob.c/OpenBlob/2517. convert: unable to open file `/home1/curinous/public_html/relationalcloud/images/4/4e/2tpcc-2mysql-innodb.png' @ error/png.c/ReadPNGImage/3137. convert: missing an image filename `/home1/curinous/public_html/relationalcloud/images/thumb/4/4e/2tpcc-2mysql-innodb.png/600px-2tpcc-2mysql-innodb.png' @ error/convert.c/ConvertImageCommand/2953. |
Running 2 TPC-C workloads on 2 MySQL DBMS (each with 476MB buffer-pool, O_DIRECT)
The image shows the utilization of system resources:
- 2 TPC-C workloads running on the 1 MySQL DBMSs
- each scaled to 10 warehouses and 20 terminals
- 2 MySQL instances are in version 5.4 with 476MB of buffer-pool
- farm6: 2 x Dualcore Xeon, 2GB RAM, 1 x 7200 RPM SATA drive
| Error creating thumbnail: convert: unable to open image `/home1/curinous/public_html/relationalcloud/images/9/94/2tpcc-2mysql-classic2-1000mb.png': @ error/blob.c/OpenBlob/2517. convert: unable to open file `/home1/curinous/public_html/relationalcloud/images/9/94/2tpcc-2mysql-classic2-1000mb.png' @ error/png.c/ReadPNGImage/3137. convert: missing an image filename `/home1/curinous/public_html/relationalcloud/images/thumb/9/94/2tpcc-2mysql-classic2-1000mb.png/600px-2tpcc-2mysql-classic2-1000mb.png' @ error/convert.c/ConvertImageCommand/2953. |
And some innodb internal statistics:
| Error creating thumbnail: convert: unable to open image `/home1/curinous/public_html/relationalcloud/images/f/f3/2tpcc-2mysql-innodb-1000mb.png': @ error/blob.c/OpenBlob/2517. convert: unable to open file `/home1/curinous/public_html/relationalcloud/images/f/f3/2tpcc-2mysql-innodb-1000mb.png' @ error/png.c/ReadPNGImage/3137. convert: missing an image filename `/home1/curinous/public_html/relationalcloud/images/thumb/f/f3/2tpcc-2mysql-innodb-1000mb.png/600px-2tpcc-2mysql-innodb-1000mb.png' @ error/convert.c/ConvertImageCommand/2953. |
TPC-C Hardware resource utilization (throttled clients)
The goal of the following tests, is to study TPC-C when is running not at the boundaries of the available HW resources, and to verify hypothesis of how multiple workloads would combine.
Summary of the tested configuration and results for disk-io is:
workload scale dbms buffer-pool terminals latency target throughput actual throughput io_read io_writes disk_read disk_writes notes
(# warehouse) (MB (#) (ms) (tpmC) (tpmC) (#) (#) (KB) (MB)
1 TPC-C 10 1 MySQL 1 x 476MB 10 ? 200 197.9 9.39 87.78 153.6KB 2.65MB
1 TPC-C 10 1 MySQL 1 x 476MB 10 ? 400 400.1 18.60 172.72 303.9KB 5.36MB
1 TPC-C 10 1 MySQL 1 x 476MB 10 ? 800 800.2 37.85 200.04 619.6KB 6.84MB
2 TPC-C 2 x 10 2 MYSQL 2 x 476MB 2x10 ? 2 x 400 2 x 399.1 37.91 205.62 619.8KB 7.05MB
2 TPC-C 2 x 10 1 MYSQL 1 x 953MB 2x10 ? 2 x 400 2 x 399.3 37.92 198.72 620.2KB 6.99MB
1 TPC-C 10 1 MySQL 1 x 476MB 10 ? MAX 1239.5 58.39 180.34 954.2KB 7.83MB
1 TPC-C 10 1 MySQL 1 x 476MB 10 ? MAX 1260.8 59.08 179.06 966.1KB 7.87MB (innodb_io_capacity=400)
1 TPC-C 10 1 MySQL 1 x 476MB 10 ? MAX 1336.8 (warm?) 64.11 184.54 1060.7KB 8.01MB (log in RAMDISK)
1 TPC-C 10 1 MySQL 1 x 476MB 20 ? MAX 1412.0 (warm?) 65.97 165.59 1079.2KB 8.26MB (log in RAMDISK, innodb_io_capacity=400)
1 TPC-C 5 1 MYSQL 1 x 476MB 10 ? 1600 1599.5 0.83 287.44 13.6KB 11.15MB
2 TPC-C 2 x 5 1 MYSQL 1 x 953MB 2x10 ? MAX 2 x 1695.8 1.61 394.01 26.1KB 19.64MB
1 TPC-C 5 1 MYSQL 1 x 476MB 10 ? MAX 4858.6 3.53 368.69 57.7KB 22.90MB
1 TPC-C 5 1 MYSQL 1 x 953MB 10 ? MAX 5115.6 0.60 379.28 10.7KB 23.78MB
To be noted: for low tpmC the throttling of our client TPC-C implementation is rather bursty (does this affect measures? hopefully not... the above are averaged values).
Hypothesis:
- the 200 tpmC and 400 tpmC show a clear/clean doubling in disk I/O utilization both on reads and writes (we are clearly far from the disk limits)
- from 400 tpmC to 800 tpmC (with 2 workloads) and further to 1239tpmC we approach the disk limit, weird things happen: reads still double, but writes (both io requests and MB/sec) are growing much less than linearly. I guess innodb exploit group commits combined with densely packed log pages, which allow to increase tpmC without increase disk I/O as much.
- moving to two MySQL the above effect must be even more intense since the bandwidth for each mysql is about half than before, innodb must be very good at group commit and to pack densely the log pages.
- logs contributes to the number of IO but not much, moving it to RAMDISK (thus virtually making it free) doesn't improve performance by much, and IO grow by a little (more pages can be read and written), but not by much
- innodb_io_capacity doesn't influence much performance (i.e., the limit is the actual physical disk limit)
- (to be tested)two workloads doing random operations (like TPC-C when running with a small bufferpool) combine and hit the seek capacity of the disk... about 63 requests/sec for the disk we have (measured with sysbench)
- (to be tested) two workloads doing only sequential operations (TPC-C running with plenty bufferpool, and thus with the need to write only the log), combine and hit the bound of sequential write of the system (40MB/sec)
Running 1 TPC-C workload (throttled to 200 tpmC each) on a 1 MySQL DBMS (with 476 MB buffer-pool each, O_DIRECT)
The image shows the utilization of system resources:
- it starts with a single TPC-C workload running on MySQL with a target tpmC MAX
- the workload is scaled to 10 warehouses and 10 terminals each (enough to get to 200tpmC comfortably)
- MySQL instance is in version 5.4 with 476MB of buffer-pool
- farm6: 2 x Dualcore Xeon, 2GB RAM, 1 x 7200 RPM SATA drive
| Error creating thumbnail: convert: unable to open image `/home1/curinous/public_html/relationalcloud/images/2/26/1tpcc-1mysql-stats-500mb-thottled-200.png': @ error/blob.c/OpenBlob/2517. convert: unable to open file `/home1/curinous/public_html/relationalcloud/images/2/26/1tpcc-1mysql-stats-500mb-thottled-200.png' @ error/png.c/ReadPNGImage/3137. convert: missing an image filename `/home1/curinous/public_html/relationalcloud/images/thumb/2/26/1tpcc-1mysql-stats-500mb-thottled-200.png/600px-1tpcc-1mysql-stats-500mb-thottled-200.png' @ error/convert.c/ConvertImageCommand/2953. |
And some innodb internal statistics:
| Error creating thumbnail: convert: unable to open image `/home1/curinous/public_html/relationalcloud/images/3/3e/1tpcc-1mysql-innodb-500mb-thottled-200.png': @ error/blob.c/OpenBlob/2517. convert: unable to open file `/home1/curinous/public_html/relationalcloud/images/3/3e/1tpcc-1mysql-innodb-500mb-thottled-200.png' @ error/png.c/ReadPNGImage/3137. convert: missing an image filename `/home1/curinous/public_html/relationalcloud/images/thumb/3/3e/1tpcc-1mysql-innodb-500mb-thottled-200.png/600px-1tpcc-1mysql-innodb-500mb-thottled-200.png' @ error/convert.c/ConvertImageCommand/2953. |
Running 1 TPC-C workload (throttled to 800 tpmC) on a 1 MySQL DBMS (with 476 MB buffer-pool, O_DIRECT)
The image shows the utilization of system resources:
- a single TPC-C workload running on MySQL with a target tpmC of 800
- the workload is scaled to 10 warehouses and 10 terminals each (enough to get to 800tpmC comfortably)
- 2 MySQL instances are in version 5.4 with 476MB of buffer-pool
- farm6: 2 x Dualcore Xeon, 2GB RAM, 1 x 7200 RPM SATA drive
| Error creating thumbnail: convert: unable to open image `/home1/curinous/public_html/relationalcloud/images/4/4e/1tpcc-1mysql-stats-500mb-thottled-800.png': @ error/blob.c/OpenBlob/2517. convert: unable to open file `/home1/curinous/public_html/relationalcloud/images/4/4e/1tpcc-1mysql-stats-500mb-thottled-800.png' @ error/png.c/ReadPNGImage/3137. convert: missing an image filename `/home1/curinous/public_html/relationalcloud/images/thumb/4/4e/1tpcc-1mysql-stats-500mb-thottled-800.png/600px-1tpcc-1mysql-stats-500mb-thottled-800.png' @ error/convert.c/ConvertImageCommand/2953. |
And some innodb internal statistics:
| Error creating thumbnail: convert: unable to open image `/home1/curinous/public_html/relationalcloud/images/4/47/1tpcc-1mysql-innodb-500mb-thottled-800.png': @ error/blob.c/OpenBlob/2517. convert: unable to open file `/home1/curinous/public_html/relationalcloud/images/4/47/1tpcc-1mysql-innodb-500mb-thottled-800.png' @ error/png.c/ReadPNGImage/3137. convert: missing an image filename `/home1/curinous/public_html/relationalcloud/images/thumb/4/47/1tpcc-1mysql-innodb-500mb-thottled-800.png/600px-1tpcc-1mysql-innodb-500mb-thottled-800.png' @ error/convert.c/ConvertImageCommand/2953. |
Running 1 (and then 2) TPC-C workload (throttled to 400 tpmC each) on a 1 (and then 2) MySQL DBMS (with 476 MB buffer-pool each, O_DIRECT)
The image shows the utilization of system resources:
- it starts with a single TPC-C workload running on MySQL with a target tpmC of 400
- then a second identical workload kicks in running on the other MySQL instance
- both workloads are scaled to 10 warehouses and 10 terminals each (enough to get to 400tpmC comfortably)
- 2 MySQL instances are in version 5.4 with 476MB of buffer-pool
- farm6: 2 x Dualcore Xeon, 2GB RAM, 1 x 7200 RPM SATA drive
| Error creating thumbnail: convert: unable to open image `/home1/curinous/public_html/relationalcloud/images/5/5a/2tpcc-2mysql-stats-1000mb-thottled-400-400.png': @ error/blob.c/OpenBlob/2517. convert: unable to open file `/home1/curinous/public_html/relationalcloud/images/5/5a/2tpcc-2mysql-stats-1000mb-thottled-400-400.png' @ error/png.c/ReadPNGImage/3137. convert: missing an image filename `/home1/curinous/public_html/relationalcloud/images/thumb/5/5a/2tpcc-2mysql-stats-1000mb-thottled-400-400.png/600px-2tpcc-2mysql-stats-1000mb-thottled-400-400.png' @ error/convert.c/ConvertImageCommand/2953. |
And some innodb internal statistics:
| Error creating thumbnail: convert: unable to open image `/home1/curinous/public_html/relationalcloud/images/5/5f/2tpcc-2mysql-innodb-1000mb-thottled-400-400.png': @ error/blob.c/OpenBlob/2517. convert: unable to open file `/home1/curinous/public_html/relationalcloud/images/5/5f/2tpcc-2mysql-innodb-1000mb-thottled-400-400.png' @ error/png.c/ReadPNGImage/3137. convert: missing an image filename `/home1/curinous/public_html/relationalcloud/images/thumb/5/5f/2tpcc-2mysql-innodb-1000mb-thottled-400-400.png/600px-2tpcc-2mysql-innodb-1000mb-thottled-400-400.png' @ error/convert.c/ConvertImageCommand/2953. |
Running 1 TPC-C workload on a 1 MySQL DBMS (with 476 MB buffer-pool each, O_DIRECT, innodb_io_capacity=400)
The image shows the utilization of system resources:
- it starts with a single TPC-C workload running on MySQL with a target tpmC MAX
- the workload is scaled to 10 warehouses and 10 terminals each
- MySQL instance is in version 5.4 with 476MB of buffer-pool
- farm6: 2 x Dualcore Xeon, 2GB RAM, 1 x 7200 RPM SATA drive
Note: innodb_io_capacity > 200 does not influece results significantly
| Error creating thumbnail: convert: unable to open image `/home1/curinous/public_html/relationalcloud/images/0/07/1tpcc-1mysql-stats-500mb-max-iocap.png': @ error/blob.c/OpenBlob/2517. convert: unable to open file `/home1/curinous/public_html/relationalcloud/images/0/07/1tpcc-1mysql-stats-500mb-max-iocap.png' @ error/png.c/ReadPNGImage/3137. convert: missing an image filename `/home1/curinous/public_html/relationalcloud/images/thumb/0/07/1tpcc-1mysql-stats-500mb-max-iocap.png/600px-1tpcc-1mysql-stats-500mb-max-iocap.png' @ error/convert.c/ConvertImageCommand/2953. |
And some innodb internal statistics:
| Error creating thumbnail: convert: unable to open image `/home1/curinous/public_html/relationalcloud/images/6/68/1tpcc-1mysql-innodb-500mb-max-iocap.png': @ error/blob.c/OpenBlob/2517. convert: unable to open file `/home1/curinous/public_html/relationalcloud/images/6/68/1tpcc-1mysql-innodb-500mb-max-iocap.png' @ error/png.c/ReadPNGImage/3137. convert: missing an image filename `/home1/curinous/public_html/relationalcloud/images/thumb/6/68/1tpcc-1mysql-innodb-500mb-max-iocap.png/600px-1tpcc-1mysql-innodb-500mb-max-iocap.png' @ error/convert.c/ConvertImageCommand/2953. |
Running 1 TPC-C workload on a 1 MySQL DBMS (with 476 MB buffer-pool each, O_DIRECT)
The image shows the utilization of system resources:
- it starts with a single TPC-C workload running on MySQL with a target tpmC MAX
- the workload is scaled to 10 warehouses and 10 terminals each
- MySQL instance is in version 5.4 with 476MB of buffer-pool
- farm6: 2 x Dualcore Xeon, 2GB RAM, 1 x 7200 RPM SATA drive
| Error creating thumbnail: convert: unable to open image `/home1/curinous/public_html/relationalcloud/images/8/85/1tpcc-1mysql-stats-1000mb-max.png': @ error/blob.c/OpenBlob/2517. convert: unable to open file `/home1/curinous/public_html/relationalcloud/images/8/85/1tpcc-1mysql-stats-1000mb-max.png' @ error/png.c/ReadPNGImage/3137. convert: missing an image filename `/home1/curinous/public_html/relationalcloud/images/thumb/8/85/1tpcc-1mysql-stats-1000mb-max.png/600px-1tpcc-1mysql-stats-1000mb-max.png' @ error/convert.c/ConvertImageCommand/2953. |
And some innodb internal statistics:
| Error creating thumbnail: convert: unable to open image `/home1/curinous/public_html/relationalcloud/images/2/20/1tpcc-1mysql-innodb-1000mb-max.png': @ error/blob.c/OpenBlob/2517. convert: unable to open file `/home1/curinous/public_html/relationalcloud/images/2/20/1tpcc-1mysql-innodb-1000mb-max.png' @ error/png.c/ReadPNGImage/3137. convert: missing an image filename `/home1/curinous/public_html/relationalcloud/images/thumb/2/20/1tpcc-1mysql-innodb-1000mb-max.png/600px-1tpcc-1mysql-innodb-1000mb-max.png' @ error/convert.c/ConvertImageCommand/2953. |
Running 1 (and then 2) TPC-C workload (throttled to 400 tpmC each) on a 1 MySQL DBMS (with 953 MB buffer-pool each, O_DIRECT)
The image shows the utilization of system resources:
- it starts 2 TPC-C workload running on MySQL each with a target tpmC of 400
- both workloads are scaled to 10 warehouses and 10 terminals each (enough to get to 400tpmC comfortably)
- the MySQL instance is in version 5.4 with 953MB of buffer-pool
- farm6: 2 x Dualcore Xeon, 2GB RAM, 1 x 7200 RPM SATA drive
| Error creating thumbnail: convert: unable to open image `/home1/curinous/public_html/relationalcloud/images/f/f4/2tpcc-1mysql-stats-1000mb-thottled-400-400.png': @ error/blob.c/OpenBlob/2517. convert: unable to open file `/home1/curinous/public_html/relationalcloud/images/f/f4/2tpcc-1mysql-stats-1000mb-thottled-400-400.png' @ error/png.c/ReadPNGImage/3137. convert: missing an image filename `/home1/curinous/public_html/relationalcloud/images/thumb/f/f4/2tpcc-1mysql-stats-1000mb-thottled-400-400.png/600px-2tpcc-1mysql-stats-1000mb-thottled-400-400.png' @ error/convert.c/ConvertImageCommand/2953. |
And some innodb internal statistics:
| Error creating thumbnail: convert: unable to open image `/home1/curinous/public_html/relationalcloud/images/c/cb/2tpcc-1mysql-innodb-1000mb-thottled-400-400.png': @ error/blob.c/OpenBlob/2517. convert: unable to open file `/home1/curinous/public_html/relationalcloud/images/c/cb/2tpcc-1mysql-innodb-1000mb-thottled-400-400.png' @ error/png.c/ReadPNGImage/3137. convert: missing an image filename `/home1/curinous/public_html/relationalcloud/images/thumb/c/cb/2tpcc-1mysql-innodb-1000mb-thottled-400-400.png/600px-2tpcc-1mysql-innodb-1000mb-thottled-400-400.png' @ error/convert.c/ConvertImageCommand/2953. |
Running 2 TPC-C workloads (throttled to 300 tpmC each) on 2 MySQL DBMS (each with 476MB buffer-pool, O_DIRECT)
The image shows the utilization of system resources:
- it starts with a single TPC-C workload running on MySQL with a target tpmC of 300
- then a second identical workload kicks in running on the same MySQL
- both workloads are scaled to 10 warehouses and 5 terminals each (enough to get to 300tpmC comfortably)
- 2 MySQL instances are in version 5.4 with 476MB of buffer-pool
- farm6: 2 x Dualcore Xeon, 2GB RAM, 1 x 7200 RPM SATA drive
| Error creating thumbnail: convert: unable to open image `/home1/curinous/public_html/relationalcloud/images/9/9a/2tpcc-2mysql-classic2-1000mb-throttled-300-300.png': @ error/blob.c/OpenBlob/2517. convert: unable to open file `/home1/curinous/public_html/relationalcloud/images/9/9a/2tpcc-2mysql-classic2-1000mb-throttled-300-300.png' @ error/png.c/ReadPNGImage/3137. convert: missing an image filename `/home1/curinous/public_html/relationalcloud/images/thumb/9/9a/2tpcc-2mysql-classic2-1000mb-throttled-300-300.png/600px-2tpcc-2mysql-classic2-1000mb-throttled-300-300.png' @ error/convert.c/ConvertImageCommand/2953. |
And some innodb internal statistics:
| Error creating thumbnail: convert: unable to open image `/home1/curinous/public_html/relationalcloud/images/9/98/2tpcc-2mysql-innodb-1000mb-throttled-300-300.png': @ error/blob.c/OpenBlob/2517. convert: unable to open file `/home1/curinous/public_html/relationalcloud/images/9/98/2tpcc-2mysql-innodb-1000mb-throttled-300-300.png' @ error/png.c/ReadPNGImage/3137. convert: missing an image filename `/home1/curinous/public_html/relationalcloud/images/thumb/9/98/2tpcc-2mysql-innodb-1000mb-throttled-300-300.png/600px-2tpcc-2mysql-innodb-1000mb-throttled-300-300.png' @ error/convert.c/ConvertImageCommand/2953. |
Hardware Reference comparisons
In order to improve the usefulness of the above results, we include some standard measure of the hardware performance.
Disk Subsystems
We compare using Bonnie++ [1] the disk subsystem for:
- vise: 2x Quadcore Xeon, 24GB RAM, PERC 6 with 6 X 2TB 7200 RPM SATA drives
- farm6: 2 x Dualcore Xeon, 2GB RAM, 1 x 7200 RPM SATA drive
This is the output for the two:
FOR VISE:
Writing a byte at a time...done
Writing intelligently...done
Rewriting... done
Reading a byte at a time...done
Reading intelligently...done
start 'em...done...done...done...done...done...
Create files in sequential order...done.
Stat files in sequential order...done.
Delete files in sequential order...done.
Create files in random order...done.
Stat files in random order...done.
Delete files in random order...done.
Version 1.96 ------Sequential Output------ --Sequential Input- --Random-
Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks--
Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP
vise 48304M 681 99 166214 86 73899 10 2618 87 335599 18 446.8 25
Latency 17302us 301ms 580ms 87265us 277ms 70517us
Version 1.96 ------Sequential Create------ --------Random Create--------
vise -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete--
files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP
16 32745 67 +++++ +++ +++++ +++ +++++ +++ +++++ +++ +++++ +++
Latency 28180us 669us 716us 302us 69us 199us
1.96,1.96,vise,1,1270966612,48304M,,681,99,166214,86,73899,10,2618,87,335599,18,446.8,25,16,,,,,32745,67,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++,17302us,301ms,580ms,87265us,277ms,70517us,28180us,669us,716us,302us,69us,199us
FOR FARM6:
Writing a byte at a time...done
Writing intelligently...done
Rewriting...done
Reading a byte at a time...done
Reading intelligently...done
start 'em...done...done...done...done...done...
Create files in sequential order...done.
Stat files in sequential order...done.
Delete files in sequential order...done.
Create files in random order...done.
Stat files in random order...done.
Delete files in random order...done.
Version 1.96 ------Sequential Output------ --Sequential Input- --Random-
Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks--
Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP
farm6 4G 308 99 42277 16 21469 5 1220 97 69576 6 129.5 3
Latency 26463us 1658ms 1583ms 51956us 120ms 901ms
Version 1.96 ------Sequential Create------ --------Random Create--------
farm6 -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete--
files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP
16 21625 50 +++++ +++ 29000 54 24417 55 +++++ +++ 28651 53
Latency 37930us 956us 999us 1435us 127us 135us
1.96,1.96,farm6,1,1270940735,4G,,308,99,42277,16,21469,5,1220,97,69576,6,129.5,3,16,,,,,21625,50,+++++,+++,29000,54,24417,55,+++++,+++,28651,53,26463us,1658ms,1583ms,51956us,120ms,901ms,37930us,956us,999us,1435us,127us,135us
| Error creating thumbnail: convert: unable to open image `/home1/curinous/public_html/relationalcloud/images/2/2b/Bonnie-vise-farm6.png': @ error/blob.c/OpenBlob/2517. convert: unable to open file `/home1/curinous/public_html/relationalcloud/images/2/2b/Bonnie-vise-farm6.png' @ error/png.c/ReadPNGImage/3137. convert: missing an image filename `/home1/curinous/public_html/relationalcloud/images/thumb/2/2b/Bonnie-vise-farm6.png/600px-Bonnie-vise-farm6.png' @ error/convert.c/ConvertImageCommand/2953. |
>> [assignment Result Prob] = wiki_placement('../wikitig.w300.idle.csv/normalized','cpu_load',20000,10,'glcDirect',5,1080,287,1); Super-optimistic lower bound (simple max(sum(cpus)): 5
Maximing balance of load ===== * * * =================================================================== * * * TOMLAB - Tomlab user Demo license 999100. Valid to 2010-08-17
=========================================================================
Problem: --- 1: Wikipedia with NONlinear CPU, real data from trace f_k 0.334030520973002287
Solver: glcDirect. EXIT=0. INFORM=4. Constrained DIRECT - C Implementation Maximum number of f(x) evaluations reached. Tried 19957 rectangles, computing 8502 f(x) values.
FuncEv 8502 ConstrEv 8502 Iter 725 Maximum rectangle size 1.000000000000000 Optimal points found at x trial #: 4193 CPU time: 42.300000 sec. Elapsed time: 23.321755 sec. Optimal vector x (Length 325. Print first 20): x_k: 1.000000 1.000000 0.000000 1.000000 0.000000 0.000000
0.000000 0.000000 0.000000 0.000000 0.000000 0.000000
0.000000 0.000000 1.000000 1.000000 0.000000 0.000000
0.000000 0.000000
Error in 5 nonlinear constraints. cErr 0.000000e+00 0.000000e+00 0.000000e+00 0.000000e+00 0.000000e+00 TOMLAB found 390 active constraints. The Lagrange multipliers are not unique. Lagrange multipliers:
=== * * * ================================================== * * *
===== * * * =================================================================== * * *
TOMLAB - Tomlab user Demo license 999100. Valid to 2010-08-17
=========================================================================
Problem: --- 1: Wikipedia with NONlinear CPU, real data from trace f_k 0.334030520973002287
Solver: glcDirect. EXIT=0. INFORM=4. Constrained DIRECT - C Implementation Max f(x) evals. Tried total 39911 f(x), 1563 iter. Tried 51404 rectangles, computing 19330 f(x) values.
FuncEv 10828 ConstrEv 10828 Iter 838 Maximum rectangle size 1.000000000000000 Optimal points found at x trial #: 4193 CPU time: 88.920000 sec. Elapsed time: 62.999468 sec. Optimal vector x (Length 325. Print first 20): x_k: 1.000000 1.000000 0.000000 1.000000 0.000000 0.000000
0.000000 0.000000 0.000000 0.000000 0.000000 0.000000
0.000000 0.000000 1.000000 1.000000 0.000000 0.000000
0.000000 0.000000
Error in 5 nonlinear constraints. cErr 0.000000e+00 0.000000e+00 0.000000e+00 0.000000e+00 0.000000e+00 TOMLAB found 390 active constraints. The Lagrange multipliers are not unique. Lagrange multipliers:
=== * * * ================================================== * * *
===== * * * =================================================================== * * *
TOMLAB - Tomlab user Demo license 999100. Valid to 2010-08-17
=========================================================================
Problem: --- 1: Wikipedia with NONlinear CPU, real data from trace f_k 0.334030520973002287
Solver: glcDirect. EXIT=0. INFORM=4. Constrained DIRECT - C Implementation Max f(x) evals. Tried total 59805 f(x), 2388 iter. Tried 91970 rectangles, computing 31834 f(x) values.
FuncEv 12504 ConstrEv 12504 Iter 825 Maximum rectangle size 1.000000000000000 Optimal points found at x trial #: 4193 CPU time: 162.030000 sec. Elapsed time: 133.767348 sec. Optimal vector x (Length 325. Print first 20): x_k: 1.000000 1.000000 0.000000 1.000000 0.000000 0.000000
0.000000 0.000000 0.000000 0.000000 0.000000 0.000000
0.000000 0.000000 1.000000 1.000000 0.000000 0.000000
0.000000 0.000000
Error in 5 nonlinear constraints. cErr 0.000000e+00 0.000000e+00 0.000000e+00 0.000000e+00 0.000000e+00 TOMLAB found 390 active constraints. The Lagrange multipliers are not unique. Lagrange multipliers:
=== * * * ================================================== * * *
===== * * * =================================================================== * * *
TOMLAB - Tomlab user Demo license 999100. Valid to 2010-08-17
=========================================================================
Problem: --- 1: Wikipedia with NONlinear CPU, real data from trace f_k 0.334030520973002287
Solver: glcDirect. EXIT=0. INFORM=4. Constrained DIRECT - C Implementation Max f(x) evals. Tried total 79639 f(x), 3312 iter. Tried 139936 rectangles, computing 46743 f(x) values.
FuncEv 14909 ConstrEv 14909 Iter 924 Maximum rectangle size 1.000000000000000 Optimal points found at x trial #: 4193 CPU time: 374.680000 sec. Elapsed time: 343.318014 sec. Optimal vector x (Length 325. Print first 20): x_k: 1.000000 1.000000 0.000000 1.000000 0.000000 0.000000
0.000000 0.000000 0.000000 0.000000 0.000000 0.000000
0.000000 0.000000 1.000000 1.000000 0.000000 0.000000
0.000000 0.000000
Error in 5 nonlinear constraints. cErr 0.000000e+00 0.000000e+00 0.000000e+00 0.000000e+00 0.000000e+00 TOMLAB found 390 active constraints. The Lagrange multipliers are not unique. Lagrange multipliers:
=== * * * ================================================== * * *
===== * * * =================================================================== * * *
TOMLAB - Tomlab user Demo license 999100. Valid to 2010-08-17
=========================================================================
Problem: --- 1: Wikipedia with NONlinear CPU, real data from trace f_k 0.334030520973002287
Solver: glcDirect. EXIT=0. INFORM=4. Constrained DIRECT - C Implementation Max f(x) evals. Tried total 99547 f(x), 4539 iter. Tried 192981 rectangles, computing 64327 f(x) values.
FuncEv 17584 ConstrEv 17584 Iter 1227 Maximum rectangle size 1.000000000000000 Optimal points found at x trial #: 4193 CPU time: 518.370000 sec. Elapsed time: 482.076711 sec. Optimal vector x (Length 325. Print first 20): x_k: 1.000000 1.000000 0.000000 1.000000 0.000000 0.000000
0.000000 0.000000 0.000000 0.000000 0.000000 0.000000
0.000000 0.000000 1.000000 1.000000 0.000000 0.000000
0.000000 0.000000
Error in 5 nonlinear constraints. cErr 0.000000e+00 0.000000e+00 0.000000e+00 0.000000e+00 0.000000e+00 TOMLAB found 390 active constraints. The Lagrange multipliers are not unique. Lagrange multipliers:
=== * * * ================================================== * * *
===== * * * =================================================================== * * *
TOMLAB - Tomlab user Demo license 999100. Valid to 2010-08-17
=========================================================================
Problem: --- 1: Wikipedia with NONlinear CPU, real data from trace f_k 0.334030520973002287
Solver: glcDirect. EXIT=0. INFORM=4. Constrained DIRECT - C Implementation Max f(x) evals. Tried total 119478 f(x), 5884 iter. Tried 248459 rectangles, computing 82066 f(x) values.
FuncEv 17739 ConstrEv 17739 Iter 1345 Maximum rectangle size 1.000000000000000 Optimal points found at x trial #: 4193 CPU time: 709.810000 sec. Elapsed time: 668.373884 sec. Optimal vector x (Length 325. Print first 20): x_k: 1.000000 1.000000 0.000000 1.000000 0.000000 0.000000
0.000000 0.000000 0.000000 0.000000 0.000000 0.000000
0.000000 0.000000 1.000000 1.000000 0.000000 0.000000
0.000000 0.000000
Error in 5 nonlinear constraints. cErr 0.000000e+00 0.000000e+00 0.000000e+00 0.000000e+00 0.000000e+00 TOMLAB found 390 active constraints. The Lagrange multipliers are not unique. Lagrange multipliers:
=== * * * ================================================== * * *
===== * * * =================================================================== * * *
TOMLAB - Tomlab user Demo license 999100. Valid to 2010-08-17
=========================================================================
Problem: --- 1: Wikipedia with NONlinear CPU, real data from trace f_k 0.331359216176065174
Solver: glcDirect. EXIT=0. INFORM=4. Constrained DIRECT - C Implementation Max f(x) evals. Tried total 139302 f(x), 7102 iter. Tried 306119 rectangles, computing 100365 f(x) values.
FuncEv 18299 ConstrEv 18299 Iter 1218 Maximum rectangle size 1.000000000000000 Optimal points found at x trial #: 102713 CPU time: 1210.750000 sec. Elapsed time: 1165.855409 sec. Optimal vector x (Length 325. Print first 20): x_k: 1.000000 0.000000 1.000000 1.000000 0.000000 1.000000
0.000000 1.000000 1.000000 1.000000 0.000000 0.000000
0.000000 1.000000 0.000000 0.000000 0.000000 0.000000
0.000000 0.000000
Error in 5 nonlinear constraints. cErr 0.000000e+00 0.000000e+00 0.000000e+00 0.000000e+00 0.000000e+00 TOMLAB found 390 active constraints. The Lagrange multipliers are not unique. Lagrange multipliers:
=== * * * ================================================== * * *
===== * * * =================================================================== * * *
TOMLAB - Tomlab user Demo license 999100. Valid to 2010-08-17
=========================================================================
Problem: --- 1: Wikipedia with NONlinear CPU, real data from trace f_k 0.331359216176065174
Solver: glcDirect. EXIT=0. INFORM=4. Constrained DIRECT - C Implementation Max f(x) evals. Tried total 159215 f(x), 8232 iter. Tried 365483 rectangles, computing 119012 f(x) values.
FuncEv 18647 ConstrEv 18647 Iter 1130 Maximum rectangle size 1.000000000000000 Optimal points found at x trial #: 98690 CPU time: 1398.790000 sec. Elapsed time: 1350.012669 sec. Optimal vector x (Length 325. Print first 20): x_k: 1.000000 0.000000 1.000000 1.000000 0.000000 1.000000
0.000000 1.000000 1.000000 1.000000 0.000000 0.000000
0.000000 1.000000 0.000000 0.000000 0.000000 0.000000
0.000000 0.000000
Error in 5 nonlinear constraints. cErr 0.000000e+00 0.000000e+00 0.000000e+00 0.000000e+00 0.000000e+00 TOMLAB found 390 active constraints. The Lagrange multipliers are not unique. Lagrange multipliers:
=== * * * ================================================== * * *
===== * * * =================================================================== * * *
TOMLAB - Tomlab user Demo license 999100. Valid to 2010-08-17
=========================================================================
Problem: --- 1: Wikipedia with NONlinear CPU, real data from trace f_k 0.328719637446106050
Solver: glcDirect. EXIT=0. INFORM=4. Constrained DIRECT - C Implementation Max f(x) evals. Tried total 179014 f(x), 9378 iter. Tried 426055 rectangles, computing 137839 f(x) values.
FuncEv 18827 ConstrEv 18827 Iter 1146 Maximum rectangle size 1.000000000000000 Optimal points found at x trial #: 159037 CPU time: 2471.410000 sec. Elapsed time: 2419.304572 sec. Optimal vector x (Length 325. Print first 20): x_k: 1.000000 0.000000 1.000000 1.000000 0.000000 1.000000
0.000000 1.000000 0.000000 1.000000 0.000000 0.000000
0.000000 1.000000 0.000000 1.000000 0.000000 0.000000
0.000000 0.000000
Error in 5 nonlinear constraints. cErr 0.000000e+00 0.000000e+00 0.000000e+00 0.000000e+00 0.000000e+00 TOMLAB found 390 active constraints. The Lagrange multipliers are not unique. Lagrange multipliers:
=== * * * ================================================== * * *
===== * * * =================================================================== * * *
TOMLAB - Tomlab user Demo license 999100. Valid to 2010-08-17
=========================================================================
Problem: --- 1: Wikipedia with NONlinear CPU, real data from trace f_k 0.328719637446106050
Solver: glcDirect. EXIT=0. INFORM=4. Constrained DIRECT - C Implementation Max f(x) evals. Tried total 198826 f(x), 10452 iter. Tried 487676 rectangles, computing 156054 f(x) values.
FuncEv 18215 ConstrEv 18215 Iter 1074 Maximum rectangle size 1.000000000000000 Optimal points found at x trial #: 127319 CPU time: 2188.360000 sec. Elapsed time: 2139.357651 sec. Optimal vector x (Length 325. Print first 20): x_k: 1.000000 0.000000 1.000000 1.000000 0.000000 1.000000
0.000000 1.000000 0.000000 1.000000 0.000000 0.000000
0.000000 1.000000 0.000000 1.000000 0.000000 0.000000
0.000000 0.000000
Error in 5 nonlinear constraints. cErr 0.000000e+00 0.000000e+00 0.000000e+00 0.000000e+00 0.000000e+00 TOMLAB found 390 active constraints. The Lagrange multipliers are not unique. Lagrange multipliers:
=== * * * ================================================== * * *
===== * * * =================================================================== * * *
TOMLAB - Tomlab user Demo license 999100. Valid to 2010-08-17
=========================================================================
Problem: --- 1: Wikipedia with NONlinear CPU, real data from trace f_k 0.322223973341107306
Solver: glcDirect. EXIT=0. INFORM=4. Constrained DIRECT - C Implementation Max f(x) evals. Tried total 218761 f(x), 11434 iter. Tried 551094 rectangles, computing 173013 f(x) values.
FuncEv 16959 ConstrEv 16959 Iter 982 Maximum rectangle size 1.000000000000000 Optimal points found at x trial #: 172234 CPU time: 2284.030000 sec. Elapsed time: 2229.217602 sec. Optimal vector x (Length 325. Print first 20): x_k: 1.000000 0.000000 1.000000 0.000000 0.000000 1.000000
0.000000 1.000000 1.000000 1.000000 0.000000 0.000000
0.000000 1.000000 0.000000 0.000000 0.000000 0.000000
0.000000 0.000000
Error in 5 nonlinear constraints. cErr 0.000000e+00 0.000000e+00 0.000000e+00 0.000000e+00 0.000000e+00 TOMLAB found 390 active constraints. The Lagrange multipliers are not unique. Lagrange multipliers:
=== * * * ================================================== * * *
===== * * * =================================================================== * * *
TOMLAB - Tomlab user Demo license 999100. Valid to 2010-08-17
=========================================================================
Problem: --- 1: Wikipedia with NONlinear CPU, real data from trace f_k 0.322223973341107306
Solver: glcDirect. EXIT=0. INFORM=4. Constrained DIRECT - C Implementation Max f(x) evals. Tried total 218761 f(x), 11434 iter. Tried 551094 rectangles, computing 173013 f(x) values.
FuncEv 16959 ConstrEv 16959 Iter 982 Maximum rectangle size 1.000000000000000 Optimal points found at x trial #: 172234 CPU time: 2284.030000 sec. Elapsed time: 2229.217602 sec. Optimal vector x (Length 325. Print first 20): x_k: 1.000000 0.000000 1.000000 0.000000 0.000000 1.000000
0.000000 1.000000 1.000000 1.000000 0.000000 0.000000
0.000000 1.000000 0.000000 0.000000 0.000000 0.000000
0.000000 0.000000
=== * * * ================================================== * * *
Servers Assignments -----------------
_tig_auth-ns0.csail.mit.edu.csv ==> 1 _tig_booboo.csail.mit.edu.csv ==> 5 _tig_brave-little-toaster.csail.mit.edu.csv ==> 1 _tig_courses.csail.mit.edu.csv ==> 4 _tig_death.csail.mit.edu.csv ==> 5 _tig_dib.csail.mit.edu.csv ==> 1 _tig_foghorn-leghorn.csail.mit.edu.csv ==> 5 _tig_gentleman-jack.csail.mit.edu.csv ==> 1 _tig_gir.csail.mit.edu.csv ==> 1 _tig_groups.csail.mit.edu.csv ==> 1 _tig_hindenburg.csail.mit.edu.csv ==> 2 _tig_iap.csail.mit.edu.csv ==> 3 _tig_lampang.csail.mit.edu.csv ==> 3 _tig_megatron.csail.mit.edu.csv ==> 1 _tig_metroplex.csail.mit.edu.csv ==> 4 _tig_ns0.csail.mit.edu.csv ==> 3 _tig_ns2.csail.mit.edu.csv ==> 3 _tig_ntp-0.csail.mit.edu.csv ==> 3 _tig_people.csail.mit.edu.csv ==> 5 _tig_postgres-1.csail.mit.edu.csv ==> 3 _tig_projects.csail.mit.edu.csv ==> 5 _tig_rocky-mountain.csail.mit.edu.csv ==> 1 _tig_samurai-jack.csail.mit.edu.csv ==> 4 _tig_squid.csail.mit.edu.csv ==> 5 _tig_tweety.csail.mit.edu.csv ==> 3 _wiki_adler.pmtpa.wmnet.csv ==> 5 _wiki_db1.pmtpa.wmnet.csv ==> 1 _wiki_db10.pmtpa.wmnet.csv ==> 1 _wiki_db11.pmtpa.wmnet.csv ==> 4 _wiki_db12.pmtpa.wmnet.csv ==> 1 _wiki_db13.pmtpa.wmnet.csv ==> 5 _wiki_db14.pmtpa.wmnet.csv ==> 5 _wiki_db15.pmtpa.wmnet.csv ==> 3 _wiki_db16.pmtpa.wmnet.csv ==> 1 _wiki_db17.pmtpa.wmnet.csv ==> 1 _wiki_db18.pmtpa.wmnet.csv ==> 3 _wiki_db2.pmtpa.wmnet.csv ==> 2 _wiki_db20.pmtpa.wmnet.csv ==> 5 _wiki_db21.pmtpa.wmnet.csv ==> 4 _wiki_db22.pmtpa.wmnet.csv ==> 3 _wiki_db23.pmtpa.wmnet.csv ==> 2 _wiki_db24.pmtpa.wmnet.csv ==> 1 _wiki_db25.pmtpa.wmnet.csv ==> 4 _wiki_db26.pmtpa.wmnet.csv ==> 5 _wiki_db27.pmtpa.wmnet.csv ==> 2 _wiki_db29.pmtpa.wmnet.csv ==> 5 _wiki_db3.pmtpa.wmnet.csv ==> 4 _wiki_db30.pmtpa.wmnet.csv ==> 3 _wiki_db31.pmtpa.wmnet.csv ==> 4 _wiki_db32.pmtpa.wmnet.csv ==> 2 _wiki_db33.pmtpa.wmnet.csv ==> 1 _wiki_db35.pmtpa.wmnet.csv ==> 5 _wiki_db36.pmtpa.wmnet.csv ==> 5 _wiki_db37.pmtpa.wmnet.csv ==> 2 _wiki_db38.pmtpa.wmnet.csv ==> 4 _wiki_db39.pmtpa.wmnet.csv ==> 4 _wiki_db4.pmtpa.wmnet.csv ==> 2 _wiki_db40.pmtpa.wmnet.csv ==> 2 _wiki_db5.pmtpa.wmnet.csv ==> 1 _wiki_db7.pmtpa.wmnet.csv ==> 2 _wiki_db8.pmtpa.wmnet.csv ==> 1 _wiki_db9.pmtpa.wmnet.csv ==> 4 _wiki_ixia.pmtpa.wmnet.csv ==> 3 _wiki_storage1.wikimedia.org.csv ==> 1 _wiki_thistle.pmtpa.wmnet.csv ==> 3
TOTAL NUMBER SERVER: 5
