Monday, May 31, 2010


Who says old bugs never get any attention?

The number of antique bugs still open is not very big:

mysql> select count(1) from bugs where bug_id < 10000 and bug_status in ("NEW", "ASSIGNED", "REOPENED");
| count(1) |
|       77 |
1 row in set (0.01 sec)

Wednesday, May 26, 2010 gets new database servers

Last weekend we've migrated our MySQL master and slave databases to the newly donated hardware from Intel and Google.  In this case, both servers are Intel SR-2625's with two Xeon e5540 quad-core CPUs and 48G of RAM (courtesy of Google).  The servers also have a nifty RAID array, but the strategy was to avoid touching the disks.  With 48G of RAM, mission accomplished.

Check out the load average for yesterday:

That's a peak of 0.87 for dbmaster, and 1.98 for dbslave, with averages of about 0.50 each.  With 8 CPU cores, this kind of load average is just barely above idle.

Previously, the databases coexisted with the NFS file servers, so there is an inherent double-whammy in performance gains by removing MySQL burden from the NFS servers.

Tuesday, May 18, 2010

I don't see emails like this everyday.

An email with the subject line "CVS is very fast today" gets our immediate attention.

Over the weekend we changed a few mounts on our NFS servers to spread the load a bit better, and to more closely match our classes of service.  As a result, our primary NFS server, which serves files for committer CVS, SVN, Git, and other has-to-be-fast content has seen a drastic reduction in disk load.

Committers should expect drastic improvements in performance to their favourite code repos.

Friday, May 14, 2010

Ewwwww... Get it off of me.

I bought a copy of Windows 7 Professional yesterday to install it on one if the newly donated IBM servers we'll use for testing.  I cried during the entire transaction.

It's not that I don't like to pay for software.  I just don't like paying for Windows.  Yuck.

When I got home I took a cold shower, and showed my 4-year-old how to write shell scripts.