Thursday, May 01, 2008

Dash Hits the Fast Lane

The Dash Project's commits explorer has been a popular site since Bjorn and Ward first brought it out. Nick Boldt contributed a bunch of additional scripts and gave it a face lift and I added SVN integration. There is a lot of interesting data, but you always had to really want it. Dash was always that old motor home lumbering in the slow lane. Useful, and full of great stuff, but slow. We've had a lot of commits in the whole history of Eclipse and that leads to lots of data, which leads to slow queries.

AMD to the rescue! We migrated the Dash back-end database to one of our spanking new AMD servers (pebbles) while leaving the front end on the same vserver that has hosted it for the last 9 months or so. Here are some numbers Denis (who did most of the leg work) ran for comparison:

SELECT YEAR AS X, COMPANY AS Y, COUNT(*) AS COUNT FROM commits WHERE TOPPROJECT LIKE 'eclipse' AND PROJECT LIKE 'eclipse.platform' GROUP BY YEAR, COMPANY;

dash: 17.83s
pebbles: 2.66s

That's huge...

SELECT YEAR AS X, PROJECT AS Y, COUNT(*) AS COUNT FROM commits WHERE TOPPROJECT LIKE 'technology' GROUP BY YEAR, PROJECT

dash: 1m7.64s
pebbles: 6.47s

HOLY SMOKES. That's a bit different.

SELECT YEAR AS X, PROJECT AS Y, COUNT(*) AS COUNT FROM commits WHERE TOPPROJECT LIKE 'tools' GROUP BY YEAR, PROJECT

dash: 8.56s
pebbles: 1.74s

Try it out... if you remember that old lumbering motor home, you'll like the new big block transplant and aerodynamic treatment.

1 Comments:

Anonymous Denis Roy said...

Didn't you read the memo? I'm working on speeding up Bugzilla too. Coffee will be obsolete.

11:07 AM  

Post a Comment

<< Home