Joerg Plewe's Blog

A new DB benchmark in town

Since I've been investigating on persistence recently, I found that performance might be an issue, esp. when thinking about embedded databases.

So I organized a race (very obviously inspired by db4o's Formula1 tutorial) and put the results online in form of the SourceForge project PolePosition

Currently I lined up these database systems for some training laps:

• jdbc
  • MySQL
  • Apache Derby (Cloudscape)
  • HSQLDB
  • McKoi
• db4o
• Hibernate

I started from scratch without having much experience in any of the databases tested. So the code is pretty much unbiased and shows what an average programmer might achieve performance-wise. On the long hand, each database should use the best code possible. For I will never be an expert for that variety of database systems at the same time, making the project opensource gives the possibility for the dedicated experts out there to optimize for their resp. favorite. So please let me know where the code is poor and where improvements are mandatory.

The preliminary results are quite mixed without having one single winner for all purposes. Just take a look at the results yourself.

There are other important benchmarks which are not part of the results published. The 'hassle' or the 'learning curve', the 'lines of code' or 'time for debug' benchmark e.g. just to mention a few. As mentioned earlier, db4o is hard to beat there....

There are more things to come. Anybody volunteering for the JDO team?

Everybody have fun with the code and let me know what you think.

Comments

• People pointed out that these teams sent their cars can be interpreted as these vendors contributed and authorized. This is not the case. It only reflects which database systems I did use for benchmarking.

  Posted by: herkules on March 31, 2005 at 11:55 PM

• People pointed out that these teams sent their cars can be interpreted as these vendors contributed and authorized. This is not the case. It only reflects which database systems I did use for benchmarking.

  Posted by: herkules on April 01, 2005 at 12:12 AM

• Hi there,

  You wouldn't have a skeleton design (may be diagrams or something) of PolePos so I can see how it's structured, would you? I am getting syntax errors and many more other types of errors when I load PolePos onto Eclipse.

  Please help.

  
  

  Posted by: hip33 on August 10, 2005 at 07:53 PM

• Something like that?

  http://www.polepos.org/overview.jpg

  Please note that you have to have JDK5 installed to compile PolePos.
  

  Posted by: herkules on August 11, 2005 at 02:05 PM

• - Something like that?
  - http://www.polepos.org/overview.jpg
  That's great. Thanks for that. I will try to get that into detailed class diagram.

  - Please note that you have to have JDK5 installed to compile PolePos.
  That helps. It's working fine.
  Thanks.
  

  Posted by: hip33 on August 11, 2005 at 06:40 PM

This work is licensed under a Creative Commons License.