Skip to main content

New SPECjAppServer scores for Glassfish

Posted by sdo on December 14, 2006 at 3:47 PM PST

Today, Sun releases version 9.0 Update Release 1 Patch 1 of its application server (quite a mouthful!). See what's new in this release.

From my perspective, its most important fix is to a bug that caused the SPEC organization to mark our previously submitted SPECjAppServer scores as non-compliant. This allowed us to resubmit results on this benchmark.

Accordingly, a few weeks ago we resubmitted results on the Sun Fire T2000 Cool Threads server. This is clearly a machine of choice for Java EE applications, as almost every application server vendor who has submitted results for this benchmark has done so on that hardware.

This result is also the first benchmark in the industry to use the new, just-released, Java 6 JDK, which has some pretty impressive performance results to boast about as well.

The results show that glassfish is still clearly the price-performance leader for the application server tier.

Application Server Vendor    SPECjAppServer2004 JOPS@Standard    Application Tier $/SPECjAppServer2004 JOPS@Standard
Sun Java Systems AS 9.0 UR1 Patch 1 521.42 $51.81
BEA Weblogic 9.0 615.64 ??
IBM WebSphere 6.1 616.22 $122.13

Notes on pricing data: Pricing is calculated on the acquisition cost for the application server tier hardware and software. Pricing for the application server hardware is from http://www.sun.com/. Pricing for IBM WebSphere is from http://www.cdw.com/. All pricing is list pricing as of 12/14/06.

I'd really like to include BEA's cost in the above table, but BEA doesn't have transparent pricing. http://www.awaretechnologies.com/ has a price for a single core license of BEA 8.1 Advantage Edition at $10K. At that price, BEA would come in at $60.13/JOP. But of course, the T2000 has 8 cores, and BEA list price on that machine is likely closer to $20K, leaving them at $76.37/JOP. Alas, to be truly accurate, you'll have to get your BEA rep to give you their list price, and do the math yourself: ($26917 (HW price including OS Media) + BEA list Price) / 615.64.

More disclosures: SPEC and the benchmark name SPECjAppServer 2004 are registered trademarks of the Standard Performance Evaluation Corporation. Competitive benchmark results stated above reflect results published on www.spec.org as of 12/14/06. The comparison presented is based on application servers run on the Sun Fire T2000 1.2 ghz server. For the latest SPECjAppServer 2004 benchmark results, visit http://www.spec.org/.

Related Topics >>