Comments on: Scaling on EC2

By: John

John — Fri, 05 Dec 2008 20:27:37 +0000

Great post! Thanks for sharing your architecture!

By: Rob

Rob — Tue, 22 Jul 2008 14:09:31 +0000

@Mathew That benchmark doesn’t really give a very clear picture. It looks like it’s done with a very naieve Solr setup. Solr can gain a *lot* with a bit of configuration and playing around with much resource you let it use.

By: The Burgeoning Openly Owned Web » links for 2008-07-22

The Burgeoning Openly Owned Web » links for 2008-07-22 — Tue, 22 Jul 2008 00:45:48 +0000

[...] Scaling on EC2 « WebMynd Blog An article written about scaling on the EC2 cloud. Somewhat useful. (tags: ec2 scalability amazon architecture scaling cloud) [...]

By: andy.edmonds.be › links for 2008-07-22

andy.edmonds.be › links for 2008-07-22 — Tue, 22 Jul 2008 00:38:37 +0000

[...] Scaling on EC2 « WebMynd Blog An article written about scaling on the EC2 cloud. Somewhat useful. (tags: ec2 scalability amazon architecture scaling cloud) [...]

By: James Brady

James Brady — Tue, 15 Jul 2008 07:51:24 +0000

@Karthik Yes, we did consider SimpleDB; the pricing and scaling characteristics is a convincing case for some situations. However, for us, we really felt like we needed full relational capabilities.

When you’re dealing with innately relational schemas, to use flat databases like SimpleDB and BigTable you need to denormalise your data to match the capabilities of the database. If an RDBMS can scale to match your needs (and in our case it can, easily), then it would be premature optimisation to trade in simplicity and functionality for scalability which might never be used.

By: Interesting Finds: 2008.07.15 - gOODiDEA.NET

Interesting Finds: 2008.07.15 - gOODiDEA.NET — Tue, 15 Jul 2008 00:42:32 +0000

[...] Scaling on EC2 [...]

By: Karthik

Karthik — Sat, 12 Jul 2008 17:49:19 +0000

James

Very intuitive and informative post. I was curious if you guys contemplated using Amazon’s SimpleDB as your database. I know it does not have all the bells and whistles of a traditional RDBMS , but given the reliability and scalability don’t you think it is worthwhile to give SimpleDB a shot.

By: items for 07.11.2008 « Tzetze Fly

items for 07.11.2008 « Tzetze Fly — Sat, 12 Jul 2008 13:01:06 +0000

[...] Scaling on EC2 – WebMynd Blog Interesting post about how WebMynd is scaling quickly using EC2, Solr, and nginx. (tags: ec2 scalability architecture solr) [...]

By: scott

scott — Fri, 11 Jul 2008 16:15:39 +0000

Thanks James. Much appreciated!

By: James Brady

James Brady — Fri, 11 Jul 2008 16:11:41 +0000

@scott Hi, yes that linkage from frontend to app server was definitely one we spent a lot of time experimenting with.

The current best setup we have is to run several standalone TurboGears instances, with the built-in CherryPy webserver, directly behind HAProxy.

In that scenario, running TG behind mod_python, mod_proxy or whatever else just isn’t necessary (and we found it really hurt performance). I really like the look of some of WSGI’s features, but we found support for it to be slightly flaky in the TG 1.x branch (can’t wait to try TG 2!)