I was reading this fancy article Twitter, Rails, Hammers, and 11,000 Nails per Second and had to stop at the first sentence because of this word, kerfuffle. Say it with me; kerfuffle.
There’s an interesting kerfluffle going on regarding the scaling woes that Twitter.com is going through, especially since it’s built on Ruby […]
Hive was developed iteratively by a 2 or 3 person team (I think Jeff Hammerbacher was also involved) making it easy for business analysts to ask ad hoc questions of terabytes worth of logfile data by abstracting MapReduce into a SQL like dialect. Think of it as a data warehouse sitting on top […]
Dr Nic comments on Friends for Sale Architecture - A 300 Million Page View/Month Facebook Ruby on Rails App with this gem:
Um you guys probably weren’t at the meeting when it was decided that “Rails doesn’t scale”. I’ll forgive you this once, but don’t let me catch you scaling Rails again.
Protip: if you are starting a business whose success hinges on scalability of a data store, you had best figure out how to shard across N machines before you launch. Using a single instance of MySQL for the whole thing is a strong indicator that you have failed at life. […]
The numbers are looking good for EC2. Read Live Blogging Experiment Results - Sitening.com for the full details, below are the important numbers.
7 pictures 130 text posts 20k visits 50k pageviews to the page 5M requests - this includes the 15 second content refresh and the […]
Last year I was just observing the revolution when I spoke of inverting the CPU model into a rented hourly service for machine images. Now Amazon is asking “Who needs a search engine packed as an AMI? I say, who doesn’t? We’ve been watching desktop search happen in every company from […]
I am a certified dork because papers about boarding airplanes interest me.
Analog Concurrency: Boarding a Plane Linked from the above in the comments is this paper: Novel Approaches to Airplane Boarding (PDF Link)
Google is holding a conference in Seattle about scalability They are accepting papers now and will open up registration in a while. The conference will take place June 23, 2007 at Google’s Seattle office.
If you have a great new idea for handling a growing system or an innovative approach to […]
It’s time to re-examine those long running batch jobs. Could you partition the data to allow for MapReduce? I bet you can. I know I’ve always wanted an affordable way to fire up 30 servers and run MapReduce operations against giant datasets, it’s confirmed; I’m a dork.
Tom […]
Digipede Evangelista Kim Greenlee will be giving a talk on concurrency and software development at the .NET Developer Association Monday on the Microsoft campus. dan ciruli’s West Coast Grid
If I didn’t already have plans Monday, I’d be at this talk. Sure it’s over in Redmond, but it sounds really interesting.
[…]