2 days ago
Anil : Details of Execution - Sometimes if you do something very difficult, and you do it really well, the end result is that your achievement becomes completely invisible. I mentioned a year and a half ago that I like Twitter. That was a little bit less common a position to take b
# copy
12 days ago
Anil : Details of Execution - Sometimes if you do something very difficult, and you do it really well, the end result is that your achievement becomes completely invisible. I mentioned a year and a half ago that I like Twitter. That was a little bit less common a position to take b
# copy12 days ago
Anil : Details of Execution - Sometimes if you do something very difficult, and you do it really well, the end result is that your achievement becomes completely invisible. I mentioned a year and a half ago that I like Twitter. That was a little bit less common a position to take b
# copy
2 month ago
Simon Willison : Queue everything and delight everyone - Queue everything and delight everyone. Les Orchard explains why I’ve been getting interested in queues recently: “One of the problems it seems most modern web apps face is the tendency to want to do everything all at once, and all in the same code t
Rod Begbie : Queue everything and delight everyone - Good thoughts from Les Orchard -- Your webapps don't have to do all your work the second a user clicks the button on a form. Queue up tasks and respond quickly, and everyone wins. #
Linkorama : Queue everything and delight everyone - The idea here is that the social structure can help you scale, while still delighting people.
# copy
4 month ago
bmilleare : sparrow - Sparrow is a really fast lightweight queue written in Ruby that speaks memcache.
# copy
4 month ago
joshua : Preparing For EC2 Persistent Storage
bmilleare : Preparing For EC2 Persistent Storage - Awesome write-up for preperation of persistent storage on AWS
# copy
4 month ago
deusx : I'm Going To Scale My Foot Up Your Ass - Ted Dziuba - "Shut up about scalability, no one is using your app anyway."
Jeremy Zawodny : I'm Going To Scale My Foot Up Your Ass - Ted Dziuba - I'm Going To Scale My Foot Up Your Ass - Ted Dziuba: hahahhahahahaahahhahha... so true
# copy
4 month ago
deusx : random($foo): Internet Asshattery, Armchair Scaling Experts Edition - "it really is true that if you haven't done it, that is: been intimately involved growing a social web app from prototype to large/giant-scale on a UNIX stack, then you really don't know shit."
Kellan : random($foo): Internet Asshattery, Armchair Scaling Experts Edition - I miss Leonard, Gordon, and Andy. But now that they’ve dispersed from Big Purple it’s nice to see all three of them schooling the internet in what real tech reporting might look like. You almost forget how bad it’s gotten until you see #
Simon Willison : Internet Asshattery, Armchair Scaling Experts Edition - Internet Asshattery, Armchair Scaling Experts Edition. Leonard says what needs to be said about the most recent case of Twitter scaling flame-bait. [via]
# copy
4 month ago
Jeremy Zawodny : Scaling out MySQL: Hardware today and tomorrow - Scaling out MySQL: Hardware today and tomorrow: good talk slides
bmilleare : Scaling out MySQL: Hardware today and tomorrow - Good slides.
# copy
5 month ago
Simon Willison : Amazon takes EC2 to the next level with persistent storage volumes - Amazon takes EC2 to the next level with persistent storage volumes. You can store a snapshot of a storage volume to S3 with a single API call, making backups trivial.
Jeremy Zawodny : Amazon takes EC2 to the next level with persistent storage volumes - Amazon takes EC2 to the next level with persistent storage volumes: good to hear how well baked this appears to be
bmilleare : Amazon takes EC2 to the next level with persistent storage volumes - This is potentially game-changing in the cloud computing dept.
# copy
5 month ago
deusx : Tom White: "Disks have become tapes" - "In essence MapReduce works by repeatedly sorting and merging data that is streamed to and from disk at the transfer rate of the disk. Contrast this to accessing data from a relational database that operates at the seek rate of the disk"
Matthew M. Boedicker : thinking of disks as a sequential device rather than a random access device - (via reddit) [via]
# copy
5 month ago
deusx : Working Notes on Consistent Hashing - Laughing Meme - "Nice to see consistent hashing go from obscure to blindingly obvious in a few short whitepapers. "
# copy
6 month ago
Simon Willison : Consistent Hashing - Consistent Hashing. Beautifully clear explanation of consistent hashing, a simple technique that allows you to add new caching servers to a cluster without re-hashing your keys and hence invalidating all of your caches.
deusx : Programmer’s Toolbox Part 3: Consistent Hashing | Spiteful.com - "Consistent hashing is a powerful idea for anyone building services that have to scale across a group of computers."
# copy
6 month ago
Simon Willison : Two data streams for a happy website - Two data streams for a happy website. Useful architectural concept for scaling: keep user-specific and generic data separate from the start, in recognition of their different caching and partitioning constraints.
deusx : Gojko Adzic » Two data streams for a happy website - "One of the most important architectural decisions that must be done early on in a scalable web site project is splitting the data flow into two streams: one that is user specific and one that is generic."
# copy
9 month ago
Linkorama : Amazon SimpleDB 101 - This service works in close conjunction with Amazon Simple Storage Service (Amazon S3) and Amazon Elastic Compute Cloud (Amazon EC2), collectively providing the ability to store, process and query data sets in the cloud.
# copy
9 month ago
deusx : Beanstalkd - Software - xph.us - "beanstalkd is a fast, distributed, in-memory workqueue service."
factoryjoe : Beanstalkd - Software - xph.us - beanstalkd is a fast, distributed, in-memory workqueue service. Its interface is generic, but is intended for use in reducing the latency of page views in high-volume web applications by running most time-consuming tasks asynchronously.
Simon Willison : Beanstalkd - Beanstalkd. This is the light-weight cross-language queue I’ve been waiting for. Similar to Starling but your workers don’t need to poll for new jobs; you can call the blocking “reserve” call instead.
bmilleare : Beanstalkd - Nice queuing daemon - beats using Amazon SQS IMO
# copy10 month ago
Linkorama : Coming Soon, Free Hosting for Facebook Apps - Joyent is like an industrial strength special purpose Amazon EC-3 platform for RoR
# copy
12 month ago
jcgregorio : Advanced Topics in Programming Languages: Concurrency/message passing Newsqueak - Awesome talk by Rob Pike on Newsqueak. Hits a lot of topics close to my heart like message passing, etc. Must see if you are watching the rising interest in Erlang.
# copy
14 month ago
Simon Willison : YouTube Scalability Talk - YouTube Scalability Talk. Kyle Cordes’ notes on a Google Tech Talk on scaling YouTube by Cuong Do.
joshua : YouTube Scalability Talk - nice summary
# copy14 month ago
nelson : Flickr capacity talk - Lots of details about how a big webapp cluster works
# copy
16 month ago
Simon Willison : The top 10 presentations on scaling websites: twitter, Flickr, Bloglines, Vox and more. - The top 10 presentations on scaling websites: twitter, Flickr, Bloglines, Vox and more.. I normally avoid linking to “top 10” lists on principle, but this one pulls together some great resources and adds some extra context to each one.
jcgregorio : The top 10 presentations on scaling websites: twitter, Flickr, Bloglines, Vox and more. - Doesn't cover Google or eBay, but still a good list.
jimray : The top 10 presentations on how to scale websites - Flickr, Bloglines, Vox, etc - learn how to build strong sites
bmilleare : The top 10 presentations on scaling websites: twitter, Flickr, Bloglines, Vox and more.
nelson : System scaling - Collection of videos on how they make systems scale
joshua : A bunch of presentations on scaling websites: twitter, Flickr, Bloglines, Vox and more.
philgyford : Peter Van Dijck’s Guide to Ease » Blog Archive » A bunch of presentations on scaling websites: twitter, Flickr, Bloglines, Vox and more. - The kind of thing I keep meaning to read up on. (via Kottke)
# copy
16 month ago
nelson : Perfect DB storage - SmugMug's idea on what makes a great RAID array for MySQL
bmilleare : The Perfect DB Storage Array
# copy
17 month ago
Linkorama : Twitter trouble - In any case, I'm proud that Twitter is having to push the envelope on scaling Rails. Fielding 11,000+ requests per second is no small feat for any dynamic web application. Once the stress of having to deal with that in the moment subsides, I'm convinced t
# copy
19 month ago
jcgregorio : Ning | Developer Blog » Blog Archive » Rocky and App Core Scaling - Yet another non-relational db story
# copy
