3 month ago
Jeremy Zawodny : Hadoop at Twitter (part 1): Splittable LZO Compression - Hadoop at Twitter (part 1): Splittable LZO Compression: LZO sounds pretty interesting
nelson : LZO + Hadoop - Great article about using compression to make distributed computation faster
# copy5 month ago
Jeremy Zawodny : How We Made GitHub Fast - GitHub - How We Made GitHub Fast - GitHub: good to see stuff like this
Simon Willison : How We Made GitHub Fast - How We Made GitHub Fast. Detailed overview of the new GitHub architecture. It’s a lot more complicated than I would have expected—lots of moving parts are involved in ensuring they can scale horizontally when they need to. Interesting components inc
nelson : GitHub architecture - Nice summary of various server technologies the site uses
# copy10 month ago
nelson : Warehouse scale computers - Long paper from Google about datacenters
# copy16 month ago
Jeremy Zawodny : What Your Computer Does While You Wait - What Your Computer Does While You Wait: this is good but kinda makes me sad too
nelson : Computer speeds - Great details of how CPU, cache, RAM, and bus interact for different latencies.
Rod Begbie : What Your Computer Does While You Wait : Gustavo Duarte - The latencies of the modern computer laid bare. "Waiting for a hard drive seek is like leaving the building to roam the earth for one year and three months." [via] #
# copy25 month ago
nelson : Hadoop + EC2 + S3 = NYT PDF - Nice breakdown of how to use cloud computing services to do a large scale rendering job
# copy25 month ago
nelson : Hadoop success - Yahoo talks about how they do web indexing. Google considers their equivalent system highly proprietary; neat that Hadoop is open source.
# copy
27 month ago
nelson : MapReduce whitepaper - Nice summary, link in comments to full paper. Google's apparently crunching the equivalent of 130,000 computers full time.
# copy
27 month ago
Simon Willison : Eventually Consistent - Eventually Consistent. Werner Vogels explains the trade-offs involved in building scalable, highly-available data stores such as Amazon’s SimpleDB.
jcgregorio : Eventually Consistent - All Things Distributed
joshua : Werner Vogels on Eventually Consistency - design considerations for distributed databases
nelson : Eventually Consistent - Werner breaks down some distributed system design choices
Jeremy Zawodny : Eventually Consistent - Eventually Consistent: somehow I missed this the first time around... Werner does a good job of discussing Amazon's "eventually consistent" model
# copy
31 month ago
nelson : Skype outage cause - Windows update causes reboots causes Skype overload
# copy
34 month ago
Linkorama : Musing about collective intelligence and Agile - "And maybe that’s where collective intelligence should meet Agile. Where we use the power of well-established knowledge bases and tie it up to the experience of a large collective in order to focus on a problem, then use an accelerated evolutionary
# copy
42 month ago
Linkorama : Beyond Technology and Automation - Through experience, we have learned the limitations in our ability to leverage IT to automate quintessentially human tasks, even many seemingly simple ones, no matter how fast our computers have become. I think that the key breakthrough that we have need
# copy
46 month ago
Linkorama : Skype as Future of Connectivity - from the edge: Skype, not "Internet 2" represents the future of connectivity.
# copy
49 month ago
Linkorama : Humans in the Loop - Maybe we should be including some of the early systems thinkers in that remembrance as well. A lot of their big dreams didn't work out, and a few ended tragically. But we now have something they never had: experimental social cybernetics, at the scale of
# copy
49 month ago
Linkorama : Software’s Glorious Revolution - The realization that we are in the midst of a profound revolution in the software industry and that we are witnessing the establishment of a New System of the Software World.
# copy
52 month ago
Linkorama : Collective Choice: Rating Systems - the average of 5 is 4
# copy
53 month ago
Linkorama : What is an information system? - Moral of the story: Information systems don't have to mean information technology (at least not digital information technology)....
# copy
55 month ago
Linkorama : Semi-structured meta-data has a posse - You could make a lot of money or win a lot of bar bets when thinking about the digital realm if you compare technologies between hard or easy, rigorous or sloppy, sophisticated or naïve, expensive or cheap, professional or amateur, and then bet on the
# copy63 month ago
plasticbag : G-Cans photos of Tokyo's massive underground flood and water systems - I was sure I'd posted this before, but I can't find it anywhere on delicious or on the main weblog, so I guess I didn't. Stunning pictures - like something from Quake...
cameron : Tokyo G-Cans project photos - Cavernous pipes for draining water during the typhoon season
# copy63 month ago
plasticbag : Guardian Review of "The Subterranean Railway" by Christian Wolmar - Thanks to the 2lmc-ers for mentioning this. Key quote: "This new book is an entry-level history of the Underground, and it becomes clear from reading it that the faults of the system were built into it from the moment the first sod was turned."
# copy
