Posts with keyword: scaling


Reactive Programming with Picos

This is an introduction to picos as a method for doing reactive programming. The article contains many links to other, more detailed articles about specific topics. You can thus consider this an index to a detailed look at how picos work and how they can be programmed.
Continue reading {Reactive Programming with Picos}


Velocity 08: Storage at Scale

Google's reliability strategy is to buy cheap hardware with no reliability features and create reliable clusters from them because no problem Google wants to solve fits on a single machine anyway. The Google File System (GFS) is a cluster file system with a familiar interface, but not POSIX compliant. Bigtable is a distributed database system. This has a custom interface, not SQL. There are 100's of instances of each of these cells scaling in to 1000's of servers and petabytes of data. in the GFS, a master manages metadata. Data is broken into chunks (64Mb) and multiple copies (typically
Continue reading {Velocity 08: Storage at Scale}