Silo-Busting MyWord Editor is Now Public
The MyWord Editor and nodeStorage system are a perfect example of what I call a personal cloud application architecture.
Continue reading {Silo-Busting MyWord Editor is Now Public}
nodeStorage and the Personal Cloud Application Architecture
Dave Winer has released a new, general-purpose app backend called nodeStorage. I'm very bullish on this model.
Continue reading {nodeStorage and the Personal Cloud Application Architecture}
Pricing Bulk Cold Storage and Real Engineering
Image by penguincakes via Flickr James Hamilton has put together an analysis of the cost of bulk cold storage. That is, the cost of storing data, including the fully burdened cost of power in a data center, without the associated transport fees. The answer: $0.80/GB/year. Wow--that's cheap. And of course it's getting cheaper. When James did a similar analysis using numbers from two years ago, the cost was $2.50/GB/year. One thought I had as I looked at James' analysis is that we don't teach enough people to do these kinds of calculations. Not that there's anything particularly difficult about
Continue reading {Pricing Bulk Cold Storage and Real Engineering}
Velocity 08: Storage at Scale
Google's reliability strategy is to buy cheap hardware with no reliability features and create reliable clusters from them because no problem Google wants to solve fits on a single machine anyway. The Google File System (GFS) is a cluster file system with a familiar interface, but not POSIX compliant. Bigtable is a distributed database system. This has a custom interface, not SQL. There are 100's of instances of each of these cells scaling in to 1000's of servers and petabytes of data. in the GFS, a master manages metadata. Data is broken into chunks (64Mb) and multiple copies (typically
Continue reading {Velocity 08: Storage at Scale}





