Lustre is an OSS clustered file system [Lustre]. 3:01:15 PM    comment []  

A little write up at The New York Times on my favorite little DVD rental service, Netflix [Netflix Uses Speed to Fend Off Wal-mart Challenge]. 2:10:33 PM    comment []  

PhotoSIG is a site with photos posted by many different photographers and discussion lists [photoSIG]. 1:57:15 PM    comment []  

I was telling some people the other day that I thought it would be easy to build a distributed file-system that would have higher throughput, higher capacity and be easier to scale than the big SAN solutions at a fraction of the cost. The key is to build it using commodity hardware and IDE drives (SCSI would be optional). Google has release a papaer on the Google File System [ArsTechnica].

While sharing many of the same goals as previous distributed file systems, our design has been driven by observations of our application workloads and technological environment, both current and anticipated, that reflect a marked departure from some earlier file system assumptions. This has led us to reexamine traditional choices and explore radically different design points.

If I were to consult on a file storage system to be built from scratch, I would most likely suggest a distributed approach. Anyone out there know of any OSS projects to build such a filesystem? 1:55:07 PM    comment []