Hudson River Trading's distributed file system for comparison: <a href="https://www.hudsonrivertrading.com/hrtbeat/distributed-filesystem-for-scalable-research/" rel="nofollow">https://www.hudsonrivertrading.com/hrtbeat/distributed-files...</a>

Over 500PB of data, wow. Would love to know how and why "statistical models that produce price forecasts for over 50,000 financial instruments worldwide" require that much storage.

> Most of the metadata activity is contained within a single shard: > > - File creation, same-directory renames, and deletion. > - Listing directory contents. > - Getting attributes of files or directories.<p>I guess this is a trade-off between a file system and an object store? As in S3, ListObjects() is a heavy hitter and there can be potentially billions of objects under any prefix. Scanning only on a single instance won't be sufficient.

Cool project and kudos for open sourcing it. Noteworthy limitation:<p>> TernFS should not be used for tiny files — our median file size is 2MB.

That was a good read. Compliments to the chefs.<p>It'd be helpful to have a couple of usage examples that illustrate common operations, like creating a file or finding and reading one, right after the high-level overview section. Just to get an idea what happens at the service level in these cases.

> The firm started out with a couple of desktops and an NFS server, and 10 years later ended up with tens of thousands of high-end GPUs, hundreds of thousands of CPUs, and hundreds of petabytes of storage.<p>So much resources for producing nothing of real value. What a waste.<p>Great project though, appreciate open sourcing it.

Thanks a lot. Regarding your company, it is really hard for me to understand, what XTX is actually doing. Trading? VC? AI/ML?

How does TernFS compare to CephFS and why not CephFS, since it is also tested for the multiple Petabyte range?

Wow, great project.

Thanks for sharing.

GPLv2-or-later, in case you were wondering <a href="https://github.com/XTXMarkets/ternfs/blob/7a4e466ac655117d24400dc17f817a4ed6e7c9ca/README.md#licensing" rel="nofollow">https://github.com/XTXMarkets/ternfs/blob/7a4e466ac655117d24...</a>

seems like a colossusly nice design.

[dead]

Ha ha, I forecast, SPY goes up, and I’ve already made more money than XTX or any of its clients…<p>Look I like technology as much as anyone. Improbable spent $500 million on product development, and its most popular product is its grpc-web client. It didn't release any of its exotic technology. You could also go and spend that money on making $500m of games without any exotic technology, and also make it open source.

This sounds like it would be a good underpinning for a decentralized blockchain file storage system with its focus on immutability and redundancy.