Posted March 26Mar 26 From YouTube and Gmail to BigQuery and Cloud Storage, almost all of Google’s products depend on Colossus, our foundational distributed storage system. As Google’s universal storage platform, Colossus achieves throughput that rivals or exceeds the best parallel file systems, has the management and scale of an object storage system, and an easy-to-use programming model that’s used by all Google teams. Moreover, it does all this while serving the needs of products with incredibly diverse requirements, be it scale, affordability, throughput, or latency. Example applicationI/O sizesExpected performanceBigQuery scanshundreds of KBs to tens of MBsTB/sCloud Storage - standardKBs to tens of MBs100s of millisecondsGmail messagesless than hundreds of KBs10s of millisecondsGmail attachmentsKBs to MBssecondsHyperdisk readsKBs to hundreds of KBs<1 msYouTube video storageMBssecondsView the full article
.png.6dd3056f38e93712a18d153891e8e0fc.png.1dbd1e5f05de09e66333e631e3342b83.png.933f4dc78ef5a5d2971934bd41ead8a1.png)
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.