HawkInsight

  • Contact Us
  • App
  • English

DeepSeek opens source and releases 3FS, a high-speed parallel file system that optimizes AI data access

According to online reports, according to DeepSeek's announcement, on the fifth day of Open Source Week, its Fire-Flyer File System (3FS) was officially open source. As a high-performance parallel file system, 3FS can make full use of modern SSDs and RDMA networks to achieve high-speed data access. Improve AI model training and reasoning efficiency. 3FS key performance indicators: achieve a total read throughput of 6.6 TiB/s in an 180-node cluster; achieve a throughput of 3.66 TiB/minute in the 25-node GraySort benchmark; peak query throughput of single-node KVCache exceeds 40+ GiB/s. 3FS adopts a separate architecture that supports data preprocessing, data set loading, checkpoint storage/recovery, embedded vector search and inferential KVCache queries, and has strong consistent semantics. DeepSeek simultaneously launched the Smallpond data processing framework to further optimize 3FS data management capabilities.

Disclaimer: The views in this article are from the original Creator and do not represent the views or position of Hawk Insight. The content of the article is for reference, communication and learning only, and does not constitute investment advice. If it involves copyright issues, please contact us for deletion.

NewFlashHawk Insight
More