Large datasets are stored [[Off-Chain Data Management with IPFS and Filecoin|off-chain]] using IPFS, supplemented by a custom replication management layer implemented through [[Substrate]]'s [[Proof Pods in the Data Marketplace|off-chain workers]] that implements periodic health checks and incentive-driven replication. Specifically, the marketplace includes: - A tracker service that monitors [[ZKP/ZKP Base Layer/ZKP Blockchain/Storage Layer/On-Chain Metadata Storage|content addressable storage]] (CAS) object availability across the network through off-chain worker coordination - Economic incentives tied to the [[Proof of Space (PoSp)]] mechanism managed through custom pallets that reward storage providers proportionally to both their uptime and replication support - A redundancy coordinator implemented as a Substrate pallet that automatically initiates new storage requests when availability metrics drop below threshold Through these mechanisms, the system [[ZKP/ZKP Base Layer/ZKP Blockchain/Performance/Storage Layer|targets 99.9% availability]] while acknowledging that actual performance will require extensive testnet validation. This hybrid model stores metadata in Patricia Tries while keeping data off-chain, reducing blockchain bloat while maintaining decentralized storage principles. See also: [[ZKP/Data Marketplace/High-Level Overview/Smart Contract Operations|Smart Contract Operations]]