For many years, the personal data of billions of people has been stored on centralized servers owned by big tech giants like Google, Amazon, and Facebook. While these international corporations have built monolithic empires through the collection of vast troves of monetizable data – often without transparency or consent – frequent breaches have repeatedly highlighted their vulnerability.
Research by IBM suggests the United States is the most expensive place to suffer such a breach, with an average cost to organizations of almost $10 million. Thankfully, a new era is beginning to dawn, carried on the winds of change that gusted after the Cambridge Analytica scandal came to light in 2018.
Decentralized data comes of age
Breaches, after all, aren’t always perpetrated by prototypical hackers seeking to commit identity theft or bank fraud. The Cambridge Analytica affair saw the eponymous British consulting firm harvest the data of up to 87 million Facebook profiles without their knowledge, misconduct that later saw CEO Mark Zuckerberg hauled in front of Congress and the social media firm fined $5 billion by the Federal Trade Commission.
In the six years since, solutions to the centralized data problem have emerged, many of them employing cutting-edge web3 technologies like blockchain, zero-knowledge proofs (ZKPs), and self-sovereign identities (SSIs) to put users back in the data driver’s seat. The best of these decentralized storage platforms enable consumers to securely store their information and access it whenever and however they wish – without relinquishing ownership to third parties with ulterior motives.
Alternative data storage systems often incentivize users to contribute storage bandwidth and computing power by paying them in crypto tokens, with data itself encrypted and distributed across a wide network of nodes. In stark contrast to their cloud service provider counterparts, decentralized systems are secure, private, and cost-effective. The main solutions on the market are decentralized file storage networks (DSFN) like Filecoin and Arweave, and decentralized data warehouses like Space and Time (SxT).
A 2024 report by research company Messari pegged the total addressable market for cloud storage at a staggering $80 billion, with 25% annual growth. Despite their relative growth in recent years, decentralized solutions still account for just 0.1% of that market, notwithstanding the 70% lower costs they offer when compared to dominant players like Amazon S3. The potential for disruption is clearly huge.
Despite the furore that erupted after Cambridge Analytica, the dirty data problem hasn’t gone away: major breaches are commonplace, with a report by Apple last year indicating that the total number of data breaches tripled between 2013 and 2022. In the past two years alone, 2.6 billion personal records were exposed – with the problem continuing to worsen in 2023.
A different kind of data warehouse
One of the projects seeking to tackle the data privacy problem head-on is the aforementioned Space and Time (SxT), an AI-powered decentralized data warehouse that represents an alternative to centralized blockchain indexing services, databases, and APIs – all with a core focus on user privacy, security and sovereignty.
Designed to be used by enterprises – whose users will reap the privacy benefits – the comprehensive solution also furnishes businesses with a great deal of utility, supporting transactional queries for powering apps as well as complex analytics for generating insights, thereby negating the need for separate databases and warehouses.
Built to seamlessly integrate with existing enterprise systems, the data warehouse lets businesses tap into blockchain data while publishing query results back on-chain. Thanks to its integration with the Chainlink oracle network, companies can selectively put only the most critical data on the blockchain, avoiding excessive fees. Interestingly, storage on Space and Time’s decentralized network is completely free and data is encrypted in-database for second-to-none security.
One game-changing innovation credited to SxT is Proof of SQL, an zk-SNARK that cryptographically validates the accuracy of SQL operations. In effect, this allows for the querying of sensitive datasets (the purchasing profile of a consumer, for example) while proving that the underlying data wasn’t tampered with and that the computation was performed correctly – since the proof is published on-chain.
From a consumer’s perspective, Space and Time demonstrates how web3 technology can empower individuals with genuine data ownership and privacy. By comparison, centralized data warehouses operated by big tech leave users in the dark about how their sensitive information is stored and handled.
Conclusion
Bringing about a new era of user privacy won’t just be the responsibility of technologists, of course. Consumers themselves should speak out and speak up, holding companies’ feet to the fire when data misuse is exposed. Governments must also take action, and indeed have in some respects with tougher data protection regulations in recent years.
Although decentralized storage remains a nascent field, the implications of putting people, rather than corporations, in charge of their data are enormous. Perhaps the big tech cartel’s reign is finally coming to an end.
Featured image credit: Paul Hanaoka/Unsplash
