Alluxio
Data orchestration layer that sits between compute engines and storage systems, caching data for faster, unified access across the two.
Overview
Alluxio sits between compute frameworks (like Spark or Trino) and one or more underlying storage systems (S3, HDFS, and others), presenting a unified namespace and caching frequently accessed data in memory or on fast local disks to speed up analytics workloads without moving the underlying data. It decouples compute from storage location.
Alluxio is a fit for data platform teams running analytics engines against remote or slow storage who want a caching and unification layer, a distinct role from the object-storage systems (MinIO, SeaweedFS) already in this catalog - it sits in front of storage rather than being storage itself.
- Categories
- Storage
- Languages
- Java
- License
- Apache-2.0
Related Projects
CubeFS
Apache-2.0Distributed filesystem and object storage system built for cloud-native, large-scale data-intensive applications.
- Storage
Appwrite
BSD-3-ClauseOpen-source backend platform providing authentication, databases, storage, functions and realtime APIs, self-hosted or as a managed cloud service.
- Backend
- Database
- Authentication & Security
Ceph
LGPL-2.1Industry-standard distributed storage system providing object, block, and file storage from a single unified cluster.
- Storage
JuiceFS
Apache-2.0Distributed POSIX filesystem that stores data on object storage like S3, combining familiar filesystem semantics with cloud-scale storage.
- Storage
Spotted an error? Suggest an edit on GitHub.