Goals and non-goals
Garage is a lightweight geo-distributed data store that implements the Amazon S3 object storage protocol. It enables applications to store large blobs such as pictures, video, images, documents, etc., in a redundant multi-node setting. S3 is versatile enough to also be used to publish a static website.
Garage is an opinionated object storage solution, we focus on the following desirable properties:
- Internet enabled: made for multi-sites (eg. datacenters, offices, households, etc.) interconnected through regular Internet connections.
- Self-contained & lightweight: works everywhere and integrates well in existing environments to target hyperconverged infrastructures.
- Highly resilient: highly resilient to network failures, network latency, disk failures, sysadmin failures.
- Simple: simple to understand, simple to operate, simple to debug.
We also noted that the pursuit of some other goals are detrimental to our initial goals. The following has been identified as non-goals (if these points matter to you, you should not use Garage):
- Extreme performances: high performances constrain a lot the design and the infrastructure; we seek performances through minimalism only.
- Feature extensiveness: we do not plan to add additional features compared to the ones provided by the S3 API.
- Storage optimizations: erasure coding or any other coding technique both increase the difficulty of placing data and synchronizing; we limit ourselves to duplication.
- POSIX/Filesystem compatibility: we do not aim at being POSIX compatible or to emulate any kind of filesystem. Indeed, in a distributed environment, such synchronizations are translated in network messages that impose severe constraints on the deployment.
Are you also using Garage in your organization? Open a PR to add your use case here!
Deuxfleurs is an experimental non-profit hosting organization that develops Garage. Deuxfleurs is focused on building highly available infrastructure through redundancy in multiple geographical locations. They use Garage themselves for the following tasks:
As a Matrix media backend
As a Nix binary cache
To store personal data and shared documents through Bagage, a homegrown WebDav-to-S3 and SFTP-to-S3 proxy
As a backup target using
In the Drone continuous integration platform to store task logs
The Deuxfleurs Garage cluster is a multi-site cluster currently composed of 9 nodes in 3 physical locations.