Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Pg 17 Incremental backup support for Barman Cloud #1039

Open
vladimirfx opened this issue Dec 10, 2024 · 0 comments
Open

Pg 17 Incremental backup support for Barman Cloud #1039

vladimirfx opened this issue Dec 10, 2024 · 0 comments

Comments

@vladimirfx
Copy link

Please consider the implementation of incremental backups for the Cloud variant.

Motivation:

Now Barman Cloud (in contract to Barman) is the weakest backup option on the 'cloud' market because it lacks incremental backup support. Moreover, it kills any chance of deduplication on the storage side because of 100Gb tar blobs that are always unique instead of Pg data files themselves. As a result, Barman Cloud archives are up to 10 times bigger than PgBackrest or WAL-G for a 1-1.5Tb database with moderate update activity. It's a practical observation based on running a CNPG-based cluster, so incremental backups are a game changer for us (now is a stopper for us to fully adoption of CNPG on cluster > 1Tb).

Implementing support for Pg 17 incremental backups does not require a complete change of Braman Cloud architecture but mostly metadata and logic enhancements. In that way, tar archives can't be deduplicated but will be much smaller than now (of course for incremental backups only).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant