Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Conditional Writes to object store #9

Open
naveen246 opened this issue Oct 12, 2024 · 1 comment
Open

Conditional Writes to object store #9

naveen246 opened this issue Oct 12, 2024 · 1 comment

Comments

@naveen246
Copy link
Collaborator

naveen246 commented Oct 12, 2024

We are currently using thanos-io/objstore lib to write to object store.
Right now we have a putIfNotExists() method which is not atomic.
https://github.com/slatedb/slatedb-go/blob/v0.1.3/slatedb/object_store.go#L39

The thanos-io/objstore library does not yet have an API that supports conditional writes.
https://aws.amazon.com/about-aws/whats-new/2024/08/amazon-s3-conditional-writes/

They have an open issue for it.
thanos-io/objstore#129

See if we wait for them to implement or explore using other libraries ?
https://github.com/minio/minio-go
https://github.com/apache/opendal/tree/main/bindings/go
apache/opendal#5097

Relevant discussion:
slatedb/slatedb#45

@Xuanwo
Copy link

Xuanwo commented Nov 16, 2024

Conditional Writes are now supported within opendal, and we are eager to extend this support to the OpenDAL Go binding. Please let me know if you need any assistance in this area.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants