Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Rust client #8372

Open
offirc2 opened this issue Nov 14, 2024 · 1 comment
Open

Rust client #8372

offirc2 opened this issue Nov 14, 2024 · 1 comment

Comments

@offirc2
Copy link
Contributor

offirc2 commented Nov 14, 2024

We use Rust heavily to interact with LakeFS. However, we were unable to find any published official Rust bindings in crates.io, hence we have to manually check in your OpenAPI spec into our repo, generate bindings and publish to our internal registry ourselves. This also has the big maintenance overhead of us having to keep it up to date with your GitHub. Are there any plans to publish Rust bindings from your side?

@ion-elgreco
Copy link

ion-elgreco commented Nov 22, 2024

@talSofer if you guys release a Rust client officially, then in delta-rs we can start providing native support. Then a commit would be this process:

  • create tnx_branch
    • write parquet
    • do write_commit_entry
      - this puts file in tnx branch
      - tries merge tnx branch to source branch
      - if fails, run conflict checker
      - if can be retried, now only rename commit and try again
      - after X retries still fails, then abort by deleting tnx branch

Currently resources are getting waste because we might do multiple concurrent writes that can fail since we can't merge the branches properly.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants