Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Snapshot summary map must have operation key #11354

Open
wants to merge 4 commits into
base: main
Choose a base branch
from

Conversation

kevinjqliu
Copy link
Contributor

@kevinjqliu kevinjqliu commented Oct 19, 2024

This PR adds additional constraints in the SnapshotParser and also includes tests to verify the behaviors.

Snapshot's summary field is optional in V1 but required in V2. See https://iceberg.apache.org/spec/#snapshots
When serializing Snapshot to JSON, if the summary field exists, the operation key must also exist (code). In other words, the summary field without the operation key is considered invalid.

Devlist discussion https://lists.apache.org/thread/h9qmrmlgxh91ol0y2v8olt90b9q6p9xr
Relates to apache/iceberg-python/#1106

@kevinjqliu kevinjqliu marked this pull request as ready for review October 19, 2024 19:59
@github-actions github-actions bot added the core label Oct 19, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant