Apache Iceberg 1.6.0

What's Changed

• API, Spark 3.3: Remove all usages of deprecated AssertHelpers by @findepi in #10500
• API: Fix default FileIO#newInputFile ManifestFile, DataFile and DeleteFile implementation to pass lengths by @amogh-jahagirdar in #9953
• AWS, Core: Replace .withFailMessage() usage with .as() by @nastra in #10000
• AWS: Fix TestGlueCatalogTable#testCreateTable by @aajisaka in #10221
• AWS: Make sure Signer + User Agent config are both applied by @nastra in #10198
• AWS: Retain Glue Catalog column comment after updating Iceberg table by @lawofcycles in #10276
• AWS: Retain Glue Catalog table description after updating Iceberg table by @aajisaka in #10199
• AWS: Support S3 DSSE-KMS encryption by @aajisaka in #8370
• AWS: close underlying executor for DynamoDb LockManager by @regadas in #10132
• Add 13 Dremio Blogs + Fix a few incorrect dates by @AlexMercedCoder in #9967
• Add EnumConfParser to SparkConfParser by @huaxingao in #10311
• Add Pagination To List Apis by @rahil-c in #9782
• Add bloom filter fpp config by @huaxingao in #10149
• Add checkstyle rule for uppercase constant fields by @attilakreiner in #10673
• Add issue template and docs for iceberg proposals by @danielcweeks in #9932
• Add local nightly build to test current docs changes by @bitsondatadev in #9943
• Add stale PRs management by @jbonofre in #10134
• Add support for providing output-spec-id during rewrite - spark 3.5 by @himadripal in #9803
• Address Intellij inspection findings by @snazy in #10583
• Allow Java 17 in contribute.md by @findepi in #10545
• Apply IntelliJ inspection findings to older Spark + Flink versions by @snazy in #10625
• Avoid adding a closed client to the pool by @flyrain in #10337
• Aws: Add Iceberg version to UserAgent in S3 requests by @CsengerG in #9963
• Backport Flink 1.18 JUnit5 migration to Flink 1.17 by @tomtongue in #10163
• Backport HadoopCatalog related classes in Flink by @tomtongue in #10620
• Backport source package changes in Flink to other versions by @tomtongue in #10663
• Basic manifest encryption by @ggershinsky in #8252
• Build: Align Jackson versions by @nastra in #9925
• Build: Bump Nessie to 0.90.4 by @adutra in #10492
• Build: Bump Nessie to 0.91.2 by @adutra in #10563
• Build: Bump Spark 3.5 to 3.5.1 by @manuzhang in #9832
• Build: Bump arrow from 15.0.0 to 15.0.1 by @dependabot in #9910
• Build: Bump arrow from 15.0.1 to 15.0.2 by @dependabot in #10034
• Build: Bump com.azure:azure-sdk-bom from 1.2.20 to 1.2.21 by @dependabot in #9857
• Build: Bump com.azure:azure-sdk-bom from 1.2.21 to 1.2.22 by @dependabot in #10071
• Build: Bump com.azure:azure-sdk-bom from 1.2.22 to 1.2.23 by @dependabot in #10238
• Build: Bump com.azure:azure-sdk-bom from 1.2.23 to 1.2.24 by @dependabot in #10420
• Build: Bump com.azure:azure-sdk-bom from 1.2.24 to 1.2.25 by @dependabot in #10652
• Build: Bump com.esotericsoftware:kryo from 4.0.2 to 4.0.3 by @dependabot in #9984
• Build: Bump com.google.cloud:libraries-bom from 26.28.0 to 26.43.0 by @dependabot in #10699
• Build: Bump com.google.errorprone:error_prone_annotations from 2.24.1 to 2.26.1 by @dependabot in #9972
• Build: Bump com.google.errorprone:error_prone_annotations from 2.26.1 to 2.27.0 by @dependabot in #10236
• Build: Bump com.google.errorprone:error_prone_annotations from 2.27.0 to 2.28.0 by @dependabot in #10418
• Build: Bump com.gorylenko.gradle-git-properties:gradle-git-properties from 2.4.1 to 2.4.2 by @dependabot in #10239
• Build: Bump com.palantir.gradle.gitversion:gradle-git-version from 3.0.0 to 3.1.0 by @dependabot in #10468
• Build: Bump datamodel-code-generator from 0.25.4 to 0.25.5 by @dependabot in #9979
• Build: Bump datamodel-code-generator from 0.25.5 to 0.25.6 by @dependabot in #10242
• Build: Bump datamodel-code-generator from 0.25.6 to 0.25.7 by @dependabot in #10507
• Build: Bump datamodel-code-generator from 0.25.7 to 0.25.8 by @dependabot in #10649
• Build: Bump gradle.plugin.io.morethan.jmhreport:gradle-jmh-report from 0.9.0 to 0.9.6 by @dependabot in #10193
• Build: Bump guava from 33.0.0-jre to 33.1.0-jre by @dependabot in #9977
• Build: Bump guava from 33.1.0-jre to 33.2.0-jre by @dependabot in #10271
• Build: Bump guava from 33.2.0-jre to 33.2.1-jre by @dependabot in #10414
• Build: Bump io.airlift:aircompressor from 0.26 to 0.27 by @dependabot in #10383
• Build: Bump io.delta:delta-spark_2.12 from 3.1.0 to 3.2.0 by @dependabot in #10320
• Build: Bump io.delta:delta-standalone_2.12 from 3.1.0 to 3.2.0 by @dependabot in #10321
• Build: Bump io.github.goooler.shadow:shadow-gradle-plugin from 8.1.7 to 8.1.8 by @dependabot in #10612
• Build: Bump io.netty:netty-buffer from 4.1.107.Final to 4.1.108.Final by @dependabot in #10032
• Build: Bump io.netty:netty-buffer from 4.1.108.Final to 4.1.109.Final by @dependabot in #10191
• Build: Bump io.netty:netty-buffer from 4.1.109.Final to 4.1.110.Final by @dependabot in #10384
• Build: Bump io.netty:netty-buffer from 4.1.110.Final to 4.1.111.Final by @dependabot in #10504
• Build: Bump jetty from 9.4.53.v20231009 to 9.4.54.v20240208 by @dependabot in #9982
• Build: Bump jetty from 9.4.54.v20240208 to 9.4.55.v20240627 by @dependabot in #10654
• Build: Bump kafka from 3.6.1 to 3.7.0 by @dependabot in #9855
• Build: Bump kafka from 3.7.0 to 3.7.1 by @dependabot in #10653
• Build: Bump mkdocs-material from 9.5.14 to 9.5.15 by @dependabot in #10031
• Build: Bump mkdocs-material from 9.5.15 to 9.5.17 by @dependabot in #10092
• Build: Bump mkdocs-material from 9.5.17 to 9.5.18 by @dependabot in #10189
• Build: Bump mkdocs-material from 9.5.18 to 9.5.19 by @dependabot in #10241
• Build: Bump mkdocs-material from 9.5.19 to 9.5.21 by @dependabot in #10272
• Build: Bump mkdocs-material from 9.5.21 to 9.5.23 by @dependabot in #10353
• Build: Bump mkdocs-material from 9.5.23 to 9.5.25 by @dependabot in #10413
• Build: Bump mkdocs-material from 9.5.25 to 9.5.26 by @dependabot in #10464
• Build: Bump mkdocs-material from 9.5.26 to 9.5.27 by @dependabot in #10555
• Build: Bump mkdocs-material from 9.5.27 to 9.5.28 by @dependabot in #10648
• Build: Bump mkdocs-material from 9.5.9 to 9.5.14 by @dependabot in #9983
• Build: Bump nessie from 0.77.1 to 0.79.0 by @dependabot in #9976
• Build: Bump nessie from 0.79.0 to 0.80.0 by @dependabot in #10237
• Build: Bump nessie from 0.80.0 to 0.81.1 by @dependabot in #10267
• Build: Bump nessie from 0.81.1 to 0.82.0 by @dependabot in #10318
• Build: Bump nessie from 0.82.0 to 0.83.2 by @dependabot in #10381
• Build: Bump nessie from 0.90.4 to 0.91.1 by @dependabot in #10551
• Build: Bump nessie from 0.91.2 to 0.91.3 by @dependabot in #10608
• Build: Bump nessie from 0.92.0 to 0.92.1 by @dependabot in #10697
• Build: Bump net.snowflake:snowflake-jdbc from 3.14.5 to 3.15.1 by @dependabot in #10095
• Build: Bump net.snowflake:snowflake-jdbc from 3.15.1 to 3.16.0 by @dependabot in #10269
• Build: Bump net.snowflake:snowflake-jdbc from 3.16.0 to 3.16.1 by @dependabot in #10419
• Build: Bump net.snowflake:snowflake-jdbc from 3.16.1 to 3.17.0 by @dependabot in #10696
• Build: Bump orc from 1.9.2 to 1.9.3 by @dependabot in #10033
• Build: Bump org.assertj:assertj-core from 3.25.3 to 3.26.0 by @dependabot in #10416
• Build: Bump org.assertj:assertj-core from 3.26.0 to 3.26.3 by @dependabot in #10698
• Build: Bump org.awaitility:awaitility from 4.2.0 to 4.2.1 by @dependabot in #9970
• Build: Bump org.glassfish.jaxb:jaxb-runtime from 2.3.3 to 2.3.9 by @dependabot in #9988
• Build: Bump org.roaringbitmap:RoaringBitmap from 1.0.1 to 1.0.5 by @dependabot in #9911
• Build: Bump org.roaringbitmap:RoaringBitmap from 1.0.5 to 1.0.6 by @dependabot in #10190
• Build: Bump org.roaringbitmap:RoaringBitmap from 1.0.6 to 1.1.0 by @dependabot in #10552
• Build: Bump org.roaringbitmap:RoaringBitmap from 1.1.0 to 1.2.0 by @dependabot in #10655
• Build: Bump org.scala-lang.modules:scala-collection-compat_2.13 from 2.11.0 to 2.12.0 by @dependabot in #10195
• Build: Bump org.springframework:spring-web from 5.3.30 to 5.3.33 by @dependabot in #9989
• Build: Bump org.springframework:spring-web from 5.3.33 to 5.3.34 by @dependabot in #10139
• Build: Bump org.springframework:spring-web from 5.3.34 to 5.3.35 by @dependabot in #10354
• Build: Bump org.springframework:spring-web from 5.3.35 to 5.3.36 by @dependabot in #10382
• Build: Bump org.springframework:spring-web from 5.3.36 to 5.3.37 by @dependabot in #10503
• Build: Bump org.testcontainers:testcontainers from 1.19.5 to 1.19.7 by @dependabot in #9912
• Build: Bump org.testcontainers:testcontainers from 1.19.7 to 1.19.8 by @dependabot in #10322
• Build: Bump org.xerial:sqlite-jdbc from 3.45.1.0 to 3.45.2.0 by @dependabot in #9974
• Build: Bump org.xerial:sqlite-jdbc from 3.45.2.0 to 3.45.3.0 by @dependabot in #10194
• Build: Bump org.xerial:sqlite-jdbc from 3.45.3.0 to 3.46.0.0 by @dependabot in #10415
• Build: Bump software.amazon.awssdk:bom from 2.24.5 to 2.25.18 by @dependabot in #10050
• Build: Bump software.amazon.awssdk:bom from 2.25.18 to 2.25.21 by @dependabot in #10072
• Build: Bump software.amazon.awssdk:bom from 2.25.21 to 2.25.31 by @dependabot in #10138
• Build: Bump software.amazon.awssdk:bom from 2.25.31 to 2.25.35 by @dependabot in #10192
• Build: Bump software.amazon.awssdk:bom from 2.25.35 to 2.25.40 by @dependabot in #10240
• Build: Bump software.amazon.awssdk:bom from 2.25.40 to 2.25.45 by @dependabot in #10266
• Build: Bump software.amazon.awssdk:bom from 2.25.45 to 2.25.50 by @dependabot in #10323
• Build: Bump software.amazon.awssdk:bom from 2.25.50 to 2.25.57 by @dependabot in #10367
• Build: Bump software.amazon.awssdk:bom from 2.25.57 to 2.25.60 by @dependabot in #10385
• Build: Bump software.amazon.awssdk:bom from 2.25.60 to 2.25.64 by @dependabot in #10421
• Build: Bump software.amazon.awssdk:bom from 2.25.64 to 2.25.69 by @dependabot in #10466
• Build: Bump software.amazon.awssdk:bom from 2.25.69 to 2.26.3 by @dependabot in #10505
• Build: Bump software.amazon.awssdk:bom from 2.26.12 to 2.26.16 by @dependabot in #10650
• Build: Bump software.amazon.awssdk:bom from 2.26.16 to 2.26.20 by @dependabot in #10700
• Build: Bump software.amazon.awssdk:bom from 2.26.3 to 2.26.7 by @dependabot in #10554
• Build: Bump software.amazon.awssdk:bom from 2.26.7 to 2.26.12 by @dependabot in #10611
• Build: Bump spring-boot from 2.5.4 to 2.7.18 by @dependabot in #9985
• Build: Clean up Jackson dependency usages by @nastra in #10448
• Build: Define JUnit4 dependency only where necessary by @nastra in #10672
• Build: Downgrade Gradle from 8.8 to 8.7 due to bug with older OSX versions by @nastra in #10637
• Build: Fix ignoring major version update in dependabot by @manuzhang in #9981
• Build: Free disk space before running action in Spark CI by @manuzhang in #9786
• Build: Ignore link-checking for Blogs / https://search.maven.org/ by @nastra in #10081
• Build: Let revapi compare against 1.5.0 by @ajantha-bhat in #9777
• Build: Merge job definitions in spark-ci.yml by @findepi in #10513
• Build: Move to goooler shadow plugin by @Fokko in #10568
• Build: Remove links checker by @Fokko in #10404
• Build: Require approving review by @Fokko in #10424
• Build: Update NOTICE to include copyright for 2024 by @caicancai in #10471
• Build: Upgrade to gradle 8.8 by @jbonofre in #8486
• Build: Use official revapi Gradle plugin by @ajantha-bhat in #10631
• Build: disable link-check for all medium blog posts by @manuzhang in #10057
• Build: disable link-check for existing medium blog posts by @manuzhang in #10042
• Build: don't include slf4j-api in bundled JARs by @devinrsmith in #10665
• Bump Nessie from 0.91.3 to 0.92.0 by @snazy in #10689
• CI: Run Markdown links checker only when {docs,site}/** changes by @Fokko in #10049
• Clean backport with:Flink: Backport #10207 to v1.18 and v1.17 by @pvary in #10235
• Core, Parquet, ORC: Don't write column sizes when metrics mode is None by @amogh-jahagirdar in #10440
• Core, Spark 3.4: Remove redundant output in tests by @aokolnychyi in #10348
• Core, Spark: Fix handling of null binary values when sorting with zorder by @amogh-jahagirdar in #10026
• Core, Spark: Spark writes/actions should only perform cleanup if failure is cleanable by @amogh-jahagirdar in #10373
• Core, Spark: Use 'delete' if RowDelta only has delete files by @nastra in #10123
• Core: Add EnvironmentContext to commit summary by @manuzhang in #9273
• Core: Add explicit JSON parser for ConfigResponse by @nastra in #9952
• Core: Add property to disable table initialization for JdbcCatalog by @mrcnc in #10124
• Core: Add test for renaming table to a non-existing namespace by @nastra in #9895
• Core: Assume issued_token_type is access_token to fully comply with RFC 6749 by @adutra in #10314
• Core: Calling rewrite_position_delete_files fails on tables with more than 1k columns by @szehon-ho in #10020
• Core: Exclude unexpected namespaces JdbcCatalog.listNamespaces by @ebyhr in #10498
• Core: Expose table incremental scan for appends API in SerializableTable by @deniskuzZ in #10682
• Core: Fix JDBC Catalog table commit when migrating from schema V0 to V1 by @jbonofre in #10111
• Core: Fix NPE during conflict handling of NULL partitions by @boroknagyz in #10680
• Core: Fix ParallelIterable memory leak where queue continues to be populated even after iterator close by @Heltman in #9402
• Core: Fix create v1 table on REST Catalog by @hantangwangd in #10369
• Core: Fix logging table name in scanning metadata table by @manuzhang in #10141
• Core: Handles possible heap data corruption of OAuth2Util.AuthSession#headers by @tlm365 in #10615
• Core: Handles potential NPE in RESTSessionCatalog#newSessionCache by @tlm365 in #10607
• Core: Improve size check in CatalogTests by @nastra in #10182
• Core: Introduce AuthConfig by @nastra in #10161
• Core: Lazily compute & cache hashCode in CharSequenceWrapper by @nastra in #10023
• Core: Make constants in CatalogTests protected by @snazy in #9894
• Core: Make new TableMetadata.Builder constructor private by @amogh-jahagirdar in #10714
• Core: Mark 502 and 504 statuses as retryable to the REST exponential retry strategy by @amogh-jahagirdar in #9885
• Core: Prevent duplicate data/delete files by @nastra in #10007
• Core: Remove unused ManifestGroup#filterManifests(Predicate) by @amogh-jahagirdar in #10339
• Core: Replace deprecated Roaring64Bitmap#add call with addRange by @amogh-jahagirdar in #10350
• Core: Retry connections in JDBC catalog with user configured error code list by @amogh-jahagirdar in #10140
• Core: Reword exception message in RewriteManifests by @ajantha-bhat in #10446
• Core: Simplify loadCatalog method call in Iceberg by @dzzxjl in #10488
• Core: Use 'delete' / 'append' if OverwriteFiles only deletes/appends data files by @nastra in #10150
• Core: Use <?> as type parameter instead of raw type for SnapshotUpdate by @nastra in #10015
• Core: Use TestTemplate instead of Test annotation in TestPartitionSpecParser/Info by @nastra in #10435
• Core: add a new task-type field to task JSON serialization. add data task JSON serialization implementation. by @stevenzwu in #9728
• Core: add missing @Test annotation in TestRESTCatalog by @adutra in #9899
• Core: fix namespace SQL statement using ESCAPE character working with MySQL, PostgreSQL, ... by @jbonofre in #10167
• Core: pushdown data_file.content when filter manifests in entries table by @dramaticlly in #10203
• Core: use bulk delete when removing old metadata.json files by @dramaticlly in #10679
• Core：Simplify newTableMetadata method in TableMetadata class by @DaqianLiao in #10528
• Data, Spark, Flink: Migrate TestAppenderFactory and subclasses to JUnit5 by @nk1506 in #9862
• Data: Switch tests to JUnit5 + AssertJ-style assertions by @attilakreiner in #10657
• Dell, Hive3: Convert remaining tests to JUnit5 by @nastra in #10670
• Described as Hive 4.0.0 by @911432 in #10325
• Doc: Clarify table properties on metadata metrics inferred column defaults by @dramaticlly in #9865
• Docs: Add BigQuery docs url to sidebar by @uatach in #10574
• Docs: Add DDL docs for Views by @nastra in #9878
• Docs: Add Daft into Iceberg documentation by @jaychia in #9836
• Docs: Add archive for documentations older than 1.4.0 by @manuzhang in #10374
• Docs: Add flinkVersion and flinkVersionMajor instead of hardcode by @manuzhang in #10463
• Docs: Add release notes for 1.5.2 by @amogh-jahagirdar in #10295
• Docs: Added Upsolver to vendor list by @jasonf20 in #10096
• Docs: Document support for binary in truncate transform by @TheNeuralBit in #10079
• Docs: Don't check links on Release page by @nastra in #10212
• Docs: Enhance Flink pages by @manuzhang in #9919
• Docs: Enhance Spark pages by @manuzhang in #9920
• Docs: Enhance create_changelog_view usage by @manuzhang in #9889
• Docs: Fix On-screen display issues and minor expressions on Branching and Tagging DDL by @lawofcycles in #10091
• Docs: Fix links of Get Started and Community sections in footer by @wayneguow in #10098
• Docs: Fix links to internal files by @manuzhang in #9819
• Docs: Fix release notes indentation by @ajantha-bhat in #9933
• Docs: Point links in metrics-reporting.md to GitHub Java source by @manuzhang in #10397
• Docs: Refer to the README.md in site/ for the docs by @Fokko in #10402
• Docs: Remove link to Flink unit test by @manuzhang in #10160
• Docs: Update defaults for distribution mode by @szehon-ho in #10575
• Docs: Update doap.rdf for 1.5.1 release by @ajantha-bhat in #10255
• Docs: Update features for Hive 4.0 by @SourabhBadhya in #10162
• Docs: Update releases.md for Spark scala versions by @liko9 in #10104
• Docs: Update site docs by @ajantha-bhat in #9946
• Docs: Update vendor information for Cloudera by @bartash in #10278
• Docs: add metrics-reporting back by @manuzhang in #10377
• Docs: document view properties by @nastra in #9961
• DynConstructors cleanup by @findepi in #10542
• DynFields, DynMethods code cleanup by @findepi in #10543
• Enable the Gradle build cache by @snazy in #10602
• Extend HTTPClient Builder to allow setting a proxy server by @harishch1998 in #10052
• Feature make oauth audience configurable by @himadripal in #9839
• Fix CI script inclusion of release branches by @findepi in #10514
• Fix TestStrictMetricsEvaluator assertion message by @Fokko in #9992
• Fix aggregate pushdown when optional DataFile stats are null by @jkolash in #10273
• Fix code depending on JVM default charset by @findepi in #10529
• Fix incorrect double-checked-locking around TestStreamScanSql#tEnv by @tlm365 in #10605
• Fix lower/upper-case not to depend on JVM locale by @findepi in #10521
• Fix open-api /rename/views success return code by @c-thiel in #10166
• Fix pagination description based on new feedback by @rahil-c in #9917
• Fix some long casting issues by @snazy in #10580
• Fix struct evolution default value rule list by @sfc-gh-dmetzgar in #10290
• Fix/add dremio blogs by @AlexMercedCoder in #10028
• Flink 1.19: Fix flaky TestIcebergSourceFailover > testBoundedWithSavepoint by @pvary in #10393
• Flink, Spark: Rename constants to be all uppercase by @attilakreiner in #10675
• Flink, Spark: Replace Boolean.getBoolean() with Boolean.parseBoolean() by @nastra in #10136
• Flink: Adds support for Flink 1.19 version by @rodmeneses in #10112
• Flink: Apply DeleteGranularity for writes by @pvary in #10200
• Flink: Backport #10200 to v1.19 and v1.17 by @pvary in #10259
• Flink: Backport #10208 to v1.18 and v1.17 by @pvary in #10230
• Flink: Backport #10565 to v1.18 and v1.19 by @fengjiajie in #10676
• Flink: Bump minor versions by @ajantha-bhat in #9875
• Flink: Don't fail to serialize IcebergSourceSplit when there is too many delete files by @javrasya in #9464
• Flink: Fix long casting issues by @snazy in #10629
• Flink: Fix bounded source state restore record duplication by @pvary in #10208
• Flink: Fix the condition of formatVersion for skipping test cases by @zhongqishang in #10541
• Flink: Maintenance - MonitorSource by @pvary in #10308
• Flink: Move ParquetReader to LogicalTypeAnnotationVisitor by @Fokko in #9719
• Flink: Pre-create fieldGetters to avoid constructing them for each row by @fengjiajie in #10565
• Flink: Prevent setting endTag/endSnapshotId for streaming source by @pvary in #10207
• Flink: backport PR #9321 for range partitioner on map statistics by @stevenzwu in #10061
• Flink: implement range partitioner for map data statistics by @stevenzwu in #9321
• Flink: port #9464 to v1.17 and v1.19 by @elkhand in #10177
• Flink: refactor sink shuffling statistics collection by @stevenzwu in #10331
• Hive, JDBC: Add null check before matching the error message by @nk1506 in #10082
• Hive: Arrange common part of the code for Iceberg View. by @nk1506 in #10001
• Hive: Fix metadata file not found by @lurnagao-dahua in #10069
• Hive: Remove deprecated method by @Fokko in #10257
• Hive: Tests to do validation hive content and iceberg table with the same name by @nk1506 in #9980
• Hive: Use base table metadata to create HiveLock by @lirui-apache in #10016
• Hive: turn off the stats gathering when iceberg.hive.keep.stats is false by @stargrey102 in #10148
• Import Assertions statically in Flink modules by @findepi in #10532
• Import Assertions statically in Spark modules by @findepi in #10531
• Import the right assertThatThrownBy method from assertj by @findepi in #10512
• Infra: Add 1.5.0 to issue template by @ajantha-bhat in #9778
• Infra: Add 1.5.1 to issue template by @amogh-jahagirdar in #10214
• Infra: Add Iceberg 1.5.2 to issue template by @amogh-jahagirdar in #10296
• Infra: Fix stale PR workflow by @ajantha-bhat in #10706
• Infra: Improve Bug report template by @nastra in #10708
• Infra: Increase operation per limit for stale bot workflow by @ajantha-bhat in #10712
• Introduce two properties for reading the connection timeout and socke… by @harishch1998 in #10053
• Kafka Connect: Commit coordination by @bryanck in #10351
• Kafka Connect: Record converters by @bryanck in #9641
• Kafka-connect: Handle namespace creation for auto table creation by @ajantha-bhat in #10186
• Kafka-connect: Update iceberg.hadoop-conf-dir config description by @ajantha-bhat in #10184
• Make AzureProperties w/ shared-key creds serializable by @snazy in #10045
• Make proxy endpoint configurable for s3 Http clients by @flyrain in #10332
• Migrate AWS tests to JUnit5 by @tomtongue in #10086
• Migrate Files, Append and Overwrite files in Core to JUnit5 by @tomtongue in #9994
• Migrate FlinkTestBase related tests by @tomtongue in #10232
• Migrate HadoopCatalog related tests in Flink by @tomtongue in #10358
• Migrate Manifest, FormatVersion and LocationProvider files in Core to JUnit5 by @tomtongue in #9964
• Migrate Metadata files in Core to JUnit5 by @tomtongue in #9927
• Migrate Read in Core to JUnit5 by @tomtongue in #9849
• Migrate Scan, Schema and remaining Partition files in Core to JUnit5 by @tomtongue in #10014
• Migrate Snapshot files in Core to JUnit5 by @tomtongue in #9892
• Migrate TableTestBase related classes to JUnit5 and delete TableTestBase by @tomtongue in #10063
• Migrate TableTestBase related classes to JUnit5 by @tomtongue in #10080
• Migrate Transactions, Partitions and Statistics files in Core to JUnit5 by @tomtongue in #9999
• Migrate WAP, Metrics and FilterFiles in Core to JUnit5 by @tomtongue in #10039
• Migrate non TestBase related and Data classes in Flink by @tomtongue in #10130
• Migrate other files in Core to JUnit5 by @tomtongue in #10027
• Migrate source package in Flink by @tomtongue in #10632
• Mr: Optimize schema string retrieval in Iceberg by @dzzxjl in #10489
• Nessie: Gracefully handle empty namespace lookup by @ajantha-bhat in #9877
• Nit: fix/suppress false-positivie errorprone warning by @snazy in #10690
• Open-API: TableRequirements should use union of subclasses by @anuragmantri in #10434
• OpenAPI: Deprecate oauth/tokens endpoint by @snazy in #10603
• OpenAPI: Fix additionalProperties for SnapshotSummary by @haizhou-zhao in #9838
• OpenAPI: Fix property names for stats/partition stats by @nastra in #10662
• Parquet: Refactor BasePageIterator to add initRepetitionLevelsReader by @wgtmac in #9751
• Parquet: Remove deprecated TestHelpers in parquet module by @advancedxy in #10428
• Pin 3rd party CI action version by @findepi in #10481
• Prevent deadlock in Jackson by @snazy in #10379
• REST: disallow overriding "credential" in table sessions by @adutra in #10345
• REST: fix incorrect token refresh thread name by @adutra in #10223
• REST: fix spurious warning when shutting down refresh executor by @adutra in #10087
• Release: add instruction to update doap.rdf file as part of release process by @jbonofre in #9655
• Remove deprecated APIs scheduled for removal in 1.6.0 by @findepi in #10501
• Remove redundant -XX:+IgnoreUnrecognizedVMOptions by @findepi in #10475
• Remove some dead code, fill some javadocs by @findepi in #10530
• Removes Flink version 1.16 by @rodmeneses in #10154
• Rename allVersions to allModules by @findepi in #10499
• Rename test helper to deconflict with Assertions by @findepi in #10511
• Require Assertions to be statically imported by @findepi in #10517
• Run CI checks on all supported JDKs by @findepi in #10473
• Run Flink tests on Java 17 too by @findepi in #10477
• Run Hive3 tests on Java 11 and 17 too by @findepi in #10482
• Run revapi workflow on workflow/build system changes by @findepi in #10485
• SHOW VIEWS failed with AssertionError by @huaxingao in #10442
• Site: Update release notes for 1.5.0 by @ajantha-bhat in #9835
• Sort error-prone configuration options by @findepi in #10540
• Spark 3.3/3.4: support read of partition metadata column when table is over 1k by @dramaticlly in #10641
• Spark 3.3: Ignore flaky test taking up all device space by @manuzhang in #10704
• Spark 3.4, 3.3 : support output-spec-id in rewrite (back port #9803) by @himadripal in #9901
• Spark 3.4, 3.3: Fix the setting of equalAuthorities in RemoveOrphanFilesProcedure by @hantangwangd in #10342
• Spark 3.4: Fail on recursive cycle in view by @nastra in #10048
• Spark 3.4: Fix system function pushdown in CoW row-level commands by @aokolnychyi in #10119
• Spark 3.4: Only traverse ancestors of current snapshot when building changelog scan by @manuzhang in #10405
• Spark 3.5: Add max allowed failed commits to RewriteDataFiles when partial progress is enabled by @manuzhang in #9611
• Spark 3.5: Fix system function pushdown in CoW row-level commands by @aokolnychyi in #9873
• Spark 3.5: Fix the setting of equalAuthorities in RemoveOrphanFilesProcedure by @hantangwangd in #10334
• Spark 3.5: Only traverse ancestors of current snapshot when building changelog scan by @manuzhang in #10252
• Spark 3.5: Parallelize reading files in snapshot and migrate procedures by @manuzhang in #10037
• Spark 3.5: Remove obsolete conf parsing logic by @aokolnychyi in #10309
• Spark 3.5: Support camel case session configs and options by @aokolnychyi in #10310
• Spark-3.5: Support CTAS and RTAS to preserve schema nullability. by @zhongyujiang in #10074
• Spark3.4: Add support for enums in SparkConfParser by @huaxingao in #10330
• Spark3.4: Support Aggregate push down for incremental scan by @huaxingao in #10561
• Spark: Backport #10373 to Spark 3.3 and 3.4 by @amogh-jahagirdar in #10546
• Spark: Backport tests for struct aggregation pushdown to 3.3/3.4 by @amogh-jahagirdar in #10333
• Spark: Bump minor version for Spark-3.4 by @ajantha-bhat in #10243
• Spark: Clarify schema behavior when working with branches by @nastra in #10055
• Spark: Coerce shorts and bytes into ints in Parquet Writer by @shardulm94 in #10349
• Spark: Don't allow branch_ usage with TIMESTAMP AS OF by @nastra in #10059
• Spark: Fail on recursive cycle in view by @nastra in #9834
• Spark: Fix issue when partitioning by UUID by @nastra in #8250
• Spark: Improvements around test initialization by @nastra in #10131
• Spark: Remove useless code in TestRemoveOrphanFilesProcedure by @hantangwangd in #10562
• Spark: Simplify SparkSchemaUtil#schemaForTable by @amogh-jahagirdar in #10137
• Spark: Use bulk deletes in rewrite manifests action by @amogh-jahagirdar in #10343
• Spark: support read of partition metadata column when table is over 1k by @dramaticlly in #10547
• Spec: Clarify missing fields when writing by @Fokko in #8672
• Spec: remove the JSON spec for content file and file scan task sections by @stevenzwu in #9771
• Spec: required request bodies by @westse in #10125
• Support Aggregate push down for incremental scan by @huaxingao in #10538
• Update 1.5.1 release notes by @amogh-jahagirdar in #10224
• Update ASF DOAP rdf file for 1.5.0 by @ajantha-bhat in #9922
• Update doap.rdf for 1.5.2 release by @amogh-jahagirdar in #10297
• Update mkdocs.yml - Fixes Apache Doris documentation link by @detinho in #10263
• Update references to main branch by @findepi in #10705
• Update site to 1.5.0 docs by @bitsondatadev in #9931
• Update site to 1.5.1 docs by @amogh-jahagirdar in #10218
• Update site to 1.5.2 docs by @amogh-jahagirdar in #10291
• Update specs from hugo to mkdocs format by @bitsondatadev in #9861
• Update the version in deprecation messages by @findepi in #10715
• Updates flink versioning information in our docs by @rodmeneses in #10155
• Upgrade to Gradle 8.9 by @jbonofre in #10686
• Url encode field names for partition paths by @danielcweeks in #10329
• Use svn mv when releasing the binaries by @Fokko in #9926
• Use a unique field-id for delete files elements by @fqaiser94 in #10347
• [Docs] Add examples for DataFrame branch writes by @anuragmantri in #10644
• [core] fix #9997 - Handle s3a file upload interrupt which results in table metadata pointing to files that doesn't exist by @abmo-x in #9998
• docs: Add links checker by @Fokko in #9965
• docs: Remove roadmap by @Fokko in #9941
• docs: deploy on changes in docs/ by @manuzhang in #10394
• mr: Fix using Date type as partition field by @lurnagao-dahua in #10210
• nit: Typo in the spec by @Fokko in #10564
• reduce enum array allocation by @sullis in #10126
• remove static import from SmokeTest by @huaxingao in #10451
• spec: Fix formatting of Default values by @Fokko in #10525

New Contributors

• @himadripal made their first contribution in #9803
• @AlexMercedCoder made their first contribution in #9967
• @jaychia made their first contribution in #9836
• @CsengerG made their first contribution in #9963
• @lurnagao-dahua made their first contribution in #10069
• @TheNeuralBit made their first contribution in #10079
• @liko9 made their first contribution in #10104
• @lawofcycles made their first contribution in #10091
• @wayneguow made their first contribution in #10098
• @harishch1998 made their first contribution in #10053
• @sullis made their first contribution in #10126
• @westse made their first contribution in #10125
• @regadas made their first contribution in #10132
• @c-thiel made their first contribution in #10166
• @javrasya made their first contribution in #9464
• @elkhand made their first contribution in #10177
• @stargrey102 made their first contribution in #10148
• @SourabhBadhya made their first contribution in #10162
• @sfc-gh-dmetzgar made their first contribution in #10290
• @detinho made their first contribution in #10263
• @jkolash made their first contribution in #10273
• @dzzxjl made their first contribution in #10488
• @caicancai made their first contribution in #10471
• @DaqianLiao made their first contribution in #10528
• @zhongqishang made their first contribution in #10541
• @uatach made their first contribution in #10574
• @attilakreiner made their first contribution in #10657
• @fengjiajie made their first contribution in #10565
• @devinrsmith made their first contribution in #10665

Full Changelog: apache-iceberg-1.5.2...apache-iceberg-1.6.0