apache-iceberg-1.10.0

What's Changed

• Add format/ to site-ci by @Fokko in #12869
• update links to daft docs by @ccmao1130 in #12860
• Spark3.4: BackPort Add Parallelism Parameter Validation to AddFilesProcedure. by @slfan1989 in #12872
• Core: Add test when listing namespaces with a non-existing namespace by @nastra in #12873
• Flink: Add support for Flink 2.0 by @mxm in #12527
• Core: Fix Kryo ser/de with StorageCredential config by @nastra in #12882
• Add timestamp_ns, time and UUID types for Variant by @aihuaxu in #12682
• Spec: Avoid struct field conflicts in default values by @rdblue in #12841
• Core: Ensure reactivated view version uses correct timestamp by @lliangyu-lin in #12821
• Parquet: Add variant array reader in Parquet by @aihuaxu in #12512
• Build: Bump nessie from 0.103.3 to 0.103.5 by @dependabot[bot] in #12902
• Build: Bump testcontainers from 1.20.6 to 1.21.0 by @dependabot[bot] in #12904
• Build: Bump mkdocs-material from 9.6.11 to 9.6.12 by @dependabot[bot] in #12848
• Build: upgrade to Gradle 8.14 by @jbonofre in #12898
• Spark: Use newArrayListWithExpectedSize instead of newArrayList for NDVSketchUtil by @jackylee-ch in #12907
• Build: Bump org.apache.httpcomponents.client5:httpclient5 from 5.4.3 to 5.4.4 by @dependabot[bot] in #12906
• Docs: Release notes for 1.9.0 by @ajantha-bhat in #12911
• Infra: Add 1.9.0 to issue template by @ajantha-bhat in #12913
• Infra: Update doap.rdf file by @ajantha-bhat in #12918
• Core: Increase wait time of flaky test by @manuzhang in #12714
• Flink: Backport add StreamingStartingStrategy.INCREMENTAL_FROM_LATEST_SNAPSHOT_EXCLUSIVE to Flink 1.19 by @morhidi in #12899
• Docs: Site updates for 1.9.0 by @ajantha-bhat in #12921
• Spark 3.5: Update MERGE and UPDATE for row lineage by @amogh-jahagirdar in #12736
• Flink: Add lockFactory open in LockRemover for table maintenance by @Guosmilesmile in #12900
• Docs: Fix version doc release step by @ajantha-bhat in #12922
• Parquet variant array write by @aihuaxu in #12847
• Build: Bump software.amazon.awssdk:bom from 2.29.52 to 2.31.30 by @dependabot[bot] in #12905
• Build: Bump jackson-bom from 2.18.3 to 2.19.0 by @dependabot[bot] in #12903
• Spark 3.4: Migrate tests in sql by @tomtongue in #12934
• Flink: Backport Add lockFactory open in LockRemover for table maintenance to Flink 1.20 and 1.19 by @Guosmilesmile in #12929
• Docs: Add DuckDB by @szarnyasg in #12932
• Spark 3.4: Migrate Spark Partition Transform tests by @tomtongue in #12941
• Flink: Fix typo in JdbcLockFactory by @Guosmilesmile in #12940
• Spark: Update RewriteDataFilesSparkAction and RewritePositionDeleteFilesSparkAction to use the new APIs by @pvary in #12692
• Flink: Change Preconditions import from flink util to guava by @Guosmilesmile in #12939
• Update Spark Parquet vectorized read tests to uses Iceberg Record instead of Avro GenericRecord by @amogh-jahagirdar in #12925
• Follow up to address comments in variant array writer by @aihuaxu in #12933
• OpenAPI: Use more clear language in recommending error responses by @sungwy in #12376
• Core: Broaden exception handling in writer clean up logic by @xiaoxuandev in #12863
• Spec: Remove misleading statement about source-ids by @wypoon in #12948
• API, Build: Explicitly pass version into Git Properties Plugin by @RussellSpitzer in #12949
• Build: Bump parquet from 1.15.1 to 1.15.2 by @dependabot[bot] in #12964
• Build: Bump org.openapitools:openapi-generator-gradle-plugin from 7.12.0 to 7.13.0 by @dependabot[bot] in #12966
• Build: Bump software.amazon.awssdk:bom from 2.31.30 to 2.31.35 by @dependabot[bot] in #12967
• Build: Bump nessie from 0.103.5 to 0.103.6 by @dependabot[bot] in #12963
• Spark 3.4: Migrate other sql tests by @tomtongue in #12945
• Build: Bump datamodel-code-generator from 0.28.5 to 0.30.1 by @dependabot[bot] in #12961
• Docs: Incorrect property in CREATE CATALOG for Flink by @mrsubhash in #12894
• Spark: Add flag to handle missing files for importSparkTable by @jshmchenxi in #12212
• Spec additions for encryption by @ggershinsky in #12162
• Spec: Update partition stats for V3 by @aokolnychyi in #12098
• AWS, GCP: Deprecate passing FileIO properties through constructor by @nastra in #12972
• Flink: Maintenance - RewriteDataFiles by @pvary in #11497
• Build: Bump net.snowflake:snowflake-jdbc from 3.23.2 to 3.24.0 by @dependabot[bot] in #12965
• API, Core: Add deleteFile to RowDelta API by @RussellSpitzer in #12861
• API, Core: Add table metadata keys for encryption by @rdblue in #12927
• Enable HTTP proxy support for the client used by REST Catalog by @akhilputhiry in #12406
• Flink: Backport Maintenance - RewriteDataFiles to Flink 1.19, 1.20 by @gyfora in #12991
• Build: Bump Comet from 0.5.0 to 0.8.1 by @huaxingao in #12974
• Core: Disallow creation of invalid PartitionSpec by @devinrsmith in #12887
• REST spec: Remove update to enable row lineage by @rdblue in #12986
• Spec: Update v3 summary, add row lineage by @rdblue in #12982
• Docs: Mark Spark 3.3 as End-of-Life since 1.9 by @manuzhang in #12989
• Spark 3.4: Update RewriteDataFilesSparkAction and RewritePositionDeleteFilesSparkAction to use the new APIs by @gaborkaszab in #12980
• Build, Core: Let RevAPI compare against 1.9.0 / Fix API breakage around StorageCredential by @nastra in #12930
• GCP: Support multiple storage credential prefixes by @nastra in #12881
• AWS, Core, Flink, Parquet: Remove deprecations for 1.10.0 by @manuzhang in #12909
• Spark 4.0 integration by @huaxingao in #12494
• Spark 3.4: Migrate source and spark tests by @tomtongue in #12998
• ORC: Upgrade ORC to 1.9.6 by @dongjoon-hyun in #13003
• Spark 3.4: Migrate the remaining SparkCatalogTestBase related tests and remove SparkCatalogTestBase by @tomtongue in #13007
• Core: Refactor and use InternalData for partition stats by @ajantha-bhat in #12946
• Add databend & iceberg docuement url by @sundy-li in #13002
• Revert "Spark 4.0 integration" by @huaxingao in #13006
• Update ADLS implementation status by @mrcnc in #13020
• Spec: Clarify behavior of special geo objects for lower/upper bounds by @szehon-ho in #12956
• Spark: Migrate Spark 3.4 SparkTestBaseWithCatalog related tests including refactoring Spark 3.5 tests by @tomtongue in #13015
• Spark: Migrate Spark 3.4 SparkTestBase related tests including refactoring Spark 3.5 tests by @tomtongue in #13031
• Docs: Add Spark SQL Configurations by @guykhazma in #12931
• Parquet: Fix to ensure that last updated sequence numbers for V2 and earlier tables are null by @amogh-jahagirdar in #13001
• Build: Bump mkdocs-material from 9.6.12 to 9.6.13 by @dependabot[bot] in #13029
• REST spec: Add encryption keys by @rdblue in #12987
• Add table property to disable/enable parquet column statistics #12770 by @huaxiangsun in #12771
• Docs: Fix ...

Apache Iceberg 1.9.2

What's Changed

• Stop retrying on 502 / 504 by @singhpk234 in #13461

Full Changelog: apache-iceberg-1.9.1...apache-iceberg-1.9.2

Apache Iceberg 1.9.1

What's Changed

• Core: Ensure reactivated view version uses correct timestamp by @lliangyu-lin in #12821
• API, Build: Explicitly pass version into Git Properties Plugin by @RussellSpitzer in #12949
• Bump Apache Parquet to 1.15.2 by @Fokko
• Core: Revert #12670 to Temporarily Restore Sending Single Snapshot Changes Rather than in Bulk by @aihuaxu in #13100

Full Changelog: apache-iceberg-1.9.0...apache-iceberg-1.9.1

Apache Iceberg 1.9.0

What's Changed

• Build: Bump software.amazon.awssdk:bom from 2.30.11 to 2.30.16 by @dependabot in #12208
• Build: Bump com.google.cloud:libraries-bom from 26.53.0 to 26.54.0 by @dependabot in #12207
• Build: Bump org.xerial:sqlite-jdbc from 3.48.0.0 to 3.49.0.0 by @dependabot in #12206
• Build: Bump org.apache.httpcomponents.client5:httpclient5 from 5.4.1 to 5.4.2 by @dependabot in #12209
• Docs: Fix expire_snapshots output by @manuzhang in #12213
• Update LICENSE/NOTICE files with last dependency updates by @jbonofre in #12214
• Doc: update note about notebook in spark-quickstart by @xxchan in #11996
• Spec: Support geo type by @szehon-ho in #10981
• Build: skip scheduled docker image publish workflows on forks by @dramaticlly in #12218
• Docs: Add missing types to the spec v3 summary by @wgtmac in #12219
• Spec: Typo - missing be by @RussellSpitzer in #12229
• Docs: Site update for 1.8.0 release by @amogh-jahagirdar in #12242
• spec: Remove source-ids for V{1,2} tables by @Fokko in #12161
• Build: Update revAPI to compare against 1.8.0 by @amogh-jahagirdar in #12244
• Update release version to 1.8.0 in doap.rdf by @amogh-jahagirdar in #12247
• Infra: Update Iceberg bug report template for 1.8.0 by @amogh-jahagirdar in #12248
• Docs: Fix formatting of 1.8.0 release notes by @amogh-jahagirdar in #12249
• Core: Adjust Jackson settings to handle large metadata json by @bryanck in #12224
• Build: Bump Hive to 2.3.10 by @nastra in #12253
• Build: Clean up dependencies by @nastra in #12252
• Core: Add InternalData read and write builders by @rdblue in #12060
• API, Core: Support default values in UpdateSchema by @rdblue in #12211
• update site to include iceberg summit link by @danicafine in #12256
• Core: Fix divide by zero when adjust split size by @hantangwangd in #12201
• Spark: Remove unused PruneColumnsWithReordering class by @rdblue in #12258
• Spark: Fix assertion checks by @nastra in #12255
• API: Deprecate NestedType.of in favor of builder by @rdblue in #12227
• Docker: Pin QEMU version temporarily by @ebyhr in #12262
• OpenAPI: Add RemoveSchemas REST update type by @gaborkaszab in #12022
• Minor: update Learn More to point to spark quickstart by @danicafine in #12272
• Build: Bump datamodel-code-generator from 0.27.2 to 0.28.1 by @manuzhang in #12290
• Spark 3.5: Fix job description of RewriteTablePathSparkAction by @ebyhr in #12282
• Build: Bump io.netty:netty-buffer from 4.1.117.Final to 4.1.118.Final by @dependabot in #12287
• Build: Bump software.amazon.awssdk:bom from 2.30.16 to 2.30.21 by @dependabot in #12286
• OpenAPI: Add overwrite option when registering an iceberg table by @dramaticlly in #12239
• Build: Bump mkdocs-material from 9.6.3 to 9.6.4 by @dependabot in #12284
• Core: Fix non-setting row-lineage from table properties on initial table creation by @tomtongue in #12307
• API: Reject unknown type for required fields and validate defaults by @rdblue in #12302
• API: Fix TestInclusiveMetricsEvaluator notStartsWith tests by @rdblue in #12303
• Core: add variant type support by @aihuaxu in #11831
• Fix CI: Update tests with UnknownType from Required to Optional by @Fokko in #12316
• Docs: Refactor site navigation bar by @manuzhang in #12289
• Parquet: Implement Variant readers by @rdblue in #12139
• Docs: Add rewrite-table-path in spark procedure by @dramaticlly in #12115
• Parquet: Fix errorprone warning by @ebyhr in #12324
• Docs: add apache amoro(incubating) with iceberg (#11965) by @czy006 in #11966
• Parquet: Fix performance regression in reader init by @bryanck in #12305
• Core: Fallback to GET requests for namespace/table/view exists checks by @nastra in #12314
• Fix: fix apache amoro ams doc pic ref by @czy006 in #12332
• Revert "Core: Serialize null when there is no current snapshot" by @Fokko in #12312
• [1.8.x] Parquet: Fix performance regression in reader init (#12305) by @nastra in #12329
• Checkstyle: Apply the same generic type naming rules to interfaces and classes by @pvary in #12333
• Kafka: Pin Kafka-Connect version to fix integration tests by @nastra in #12340
• Docs: Fix link of catalog in terms.md by @wangyinsheng in #12326
• Docs: Add documentation for Rate limiting in Spark Structured Streaming by @singhpk234 in #12217
• Spark 3.5: Fix Incorrect Spec Used With AddFiles Procedure by @RussellSpitzer in #12319
• Parquet: Remove deprecated VectorizedReader.setRowGroupInfo and ParquetValueReader.setPageSource by @ebyhr in #12321
• Bump versions in {LICENSE,NOTICE} by @Fokko in #12337
• Spark: Remove Spark 3.3 support by @manuzhang in #12279
• Core: Remove deprecated Util.blockLocations method and StructCopy class by @ebyhr in #12320
• Core: Handle partition evolution case in PartitionStatsUtil#computeStats by @deniskuzZ in #12137
• Core, Spark: Remove deprecated code for 1.9.0 by @nastra in #12336
• API: Move variant to API and add extract expression by @rdblue in #12304
• Core: Remove namespace/table/view HEAD endpoints from defaults by @nastra in #12351
• Nit: Remove additional 'Iceberg' in Puffin footer payload by @tomtongue in #12369
• API: Move Variant interfaces and serialized implementations to API by @rdblue in #12374
• Flink: Fix the comment error in SketchDataStatistics by @Guosmilesmile in #12375
• Core: Don't remove trailing slash from absolute paths by @adutra in #12389
• Build: Bump mkdocs-material from 9.6.4 to 9.6.5 by @dependabot in #12386
• Build: Bump org.xerial:sqlite-jdbc from 3.49.0.0 to 3.49.1.0 by @dependabot in #12385
• Build: Bump org.awaitility:awaitility from 4.2.2 to 4.3.0 by @dependabot in #12384
• Build: Bump nessie from 0.102.5 to 0.103.0 by @dependabot in #12383
• Build: Bump com.google.cloud:libraries-bom from 26.54.0 to 26.55.0 by @dependabot in #12382
• Build: Bump testcontainers from 1.20.4 to 1.20.5 by @dependabot in #12380
• Build: Bump software.amazon.awssdk:bom from 2.30.21 to 2.30.26 by @dependabot in #12379
• Spec: Allow Equality Deletes with Row Lineage and Define Behavior by @RussellSpitzer in #12230
• Core: Add "volatile" to HadoopFileIO#hadoopConf by @okumin in #12388
• Arrow, Parquet, Spark 3.5, Flink 1.20: Avoid deprecated method by @ebyhr in #11874
• Docs: Add Stackable to the Vendors page by @lfrancke in #12344
• Build: Upgrade to Gradle 8.13 by @jbonofre in #12398
• Kafka Connect: Add SMTs for Debezium and AWS DMS by @ismailsimsek in #11936
• API, Core: Update inclusive metrics evaluator for extract and transforms by @rdblue in #12311
• Build: remove Hadoop 2 dependency by @Kontinuation in #12348
• View Spec: Fix typo by @ajantha-bhat in #12405
• Fix grammar issues in descriptions about Hive environment in hive-quickstart.md by @wenxin-cn in #12402
• ...

apache-iceberg-1.7.2

What's Changed

• 1.7.x cherry pick #11526 by @bryanck in #11629
• [1.7] Revert "Support WASB scheme in ADLSFileIO" by @mrcnc in #11817
• Core, Spark, Flink, Hive: Remove unused failsafe dependency from core and add Failsafe to runtime LICENSE(s) by @amogh-jahagirdar in #11828
• [1.7.x] AWS, Core, GCP: Support relative credential endpoint / pass OAuth2 token to credential provider by @nastra in #11971
• Spark: Fix empty scan issue when start timestamp retrieves root snapshot and end timestamp is missing (#11967) by @Fokko in #11983
• Remove slf4j-api reference in LICENSE (#12052) by @Fokko in #12068
• [1.7.x] Core: Retain current view version during expiration (#12067) by @nastra in #12084
• Bump the versions of site/mkdocs.yml by @Fokko in #12175
• [1.7.x] Kafka: Pin Kafka-Connect version to fix integration tests by @Fokko in #12354
• [1.7.x] Bump Nessie to 0.120.5 to include updated License/Notice by @Fokko in #12356
• [1.7.x] Fix {LICENSE,NOTICE} for Kafka Connect Runtime by @Fokko in #12353
• [1.7.x] Fix {LICENSE,NOTICE} for Flink Runtime by @Fokko in #12358
• [1.7.x] Fix {LICENSE,NOTICE} for GCP Bundle by @Fokko in #12359
• [1.7.x] Fix {LICENSE,NOTICE} for AWS Bundle by @Fokko in #12360
• [1.7.x] Fix {LICENSE,NOTICE} for Azure Bundle by @Fokko in #12361
• [1.7.x] Fix {LICENSE,NOTICE} for Spark Runtime by @Fokko in #12355
• [1.7.x] Align azure-storage-blob version in azure-bundle LICENSE by @jbonofre in #12445
• [1.7.x] Fix Kafka-connect LICENSE and NOTICE by @Fokko in #12400
• [1.7.x] AWS: Don't fetch credential from endpoint if properties contain a valid credential (#12504) by @nastra in #12515

Full Changelog: apache-iceberg-1.7.1...apache-iceberg-1.7.2

apache-iceberg-1.8.1

What's Changed

• [1.8.x] Revert "Core: Serialize null when there is no current snapshot" by @Fokko in #12313
• [1.8.x] Core: Fallback to GET requests for namespace/table/view exists checks by @nastra in #12328
• [1.8.x] Core: Adjust Jackson settings to handle large metadata json (#12224) by @nastra in #12330
• [1.8.x] Parquet: Fix performance regression in reader init (#12305) by @nastra in #12338
• [1.8.x] Kafka: Pin Kafka-Connect version to fix integration tests by @nastra in #12341
• [1.8.x] Build: Revert AWS SDK from 2.30.11 to 2.29.52 by @nastra in #12339
• [1.8.x] Core: Remove namespace/table/view HEAD endpoints from defaults (#12351) by @nastra in #12368
• [1.8.x] Core: Don't remove trailing slash from absolute paths by @adutra in #12390
• [1.8.x] Fix versions in LICENSE/NOTICE by @jbonofre in #12365

Full Changelog: apache-iceberg-1.8.0...apache-iceberg-1.8.1

apache-iceberg-1.8.0

What's Changed

• Doc: Update rewrite data files spark procedure by @dramaticlly in #11396
• Docs: warn parallelism > 1 doesn't work for migration procedures by @manuzhang in #11417
• Core: log retry sleep time by @sullis in #11413
• Core: Use RoaringPositionBitmap in position index by @aokolnychyi in #11441
• Core: Add validation for table commit properties by @dramaticlly in #11437
• Core: Add cardinality to PositionDeleteIndex by @aokolnychyi in #11442
• Puffin: Add delete-vector-v1 blob type by @rdblue in #11238
• Spec v3: Add deletion vectors to the table spec by @rdblue in #11240
• API, Core: Add data file reference to DeleteFile by @aokolnychyi in #11443
• Build: Bump software.amazon.awssdk:bom from 2.29.1 to 2.29.6 by @dependabot in #11454
• Build: Bump com.gradleup.shadow:shadow-gradle-plugin from 8.3.3 to 8.3.5 by @dependabot in #11452
• Build: Bump com.google.cloud:libraries-bom from 26.49.0 to 26.50.0 by @dependabot in #11451
• Build: Bump org.apache.httpcomponents.client5:httpclient5 from 5.4 to 5.4.1 by @dependabot in #11450
• Build: Bump com.azure:azure-sdk-bom from 1.2.28 to 1.2.29 by @dependabot in #11453
• Flink: Maintenance - TableManager + ExpireSnapshots by @pvary in #11144
• Build: Bump mkdocs-material from 9.5.42 to 9.5.43 by @dependabot in #11455
• Build: Bump net.snowflake:snowflake-jdbc from 3.19.1 to 3.20.0 by @dependabot in #11447
• Build: Bump kafka from 3.8.0 to 3.8.1 by @dependabot in #11449
• Build: Bump jackson-bom from 2.18.0 to 2.18.1 by @dependabot in #11448
• Core: Fix generated position delete file spec by @aokolnychyi in #11458
• API, Core: Add content offset and size to DeleteFile by @aokolnychyi in #11446
• Build: Revert Parquet to 1.13.1 by @RussellSpitzer in #11462
• Spark 3.5: Preserve data file reference during manifest rewrites by @aokolnychyi in #11457
• Core: Make PositionDeleteIndex serializable by @aokolnychyi in #11463
• Spark 3.5: Preserve content offset and size during manifest rewrites by @aokolnychyi in #11469
• Spark 3.5: Fix flaky test due to temp directory not empty during delete by @manuzhang in #11470
• Core, Data, Flink, Spark: Improve tableDir initialization for tests by @nastra in #11460
• Core: Support DVs in DeleteFileIndex by @aokolnychyi in #11467
• Core: Adapt commit, scan, and snapshot stats for DVs by @aokolnychyi in #11464
• Spark: Merge new position deletes with old deletes during writing by @amogh-jahagirdar in #11273
• Fix ADLSLocation file parsing by @mrcnc in #11395
• open-api: Build runtime jar for test fixture by @ajantha-bhat in #11279
• Core, Puffin: Add DV file writer by @aokolnychyi in #11476
• Flink: Fix config key typo in error message of SplitComparators by @liuml07 in #11482
• API: Removes Explicit Parameterization of Schema Tests by @RussellSpitzer in #11444
• Docs: Fix verifying release candidate with Spark and Flink by @manuzhang in #11461
• Flink: Port #11144 to v1.19 by @pvary in #11473
• Docs: Fix format of verifying release candidate with Flink by @manuzhang in #11487
• Core: Support DVs in DeleteLoader by @aokolnychyi in #11481
• Infra: Update DOAP.RDF for Apache Iceberg 1.7.0 by @RussellSpitzer in #11492
• Docs: Site Update for 1.7.0 Release by @RussellSpitzer in #11494
• Infra: Add 1.7.0 to issue template by @RussellSpitzer in #11491
• Build: Let revapi compare against 1.7.0 by @RussellSpitzer in #11490
• Docs: Adds Release notes for 1.6.1 by @RussellSpitzer in #11500
• Docs: Fixes Release Formatting for 1.7.0 Release Notes by @RussellSpitzer in #11499
• Spec: Explicitly specify operation as a required field of Snapshot's summary field by @sungwy in #11355
• Exclude reading _pos column if it's not in the scan list by @huaxingao in #11390
• Build: Bump mkdocs-redirects from 1.2.1 to 1.2.2 by @dependabot in #11511
• Build: Bump mkdocs-material from 9.5.43 to 9.5.44 by @dependabot in #11510
• Build: Bump software.amazon.awssdk:bom from 2.29.6 to 2.29.9 by @dependabot in #11509
• Docs: Update multi-engine support after 1.7.0 release by @manuzhang in #11503
• Spark: Fix typo in spark ddl document by @hantangwangd in #11517
• Core: Support commits with DVs by @aokolnychyi in #11495
• Kafka Connect: fix Hadoop dependency exclusion by @bryanck in #11516
• Upgrade to Gradle 8.11.0 by @jbonofre in #11521
• Spark 3.5: Iceberg parser should passthrough unsupported procedure to delegate by @pan3793 in #11480
• use dist/release KEYS by @kevinjqliu in #11526
• Remove iceberg-pig by @jbonofre in #11380
• Core, Flink, Spark: Verify maintenance actions with DVs by @nastra in #11485
• Spark: Use assumeThat(format).isEqualTo(FileFormat.PARQUET) instead of assumeThat(format).isEqualTo(parquet) by @huaxingao in #11540
• Spark 3.4: Support Spark Column Stats by @saitharun15 in #11532
• Docs: Fix rendering lists by @manuzhang in #11546
• Build: Bump kafka from 3.8.1 to 3.9.0 by @dependabot in #11508
• Support WASB scheme in ADLSFileIO by @mrcnc in #11504
• Docs: 4 Spaces are Required for Sublists by @RussellSpitzer in #11549
• API, Core, Spark: Ignore schema merge updates from long -> int by @rocco408 in #11419
• Docs: Fix level of Deletion Vectors by @manuzhang in #11547
• API, Core: Replace deprecated ContentFile#path usage with location by @amogh-jahagirdar in #11550
• API: Add Variant data type by @aihuaxu in #11324
• Spark 3.5: Adapt DeleteFileIndexBenchmark for DVs by @aokolnychyi in #11529
• Spark 3.5: Adapt PlanningBenchmark for DVs by @aokolnychyi in #11531
• Spark 3.5: Add DVReaderBenchmark by @aokolnychyi in #11537
• Build: Bump datamodel-code-generator from 0.26.2 to 0.26.3 by @dependabot in #11572
• Build: Bump software.amazon.awssdk:bom from 2.29.9 to 2.29.15 by @dependabot in #11568
• Build: Bump io.netty:netty-buffer from 4.1.114.Final to 4.1.115.Final by @dependabot in #11569
• Data, Flink, Spark: Test deletes with format-version=3 by @nastra in #11538
• Build: Bump nessie from 0.99.0 to 0.100.0 by @dependabot in #11567
• Build: Bump orc from 1.9.4 to 1.9.5 by @dependabot in #11571
• API, Arrow, Core, Data, Spark: Replace usage of deprecated ContentFile#path API with location API by @amogh-jahagirdar in #11563
• Core: Serialize null when there is no current snapshot by @Fokko in #11560
• Spark 3.4: Iceberg parser should passthrough unsupported procedure to delegate by @pan3793 in #11579
• Spark 3.3: Iceberg parser should passthrough unsupported procedure to delegate by @pan3793 in #11580
• Core: Inherited classes from SnapshotProducer has TableOperations red… by @gaborkaszab in #11578
• Revert "Core: Use encoding/decoding methods for namespaces and deprecate Splitter/Joiner" by @nastra in #11574
• Core: delete temp metadata file when version already exists by @leesf in https://github.com/apache...

Apache Iceberg 1.7.1

What's Changed

• Kafka Connect: fix Hadoop dependency exclusion (#11516)
• Azure: Fix ADLSLocation file parsing (#11395)
• Azure: Support WASB scheme in ADLSFileIO (#11504)
• Revert "Core: Use encoding/decoding methods for namespaces and deprecate Splitter/Joiner" (#11574)
• Spark 3.5: Fix NotSerializableException when migrating Spark tables (#11157)
• Spark: Fix changelog table bug for start time older than current snapshot (#11564)
• Revert "Core: Update TableMetadataParser to ensure all streams closed" (#11621)

Full Changelog: apache-iceberg-1.7.0...apache-iceberg-1.7.1

Apache Iceberg 1.7.0

What's Changed

• [DOCS] Fix link on Concepts page by @gaborkaszab in #10718
• Core: Support appending files with different specs by @fqaiser94 in #9860
• Remove unnecessary class-level synchronized in ManifestFiles by @findepi in #10544
• Spec: Clarify which columns can be used for equality delete files. by @emkornfield in #8981
• Build: Bump nessie from 0.92.1 to 0.93.1 by @dependabot in #10727
• Build: Bump org.testcontainers:testcontainers from 1.19.8 to 1.20.0 by @dependabot in #10730
• Build: Bump mkdocs-material from 9.5.28 to 9.5.29 by @dependabot in #10734
• Build: Bump org.roaringbitmap:RoaringBitmap from 1.2.0 to 1.2.1 by @dependabot in #10733
• Build: Bump software.amazon.awssdk:bom from 2.26.20 to 2.26.21 by @dependabot in #10729
• Build: Bump io.netty:netty-buffer from 4.1.111.Final to 4.1.112.Final by @dependabot in #10726
• Build: Bump orc from 1.9.3 to 1.9.4 by @dependabot in #10728
• Build: Bump com.google.errorprone:error_prone_annotations from 2.28.0 to 2.29.2 by @dependabot in #10731
• Flink: Migrate remaining classes to JUnit5 by @tomtongue in #10684
• Api, Build: Fix typo in comments in Table and gradlew by @hantangwangd in #10744
• Flink: parameterize Flink table source tests to test both old and FLIP-27 source implementations by @stevenzwu in #10741
• Core: Limit memory used by ParallelIterable by @findepi in #10691
• Flink: handle rescale properly and refactor statistics by @stevenzwu in #10457
• Flink: Backport other remaining classes by @tomtongue in #10749
• Spec: Clarify time travel implementation in Iceberg by @emkornfield in #8982
• Build: Let revapi compare against 1.6.0 by @ajantha-bhat in #10754
• Support for Flink's SpeculativeExecution in batch execution mode by @venkata91 in #10548
• API: Update StatisticsFile javadoc by @rice668 in #10769
• Flink: Remove JUnit4 dependency by @nastra in #10770
• Docs: Add bodo to iceberg vendors by @ritwika314 in #10756
• Core: Add estimateRowCount for Files and Entries Metadata Tables by @szehon-ho in #10759
• Update checkstyle definition by @attilakreiner in #10681
• API: Fix typo in RewriteManifestFiles java doc by @amogh-jahagirdar in #10778
• Update .asf.yaml by @ajantha-bhat in #10767
• Support building with Java 21 by @findepi in #10474
• Infra, Docs: Publish Apache Iceberg 1.6.0 release by @jbonofre in #10752
• Update iceberg version on site to 1.6.0 by @jbonofre in #10783
• Hive: close the fileIO client when closing the hive catalog by @hussein-awala in #10771
• Add jbonofre as collaborator on the project by @jbonofre in #10782
• Docs: Make compatibility example consistent. by @emkornfield in #10781
• mr：Fix issues 10639 by @lurnagao-dahua in #10661
• Flink: backport PR #10331 and PR #10457 by @stevenzwu in #10757
• Build: Bump software.amazon.awssdk:bom from 2.26.21 to 2.26.25 by @dependabot in #10800
• Build: Bump nessie from 0.93.1 to 0.94.2 by @dependabot in #10798
• Build: Bump net.snowflake:snowflake-jdbc from 3.17.0 to 3.18.0 by @dependabot in #10801
• Build: Bump mkdocs-material from 9.5.29 to 9.5.30 by @dependabot in #10796
• Flink: Disabling flaky test TestIcebergSourceFailover.testBoundedWithSavepoint by @pvary in #10802
• Build: Bump mkdocs-awesome-pages-plugin from 2.9.2 to 2.9.3 by @dependabot in #10795
• Kafka Connect: Runtime distribution with integration tests by @bryanck in #10739
• Flink: improve snapshot compatibility check by comparing projected sort schema in SortKeySerializer by @stevenzwu in #10794
• Flink: support limit pushdown in FLIP-27 source by @stevenzwu in #10748
• Flink: Remove MiniClusterResource in Flink by @tomtongue in #10817
• Docs: Use link addresses instead of descriptions in releases.md by @lurnagao-dahua in #10815
• Build: Declare avro as an api dependency of iceberg-core by @devinrsmith in #10573
• Flink: backport PR #10748 for limit pushdown by @stevenzwu in #10813
• [DOCS] Fix header for entries metadata table by @gaborkaszab in #10826
• Support Spark Column Stats by @huaxingao in #10659
• Support for Flink's SpeculativeExecution in batch execution mode - Backport of PR #10548 by @venkata91 in #10776
• Infra: Improve feature request template by @nastra in #10825
• Core: (unit test) Replace the duplicated ALL_DATA_FILES with ALL_DELETE_FILES by @hsiang-c in #10836
• Core: Adds Basic Classes for Iceberg Table Version 3 by @RussellSpitzer in #10760
• Core: Allow SnapshotProducer to skip uncommitted manifest cleanup after commit by @grantatspothero in #10523
• Flink: a few small fixes or tuning for range partitioner by @stevenzwu in #10823
• Core: Drop support for Java 8 by @findepi in #10518
• Build: Bump com.adobe.testing:s3mock-junit5 from 2.11.0 to 2.17.0 by @nastra in #10851
• Core: Upgrade Jetty and Servlet API by @nastra in #10850
• Build for Java 11 by @snazy in #10849
• Build: Bump kafka from 3.7.1 to 3.8.0 by @dependabot in #10797
• Build: Update baseline gradle plugin to 5.58.0 by @findepi in #10788
• Flink: refactor sink tests to reduce the number of combinations with parameterized tests by @stevenzwu in #10777
• Flink: backport PR #10823 for range partitioner fixup by @stevenzwu in #10847
• Core: Remove reflection from TestParallelIterable by @findepi in #10857
• Spec: Deprecate the file system table scheme. by @rdblue in #10833
• Core, API: Add addNonDefaultSpec to UpdatePartitionSpec to not set the new partition spec as default by @shanielh in #10736
• Build: Bump com.palantir.baseline:gradle-baseline-java from 5.58.0 to 5.61.0 by @dependabot in #10864
• Build: Bump nessie from 0.94.2 to 0.94.4 by @dependabot in #10869
• Build: Bump org.xerial:sqlite-jdbc from 3.46.0.0 to 3.46.0.1 by @dependabot in #10871
• Build: Bump org.apache.commons:commons-compress from 1.26.0 to 1.26.2 by @dependabot in #10868
• Build: Bump software.amazon.awssdk:bom from 2.26.25 to 2.26.29 by @dependabot in #10866
• Build: Bump mkdocs-material from 9.5.30 to 9.5.31 by @dependabot in #10863
• Build: Fix Scala compilation by @snazy in #10860
• Build: Enable FormatStringAnnotation error-prone check by @findepi in #10856
• Core: Use encoding/decoding methods for namespaces and deprecate Splitter/Joiner by @nastra in #10858
• Aliyun: Replace assert usage with assertThat by @nastra in #10880
• Core: Extract filePath comparator into it's own class by @deniskuzZ in #10664
• Docs: Fix SQL in branching docs by @nakaken-churadata in #10876
• API: Add SupportsRecoveryOperations mixin for FileIO by @amogh-jahagirdar in #10711
• Spec: Clarify identity partition edge cases. by @emkornfield in #10835
• Build: Bump org.testcontainers:testcontainers from 1.20.0 to 1.20.1 by @dependabot in #10865
• Flink: add 1.20 support and remove 1.17 by @stevenzwu in #10881
• Build: Add checkstyle rule to ba...

Apache Iceberg 1.6.1

What's Changed

• Core: Limit ParallelIterable memory consumption by yielding in tasks by @raunaqmorarka in #10787
• [1.6] Core: Drop ParallelIterable's queue low water mark by @findepi in #10979
• Build: Bump orc from 1.9.3 to 1.9.4 (#10728) by @Fokko in #10988

New Contributors

• @raunaqmorarka made their first contribution in #10787

Full Changelog: apache-iceberg-1.6.0...apache-iceberg-1.6.1