# Changelog

## Score

- CAI 66 → 65 (-0.8)
- Rubric changed (rubric-2026.10.5 → rubric-2026.11.4) — scores are not directly comparable.

## Lenses

- Code Health 62 → 62 (+0.0)
- Architecture 87 → 87 (+0.0)
- Maturity 71 → 75 (+3.7)
- Readiness 62 → 59 (-3.7)
- Security 77 → 74 (-2.8)
- Performance 78 → 89 (+11.1)

## Resolved (70)

- ClassTooLong: DeltaV2MicroBatchStream (spark/v2/src/main/java/org/apache/spark/sql/delta/v2/read/DeltaV2MicroBatchStream.java)
- DeltaV2MicroBatchStream.applyPerCommitCDCAdmission (cognitive 20) (spark/v2/src/main/java/org/apache/spark/sql/delta/v2/read/DeltaV2MicroBatchStream.java)
- DeltaV2MicroBatchStream.checkReadIncompatibleSchemaChangeOnStreamStartOnce (cognitive 16) (spark/v2/src/main/java/org/apache/spark/sql/delta/v2/read/DeltaV2MicroBatchStream.java)
- DeltaV2MicroBatchStream.collectAndBuildCDCIndexedFiles (cognitive 56) (spark/v2/src/main/java/org/apache/spark/sql/delta/v2/read/DeltaV2MicroBatchStream.java)
- DeltaV2MicroBatchStream.collectAndBuildCDCIndexedFiles (cyclomatic 25) (spark/v2/src/main/java/org/apache/spark/sql/delta/v2/read/DeltaV2MicroBatchStream.java)
- DeltaV2MicroBatchStream.getCommitsFromRange (cognitive 19) (spark/v2/src/main/java/org/apache/spark/sql/delta/v2/read/DeltaV2MicroBatchStream.java)
- DeltaV2MicroBatchStream.validateCommitAndDecideSkipping (cognitive 38) (spark/v2/src/main/java/org/apache/spark/sql/delta/v2/read/DeltaV2MicroBatchStream.java)
- DeltaV2MicroBatchStream.validateCommitAndDecideSkipping (cyclomatic 21) (spark/v2/src/main/java/org/apache/spark/sql/delta/v2/read/DeltaV2MicroBatchStream.java)
- Duplicated block (10 lines × 2) (storage/src/main/java/io/delta/storage/commit/uccommitcoordinator/UCDeltaTokenBasedRestClient.java)
- Duplicated block (12–13 lines × 2) (icebergShaded/src/main/java/org/apache/iceberg/hive/HiveCatalog.java)
- Duplicated block (12–14 lines × 2) (spark/v2/src/main/java/org/apache/spark/sql/delta/v2/read/DeltaV2MicroBatchStream.java)
- Duplicated block (14–15 lines × 2) (spark/v2/src/main/java/org/apache/spark/sql/delta/v2/utils/PartitionUtils.java)
- Duplicated block (23 lines × 2) (kernel/examples/kernel-examples/src/main/java/io/delta/kernel/integration/ReadIntegrationTestSuite.java)
- Duplicated block (5 lines × 2) (kernel/kernel-defaults/src/main/java/io/delta/kernel/defaults/internal/expressions/DefaultExpressionEvaluator.java)
- Duplicated block (5 lines × 2) (spark/v2/src/main/java/org/apache/spark/sql/delta/v2/read/DeltaV2MicroBatchStream.java)
- Duplicated block (5 lines × 2) (spark/v2/src/main/java/org/apache/spark/sql/delta/v2/utils/SparkRowToKernelRow.java)
- Duplicated block (58 lines × 2) (spark/v2/src/main/java/org/apache/spark/sql/delta/v2/utils/KernelRowToSparkRow.java)
- Duplicated block (6 lines × 2) (iceberg/src/main/scala/org/apache/spark/sql/delta/icebergShaded/DeltaToIcebergConvert.scala)
- Duplicated block (7 lines × 2) (iceberg/src/main/scala/org/apache/spark/sql/delta/icebergShaded/DeltaToIcebergConvert.scala)
- Duplicated block (7 lines × 2) (storage/src/main/java/io/delta/storage/commit/uccommitcoordinator/UCDeltaTokenBasedRestClient.java)
- …and 50 more

## New (213)

- DeltaV2MicroBatchStream.applyPerCommitCDCAdmission (cognitive 24) (spark/v2/src/main/scala/org/apache/spark/sql/delta/v2/read/DeltaV2MicroBatchStream.scala)
- DeltaV2MicroBatchStream.checkReadIncompatibleSchemaChangeOnStreamStartOnce (cognitive 16) (spark/v2/src/main/scala/org/apache/spark/sql/delta/v2/read/DeltaV2MicroBatchStream.scala)
- DeltaV2MicroBatchStream.collectAndBuildCDCIndexedFiles (cognitive 61) (spark/v2/src/main/scala/org/apache/spark/sql/delta/v2/read/DeltaV2MicroBatchStream.scala)
- DeltaV2MicroBatchStream.collectAndBuildCDCIndexedFiles (cyclomatic 24) (spark/v2/src/main/scala/org/apache/spark/sql/delta/v2/read/DeltaV2MicroBatchStream.scala)
- DeltaV2MicroBatchStream.getCommitsFromRange (cognitive 19) (spark/v2/src/main/scala/org/apache/spark/sql/delta/v2/read/DeltaV2MicroBatchStream.scala)
- DeltaV2MicroBatchStream.validateCommitAndDecideSkipping (cognitive 33) (spark/v2/src/main/scala/org/apache/spark/sql/delta/v2/read/DeltaV2MicroBatchStream.scala)
- DeltaV2MicroBatchStream.validateCommitAndDecideSkipping (cyclomatic 23) (spark/v2/src/main/scala/org/apache/spark/sql/delta/v2/read/DeltaV2MicroBatchStream.scala)
- Duplicated block (10–11 lines × 2) (storage/src/main/java/io/delta/storage/commit/uccommitcoordinator/UCDeltaTokenBasedRestClient.java)
- Duplicated block (9 lines × 3) (spark/v2/src/main/java/org/apache/spark/sql/delta/v2/utils/StreamingHelper.java)
- Duplicated block (9–11 lines × 2) (spark/v2/src/main/java/org/apache/spark/sql/delta/v2/utils/StreamingHelper.java)
- Edited copies of one member (3 members, 10+ corresponding lines) (python/delta/connect/tables.py)
- Edited copies of one member (3 members, 10+ corresponding lines) (spark/src/main/java/org/apache/spark/sql/delta/deletionvectors/mumbling/BitPacking.java)
- Edited copies of one member (3 members, 10+ corresponding lines) (spark/v2/src/main/java/org/apache/spark/sql/delta/v2/utils/SchemaUtils.java)
- Edited copies of one member (3 members, 13+ corresponding lines) (spark-connect/client/src/main/scala/io/delta/connect/tables/DeltaMergeBuilder.scala)
- Edited copies of one member (3 members, 15+ corresponding lines) (spark/src/main/scala/org/apache/spark/sql/delta/catalog/AbstractDeltaCatalog.scala)
- Edited copies of one member (3 members, 15+ corresponding lines) (spark/v2/src/main/java/org/apache/spark/sql/delta/v2/read/ColumnReorderReadFunction.java)
- Edited copies of one member (3 members, 16+ corresponding lines) (spark/src/main/scala/org/apache/spark/sql/delta/DeltaErrors.scala)
- Edited copies of one member (3 members, 18+ corresponding lines) (spark/v2/src/main/java/org/apache/spark/sql/delta/v2/read/DeltaV2MicroBatchStreamUtils.java)
- Edited copies of one member (3 members, 24+ corresponding lines) (docs/apis/generate_api_docs.py)
- Edited copies of one member (3 members, 26+ corresponding lines) (python/delta/tables.py)
- …and 193 more

## Changes since last survey

- 132 commits — 126 feature/other, 6 fixes

## By area

- spark/src — 58 commits
- spark/v2 — 39 commits
- kernel/kernel-api — 7 commits
- protocol_rfcs/iceberg-v4-metadata.md — 7 commits
- protocol_rfcs/file-type.md — 4 commits
- spark-unified/src — 4 commits
- docs/src — 2 commits
- storage/src — 2 commits
- (root) — 1 commit
- .github/CODEOWNERS — 1 commit
- .github/ci-requirements — 1 commit
- .github/workflows — 1 commit
- iceberg/src — 1 commit
- kernel/kernel-defaults — 1 commit
- kernel/unitycatalog — 1 commit
- protocol_rfcs/interval-types.md — 1 commit
- spark/unitycatalog — 1 commit

## Notable commits

- fix: [PROTOCOL] File data type: fix the schema example and three wording errors (#8088)
- fix: [Spark] Fix a losing OPTIMIZE CHECKPOINT hiding a concurrent SetTransaction commit (#8015)
- fix: [Spark] Revert "Convert DeltaV2Scan from Java to Scala" (#8052)
- fix: [Spark] Revert "Pass the table manager to optimistic transactions" (#8003)
- fix: [Spark] Revert "Read V2 single commits through LogStore" (#8133)
- fix: fix: allow large JSON strings in the kernel default reader (#7943)
- change: Clarify DeltaV2Table references in connector tests (#8051)
- change: Convert UCManagedTableSnapshotManager from Java to Scala (#8140)
- change: Count files to delete before starting the VACUUM START transaction (#7961)
- change: Refactor Relativize path code to pass boolean param using their names (#7974)
- change: Remove unused coordinated commits validation error classes (#8108)
- change: Retry Vacuum commit failures (#7988)
- change: Skip incremental checksum when a derived field is negative (#8084)
- change: [Build] Add murali-db as project code owner (#8106)
- change: [DEDUP] Share action extraction in StreamingHelper (#8100)
- change: [Flink] Update Unity Catalog calls for include_browse (#8104)
- change: [Kernel] Accept published commits returned by the catalog (#7922)
- change: [Kernel] Add hashCode to CollationIdentifier (#7957)
- change: [Kernel] Add relaxed CommitRange validation (#8001)
- change: [Kernel] Expose commit range validation options in UC client (#8029)
- …and 112 more

## Architecture

- Containers 0 added · 0 removed · contexts 0 added · 0 removed · edges 0 added · 1 removed

## Removed dependency edges (was a dependency, now gone) (1)

- benchmarks → repository
