Skip to content

Include required schema-id metadata in written manifests #42

Description

@platypii

Problem

The Iceberg v2/v3 manifest specification requires every manifest Avro file to include a schema-id key in its file metadata. Icebird currently writes schema, partition-spec, partition-spec-id, format-version, and content, but omits schema-id.

Affected writer paths in src/write/manifest.js:

Spec reference: Manifest metadata requirements. The table marks schema-id as required for v2 manifests; v3 retains this requirement.

Expected behavior

Each writer should include:

"schema-id": String(schema["schema-id"])

in the Avro file metadata, and manifest round-trip tests should assert that the value is present for both v2 and v3 output.

This is a pre-existing compliance gap identified while reviewing #39; it is not caused by that PR.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions