Skip to content

Support data files compaction #1092

Description

@sungwy

Introduce an API to compact data files. The first version of the API will do the following:

  • take a predicate expression as input parameter to find data files matching the filter that will be re-written
  • group data files by partitions and rewrite them using the same bin-packing constraints of the writer

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions