Skip to content

Add the image extra: transformers, torchvision and pillow - #399

Merged
alanprior merged 4 commits into
mainfrom
alan/image-extra
Sep 17, 2026
Merged

alanprior merged 4 commits into
mainfrom
alan/image-extra

Conversation

@alanprior

@alanprior alanprior commented Sep 16, 2026

Copy link
Copy Markdown
Contributor

Layer 1 of 4 in stack #402: the image optional-dependency group. #401 adds the encoder internals, #400 the transformer and estimator wrapper, #398 the example and docs. Only pyproject.toml and uv.lock change here, so the dependency footprint can be reviewed on its own.

What it installs

pip install "tabpfn-extensions[image]" adds transformers>=4.57.1, which loads the DINOv3 encoder and its image processor, torchvision>=0.20, which that processor is built on, and pillow>=10.4, which decodes the images. The extra joins the all meta-extra. The lock gains transformers, tokenizers, regex and torchvision; nothing is removed.

Design decisions

  • The extension uses the model's own image processor from transformers, the way MulTaBench does, so torchvision is required: transformers ships no PIL backend for the DINOv3 processor. torchvision pins torch exactly; under lowest-direct that is torch 2.5.0, which tabpfn's own floor already selects.
  • transformers 4.57.1 is the floor: 4.57.0, the first release with DINOv3, is yanked on PyPI.
  • The added packages are Apache, MIT or BSD licensed and pass the repository's license check.

馃 Generated with Claude Code

alanprior and others added 2 commits September 16, 2026 11:46
tabpfn-extensions[image] brings transformers, which loads the frozen DINOv3
encoder the image extension embeds pictures with, and pillow, which decodes
them. The floor is transformers 4.57.1, the first release with DINOv3 that
is not yanked. The extra joins the all meta-extra.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
The DINOv3 image processor in transformers is torchvision-backed, and the
extension uses that processor rather than its own resize and normalisation.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
@alanprior alanprior changed the title Add the image extra: transformers and pillow Add the image extra: transformers, torchvision and pillow Sep 16, 2026
Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
@alanprior alanprior added enhancement New feature or request dependencies Pull requests that update a dependency file and removed enhancement New feature or request labels Sep 16, 2026
@alanprior
alanprior added this pull request to stack #402 September 16, 2026 16:33
@alanprior
alanprior merged commit 795f42e into main Sep 17, 2026
20 checks passed
@alanprior
alanprior deleted the alan/image-extra branch September 17, 2026 11:34
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

dependencies Pull requests that update a dependency file

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants