Skip to content

feat(3d): add Pixal3D multiview generation - #12319

Draft
localai-org-maint-bot wants to merge 4 commits into
masterfrom
feat/pixal3d-12201
Draft

localai-org-maint-bot wants to merge 4 commits into
masterfrom
feat/pixal3d-12201

Conversation

@localai-org-maint-bot

Copy link
Copy Markdown
Collaborator

Description

Closes #12201.

Add a native Pixal3D backend for generating a GLB from four RGBA PNG views in front/right/back/left order and an explicit mesh scale. The 3D API, distributed file staging, and Studio form support these inputs. The importer installs the nine checksummed model files and manifest from the official quantized repository.

Includes backend discovery, pinned CLI builds and packaging for Linux CPU/CUDA/Vulkan and macOS Metal, and user documentation. Native generation runs in a temporary output directory so PNG and PLY sidecars are removed; only the validated GLB is published.

Notes for Reviewers

Initial support is canonical four-view generation at 1024 resolution. The CLI reloads model weights for each request; this limitation is documented.

Validation completed:

  • Focused Go tests for input validation, the backend adapter, HTTP handling, distributed staging, importer, and configuration.
  • Backend-filter tests (43/43), shell syntax, image/matrix consistency, and whitespace checks.
  • React production build, inline-style gate, and syntax check for the added browser spec.
  • Regression tests for sidecar cleanup after success, native failure, and invalid output.

This PR is a draft pending native C++/container builds and real model inference. Browser execution was unavailable because cached Chromium lacks its ELF loader. The full config suite also encounters an existing HTTP 403 while downloading the Hermes fixture; its focused Pixal3D tests pass.

Signed commits

  • Yes, I signed my commits.
  • Documentation updated (docs/content/) for user-facing changes, or not applicable

Comment thread backend/go/pixal3dcpp/pixal3d.go Fixed
Comment thread backend/go/pixal3dcpp/pixal3d.go Fixed
Comment thread backend/go/pixal3dcpp/pixal3d.go Fixed
Comment thread backend/go/pixal3dcpp/pixal3d.go Fixed
Comment thread backend/go/pixal3dcpp/pixal3d.go Fixed
Comment thread core/http/endpoints/localai/model3d.go Fixed
Comment thread backend/go/pixal3dcpp/pixal3d.go Fixed
Comment thread backend/go/pixal3dcpp/pixal3d.go Fixed
Comment thread backend/go/pixal3dcpp/pixal3d.go Fixed
Comment thread backend/go/pixal3dcpp/pixal3d.go Fixed
Support four ordered RGBA views through the native Pixal3D CLI.
Wire request validation, distributed staging, discovery, packaging,
and a dedicated UI form while preserving single-image TRELLIS.

Generate native output in a temporary directory and copy only the
validated GLB so texture and mesh sidecars do not accumulate.

Assisted-by: Codex:GPT-6
Check file-close errors and report failed temporary-file cleanup.
Document trusted paths and the packaged CLI for security analysis.

Assisted-by: Codex:gpt-6 golangci-lint gosec
Let model descriptions wrap without losing the install action offscreen.
Give page table rules precedence over the shared table styles.

Separate background facet probes from navigation assertions and wait for
asynchronous size sorting and masonry layout. Fix the chat fixture clock
so runs near midnight keep the expected conversation groups and order.

Assisted-by: Codex:gpt-6
Playwright joins adjacent table-cell text. A llama-cpp backend followed
by 99 requests then matches p99, although no percentile is shown.
Require word boundaries while keeping the absence assertion.

Assisted-by: Codex:gpt-6

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Add Pixal3D backend

2 participants