[TRTLLM-14268][feat] Cosmos3 Transfer (control-video conditioning) - #16394

Merged

chang-l merged 47 commits into

NVIDIA:mainfrom

ishovkun:cosmos3_control

Aug 22, 2026

Commits on Aug 6, 2026

Intial version of Cosmos3 Trasnfer

bastefaniak
authored and
ishovkun
committed
8efa9c0
Fix transfer transformer calling convention and use OpenCV-backed media decode
ishovkun
committed
c2f5e2d
Default use_system_prompt off for transfer requests
ishovkun
committed
44b00bd
Add Cosmos3 transfer unit tests ported from vllm-omni
ishovkun
committed
7f8ab45
Add transfer example surface: extra_params flag, ball-control generator, docs
ishovkun
committed
ac35bcb
Fill transfer extra-param descriptions and tidy imports
ishovkun
committed
01f6406
Fix import order and trailing whitespace in cosmos3 pipeline
ishovkun
committed
5353b7a
Add `find_closest_target_size` for Cosmos3 transfer resolution
ishovkun
committed
f1f5d1e
Replace PyAV with OpenCV for video dimension probing in Cosmos3 transfer
ishovkun
committed
7cb24d5
Fix line length and formatting in Cosmos3 transfer module
ishovkun
committed
eeb9ccf
Fix pre-commit formatting issues in Cosmos3 files
ishovkun
committed
f655fb8
Refactor Cosmos3 transfer helpers and consolidate constants
ishovkun
committed
1650e95
Add unit tests for Cosmos3 transfer media-conversion helpers
ishovkun
committed
8a350bf
Carry Cosmos3 transfer control media as encoded bytes
ishovkun
committed
ad6cc5f
Drop the PyAV dependency from the ball-control generator
ishovkun
committed
ab393b7
Accept inline base64 media for bytes-typed extra params
ishovkun
committed
8c48dd1
Stop the Cosmos3 transfer branch skipping shared pipeline machinery
ishovkun
committed
bede20c
Read source dimensions through the declared decoder, not OpenCV
ishovkun
committed
8c735e6
Generate Cosmos3 transfer controls on the GPU
ishovkun
committed
4ad477c
Bound Cosmos3 control preprocessing by a frame window
ishovkun
committed
6cf5efd
Validate Cosmos3 transfer extra params at preflight
ishovkun
committed
5ba802e
Size Cosmos3 output to the source aspect worker-side
ishovkun
committed
ced154e
Follow the source frame rate when the caller sets none
ishovkun
committed
6a69022
Address review findings on the Cosmos3 transfer branch
ishovkun
committed
9484408
Harden the control resize kernels for direct callers
ishovkun
committed
72e78ab
Close out the remaining example and serving-doc review notes
ishovkun
committed
19008ff
Apply the reviewer nitpicks that still hold
ishovkun
committed
1c1b9d5
Follow the source frame rate on the transfer path too
ishovkun
committed
9316978
Reject strided inputs in the control kernels
ishovkun
committed
391030b
Name the kernel guard for what it validates
ishovkun
committed
c456fbe
Read windowed clips in place in the edge control path
ishovkun
committed
372aa2b

Commits on Aug 10, 2026

Merge remote-tracking branch 'upstream/main' into cosmos3_control
ishovkun
committed
06d4e71

Commits on Aug 11, 2026

Merge remote-tracking branch 'upstream/main' into cosmos3_control
ishovkun
committed
dda103f

Commits on Aug 12, 2026

Restore imports dropped by the upstream merge
ishovkun
committed
5134453

Commits on Aug 16, 2026

Commits on Aug 17, 2026

Commits on Aug 18, 2026

Merge remote-tracking branch 'upstream/main' into cosmos3_control
ishovkun
committed
475cd9a

Commits on Aug 19, 2026

Commits on Aug 21, 2026

Merge remote-tracking branch 'upstream/main' into cosmos3_control
ishovkun
committed
0825886