Skip to content

feat: context sliding window (infinite generation beyond max_seq_len)#31

Open
cstroie wants to merge 15 commits into
RightNow-AI:mainfrom
cstroie:sliding-window
Open

feat: context sliding window (infinite generation beyond max_seq_len)#31
cstroie wants to merge 15 commits into
RightNow-AI:mainfrom
cstroie:sliding-window

feat: implement KV cache sliding window for infinite generation

872fdb0
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs