Skip to content

Commit 2da0ce8

Browse files
Add LMCache entry with description and links (#67)
Added LMCache information to landscape.yml.
1 parent 9d54428 commit 2da0ce8

File tree

1 file changed

+7
-0
lines changed

1 file changed

+7
-0
lines changed

landscape.yml

Lines changed: 7 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -742,6 +742,13 @@ landscape:
742742
logo: einops.svg
743743
repo_url: https://github.com/arogozhnikov/einops
744744
crunchbase: https://www.crunchbase.com/organization/chai-discovery
745+
- item:
746+
name: LMCache
747+
description: LMCache is an LLM serving engine extension that combines with vLLM or SGLang to reduce TTFT and increase throughput, especially under long-context scenarios. By storing the KV caches of reusable texts across various locations, including (GPU, CPU DRAM, Local Disk, Databases), LMCache reuses the KV caches of any reused text (not necessarily prefix) in any serving engine instance. Thus, LMCache saves precious GPU cycles and reduces user response delay.
748+
homepage_url: https://lmcache.ai/
749+
logo: LMCache.svg
750+
repo_url: https://github.com/LMCache
751+
crunchbase:
745752
- item:
746753
name: SGLang
747754
description: SGLang is a fast serving framework for large language models and vision language models.

0 commit comments

Comments
 (0)