llm-d-infra

This repository includes examples, Helm charts, and release assets for llm-d-infra:

• Quickstarts for deploying infrastructure and a model
  • See quickstart/examples
• Quickstarts for interacting with a running deployment
  • See quickstart/interactive-pod
• Helm charts for deploying llm-d-infra
  • See charts/llm-d-infra/README.md
• Release assets for running llm-d
  • See release notes

License

This project is licensed under the Apache License 2.0. See the LICENSE file for details.