Skip to content

Commit 46994b3

Browse files
📝 add guide on using TPU with TGI in the docs (#2907)
1 parent dc9b8e9 commit 46994b3

File tree

2 files changed

+5
-0
lines changed

2 files changed

+5
-0
lines changed

docs/source/_toctree.yml

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -13,6 +13,8 @@
1313
title: Using TGI with Intel Gaudi
1414
- local: installation_inferentia
1515
title: Using TGI with AWS Inferentia
16+
- local: installation_tpu
17+
title: Using TGI with Google TPU
1618
- local: installation_intel
1719
title: Using TGI with Intel GPUs
1820
- local: installation

docs/source/installation_tpu.md

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,3 @@
1+
# Using TGI with Google TPU
2+
3+
Check out this [guide](https://huggingface.co/docs/optimum-tpu) on how to serve models with TGI on TPUs.

0 commit comments

Comments
 (0)