From 2315d797e23a27d71da801417935e7cd19d7b725 Mon Sep 17 00:00:00 2001 From: Alvaro Bartolome <36760800+alvarobartt@users.noreply.github.com> Date: Wed, 5 Aug 2026 09:32:42 +0200 Subject: [PATCH 01/17] Rewrite docs to be more Microsoft Foundry centric Signed-off-by: Alvaro Bartolome <36760800+alvarobartt@users.noreply.github.com> --- Makefile | 6 +- docs/scripts/auto-generate-examples.py | 10 +- docs/scripts/auto-update-toctree.py | 29 +-- docs/source/_redirects.yml | 39 ++-- docs/source/_toctree.yml | 115 ++++++++---- docs/source/agents/introduction.mdx | 1 + docs/source/deprecated/faq.mdx | 11 ++ docs/source/deprecated/features.mdx | 17 ++ .../examples/build-agents-with-smolagents.mdx | 27 +++ .../examples/deploy-large-language-models.mdx | 27 +++ .../examples/deploy-nvidia-parakeet-asr.mdx | 26 +++ .../foundry/examples/deploy-smollm3.mdx | 26 +++ .../deploy-vision-language-models.mdx | 26 +++ docs/source/deprecated/foundry/hardware.mdx | 5 + .../deprecated/foundry/introduction.mdx | 5 + docs/source/deprecated/foundry/models.mdx | 9 + docs/source/deprecated/foundry/tasks.mdx | 5 + .../deprecated/guides/access-gated-models.mdx | 13 ++ .../configure-azure-ml-microsoft-foundry.mdx | 17 ++ .../source/deprecated/guides/introduction.mdx | 17 ++ .../guides/managed-compute-foundry.mdx | 12 ++ .../guides/one-click-deployment-foundry.mdx | 17 ++ .../guides/request-model-addition.mdx | 13 ++ .../tool-calling-agent-fine-tuning.mdx | 22 +++ docs/source/deprecated/overview.mdx | 11 ++ docs/source/{ => deprecated}/resources.mdx | 20 +- docs/source/deprecated/security.mdx | 14 ++ docs/source/faq.mdx | 28 --- docs/source/features.mdx | 81 -------- docs/source/foundry/hardware.mdx | 43 ----- docs/source/foundry/introduction.mdx | 20 -- docs/source/foundry/models.mdx | 29 --- docs/source/foundry/tasks.mdx | 41 ---- ...els-from-microsoft-foundry-with-python.mdx | 1 + ...loy-open-models-from-microsoft-foundry.mdx | 1 + docs/source/guides/access-gated-models.mdx | 136 -------------- .../configure-azure-ml-microsoft-foundry.mdx | 134 -------------- docs/source/guides/introduction.mdx | 11 -- .../source/guides/managed-compute-foundry.mdx | 175 ------------------ .../guides/one-click-deployment-foundry.mdx | 27 --- docs/source/guides/request-model-addition.mdx | 23 --- docs/source/index.mdx | 49 ++++- .../large-language-models/introduction.mdx | 1 + docs/source/security.mdx | 25 --- 44 files changed, 509 insertions(+), 856 deletions(-) create mode 100644 docs/source/agents/introduction.mdx create mode 100644 docs/source/deprecated/faq.mdx create mode 100644 docs/source/deprecated/features.mdx create mode 100644 docs/source/deprecated/foundry/examples/build-agents-with-smolagents.mdx create mode 100644 docs/source/deprecated/foundry/examples/deploy-large-language-models.mdx create mode 100644 docs/source/deprecated/foundry/examples/deploy-nvidia-parakeet-asr.mdx create mode 100644 docs/source/deprecated/foundry/examples/deploy-smollm3.mdx create mode 100644 docs/source/deprecated/foundry/examples/deploy-vision-language-models.mdx create mode 100644 docs/source/deprecated/foundry/hardware.mdx create mode 100644 docs/source/deprecated/foundry/introduction.mdx create mode 100644 docs/source/deprecated/foundry/models.mdx create mode 100644 docs/source/deprecated/foundry/tasks.mdx create mode 100644 docs/source/deprecated/guides/access-gated-models.mdx create mode 100644 docs/source/deprecated/guides/configure-azure-ml-microsoft-foundry.mdx create mode 100644 docs/source/deprecated/guides/introduction.mdx create mode 100644 docs/source/deprecated/guides/managed-compute-foundry.mdx create mode 100644 docs/source/deprecated/guides/one-click-deployment-foundry.mdx create mode 100644 docs/source/deprecated/guides/request-model-addition.mdx create mode 100644 docs/source/deprecated/machine-learning/examples/tool-calling-agent-fine-tuning.mdx create mode 100644 docs/source/deprecated/overview.mdx rename docs/source/{ => deprecated}/resources.mdx (68%) create mode 100644 docs/source/deprecated/security.mdx delete mode 100644 docs/source/faq.mdx delete mode 100644 docs/source/features.mdx delete mode 100644 docs/source/foundry/hardware.mdx delete mode 100644 docs/source/foundry/introduction.mdx delete mode 100644 docs/source/foundry/models.mdx delete mode 100644 docs/source/foundry/tasks.mdx create mode 100644 docs/source/get-started/deploy-open-models-from-microsoft-foundry-with-python.mdx create mode 100644 docs/source/get-started/deploy-open-models-from-microsoft-foundry.mdx delete mode 100644 docs/source/guides/access-gated-models.mdx delete mode 100644 docs/source/guides/configure-azure-ml-microsoft-foundry.mdx delete mode 100644 docs/source/guides/introduction.mdx delete mode 100644 docs/source/guides/managed-compute-foundry.mdx delete mode 100644 docs/source/guides/one-click-deployment-foundry.mdx delete mode 100644 docs/source/guides/request-model-addition.mdx create mode 100644 docs/source/large-language-models/introduction.mdx delete mode 100644 docs/source/security.mdx diff --git a/Makefile b/Makefile index ee13bf7..072a57d 100644 --- a/Makefile +++ b/Makefile @@ -7,8 +7,8 @@ install: docs: clean @$(foreach svc,$(SERVICES), \ - echo "Creating docs/source/$(svc)/examples directory for examples/$(svc)..." && \ - mkdir -p docs/source/$(svc)/examples && \ + echo "Creating docs/source/deprecated/$(svc)/examples directory for examples/$(svc)..." && \ + mkdir -p docs/source/deprecated/$(svc)/examples && \ echo "Converting Jupyter Notebooks to MDX for $(svc)..." && \ doc-builder notebook-to-mdx examples/$(svc)/ && \ ) true @@ -26,7 +26,7 @@ docs: clean clean: @echo "Cleaning up generated documentation..." @$(foreach svc,$(SERVICES), \ - rm -rf docs/source/$(svc)/examples && \ + rm -rf docs/source/deprecated/$(svc)/examples && \ ) true @awk '/# GENERATED CONTENT DO NOT EDIT/,/# END OF GENERATED CONTENT/{next} {print}' docs/source/_toctree.yml | sed -e :a -e '/^\n*$$/{$$d;N;ba' -e '}' > docs/source/_toctree.yml.tmp; mv docs/source/_toctree.yml.tmp docs/source/_toctree.yml @echo "Cleaning up generated Markdown Notebook files (if any)..." diff --git a/docs/scripts/auto-generate-examples.py b/docs/scripts/auto-generate-examples.py index 354aa77..9025ae9 100644 --- a/docs/scripts/auto-generate-examples.py +++ b/docs/scripts/auto-generate-examples.py @@ -3,10 +3,12 @@ import subprocess SERVICES = [ - ("Microsoft Foundry", "foundry"), - ("Azure Machine Learning", "machine-learning"), + ("Archived Microsoft Foundry", "foundry"), + ("Archived Azure Machine Learning", "machine-learning"), ] +TARGET_ROOT = "docs/source/deprecated" + def get_git_date(file_path: str) -> str | None: """Get the last commit date (YYYY-MM-DD) for a file using git.""" @@ -29,7 +31,7 @@ def get_git_date(file_path: str) -> str | None: def process_readme_files(): for _, dir_name in SERVICES: print(f"Processing azure-notebook.md files from examples/{dir_name}...") - os.makedirs(f"docs/source/{dir_name}/examples", exist_ok=True) + os.makedirs(f"{TARGET_ROOT}/{dir_name}/examples", exist_ok=True) for root, _, files in os.walk(f"examples/{dir_name}"): for file in files: @@ -42,7 +44,7 @@ def process_file(root, file, dir_name): subdir = root.replace(f"examples/{dir_name}/", "") base = os.path.basename(subdir) - target = f"docs/source/{dir_name}/examples/{base}.mdx" + target = f"{TARGET_ROOT}/{dir_name}/examples/{base}.mdx" print(f"Processing {file_path} to {target}") with open(file_path, "r") as f: diff --git a/docs/scripts/auto-update-toctree.py b/docs/scripts/auto-update-toctree.py index 36436bd..c18fa03 100644 --- a/docs/scripts/auto-update-toctree.py +++ b/docs/scripts/auto-update-toctree.py @@ -6,8 +6,8 @@ from pathlib import Path SERVICES = [ - ("Microsoft Foundry", "foundry"), - ("Azure Machine Learning", "machine-learning"), + ("Archived Microsoft Foundry examples", "foundry"), + ("Archived Azure Machine Learning examples", "machine-learning"), ] @@ -129,7 +129,7 @@ def inject_author_date(content: str, author: str | None, date: str | None) -> st def get_example_entries(dir_name: str) -> list: """Find, process, and sort example files for a given service directory.""" - example_files = sorted(glob.glob(f"docs/source/{dir_name}/examples/*.mdx")) + example_files = sorted(glob.glob(f"docs/source/deprecated/{dir_name}/examples/*.mdx")) if not example_files: return [] @@ -179,20 +179,19 @@ def get_example_entries(dir_name: str) -> list: return entries -def build_examples_section(dir_name: str, entries: list) -> list: +def build_examples_section(dir_name: str, entries: list, indent: str) -> list: """Build the YAML lines for an Examples sub-section.""" lines = [] - lines.append(" # GENERATED CONTENT DO NOT EDIT") - lines.append(" - sections:") + lines.append(f"{indent}# GENERATED CONTENT DO NOT EDIT") + lines.append(f"{indent}- sections:") for base, title, is_new, creation_date in entries: - lines.append(f" - local: {dir_name}/examples/{base}") - lines.append(f' title: "{title}"') + lines.append(f"{indent} - local: deprecated/{dir_name}/examples/{base}") + lines.append(f'{indent} title: "{title}"') # if is_new: # lines.append(" new: true") - lines.append(" title: Examples") - # NOTE: set to true now, to improve discoverability - lines.append(" isExpanded: true") - lines.append(" # END OF GENERATED CONTENT") + lines.append(f"{indent} title: Examples") + lines.append(f"{indent} isExpanded: false") + lines.append(f"{indent}# END OF GENERATED CONTENT") return lines @@ -223,7 +222,9 @@ def inject_examples_for_service( result_lines = [] for line in lines: if is_service_title_line(line, display_name): - result_lines.extend(build_examples_section(dir_name, entries)) + indent_match = re.match(r"^(\s*)title:", line) + indent = indent_match.group(1) if indent_match else " " + result_lines.extend(build_examples_section(dir_name, entries, indent)) result_lines.append(line) return result_lines @@ -235,7 +236,7 @@ def inject_examples_for_service( new_section.append("- sections:") new_section.append(" - sections:") for base, title, is_new, creation_date in entries: - new_section.append(f" - local: {dir_name}/examples/{base}") + new_section.append(f" - local: deprecated/{dir_name}/examples/{base}") new_section.append(f' title: "{title}"') new_section.append(" title: Examples") new_section.append(" isExpanded: true") diff --git a/docs/source/_redirects.yml b/docs/source/_redirects.yml index 3c9ae61..6bbd906 100644 --- a/docs/source/_redirects.yml +++ b/docs/source/_redirects.yml @@ -1,16 +1,29 @@ -guides/one-click-deployment-azure-ml: guides/one-click-deployment-foundry -guides/one-click-deployment-azure-ai: guides/one-click-deployment-foundry -azure-ai/configure: guides/configure-azure-ml-microsoft-foundry -azure-ai/set-up: guides/configure-azure-ml-microsoft-foundry +guides/one-click-deployment-azure-ml: deprecated/guides/one-click-deployment-foundry +guides/one-click-deployment-azure-ai: deprecated/guides/one-click-deployment-foundry +azure-ai/configure: deprecated/guides/configure-azure-ml-microsoft-foundry +azure-ai/set-up: deprecated/guides/configure-azure-ml-microsoft-foundry # NOTE: The redirects below are required only for the entries and examples # published before the rename from Azure AI Foundry to Microsoft Foundry -azure-ai/hardware: foundry/hardware -azure-ai/introduction: foundry/introduction -azure-ai/models: foundry/models -azure-ai/tasks: foundry/tasks -azure-ai/examples/build-agents-with-smolagents: foundry/examples/build-agents-with-smolagents -azure-ai/examples/deploy-large-language-models: foundry/examples/deploy-large-language-models -azure-ai/examples/deploy-nvidia-parakeet-asr: foundry/examples/deploy-nvidia-parakeet-asr -azure-ai/examples/deploy-smollm3: foundry/examples/deploy-smollm3 -azure-ai/examples/deploy-vision-language-models: foundry/examples/deploy-vision-language-models +azure-ai/hardware: deprecated/foundry/hardware +azure-ai/introduction: deprecated/foundry/introduction +azure-ai/models: deprecated/foundry/models +azure-ai/tasks: deprecated/foundry/tasks +azure-ai/examples/build-agents-with-smolagents: deprecated/foundry/examples/build-agents-with-smolagents +azure-ai/examples/deploy-large-language-models: deprecated/foundry/examples/deploy-large-language-models +azure-ai/examples/deploy-nvidia-parakeet-asr: deprecated/foundry/examples/deploy-nvidia-parakeet-asr +azure-ai/examples/deploy-smollm3: deprecated/foundry/examples/deploy-smollm3 +azure-ai/examples/deploy-vision-language-models: deprecated/foundry/examples/deploy-vision-language-models + +features: deprecated/features +security: deprecated/security +faq: deprecated/faq +guides/introduction: deprecated/guides/introduction +guides/managed-compute-foundry: deprecated/guides/managed-compute-foundry +guides/access-gated-models: deprecated/guides/access-gated-models +guides/configure-azure-ml-microsoft-foundry: deprecated/guides/configure-azure-ml-microsoft-foundry +guides/one-click-deployment-foundry: deprecated/guides/one-click-deployment-foundry +foundry/introduction: deprecated/foundry/introduction +foundry/models: deprecated/foundry/models +foundry/tasks: deprecated/foundry/tasks +foundry/hardware: deprecated/foundry/hardware diff --git a/docs/source/_toctree.yml b/docs/source/_toctree.yml index b7fce87..d0acc6a 100644 --- a/docs/source/_toctree.yml +++ b/docs/source/_toctree.yml @@ -1,35 +1,88 @@ - sections: - local: index - title: Hugging Face on Microsoft Azure - - local: features - title: Features & Benefits - - local: security - title: Security & Compliance - - local: resources - title: Other Resources - - local: faq - title: Frequent Asked Questions (FAQ) - title: Getting Started + title: Overview + title: Overview - sections: - - local: guides/managed-compute-foundry - title: Deploy Hugging Face Models in Foundry with Managed Compute - - local: guides/one-click-deployment-foundry - title: One-click deployments from the Hugging Face Hub on Microsoft Foundry - - local: guides/access-gated-models - title: Deploy Hugging Face gated models on Microsoft Foundry - - local: guides/request-model-addition - title: Request a model addition in the Hugging Face collection on Microsoft Foundry - - local: guides/configure-azure-ml-microsoft-foundry - title: Configure Azure Machine Learning and Microsoft Foundry - local: guides/introduction - title: Guides + - local: get-started/deploy-open-models-on-microsoft-foundry-with-python + title: Deploy open-models on Microsoft Foundry with Python + - local: get-started/deploy-open-models-on-microsoft-foundry + title: Deploy open-models on Microsoft Foundry + title: Get started - sections: - - local: foundry/introduction - title: Introduction - - local: foundry/tasks - title: Supported Tasks - - local: foundry/hardware - title: Supported Hardware - - local: foundry/models - title: Supported Models - title: Microsoft Foundry + - local: agents/introduction + title: Agents + title: Agents +- sections: + - local: large-language-models/introduction + title: Large Language Models + title: Large Language Models +- sections: + - local: deprecated/overview + title: Overview + - sections: + - local: deprecated/features + title: Features & Benefits + - local: deprecated/security + title: Security & Compliance + - local: deprecated/resources + title: Other Resources + - local: deprecated/faq + title: FAQ + title: Legacy top-level pages + isExpanded: false + - sections: + - local: deprecated/guides/introduction + title: Guides index + - local: deprecated/guides/configure-azure-ml-microsoft-foundry + title: Configure Azure Machine Learning and Microsoft Foundry + - local: deprecated/guides/managed-compute-foundry + title: Deploy Hugging Face Models in Foundry with Managed Compute + - local: deprecated/guides/one-click-deployment-foundry + title: One-click deployments from the Hugging Face Hub on Microsoft Foundry + - local: deprecated/guides/access-gated-models + title: Deploy Hugging Face gated models on Microsoft Foundry + - local: deprecated/guides/request-model-addition + title: Request a model addition in the Hugging Face collection on Microsoft Foundry + title: Legacy guides + isExpanded: false + - sections: + - local: deprecated/foundry/introduction + title: Introduction + - local: deprecated/foundry/tasks + title: Supported tasks + - local: deprecated/foundry/hardware + title: Supported hardware + - local: deprecated/foundry/models + title: Supported models + title: Legacy Foundry reference + isExpanded: false + - sections: + # GENERATED CONTENT DO NOT EDIT + - sections: + - local: deprecated/foundry/examples/build-agents-with-smolagents + title: "Archived Example: Build Agents with smolagents on Microsoft Foundry" + - local: deprecated/foundry/examples/deploy-large-language-models + title: "Archived Example: Deploy Large Language Models on Microsoft Foundry" + - local: deprecated/foundry/examples/deploy-nvidia-parakeet-asr + title: "Archived Example: Deploy NVIDIA Parakeet for ASR on Microsoft Foundry" + - local: deprecated/foundry/examples/deploy-smollm3 + title: "Archived Example: Deploy SmolLM3 on Microsoft Foundry" + - local: deprecated/foundry/examples/deploy-vision-language-models + title: "Archived Example: Deploy Vision Language Models on Microsoft Foundry" + title: Examples + isExpanded: false + # END OF GENERATED CONTENT + title: Archived Microsoft Foundry examples + isExpanded: false + - sections: + # GENERATED CONTENT DO NOT EDIT + - sections: + - local: deprecated/machine-learning/examples/tool-calling-agent-fine-tuning + title: "Archived Example: Tool-calling Agent Fine-tuning on Azure Machine Learning" + title: Examples + isExpanded: false + # END OF GENERATED CONTENT + title: Archived Azure Machine Learning examples + isExpanded: false + title: Deprecated / Archived + isExpanded: false diff --git a/docs/source/agents/introduction.mdx b/docs/source/agents/introduction.mdx new file mode 100644 index 0000000..57be659 --- /dev/null +++ b/docs/source/agents/introduction.mdx @@ -0,0 +1 @@ +# Agents diff --git a/docs/source/deprecated/faq.mdx b/docs/source/deprecated/faq.mdx new file mode 100644 index 0000000..c4cff70 --- /dev/null +++ b/docs/source/deprecated/faq.mdx @@ -0,0 +1,11 @@ +# Archived: FAQ + +This page preserves the older FAQ topics from the previous docs structure. + +## What did the old FAQ focus on? + +- The distinction between Azure Machine Learning and Microsoft Foundry +- Why hub-based projects mattered for open-model deployments +- What capabilities were limited in standalone Foundry projects + +That content has been simplified in the current [FAQ](../reference/faq), but the old framing is still useful when reading older screenshots, tutorials, or issue threads that refer to Azure AI Foundry hubs and projects. diff --git a/docs/source/deprecated/features.mdx b/docs/source/deprecated/features.mdx new file mode 100644 index 0000000..0ead4dc --- /dev/null +++ b/docs/source/deprecated/features.mdx @@ -0,0 +1,17 @@ +# Archived: Features & Benefits + +This page preserves the former high-level features summary from the previous documentation structure. + +The legacy framing emphasized: + +- A large Hugging Face catalog available through Microsoft Foundry and Azure Machine Learning +- Managed deployment paths with Azure-hosted security, scaling, and monitoring +- Coverage across text, multimodal, audio, vision, and embeddings workloads +- Open-source runtimes such as TGI, vLLM, SGLang, and TEI +- Enterprise controls around compliance, isolation, and governance + +For the current task-oriented docs, use: + +- [Overview](../index) +- [Supported models](../reference/supported-models) +- [Security and model eligibility](../reference/security-and-eligibility) diff --git a/docs/source/deprecated/foundry/examples/build-agents-with-smolagents.mdx b/docs/source/deprecated/foundry/examples/build-agents-with-smolagents.mdx new file mode 100644 index 0000000..c8ff608 --- /dev/null +++ b/docs/source/deprecated/foundry/examples/build-agents-with-smolagents.mdx @@ -0,0 +1,27 @@ +# Archived Example: Build Agents with smolagents on Microsoft Foundry + +

Last updated 2026-03-02

+ + +

Last updated 2026-03-02

+ + +This archived example focused on building an agent with `smolagents` on top of a Hugging Face deployment in Microsoft Foundry. + +## What it covered + +- Deploying a coding-oriented LLM from the Hugging Face collection +- Invoking the model from Python +- Wiring the deployment into a `smolagents` workflow +- Comparing Hub, Azure ML, and Foundry views of the same model + +## Original assets + +- [Notebook source](https://github.com/huggingface/Microsoft-Azure/tree/main/examples/foundry/build-agents-with-smolagents/azure-notebook.ipynb) +- [Example directory](https://github.com/huggingface/Microsoft-Azure/tree/main/examples/foundry/build-agents-with-smolagents) + +## Current docs to read instead + +- [Build agents with Foundry deployments](../../../agents/introduction) +- [Define custom tools](../../../agents/define-custom-tools) +- [Connect MCP servers](../../../agents/connect-mcp) \ No newline at end of file diff --git a/docs/source/deprecated/foundry/examples/deploy-large-language-models.mdx b/docs/source/deprecated/foundry/examples/deploy-large-language-models.mdx new file mode 100644 index 0000000..9e8b004 --- /dev/null +++ b/docs/source/deprecated/foundry/examples/deploy-large-language-models.mdx @@ -0,0 +1,27 @@ +# Archived Example: Deploy Large Language Models on Microsoft Foundry + +

Last updated 2026-03-02

+ + +

Last updated 2026-03-02

+ + +This archived example showed a more notebook-heavy path for deploying a text-generation model and then calling it from several clients. + +## What it covered + +- Programmatic deployment with the Azure ML SDK +- OpenAI-compatible inference calls +- A local Gradio chat client +- The relationship between the Hugging Face model ID and the Azure model URI + +## Original assets + +- [Notebook source](https://github.com/huggingface/Microsoft-Azure/tree/main/examples/foundry/deploy-large-language-models/azure-notebook.ipynb) +- [Example directory](https://github.com/huggingface/Microsoft-Azure/tree/main/examples/foundry/deploy-large-language-models) + +## Current docs to read instead + +- [Deploy your first model](../../../get-started/deploy-first-model) +- [Call your deployment](../../../get-started/call-your-deployment) +- [Third-party integrations](../../../guides/third-party-integrations) \ No newline at end of file diff --git a/docs/source/deprecated/foundry/examples/deploy-nvidia-parakeet-asr.mdx b/docs/source/deprecated/foundry/examples/deploy-nvidia-parakeet-asr.mdx new file mode 100644 index 0000000..6ead456 --- /dev/null +++ b/docs/source/deprecated/foundry/examples/deploy-nvidia-parakeet-asr.mdx @@ -0,0 +1,26 @@ +# Archived Example: Deploy NVIDIA Parakeet for ASR on Microsoft Foundry + +

Last updated 2026-03-02

+ + +

Last updated 2026-03-02

+ + +This archived example focused on automatic speech recognition using NVIDIA Parakeet. + +## What it covered + +- Deploying an ASR model from the Hugging Face collection +- Sending audio transcription requests +- Comparing different client approaches, including cURL and Python +- Working with a speech-focused deployment instead of a text chat model + +## Original assets + +- [Notebook source](https://github.com/huggingface/Microsoft-Azure/tree/main/examples/foundry/deploy-nvidia-parakeet-asr/azure-notebook.ipynb) +- [Example directory](https://github.com/huggingface/Microsoft-Azure/tree/main/examples/foundry/deploy-nvidia-parakeet-asr) + +## Current docs to read instead + +- [Deploy your first model](../../../get-started/deploy-first-model) +- [Supported tasks](../../../reference/supported-tasks) \ No newline at end of file diff --git a/docs/source/deprecated/foundry/examples/deploy-smollm3.mdx b/docs/source/deprecated/foundry/examples/deploy-smollm3.mdx new file mode 100644 index 0000000..de6ce17 --- /dev/null +++ b/docs/source/deprecated/foundry/examples/deploy-smollm3.mdx @@ -0,0 +1,26 @@ +# Archived Example: Deploy SmolLM3 on Microsoft Foundry + +

Last updated 2026-03-02

+ + +

Last updated 2026-03-02

+ + +This archived example focused on deploying `HuggingFaceTB/SmolLM3-3B` and calling it through the OpenAI-compatible route. + +## What it covered + +- Building the Azure model URI from the Hugging Face model ID +- Creating a managed endpoint and deployment +- Running text-generation requests +- Reasoning-oriented and long-context positioning for a small model + +## Original assets + +- [Notebook source](https://github.com/huggingface/Microsoft-Azure/tree/main/examples/foundry/deploy-smollm3/azure-notebook.ipynb) +- [Example directory](https://github.com/huggingface/Microsoft-Azure/tree/main/examples/foundry/deploy-smollm3) + +## Current docs to read instead + +- [Deploy your first model](../../../get-started/deploy-first-model) +- [Thinking levels](../../../guides/thinking-levels) \ No newline at end of file diff --git a/docs/source/deprecated/foundry/examples/deploy-vision-language-models.mdx b/docs/source/deprecated/foundry/examples/deploy-vision-language-models.mdx new file mode 100644 index 0000000..053525d --- /dev/null +++ b/docs/source/deprecated/foundry/examples/deploy-vision-language-models.mdx @@ -0,0 +1,26 @@ +# Archived Example: Deploy Vision Language Models on Microsoft Foundry + +

Last updated 2026-03-02

+ + +

Last updated 2026-03-02

+ + +This archived example focused on multimodal deployments, using a vision-language model that accepts both images and text. + +## What it covered + +- Deploying a VLM from the Hugging Face collection +- Sending multimodal requests +- Using the deployment through both SDK and notebook flows +- Handling image-aware prompts in a Foundry deployment + +## Original assets + +- [Notebook source](https://github.com/huggingface/Microsoft-Azure/tree/main/examples/foundry/deploy-vision-language-models/azure-notebook.ipynb) +- [Example directory](https://github.com/huggingface/Microsoft-Azure/tree/main/examples/foundry/deploy-vision-language-models) + +## Current docs to read instead + +- [Deploy your first model](../../../get-started/deploy-first-model) +- [Supported tasks](../../../reference/supported-tasks) \ No newline at end of file diff --git a/docs/source/deprecated/foundry/hardware.mdx b/docs/source/deprecated/foundry/hardware.mdx new file mode 100644 index 0000000..0d18581 --- /dev/null +++ b/docs/source/deprecated/foundry/hardware.mdx @@ -0,0 +1,5 @@ +# Archived: Supported Hardware + +This page preserves the older hardware table references for GPU and CPU instance families used in Foundry-related deployment flows. + +The maintained version is [Supported hardware](../../reference/supported-hardware). diff --git a/docs/source/deprecated/foundry/introduction.mdx b/docs/source/deprecated/foundry/introduction.mdx new file mode 100644 index 0000000..4048557 --- /dev/null +++ b/docs/source/deprecated/foundry/introduction.mdx @@ -0,0 +1,5 @@ +# Archived: Hugging Face on Microsoft Foundry + +This page preserves the former service-introduction page that described the broader Hugging Face and Microsoft collaboration, the expansion through Build and Ignite announcements, and the catalog-scale messaging used in the earlier docs. + +That material has been replaced in the main docs by a shorter, task-oriented [Overview](../../index). diff --git a/docs/source/deprecated/foundry/models.mdx b/docs/source/deprecated/foundry/models.mdx new file mode 100644 index 0000000..6e3721e --- /dev/null +++ b/docs/source/deprecated/foundry/models.mdx @@ -0,0 +1,9 @@ +# Archived: Supported Models + +This page preserves the earlier explanation of how to check whether a Hugging Face model is available in the Foundry catalog, including: + +- Checking the **Deploy on Microsoft Foundry** action on the Hub +- Searching the Hugging Face collection in Foundry +- Using the old Azure lookup endpoint mentioned in the earlier docs + +The maintained version is [Supported models](../../reference/supported-models). diff --git a/docs/source/deprecated/foundry/tasks.mdx b/docs/source/deprecated/foundry/tasks.mdx new file mode 100644 index 0000000..2ac9d59 --- /dev/null +++ b/docs/source/deprecated/foundry/tasks.mdx @@ -0,0 +1,5 @@ +# Archived: Supported Tasks + +This page preserves the older task list wording that grouped supported workloads across text, multimodal, audio, and vision. + +The maintained version is [Supported tasks](../../reference/supported-tasks). diff --git a/docs/source/deprecated/guides/access-gated-models.mdx b/docs/source/deprecated/guides/access-gated-models.mdx new file mode 100644 index 0000000..a964851 --- /dev/null +++ b/docs/source/deprecated/guides/access-gated-models.mdx @@ -0,0 +1,13 @@ +# Archived: Deploy Hugging Face gated models on Microsoft Foundry + +This page preserves the former gated-model deployment flow. + +## Legacy flow summary + +1. Request access to the gated repository on the Hugging Face Hub +2. Create a Hugging Face token with gated-repository read permissions +3. Store that token in an Azure Machine Learning connection +4. Ensure the endpoint can access the secret store +5. Deploy the model using the Azure ML SDK + +The maintained version of this guidance is [Gated models](../../guides/gated-models). diff --git a/docs/source/deprecated/guides/configure-azure-ml-microsoft-foundry.mdx b/docs/source/deprecated/guides/configure-azure-ml-microsoft-foundry.mdx new file mode 100644 index 0000000..e91c641 --- /dev/null +++ b/docs/source/deprecated/guides/configure-azure-ml-microsoft-foundry.mdx @@ -0,0 +1,17 @@ +# Archived: Configure Azure Machine Learning and Microsoft Foundry + +This page preserves the former setup flow that walked through: + +1. Installing and authenticating the Azure CLI +2. Installing the `az ml` extension +3. Creating a resource group +4. Creating an Azure AI Foundry hub +5. Creating a project attached to that hub + +That flow assumed the older Azure AI Foundry naming and hub/project model. The maintained version is [Configure Microsoft Foundry](../../get-started/configure-foundry). + +## Legacy notes + +- Older guides and notebooks may refer to Azure AI Foundry instead of Microsoft Foundry +- Older commands may reference hub-based projects explicitly +- Some screenshots and resource names in notebooks still follow that older wording diff --git a/docs/source/deprecated/guides/introduction.mdx b/docs/source/deprecated/guides/introduction.mdx new file mode 100644 index 0000000..fbd7cb1 --- /dev/null +++ b/docs/source/deprecated/guides/introduction.mdx @@ -0,0 +1,17 @@ +# Archived: Guides + +This page used to act as the guides index in the former documentation structure. + +The old guide set centered on: + +- One-click deployments from the Hugging Face Hub +- Deploying gated models +- Requesting model additions +- Configuring Azure Machine Learning and Microsoft Foundry +- Managed compute + +The maintained equivalents now live under: + +- [Get started](../../get-started/introduction) +- [Guides](../../guides/managed-compute) +- [Agents](../../agents/introduction) diff --git a/docs/source/deprecated/guides/managed-compute-foundry.mdx b/docs/source/deprecated/guides/managed-compute-foundry.mdx new file mode 100644 index 0000000..da79f67 --- /dev/null +++ b/docs/source/deprecated/guides/managed-compute-foundry.mdx @@ -0,0 +1,12 @@ +# Archived: Deploy Hugging Face Models in Foundry with Managed Compute + +This archived page keeps the older, more detailed managed-compute framing that predated the simplified guide set. + +The former guide emphasized: + +- Managed compute as a dedicated-capacity deployment option +- Accelerator-family-specific quota requirements +- Template-driven deployment choices +- Validation through the Foundry playground before moving to code + +For the current streamlined version, see [Managed compute](../../guides/managed-compute). diff --git a/docs/source/deprecated/guides/one-click-deployment-foundry.mdx b/docs/source/deprecated/guides/one-click-deployment-foundry.mdx new file mode 100644 index 0000000..7f79db7 --- /dev/null +++ b/docs/source/deprecated/guides/one-click-deployment-foundry.mdx @@ -0,0 +1,17 @@ +# Archived: One-click deployments from the Hugging Face Hub on Microsoft Foundry + +This page preserves the former one-click deployment entry point. + +## Legacy flow + +1. Browse models on the Hugging Face Hub +2. Use the **Deploy** button on a supported model card +3. Choose **Deploy on Microsoft Foundry** +4. Review the model card in Foundry +5. Create the deployment and test the endpoint + +The current maintained equivalent is [Deploy your first model](../../get-started/deploy-first-model). + +## Why keep this archived page? + +Older tutorials, screenshots, and issues often refer to the Hub-first flow rather than the current docs navigation. diff --git a/docs/source/deprecated/guides/request-model-addition.mdx b/docs/source/deprecated/guides/request-model-addition.mdx new file mode 100644 index 0000000..cbf61ee --- /dev/null +++ b/docs/source/deprecated/guides/request-model-addition.mdx @@ -0,0 +1,13 @@ +# Archived: Request a model addition in the Hugging Face collection on Microsoft Foundry + +This page preserves the earlier model-addition guidance from the old docs structure. + +The previous checklist focused on: + +- `Transformers`, `Diffusers`, or `Sentence-Transformers` compatibility +- A supported task taxonomy +- Runtime alignment for TGI, vLLM, SGLang, or TEI when relevant +- Public visibility on the Hub +- Secure artifact formats and security scanning + +The maintained version is [Request model addition](../../guides/request-model-addition). diff --git a/docs/source/deprecated/machine-learning/examples/tool-calling-agent-fine-tuning.mdx b/docs/source/deprecated/machine-learning/examples/tool-calling-agent-fine-tuning.mdx new file mode 100644 index 0000000..b74f669 --- /dev/null +++ b/docs/source/deprecated/machine-learning/examples/tool-calling-agent-fine-tuning.mdx @@ -0,0 +1,22 @@ +# Archived Example: Tool-calling Agent Fine-tuning on Azure Machine Learning + +

Last updated 2026-03-02

+ + +

Last updated 2026-03-02

+ + +This archived example comes from the earlier Azure Machine Learning example set rather than the current Foundry-first docs path. + +## What it covered + +- Fine-tuning an agent-oriented model +- Preparing training data for tool-calling behavior +- Running an Azure Machine Learning job +- Inspecting experiment and log outputs + +## Original assets + +- [Example directory](https://github.com/huggingface/Microsoft-Azure/tree/main/examples/machine-learning/tool-calling-agent-fine-tuning) + +This material remains archived because the active docs are now centered on Foundry deployment and integration workflows instead of Azure ML training examples. \ No newline at end of file diff --git a/docs/source/deprecated/overview.mdx b/docs/source/deprecated/overview.mdx new file mode 100644 index 0000000..a266581 --- /dev/null +++ b/docs/source/deprecated/overview.mdx @@ -0,0 +1,11 @@ +# Deprecated / Archived + +This section preserves the former documentation layout and legacy examples that existed before the docs were reorganized around the simpler Foundry-focused structure. + +Use this section when you need to: + +- Follow an old link that no longer belongs in the main learning path +- Recover older wording, screenshots, or step-by-step examples +- Compare the previous docs organization with the current one + +The archived pages are kept for continuity, not as the recommended entry point for new users. For the current docs, start from the main [Overview](../index). diff --git a/docs/source/resources.mdx b/docs/source/deprecated/resources.mdx similarity index 68% rename from docs/source/resources.mdx rename to docs/source/deprecated/resources.mdx index 3b0cf10..6dcf149 100644 --- a/docs/source/resources.mdx +++ b/docs/source/deprecated/resources.mdx @@ -1,20 +1,14 @@ -# Resources +# Archived: Other Resources -- [Hugging Face on Azure](https://azure.microsoft.com/en-us/solutions/hugging-face-on-azure) - -## Posts +This page keeps the older external-reading collection that used to live near the top of the docs. -### 2025 +## Legacy links +- [Hugging Face on Azure](https://azure.microsoft.com/en-us/solutions/hugging-face-on-azure) - [Microsoft and Hugging Face expand collaboration](https://huggingface.co/blog/azure-ai-foundry) - [Microsoft and Hugging Face expand collaboration to accelerate Open-Source AI Innovation on Azure AI Foundry](https://devblogs.microsoft.com/foundry/microsoft-and-hugging-face-expand-partnership-to-accelerate-open-source-ai-innovation-on-azure-ai-foundry/) - -### 2024 - -- [From cloud to developers: Hugging Face and Microsoft Deepen Collaboration](https://huggingface.co/blog/microsoft-collaboration) +- [From cloud to developers: Hugging Face and Microsoft deepen collaboration](https://huggingface.co/blog/microsoft-collaboration) - [Microsoft and Hugging Face deepen generative AI partnership](https://techcommunity.microsoft.com/blog/aiplatformblog/microsoft-and-hugging-face-deepen-generative-ai-partnership/4144565) +- [Hugging Face collaborates with Microsoft to launch Hugging Face Model Catalog on Azure](https://huggingface.co/blog/hugging-face-endpoints-on-azure) -### 2023 - -- [Hugging Face Collaborates with Microsoft to launch Hugging Face Model Catalog on Azure](https://huggingface.co/blog/hugging-face-endpoints-on-azure) -- [Accelerating over 130,000 Hugging Face models with ONNX Runtime](https://opensource.microsoft.com/blog/2023/10/04/accelerating-over-130000-hugging-face-models-with-onnx-runtime/) +For the maintained external-links page, see [Resources](../resources). diff --git a/docs/source/deprecated/security.mdx b/docs/source/deprecated/security.mdx new file mode 100644 index 0000000..4d552b4 --- /dev/null +++ b/docs/source/deprecated/security.mdx @@ -0,0 +1,14 @@ +# Archived: Security & Compliance + +This page preserves the earlier security-focused explanation from the old docs layout. + +The legacy guidance highlighted the following model eligibility requirements: + +- Public availability on the Hugging Face Hub, including gated public repositories +- Safe weight formats such as `safetensors` +- No unreviewed `trust_remote_code` or unsupported custom execution code +- Security scanning on Hub artifacts before catalog inclusion + +It also stressed that enterprise controls such as private networking, auditability, and access control still depend on the surrounding Microsoft Foundry and Azure environment. + +For the maintained version of this material, see [Security and model eligibility](../reference/security-and-eligibility). diff --git a/docs/source/faq.mdx b/docs/source/faq.mdx deleted file mode 100644 index b721ec0..0000000 --- a/docs/source/faq.mdx +++ /dev/null @@ -1,28 +0,0 @@ -# Frequent Asked Questions (FAQ) - -## What is Azure Machine Learning (Azure ML)? - -Azure ML is Microsoft’s cloud-native platform for fully managing the ML lifecycle—training, deployment, monitoring, pipelines, AutoML, model registries, and responsible AI tooling—designed for data scientists and ML engineers. - -## What is Microsoft Foundry (formerly Azure AI Foundry, and Azure AI Studio before)? - -Microsoft Foundry builds on Azure Machine Learning but is tailored specifically for generative AI and agent-based applications. It offers: - -* A unified experience for building, evaluating, and deploying LLMs and multimodal agents. -* Access to a broad catalog of open-source and commercial frontier models—from Azure OpenAI, Hugging Face, Meta, DeepSeek, etc. -* Integrated tools like model evaluation leaderboards, prompt flows (for RAG), content safety, and agent orchestration. - -More information can be found at [What is Microsoft Foundry?](https://learn.microsoft.com/en-us/azure/ai-foundry/what-is-azure-ai-foundry). - -## What’s the difference between a **Hub-based project** and a **Foundry (standalone) project**? - -| Feature | Hub-based project | Standalone Foundry project | -|--------|--------------------|-----------------------------| -| Requires a Hub resource | ✅ Yes—project is linked to a hub | ❌ No—project created individually | -| Shared infrastructure (compute/quota) | ✅ Yes | ❌ No | -| Shared security/network settings | ✅ Yes | ❌ No | -| Shared resource connections | ✅ Yes (e.g., models, storage) | ❌ Per‑project only | -| Full Generative AI tooling (fine-tuning, evaluation, RAG, agent orchestration) | ✅ Yes | ⚠️ Limited support | -| Accessible from Azure ML Studio | ✅ Yes | Limited/absent | - -Hub-based projects provide **complete** access to generative-AI features; standalone projects operate with **limited** capabilities. Open-model deployments are only accessible through Hub-based project for now. diff --git a/docs/source/features.mdx b/docs/source/features.mdx deleted file mode 100644 index 35e278f..0000000 --- a/docs/source/features.mdx +++ /dev/null @@ -1,81 +0,0 @@ -# Features & Benefits - -1. Extensive Model Catalog Integration - - Over 11,000 Hugging Face models, including text, vision, speech, and multimodal models are directly accessible within Microsoft Foundry Hub and Azure Machine Learning Studio for one-click deployment. - - Continuous updates ensure day-0 releases of new and trending models from the Hugging Face Hub are available on Azure as soon as they launch. - -2. Secure, Scalable, and Managed Deployments - - Models can be deployed on managed online endpoints within Azure Machine Learning, providing secure, scalable REST APIs for real-time inference. - - Azure's infrastructure supports both CPU and GPU deployments, with features like autoscaling, traffic splitting, and monitoring built in. - - Models are scanned for vulnerabilities, and certain model weights are hosted directly on Azure for enhanced security and compliance, including private network deployments with no external egress. - -3. Multimodal and Domain-Specific Support - - The collaboration covers a wide range of modalities and tasks: text generation, translation, image classification, segmentation, speech recognition, audio classification, and more. - - Ongoing expansion includes support for video, 3D, time series, protein folding, and other specialized domains. - -4. Enterprise-Grade Infrastructure and Developer Tools - - Integration leverages Azure's enterprise-grade infrastructure, including the latest GPU and CPU offerings. - - Hugging Face models are optimized for Azure's hardware, ensuring high performance and efficiency, especially for demanding generative AI applications. - - Integration with Azure Machine Learning SDK, Azure AI SDK, and Python APIs for seamless automation and scripting. - -6. Community and Open-Source Ecosystem - - The partnership brings the innovation of Hugging Face's open-source community (nearly 2 million models and 8 million users) to Azure's enterprise customers. - - The Hugging Face models are powered by open-source inference engines backed by Transformers, Diffusers, or Sentence Transformers; as well as efficient production-ready solutions such as Text Generation Inference (TGI), vLLM, SGLang and Text Embeddings Inference (TEI), among others to come. - -7. Enhanced Security, Compliance, and Monitoring - - All models available via Azure are subject to security scans and compliance checks, as the model weights are ensured to be distributed in Safetensors format, scanned with JFrog, Protect AI, and ClamAV, as Hugging Face Security Partners, and Hugging Face's Pickelscan. - - Azure's enterprise security features (private endpoints, network isolation, audit trails) are available for Hugging Face model deployments. - -## Benefits for Enterprises and Developers - -1. Accelerated AI Adoption and Innovation - - Rapid access to the latest open-source models and state-of-the-art AI capabilities without the overhead of infrastructure setup or maintenance. - - Enables organizations to build, experiment, and iterate on AI solutions faster, keeping pace with the evolving AI landscape. - -2. Lower Barriers to Production-Ready AI - - Simplifies the deployment of complex models (like Transformers and LLMs) into secure, production environments with minimal configuration. - - Reduces the need for specialized DevOps or ML infrastructure expertise. - -3. Flexibility and Control - - Enterprises retain full control over data, model selection, and deployment environments, supporting both public and private cloud scenarios. - -4. Cost and Resource Optimization - - Azure's flexible scaling, global availability, and pay-as-you-go pricing help optimize costs for both experimentation and large-scale production. - - Efficient resource utilization through auto-scaling and traffic management features. - -5. Security and Compliance - - Enterprise-grade security, compliance, and privacy controls are built into every stage of the model lifecycle. - - Models are vetted for vulnerabilities and can be deployed in isolated environments to meet regulatory requirements. - -6. Future-Proofing and Ecosystem Growth - - Ongoing collaboration ensures regular updates, support for new modalities, and integration with emerging Azure and Hugging Face features. - - Access to both open and proprietary models, as well as tools for building modular, agentic, and composable AI applications. - ---- - -This deep integration between Hugging Face and Microsoft Azure empowers organizations to harness the best of open-source AI with the reliability, security, and scalability of Azure's cloud ecosystem. diff --git a/docs/source/foundry/hardware.mdx b/docs/source/foundry/hardware.mdx deleted file mode 100644 index 60aa465..0000000 --- a/docs/source/foundry/hardware.mdx +++ /dev/null @@ -1,43 +0,0 @@ -# Supported Hardware - -## NVIDIA GPUs - -Instance Name | GPU Type | GPUs | Total GPU VRAM ---------------------------|------------------|------|---------------- -Standard_NC4as_T4_v3 | NVIDIA TESLA T4 | 1 | 16 GB -Standard_NC8as_T4_v3 | NVIDIA TESLA T4 | 1 | 16 GB -Standard_NC16as_T4_v3 | NVIDIA TESLA T4 | 1 | 16 GB -Standard_NC64as_T4_v3 | NVIDIA TESLA T4 | 4 | 64 GB -Standard_NC24ads_A100_v4 | NVIDIA A100 80GB | 1 | 80 GB -Standard_NC40ads_H100_v5 | NVIDIA H100 80GB | 1 | 80 GB -Standard_NC48ads_A100_v4 | NVIDIA A100 80GB | 2 | 160 GB -Standard_NC80adis_H100_v5 | NVIDIA H100 80GB | 2 | 160 GB -Standard_NC96ads_A100_v4 | NVIDIA A100 80GB | 4 | 320 GB -Standard_ND96asr_v4 | NVIDIA A100 40GB | 8 | 320 GB -Standard_ND96amsr_A100_v4 | NVIDIA A100 80GB | 8 | 640 GB -Standard_ND96isr_H100_v5 | NVIDIA H100 80GB | 8 | 640 GB -Standard_ND96is_H100_v5 | NVIDIA H100 80GB | 8 | 640 GB - -More information about those GPU Types / Families can be found in the [Microsoft Azure Documentation - Sizes for virtual machines in Azure - GPU accelerated](https://learn.microsoft.com/en-us/azure/virtual-machines/sizes/overview?tabs=breakdownseries%2Cgeneralsizelist%2Ccomputesizelist%2Cmemorysizelist%2Cstoragesizelist%2Cgpusizelist%2Cfpgasizelist%2Chpcsizelist#gpu-accelerated). - -## Intel CPUs - -Instance | CPU Model (Family) | vCPUs | RAM (GiB) ------------------|--------------------------------|-------|----------- -Standard_F2s_v2 | Intel Xeon Platinum 8272CL | 2 | 4 -Standard_DS2_v2 | Intel Xeon E5-2673 v4 / 8272CL | 2 | 7 -Standard_F4s_v2 | Intel Xeon Platinum 8272CL | 4 | 8 -Standard_DS3_v2 | Intel Xeon E5-2673 v4 / 8272CL | 4 | 14 -Standard_E2s_v3 | Intel Xeon Platinum 8272CL | 2 | 16 -Standard_F8s_v2 | Intel Xeon Platinum 8272CL | 8 | 16 -Standard_DS4_v2 | Intel Xeon Platinum 8272CL | 8 | 28 -Standard_E4s_v3 | Intel Xeon 8171M | 4 | 32 -Standard_F16s_v2 | Intel Xeon Platinum 8272CL | 16 | 32 -Standard_DS5_v2 | Intel Xeon Platinum 8272CL | 16 | 56 -Standard_F32s_v2 | Intel Xeon Platinum 8272CL | 32 | 64 -Standard_F48s_v2 | Intel Xeon Platinum 8272CL | 48 | 96 -Standard_E16s_v3 | Intel Xeon Platinum 8272CL | 16 | 128 -Standard_F64s_v2 | Intel Xeon Platinum 8272CL | 64 | 128 -Standard_F72s_v2 | Intel Xeon Platinum 8272CL | 72 | 144 - -More information about those CPU Models / Families can be found in the [Microsoft Azure Documentation - Sizes for virtual machines in Azure](https://learn.microsoft.com/en-us/azure/virtual-machines/sizes/overview) under the bookmarks [General Purpose](https://learn.microsoft.com/en-us/azure/virtual-machines/sizes/overview?tabs=breakdownseries%2Cgeneralsizelist%2Ccomputesizelist%2Cmemorysizelist%2Cstoragesizelist%2Cgpusizelist%2Cfpgasizelist%2Chpcsizelist#general-purpose) and [Compute Optimized](https://learn.microsoft.com/en-us/azure/virtual-machines/sizes/overview?tabs=breakdownseries%2Cgeneralsizelist%2Ccomputesizelist%2Cmemorysizelist%2Cstoragesizelist%2Cgpusizelist%2Cfpgasizelist%2Chpcsizelist#compute-optimized). diff --git a/docs/source/foundry/introduction.mdx b/docs/source/foundry/introduction.mdx deleted file mode 100644 index d1cc049..0000000 --- a/docs/source/foundry/introduction.mdx +++ /dev/null @@ -1,20 +0,0 @@ -# Hugging Face on Microsoft Foundry - -Hugging Face has partnered with Microsoft to bring open-source models from the [Hugging Face Hub](https://huggingface.co) into [Microsoft Foundry](https://ai.azure.com/) and [Azure Machine Learning](https://ml.azure.com/). The Hugging Face Hub is the home of over 1,700,000 public access open-source models, as well as datasets, spaces and much more. The integration with Microsoft Foundry and Azure Machine Learning enables you to deploy open-source models of your choice to secure and scalable inference infrastructure on Azure powered by Hugging Face and other open-source inference solutions such as Text Generation Inference (TGI), vLLM or SGLang for LLMs and VLMs, or Text Embeddings Inference (TEI) for embeddings, and many more. Now, the Microsoft Foundry and Azure Machine Learning model catalogs are the home for over 11,000 of the most popular and downloaded open-source models on the Hugging Face Hub, ensuring secure and verified weights, that can be deployed to managed online endpoints with ease. Once deployed, the managed online endpoint gives you secure REST API to score your model in real time. - -The Microsoft Foundry and Azure Machine Learning model catalogs contain over 11,000 Hugging Face deployable models, ranging a wide-variety of models for different tasks such as image generation, Large Language Models (LLMs), Visual Language Models (VLMs), or embeddings, among many others; all of those powered by open-source inference solutions. Additionally, each of those models can be deployed in a wide variety of hardware available on Microsoft Azure, ranging NVIDIA GPUs to CPUs, so that each model comes with a default suggested hardware. - -At Microsoft Build 2025, an expansion of the partnership between Hugging Face and Microsoft Azure was announced. Among the main takeaways, the expanded collaboration will not only cover [Azure Machine Learning](https://azure.microsoft.com/en-us/products/machine-learning), but also [Azure AI Foundry Hub](https://azure.microsoft.com/en-us/products/ai-foundry) allowing Microsoft Azure users to design, customize, and manage AI apps and agents at scale with open-source models from Hugging Face. - -![Satya Nadella announcing the Hugging Face expanded collaboration on Microsoft Build 2025](https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/microsoft-azure/microsoft-build-2025.png) - -Later that year, at Microsoft Ignite 2025, Azure AI Foundry was renamed to Microsoft Foundry, along with the announcement of a new experience, for a unified Azure platform-as-a-service offering for enterprise AI operations, model builders, and application development. - -Read more about Azure AI Foundry evolving into Microsoft Foundry and other announcements at Microsoft Ignite 2025 in the [Microsoft Ignite Book of news](https://news.microsoft.com/ignite-2025-book-of-news/). - -## Resources - -- [Azure Machine Learning - Deploy models from Hugging Face Hub to Azure Machine Learning online endpoints for real-time inference](https://learn.microsoft.com/en-us/azure/machine-learning/how-to-deploy-models-from-huggingface) -- [Azure Machine Learning - How to use Open Source foundation models curated by Azure Machine Learning](https://learn.microsoft.com/en-us/azure/machine-learning/how-to-use-foundation-models) -- [Microsoft and Hugging Face expand collaboration](https://huggingface.co/blog/azure-ai-foundry) -- [Microsoft and Hugging Face expand collaboration to accelerate Open-Source AI Innovation on Microsoft Foundry](https://devblogs.microsoft.com/foundry/microsoft-and-hugging-face-expand-partnership-to-accelerate-open-source-ai-innovation-on-azure-ai-foundry/) diff --git a/docs/source/foundry/models.mdx b/docs/source/foundry/models.mdx deleted file mode 100644 index fef3b22..0000000 --- a/docs/source/foundry/models.mdx +++ /dev/null @@ -1,29 +0,0 @@ -# Supported Models - -Around +11,000 open models from the Hugging Face Hub are available through Microsoft Foundry and Azure Machine Learning. This curated subset of the +2,200,000 public open-models on the Hub includes the most downloaded and relevant models, all compatible with Transformers, Sentence Transformers, Diffusers, and other Hugging Face libraries and solutions. - - - -Even if you don't have a Microsoft Azure account, you can still explore the [public Hugging Face Collection on Microsoft Foundry](https://ai.azure.com/catalog/publishers/hugging%20face,huggingface). - - - -This being said, the supported models range different architectures and backends, but a way to identify whether a model from the Hugging Face Hub is made available within the model catalog in Microsoft Foundry and Azure Machine Learning is to either: - -1. Navigate to the model card of the given model under https://huggingface.co/models, and check whether the "Deploy" button is available with the "Deploy on Microsoft Foundry" option listed there. If available, the URL pointing to the model on Microsoft Foundry will be provided via the "Go to model on Microsoft Foundry" button. Otherwise, you can request the model's addition by clicking "Request to add" (See [Request a model addition in the Hugging Face collection on Microsoft Foundry](../guides/request-model-addition) for details). - -2. On the other hand, you can also navigate to either the Microsoft Foundry (from a Hub-based project) or the Azure Machine Learning model catalogs under the Hugging Face collection, and search the given model. If the model appears, it means it's supported and you can grab the URI pointing to it to programmatically deploy it. Otherwise, you can either [open an issue](https://github.com/huggingface/Microsoft-Azure/issues/new) requesting the model addition, or request it via the Hugging Face Hub model card with the "Request to add" button as mentioned before. - -3. Alternatively, you can also check if the given model is available on Microsoft Foundry programmatically with the following Python snippet, that sends a request to an Azure API that given a model ID from the Hugging Face Hub returns either HTTP 200 with the model URL if it's available, or just HTTP 404 if not available. - -```python -import requests - -model_id = "HuggingFaceTB/SmolLM3-3B" -response = requests.get("https://get-azure-ai-url.azurewebsites.net/api/get-azure-ai-url", params={"model_id": model_id}) -if response.status_code == 200: - print(response.json()) - # {"url": "https://ai.azure.com/explore/models/HuggingFaceTB-SmolLM3-3B/version/6/registry/HuggingFace"} -``` - -We are really excited for this partnership between Hugging Face and Microsoft Azure, and working really hard to bring Azure customers the best open models from the Hugging Face collection into Microsoft Foundry and Azure Machine Learning, so stay tuned for updates and a lot more models to come in the following months! diff --git a/docs/source/foundry/tasks.mdx b/docs/source/foundry/tasks.mdx deleted file mode 100644 index 54644b1..0000000 --- a/docs/source/foundry/tasks.mdx +++ /dev/null @@ -1,41 +0,0 @@ -# Supported Tasks - -The following Hugging Face tasks are natively supported on Azure Machine Learning and, so on, on Microsoft Foundry: - -- `embeddings` (also known as `feature-extraction`) -- `sentence-similarity` -- `text-ranking` (also formerly known as `sentence-ranking`) -- `automatic-speech-recognition` -- `text-to-speech` (also formerly known as `text-to-audio`) -- `speech-to-text` -- `translation` -- `text-translation` -- `question-answering` -- `text-classification` -- `fill-mask` -- `token-classification` -- `summarization` (also known as `text-summarization`) -- `text-generation` (also know as either `completions`, `chat-completion`, `text2text-generation` or `conversational`) -- `image-text-to-text` (also know as `chat-completion` with vision-capabilities) -- `image-classification` -- `image-segmentation` -- `object-detection` -- `text-to-image` -- `zero-shot-image-classification` -- `table-question-answering` -- `zero-shot-classification` -- `visual-question-answering` -- `mask-generation` - -With upcoming support for some of the following tasks: - -- `image-to-image` -- `text-to-image` with LoRA -- `image-feature-extraction` -- `image-to-text` (also known as `image-captioning`) -- `text-to-speech` -- `image-to-3d` -- `audio-to-audio` (also known as `speech-to-speech`) -- `text-to-video` - -More information about all the supported tasks at [Hugging Face Tasks](https://huggingface.co/tasks). diff --git a/docs/source/get-started/deploy-open-models-from-microsoft-foundry-with-python.mdx b/docs/source/get-started/deploy-open-models-from-microsoft-foundry-with-python.mdx new file mode 100644 index 0000000..2d6f9c8 --- /dev/null +++ b/docs/source/get-started/deploy-open-models-from-microsoft-foundry-with-python.mdx @@ -0,0 +1 @@ +# Deploy open-models from Microsoft Foundry with Python diff --git a/docs/source/get-started/deploy-open-models-from-microsoft-foundry.mdx b/docs/source/get-started/deploy-open-models-from-microsoft-foundry.mdx new file mode 100644 index 0000000..e379b3e --- /dev/null +++ b/docs/source/get-started/deploy-open-models-from-microsoft-foundry.mdx @@ -0,0 +1 @@ +# Deploy open-models from Microsoft Foundry diff --git a/docs/source/guides/access-gated-models.mdx b/docs/source/guides/access-gated-models.mdx deleted file mode 100644 index dddfbcf..0000000 --- a/docs/source/guides/access-gated-models.mdx +++ /dev/null @@ -1,136 +0,0 @@ -# Deploy Hugging Face gated models on Microsoft Foundry - -Some Hugging Face models on Microsoft Foundry are **gated**, meaning you must request access from the model publisher on the Hugging Face Hub before you can deploy them on Foundry. The access request is then tied to your Hugging Face identity and allows you to download the model weights from the Hub. - -This guide walks you through how to deploy a Hugging Face gated model on Microsoft Foundry. - -## 0. Pre-requisites - -To run the guide, you will need to comply with the following pre-requisites: - -- An Azure account with an active subscription. -- The Azure CLI installed and logged in. -- The Azure Machine Learning extension for the Azure CLI. -- An Azure Resource Group. -- A Hub-based project on Microsoft Foundry (classic, i.e., Azure AI Foundry Hub-based project). - -For more information, please go through the steps in [Configure Azure Machine Learning and Microsoft Foundry](https://huggingface.co/docs/microsoft-azure/guides/configure-azure-ml-microsoft-foundry). - -In this example, the [Azure Machine Learning SDK for Python](https://github.com/Azure/azure-sdk-for-python/tree/main/sdk/ml/azure-ai-ml) will be used to create the endpoint and the deployment. Along with it, you will also need to install `azure-identity` to authenticate with your Azure credentials via Python. - -```bash -pip install azure-ai-ml azure-identity --upgrade --quiet -``` - -Then, setting the following environment variables is recommended as those will be used along the example for the Azure ML Client, so make sure to update and set those values accordingly. - -```bash -env LOCATION eastus -env SUBSCRIPTION_ID -env RESOURCE_GROUP -env WORKSPACE_NAME -``` - -You also need to define both the endpoint and deployment names. Those will be used throughout the example. - -> Endpoint names must to be globally unique per region i.e., even if you don't have any endpoint named that way running under your subscription, if the name is reserved by another Azure customer, then you won't be able to use the same name. Adding a timestamp or a custom identifier is recommended to prevent running into HTTP 400 validation issues when trying to deploy an endpoint with an already locked / reserved name. Also the endpoint name must be between 3 and 32 characters long. - -```python -import os -from uuid import uuid4 - -os.environ["ENDPOINT_NAME"] = f"endpoint-{str(uuid4())[:8]}" -os.environ["DEPLOYMENT_NAME"] = f"deployment-{str(uuid4())[:8]}" -``` - -## 1. Identify a gated model in the catalog - -When you select a model from the Microsoft Foundry catalog under the Hugging Face collection, if the model is gated, you will see a banner at the top mentioning a **Gated Model Access** is required, as well as the `isGated` property set. - -## 2. Request access on Hugging Face - -In the model page for the gated model on Microsoft Foundry you will see a link to the model on the Hugging Face Hub. If you then go to the Hub, you can **Request access** / **Agree and access repository** action (wording varies by model). Finally, you need to wait for approval from the model authors or organization in charge. - -Note that some models approve instantly; others require review that can take up to a day. - -## 3. Create a Hugging Face Token - -You can manage your access tokens in your Hugging Face account settings. Create a fine-grained token with `Read access to contents of all public gated repositories you can access` selected [here](https://huggingface.co/settings/tokens/new?canReadGatedRepos=true&tokenType=fineGrained). - -> For organizations seeking stronger oversight on their user’s token, [Hugging Face Team and Enterprise Plans](https://huggingface.co/enterprise) offer enhanced token governance capabilities to companies. - -## 4. Create an Azure Machine Learning Connection with Custom keys - -Create a **Custom keys** workspace connection with your Hugging Face Token. This connection is how the deployment process authenticates to the Hugging Face Hub to validate access and download the gated model. - -```bash -az ml connection create \ - --name HuggingFaceTokenConnection \ - --type "Generic" \ - --resource-group $RESOURCE_GROUP \ - --workspace-name $WORKSPACE_NAME \ - --secret "HF_TOKEN=" -``` - -### 5. Create the Managed Online Endpoint with secret-store access enabled - -First you need to authenticate into the Microsoft Foundry via Azure Machine Learning with the Python SDK: - -```bash -import os -from azure.ai.ml import MLClient -from azure.identity import DefaultAzureCredential - -client = MLClient( - credential=DefaultAzureCredential(), - subscription_id=os.getenv("SUBSCRIPTION_ID"), - resource_group_name=os.getenv("RESOURCE_GROUP"), - workspace_name=os.getenv("WORKSPACE_NAME"), -) -``` - -Then, when creating the Managed Online Endpoint for the deployment, ensure the endpoint is configured to allow access to default secret stores. this is what allows the Managed Online Endpoint in Azure Machine Learning to read the Connection Secret. It can only be done programmatically for now. - -```python -from azure.ai.ml.entities import ManagedOnlineEndpoint - -endpoint = ManagedOnlineEndpoint( - name=os.getenv("ENDPOINT_NAME"), - properties={"enforce_access_to_default_secret_stores": "enabled"}, -) - -client.begin_create_or_update(endpoint).wait() -``` - -This allows the endpoint deployment to read the secret connection value (your token) at deployment time. - -### 6. Create the Managed Online Deployment - -After creating the endpoint, you need to create the [ManagedOnlineDeployment via the Azure ML Python SDK](https://learn.microsoft.com/en-us/python/api/azure-ai-ml/azure.ai.ml.entities.managedonlinedeployment?view=azure-python) i.e., create a deployment linked to the given endpoint. - -To create the Azure Machine Learning Managed Online Endpoint you don't need to provide the model ID on the Hugging Face Hub but rather the model URI on Azure Machine Learning formatted as follows: - -```python -model_id = "facebook/sam3" # example gated model - -model_uri = f"azureml://registries/HuggingFace/models/{model_id.replace('/', '-').replace('_', '-').lower()}/labels/latest" -model_uri -``` - -Make sure to select the instance type recommended for the model you want to deploy. You can find it in the model catalog deploy page. - -```python -from azure.ai.ml.entities import ManagedOnlineDeployment - -deployment = ManagedOnlineDeployment( - name=os.getenv("DEPLOYMENT_NAME"), - endpoint_name=os.getenv("ENDPOINT_NAME"), - model=model_uri, - instance_type="Standard_NC40ads_H100_v5", - instance_count=1, -) - -client.online_deployments.begin_create_or_update(deployment).wait() -``` - -That's it, you deployed your first Hugging Face gated model on Microsoft Foundry! \ No newline at end of file diff --git a/docs/source/guides/configure-azure-ml-microsoft-foundry.mdx b/docs/source/guides/configure-azure-ml-microsoft-foundry.mdx deleted file mode 100644 index 6ba9e34..0000000 --- a/docs/source/guides/configure-azure-ml-microsoft-foundry.mdx +++ /dev/null @@ -1,134 +0,0 @@ -# Configure Azure Machine Learning and Microsoft Foundry - - - -Throughout this guide you'll see references to both Azure AI Foundry and Microsoft Foundry simultaneously, but that's because Microsoft Foundry has superseded Azure AI Foundry, but still referencing to it for the "classic" experience, which is the one that supports Hub-based projects and then, models from the Hugging Face Hub. - - - -This guide explains how to configure Azure Machine Learning and Microsoft Foundry in your Microsoft Azure subscription. These pre-requisites are required to run the Microsoft Foundry examples in this documentation, as well as any example on Azure Machine Learning. - -You can either follow along the below steps, or either read more about those in the [Azure Machine Learning Tutorial: Create resources you need to get started](https://learn.microsoft.com/en-us/azure/machine-learning/quickstart-create-resources?view=azureml-api-2). - -Also note that the steps below will use the `az` CLI i.e., the Azure CLI, but there are other alternatives such as e.g. the Azure SDK for Python, or even the Azure Portal, so pick the one you feel more comfortable with. - -## Azure Account - -A Microsoft Azure account with an active subscription. If you don't have a Microsoft Azure account, you can now [create one for free](https://azure.microsoft.com/en-us/pricing/purchase-options/azure-account), including 200 USD worth of credits to use within the next 30 days after the account creation. - -## Azure CLI - -The Azure CLI (`az`) installed on the instance that you're running this example on, see [the installation steps](https://learn.microsoft.com/en-us/cli/azure/install-azure-cli?view=azure-cli-latest), and follow the steps of the preferred method based on your instance. Then log in into your subscription as follows: - -```bash -az login -``` - -More information at [Sign in with Azure CLI - Login and Authentication](https://learn.microsoft.com/en-us/cli/azure/authenticate-azure-cli?view=azure-cli-latest). - -## Azure CLI extension for Azure Machine Learning - -Besides the Azure CLI (`az`), you also need to install the Azure Machine Learning CLI extension (`az ml`) which will be used to create the Azure Machine Learning and Microsoft Foundry required resources. - -First you will need to list the current extensions and remove any `ml`-related extension before installing the latest one i.e., v2. - -```bash -az extension list -az extension remove --name azure-cli-ml -az extension remove --name ml -``` - -Then you can install the `az ml` v2 extension as follows: - -```bash -az extension add --name ml -``` - -More information at [Azure Machine Learning (ML) - Install and setup the CLI (v2)](https://learn.microsoft.com/en-us/azure/machine-learning/how-to-configure-cli?view=azureml-api-2&tabs=public). - -## Azure Resource Group - -An Azure Resource Group under the one you will create the Microsoft Foundry (classic) i.e., an Azure AI Foundry Hub-based project (note it will create an Azure AI Foundry resource as an Azure Machine Learning Workspace, but not the other way around, meaning that the Azure AI Foundry Hub will be listed as an Azure Machine Learning workspace, but leveraging the Microsoft Foundry capabilities for Gen AI), and the rest of the required resources. If you don't have one, you can create it as follows: - -```bash -az group create --name huggingface-azure-rg --location eastus -``` - -Then, you can ensure that the resource group was created successfully by e.g. listing all the available resource groups that you have access to on your subscription: - -```bash -az group list --output table -``` - -More information at [Manage Azure resource groups by using Azure CLI](https://learn.microsoft.com/en-us/azure/azure-resource-manager/management/manage-resource-groups-cli). - - - -You can also create the Azure Resource Group [via the Azure Portal](https://learn.microsoft.com/en-us/azure/azure-resource-manager/management/manage-resource-groups-portal), or [via the Azure Resource Management Python SDK](https://learn.microsoft.com/en-us/azure/developer/python/sdk/examples/azure-sdk-example-resource-group?tabs=bash) (requires it to be installed as `pip install azure-mgmt-resource` in advance). - - - -## Azure AI Foundry Hub-based project - -An Azure AI Foundry Hub-based project (given that the new experience on Microsoft Foundry does not yet support Hugging Face models, but rather only the classic experience which is the same as saying Azure AI Foundry) under the aforementioned subscription and resource group. If you don't have one, you can create it as follows: - -```bash -az ml workspace create \ - --kind hub \ - --name huggingface-azure-hub \ - --resource-group huggingface-azure-rg \ - --location eastus -``` - - - -Note that the main difference with an standard Azure Machine Learning Workspace is that the Microsoft Foundry (classic) i.e., Azure AI Foundry Hub, requires you to specify the `--kind hub`, removing it would create a standard Azure Machine Learning Workspace instead, so you wouldn't benefit from the features that the Microsoft Foundry brings. But, when you create an Azure AI Foundry Hub, you can still benefit from all the features that Azure Machine Learning brings, since Microsoft Foundry will still rely on Azure Machine Learning, but not the other way around. - - - -Then, you can ensure that the workspace was created successfully by e.g. listing all the available workspaces that you have access to on your subscription: - -```bash -az ml workspace list --filtered-kinds hub --query "[].{Name:name, Kind:kind}" --resource-group huggingface-azure-rg --output table -``` - - - -The `--filtered-kinds` argument has been recently included as of [Azure Machine Learning CLI 2.37.0](https://learn.microsoft.com/en-us/azure/machine-learning/azure-machine-learning-release-notes-cli-v2?view=azureml-api-2#azure-machine-learning-cli-v2-v-2370), meaning that you may need to upgrade `az ml` as `az extension update --name ml`. - - - -Once the Azure AI Foundry Hub-based project is created, you need to create an Azure AI Foundry project linked to that Hub, to do so you first need to obtain the Azure AI Foundry Hub ID of the recently created Hub as follows (replace the resource names with yours): - -```bash -az ml workspace show \ - --name huggingface-azure-hub \ - --resource-group huggingface-azure-rg \ - --query "id" \ - -o tsv -``` - -That command will provide the ID as follows `/subscriptions//resourceGroups//providers/Microsoft.MachineLearningServices/workspaces/huggingface-azure-hub`, meaning that you can also format it manually yourself with the appropriate replacements. Then you need to run the following command to create the Microsoft Foundry Project for that Hub as: - -```bash -az ml workspace create \ - --kind project \ - --hub-id $(az ml workspace show --name huggingface-azure-hub --resource-group huggingface-azure-rg --query "id" -o tsv) \ - --name huggingface-azure-project \ - --resource-group huggingface-azure-rg \ - --location eastus -``` - -Finally, you can verify that it was correctly created with the following command: - -```bash -az ml workspace list --filtered-kinds project --query "[].{Name:name, Kind:kind}" --resource-group huggingface-azure-rg --output table -``` - -More information at [How to create and manage an Azure AI Foundry Hub](https://learn.microsoft.com/en-us/azure/ai-foundry/how-to/create-azure-ai-resource?tabs=portal) and at [How to create a Hub using the Azure CLI](https://learn.microsoft.com/en-us/azure/ai-foundry/how-to/develop/create-hub-project-sdk?tabs=azurecli). - - - -You can also create the Azure AI Foundry Hub [via the Azure Portal](https://learn.microsoft.com/en-us/azure/ai-foundry/how-to/create-secure-ai-hub), or [via the Azure Machine Learning Python SDK](https://learn.microsoft.com/en-us/azure/ai-foundry/how-to/develop/create-hub-project-sdk?tabs=python), among other options listed in [Manage AI Hub Resources](https://learn.microsoft.com/en-us/azure/ai-foundry/concepts/ai-resources). - - diff --git a/docs/source/guides/introduction.mdx b/docs/source/guides/introduction.mdx deleted file mode 100644 index 901e92e..0000000 --- a/docs/source/guides/introduction.mdx +++ /dev/null @@ -1,11 +0,0 @@ -# Guides - -Take a look at our guides on how to get started with Hugging Face models on Microsoft Foundry. - -- [Deploy Hugging Face Models in Foundry with Managed Compute](./managed-compute-foundry) -- [One-click deployments from the Hugging Face Hub on Microsoft Foundry](./one-click-deployment-foundry) -- [Deploy Hugging Face gated models on Microsoft Foundry](./access-gated-models) -- [Request a model addition in the Hugging Face collection on Microsoft Foundry](./request-model-addition) -- [Configure Azure Machine Learning and Microsoft Foundry](./configure-azure-ml-microsoft-foundry) - -For more detailed examples please check the "Examples" section under each service. diff --git a/docs/source/guides/managed-compute-foundry.mdx b/docs/source/guides/managed-compute-foundry.mdx deleted file mode 100644 index 6088541..0000000 --- a/docs/source/guides/managed-compute-foundry.mdx +++ /dev/null @@ -1,175 +0,0 @@ -# Deploy Hugging Face Models in Foundry with Managed Compute - - - -Managed compute in Microsoft Foundry is currently in **Public Preview**, expect no SLA for the time being. - - - -Managed compute is a deployment type in Microsoft Foundry that hosts open-source models from the Hugging Face collection on dedicated GPU capacity, without requiring you to provision virtual machines, operate a Kubernetes cluster, or build and patch your own container images. Microsoft owns the GPU topology, the serving runtime (vLLM, SGLang, TEI, and more depending on the model), the container image, and security patching. You choose the model, a deployment template, the accelerator family (NVIDIA A100, NVIDIA H100, or AMD MI300X), and how many instances to run. - -Managed compute deployments live behind the same unified Foundry Routing Endpoint, authentication (Microsoft Entra ID or API key), SDKs, and observability surface as any other Foundry deployment, so switching from a pay-per-token model to an open-source one is just a change of the `model` field in your requests. - -This guide walks you through discovering a Hugging Face model in the Foundry catalog, deploying it with managed compute, and sending inference requests. - -To see managed compute in action, watch the deep-dive session from Microsoft Build 2026, [Hugging Face open-source models to production on Microsoft Foundry](https://build.microsoft.com/en-US/sessions/DEM320): - -