Skip to content

Commit 9b35598

Browse files
RodgerZhuedmundsongHsy-Intelzzzqc1234
authored
Confidential ai (#309)
* Create README.md Create confidential_ai and readme structure * Update README.md * Update system architecture and demo workflow into readme Update system architecture and demo workflow into readme * Update README.md Fix typo and image link issues * Update README.md Update one line miss for CR * Update arch flow and design document 1. Add measurement into design architecture flow. 2. Add security design overview into README.md * Create #README.md# * Remove intermediate files and update deployment diagram Remove intermediate files and update deployment diagram * Add attestation service for confidential AI solution Signed-off-by: Yunge Zhu <[email protected]> * Add quote generation componment (#291) * Update Readme (#294) * update readme * update picure name * update issue link * update link * update links * update * update pictures * Add Chinese version * Update README_CN.md * Update readme_cn (#295) * update readme * update picure name * update issue link * update link * update links * update * update pictures * update readme_cn * update * update (#297) * update readme * update picure name * update issue link * update link * update links * update * update pictures * update readme_cn * update * update * update --------- Co-authored-by: Zhu Yunge <[email protected]> * rename to tdx_measurement_plugin (#298) * Update readme (#299) * update readme * update picure name * update issue link * update link * update links * update * update pictures * update readme_cn * update * update * update * fix format * update open-webui work flow * update flow --------- Co-authored-by: Zhu Yunge <[email protected]> * Create v0.5.20-feature-cc-tdx-v1.0.patch # Feature patch (cc-tdx v1.0) based on tag 0.5.20: Introducing support for confidential computing VMs on TDX * Update Confidential AI Flow.png * update patchfile (#301) * update readme * update picure name * update issue link * update link * update links * update * update pictures * update readme_cn * update * update * update * fix format * update open-webui work flow * update flow * update * Add patch readme * fix quotedata undefine error --------- Co-authored-by: Zhu Yunge <[email protected]> * Revert "update patchfile (#301)" (#303) This reverts commit ef5634f. * Update readme and patch (#306) Signed-off-by: Yunge Zhu <[email protected]> * Update README.md * Update README.md Refine article contents (English version) * Update README_CN.md * Update patch & quote funation (#307) * Update README_CN.md * Add files via upload * Update README_CN.md * Update README.md * Update README.md * Update README_CN.md * Update README.md * Update README.md * Update README_CN.md * Update README.md * Update README_CN.md --------- Signed-off-by: Yunge Zhu <[email protected]> Co-authored-by: Song, Edmund <[email protected]> Co-authored-by: Hsy-Intel <[email protected]> Co-authored-by: zzzqc1234 <[email protected]>
1 parent 60e3a79 commit 9b35598

File tree

2 files changed

+18
-13
lines changed

2 files changed

+18
-13
lines changed

‎cczoo/confidential_ai/README.md‎

Lines changed: 11 additions & 9 deletions
Original file line numberDiff line numberDiff line change
@@ -151,13 +151,13 @@ sudo npm install 20.18.1
151151
```
152152
Install Miniconda(Used to start the open-webui virtual environment)：
153153
```bash
154-
sudo wget https://repo.anaconda.com/miniconda/Miniconda3-latest-Linux-x86_64.sh
155-
sudo bash Miniconda3-latest-Linux-x86_64.sh -bu
154+
sudo wget https://github.com/conda-forge/miniforge/releases/download/24.11.3-2/Miniforge3-24.11.3-2-Linux-x86_64.sh
155+
sudo bash Miniforge3-24.11.3-2-Linux-x86_64.sh -bu
156156
```
157157
2. Configuring environment variables
158158
```bash
159-
# Set Miniconda path,Defaulte path is: /root/miniconda3/bin
160-
export PATH="/root/miniconda3/bin:$PATH"
159+
# Set miniforge3 path
160+
export PATH="/root/miniforge3/bin:$PATH"
161161

162162
# initial Conda
163163
conda init
@@ -181,7 +181,7 @@ cd <work_dir>
181181
git clone https://github.com/open-webui/open-webui.git
182182

183183
# checkout to tag:v0.5.20
184-
cd open-webui-main/
184+
cd open-webui/
185185
git checkout v0.5.20
186186

187187
# merger to CCZoo's patch，the patch enhance the functions of open-webui for TDX remote authentication
@@ -204,7 +204,7 @@ python3 -c "import quote_generator"
204204
5）Compile open-webui
205205
```bash
206206
# Install Dependencies
207-
cd <work_dir>/open-webui-main/open-webui/
207+
cd <work_dir>/open-webui/
208208
sudo npm install
209209
210210
#Compile
@@ -226,24 +226,26 @@ uvicorn open_webui.main:app --port $PORT --host 0.0.0.0 --forwarded-allow-ips '*
226226
Install Python Dependencies
227227
```bash
228228
pip install -r requirements.txt -U
229-
conda deactiva
229+
conda deactivate
230230
```
231231
232232
## 4. Run and Test
233233
1. Run ollama + DeepSeek model
234234
```bash
235+
# Run ollama with deepseek-r1:70b
235236
ollama run deepseek-r1:70b
237+
# Exit the service
236238
/bye
237239
```
238-
2. Alibaba Cloud Remote Attestation Service(URL:https://attest.cn-beijing.aliyuncs.com/v1/attestation) has been configured in <work_dir>/open-webui-main/open-webui/external/acs-attest-client/index.js
240+
2. Alibaba Cloud Remote Attestation Service(URL:https://attest.cn-beijing.aliyuncs.com/v1/attestation) has been configured in <work_dir>/open-webui/external/acs-attest-client/index.js
239241
3. run openwebui
240242
1) activate open-webui environment
241243
```bash
242244
conda activate open-webui
243245
```
244246
2) Enable backend services：
245247
```bash
246-
cd <work_dir>/open-webui-main/open-webui/backend/ && ./dev.sh
248+
cd <work_dir>/open-webui/backend/ && ./dev.sh
247249
```
248250
![backend service](./images/openwebui-backend.png)
249251
3) Open browser and enter the IP address of the current heterogeneous confidential computing instance，https://{ip_address}:{port}/(Note that the IP address is replaced with the IP address of the instance where open-webui is located, and the port number is the default port 18080).

‎cczoo/confidential_ai/README_CN.md‎

Lines changed: 7 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -124,7 +124,10 @@ curl -fsSL https://ollama.com/install.sh | sh
124124
125125
#### 步骤2：下载并运行deepseek模型
126126
```bash
127+
# 运行ollama + deepseek-r1:70b
127128
ollama run deepseek-r1:70b
129+
# 退出ollama
130+
/bye
128131
```
129132
130133
#### 步骤3：编译安装 open-webui
@@ -193,7 +196,7 @@ python3 -c "import quote_generator"
193196
5）编译open-webui
194197
```bash
195198
# 安装依赖
196-
cd <work_dir>/open-webui-main/open-webui/
199+
cd <work_dir>/open-webui/
197200
sudo npm install
198201

199202
#编译
@@ -215,7 +218,7 @@ uvicorn open_webui.main:app --port $PORT --host 0.0.0.0 --forwarded-allow-ips '*
215218
安装Python依赖库
216219
```bash
217220
pip install -r requirements.txt -U
218-
conda deactiva
221+
conda deactivate
219222
```
220223
221224
#### 步骤4：运行 openwebui
@@ -224,15 +227,15 @@ conda deactiva
224227
ollama run deepseek-r1:70b
225228
/bye
226229
```
227-
2. 阿里云远程证明服务Attestation Service(URL:https://attest.cn-beijing.aliyuncs.com/v1/attestation)已配置在<work_dir>/open-webui-main/open-webui/external/acs-attest-client/index.js
230+
2. 阿里云远程证明服务Attestation Service(URL:https://attest.cn-beijing.aliyuncs.com/v1/attestation)已配置在<work_dir>/open-webui/external/acs-attest-client/index.js
228231
3. 运行 openwebui
229232
1) 激活open-webui环境
230233
```bash
231234
conda activate open-webui
232235
```
233236
2) 开启后端服务：
234237
```bash
235-
cd <work_dir>/open-webui-main/open-webui/backend/ && ./dev.sh
238+
cd <work_dir>/open-webui/backend/ && ./dev.sh
236239
```
237240
![backend service](./images/openwebui-backend.png)
238241
3) 打开本地浏览器输入当前异构机密计算实例的IP地址，https://{ip_address}:{port}/(注意替换ip地址为open-webui所在实例IP地址，端口号为18080默认端口)。

0 commit comments

Comments
 (0)