From b2a5241ba226fdb4df38d4441b0c0333e5445aeb Mon Sep 17 00:00:00 2001 From: devlooped-bot Date: Wed, 24 Sep 2025 18:48:22 +0000 Subject: [PATCH] =?UTF-8?q?+M=E1=90=81=20includes?= MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit --- readme.md | 27 +++++++++++++++------------ 1 file changed, 15 insertions(+), 12 deletions(-) diff --git a/readme.md b/readme.md index 77e9605..2aee3cf 100644 --- a/readme.md +++ b/readme.md @@ -28,22 +28,25 @@ Results: ``` -BenchmarkDotNet v0.14.0, Windows 11 (10.0.22631.4890/23H2/2023Update/SunValley3) +BenchmarkDotNet v0.14.0, Windows 11 (10.0.26100.3775) Intel Core i9-10900T CPU 1.90GHz, 1 CPU, 20 logical and 10 physical cores -.NET SDK 9.0.200 - [Host] : .NET 8.0.13 (8.0.1325.6609), X64 RyuJIT AVX2 - DefaultJob : .NET 8.0.13 (8.0.1325.6609), X64 RyuJIT AVX2 +.NET SDK 9.0.201 + [Host] : .NET 8.0.15 (8.0.1525.16413), X64 RyuJIT AVX2 + DefaultJob : .NET 8.0.15 (8.0.1525.16413), X64 RyuJIT AVX2 ``` -| Method | Client | Provider | Model | Mean | Error | StdDev | Median | -|------- |---------------- |--------- |------------ |---------:|---------:|----------:|---------:| -| **Chat** | **aai-gpt-4o** | **Azure AI** | **gpt-4o** | **20.170 s** | **6.4958 s** | **19.1529 s** | **13.888 s** | -| **Chat** | **aai-gpt-4o-mini** | **Azure AI** | **gpt-4o-mini** | **20.221 s** | **5.3235 s** | **15.6966 s** | **18.061 s** | -| **Chat** | **oai-gpt-4o** | **OpenAI** | **gpt-4o** | **2.387 s** | **0.1910 s** | **0.5540 s** | **2.269 s** | -| **Chat** | **oai-gpt-4o-mini** | **OpenAI** | **gpt-4o-mini** | **2.620 s** | **0.1723 s** | **0.4859 s** | **2.573 s** | -| **Chat** | **xai-grok-2** | **xAI** | **grok-2** | **1.876 s** | **0.1525 s** | **0.4447 s** | **1.770 s** | -| **Chat** | **xai-grok-beta** | **xAI** | **grok-beta** | **1.661 s** | **0.1001 s** | **0.2919 s** | **1.655 s** | +| Method | Client | Provider | Model | Mean | Error | StdDev | Median | +|------- |--------------------- |--------- |----------------- |---------:|---------:|----------:|--------:| +| **Chat** | **aai-gpt-4o** | **Azure AI** | **gpt-4o** | **20.181 s** | **7.8701 s** | **23.2052 s** | **5.630 s** | +| **Chat** | **aai-gpt-4o-mini** | **Azure AI** | **gpt-4o-mini** | **20.171 s** | **6.6035 s** | **19.4707 s** | **9.726 s** | +| **Chat** | **oai-gpt-4o** | **OpenAI** | **gpt-4o** | **2.013 s** | **0.1394 s** | **0.4000 s** | **1.937 s** | +| **Chat** | **oai-gpt-4o-mini** | **OpenAI** | **gpt-4o-mini** | **2.930 s** | **0.1641 s** | **0.4736 s** | **2.916 s** | +| **Chat** | **xai-grok-3-beta** | **xAI** | **grok-3-beta** | **NA** | **NA** | **NA** | **NA** | +| **Chat** | **xai-grok-3-mini-beta** | **xAI** | **grok-3-mini-beta** | **5.666 s** | **0.2034 s** | **0.5964 s** | **5.699 s** | + +Benchmarks with issues: + ModelPerformance.Chat: DefaultJob [Client=xai-grok-3-beta]