Skip to content

Add apm-sdks-benchmarks to CI#10775

Merged
gh-worker-dd-mergequeue-cf854d[bot] merged 1 commit intomasterfrom
sarahchen6/add-benchmarks
Apr 22, 2026
Merged

Add apm-sdks-benchmarks to CI#10775
gh-worker-dd-mergequeue-cf854d[bot] merged 1 commit intomasterfrom
sarahchen6/add-benchmarks

Conversation

@sarahchen6
Copy link
Copy Markdown
Contributor

@sarahchen6 sarahchen6 commented Mar 9, 2026

What Does This Do

Add apm-sdks-benchmarks to CI

Motivation

This is a precursor to #10550 that will format these benchmarks and replace the dd-trace-java local ones

Additional Notes

Contributor Checklist

Jira ticket: https://datadoghq.atlassian.net/browse/APMLP-714

Note: Once your PR is ready to merge, add it to the merge queue by commenting /merge. /merge -c cancels the queue request. /merge -f --reason "reason" skips all merge queue checks; please use this judiciously, as some checks do not run at the PR-level. For more information, see this doc.

@pr-commenter
Copy link
Copy Markdown

pr-commenter Bot commented Mar 9, 2026 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sarahchen6/add-benchmarks
git_commit_date 1776859790 1776864359
git_commit_sha aeb83d6 9e26d3f
release_version 1.62.0-SNAPSHOT~aeb83d6118 1.62.0-SNAPSHOT~9e26d3fff8
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1776866137 1776866137
ci_job_id 1619587530 1619587530
ci_pipeline_id 109038314 109038314
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-8wqbc6xx 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-8wqbc6xx 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 64 metrics, 7 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.62.0-SNAPSHOT~9e26d3fff8, baseline=1.62.0-SNAPSHOT~aeb83d6118

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.074 s) : 0, 1074467
Total [baseline] (8.837 s) : 0, 8837193
Agent [candidate] (1.063 s) : 0, 1062565
Total [candidate] (8.88 s) : 0, 8879645
section iast
Agent [baseline] (1.229 s) : 0, 1229498
Total [baseline] (9.563 s) : 0, 9563286
Agent [candidate] (1.24 s) : 0, 1240015
Total [candidate] (9.543 s) : 0, 9543166
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.074 s -
Agent iast 1.229 s 155.031 ms (14.4%)
Total tracing 8.837 s -
Total iast 9.563 s 726.093 ms (8.2%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.063 s -
Agent iast 1.24 s 177.45 ms (16.7%)
Total tracing 8.88 s -
Total iast 9.543 s 663.521 ms (7.5%) 
gantt
    title insecure-bank - break down per module: candidate=1.62.0-SNAPSHOT~9e26d3fff8, baseline=1.62.0-SNAPSHOT~aeb83d6118

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.243 ms) : 0, 1243
crashtracking [candidate] (1.264 ms) : 0, 1264
BytebuddyAgent [baseline] (645.065 ms) : 0, 645065
BytebuddyAgent [candidate] (638.15 ms) : 0, 638150
AgentMeter [baseline] (30.013 ms) : 0, 30013
AgentMeter [candidate] (29.793 ms) : 0, 29793
GlobalTracer [baseline] (251.326 ms) : 0, 251326
GlobalTracer [candidate] (249.303 ms) : 0, 249303
AppSec [baseline] (32.846 ms) : 0, 32846
AppSec [candidate] (32.454 ms) : 0, 32454
Debugger [baseline] (59.835 ms) : 0, 59835
Debugger [candidate] (59.216 ms) : 0, 59216
Remote Config [baseline] (608.131 µs) : 0, 608
Remote Config [candidate] (588.763 µs) : 0, 589
Telemetry [baseline] (8.144 ms) : 0, 8144
Telemetry [candidate] (8.051 ms) : 0, 8051
Flare Poller [baseline] (8.901 ms) : 0, 8901
Flare Poller [candidate] (7.48 ms) : 0, 7480
section iast
crashtracking [baseline] (1.227 ms) : 0, 1227
crashtracking [candidate] (1.235 ms) : 0, 1235
BytebuddyAgent [baseline] (807.865 ms) : 0, 807865
BytebuddyAgent [candidate] (816.743 ms) : 0, 816743
AgentMeter [baseline] (11.39 ms) : 0, 11390
AgentMeter [candidate] (11.514 ms) : 0, 11514
GlobalTracer [baseline] (238.701 ms) : 0, 238701
GlobalTracer [candidate] (240.231 ms) : 0, 240231
AppSec [baseline] (26.433 ms) : 0, 26433
AppSec [candidate] (27.408 ms) : 0, 27408
Debugger [baseline] (64.621 ms) : 0, 64621
Debugger [candidate] (64.01 ms) : 0, 64010
Remote Config [baseline] (527.642 µs) : 0, 528
Remote Config [candidate] (522.112 µs) : 0, 522
Telemetry [baseline] (7.733 ms) : 0, 7733
Telemetry [candidate] (7.7 ms) : 0, 7700
Flare Poller [baseline] (3.37 ms) : 0, 3370
Flare Poller [candidate] (3.429 ms) : 0, 3429
IAST [baseline] (31.673 ms) : 0, 31673
IAST [candidate] (30.996 ms) : 0, 30996
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.62.0-SNAPSHOT~9e26d3fff8, baseline=1.62.0-SNAPSHOT~aeb83d6118

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.058 s) : 0, 1058043
Total [baseline] (11.1 s) : 0, 11100256
Agent [candidate] (1.061 s) : 0, 1061231
Total [candidate] (11.122 s) : 0, 11121740
section appsec
Agent [baseline] (1.259 s) : 0, 1259386
Total [baseline] (10.952 s) : 0, 10952452
Agent [candidate] (1.266 s) : 0, 1266414
Total [candidate] (11.05 s) : 0, 11049965
section iast
Agent [baseline] (1.232 s) : 0, 1231516
Total [baseline] (11.347 s) : 0, 11346653
Agent [candidate] (1.231 s) : 0, 1230709
Total [candidate] (11.361 s) : 0, 11361434
section profiling
Agent [baseline] (1.186 s) : 0, 1186481
Total [baseline] (11.162 s) : 0, 11162258
Agent [candidate] (1.188 s) : 0, 1188323
Total [candidate] (11.058 s) : 0, 11058329
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.058 s -
Agent appsec 1.259 s 201.343 ms (19.0%)
Agent iast 1.232 s 173.474 ms (16.4%)
Agent profiling 1.186 s 128.439 ms (12.1%)
Total tracing 11.1 s -
Total appsec 10.952 s -147.804 ms (-1.3%)
Total iast 11.347 s 246.397 ms (2.2%)
Total profiling 11.162 s 62.002 ms (0.6%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.061 s -
Agent appsec 1.266 s 205.183 ms (19.3%)
Agent iast 1.231 s 169.478 ms (16.0%)
Agent profiling 1.188 s 127.092 ms (12.0%)
Total tracing 11.122 s -
Total appsec 11.05 s -71.775 ms (-0.6%)
Total iast 11.361 s 239.694 ms (2.2%)
Total profiling 11.058 s -63.412 ms (-0.6%) 
gantt
    title petclinic - break down per module: candidate=1.62.0-SNAPSHOT~9e26d3fff8, baseline=1.62.0-SNAPSHOT~aeb83d6118

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.223 ms) : 0, 1223
crashtracking [candidate] (1.222 ms) : 0, 1222
BytebuddyAgent [baseline] (633.464 ms) : 0, 633464
BytebuddyAgent [candidate] (636.728 ms) : 0, 636728
AgentMeter [baseline] (29.637 ms) : 0, 29637
AgentMeter [candidate] (29.535 ms) : 0, 29535
GlobalTracer [baseline] (249.319 ms) : 0, 249319
GlobalTracer [candidate] (248.686 ms) : 0, 248686
AppSec [baseline] (32.285 ms) : 0, 32285
AppSec [candidate] (32.313 ms) : 0, 32313
Debugger [baseline] (59.903 ms) : 0, 59903
Debugger [candidate] (59.833 ms) : 0, 59833
Remote Config [baseline] (598.03 µs) : 0, 598
Remote Config [candidate] (598.635 µs) : 0, 599
Telemetry [baseline] (8.064 ms) : 0, 8064
Telemetry [candidate] (8.007 ms) : 0, 8007
Flare Poller [baseline] (7.427 ms) : 0, 7427
Flare Poller [candidate] (8.139 ms) : 0, 8139
section appsec
crashtracking [baseline] (1.216 ms) : 0, 1216
crashtracking [candidate] (1.228 ms) : 0, 1228
BytebuddyAgent [baseline] (673.313 ms) : 0, 673313
BytebuddyAgent [candidate] (677.517 ms) : 0, 677517
AgentMeter [baseline] (12.156 ms) : 0, 12156
AgentMeter [candidate] (12.191 ms) : 0, 12191
GlobalTracer [baseline] (248.625 ms) : 0, 248625
GlobalTracer [candidate] (249.44 ms) : 0, 249440
AppSec [baseline] (186.056 ms) : 0, 186056
AppSec [candidate] (185.761 ms) : 0, 185761
Debugger [baseline] (65.542 ms) : 0, 65542
Debugger [candidate] (67.35 ms) : 0, 67350
Remote Config [baseline] (581.311 µs) : 0, 581
Remote Config [candidate] (571.225 µs) : 0, 571
Telemetry [baseline] (7.877 ms) : 0, 7877
Telemetry [candidate] (8.017 ms) : 0, 8017
Flare Poller [baseline] (3.475 ms) : 0, 3475
Flare Poller [candidate] (3.534 ms) : 0, 3534
IAST [baseline] (24.234 ms) : 0, 24234
IAST [candidate] (24.437 ms) : 0, 24437
section iast
crashtracking [baseline] (1.221 ms) : 0, 1221
crashtracking [candidate] (1.216 ms) : 0, 1216
BytebuddyAgent [baseline] (809.597 ms) : 0, 809597
BytebuddyAgent [candidate] (808.82 ms) : 0, 808820
AgentMeter [baseline] (11.453 ms) : 0, 11453
AgentMeter [candidate] (11.438 ms) : 0, 11438
GlobalTracer [baseline] (239.163 ms) : 0, 239163
GlobalTracer [candidate] (239.161 ms) : 0, 239161
AppSec [baseline] (28.101 ms) : 0, 28101
AppSec [candidate] (26.512 ms) : 0, 26512
Debugger [baseline] (63.591 ms) : 0, 63591
Debugger [candidate] (63.708 ms) : 0, 63708
Remote Config [baseline] (530.337 µs) : 0, 530
Remote Config [candidate] (531.921 µs) : 0, 532
Telemetry [baseline] (7.775 ms) : 0, 7775
Telemetry [candidate] (7.724 ms) : 0, 7724
Flare Poller [baseline] (3.374 ms) : 0, 3374
Flare Poller [candidate] (3.338 ms) : 0, 3338
IAST [baseline] (30.716 ms) : 0, 30716
IAST [candidate] (31.429 ms) : 0, 31429
section profiling
crashtracking [baseline] (1.194 ms) : 0, 1194
crashtracking [candidate] (1.186 ms) : 0, 1186
BytebuddyAgent [baseline] (692.436 ms) : 0, 692436
BytebuddyAgent [candidate] (692.322 ms) : 0, 692322
AgentMeter [baseline] (8.971 ms) : 0, 8971
AgentMeter [candidate] (8.999 ms) : 0, 8999
GlobalTracer [baseline] (207.802 ms) : 0, 207802
GlobalTracer [candidate] (208.921 ms) : 0, 208921
AppSec [baseline] (32.629 ms) : 0, 32629
AppSec [candidate] (32.876 ms) : 0, 32876
Debugger [baseline] (66.111 ms) : 0, 66111
Debugger [candidate] (65.991 ms) : 0, 65991
Remote Config [baseline] (588.277 µs) : 0, 588
Remote Config [candidate] (572.193 µs) : 0, 572
Telemetry [baseline] (7.876 ms) : 0, 7876
Telemetry [candidate] (7.9 ms) : 0, 7900
Flare Poller [baseline] (3.504 ms) : 0, 3504
Flare Poller [candidate] (3.542 ms) : 0, 3542
ProfilingAgent [baseline] (94.072 ms) : 0, 94072
ProfilingAgent [candidate] (94.264 ms) : 0, 94264
Profiling [baseline] (94.637 ms) : 0, 94637
Profiling [candidate] (94.837 ms) : 0, 94837
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sarahchen6/add-benchmarks
git_commit_date 1776859790 1776864359
git_commit_sha aeb83d6 9e26d3f
release_version 1.62.0-SNAPSHOT~aeb83d6118 1.62.0-SNAPSHOT~9e26d3fff8
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1776866703 1776866703
ci_job_id 1619587532 1619587532
ci_pipeline_id 109038314 109038314
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-faroo3af 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-faroo3af 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 6 performance improvements and 1 performance regressions! Performance is the same for 14 metrics, 15 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:iast:high_load better
[-305.541µs; -188.686µs] or [-10.665%; -6.586%]		 better
[-1019.280µs; -495.808µs] or [-12.336%; -6.000%]		 unstable
[-46.128op/s; +251.253op/s] or [-3.658%; +19.923%]		 2.618ms 7.505ms 1363.688op/s 2.865ms 8.263ms 1261.125op/s
scenario:load:insecure-bank:profiling:high_load worse
[+68.302µs; +189.129µs] or [+3.731%; +10.330%]		 unstable
[+157.570µs; +937.069µs] or [+2.798%; +16.639%]		 unstable
[-400.077op/s; +46.827op/s] or [-20.646%; +2.417%]		 1.960ms 6.179ms 1761.188op/s 1.831ms 5.632ms 1937.812op/s
scenario:load:petclinic:no_agent:high_load better
[-3.085ms; -1.771ms] or [-16.186%; -9.293%]		 better
[-4.590ms; -1.812ms] or [-14.660%; -5.787%]		 unstable
[+3.197op/s; +58.365op/s] or [+1.329%; +24.256%]		 16.633ms 28.109ms 271.406op/s 19.061ms 31.310ms 240.625op/s
scenario:load:petclinic:code_origins:high_load better
[-1273.571µs; -539.844µs] or [-6.867%; -2.911%]		 unsure
[-2.002ms; -0.348ms] or [-6.654%; -1.157%]		 unstable
[-14.444op/s; +37.694op/s] or [-5.842%; +15.245%]		 17.641ms 28.918ms 258.875op/s 18.547ms 30.094ms 247.250op/s
scenario:load:petclinic:iast:high_load better
[-1396.842µs; -421.275µs] or [-7.498%; -2.261%]		 unsure
[-1.751ms; -0.294ms] or [-5.880%; -0.986%]		 unstable
[-14.964op/s; +37.214op/s] or [-6.072%; +15.101%]		 17.721ms 28.763ms 257.562op/s 18.630ms 29.786ms 246.438op/s
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.62.0-SNAPSHOT~9e26d3fff8, baseline=1.62.0-SNAPSHOT~aeb83d6118
    dateFormat X
    axisFormat %s
section baseline
no_agent (19.401 ms) : 19203, 19598
.   : milestone, 19401,
appsec (18.74 ms) : 18551, 18928
.   : milestone, 18740,
code_origins (18.877 ms) : 18690, 19065
.   : milestone, 18877,
iast (18.937 ms) : 18749, 19126
.   : milestone, 18937,
profiling (18.356 ms) : 18174, 18539
.   : milestone, 18356,
tracing (17.983 ms) : 17805, 18161
.   : milestone, 17983,
section candidate
no_agent (17.189 ms) : 17021, 17357
.   : milestone, 17189,
appsec (18.825 ms) : 18634, 19016
.   : milestone, 18825,
code_origins (18.027 ms) : 17850, 18204
.   : milestone, 18027,
iast (18.117 ms) : 17938, 18296
.   : milestone, 18117,
profiling (18.731 ms) : 18544, 18917
.   : milestone, 18731,
tracing (17.847 ms) : 17671, 18022
.   : milestone, 17847,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.401 ms [19.203 ms, 19.598 ms] -
appsec 18.74 ms [18.551 ms, 18.928 ms] -660.968 µs (-3.4%)
code_origins 18.877 ms [18.69 ms, 19.065 ms] -523.204 µs (-2.7%)
iast 18.937 ms [18.749 ms, 19.126 ms] -463.269 µs (-2.4%)
profiling 18.356 ms [18.174 ms, 18.539 ms] -1.044 ms (-5.4%)
tracing 17.983 ms [17.805 ms, 18.161 ms] -1.418 ms (-7.3%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 17.189 ms [17.021 ms, 17.357 ms] -
appsec 18.825 ms [18.634 ms, 19.016 ms] 1.636 ms (9.5%)
code_origins 18.027 ms [17.85 ms, 18.204 ms] 837.901 µs (4.9%)
iast 18.117 ms [17.938 ms, 18.296 ms] 928.032 µs (5.4%)
profiling 18.731 ms [18.544 ms, 18.917 ms] 1.542 ms (9.0%)
tracing 17.847 ms [17.671 ms, 18.022 ms] 657.757 µs (3.8%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.62.0-SNAPSHOT~9e26d3fff8, baseline=1.62.0-SNAPSHOT~aeb83d6118
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.255 ms) : 1243, 1267
.   : milestone, 1255,
iast (3.637 ms) : 3589, 3685
.   : milestone, 3637,
iast_FULL (6.31 ms) : 6245, 6375
.   : milestone, 6310,
iast_GLOBAL (3.649 ms) : 3594, 3703
.   : milestone, 3649,
profiling (2.339 ms) : 2318, 2361
.   : milestone, 2339,
tracing (1.891 ms) : 1873, 1909
.   : milestone, 1891,
section candidate
no_agent (1.244 ms) : 1231, 1257
.   : milestone, 1244,
iast (3.358 ms) : 3307, 3409
.   : milestone, 3358,
iast_FULL (6.119 ms) : 6056, 6183
.   : milestone, 6119,
iast_GLOBAL (3.723 ms) : 3661, 3785
.   : milestone, 3723,
profiling (2.583 ms) : 2555, 2610
.   : milestone, 2583,
tracing (1.883 ms) : 1868, 1898
.   : milestone, 1883,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.255 ms [1.243 ms, 1.267 ms] -
iast 3.637 ms [3.589 ms, 3.685 ms] 2.382 ms (189.7%)
iast_FULL 6.31 ms [6.245 ms, 6.375 ms] 5.055 ms (402.7%)
iast_GLOBAL 3.649 ms [3.594 ms, 3.703 ms] 2.393 ms (190.7%)
profiling 2.339 ms [2.318 ms, 2.361 ms] 1.084 ms (86.4%)
tracing 1.891 ms [1.873 ms, 1.909 ms] 636.127 µs (50.7%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.244 ms [1.231 ms, 1.257 ms] -
iast 3.358 ms [3.307 ms, 3.409 ms] 2.114 ms (169.9%)
iast_FULL 6.119 ms [6.056 ms, 6.183 ms] 4.875 ms (391.9%)
iast_GLOBAL 3.723 ms [3.661 ms, 3.785 ms] 2.479 ms (199.3%)
profiling 2.583 ms [2.555 ms, 2.61 ms] 1.339 ms (107.6%)
tracing 1.883 ms [1.868 ms, 1.898 ms] 639.135 µs (51.4%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sarahchen6/add-benchmarks
git_commit_date 1776859790 1776864359
git_commit_sha aeb83d6 9e26d3f
release_version 1.62.0-SNAPSHOT~aeb83d6118 1.62.0-SNAPSHOT~9e26d3fff8
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1776866390 1776866390
ci_job_id 1619587535 1619587535
ci_pipeline_id 109038314 109038314
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-oshjt00o 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-oshjt00o 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.62.0-SNAPSHOT~9e26d3fff8, baseline=1.62.0-SNAPSHOT~aeb83d6118
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.487 ms) : 1475, 1498
.   : milestone, 1487,
appsec (3.803 ms) : 3583, 4023
.   : milestone, 3803,
iast (2.295 ms) : 2225, 2366
.   : milestone, 2295,
iast_GLOBAL (2.333 ms) : 2262, 2403
.   : milestone, 2333,
profiling (2.117 ms) : 2062, 2172
.   : milestone, 2117,
tracing (2.098 ms) : 2045, 2152
.   : milestone, 2098,
section candidate
no_agent (1.502 ms) : 1490, 1514
.   : milestone, 1502,
appsec (3.846 ms) : 3623, 4069
.   : milestone, 3846,
iast (2.288 ms) : 2219, 2358
.   : milestone, 2288,
iast_GLOBAL (2.343 ms) : 2273, 2413
.   : milestone, 2343,
profiling (2.125 ms) : 2070, 2180
.   : milestone, 2125,
tracing (2.097 ms) : 2044, 2151
.   : milestone, 2097,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.487 ms [1.475 ms, 1.498 ms] -
appsec 3.803 ms [3.583 ms, 4.023 ms] 2.316 ms (155.8%)
iast 2.295 ms [2.225 ms, 2.366 ms] 808.8 µs (54.4%)
iast_GLOBAL 2.333 ms [2.262 ms, 2.403 ms] 846.072 µs (56.9%)
profiling 2.117 ms [2.062 ms, 2.172 ms] 630.375 µs (42.4%)
tracing 2.098 ms [2.045 ms, 2.152 ms] 611.812 µs (41.2%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.502 ms [1.49 ms, 1.514 ms] -
appsec 3.846 ms [3.623 ms, 4.069 ms] 2.344 ms (156.0%)
iast 2.288 ms [2.219 ms, 2.358 ms] 786.359 µs (52.4%)
iast_GLOBAL 2.343 ms [2.273 ms, 2.413 ms] 840.85 µs (56.0%)
profiling 2.125 ms [2.07 ms, 2.18 ms] 622.803 µs (41.5%)
tracing 2.097 ms [2.044 ms, 2.151 ms] 595.176 µs (39.6%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.62.0-SNAPSHOT~9e26d3fff8, baseline=1.62.0-SNAPSHOT~aeb83d6118
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.594 s) : 15594000, 15594000
.   : milestone, 15594000,
appsec (14.839 s) : 14839000, 14839000
.   : milestone, 14839000,
iast (18.662 s) : 18662000, 18662000
.   : milestone, 18662000,
iast_GLOBAL (17.87 s) : 17870000, 17870000
.   : milestone, 17870000,
profiling (15.483 s) : 15483000, 15483000
.   : milestone, 15483000,
tracing (15.0 s) : 15000000, 15000000
.   : milestone, 15000000,
section candidate
no_agent (15.015 s) : 15015000, 15015000
.   : milestone, 15015000,
appsec (14.718 s) : 14718000, 14718000
.   : milestone, 14718000,
iast (18.458 s) : 18458000, 18458000
.   : milestone, 18458000,
iast_GLOBAL (18.226 s) : 18226000, 18226000
.   : milestone, 18226000,
profiling (15.017 s) : 15017000, 15017000
.   : milestone, 15017000,
tracing (14.714 s) : 14714000, 14714000
.   : milestone, 14714000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.594 s [15.594 s, 15.594 s] -
appsec 14.839 s [14.839 s, 14.839 s] -755.0 ms (-4.8%)
iast 18.662 s [18.662 s, 18.662 s] 3.068 s (19.7%)
iast_GLOBAL 17.87 s [17.87 s, 17.87 s] 2.276 s (14.6%)
profiling 15.483 s [15.483 s, 15.483 s] -111.0 ms (-0.7%)
tracing 15.0 s [15.0 s, 15.0 s] -594.0 ms (-3.8%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.015 s [15.015 s, 15.015 s] -
appsec 14.718 s [14.718 s, 14.718 s] -297.0 ms (-2.0%)
iast 18.458 s [18.458 s, 18.458 s] 3.443 s (22.9%)
iast_GLOBAL 18.226 s [18.226 s, 18.226 s] 3.211 s (21.4%)
profiling 15.017 s [15.017 s, 15.017 s] 2.0 ms (0.0%)
tracing 14.714 s [14.714 s, 14.714 s] -301.0 ms (-2.0%)

@sarahchen6 sarahchen6 force-pushed the sarahchen6/add-benchmarks branch 2 times, most recently from c94c76c to 8c4fb1c Compare March 12, 2026 17:01
@sarahchen6 sarahchen6 mentioned this pull request Mar 12, 2026
Closed
@sarahchen6 sarahchen6 added tag: no release notes Changes to exclude from release notes type: refactoring comp: tooling Build & Tooling labels Mar 16, 2026
@sarahchen6 sarahchen6 force-pushed the sarahchen6/add-benchmarks branch from ce901a3 to 9e26d3f Compare April 22, 2026 13:26
@sarahchen6 sarahchen6 marked this pull request as ready for review April 22, 2026 17:28
@sarahchen6 sarahchen6 requested a review from a team as a code owner April 22, 2026 17:28
@sarahchen6 sarahchen6 requested review from faydef and pawelchcki and removed request for a team April 22, 2026 17:28
@sarahchen6
Copy link
Copy Markdown
Contributor Author

sarahchen6 commented Apr 22, 2026

/merge

@gh-worker-devflow-routing-ef8351
Copy link
Copy Markdown

gh-worker-devflow-routing-ef8351 Bot commented Apr 22, 2026 •
edited
Loading

View all feedbacks in Devflow UI.

2026-04-22 20:59:14 UTC ℹ️ Start processing command /merge

2026-04-22 20:59:18 UTC ℹ️ MergeQueue: pull request added to the queue

The expected merge time in master is approximately 2h (p90).

2026-04-22 22:12:38 UTC ℹ️ MergeQueue: This merge request was merged

@gh-worker-dd-mergequeue-cf854d gh-worker-dd-mergequeue-cf854d Bot merged commit ac97668 into master Apr 22, 2026
572 checks passed
@gh-worker-dd-mergequeue-cf854d gh-worker-dd-mergequeue-cf854d Bot deleted the sarahchen6/add-benchmarks branch April 22, 2026 22:12
@github-actions github-actions Bot added this to the 1.62.0 milestone Apr 22, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@faydef faydef faydef approved these changes

@pawelchcki pawelchcki Awaiting requested review from pawelchcki pawelchcki is a code owner automatically assigned from DataDog/apm-release-platform

Assignees

No one assigned

Labels

comp: tooling Build & Tooling tag: no release notes Changes to exclude from release notes type: refactoring

Projects

None yet

Milestone

1.62.0

Development

Successfully merging this pull request may close these issues.

2 participants

@sarahchen6 @faydef