Instrument QueryExecution.assertAnalyzed() to catch DataFrame analysis failures by aboitreaud · Pull Request #11033 · DataDog/dd-trace-java

aboitreaud · 2026-04-01T21:05:38Z

What Does This Do

Adds instrumentation on QueryExecution.assertAnalyzed() to catch Catalyst analysis failures from any entry point — SparkSession.sql(), Dataset.select(), Dataset.filter(), etc. Previously, only SparkSession.sql() failures were caught (PR #10981), but customer failures through DataFrame API operations (df.select()) were invisible to the tracer.

Also reverts the lastSqlFailed reset removal from the original branch — a successful Spark job now resets both lastJobFailed and lastSqlFailed, matching existing behavior and avoiding false positives for apps that catch and recover from SQL errors.

Debug logging is intentionally included — this build is for customer validation, not merge.

Motivation

Customer BRE stderr logs showed spark.application span marked SUCCESS when the EMR step failed. The AnalysisException (UNRESOLVED_COLUMN) was thrown from Dataset.select() → QueryExecution.assertAnalyzed(), a path not covered by the existing SparkSqlFailureAdvice on SparkSession.sql().

Additional Notes

QueryExecution.assertAnalyzed() is stable (public void assertAnalyzed()) across Spark 3.5.x, 4.0.x, 4.1.x
Existing SparkSqlFailureAdvice on SparkSession.sql() is kept (redundant but harmless, cleanup later)
New integration test exercises the DataFrame API path specifically (sparkSession.range(1).toDF("id").select("nonexistent_column"))

Jira ticket: [PROJ-IDENT]

…s failures

pr-commenter · 2026-04-21T17:43:02Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	adrien.boitreaud/no-sql-failed-reset
git_commit_date	1776788798	1776790628
git_commit_sha	`6880c80`	`68ebce2`
release_version	1.62.0-SNAPSHOT~6880c80c48	1.62.0-SNAPSHOT~68ebce2b54

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1776792374	1776792374
ci_job_id	1616495858	1616495858
ci_pipeline_id	108848211	108848211
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-1flt6lh0 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-1flt6lh0 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 61 metrics, 10 unstable metrics.

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.62.0-SNAPSHOT~68ebce2b54, baseline=1.62.0-SNAPSHOT~6880c80c48

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.055 s) : 0, 1055442
Total [baseline] (8.831 s) : 0, 8831216
Agent [candidate] (1.06 s) : 0, 1060377
Total [candidate] (8.832 s) : 0, 8832422
section iast
Agent [baseline] (1.243 s) : 0, 1243309
Total [baseline] (9.612 s) : 0, 9611985
Agent [candidate] (1.242 s) : 0, 1241813
Total [candidate] (9.612 s) : 0, 9611658

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.055 s	-
Agent	iast	1.243 s	187.867 ms (17.8%)
Total	tracing	8.831 s	-
Total	iast	9.612 s	780.769 ms (8.8%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.06 s	-
Agent	iast	1.242 s	181.436 ms (17.1%)
Total	tracing	8.832 s	-
Total	iast	9.612 s	779.236 ms (8.8%)

gantt
    title insecure-bank - break down per module: candidate=1.62.0-SNAPSHOT~68ebce2b54, baseline=1.62.0-SNAPSHOT~6880c80c48

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.233 ms) : 0, 1233
crashtracking [candidate] (1.23 ms) : 0, 1230
BytebuddyAgent [baseline] (633.181 ms) : 0, 633181
BytebuddyAgent [candidate] (635.081 ms) : 0, 635081
AgentMeter [baseline] (29.482 ms) : 0, 29482
AgentMeter [candidate] (29.594 ms) : 0, 29594
GlobalTracer [baseline] (248.784 ms) : 0, 248784
GlobalTracer [candidate] (249.834 ms) : 0, 249834
AppSec [baseline] (32.31 ms) : 0, 32310
AppSec [candidate] (32.532 ms) : 0, 32532
Debugger [baseline] (59.024 ms) : 0, 59024
Debugger [candidate] (59.056 ms) : 0, 59056
Remote Config [baseline] (609.511 µs) : 0, 610
Remote Config [candidate] (587.771 µs) : 0, 588
Telemetry [baseline] (8.023 ms) : 0, 8023
Telemetry [candidate] (8.054 ms) : 0, 8054
Flare Poller [baseline] (6.62 ms) : 0, 6620
Flare Poller [candidate] (8.105 ms) : 0, 8105
section iast
crashtracking [baseline] (1.236 ms) : 0, 1236
crashtracking [candidate] (1.238 ms) : 0, 1238
BytebuddyAgent [baseline] (817.038 ms) : 0, 817038
BytebuddyAgent [candidate] (817.133 ms) : 0, 817133
AgentMeter [baseline] (11.52 ms) : 0, 11520
AgentMeter [candidate] (11.525 ms) : 0, 11525
GlobalTracer [baseline] (241.35 ms) : 0, 241350
GlobalTracer [candidate] (240.873 ms) : 0, 240873
IAST [baseline] (27.783 ms) : 0, 27783
IAST [candidate] (30.199 ms) : 0, 30199
AppSec [baseline] (30.619 ms) : 0, 30619
AppSec [candidate] (27.771 ms) : 0, 27771
Debugger [baseline] (65.541 ms) : 0, 65541
Debugger [candidate] (64.391 ms) : 0, 64391
Remote Config [baseline] (542.52 µs) : 0, 543
Remote Config [candidate] (537.946 µs) : 0, 538
Telemetry [baseline] (7.862 ms) : 0, 7862
Telemetry [candidate] (7.765 ms) : 0, 7765
Flare Poller [baseline] (3.497 ms) : 0, 3497
Flare Poller [candidate] (3.447 ms) : 0, 3447

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.62.0-SNAPSHOT~68ebce2b54, baseline=1.62.0-SNAPSHOT~6880c80c48

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.068 s) : 0, 1068175
Total [baseline] (11.058 s) : 0, 11058260
Agent [candidate] (1.06 s) : 0, 1059737
Total [candidate] (11.118 s) : 0, 11117814
section appsec
Agent [baseline] (1.271 s) : 0, 1271156
Total [baseline] (11.114 s) : 0, 11114427
Agent [candidate] (1.27 s) : 0, 1269525
Total [candidate] (10.988 s) : 0, 10988314
section iast
Agent [baseline] (1.233 s) : 0, 1233094
Total [baseline] (11.33 s) : 0, 11330077
Agent [candidate] (1.244 s) : 0, 1244352
Total [candidate] (11.381 s) : 0, 11380505
section profiling
Agent [baseline] (1.196 s) : 0, 1196046
Total [baseline] (10.992 s) : 0, 10991997
Agent [candidate] (1.189 s) : 0, 1189317
Total [candidate] (11.032 s) : 0, 11032063

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.068 s	-
Agent	appsec	1.271 s	202.981 ms (19.0%)
Agent	iast	1.233 s	164.919 ms (15.4%)
Agent	profiling	1.196 s	127.871 ms (12.0%)
Total	tracing	11.058 s	-
Total	appsec	11.114 s	56.167 ms (0.5%)
Total	iast	11.33 s	271.817 ms (2.5%)
Total	profiling	10.992 s	-66.263 ms (-0.6%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.06 s	-
Agent	appsec	1.27 s	209.787 ms (19.8%)
Agent	iast	1.244 s	184.614 ms (17.4%)
Agent	profiling	1.189 s	129.579 ms (12.2%)
Total	tracing	11.118 s	-
Total	appsec	10.988 s	-129.501 ms (-1.2%)
Total	iast	11.381 s	262.691 ms (2.4%)
Total	profiling	11.032 s	-85.751 ms (-0.8%)

gantt
    title petclinic - break down per module: candidate=1.62.0-SNAPSHOT~68ebce2b54, baseline=1.62.0-SNAPSHOT~6880c80c48

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.242 ms) : 0, 1242
crashtracking [candidate] (1.233 ms) : 0, 1233
BytebuddyAgent [baseline] (639.446 ms) : 0, 639446
BytebuddyAgent [candidate] (635.176 ms) : 0, 635176
AgentMeter [baseline] (29.946 ms) : 0, 29946
AgentMeter [candidate] (29.631 ms) : 0, 29631
GlobalTracer [baseline] (250.256 ms) : 0, 250256
GlobalTracer [candidate] (249.903 ms) : 0, 249903
AppSec [baseline] (32.542 ms) : 0, 32542
AppSec [candidate] (32.458 ms) : 0, 32458
Debugger [baseline] (59.822 ms) : 0, 59822
Debugger [candidate] (59.838 ms) : 0, 59838
Remote Config [baseline] (609.789 µs) : 0, 610
Remote Config [candidate] (594.801 µs) : 0, 595
Telemetry [baseline] (8.116 ms) : 0, 8116
Telemetry [candidate] (7.993 ms) : 0, 7993
Flare Poller [baseline] (9.898 ms) : 0, 9898
Flare Poller [candidate] (6.767 ms) : 0, 6767
section appsec
crashtracking [baseline] (1.249 ms) : 0, 1249
crashtracking [candidate] (1.24 ms) : 0, 1240
BytebuddyAgent [baseline] (680.563 ms) : 0, 680563
BytebuddyAgent [candidate] (679.342 ms) : 0, 679342
AgentMeter [baseline] (12.218 ms) : 0, 12218
AgentMeter [candidate] (12.223 ms) : 0, 12223
GlobalTracer [baseline] (251.265 ms) : 0, 251265
GlobalTracer [candidate] (250.871 ms) : 0, 250871
AppSec [baseline] (186.783 ms) : 0, 186783
AppSec [candidate] (186.928 ms) : 0, 186928
Debugger [baseline] (66.044 ms) : 0, 66044
Debugger [candidate] (66.063 ms) : 0, 66063
Remote Config [baseline] (583.32 µs) : 0, 583
Remote Config [candidate] (573.25 µs) : 0, 573
Telemetry [baseline] (7.862 ms) : 0, 7862
Telemetry [candidate] (7.9 ms) : 0, 7900
Flare Poller [baseline] (3.444 ms) : 0, 3444
Flare Poller [candidate] (3.465 ms) : 0, 3465
IAST [baseline] (24.547 ms) : 0, 24547
IAST [candidate] (24.493 ms) : 0, 24493
section iast
crashtracking [baseline] (1.223 ms) : 0, 1223
crashtracking [candidate] (1.229 ms) : 0, 1229
BytebuddyAgent [baseline] (810.41 ms) : 0, 810410
BytebuddyAgent [candidate] (816.698 ms) : 0, 816698
AgentMeter [baseline] (11.398 ms) : 0, 11398
AgentMeter [candidate] (11.568 ms) : 0, 11568
GlobalTracer [baseline] (238.993 ms) : 0, 238993
GlobalTracer [candidate] (241.785 ms) : 0, 241785
AppSec [baseline] (28.49 ms) : 0, 28490
AppSec [candidate] (28.01 ms) : 0, 28010
Debugger [baseline] (64.632 ms) : 0, 64632
Debugger [candidate] (67.267 ms) : 0, 67267
Remote Config [baseline] (534.497 µs) : 0, 534
Remote Config [candidate] (538.165 µs) : 0, 538
Telemetry [baseline] (7.82 ms) : 0, 7820
Telemetry [candidate] (7.925 ms) : 0, 7925
Flare Poller [baseline] (3.468 ms) : 0, 3468
Flare Poller [candidate] (3.423 ms) : 0, 3423
IAST [baseline] (30.104 ms) : 0, 30104
IAST [candidate] (29.641 ms) : 0, 29641
section profiling
ProfilingAgent [baseline] (94.216 ms) : 0, 94216
ProfilingAgent [candidate] (93.476 ms) : 0, 93476
crashtracking [baseline] (1.209 ms) : 0, 1209
crashtracking [candidate] (1.182 ms) : 0, 1182
BytebuddyAgent [baseline] (699.101 ms) : 0, 699101
BytebuddyAgent [candidate] (695.697 ms) : 0, 695697
AgentMeter [baseline] (9.224 ms) : 0, 9224
AgentMeter [candidate] (9.3 ms) : 0, 9300
GlobalTracer [baseline] (208.756 ms) : 0, 208756
GlobalTracer [candidate] (207.826 ms) : 0, 207826
AppSec [baseline] (33.045 ms) : 0, 33045
AppSec [candidate] (32.64 ms) : 0, 32640
Debugger [baseline] (66.568 ms) : 0, 66568
Debugger [candidate] (65.531 ms) : 0, 65531
Remote Config [baseline] (594.218 µs) : 0, 594
Remote Config [candidate] (588.482 µs) : 0, 588
Telemetry [baseline] (7.885 ms) : 0, 7885
Telemetry [candidate] (7.817 ms) : 0, 7817
Flare Poller [baseline] (3.595 ms) : 0, 3595
Flare Poller [candidate] (3.57 ms) : 0, 3570
Profiling [baseline] (94.784 ms) : 0, 94784
Profiling [candidate] (94.038 ms) : 0, 94038

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	adrien.boitreaud/no-sql-failed-reset
git_commit_date	1776788798	1776790628
git_commit_sha	`6880c80`	`68ebce2`
release_version	1.62.0-SNAPSHOT~6880c80c48	1.62.0-SNAPSHOT~68ebce2b54

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1776792855	1776792855
ci_job_id	1616495860	1616495860
ci_pipeline_id	108848211	108848211
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-c613ultw 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-c613ultw 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 2 performance improvements and 0 performance regressions! Performance is the same for 17 metrics, 17 unstable metrics.

scenario	Δ mean agg_http_req_duration_p50	Δ mean agg_http_req_duration_p95	Δ mean throughput	candidate mean agg_http_req_duration_p50	candidate mean agg_http_req_duration_p95	candidate mean throughput	baseline mean agg_http_req_duration_p50	baseline mean agg_http_req_duration_p95	baseline mean throughput
scenario:load:petclinic:profiling:high_load	better [-2.724ms; -2.089ms] or [-13.480%; -10.337%]	better [-2.802ms; -1.535ms] or [-8.926%; -4.892%]	unstable [-0.023op/s; +50.336op/s] or [-0.010%; +21.793%]	17.801ms	29.217ms	256.125op/s	20.208ms	31.385ms	230.969op/s

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.62.0-SNAPSHOT~68ebce2b54, baseline=1.62.0-SNAPSHOT~6880c80c48
    dateFormat X
    axisFormat %s
section baseline
no_agent (19.391 ms) : 19193, 19589
.   : milestone, 19391,
appsec (19.031 ms) : 18838, 19224
.   : milestone, 19031,
code_origins (17.884 ms) : 17710, 18059
.   : milestone, 17884,
iast (17.627 ms) : 17457, 17798
.   : milestone, 17627,
profiling (20.218 ms) : 20017, 20418
.   : milestone, 20218,
tracing (17.935 ms) : 17755, 18115
.   : milestone, 17935,
section candidate
no_agent (19.74 ms) : 19538, 19943
.   : milestone, 19740,
appsec (18.82 ms) : 18631, 19008
.   : milestone, 18820,
code_origins (17.702 ms) : 17528, 17875
.   : milestone, 17702,
iast (17.978 ms) : 17800, 18155
.   : milestone, 17978,
profiling (18.214 ms) : 18034, 18395
.   : milestone, 18214,
tracing (18.046 ms) : 17868, 18225
.   : milestone, 18046,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	19.391 ms [19.193 ms, 19.589 ms]	-
appsec	19.031 ms [18.838 ms, 19.224 ms]	-359.831 µs (-1.9%)
code_origins	17.884 ms [17.71 ms, 18.059 ms]	-1.507 ms (-7.8%)
iast	17.627 ms [17.457 ms, 17.798 ms]	-1.763 ms (-9.1%)
profiling	20.218 ms [20.017 ms, 20.418 ms]	826.872 µs (4.3%)
tracing	17.935 ms [17.755 ms, 18.115 ms]	-1.456 ms (-7.5%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	19.74 ms [19.538 ms, 19.943 ms]	-
appsec	18.82 ms [18.631 ms, 19.008 ms]	-920.826 µs (-4.7%)
code_origins	17.702 ms [17.528 ms, 17.875 ms]	-2.039 ms (-10.3%)
iast	17.978 ms [17.8 ms, 18.155 ms]	-1.763 ms (-8.9%)
profiling	18.214 ms [18.034 ms, 18.395 ms]	-1.526 ms (-7.7%)
tracing	18.046 ms [17.868 ms, 18.225 ms]	-1.694 ms (-8.6%)

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.62.0-SNAPSHOT~68ebce2b54, baseline=1.62.0-SNAPSHOT~6880c80c48
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.267 ms) : 1256, 1279
.   : milestone, 1267,
iast (3.265 ms) : 3215, 3315
.   : milestone, 3265,
iast_FULL (5.88 ms) : 5821, 5939
.   : milestone, 5880,
iast_GLOBAL (3.754 ms) : 3686, 3822
.   : milestone, 3754,
profiling (2.158 ms) : 2136, 2181
.   : milestone, 2158,
tracing (1.916 ms) : 1901, 1932
.   : milestone, 1916,
section candidate
no_agent (1.262 ms) : 1250, 1275
.   : milestone, 1262,
iast (3.304 ms) : 3255, 3353
.   : milestone, 3304,
iast_FULL (5.992 ms) : 5932, 6052
.   : milestone, 5992,
iast_GLOBAL (3.699 ms) : 3637, 3760
.   : milestone, 3699,
profiling (2.207 ms) : 2187, 2227
.   : milestone, 2207,
tracing (1.903 ms) : 1887, 1918
.   : milestone, 1903,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.267 ms [1.256 ms, 1.279 ms]	-
iast	3.265 ms [3.215 ms, 3.315 ms]	1.998 ms (157.6%)
iast_FULL	5.88 ms [5.821 ms, 5.939 ms]	4.613 ms (364.0%)
iast_GLOBAL	3.754 ms [3.686 ms, 3.822 ms]	2.487 ms (196.2%)
profiling	2.158 ms [2.136 ms, 2.181 ms]	891.143 µs (70.3%)
tracing	1.916 ms [1.901 ms, 1.932 ms]	649.118 µs (51.2%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.262 ms [1.25 ms, 1.275 ms]	-
iast	3.304 ms [3.255 ms, 3.353 ms]	2.042 ms (161.7%)
iast_FULL	5.992 ms [5.932 ms, 6.052 ms]	4.73 ms (374.6%)
iast_GLOBAL	3.699 ms [3.637 ms, 3.76 ms]	2.436 ms (193.0%)
profiling	2.207 ms [2.187 ms, 2.227 ms]	944.556 µs (74.8%)
tracing	1.903 ms [1.887 ms, 1.918 ms]	640.368 µs (50.7%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	adrien.boitreaud/no-sql-failed-reset
git_commit_date	1776788798	1776790628
git_commit_sha	`6880c80`	`68ebce2`
release_version	1.62.0-SNAPSHOT~6880c80c48	1.62.0-SNAPSHOT~68ebce2b54

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1776792559	1776792559
ci_job_id	1616495861	1616495861
ci_pipeline_id	108848211	108848211
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-lm85tcai 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-lm85tcai 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.62.0-SNAPSHOT~68ebce2b54, baseline=1.62.0-SNAPSHOT~6880c80c48
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.492 ms) : 1481, 1504
.   : milestone, 1492,
appsec (3.85 ms) : 3628, 4072
.   : milestone, 3850,
iast (2.291 ms) : 2220, 2361
.   : milestone, 2291,
iast_GLOBAL (2.343 ms) : 2272, 2414
.   : milestone, 2343,
profiling (2.112 ms) : 2056, 2167
.   : milestone, 2112,
tracing (2.11 ms) : 2055, 2165
.   : milestone, 2110,
section candidate
no_agent (1.49 ms) : 1479, 1502
.   : milestone, 1490,
appsec (3.788 ms) : 3570, 4005
.   : milestone, 3788,
iast (2.291 ms) : 2221, 2361
.   : milestone, 2291,
iast_GLOBAL (2.333 ms) : 2262, 2404
.   : milestone, 2333,
profiling (2.128 ms) : 2072, 2184
.   : milestone, 2128,
tracing (2.09 ms) : 2036, 2144
.   : milestone, 2090,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.492 ms [1.481 ms, 1.504 ms]	-
appsec	3.85 ms [3.628 ms, 4.072 ms]	2.358 ms (158.0%)
iast	2.291 ms [2.22 ms, 2.361 ms]	798.369 µs (53.5%)
iast_GLOBAL	2.343 ms [2.272 ms, 2.414 ms]	850.407 µs (57.0%)
profiling	2.112 ms [2.056 ms, 2.167 ms]	619.377 µs (41.5%)
tracing	2.11 ms [2.055 ms, 2.165 ms]	617.767 µs (41.4%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.49 ms [1.479 ms, 1.502 ms]	-
appsec	3.788 ms [3.57 ms, 4.005 ms]	2.297 ms (154.2%)
iast	2.291 ms [2.221 ms, 2.361 ms]	800.323 µs (53.7%)
iast_GLOBAL	2.333 ms [2.262 ms, 2.404 ms]	842.908 µs (56.6%)
profiling	2.128 ms [2.072 ms, 2.184 ms]	637.845 µs (42.8%)
tracing	2.09 ms [2.036 ms, 2.144 ms]	599.588 µs (40.2%)

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.62.0-SNAPSHOT~68ebce2b54, baseline=1.62.0-SNAPSHOT~6880c80c48
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.539 s) : 15539000, 15539000
.   : milestone, 15539000,
appsec (14.974 s) : 14974000, 14974000
.   : milestone, 14974000,
iast (18.324 s) : 18324000, 18324000
.   : milestone, 18324000,
iast_GLOBAL (18.081 s) : 18081000, 18081000
.   : milestone, 18081000,
profiling (15.029 s) : 15029000, 15029000
.   : milestone, 15029000,
tracing (14.977 s) : 14977000, 14977000
.   : milestone, 14977000,
section candidate
no_agent (15.48 s) : 15480000, 15480000
.   : milestone, 15480000,
appsec (14.8 s) : 14800000, 14800000
.   : milestone, 14800000,
iast (18.833 s) : 18833000, 18833000
.   : milestone, 18833000,
iast_GLOBAL (17.727 s) : 17727000, 17727000
.   : milestone, 17727000,
profiling (15.191 s) : 15191000, 15191000
.   : milestone, 15191000,
tracing (15.015 s) : 15015000, 15015000
.   : milestone, 15015000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.539 s [15.539 s, 15.539 s]	-
appsec	14.974 s [14.974 s, 14.974 s]	-565.0 ms (-3.6%)
iast	18.324 s [18.324 s, 18.324 s]	2.785 s (17.9%)
iast_GLOBAL	18.081 s [18.081 s, 18.081 s]	2.542 s (16.4%)
profiling	15.029 s [15.029 s, 15.029 s]	-510.0 ms (-3.3%)
tracing	14.977 s [14.977 s, 14.977 s]	-562.0 ms (-3.6%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.48 s [15.48 s, 15.48 s]	-
appsec	14.8 s [14.8 s, 14.8 s]	-680.0 ms (-4.4%)
iast	18.833 s [18.833 s, 18.833 s]	3.353 s (21.7%)
iast_GLOBAL	17.727 s [17.727 s, 17.727 s]	2.247 s (14.5%)
profiling	15.191 s [15.191 s, 15.191 s]	-289.0 ms (-1.9%)
tracing	15.015 s [15.015 s, 15.015 s]	-465.0 ms (-3.0%)

aboitreaud changed the title ~~Don't reset sql failed after a success~~ Instrument QueryExecution.assertAnalyzed() to catch DataFrame analysis failures Apr 21, 2026

aboitreaud force-pushed the adrien.boitreaud/no-sql-failed-reset branch from ef61c95 to 4e5f33e Compare April 21, 2026 16:52

aboitreaud added 2 commits April 21, 2026 18:57

Instrument QueryExecution.assertAnalyzed() to catch DataFrame analysi…

66cec29

…s failures

Restore SparkSqlFailureAdvice.enter SQL text logging

68ebce2

aboitreaud force-pushed the adrien.boitreaud/no-sql-failed-reset branch from 4e5f33e to 68ebce2 Compare April 21, 2026 16:57

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Instrument QueryExecution.assertAnalyzed() to catch DataFrame analysis failures#11033

Instrument QueryExecution.assertAnalyzed() to catch DataFrame analysis failures#11033
aboitreaud wants to merge 2 commits intomasterfrom
adrien.boitreaud/no-sql-failed-reset

aboitreaud commented Apr 1, 2026 •

edited

Loading

Uh oh!

pr-commenter Bot commented Apr 21, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

Conversation

aboitreaud commented Apr 1, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

What Does This Do

Motivation

Additional Notes

Uh oh!

pr-commenter Bot commented Apr 21, 2026

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

aboitreaud commented Apr 1, 2026 •

edited

Loading