Skip to content

chore(release): fix release bump auto-merge - #698

Merged
kaahos merged 12 commits into
mainfrom
paul.fournillon/secure-release-bump-auto-merge
Aug 3, 2026
Merged

chore(release): fix release bump auto-merge#698
kaahos merged 12 commits into
mainfrom
paul.fournillon/secure-release-bump-auto-merge

Conversation

@kaahos

@kaahos kaahos commented Jul 29, 2026

Copy link
Copy Markdown
Contributor

What does this PR do?:

Fix release bump PR auto-merge and unify automatic approval around the existing trivial label.

Motivation:

Fix the broken auto-merge PR process for new version bump.

Changes:

  • Create release bump PRs with the scoped STS token.
  • Label bump PRs with trivial.
  • Queue auto-merge only for the exact validated bump commit.
  • Make one approval workflow handle all trivial PRs.
  • Apply strict release-bump validation to automated/bump-* PRs before approval.
  • Pin bot approvals to the current PR head SHA.
  • Support both main and protected release/X.Y._ branches.
  • Remove the no-review workflow and STS policy.
  • Preserve Dependabot’s automatic approval behavior by switching it to trivial.

Additional Notes:

How to test the change?:

For Datadog employees:

  • If this PR touches code that signs or publishes builds or packages, or handles
    credentials of any kind, I've requested a security review (run the dd:platform-security-review
    skill, or file a request via the PSEC review form).
    bewaire also runs automatically on every PR.
  • This PR doesn't touch any of that.
  • JIRA: [JIRA-XXXX]

Unsure? Have a question? Request a review!

@dd-octo-sts

dd-octo-sts Bot commented Jul 29, 2026

Copy link
Copy Markdown
Contributor

CI Test Results

Run: #30804405734 | Commit: f1e3760 | Duration: 14m 41s (longest job)

All 32 test jobs passed

Status Overview

JDK glibc-aarch64/debug glibc-amd64/debug musl-aarch64/debug musl-amd64/debug
8 - - -
8-ibm - - -
8-j9 - -
8-librca - -
8-orcl - - -
11 - - -
11-j9 - -
11-librca - -
17 - -
17-graal - -
17-j9 - -
17-librca - -
21 - -
21-graal - -
21-librca - -
25 - -
25-graal - -
25-librca - -

Legend: ✅ passed | ❌ failed | ⚪ skipped | 🚫 cancelled

Summary: Total: 32 | Passed: 32 | Failed: 0


Updated: 2026-08-03 10:27:09 UTC

@dd-octo-sts

dd-octo-sts Bot commented Jul 29, 2026

Copy link
Copy Markdown
Contributor

Benchmark Results (commit edd3930)

Pipeline: https://gitlab.ddbuild.io/DataDog/apm-reliability/benchmarking-platform/-/pipelines/127754577 Commit: edd3930bf7d99de2310c8b8ae745af0b860f99c6

⚠️ Significant outliers

  • 🔴 future-genetic (JDK 21): runtime +2.6% (2052→2106 ms)
Runtime details (per benchmark × JDK)
Benchmark JDK Latest Dev Δ (dev vs latest) Issues L/D
akka-uct 21 ✅ 10344 ms (21 iters) ✅ 10134 ms (21 iters) ≈ -2% (±11%) — / —
akka-uct 25 ✅ 8794 ms (24 iters) ✅ 8820 ms (24 iters) ≈ +0.3% (±10.7%) — / —
finagle-chirper 21 ✅ 6018 ms (33 iters) ✅ 6016 ms (33 iters) ≈ -0% (±24.9%) ⚠️ W:3 / ⚠️ W:3
finagle-chirper 25 ✅ 5439 ms (36 iters) ✅ 5468 ms (36 iters) ≈ +0.5% (±24.7%) ⚠️ W:3 / ⚠️ W:3
fj-kmeans 21 ✅ 2731 ms (68 iters) ✅ 2663 ms (69 iters) ≈ -2.5% (±2.7%) — / —
fj-kmeans 25 ✅ 2762 ms (68 iters) ✅ 2817 ms (66 iters) ≈ +2% (±2.8%) — / —
future-genetic 21 ✅ 2052 ms (90 iters) ✅ 2106 ms (88 iters) 🔴 +2.6% — / —
future-genetic 25 ✅ 2051 ms (90 iters) ✅ 2011 ms (92 iters) ≈ -2% (±2.6%) — / —
naive-bayes 21 ✅ 1253 ms (136 iters) ✅ 1244 ms (137 iters) ≈ -0.7% (±32.7%) — / —
naive-bayes 25 ✅ 1012 ms (169 iters) ✅ 1017 ms (168 iters) ≈ +0.5% (±31.8%) — / —
reactors 21 ✅ 16102 ms (15 iters) ✅ 16505 ms (15 iters) ≈ +2.5% (±8.8%) — / —
Internal counter details (ddprof)

ddprof internal counters, latest / dev (✅ = 0, · = unavailable):

Benchmark JDK Dropped rec Dropped jvmti Dropped trace Skipped WC AGCT fail Unwind fail
akka-uct 21 ✅ / ✅ ✅ / ✅ 2 / 1 2045 / 1986 ✅ / ✅ ✅ / ✅
akka-uct 25 ✅ / ✅ ✅ / ✅ 1 / 2 2380 / 2421 ✅ / ✅ ✅ / ✅
finagle-chirper 21 ✅ / ✅ ✅ / ✅ 4 / 5 8249 / 8606 ✅ / ✅ ✅ / ✅
finagle-chirper 25 ✅ / ✅ ✅ / ✅ ✅ / 1 8265 / 8586 ✅ / ✅ ✅ / ✅
fj-kmeans 21 ✅ / ✅ ✅ / ✅ 1 / 12 1261 / 1249 ✅ / ✅ ✅ / ✅
fj-kmeans 25 ✅ / ✅ ✅ / ✅ 3 / 3 1285 / 1272 ✅ / ✅ ✅ / ✅
future-genetic 21 ✅ / ✅ ✅ / ✅ 1 / 2 2941 / 2979 ✅ / ✅ ✅ / ✅
future-genetic 25 ✅ / ✅ ✅ / ✅ ✅ / ✅ 2867 / 2838 ✅ / ✅ ✅ / ✅
naive-bayes 21 ✅ / ✅ ✅ / ✅ 9 / 6 3465 / 3495 ✅ / ✅ ✅ / ✅
naive-bayes 25 ✅ / ✅ ✅ / ✅ 9 / 3 3462 / 3469 ✅ / ✅ ✅ / ✅
reactors 21 ✅ / ✅ ✅ / ✅ 1 / ✅ 1665 / 1631 ✅ / ✅ ✅ / ✅
reactors 25 ✅ / ✅ ✅ / ✅ 1 / 1 1930 / 1896 ✅ / ✅ ✅ / ✅

@kaahos
kaahos marked this pull request as ready for review July 31, 2026 15:08
@kaahos
kaahos requested a review from a team as a code owner July 31, 2026 15:08

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 51ab22284b

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment thread .github/scripts/validate-release-bump.sh Outdated
@dd-octo-sts

dd-octo-sts Bot commented Jul 31, 2026

Copy link
Copy Markdown
Contributor

Benchmark Results (commit 51ab222)

Pipeline: https://gitlab.ddbuild.io/DataDog/apm-reliability/benchmarking-platform/-/pipelines/128264970 Commit: 51ab22284b5b7d9eb90eb9d047792437f64933f2

✅ Within expected boundaries

No significant runtime deltas (all within run-to-run noise) and no internal-counter outliers.

Runtime details (per benchmark × JDK)
Benchmark JDK Latest Dev Δ (dev vs latest) Issues L/D
akka-uct 21 ✅ 10212 ms (21 iters) ✅ 10391 ms (21 iters) ≈ +1.8% (±11.4%) — / —
akka-uct 25 ✅ 8984 ms (24 iters) ✅ 8887 ms (24 iters) ≈ -1.1% (±10.1%) — / —
finagle-chirper 21 ✅ 5988 ms (33 iters) ✅ 5990 ms (33 iters) ≈ +0% (±25.6%) ⚠️ W:3 / ⚠️ W:3
finagle-chirper 25 ✅ 5540 ms (35 iters) ✅ 5454 ms (36 iters) ≈ -1.6% (±24.5%) ⚠️ W:3 / ⚠️ W:3
fj-kmeans 21 ✅ 2694 ms (70 iters) ✅ 2693 ms (70 iters) ≈ -0% (±2.7%) — / —
fj-kmeans 25 ✅ 2854 ms (66 iters) ✅ 2845 ms (66 iters) ≈ -0.3% (±2.6%) — / —
future-genetic 21 ✅ 2122 ms (87 iters) ✅ 2128 ms (87 iters) ≈ +0.3% (±2.7%) — / —
future-genetic 25 ✅ 2087 ms (89 iters) ✅ 2082 ms (89 iters) ≈ -0.2% (±2.5%) — / —
naive-bayes 21 ✅ 1291 ms (132 iters) ✅ 1255 ms (136 iters) ≈ -2.8% (±32.5%) — / —
naive-bayes 25 ✅ 1007 ms (170 iters) ✅ 979 ms (174 iters) ≈ -2.8% (±31.1%) — / —
reactors 21 ✅ 16144 ms (15 iters) ✅ 16506 ms (15 iters) ≈ +2.2% (±8%) — / —
reactors 25 ✅ 18168 ms (15 iters) ✅ 18674 ms (15 iters) ≈ +2.8% (±3.7%) — / —
Internal counter details (ddprof)

ddprof internal counters, latest / dev (✅ = 0, · = unavailable):

Benchmark JDK Dropped rec Dropped jvmti Dropped trace Skipped WC AGCT fail Unwind fail
akka-uct 21 ✅ / ✅ ✅ / ✅ 1 / ✅ 1879 / 1990 ✅ / ✅ ✅ / ✅
akka-uct 25 ✅ / ✅ ✅ / ✅ ✅ / 5 2456 / 2394 ✅ / ✅ ✅ / ✅
finagle-chirper 21 ✅ / ✅ ✅ / ✅ 5 / 4 8891 / 8545 ✅ / ✅ ✅ / ✅
finagle-chirper 25 ✅ / ✅ ✅ / ✅ 1 / 1 8158 / 8542 ✅ / ✅ ✅ / ✅
fj-kmeans 21 ✅ / ✅ ✅ / ✅ 2 / 1 1290 / 1279 ✅ / ✅ ✅ / ✅
fj-kmeans 25 ✅ / ✅ ✅ / ✅ 1 / ✅ 1303 / 1276 ✅ / ✅ ✅ / ✅
future-genetic 21 ✅ / ✅ ✅ / ✅ 2 / ✅ 3022 / 2957 ✅ / ✅ ✅ / ✅
future-genetic 25 ✅ / ✅ ✅ / ✅ 2 / 2 2902 / 2887 ✅ / ✅ ✅ / ✅
naive-bayes 21 ✅ / ✅ ✅ / ✅ 1 / 3 3484 / 3492 ✅ / ✅ ✅ / ✅
naive-bayes 25 ✅ / ✅ ✅ / ✅ 2 / 1 3482 / 3473 ✅ / ✅ ✅ / ✅
reactors 21 ✅ / ✅ ✅ / ✅ 2 / 1 1688 / 1683 ✅ / ✅ ✅ / ✅
reactors 25 ✅ / ✅ ✅ / ✅ ✅ / 3 1836 / 1951 ✅ / ✅ ✅ / ✅

@dd-octo-sts

dd-octo-sts Bot commented Jul 31, 2026

Copy link
Copy Markdown
Contributor

Benchmark Results (commit 8b42e17)

Pipeline: https://gitlab.ddbuild.io/DataDog/apm-reliability/benchmarking-platform/-/pipelines/128291352 Commit: 8b42e17f4705e42253682b248cde69003cfc31c7

⚠️ Significant outliers

  • 🔴 fj-kmeans (JDK 25): runtime +4.5% (2720→2843 ms)
Runtime details (per benchmark × JDK)
Benchmark JDK Latest Dev Δ (dev vs latest) Issues L/D
akka-uct 21 ✅ 10338 ms (21 iters) ✅ 10347 ms (21 iters) ≈ +0.1% (±11.1%) — / —
akka-uct 25 ✅ 8773 ms (24 iters) ✅ 8780 ms (24 iters) ≈ +0.1% (±10%) — / —
finagle-chirper 21 ✅ 5957 ms (33 iters) ✅ 6011 ms (33 iters) ≈ +0.9% (±25.6%) ⚠️ W:3 / ⚠️ W:3
finagle-chirper 25 ✅ 5511 ms (36 iters) ✅ 5475 ms (36 iters) ≈ -0.7% (±24.3%) ⚠️ W:3 / ⚠️ W:3
fj-kmeans 21 ✅ 2688 ms (70 iters) ✅ 2691 ms (70 iters) ≈ +0.1% (±2.7%) — / —
fj-kmeans 25 ✅ 2720 ms (68 iters) ✅ 2843 ms (66 iters) 🔴 +4.5% — / —
future-genetic 21 ✅ 2118 ms (88 iters) ✅ 2066 ms (90 iters) ≈ -2.5% (±2.6%) — / —
future-genetic 25 ✅ 2062 ms (90 iters) ✅ 2053 ms (91 iters) ≈ -0.4% (±2.8%) — / —
naive-bayes 21 ✅ 1291 ms (133 iters) ✅ 1272 ms (136 iters) ≈ -1.5% (±31.9%) — / —
naive-bayes 25 ✅ 978 ms (174 iters) ✅ 1004 ms (170 iters) ≈ +2.7% (±32%) — / —
reactors 25 ✅ 18532 ms (15 iters) ✅ 18774 ms (15 iters) ≈ +1.3% (±3.7%) — / —
Internal counter details (ddprof)

ddprof internal counters, latest / dev (✅ = 0, · = unavailable):

Benchmark JDK Dropped rec Dropped jvmti Dropped trace Skipped WC AGCT fail Unwind fail
akka-uct 21 ✅ / ✅ ✅ / ✅ 2 / ✅ 2066 / 2032 ✅ / ✅ ✅ / ✅
akka-uct 25 ✅ / ✅ ✅ / ✅ 5 / 1 2410 / 2378 ✅ / ✅ ✅ / ✅
finagle-chirper 21 ✅ / ✅ ✅ / ✅ 7 / 4 8268 / 8494 ✅ / ✅ ✅ / ✅
finagle-chirper 25 ✅ / ✅ ✅ / ✅ 2 / 1 8312 / 8053 ✅ / ✅ ✅ / ✅
fj-kmeans 21 ✅ / ✅ ✅ / ✅ 4 / 2 1278 / 1247 ✅ / ✅ ✅ / ✅
fj-kmeans 25 ✅ / ✅ ✅ / ✅ ✅ / 1 1260 / 1292 ✅ / ✅ ✅ / ✅
future-genetic 21 ✅ / ✅ ✅ / ✅ 1 / ✅ 2998 / 2945 ✅ / ✅ ✅ / ✅
future-genetic 25 ✅ / ✅ ✅ / ✅ 2 / 2 2856 / 2797 ✅ / ✅ ✅ / ✅
naive-bayes 21 ✅ / ✅ ✅ / ✅ 3 / 3 3520 / 3615 ✅ / ✅ ✅ / ✅
naive-bayes 25 ✅ / ✅ ✅ / ✅ 3 / 5 3419 / 3428 ✅ / ✅ ✅ / ✅
reactors 21 ✅ / ✅ ✅ / ✅ ✅ / ✅ ✅ / ✅ ✅ / ✅ ✅ / ✅
reactors 25 ✅ / ✅ ✅ / ✅ 2 / 2 1955 / 1926 ✅ / ✅ ✅ / ✅

@dd-octo-sts

dd-octo-sts Bot commented Jul 31, 2026

Copy link
Copy Markdown
Contributor

Benchmark Results (commit fa6b4be)

Pipeline: https://gitlab.ddbuild.io/DataDog/apm-reliability/benchmarking-platform/-/pipelines/128313596 Commit: fa6b4be3d3dd93741558a421cc55f75c1fe628f7

⚠️ Significant outliers

  • 🟢 future-genetic (JDK 25): runtime -5% (2049→1946 ms)
Runtime details (per benchmark × JDK)
Benchmark JDK Latest Dev Δ (dev vs latest) Issues L/D
akka-uct 21 ✅ 10250 ms (21 iters) ✅ 10295 ms (21 iters) ≈ +0.4% (±11.6%) — / —
akka-uct 25 ✅ 8870 ms (24 iters) ✅ 8826 ms (24 iters) ≈ -0.5% (±10.2%) — / —
finagle-chirper 21 ✅ 5970 ms (33 iters) ✅ 5952 ms (33 iters) ≈ -0.3% (±25%) ⚠️ W:3 / ⚠️ W:3
finagle-chirper 25 ✅ 5486 ms (36 iters) ✅ 5442 ms (36 iters) ≈ -0.8% (±24.2%) ⚠️ W:3 / ⚠️ W:3
fj-kmeans 21 ✅ 2730 ms (68 iters) ✅ 2767 ms (68 iters) ≈ +1.4% (±2.8%) — / —
fj-kmeans 25 ✅ 2829 ms (66 iters) ✅ 2827 ms (66 iters) ≈ -0.1% (±2.7%) — / —
future-genetic 21 ✅ 2085 ms (89 iters) ✅ 2096 ms (88 iters) ≈ +0.5% (±2.7%) — / —
future-genetic 25 ✅ 2049 ms (91 iters) ✅ 1946 ms (96 iters) 🟢 -5% — / —
naive-bayes 21 ✅ 1287 ms (133 iters) ✅ 1259 ms (136 iters) ≈ -2.2% (±32.4%) — / —
naive-bayes 25 ✅ 1029 ms (166 iters) ✅ 993 ms (172 iters) ≈ -3.5% (±31.4%) — / —
reactors 21 ✅ 16400 ms (15 iters) ✅ 15831 ms (15 iters) ≈ -3.5% (±7.8%) — / —
reactors 25 ✅ 18850 ms (15 iters) ✅ 18308 ms (15 iters) ≈ -2.9% (±4.9%) — / —
Internal counter details (ddprof)

ddprof internal counters, latest / dev (✅ = 0, · = unavailable):

Benchmark JDK Dropped rec Dropped jvmti Dropped trace Skipped WC AGCT fail Unwind fail
akka-uct 21 ✅ / ✅ ✅ / ✅ 3 / 1 2021 / 2046 ✅ / ✅ ✅ / ✅
akka-uct 25 ✅ / ✅ ✅ / ✅ 2 / 2 2123 / 2088 ✅ / ✅ ✅ / ✅
finagle-chirper 21 ✅ / ✅ ✅ / ✅ 3 / 2 8828 / 8315 ✅ / ✅ ✅ / ✅
finagle-chirper 25 ✅ / ✅ ✅ / ✅ ✅ / 2 8087 / 8732 ✅ / ✅ ✅ / ✅
fj-kmeans 21 ✅ / ✅ ✅ / ✅ ✅ / 1 1261 / 1292 ✅ / ✅ ✅ / ✅
fj-kmeans 25 ✅ / ✅ ✅ / ✅ 2 / 3 1274 / 1274 ✅ / ✅ ✅ / ✅
future-genetic 21 ✅ / ✅ ✅ / ✅ 2 / 2 2888 / 2864 ✅ / ✅ ✅ / ✅
future-genetic 25 ✅ / ✅ ✅ / ✅ ✅ / ✅ 2861 / 2906 ✅ / ✅ ✅ / ✅
naive-bayes 21 ✅ / ✅ ✅ / ✅ 4 / ✅ 3525 / 3525 ✅ / ✅ ✅ / ✅
naive-bayes 25 ✅ / ✅ ✅ / ✅ ✅ / 2 3482 / 3517 ✅ / ✅ ✅ / ✅
reactors 21 ✅ / ✅ ✅ / ✅ ✅ / ✅ 1635 / 1547 ✅ / ✅ ✅ / ✅
reactors 25 ✅ / ✅ ✅ / ✅ ✅ / ✅ 1903 / 1888 ✅ / ✅ ✅ / ✅

@kaahos kaahos added the trivial label Jul 31, 2026
@kaahos
kaahos force-pushed the paul.fournillon/secure-release-bump-auto-merge branch from e9625e0 to 283974e Compare July 31, 2026 23:21
@datadog-official

This comment has been minimized.

@dd-octo-sts

dd-octo-sts Bot commented Jul 31, 2026

Copy link
Copy Markdown
Contributor

Benchmark Results (commit 283974e)

Pipeline: https://gitlab.ddbuild.io/DataDog/apm-reliability/benchmarking-platform/-/pipelines/128377789 Commit: 283974e21bf75a9f787e577d1f321c372e7f0000

✅ Within expected boundaries

No significant runtime deltas (all within run-to-run noise) and no internal-counter outliers.

Runtime details (per benchmark × JDK)
Benchmark JDK Latest Dev Δ (dev vs latest) Issues L/D
akka-uct 21 ✅ 10373 ms (21 iters) ✅ 10341 ms (21 iters) ≈ -0.3% (±11.4%) — / —
akka-uct 25 ✅ 8870 ms (24 iters) ✅ 8970 ms (24 iters) ≈ +1.1% (±10.3%) — / —
finagle-chirper 21 ✅ 6007 ms (33 iters) ✅ 6002 ms (33 iters) ≈ -0.1% (±25.5%) ⚠️ W:3 / ⚠️ W:3
finagle-chirper 25 ✅ 5389 ms (36 iters) ✅ 5455 ms (36 iters) ≈ +1.2% (±23.9%) ⚠️ W:3 / ⚠️ W:3
fj-kmeans 21 ✅ 2708 ms (70 iters) ✅ 2649 ms (71 iters) ≈ -2.2% (±2.6%) — / —
fj-kmeans 25 ✅ 2786 ms (67 iters) ✅ 2844 ms (66 iters) ≈ +2.1% (±2.7%) — / —
future-genetic 21 ✅ 2044 ms (90 iters) ✅ 2045 ms (91 iters) ≈ +0% (±2.5%) — / —
future-genetic 25 ✅ 2024 ms (91 iters) ✅ 2018 ms (91 iters) ≈ -0.3% (±2.7%) — / —
naive-bayes 21 ✅ 1227 ms (138 iters) ✅ 1268 ms (135 iters) ≈ +3.3% (±33.6%) — / —
naive-bayes 25 ✅ 1019 ms (168 iters) ✅ 1012 ms (169 iters) ≈ -0.7% (±31.4%) — / —
reactors 21 ✅ 16723 ms (15 iters) ✅ 16476 ms (15 iters) ≈ -1.5% (±8.4%) — / —
reactors 25 ✅ 18263 ms (15 iters) ✅ 18258 ms (15 iters) ≈ -0% (±5.2%) — / —
Internal counter details (ddprof)

ddprof internal counters, latest / dev (✅ = 0, · = unavailable):

Benchmark JDK Dropped rec Dropped jvmti Dropped trace Skipped WC AGCT fail Unwind fail
akka-uct 21 ✅ / ✅ ✅ / ✅ 3 / ✅ 1960 / 2052 ✅ / ✅ ✅ / ✅
akka-uct 25 ✅ / ✅ ✅ / ✅ 1 / 2 2360 / 2273 ✅ / ✅ ✅ / ✅
finagle-chirper 21 ✅ / ✅ ✅ / ✅ 5 / 3 8808 / 8349 ✅ / ✅ ✅ / ✅
finagle-chirper 25 ✅ / ✅ ✅ / ✅ 1 / 1 8004 / 8546 ✅ / ✅ ✅ / ✅
fj-kmeans 21 ✅ / ✅ ✅ / ✅ 2 / 1 1293 / 1245 ✅ / ✅ ✅ / ✅
fj-kmeans 25 ✅ / ✅ ✅ / ✅ ✅ / ✅ 1287 / 1273 ✅ / ✅ ✅ / ✅
future-genetic 21 ✅ / ✅ ✅ / ✅ 1 / ✅ 3012 / 3016 ✅ / ✅ ✅ / ✅
future-genetic 25 ✅ / ✅ ✅ / ✅ 1 / 1 2819 / 2952 ✅ / ✅ ✅ / ✅
naive-bayes 21 ✅ / ✅ ✅ / ✅ 3 / 5 3499 / 3509 ✅ / ✅ ✅ / ✅
naive-bayes 25 ✅ / ✅ ✅ / ✅ 2 / 4 3490 / 3449 ✅ / ✅ ✅ / ✅
reactors 21 ✅ / ✅ ✅ / ✅ 1 / 1 1813 / 1858 ✅ / ✅ ✅ / ✅
reactors 25 ✅ / ✅ ✅ / ✅ 1 / 2 1800 / 1801 ✅ / ✅ ✅ / ✅

Copilot AI review requested due to automatic review settings August 1, 2026 00:02

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR hardens and unifies the release automation around a single trivial-label approval workflow, and improves release workflow/run correlation to avoid auto-merging the wrong bump commit.

Changes:

  • Adds correlation + SHA-locking between utils/release.sh and release-validated.yml, and introduces an immutable bump manifest artifact consumed by a local finalizer.
  • Replaces the no-review-based auto-approval flow with a trivial-label workflow that authorizes labelers and validates automated bump PRs before approving a specific head SHA.
  • Adds hermetic shell tests + CI job coverage for the release automation scripts.

Reviewed changes

Copilot reviewed 13 out of 13 changed files in this pull request and generated 2 comments.

Show a summary per file
File Description
utils/release.sh Adds workflow-run correlation and post-run bump finalization via downloaded manifest.
utils/README.md Updates documentation to describe the new bump approval/finalization flow and tests.
utils/finalize-release-bump.sh New local finalizer to validate, label, wait for approval/checks, and SHA-lock merge of bump PRs.
.github/workflows/release-validated.yml Adds request/source SHA inputs, SHA-locks checkout, and uploads bump finalization manifest.
.github/workflows/ci.yml Adds a CI job to syntax-check, shellcheck, and run hermetic release automation tests.
.github/workflows/approve-trivial.yml Reworks trivial approval to authorize labelers and validate bump PRs before SHA-pinned approval.
.github/scripts/validate-trivial-approval.sh New validator to authorize who can apply trivial (trusted bots + write/maintain/admin humans).
.github/scripts/validate-release-bump.sh New strict validator for automated bump PRs/branches (refs, SHAs, permissions, and exact version-only diff).
.github/scripts/tests/test_release_automation.sh New hermetic test suite covering validators and key workflow/script invariants.
.github/scripts/release.sh Updates bump PR creation/labeling and pins auto-merge to the validated head SHA; emits outputs for manifest.
.github/dependabot.yml Switches Dependabot auto-approval trigger label from no-review to trivial.
.github/chainguard/self.release-bump.create-pr.sts.yaml Tightens STS claim pattern to the specific workflow ref(s) for bump-PR creation.
.github/chainguard/self.approve-trivial.approve-pr.sts.yaml Expands ref pattern to include protected release/X.Y._ branches (but needs an additional fix).

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Comment thread .github/chainguard/self.approve-trivial.approve-pr.sts.yaml
Comment thread utils/finalize-release-bump.sh Outdated
@dd-octo-sts

dd-octo-sts Bot commented Aug 1, 2026

Copy link
Copy Markdown
Contributor

Benchmark Results (commit 2d30cf4)

Pipeline: https://gitlab.ddbuild.io/DataDog/apm-reliability/benchmarking-platform/-/pipelines/128381417 Commit: 2d30cf4f53f4142efa55ec060548b1663c26ee59

⚠️ Significant outliers

  • 🟢 fj-kmeans (JDK 21): runtime -7% (2828→2630 ms)
  • 🔴 future-genetic (JDK 25): runtime +4.4% (2038→2128 ms)
Runtime details (per benchmark × JDK)
Benchmark JDK Latest Dev Δ (dev vs latest) Issues L/D
akka-uct 21 ✅ 10191 ms (21 iters) ✅ 10290 ms (21 iters) ≈ +1% (±10.7%) — / —
akka-uct 25 ✅ 8822 ms (24 iters) ✅ 8778 ms (24 iters) ≈ -0.5% (±9.8%) — / —
finagle-chirper 21 ✅ 6009 ms (33 iters) ✅ 6074 ms (33 iters) ≈ +1.1% (±25.6%) ⚠️ W:3 / ⚠️ W:3
finagle-chirper 25 ✅ 5415 ms (36 iters) ✅ 5461 ms (36 iters) ≈ +0.8% (±24.4%) ⚠️ W:3 / ⚠️ W:3
fj-kmeans 21 ✅ 2828 ms (66 iters) ✅ 2630 ms (72 iters) 🟢 -7% — / —
fj-kmeans 25 ✅ 2824 ms (66 iters) ✅ 2817 ms (66 iters) ≈ -0.2% (±2.6%) — / —
future-genetic 21 ✅ 2067 ms (89 iters) ✅ 2068 ms (89 iters) ≈ +0% (±2.7%) — / —
future-genetic 25 ✅ 2038 ms (90 iters) ✅ 2128 ms (87 iters) 🔴 +4.4% — / —
naive-bayes 21 ✅ 1239 ms (138 iters) ✅ 1234 ms (138 iters) ≈ -0.4% (±32.6%) — / —
naive-bayes 25 ✅ 1015 ms (168 iters) ✅ 1013 ms (169 iters) ≈ -0.2% (±31.6%) — / —
reactors 21 ✅ 16812 ms (15 iters) ✅ 16385 ms (15 iters) ≈ -2.5% (±7.1%) — / —
reactors 25 ✅ 18495 ms (15 iters) ✅ 18946 ms (15 iters) ≈ +2.4% (±4.5%) — / —
Internal counter details (ddprof)

ddprof internal counters, latest / dev (✅ = 0, · = unavailable):

Benchmark JDK Dropped rec Dropped jvmti Dropped trace Skipped WC AGCT fail Unwind fail
akka-uct 21 ✅ / ✅ ✅ / ✅ ✅ / 1 1928 / 1960 ✅ / ✅ ✅ / ✅
akka-uct 25 ✅ / ✅ ✅ / ✅ 1 / 3 2261 / 2096 ✅ / ✅ ✅ / ✅
finagle-chirper 21 ✅ / ✅ ✅ / ✅ 5 / 2 8816 / 8873 ✅ / ✅ ✅ / ✅
finagle-chirper 25 ✅ / ✅ ✅ / ✅ 3 / 3 8171 / 8224 ✅ / ✅ ✅ / ✅
fj-kmeans 21 ✅ / ✅ ✅ / ✅ 2 / 2 1263 / 1297 ✅ / ✅ ✅ / ✅
fj-kmeans 25 ✅ / ✅ ✅ / ✅ 1 / 2 1265 / 1270 ✅ / ✅ ✅ / ✅
future-genetic 21 ✅ / ✅ ✅ / ✅ 2 / 3 2902 / 2873 ✅ / ✅ ✅ / ✅
future-genetic 25 ✅ / ✅ ✅ / ✅ 3 / 2 2823 / 2963 ✅ / ✅ ✅ / ✅
naive-bayes 21 ✅ / ✅ ✅ / ✅ 4 / 1 3481 / 3505 ✅ / ✅ ✅ / ✅
naive-bayes 25 ✅ / ✅ ✅ / ✅ 2 / 3 3491 / 3517 ✅ / ✅ ✅ / ✅
reactors 21 ✅ / ✅ ✅ / ✅ 2 / 1 1727 / 1737 ✅ / ✅ ✅ / ✅
reactors 25 ✅ / ✅ ✅ / ✅ ✅ / 1 1924 / 1926 ✅ / ✅ ✅ / ✅

Copilot AI review requested due to automatic review settings August 2, 2026 23:35

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 14 out of 14 changed files in this pull request and generated 2 comments.

Suppressed comments (1)

.github/chainguard/self.approve-trivial.approve-pr.sts.yaml:9

  • The STS policy now claims to support release/X.Y._ refs, but job_workflow_ref is still pinned to @refs/heads/main. For pull_request_target events against protected release/* branches, the workflow ref is expected to be that release branch, so token federation may fail and block approvals on release branches.
  event_name: pull_request_target
  ref: refs/heads/(main|release/[0-9]+\.[0-9]+\._)
  ref_protected: "true"
  job_workflow_ref: DataDog/java-profiler/\.github/workflows/approve-trivial\.yml@refs/heads/main

Comment thread utils/release.sh Outdated
Comment thread .github/scripts/release.sh Outdated
Copilot AI review requested due to automatic review settings August 2, 2026 23:41

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 14 out of 14 changed files in this pull request and generated no new comments.

Suppressed comments (2)

.github/scripts/release.sh:6

  • set -x will echo every command (including env-var prefixes like GH_TOKEN=...) into workflow logs. Even if some secrets are masked, STS tokens or other sensitive values may not be, so tracing should be opt-in rather than always-on in release automation.
set -x
set -euo pipefail

.github/scripts/validate-trivial-approval.sh:41

  • If the collaborator permission lookup fails (e.g., actor is not a collaborator / API returns 404), the script currently exits with the raw gh api error output. Catching that failure and emitting a consistent die message makes the approval workflow failure mode clearer and less dependent on gh output formatting.
  command -v gh >/dev/null || die "GitHub CLI (gh) is required"
  PERMISSION=$(gh api "repos/$REPO/collaborators/$ACTOR/permission" --jq '.permission')
fi

Copilot AI review requested due to automatic review settings August 2, 2026 23:53

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot was unable to review this pull request because the user who requested the review has reached their quota limit.

Copilot AI review requested due to automatic review settings August 3, 2026 02:51

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot was unable to review this pull request because the user who requested the review has reached their quota limit.

@dd-octo-sts

dd-octo-sts Bot commented Aug 3, 2026

Copy link
Copy Markdown
Contributor

Benchmark Results (commit 0032640)

Pipeline: https://gitlab.ddbuild.io/DataDog/apm-reliability/benchmarking-platform/-/pipelines/128494089 Commit: 0032640a638f64f4bcb50b72fa0ac60fa5f14913

✅ Within expected boundaries

No significant runtime deltas (all within run-to-run noise) and no internal-counter outliers.

Runtime details (per benchmark × JDK)
Benchmark JDK Latest Dev Δ (dev vs latest) Issues L/D
akka-uct 21 ✅ 10324 ms (21 iters) ✅ 10224 ms (21 iters) ≈ -1% (±10.8%) — / —
akka-uct 25 ✅ 8937 ms (24 iters) ✅ 8805 ms (24 iters) ≈ -1.5% (±10.1%) — / —
finagle-chirper 21 ✅ 5982 ms (33 iters) ✅ 5949 ms (33 iters) ≈ -0.6% (±25.1%) ⚠️ W:3 / ⚠️ W:3
finagle-chirper 25 ✅ 5491 ms (36 iters) ✅ 5483 ms (36 iters) ≈ -0.1% (±24.2%) ⚠️ W:3 / ⚠️ W:3
fj-kmeans 21 ✅ 2724 ms (68 iters) ✅ 2735 ms (68 iters) ≈ +0.4% (±2.8%) — / —
fj-kmeans 25 ✅ 2832 ms (66 iters) ✅ 2838 ms (66 iters) ≈ +0.2% (±2.6%) — / —
future-genetic 21 ✅ 2092 ms (89 iters) ✅ 2037 ms (91 iters) ≈ -2.6% (±2.7%) — / —
future-genetic 25 ✅ 2019 ms (92 iters) ✅ 1993 ms (93 iters) ≈ -1.3% (±2.7%) — / —
naive-bayes 21 ✅ 1276 ms (134 iters) ✅ 1262 ms (135 iters) ≈ -1.1% (±33%) — / —
naive-bayes 25 ✅ 1013 ms (168 iters) ✅ 1003 ms (170 iters) ≈ -1% (±31.6%) — / —
reactors 21 ✅ 15141 ms (15 iters) ✅ 16059 ms (15 iters) ≈ +6.1% (±8.1%) — / —
reactors 25 ✅ 18514 ms (15 iters) ✅ 17974 ms (15 iters) ≈ -2.9% (±4.7%) — / —
Internal counter details (ddprof)

ddprof internal counters, latest / dev (✅ = 0, · = unavailable):

Benchmark JDK Dropped rec Dropped jvmti Dropped trace Skipped WC AGCT fail Unwind fail
akka-uct 21 ✅ / ✅ ✅ / ✅ ✅ / 1 1985 / 1899 ✅ / ✅ ✅ / ✅
akka-uct 25 ✅ / ✅ ✅ / ✅ 3 / 4 2349 / 2254 ✅ / ✅ ✅ / ✅
finagle-chirper 21 ✅ / ✅ ✅ / ✅ 7 / 3 8368 / 8497 ✅ / ✅ ✅ / ✅
finagle-chirper 25 ✅ / ✅ ✅ / ✅ 2 / 1 8529 / 8283 ✅ / ✅ ✅ / ✅
fj-kmeans 21 ✅ / ✅ ✅ / ✅ 2 / 1 1242 / 1274 ✅ / ✅ ✅ / ✅
fj-kmeans 25 ✅ / ✅ ✅ / ✅ ✅ / 3 1315 / 1279 ✅ / ✅ ✅ / ✅
future-genetic 21 ✅ / ✅ ✅ / ✅ 1 / 2 2861 / 3064 ✅ / ✅ ✅ / ✅
future-genetic 25 ✅ / ✅ ✅ / ✅ ✅ / ✅ 2907 / 2931 ✅ / ✅ ✅ / ✅
naive-bayes 21 ✅ / ✅ ✅ / ✅ 7 / 2 3469 / 3548 ✅ / ✅ ✅ / ✅
naive-bayes 25 ✅ / ✅ ✅ / ✅ 3 / 9 3435 / 3469 ✅ / ✅ ✅ / ✅
reactors 21 ✅ / ✅ ✅ / ✅ 1 / ✅ 1524 / 1791 ✅ / ✅ ✅ / ✅
reactors 25 ✅ / ✅ ✅ / ✅ 1 / 2 1910 / 1784 ✅ / ✅ ✅ / ✅

Copilot AI review requested due to automatic review settings August 3, 2026 07:52

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot was unable to review this pull request because the user who requested the review has reached their quota limit.

@dd-octo-sts

dd-octo-sts Bot commented Aug 3, 2026

Copy link
Copy Markdown
Contributor

Benchmark Results (commit ad97bab)

Pipeline: https://gitlab.ddbuild.io/DataDog/apm-reliability/benchmarking-platform/-/pipelines/128517326 Commit: ad97bab04ef6edebd591dadbd36c24f5ec7ec4cf

⚠️ Significant outliers

  • 🟢 fj-kmeans (JDK 21): runtime -4.3% (2762→2644 ms)
Runtime details (per benchmark × JDK)
Benchmark JDK Latest Dev Δ (dev vs latest) Issues L/D
akka-uct 21 ✅ 10253 ms (21 iters) ✅ 10280 ms (21 iters) ≈ +0.3% (±11.2%) — / —
akka-uct 25 ✅ 8975 ms (24 iters) ✅ 8876 ms (24 iters) ≈ -1.1% (±10.3%) — / —
finagle-chirper 21 ✅ 5991 ms (33 iters) ✅ 6056 ms (33 iters) ≈ +1.1% (±25.1%) ⚠️ W:3 / ⚠️ W:5
finagle-chirper 25 ✅ 5447 ms (36 iters) ✅ 5422 ms (36 iters) ≈ -0.5% (±23.7%) ⚠️ W:3 / ⚠️ W:3
fj-kmeans 21 ✅ 2762 ms (68 iters) ✅ 2644 ms (71 iters) 🟢 -4.3% — / —
fj-kmeans 25 ✅ 2786 ms (67 iters) ✅ 2791 ms (67 iters) ≈ +0.2% (±2.5%) — / —
future-genetic 21 ✅ 2054 ms (90 iters) ✅ 2085 ms (89 iters) ≈ +1.5% (±2.6%) — / —
naive-bayes 21 ✅ 1278 ms (134 iters) ✅ 1324 ms (130 iters) ≈ +3.6% (±32.9%) — / —
naive-bayes 25 ✅ 1004 ms (170 iters) ✅ 1010 ms (169 iters) ≈ +0.6% (±31.4%) — / —
reactors 21 ✅ 16184 ms (15 iters) ✅ 15921 ms (15 iters) ≈ -1.6% (±7.4%) — / —
reactors 25 ✅ 18402 ms (15 iters) ✅ 18743 ms (15 iters) ≈ +1.9% (±4.9%) — / —
Internal counter details (ddprof)

ddprof internal counters, latest / dev (✅ = 0, · = unavailable):

Benchmark JDK Dropped rec Dropped jvmti Dropped trace Skipped WC AGCT fail Unwind fail
akka-uct 21 ✅ / ✅ ✅ / ✅ 1 / 2 2037 / 1979 ✅ / ✅ ✅ / ✅
akka-uct 25 ✅ / ✅ ✅ / ✅ 3 / ✅ 2373 / 2236 ✅ / ✅ ✅ / ✅
finagle-chirper 21 ✅ / ✅ ✅ / ✅ 5 / 7 8496 / 8584 ✅ / ✅ ✅ / ✅
finagle-chirper 25 ✅ / ✅ ✅ / ✅ 3 / 1 8594 / 8097 ✅ / ✅ ✅ / ✅
fj-kmeans 21 ✅ / ✅ ✅ / ✅ 3 / 7 1269 / 1302 ✅ / ✅ ✅ / ✅
fj-kmeans 25 ✅ / ✅ ✅ / ✅ 1 / ✅ 1281 / 1331 ✅ / ✅ ✅ / ✅
future-genetic 21 ✅ / ✅ ✅ / ✅ 1 / 1 2920 / 3016 ✅ / ✅ ✅ / ✅
future-genetic 25 ✅ / ✅ ✅ / ✅ ✅ / ✅ 2907 / 2827 ✅ / ✅ ✅ / ✅
naive-bayes 21 ✅ / ✅ ✅ / ✅ 4 / 2 3543 / 3493 ✅ / ✅ ✅ / ✅
naive-bayes 25 ✅ / ✅ ✅ / ✅ 2 / 3 3444 / 3444 ✅ / ✅ ✅ / ✅
reactors 21 ✅ / ✅ ✅ / ✅ 1 / ✅ 1603 / 1525 ✅ / ✅ ✅ / ✅
reactors 25 ✅ / ✅ ✅ / ✅ ✅ / 1 1814 / 1898 ✅ / ✅ ✅ / ✅

Copilot AI review requested due to automatic review settings August 3, 2026 08:45

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot was unable to review this pull request because the user who requested the review has reached their quota limit.

@dd-octo-sts

dd-octo-sts Bot commented Aug 3, 2026

Copy link
Copy Markdown
Contributor

Benchmark Results (commit bce662e)

Pipeline: https://gitlab.ddbuild.io/DataDog/apm-reliability/benchmarking-platform/-/pipelines/128526362 Commit: bce662e4aeb29af21af079738011286c2465af7b

⚠️ Significant outliers

  • 🟢 fj-kmeans (JDK 21): runtime -2.9% (2708→2630 ms)
  • 🟢 future-genetic (JDK 25): runtime -4.6% (2069→1973 ms)
Runtime details (per benchmark × JDK)
Benchmark JDK Latest Dev Δ (dev vs latest) Issues L/D
akka-uct 21 ✅ 10246 ms (21 iters) ✅ 10271 ms (21 iters) ≈ +0.2% (±10.6%) — / —
akka-uct 25 ✅ 8915 ms (24 iters) ✅ 8850 ms (24 iters) ≈ -0.7% (±10.7%) — / —
finagle-chirper 21 ✅ 5900 ms (33 iters) ✅ 5984 ms (33 iters) ≈ +1.4% (±25.9%) ⚠️ W:4 / ⚠️ W:3
finagle-chirper 25 ✅ 5391 ms (36 iters) ✅ 5456 ms (36 iters) ≈ +1.2% (±23.9%) ⚠️ W:3 / ⚠️ W:3
fj-kmeans 21 ✅ 2708 ms (69 iters) ✅ 2630 ms (72 iters) 🟢 -2.9% — / —
fj-kmeans 25 ✅ 2798 ms (67 iters) ✅ 2801 ms (66 iters) ≈ +0.1% (±2.6%) — / —
future-genetic 21 ✅ 2075 ms (89 iters) ✅ 2126 ms (88 iters) ≈ +2.5% (±2.7%) — / —
future-genetic 25 ✅ 2069 ms (89 iters) ✅ 1973 ms (93 iters) 🟢 -4.6% — / —
naive-bayes 21 ✅ 1221 ms (140 iters) ✅ 1311 ms (131 iters) ≈ +7.4% (±33.7%) — / —
naive-bayes 25 ✅ 1024 ms (167 iters) ✅ 1012 ms (168 iters) ≈ -1.2% (±31.5%) — / —
reactors 21 ✅ 17096 ms (15 iters) ✅ 16175 ms (15 iters) ≈ -5.4% (±6.7%) — / —
reactors 25 ✅ 17961 ms (15 iters) ✅ 18585 ms (15 iters) ≈ +3.5% (±5.5%) — / —
Internal counter details (ddprof)

ddprof internal counters, latest / dev (✅ = 0, · = unavailable):

Benchmark JDK Dropped rec Dropped jvmti Dropped trace Skipped WC AGCT fail Unwind fail
akka-uct 21 ✅ / ✅ ✅ / ✅ 1 / ✅ 1907 / 2071 ✅ / ✅ ✅ / ✅
akka-uct 25 ✅ / ✅ ✅ / ✅ 1 / ✅ 2050 / 2222 ✅ / ✅ ✅ / ✅
finagle-chirper 21 ✅ / ✅ ✅ / ✅ 1 / 1 8511 / 8705 ✅ / ✅ ✅ / ✅
finagle-chirper 25 ✅ / ✅ ✅ / ✅ ✅ / ✅ 8244 / 8774 ✅ / ✅ ✅ / ✅
fj-kmeans 21 ✅ / ✅ ✅ / ✅ 2 / 5 1250 / 1288 ✅ / ✅ ✅ / ✅
fj-kmeans 25 ✅ / ✅ ✅ / ✅ 4 / 2 1279 / 1264 ✅ / ✅ ✅ / ✅
future-genetic 21 ✅ / ✅ ✅ / ✅ 3 / 1 2932 / 2991 ✅ / ✅ ✅ / ✅
future-genetic 25 ✅ / ✅ ✅ / ✅ 2 / 1 2835 / 2950 ✅ / ✅ ✅ / ✅
naive-bayes 21 ✅ / ✅ ✅ / ✅ 3 / 6 3482 / 3528 ✅ / ✅ ✅ / ✅
naive-bayes 25 ✅ / ✅ ✅ / ✅ 1 / 2 3480 / 3451 ✅ / ✅ ✅ / ✅
reactors 21 ✅ / ✅ ✅ / ✅ 2 / 4 1696 / 1526 ✅ / ✅ ✅ / ✅
reactors 25 ✅ / ✅ ✅ / ✅ 2 / 3 1631 / 1918 ✅ / ✅ ✅ / ✅

Copilot AI review requested due to automatic review settings August 3, 2026 09:33

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot was unable to review this pull request because the user who requested the review has reached their quota limit.

Copilot AI review requested due to automatic review settings August 3, 2026 09:54

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot was unable to review this pull request because the user who requested the review has reached their quota limit.

@dd-octo-sts

dd-octo-sts Bot commented Aug 3, 2026

Copy link
Copy Markdown
Contributor

Benchmark Results (commit 084c241)

Pipeline: https://gitlab.ddbuild.io/DataDog/apm-reliability/benchmarking-platform/-/pipelines/128533343 Commit: 084c2412e9d5e8564c5cc7f86b1ff064ab6f7c77

⚠️ Significant outliers

  • 🟢 fj-kmeans (JDK 21): runtime -4.7% (2851→2716 ms)
  • 🔴 future-genetic (JDK 21): runtime +3.5% (2071→2143 ms)
Runtime details (per benchmark × JDK)
Benchmark JDK Latest Dev Δ (dev vs latest) Issues L/D
akka-uct 21 ✅ 10334 ms (21 iters) ✅ 10256 ms (21 iters) ≈ -0.8% (±11.4%) — / —
finagle-chirper 21 ✅ 5917 ms (33 iters) ✅ 5960 ms (33 iters) ≈ +0.7% (±25.2%) ⚠️ W:3 / ⚠️ W:3
finagle-chirper 25 ✅ 5464 ms (36 iters) ✅ 5453 ms (36 iters) ≈ -0.2% (±23.9%) ⚠️ W:3 / ⚠️ W:3
fj-kmeans 21 ✅ 2851 ms (66 iters) ✅ 2716 ms (69 iters) 🟢 -4.7% — / —
future-genetic 21 ✅ 2071 ms (89 iters) ✅ 2143 ms (86 iters) 🔴 +3.5% — / —
naive-bayes 21 ✅ 1321 ms (130 iters) ✅ 1228 ms (139 iters) ≈ -7% (±31.5%) — / —
naive-bayes 25 ✅ 1017 ms (168 iters) ✅ 1030 ms (166 iters) ≈ +1.3% (±31.9%) — / —
reactors 21 ✅ 15648 ms (15 iters) ✅ 16223 ms (15 iters) ≈ +3.7% (±7.7%) — / —
reactors 25 ✅ 18663 ms (15 iters) ✅ 18249 ms (15 iters) ≈ -2.2% (±4.8%) — / —
Internal counter details (ddprof)

ddprof internal counters, latest / dev (✅ = 0, · = unavailable):

Benchmark JDK Dropped rec Dropped jvmti Dropped trace Skipped WC AGCT fail Unwind fail
akka-uct 21 ✅ / ✅ ✅ / ✅ 2 / 1 1983 / 1960 ✅ / ✅ ✅ / ✅
akka-uct 25 ✅ / ✅ ✅ / ✅ 1 / ✅ 2560 / 2270 ✅ / ✅ ✅ / ✅
finagle-chirper 21 ✅ / ✅ ✅ / ✅ 2 / 4 8478 / 8364 ✅ / ✅ ✅ / ✅
finagle-chirper 25 ✅ / ✅ ✅ / ✅ 1 / 1 8431 / 8655 ✅ / ✅ ✅ / ✅
fj-kmeans 21 ✅ / ✅ ✅ / ✅ 1 / 6 1299 / 1286 ✅ / ✅ ✅ / ✅
fj-kmeans 25 ✅ / ✅ ✅ / ✅ ✅ / 1 1284 / 1265 ✅ / ✅ ✅ / ✅
future-genetic 21 ✅ / ✅ ✅ / ✅ 2 / 1 2829 / 3037 ✅ / ✅ ✅ / ✅
naive-bayes 21 ✅ / ✅ ✅ / ✅ ✅ / ✅ ✅ / ✅ ✅ / ✅ ✅ / ✅
naive-bayes 25 ✅ / ✅ ✅ / ✅ 1 / 1 3476 / 3478 ✅ / ✅ ✅ / ✅
reactors 21 ✅ / ✅ ✅ / ✅ 1 / ✅ 1483 / 1685 ✅ / ✅ ✅ / ✅
reactors 25 ✅ / ✅ ✅ / ✅ 1 / ✅ 1923 / 1750 ✅ / ✅ ✅ / ✅

Copilot AI review requested due to automatic review settings August 3, 2026 10:09

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot was unable to review this pull request because the user who requested the review has reached their quota limit.

@dd-octo-sts

dd-octo-sts Bot commented Aug 3, 2026

Copy link
Copy Markdown
Contributor

Benchmark Results (commit 257eb8c)

Pipeline: https://gitlab.ddbuild.io/DataDog/apm-reliability/benchmarking-platform/-/pipelines/128539630 Commit: 257eb8cc86b722f0f5d5776ec5e303bb053368c6

✅ Within expected boundaries

No significant runtime deltas (all within run-to-run noise) and no internal-counter outliers.

Runtime details (per benchmark × JDK)
Benchmark JDK Latest Dev Δ (dev vs latest) Issues L/D
akka-uct 21 ✅ 10306 ms (21 iters) ✅ 10077 ms (21 iters) ≈ -2.2% (±10.2%) — / —
akka-uct 25 ✅ 8884 ms (24 iters) ✅ 8905 ms (24 iters) ≈ +0.2% (±9.4%) — / —
finagle-chirper 21 ✅ 6002 ms (33 iters) ✅ 6012 ms (33 iters) ≈ +0.2% (±24.8%) ⚠️ W:4 / ⚠️ W:3
finagle-chirper 25 ✅ 5471 ms (36 iters) ✅ 5440 ms (36 iters) ≈ -0.6% (±24.4%) ⚠️ W:3 / ⚠️ W:3
fj-kmeans 21 ✅ 2734 ms (68 iters) ✅ 2676 ms (69 iters) ≈ -2.1% (±2.6%) — / —
fj-kmeans 25 ✅ 2830 ms (66 iters) ✅ 2757 ms (68 iters) ≈ -2.6% (±2.7%) — / —
future-genetic 21 ✅ 2079 ms (89 iters) ✅ 2115 ms (89 iters) ≈ +1.7% (±2.5%) — / —
future-genetic 25 ✅ 2028 ms (92 iters) ✅ 2035 ms (91 iters) ≈ +0.3% (±2.7%) — / —
naive-bayes 21 ✅ 1250 ms (137 iters) ✅ 1261 ms (136 iters) ≈ +0.9% (±32.8%) — / —
naive-bayes 25 ✅ 1009 ms (169 iters) ✅ 1015 ms (169 iters) ≈ +0.6% (±31.7%) — / —
reactors 21 ✅ 17148 ms (15 iters) ✅ 16451 ms (15 iters) ≈ -4.1% (±9%) — / —
reactors 25 ✅ 18620 ms (15 iters) ✅ 18709 ms (14 iters) ≈ +0.5% (±4.2%) — / —
Internal counter details (ddprof)

ddprof internal counters, latest / dev (✅ = 0, · = unavailable):

Benchmark JDK Dropped rec Dropped jvmti Dropped trace Skipped WC AGCT fail Unwind fail
akka-uct 21 ✅ / ✅ ✅ / ✅ 2 / 1 1980 / 2045 ✅ / ✅ ✅ / ✅
akka-uct 25 ✅ / ✅ ✅ / ✅ 1 / 2 2244 / 2353 ✅ / ✅ ✅ / ✅
finagle-chirper 21 ✅ / ✅ ✅ / ✅ 3 / 2 8276 / 8232 ✅ / ✅ ✅ / ✅
finagle-chirper 25 ✅ / ✅ ✅ / ✅ ✅ / 2 8677 / 8587 ✅ / ✅ ✅ / ✅
fj-kmeans 21 ✅ / ✅ ✅ / ✅ 2 / 6 1234 / 1263 ✅ / ✅ ✅ / ✅
fj-kmeans 25 ✅ / ✅ ✅ / ✅ 3 / 2 1273 / 1295 ✅ / ✅ ✅ / ✅
future-genetic 21 ✅ / ✅ ✅ / ✅ 3 / 7 2968 / 3024 ✅ / ✅ ✅ / ✅
future-genetic 25 ✅ / ✅ ✅ / ✅ ✅ / ✅ 2856 / 2895 ✅ / ✅ ✅ / ✅
naive-bayes 21 ✅ / ✅ ✅ / ✅ 5 / 4 3526 / 3541 ✅ / ✅ ✅ / ✅
naive-bayes 25 ✅ / ✅ ✅ / ✅ 2 / 4 3469 / 3476 ✅ / ✅ ✅ / ✅
reactors 21 ✅ / ✅ ✅ / ✅ 2 / 1 1837 / 1690 ✅ / ✅ ✅ / ✅
reactors 25 ✅ / ✅ ✅ / ✅ ✅ / ✅ 1886 / 1592 ✅ / ✅ ✅ / ✅

@kaahos
kaahos merged commit f53b6f7 into main Aug 3, 2026
107 checks passed
@kaahos
kaahos deleted the paul.fournillon/secure-release-bump-auto-merge branch August 3, 2026 11:16
@github-actions github-actions Bot added this to the 1.49.0 milestone Aug 3, 2026
kaahos added a commit that referenced this pull request Aug 3, 2026
* fix: secure release bump auto-merge

* fix: correct release STS workflow claim

* fix: automate secure release bump merge

* fix: satisfy release automation shellcheck

* fix: harden release automation logging

* fix: gate release bump merges on approval and CI

* test: silence intentional shellcheck literals

* test: avoid shellcheck suppressions

* fix: parse paginated GitHub API responses

* fix: support initial patch releases

* test: fix release automation shellcheck

* chore: remove added copyright headers
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants