Bump Cli-testing to 1.3.0, update kafka libraries by SylvainSenechal · Pull Request #2341 · scality/Zenko

SylvainSenechal · 2026-03-02T16:23:10Z

Bump cli testing to 1.3.0 => Breaking changes around the keycloak seeder, so updates a few things related to that
Update node runner to 24
Update cucumber version from 10.x to 12.x
Update kubernetes client from 0.2 to 1.4...
Kafka libraries : align all kafka interactions on the new platformatic/kafka : drop kafkajs, drop node-rdkafka (and drop the annoying node-gyp that was needed for node-rdkafka, which was always causing weird python warnings when installing). => This new kafka library is compatible with Bunm unlike the previous ones, so later we can investigate if using Bun is worth it (I believe it is 🌚 ), before that we could'nt even try because of this lib

Ended up adding some extra stuff as I was testing my changes in Codespace and found a few stuff bothering me. I think the pr is still not too hard to review.

Can review commit by commit too

bert-e · 2026-03-02T16:23:14Z

Hello sylvainsenechal,

My role is to assist you with the merge of this
pull request. Please type @bert-e help to get information
on this process, or consult the user documentation.

Available options

name	description	privileged	authored
`/after_pull_request`	Wait for the given pull request id to be merged before continuing with the current one.
`/bypass_author_approval`	Bypass the pull request author's approval	⭐
`/bypass_build_status`	Bypass the build and test status	⭐
`/bypass_commit_size`	Bypass the check on the size of the changeset `TBA`	⭐
`/bypass_incompatible_branch`	Bypass the check on the source branch prefix	⭐
`/bypass_jira_check`	Bypass the Jira issue check	⭐
`/bypass_peer_approval`	Bypass the pull request peers' approval	⭐
`/bypass_leader_approval`	Bypass the pull request leaders' approval	⭐
`/approve`	Instruct Bert-E that the author has approved the pull request.		✍️
`/create_pull_requests`	Allow the creation of integration pull requests.
`/create_integration_branches`	Allow the creation of integration branches.
`/no_octopus`	Prevent Wall-E from doing any octopus merge and use multiple consecutive merge instead
`/unanimity`	Change review acceptance criteria from `one reviewer at least` to `all reviewers`
`/wait`	Instruct Bert-E not to run until further notice.

Available commands

name	description	privileged
`/help`	Print Bert-E's manual in the pull request.
`/status`	Print Bert-E's current status in the pull request `TBA`
`/clear`	Remove all comments from Bert-E from the history `TBA`
`/retry`	Re-start a fresh build `TBA`
`/build`	Re-start a fresh build `TBA`
`/force_reset`	Delete integration branches & pull requests, and restart merge process from the beginning.
`/reset`	Try to remove integration branches unless there are commits on them which do not appear on the source branch.

Status report is not available.

bert-e · 2026-03-02T16:23:20Z

Incorrect fix version

The Fix Version/s in issue ZENKO-5203 contains:

None

Considering where you are trying to merge, I ignored possible hotfix versions and I expected to find:

2.14.0

Please check the Fix Version/s of ZENKO-5203, or the target
branch of this pull request.

Issue: Zenko-5203

Issue: ZENKO-5203

…file Issue: ZENKO-5203

Issue: ZENKO-5203

…2.7.0 Issue: ZENKO-5203

Issue: ZENKO-5203

bert-e · 2026-03-11T15:01:41Z

Incorrect fix version

The Fix Version/s in issue ZENKO-5203 contains:

None

Considering where you are trying to merge, I ignored possible hotfix versions and I expected to find:

2.14.1

Please check the Fix Version/s of ZENKO-5203, or the target
branch of this pull request.

Issue: ZENKO-5203

…ibraries Issue: ZENKO-5203

…e DLQ was ~250 in the tests, stopping sorbetclt from restoring objects Issue: ZENKO-5203

…rs instead of sleep Issue: ZENKO-5203

Issue: ZENKO-5203

…prove debugging Issue: ZENKO-5203

Issue: ZENKO-5203

SylvainSenechal · 2026-03-11T15:12:21Z

tests/ctst/package.json

    "build": "tsc --build tsconfig.json",
    "lint": "eslint ."
+  },
+  "resolutions": {


related to issues newer azure libraries : https://scality.atlassian.net/browse/ZENKO-5213

SylvainSenechal · 2026-03-11T15:15:02Z

tests/ctst/steps/utils/utils.ts

This was an infinite loop, although catched by global test timeout, still nicer to properly control while loops

SylvainSenechal · 2026-03-11T15:15:46Z

tests/ctst/steps/utils/kubernetes.ts

These are all small syntax changes because I did a huge bump of the kubernetes client from version 0.x to 1.4.0

SylvainSenechal · 2026-03-11T15:18:04Z

tests/ctst/steps/utils/kafka.ts

+ * new `putBucketNotificationConfiguration` to the connector before the
+ * test proceeds to trigger events.
+ */ 
+export async function waitForBucketInConnectorPipeline(


Used in bucket notification : Before, we were doing

putBucketNotificationConfiguration

sleep for 10sec and pray the oplog has picked up the change and updated kafka connector.

It was risky, because triggering the notification event before kafka connector was setup would imply the notification would never be sent

Now we detect the kafka connector is really setup.

I'm kinda sad though : I thought this would fix bucket notif flaky, but it doesn't, so there are other things to check

SylvainSenechal · 2026-03-11T15:19:18Z

tests/ctst/steps/bucket-policies/common.ts

            assert.strictEqual(this.getResult().err?.includes('AccessDenied') ||
-                this.getResult().err?.includes('403'), true);
+                this.getResult().err?.includes('403')||
+                this.getResult().statusCode === 403, true);


For some reason, I got issues with this part not catching the 403 anymore.
Not fully sure why, but with the bump of the cli testing, the version of the sdk has increased quite a lot, from ~3.900 to ~3.100, maybe something changed I don't know

SylvainSenechal · 2026-03-11T15:20:41Z

tests/ctst/features/azureArchive.feature

-    Given that lifecycle is "resumed" for the "e2e-azure-archive" location
-    Then object "obj-1" should be "transitioning" and have the storage class "e2e-azure-archive"
-    And object "obj-2" should be "transitioning" and have the storage class "e2e-azure-archive"
+# This test is flaky, and doesn't make much sense as it is :


@francoisferrand Let's discuss this. I only commented for now, maybe we wanna keep it ?

But looking at the test it doesnt make much sense (cf the comment I added in the code).
But at the same time I feel like I'm missing something, there must be a reason why this test was created

SylvainSenechal · 2026-03-11T15:21:40Z

tests/ctst/common/hooks.ts

    cleanupAccount,
 } from './utils';

+import 'cli-testing/hooks/KeycloakSetup';


We have BeforeAll in Cli-testing, no import => they are not run
Imo should be in this repo but its a story for another day

SylvainSenechal · 2026-03-11T15:22:13Z

.github/scripts/end2end/run-e2e-ctst.sh

 POD_NAME="${ZENKO_NAME}-ctst-tests"
 CTST_VERSION=$(sed 's/.*"cli-testing": ".*#\(.*\)".*/\1/;t;d' ../../../tests/ctst/package.json)

-# Configure keycloak


Seed keycloak is now done in a before all from Cli-testing

SylvainSenechal · 2026-03-11T15:25:23Z

tests/ctst/common/common.ts

 import { safeJsonParse } from './utils';
 import assert from 'assert';
-import { Admin, Kafka } from 'kafkajs';
+import { Admin } from '@platformatic/kafka';


Switched the kafka library
Before we were using kafkajs, and node-rdkafka.

These internally relied on librdkafka, a C library. Because of that, we needed to setup quite a few extra stuff to make them work : node-gyp (which was throwing weird python errors when doing yarn install in the Codespace), and also need a bunch of things to be installed in the dockerfile (you'll see later in the pr, librd-XXX).
Now this library is pure js, it removes some dependency, and also it will be compatible with Bun if we wanna use it later

SylvainSenechal · 2026-03-11T15:26:42Z

tests/ctst/steps/azureArchive.ts

        const tarName = await isObjectRehydrated(this, objectName);
        assert(tarName);
-        await AzureHelper.sendBlobCreatedEventToQueue(
+        const sent = await AzureHelper.sendBlobCreatedEventToQueue(


Lost crazy amount of time on this :
sendBlobCreatedEventToQueue was erroring, the error wasn't thrown but instead the function return a boolean that was never checked -_-

SylvainSenechal force-pushed the improvement/ZENKO-5203 branch 7 times, most recently from 50ff85e to b441c6e Compare March 4, 2026 09:49

SylvainSenechal added 11 commits March 11, 2026 15:50

use node 24 for ctst linting step

9f68638

Issue: Zenko-5203

use new platformatic kafka lib for ctst

c5d3414

Issue: ZENKO-5203

replace kafkajs library with platformatic kafka

849aaee

Issue: ZENKO-5203

remove node gyp following removal of node rd kafka

fb4e81e

Issue: ZENKO-5203

remove useless tools previously used for node rd kafka in ctst docker…

d0fb059

…file Issue: ZENKO-5203

bump cucumber to 12.7

9f9495c

Issue: ZENKO-5203

bump node image to 24 in ctst dockerfile following cucumber bump to 1…

44e2bf5

…2.7.0 Issue: ZENKO-5203

bump kubernetes client to 1.4.0

3d50cfa

Issue: ZENKO-5203

bump cli-testing to 1.3.0

33081dd

Issue: ZENKO-5203

seed keycloak from cli testing before all following 1.3.0 bump

e5225c0

Issue: ZENKO-5203

update cucumber formatter

19a37e3

Issue: ZENKO-5203

SylvainSenechal force-pushed the improvement/ZENKO-5203 branch from b441c6e to b0358e1 Compare March 11, 2026 15:01

SylvainSenechal added 8 commits March 11, 2026 16:10

fix infinite loop on verify object location

1665367

Issue: ZENKO-5203

fix 403 auth check

b768dbc

Issue: ZENKO-5203

add missing cold storage tag to test

eef65ad

Issue: ZENKO-5203

pin azure core client following issues with mismatched azure client l…

e5bc301

…ibraries Issue: ZENKO-5203

increase sorbetclt limit to 1000 from default 100, as it was found th…

b7e09d3

…e DLQ was ~250 in the tests, stopping sorbetclt from restoring objects Issue: ZENKO-5203

increase notification test reliability by checking for kafka connecto…

e0d1c76

…rs instead of sleep Issue: ZENKO-5203

remove useless azure archive test

6ab442b

Issue: ZENKO-5203

improve uniqueness of object names in tests to avoid collision and im…

f603b08

…prove debugging Issue: ZENKO-5203

add cucumber extension to codespace

e39e7a2

Issue: ZENKO-5203

SylvainSenechal force-pushed the improvement/ZENKO-5203 branch from b0358e1 to e39e7a2 Compare March 11, 2026 15:10

SylvainSenechal commented Mar 11, 2026

View reviewed changes

Conversation

SylvainSenechal commented Mar 2, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

bert-e commented Mar 2, 2026

Hello sylvainsenechal,

Uh oh!

bert-e commented Mar 2, 2026

Incorrect fix version

Uh oh!

bert-e commented Mar 11, 2026

Incorrect fix version

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

SylvainSenechal commented Mar 2, 2026 •

edited

Loading