[feature][bugfix] Multiple fixes and improvements #2

IvanOgurchenok · 2025-12-26T11:35:02Z

Summary

Major improvements to VM provisioning, cluster creation workflow, and module configuration.

✨ Features

VM Provisioning

Cloud-init via Secret — config stored in K8s Secret (bypasses 2048 byte limit)
Parallel VM status check — all VMs checked concurrently with progress ⏳ VMs ready: 3/5
Data disk support — optional dataDiskSize for additional VirtualDisk
TrustIfExists for images — reuse existing ClusterVirtualImages across test runs
Kubectl aliases — k=kubectl with completion via /etc/profile.d/

SSH & Bootstrap

Bootstrap SSH key — temp key for dhctl, user key for VM connections
SSH passphrase caching — avoid repeated prompts

Worker Management

Parallel worker bootstrap — concurrent with progress [N/M]
Masters sequential — etcd quorum requirement

Configuration

SKIP_VIRTUALIZATION_CHECK — env var to skip module readiness check
Webhook retry constants — configurable WebhookRetryAttempts=10

🐛 Bug Fixes

Webhook retry — fixes "connection refused" on module apply when webhook not ready
Hostname check removed — DVP sets hostname correctly from VM name
Kernel versions — updated to match actual cloud images

…ith environment variable validation for CLUSTER_CREATE_MODE. Update README with usage instructions and remove obsolete flag handling code.

…use the specified remote port directly. Adjust cluster creation tests to validate the local port is exactly 6445.

… creation tests

…template in images.go; refine cluster_config.yml comments

…r YAML filename and SSH parameters, improving readability and maintainability.

…, introducing new variables for namespace, storage class, and cleanup options. Update related validation logic and adjust cluster creation tests accordingly.

…adding checks in BeforeAll hooks. Update documentation comments for KubeConfigPath and TestClusterCreateMode to indicate test failure conditions if not set.

…tailed descriptions of test types, required environment variables, and instructions for running tests.

…es and finalize sections. Update cluster interface by commenting out unused VirtualizationClient. Correct typo in cluster_config.yml comments for worker nodes configuration.

… for connections through a jump host. Update error messages in environment validation to reflect correct variable names. Improve VM name extraction logic to comply with RFC 1123 rules and add new functions for obtaining setup node and VM IP address. Update cluster configuration in tests to reflect new OS types and improve cleanup logic in test suite.

…rap. Docker installation works.

…ated and deleted successfully

…U core allocation. Update related YAML parsing and VM creation logic to support this new field. Implement devBranch extraction from bootstrap config and add BootstrapCluster function for cluster initialization. Update test configurations to include coreFraction values and improve logging during cluster bootstrap process.

…ented.

…erHealth - 1

…gured!

…ovide a link to the tests README

- Add TrustIfExists option for ClusterVirtualImages to reuse existing images - Add DataDiskSize option for VMs to create additional data disk - Add SKIP_VIRTUALIZATION_CHECK env to skip virtualization module check - Cache SSH passphrase after first input to avoid repeated prompts - Check all VMs in parallel during Step 5.1 instead of sequentially - Add documentation for new options in config files and README Signed-off-by: Ivan Ogurchenok <ivan.ogurchenok@flant.com>

- Store cloud-init config in Secret (bypass 2048 byte userData limit) - Use user SSH key for VM connections, bootstrap key only for dhctl upload - Add VerifyVMConfig to check/fix VM hostname after creation - Add SecretClient for virtualization API - Rename secret to e2e-cloudinit-{namespace}-{config} for clarity - Update README with cloud-init secret documentation Signed-off-by: Ivan Ogurchenok <ivan.ogurchenok@flant.com>

leave a comment about it. Signed-off-by: Ivan Ogurchenok <ivan.ogurchenok@flant.com>

- Add parallel worker bootstrapping with mutex-protected progress output - Add execWithWebhookRetry with configurable retry constants - Add kubectl aliases (k=kubectl) to cloud-init via /etc/profile.d/ - Update kernel versions in images.go to match actual cluster values Signed-off-by: Ivan Ogurchenok <ivan.ogurchenok@flant.com>

mrwesadex-flant added 30 commits December 12, 2025 15:18

Initial commit

f8041db

Flags and env.go have been added

66a3f5a

Structure a bit updated

0ed3795

kubeconfig is finally obtained and stored in temp

704011f

ssh tunnel established to the base cluster's master

d768fd3

Ginkgo logging enabled and pre-configured

0d50870

module,mc and mpo processing added

8539b17

Cleanup re-worked

6c12003

Context updated

914f26b

Refactor cluster creation configuration: replace flag-based options w…

25416e2

…ith environment variable validation for CLUSTER_CREATE_MODE. Update README with usage instructions and remove obsolete flag handling code.

Remove unused FindFreePort function and update EstablishSSHTunnel to …

5d8b77a

…use the specified remote port directly. Adjust cluster creation tests to validate the local port is exactly 6445.

Update README and add RedOS images configuration; created new cluster…

ce8b988

… creation tests

Add AutoGenerateVMNames environment variable and update cloud-config …

ff1a9a6

…template in images.go; refine cluster_config.yml comments

Creating and waiting for VMs - implemented

f7f8cce

Add virtualization client creation in cluster creation tests

a5c7efe

VMs have been deployed successfully

69f2193

Refactoring and TODOs implementations

7acc7fb

Refactor cluster creation tests to use direct configuration access fo…

52e4d84

…r YAML filename and SSH parameters, improving readability and maintainability.

Refactor environment variable handling for test cluster configuration…

e07adaf

…, introducing new variables for namespace, storage class, and cleanup options. Update related validation logic and adjust cluster creation tests accordingly.

Enhance environment variable validation in cluster creation tests by …

da33597

…adding checks in BeforeAll hooks. Update documentation comments for KubeConfigPath and TestClusterCreateMode to indicate test failure conditions if not set.

Update README.md to enhance documentation for E2E tests, including de…

e2c3e4e

…tailed descriptions of test types, required environment variables, and instructions for running tests.

Refactor TODO.md for clarity and completeness; remove redundant entri…

cf52d51

…es and finalize sections. Update cluster interface by commenting out unused VirtualizationClient. Correct typo in cluster_config.yml comments for worker nodes configuration.

Setup VM is now added by default with Ubuntu, remove after the bootst…

412d47a

…rap. Docker installation works.

Update readme, refactored cleanup, setup node processing, VMs are cre…

0f13b67

…ated and deleted successfully

Bootstrap worked

964b1cb

Re-establishing ssh tunnel to remove bootstrap VM

f14dba5

Connection to test cluster established and simple health check implem…

fcda22a

…ented.

Removed unneded interfaces, added stress-tests and fix for CheckClust…

4cabc30

…erHealth - 1

mrwesadex-flant and others added 18 commits December 19, 2025 12:22

Removed 3par...

2068852

Cluster is now deployed and checked.

21f4d55

Migration to Deckhouse entirely

82b77d7

Nodes are added, modules are not enabled yet

f209e54

Storage class envvar is now required, readm updated

7b56019

kubectl path problem fixed

0286ad4

Cluster has been deployed successfully with modules enabled and confi…

1fbd195

…gured!

test-template has been created

d983137

README for test-template - added

c987d60

Update README.md to reflect changes in test suite instructions and pr…

766ecf7

…ovide a link to the tests README

test-template createcluster fix

b006591

Cleanup logging fix

552b52a

envvar output improved a bit

ae80517

virtualization check is disabled

5515e41

removed hostname check DVP set up is as expected.

c57ad77

leave a comment about it. Signed-off-by: Ivan Ogurchenok <ivan.ogurchenok@flant.com>

Base automatically changed from make-it-working to main January 21, 2026 07:52

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[feature][bugfix] Multiple fixes and improvements #2

[feature][bugfix] Multiple fixes and improvements #2

Uh oh!

IvanOgurchenok commented Dec 26, 2025 •

edited

Loading

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

[feature][bugfix] Multiple fixes and improvements #2

Are you sure you want to change the base?

[feature][bugfix] Multiple fixes and improvements #2

Uh oh!

Conversation

IvanOgurchenok commented Dec 26, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Summary

✨ Features

VM Provisioning

SSH & Bootstrap

Worker Management

Configuration

🐛 Bug Fixes

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

IvanOgurchenok commented Dec 26, 2025 •

edited

Loading