Skip to content

add test UFC with 10,000 flags, matching test cases and validation - #139

Draft
leoromanovsky wants to merge 10 commits into
mainfrom
lr/very-large-flag
Draft

add test UFC with 10,000 flags, matching test cases and validation#139
leoromanovsky wants to merge 10 commits into
mainfrom
lr/very-large-flag

Conversation

@leoromanovsky

@leoromanovsky leoromanovsky commented Oct 29, 2025

Copy link
Copy Markdown
Member

Motivation

Our current test suite contains 19 flags with carefully crafted test cases. While excellent for functional testing, we need to validate SDK performance and correctness at scale to ensure production readiness with enterprise customers who may have 1,000+ feature flags.

Generated tests supplement (not replace) existing hand-crafted tests

👉 Hand-crafted tests in ufc/tests/ remain the canonical demonstrations of SDK functionality

Changes

  1. Flag Generator (generate-flags.ts)
  • TypeScript CLI tool that generates realistic large-scale flag configurations
  • Configurable output: 1 to 10,000 flags with custom output directories
  • Realistic targeting: Geographic, demographic, technical attribute rules
  • All variation types: STRING, INTEGER, BOOLEAN, NUMERIC, JSON
  • Complex operators: ONE_OF, MATCHES, LT/GT comparisons, IS_NULL
  • Traffic allocation: Proper shard-based A/B testing setup

npx ts-node generate-flags.ts 2000 ufc/ # Generate 2K flags

@leoromanovsky leoromanovsky changed the title add test UFC with 2,000 flags, matching test cases and validation add test UFC with 10,000 flags, matching test cases and validation Oct 29, 2025
@leoromanovsky
leoromanovsky marked this pull request as ready for review October 29, 2025 18:29
@leoromanovsky
leoromanovsky marked this pull request as draft October 30, 2025 00:00
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant