WIP: Ballista Text User Interface app by martin-g · Pull Request #1433 · apache/datafusion-ballista

martin-g · 2026-01-31T13:34:25Z

Which issue does this PR close?

Part of #1396.

Rationale for this change

See #1396

What changes are included in this PR?

Initial version of the TUI app that includes:

new Cargo feature tui to include it as part of the CLI app
New CLI option --tui to start the TUI app
Header navigation (Dashboard, Jobs, Metrics)
Help popup (activate with ? or h)
Dashboard view (scheduler state and executors info)
Placeholder for the Jobs and Metrics views
Yaml configuration
- hardcoded defaults
- OS specific config (e.g. ~/.config/ballista-tui/config.yaml)
- env variables, e.g. BALLISTA_TUI_HTTP_TIMEOUT=3000

Are there any user-facing changes?

New option for the CLI application, --tui that starts the TUI application

Signed-off-by: Martin Tzvetanov Grigorov <mgrigorov@apache.org>

Navigate to each one with: 'd', 'j' and 'm' keys respetively Signed-off-by: Martin Tzvetanov Grigorov <mgrigorov@apache.org>

Signed-off-by: Martin Tzvetanov Grigorov <mgrigorov@apache.org>

Remove obsolete functionality (search). Update the help popup window contents. Signed-off-by: Martin Tzvetanov Grigorov <mgrigorov@apache.org>

martin-g · 2026-01-31T13:36:19Z

The Dashboard view:

The help popup:

Signed-off-by: Martin Tzvetanov Grigorov <mgrigorov@apache.org>

milenkovicm · 2026-01-31T15:12:25Z

would it make sense to switch from CLI to TUI? would it be possible to have \tui command which would switch for SQL to cluster management?

milenkovicm · 2026-01-31T15:14:45Z

+    pub(crate) fn new() -> Result<Self, ConfigError> {
+        let config_dir = dirs::config_dir()
+            .unwrap_or_else(|| dirs::home_dir().unwrap().join(".config"))
+            .join("ballista-tui");


can we keep it as ballista-cli?

How about just ballista ?
And then use cli and/or tui as a parent node in the config.

This way the same config file could be used to provide the defaults for the whole cli+tui app and maybe even for the scheduler and executors later. AFAIS the cli app starts a scheduler and executor if host+port are not provided.

martin-g · 2026-01-31T15:24:29Z

would it make sense to switch from CLI to TUI? would it be possible to have \tui command which would switch for SQL to cluster management?

I think it should be possible!
Yet another option is to provide the CLI functionality as an additional tab in the TUI.

andygrove · 2026-01-31T15:26:30Z

+ _               _                    _
+| \  _. _|_  _. |_     _ o  _  ._    |_)  _. | | o  _ _|_  _.
+|_/ (_|  |_ (_| | |_| _> | (_) | |   |_) (_| | | | _>  |_ (_|
+"#;


Could we have capital 'F' in DataFusion

I think it is capital. Let me experiment with some other text banner

martin-g · 2026-01-31T16:36:14Z

would it make sense to switch from CLI to TUI? would it be possible to have \tui command which would switch for SQL to cluster management?

implemented with 3b289d9

Bumps [actions/checkout](https://github.com/actions/checkout) from 5.0.1 to 6.0.2. - [Release notes](https://github.com/actions/checkout/releases) - [Commits](actions/checkout@v5.0.1...v6.0.2) --- updated-dependencies: - dependency-name: actions/checkout dependency-version: 6.0.2 dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

…pache#1400) * Cluster RPC customizations to support TLS and custom headers * Add TLS support to scheduler flight proxy service - Update BallistaFlightProxyService to accept use_tls and customize_endpoint parameters - Add use_tls field to SchedulerConfig with with_use_tls() builder method - Unify EndpointOverrideFn type across crates to use ballista_core::extension definition - Update flight proxy to use https/http scheme based on TLS configuration - Apply custom endpoint configuration for TLS certificate setup

Bumps [tonic-prost-build](https://github.com/hyperium/tonic) from 0.14.2 to 0.14.3. - [Release notes](https://github.com/hyperium/tonic/releases) - [Changelog](https://github.com/hyperium/tonic/blob/master/CHANGELOG.md) - [Commits](hyperium/tonic@v0.14.2...v0.14.3) --- updated-dependencies: - dependency-name: tonic-prost-build dependency-version: 0.14.3 dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

Bumps [tonic-prost](https://github.com/hyperium/tonic) from 0.14.2 to 0.14.3. - [Release notes](https://github.com/hyperium/tonic/releases) - [Changelog](https://github.com/hyperium/tonic/blob/master/CHANGELOG.md) - [Commits](hyperium/tonic@v0.14.2...v0.14.3) --- updated-dependencies: - dependency-name: tonic-prost dependency-version: 0.14.3 dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

Bumps [tonic](https://github.com/hyperium/tonic) from 0.14.2 to 0.14.3. - [Release notes](https://github.com/hyperium/tonic/releases) - [Changelog](https://github.com/hyperium/tonic/blob/master/CHANGELOG.md) - [Commits](hyperium/tonic@v0.14.2...v0.14.3) --- updated-dependencies: - dependency-name: tonic dependency-version: 0.14.3 dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

lint

Signed-off-by: Martin Tzvetanov Grigorov <mgrigorov@apache.org>

… coalescing (apache#1431)

martin-g · 2026-02-01T21:27:22Z

There was a strange merge conflict in Cargo.toml and I rebased the PR to main but then its Git history got messed up ...
Opening a new PR: #1436

martin-g added 12 commits January 26, 2026 21:11

Initial version

413dc47

Fix the build

d342df7

Signed-off-by: Martin Tzvetanov Grigorov <mgrigorov@apache.org>

Add the main frames: dashboard, jobs and metrics

b05b688

Navigate to each one with: 'd', 'j' and 'm' keys respetively Signed-off-by: Martin Tzvetanov Grigorov <mgrigorov@apache.org>

Load some dummy data asynchronously for the Dashboard frame

6e8c0b5

Signed-off-by: Martin Tzvetanov Grigorov <mgrigorov@apache.org>

Render the scheduler state info in the Dashboard view

c1f4035

Introduce HttpClient and logging (not working)

f4f02eb

Fix logging into a file. Load the Dashboard data on app startup

b995ab7

Signed-off-by: Martin Tzvetanov Grigorov <mgrigorov@apache.org>

Decrease the area for the scheduler state data

26b88b4

Signed-off-by: Martin Tzvetanov Grigorov <mgrigorov@apache.org>

Show executors in the Dashboard

da8b5e6

Signed-off-by: Martin Tzvetanov Grigorov <mgrigorov@apache.org>

Use "config" crate to load the app configuration from file and env vars

0226f58

Move the TUI app from ballista-tui to ballista-cli

3a28dde

Signed-off-by: Martin Tzvetanov Grigorov <mgrigorov@apache.org>

Add ASFv2 licences

b540306

Remove obsolete functionality (search). Update the help popup window contents. Signed-off-by: Martin Tzvetanov Grigorov <mgrigorov@apache.org>

martin-g added 9 commits January 31, 2026 16:01

Remove obsolete files

0391ef1

Signed-off-by: Martin Tzvetanov Grigorov <mgrigorov@apache.org>

Extract a helper function for loading the dashboard data

6522478

Signed-off-by: Martin Tzvetanov Grigorov <mgrigorov@apache.org>

Simplify the code for detecting the active nav tab

4cedc83

Signed-off-by: Martin Tzvetanov Grigorov <mgrigorov@apache.org>

Treat last_seen==None as a problem with the date value

022f998

Signed-off-by: Martin Tzvetanov Grigorov <mgrigorov@apache.org>

Treat unparsable Scheduler started data as an error

b965e37

Signed-off-by: Martin Tzvetanov Grigorov <mgrigorov@apache.org>

Fallback to the home dir if there is no config dir

1e2f765

Signed-off-by: Martin Tzvetanov Grigorov <mgrigorov@apache.org>

Fix the config env vars prefix

fe81ff6

Signed-off-by: Martin Tzvetanov Grigorov <mgrigorov@apache.org>

remove unused functionality

939dd7f

Signed-off-by: Martin Tzvetanov Grigorov <mgrigorov@apache.org>

Give more room for the version string

c1d2446

Signed-off-by: Martin Tzvetanov Grigorov <mgrigorov@apache.org>

milenkovicm reviewed Jan 31, 2026

View reviewed changes

andygrove reviewed Jan 31, 2026

View reviewed changes

martin-g changed the title ~~Ballista Text User Interface app~~ WIP: Ballista Text User Interface app Jan 31, 2026

martin-g added 3 commits January 31, 2026 18:03

Use a more readable banner. Move the nav bar to the top-right

3ee587c

Use ballista as a name for the config and log files

691c168

Add CLI command "tui" that opens the TUI app

3b289d9

dependabot bot and others added 12 commits February 1, 2026 23:04

chore(ci): update labeler config (apache#1412)

fc4ce9d

chore(deps): bump clap from 4.5.54 to 4.5.55 (apache#1417)

d612d2a

chore: Document ballista features in README.md (apache#1418)

4ca5a59

lint

Format Cargo.toml with cargo tomlfmt

5633597

Signed-off-by: Martin Tzvetanov Grigorov <mgrigorov@apache.org>

Fix clippy and formatting issues

3ad47ce

Signed-off-by: Martin Tzvetanov Grigorov <mgrigorov@apache.org>

fix: prost build keda and TLS RPC example (apache#1429)

0b84f6c

Improve sort-based shuffle: single spill file per partition and batch…

40ac629

… coalescing (apache#1431)

martin-g force-pushed the ballusta-tui-in-cli branch from bbae391 to 40ac629 Compare February 1, 2026 21:12

github-actions bot added documentation Improvements or additions to documentation development-process labels Feb 1, 2026

martin-g closed this Feb 1, 2026

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

WIP: Ballista Text User Interface app#1433

WIP: Ballista Text User Interface app#1433
martin-g wants to merge 36 commits intoapache:mainfrom
martin-g:ballusta-tui-in-cli

martin-g commented Jan 31, 2026

Uh oh!

martin-g commented Jan 31, 2026

Uh oh!

milenkovicm commented Jan 31, 2026

Uh oh!

milenkovicm Jan 31, 2026

Uh oh!

martin-g Jan 31, 2026

Uh oh!

martin-g commented Jan 31, 2026

Uh oh!

andygrove Jan 31, 2026

Uh oh!

martin-g Jan 31, 2026

Uh oh!

martin-g commented Jan 31, 2026

Uh oh!

martin-g commented Feb 1, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

6 participants

Conversation

martin-g commented Jan 31, 2026

Which issue does this PR close?

Rationale for this change

What changes are included in this PR?

Are there any user-facing changes?

Uh oh!

martin-g commented Jan 31, 2026

Uh oh!

milenkovicm commented Jan 31, 2026

Uh oh!

milenkovicm Jan 31, 2026

Choose a reason for hiding this comment

Uh oh!

martin-g Jan 31, 2026

Choose a reason for hiding this comment

Uh oh!

martin-g commented Jan 31, 2026

Uh oh!

andygrove Jan 31, 2026

Choose a reason for hiding this comment

Uh oh!

martin-g Jan 31, 2026

Choose a reason for hiding this comment

Uh oh!

martin-g commented Jan 31, 2026

Uh oh!

martin-g commented Feb 1, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

6 participants