Skip to content

Comments

Replaces in memory bulk status with retrieval#6149

Open
keith-turner wants to merge 1 commit intoapache:mainfrom
keith-turner:redo-bulk-status
Open

Replaces in memory bulk status with retrieval#6149
keith-turner wants to merge 1 commit intoapache:mainfrom
keith-turner:redo-bulk-status

Conversation

@keith-turner
Copy link
Contributor

The manager tracked the status of bulk imports in memory. This tracking would be lost when the manager restarted. Replaced this tracking with new code that retrieves the current status from persisted data. All the in memory tracking code was deleted.

Deleted a shell command that relied on the old way of doing things and added a new admin command. This was done because the new way needs a server context which is not available in the shell.

Updated the monitor to call the new code. The new code offers more information. Will open a follow on issue to display this additional information on the monitor.

These changes were made in support of #6139. Anything the manager tracks in memory makes it harder to split the manager into multiple processes.

The manager tracked the status of bulk imports in memory. This tracking
would be lost when the manager restarted. Replaced this tracking with
new code that retrieves the current status from persisted data. All the
in memory tracking code was deleted.

Deleted a shell command that relied on the old way of doing things and
added a new admin command.  This was done because the new way needs a
server context which is not available in the shell.

Updated the monitor to call the new code.  The new code offers more
information.  Will open a follow on issue to display this additional
information on the monitor.

These changes were made in support of apache#6139.  Anything the manager
tracks in memory makes it harder to split the manager into multiple
processes.
@keith-turner keith-turner added this to the 4.0.0 milestone Feb 24, 2026
Copy link
Contributor

@dlmarion dlmarion left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This looks good. The Monitor changes here , in the rest package, will keep the monitor working for now. Ultimately, the plan was to remove the rest package as the Monitor is ported over to use the endpoints in the next package which is driven off the metrics.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants