Skip to content

Chore/fix tests in vscode - #421

Draft
elephantum wants to merge 3 commits into
masterfrom
chore/fix-tests-in-vscode
Draft

Chore/fix tests in vscode#421
elephantum wants to merge 3 commits into
masterfrom
chore/fix-tests-in-vscode

Conversation

@elephantum

Copy link
Copy Markdown
Contributor

No description provided.

@elephantum
elephantum force-pushed the chore/fix-tests-in-vscode branch 2 times, most recently from 83c67a2 to b3ec367 Compare August 1, 2026 11:37
@elephantum
elephantum marked this pull request as draft August 1, 2026 11:38
progress callback

core/progress-callback: move progress callback into RunConfig

Replace the separate `progress` parameter threaded through
ComputeStep.run_full / Executor.run_process_batch with a single
RunCallback stored on RunConfig.callback (CompositeRunCallback fans
out to multiple callbacks). Also fixes _apply_filters_to_run_config
to use dataclasses.replace instead of deepcopy, so a stateful
callback isn't forked away from the caller's instance.

core/progress-callback: replace tqdm with RunCallback-based progress reporting

Remove tqdm from the executors, BaseBatchTransformStep.fill_metadata,
update_external_table, and the CLI's run-changelist loop, reporting
progress through RunConfig.callback.on_step_progress instead. Add a
dependency-free StdoutRunCallback that the CLI attaches by default,
printing throttled completed/total lines with average time per item
and ETA. Drop the tqdm-loggable runtime dependency from datapipe-core.
@elephantum
elephantum force-pushed the chore/fix-tests-in-vscode branch from b3ec367 to c236b63 Compare August 1, 2026 19:34
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant