Skip to content

Automate time period selection in batching - #261

Closed
sjavis wants to merge 5 commits into
batching-combine-trajectoriesfrom
batching-buffer-period
Closed

sjavis wants to merge 5 commits into
batching-combine-trajectoriesfrom
batching-buffer-period

Conversation

@sjavis

@sjavis sjavis commented Sep 21, 2026

Copy link
Copy Markdown
Collaborator

This changes the batching interface to take the time period and batch interval as input arguments rather than number of iterations. It now automatically subspaces the input files to the relevant time period and saves them to the batch directory. There are also options to say a file doesn't vary in time or should be kept in memory for preprocessing. Closes #192

It also enables setting buffer periods with the buffer_period and start_buffer_period options to BatchingConfig. When combining the output files it will only keep the tracks that start within the main batch periods. Therefore, start_buffer_period has been set to just a day by default because if it is in any of that period then it is assumed to be in the previous batch. Closes #193

@sjavis sjavis self-assigned this Sep 21, 2026
@sjavis
sjavis added this pull request to stack #262 September 21, 2026 09:39
@sjavis
sjavis force-pushed the batching-buffer-period branch from 31b5562 to 8cb9c15 Compare September 29, 2026 18:07
@sjavis
sjavis force-pushed the batching-combine-trajectories branch 2 times, most recently from 478c746 to d6dc6cf Compare October 1, 2026 07:15
@sjavis
sjavis force-pushed the batching-buffer-period branch from 8cb9c15 to 2ca45b5 Compare October 1, 2026 07:15
@sjavis
sjavis force-pushed the batching-combine-trajectories branch from d6dc6cf to 31ac11b Compare October 2, 2026 12:43
@sjavis
sjavis force-pushed the batching-buffer-period branch from 2ca45b5 to 1cc7528 Compare October 2, 2026 12:43
Fixes a bug in _combine_trajectories that causes failure when there is
more than one trajectory in a batch.
@sjavis
sjavis force-pushed the batching-buffer-period branch from 1cc7528 to fae4b04 Compare October 2, 2026 12:51
@sjavis
sjavis removed this pull request from stack #262 October 5, 2026 16:27
@sjavis

sjavis commented Oct 7, 2026

Copy link
Copy Markdown
Collaborator Author

Replaced by #274

@sjavis sjavis closed this Oct 7, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Combine batching iterations using buffer periods Time-based selection of inputs for batching

1 participant