Repository navigation
Conversation
This was referenced Oct 7, 2026
sjavis
force-pushed
the
batching-buffer-period
branch
from
October 8, 2026 15:28
fae4b04 to
e11b9d3
Compare
This was
linked to
issues
Oct 9, 2026
sjavis
force-pushed
the
batching-buffer-period
branch
from
October 12, 2026 09:15
e11b9d3 to
958022e
Compare
sjavis
added this pull request to stack #275
October 12, 2026 13:47
Only tracks starting in the main batch periods are retained.
Fixes a bug in _combine_trajectories that causes failure when there is more than one trajectory in a batch.
sjavis
force-pushed
the
batching-buffer-period
branch
from
October 14, 2026 12:20
958022e to
5cdaf09
Compare
This branch has not been deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
This combines the output files from each batch into one single netcdf file. Since each file starts from a trajectory index of zero, these get re-indexed, then the trajectories are padded to match in length, and combined them with
cf.aggregate. Closes Combine batch outputs #247cf.aggregatebecause the default method fails due to the start and end flags both having the samestandard_name.This adds the time period and batch interval as arguments to
batching. It automatically subspaces the input files to the relevant time period and saves them to the batch directory. There are options to say a file doesn't vary in time or should be kept in memory for preprocessing. Closes Time-based selection of inputs for batching #192It also enables setting buffer periods with the
buffer_periodandstart_buffer_periodoptions toBatchingConfig. When combining the output files it will only keep the tracks that start within the main batch periods. Closes Combine batching iterations using buffer periods #193start_buffer_periodis set to a day by default because if it is in any of that period then it is assumed to be in the previous batch. But ifbuffer_periodis not set it is not used.This replaces the PRs #249 and #261 as there was a lot of overlap in the code changes.
This will also close #216 as batching will now handle missing output files itself.