Skip to content

add Clara schema prescaling - #1466

Open
baltzell wants to merge 3 commits into
developmentfrom
schema-prescalings
Open

baltzell wants to merge 3 commits into
developmentfrom
schema-prescalings

Conversation

@baltzell

@baltzell baltzell commented Sep 29, 2026 •

Copy link
Copy Markdown
Collaborator

Disabled by default, enabled by a YAML parameter. With prescaling set at 100, every 100th event gets a full schema:
dog

@baltzell
baltzell marked this pull request as ready for review September 29, 2026 19:34
@baltzell baltzell changed the title add schema prescaling add Clara schema prescaling Sep 29, 2026
@baltzell baltzell added this to the Pass 3 milestone Sep 29, 2026
}

// set the writer's schema factory:
writer.getSchemaFactory().copy(fullSchema);

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

isn't this overwriting the writer schemas set at line 93 and 95? can those be removed?

@baltzell baltzell Sep 30, 2026 •

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes, but they can't be removed as is. The writer object was and is being used as a transient schema store, during initialization.

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It's a weird initialization paradigm, probably worth breaking ...

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants