Repository navigation
scripts: run the model setup scripts with uv - #114
Merged
Merged
Conversation
direct_download.py and nomic2vec.py needed a manual `pip3 install -r scripts/requirements.txt` first. Declare their dependencies inline (PEP 723) and run them through `#!/usr/bin/env -S uv run --script`, so uv builds their environment. einops is needed by the trust_remote_code Nomic BERT model. Require Python 3.10, which current transformers, huggingface_hub and model2vec need, so uv does not pick an older interpreter and quietly fall back to transformers 4.x. Update the README and the usage text to match, keep requirements.txt as the documented fallback without uv, and drop hints that pointed at direct_download.py flags that do not exist and at a custom vocabulary option the distillation ignores.
meta-cla
Bot
added
the
CLA Signed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
direct_download.py and nomic2vec.py needed a manual
pip3 install -r scripts/requirements.txtfirst. Declare theirdependencies inline (PEP 723) and run them through
#!/usr/bin/env -S uv run --script, so uv builds their environment.einops is needed by the trust_remote_code Nomic BERT model. Require
Python 3.10, which current transformers, huggingface_hub and model2vec
need, so uv does not pick an older interpreter and quietly fall back
to transformers 4.x.
Update the README and the usage text to match, keep requirements.txt
as the documented fallback without uv, and drop hints that pointed at
direct_download.py flags that do not exist and at a custom vocabulary
option the distillation ignores.