Skip to content
Merged
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
6 changes: 2 additions & 4 deletions docs/llm.markdown
Original file line number Diff line number Diff line change
Expand Up @@ -73,10 +73,8 @@ jsonschema llm path/to/schema.json \
--header "Authorization: Bearer $DOUBLEWORD_API_KEY"
```

We often saw requests here take a good while longer than an ordinary completion,
as the engine compiles the schema into a grammar before generating anything. The
default `--timeout/-T` leaves room for that, though an involved schema may want
more.
Doubleword can sometimes be slow to serve a request, independently of the
model, which is what the generous default `--timeout/-T` leaves room for.

### OpenAI

Expand Down
Loading