Skip to content

chore: roadmap, readme and general docs updates - #399

Merged
haoshan98 merged 2 commits into
vllm-project:mainfrom
EmbeddedLLM:roadmap-updates
Sep 30, 2026
Merged

haoshan98 merged 2 commits into
vllm-project:mainfrom
EmbeddedLLM:roadmap-updates

Conversation

@haoshan98

Copy link
Copy Markdown
Collaborator

Summary

Several user-facing docs had fallen behind main or contradicted each other and the code. This PR brings them in line with what has shipped. It changes documentation only.

Corrected claims

  • README listed the Messages API as "🚧 Planned" while another README section documents /v1/messages. It is now listed as shipped; only stateful Messages stays planned.
  • README and docs/index.md advertised "Background execution" and gateway-executed file search. Neither exists yet: background mode is Support asynchronous/background Responses #357, and file_search declarations parse but are dropped before inference (tool/normalize.rs). Both claims are removed.
  • docs/api/index.md quoted fixed WebSocket and executor limits (256 KiB SSE lines, 1 MiB events and response budget). These now come from the configurable [responses] settings, which default to 16 MiB and 8 MiB.
  • docs/api/index.md listed only some of the conditions that route a Responses request through the executor. The list now also includes non-function tools, multi_agent.enabled, and tool-search state, matching handler/http/responses.rs.
  • CHANGELOG listed Tavily under 0.8.0, but it merged on Sep 28, after the Sep 19 release. The two Tavily entries move to [Unreleased].

Newly documented features

Roadmap

Smaller fixes

  • The repository layout in README and AGENTS.md now lists agentic-llm-d, agentic-cli-docs, and python/agentic_api/.
  • ARCHITECTURE.md's list of multi-agent rejections now includes max_tool_calls, matching executor/rehydrate.rs.
  • mkdocs.yaml adds the existing but unlinked design/shell-tool.md to the nav.

Not changed: the README's "Rust 1.85+" badge is wrong (1.85 cannot build the lockfile, see #377), but #379 already updates it to 1.88 along with rust-version and a CI check, so this PR leaves it alone to avoid a conflict.

Signed-off-by: haoshan98 <haoshanw@gmail.com>
Signed-off-by: haoshan98 <haoshanw@gmail.com>
@haoshan98
haoshan98 merged commit 8038abf into vllm-project:main Sep 30, 2026
20 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants