Repository navigation
Conversation
This was referenced Oct 9, 2026
3 of 5 tasks
Assemble provider tool calls before emitting them, preserve raw arguments and native IDs, reject unfinished streams, and use the final usage snapshot across Agent loops. BREAKING CHANGE: updated providers require the SDK 0.11 complete-call contract and coordinated Dify, Graphon, and daemon releases.
Merge current main, preserve native Claude content through the shared Vertex stream collector, close responses on errors, and reserve plugin versions after upstream releases. BREAKING CHANGE: these provider and Agent releases require the SDK 0.11 complete-call contract and the coordinated Dify, Graphon, and daemon changes.
5 of 8 tasks
This branch has not been deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Closes #4032.
Agent tool continuations lose provider replay data when they rebuild assistant messages from visible text, and streamed tool fragments can be mistaken for executable calls.
Preserve complete assistant messages through Function Calling, ReAct, and Self Refine, including Anthropic signed/redacted thinking and provider/model-scoped
model_history.Adapt the providers below to the SDK complete-call contract: assemble native fragments inside each provider, emit each finished call once, preserve raw arguments and native IDs, and generate IDs only when the provider omits them.
Shared SDK collectors reject empty or duplicate IDs before appending a batch.
Function Calling now extracts calls after collection and adds the final usage snapshot once per model request.
Repeated usage updates replace earlier snapshots, including a final zero value.
Azure AI Studio, ZhipuAI, OCI, Tongyi, Volcengine, Gitee, and Vertex Claude reject unfinished streams, failed completion states, empty names, and invalid argument objects before emitting calls.
Vertex Claude uses the same completed stream for blocking and streaming requests, preserving native thinking, signatures, redacted blocks, citations, block order, and raw tool arguments in response-owned replay data.
Tool continuations preserve the requested thinking configuration, and HTTP responses close on both success and failure.
Agent image inputs, tool schemas, configured output/thinking budgets, and prompt-cache behavior remain covered by the replay regressions.
Release Notes
Change Type
LLM Plugin Checklist
Versions and validation
All 19 projects declare SDK
>=0.11,<0.12and lock0fa060a11fd774fe8ed70c915d7881e20a765b64from SDK #390.The Python runtime is 3.12, including the updated PerfxCloud and Upstage manifests.
The following suites passed in separate environments installed from each project's frozen lockfile, without a local SDK path override.
Total: 967 passed, with 18 existing Anthropic live cases skipped because credentials were absent.
All 19 final plugin sources were packaged with the official CLI, with source hashes, manifests, locks, and exported SDK requirements verified against the archives.
Relevant lint checks and
git diff --checkpassed; existing provider lint findings were compared against HEAD.Independent acceptance used real installed vendor SSE parsers for 36 scenarios across Azure AI Studio, ZhipuAI, OCI, Tongyi, Volcengine, and Gitee.
All 30 invalid scenarios raised errors before emitting any tool call; six valid controls preserved raw arguments, IDs, and token totals.
Vertex Claude also passed real-client SSE tests and an independent public-invocation review for both modes, including fresh-instance replay and errors received after the completion event.
Eight additional controlled Vertex/OpenAI transport scenarios exercised Graphon, Dify backward invocation serialization, real SDK Session HTTP parsing, and Function Calling/Self Refine in streaming and blocking modes.
They preserved parallel calls, replay metadata, and final usage through the next model request.
Release gates
86f1e11b199bb8ad9111ed49d42edea82a16b7faand Dify #44502 for legacy Agents, workflow history, and Agent v2.Keep this PR in draft until these release gates are met.
Current manifest minimum Dify versions do not define compatibility for this joint upgrade.
Controlled HTTP responses validate transport and replay equality; real vendor signatures and production deployment remain unverified.