Skip to content

Separate RAG instructions and inputs into system and user messages - #5

Merged
shipitdev merged 1 commit into
mainfrom
codex/prompt-message-roles
Nov 10, 2026
Merged

shipitdev merged 1 commit into
mainfrom
codex/prompt-message-roles

Conversation

@shipitdev

Copy link
Copy Markdown
Owner

Task instructions were bundled with questions and source text in a user message. The pipeline now sends task rules in a system message and dynamic inputs in a JSON user message for writing, verification, repair, follow-up resolution, memory summaries and OpenUI generation.

LangSmith records the actual role-based messages. Quota estimation counts both messages, and prompt version strict_v5_message_roles distinguishes new answers from previous cached results. Strict response schemas and the existing one-repair release checks are preserved.

Validation passed with 154 local Python tests and 3 subtests, plus 16 separate checks in the RAGAS environment. Tests inspect the actual outbound HTTP messages, dynamic repair findings, OpenUI prompts and quota estimation. No live model calls were made, so a quality or latency improvement has not been measured.

@shipitdev
shipitdev merged commit 5bcf700 into main Nov 10, 2026
2 checks passed
@shipitdev
shipitdev deleted the codex/prompt-message-roles branch November 10, 2026 13:49
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant