Skip to content

AI agent testing guide #584

Closed
Closed
AI agent testing guide#584
Assignees
0xDeon
Labels
Stellar WaveIssues in the Stellar wave programaidocumentationImprovements or additions to documentationtesting

Description

@codebestia
codebestia
opened on Aug 27, 2026

Write apps/ai_agent/docs/testing.md: the pytest setup, the fixtures in tests/conftest.py (client, mock_openai, mock_weaviate, the autouse API-key fixture), and how to add a test for a new endpoint without calling a real model or vector store.

Acceptance criteria:

  • Documents each fixture, what it patches and the default it returns
  • Gives a worked example of adding an endpoint test using the existing fixtures
  • Documents the coverage configuration and how to read the report
  • Notes the known gap that /index/message has no dedicated test module, so a contributor can pick it up

Activity

  1. codebestia
    added
    documentationImprovements or additions to documentation
    testing
    ai
    on Aug 27, 2026
  2. drips-wave
    added
    Stellar WaveIssues in the Stellar wave program
    on Aug 27, 2026

  3. Fhatu12 commented on Aug 28, 2026

    @Fhatu12
    Fhatu12
    on Aug 28, 2026 – with Drips Wave

    @Fhatu12 has applied to work on this issue as part of the Stellar Wave Program's 8th wave.

    Please assign me to this issue. I’ve reviewed the current AI-agent testing setup and confirmed that the fixtures and coverage configuration described here are all present on main.

    I’ll add apps/ai_agent/docs/testing.md and document the existing client, mock_openai, mock_weaviate, and autouse API-key fixtures, including what each fixture patches and how it behaves in the current test suite.

    I’ll include a worked endpoint-test example based on the repository’s existing pytest patterns, showing how to use TestClient together with the mocked OpenAI and Weaviate clients so contributors do not accidentally call a real model or vector store.

    I’ll also document the current pytest/pytest-cov configuration, explain the term-missing coverage output and CI coverage workflow, and explicitly record the current /index/message dedicated-test gap without expanding this documentation task into implementing that separate test coverage.

    I’ll keep the change documentation-only, validate every command and example against the current AI-agent test setup, and run the relevant documentation/AI-agent checks before submitting.

    ℹ️ Repo Maintainers: To accept this application, review their application or assign @Fhatu12 to this issue.

  4. 0xDeon commented on Aug 30, 2026

    @0xDeon
    0xDeon
    on Aug 30, 2026 – with Drips Wave
    Contributor

    @0xDeon has applied to work on this issue as part of the Stellar Wave Program's 8th wave.

    Hello team.

    I’m Deon (0xDeon), a software engineer with a strong background in building scalable systems and contributing to open-source projects. I’ve taken some time to go through the repository and understand the current implementation, and I’m clear on the issue, its context, and the expected outcome.

    I’d love to work on this and take ownership of the fix. I’m confident I can cleanly resolve it while keeping everything aligned with the existing codebase and ensuring all criteria are met. Would appreciate being assigned to this issue.

    ℹ️ Repo Maintainers: To accept this application, review their application or assign @0xDeon to this issue.

  5. drips-wave commented on Aug 30, 2026

    @drips-wave
    drips-wavebot
    on Aug 30, 2026 – with Drips Wave

    Congratulations, @0xDeon! 🎉 Your application was accepted by the repo's maintainers, and the issue is due on August 31, 2026.

    🧑‍💻 @0xDeon: Please resolve the issue such that the repo's maintainers have enough time to review your contribution before the due date. You'll earn Points for completing the issue on-time, which will make you eligible for a share of the Stellar Wave Program's reward pool.

    Warning

    When opening a PR, please link it to this issue to ensure it gets tracked accurately. Points are awarded when this issue is marked as completed by the maintainer.

    🤠 Repo maintainers: Please keep an eye on the contributor's progress and review their work before the due date. You can manage this issue, including adjusting its complexity and points, here.

    🌊 Happy Wave 🌊

  6. codebestia
    assigned
    0xDeon
    on Aug 30, 2026
  7. 0xDeon
    added a commit that references this issue on Aug 31, 2026

    docs: add AI agent ops, prompts, testing and contract error references

    83d37d7

  8. github-actions commented on Aug 31, 2026

    @github-actions
    github-actionsbot
    on Aug 31, 2026 – with GitHub Actions

    Closed by #602, merged into dev.

  9. github-actions
    closed this as completedon Aug 31, 2026

  10. drips-wave commented on Aug 31, 2026

    @drips-wave
    drips-wavebot
    on Aug 31, 2026 – with Drips Wave

    This issue has been completed by @0xDeon as part of the Stellar Wave Program's 8th Wave 🥳

    😎 @0xDeon: You earned 200 Points for completing this issue! After the current Wave ends, you'll be eligible for a percentage of the Wave's reward pool based on the percentage of total points you've earned. Learn more here. You can also Leave a review to share your experience working on this issue.

    🧑‍💻 Repo maintainers: How'd the contributor do? Leave a review to share your experience working with them.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

Stellar WaveIssues in the Stellar wave programaidocumentationImprovements or additions to documentationtesting

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions