Skip to content

Issue with the LLM server while testing the API calls #74

Open
Open
Issue with the LLM server while testing the API calls#74

Description

@saharshayegan
saharshayegan
opened on Jul 10, 2025

Hi,

I am trying to test out the API calls for the claim analysis and I am facing this error. Could you please help me with it?

The endpoint is:
/v1/analysis/claim/{claim_id}/stream

And the error is:


misinformation_mitigation_api  | Traceback (most recent call last):
misinformation_mitigation_api  |   File "/app/app/api/dependencies.py", line 161, in get_llm_provider
misinformation_mitigation_api  |     provider = VertexAILlamaProvider(settings)
misinformation_mitigation_api  |                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
misinformation_mitigation_api  |   File "/app/app/core/llm/vertex_ai_llama.py", line 25, in __init__
misinformation_mitigation_api  |     raise FileNotFoundError(f"Service account file not found at: {creds_path}")
misinformation_mitigation_api  | FileNotFoundError: Service account file not found at: /app/service-account.json
misinformation_mitigation_api  | ERROR:    Exception in ASGI application
misinformation_mitigation_api  | Traceback (most recent call last):
misinformation_mitigation_api  |   File "/usr/local/lib/python3.12/site-packages/uvicorn/protocols/http/httptools_impl.py", line 401, in run_asgi
misinformation_mitigation_api  |     result = await app(  # type: ignore[func-returns-value]
misinformation_mitigation_api  |              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
misinformation_mitigation_api  |   File "/usr/local/lib/python3.12/site-packages/uvicorn/middleware/proxy_headers.py", line 60, in __call__
misinformation_mitigation_api  |     return await self.app(scope, receive, send)
misinformation_mitigation_api  |            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
misinformation_mitigation_api  |   File "/usr/local/lib/python3.12/site-packages/fastapi/applications.py", line 1054, in __call__
misinformation_mitigation_api  |     await super().__call__(scope, receive, send)
misinformation_mitigation_api  |   File "/usr/local/lib/python3.12/site-packages/starlette/applications.py", line 113, in __call__
misinformation_mitigation_api  |     await self.middleware_stack(scope, receive, send)
misinformation_mitigation_api  |   File "/usr/local/lib/python3.12/site-packages/starlette/middleware/errors.py", line 187, in __call__
misinformation_mitigation_api  |     raise exc
misinformation_mitigation_api  |   File "/usr/local/lib/python3.12/site-packages/starlette/middleware/errors.py", line 165, in __call__
misinformation_mitigation_api  |     await self.app(scope, receive, _send)
misinformation_mitigation_api  |   File "/usr/local/lib/python3.12/site-packages/starlette/middleware/cors.py", line 85, in __call__
misinformation_mitigation_api  |     await self.app(scope, receive, send)
misinformation_mitigation_api  |   File "/usr/local/lib/python3.12/site-packages/starlette/middleware/exceptions.py", line 62, in __call__
misinformation_mitigation_api  |     await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send)
misinformation_mitigation_api  |   File "/usr/local/lib/python3.12/site-packages/starlette/_exception_handler.py", line 62, in wrapped_app
misinformation_mitigation_api  |     raise exc
misinformation_mitigation_api  |   File "/usr/local/lib/python3.12/site-packages/starlette/_exception_handler.py", line 51, in wrapped_app
misinformation_mitigation_api  |     await app(scope, receive, sender)
misinformation_mitigation_api  |   File "/usr/local/lib/python3.12/site-packages/starlette/routing.py", line 715, in __call__
misinformation_mitigation_api  |     await self.middleware_stack(scope, receive, send)
misinformation_mitigation_api  |   File "/usr/local/lib/python3.12/site-packages/starlette/routing.py", line 735, in app
misinformation_mitigation_api  |     await route.handle(scope, receive, send)
misinformation_mitigation_api  |   File "/usr/local/lib/python3.12/site-packages/starlette/routing.py", line 288, in handle
misinformation_mitigation_api  |     await self.app(scope, receive, send)
misinformation_mitigation_api  |   File "/usr/local/lib/python3.12/site-packages/starlette/routing.py", line 76, in app
misinformation_mitigation_api  |     await wrap_app_handling_exceptions(app, request)(scope, receive, send)
misinformation_mitigation_api  |   File "/usr/local/lib/python3.12/site-packages/starlette/_exception_handler.py", line 62, in wrapped_app
misinformation_mitigation_api  |     raise exc
misinformation_mitigation_api  |   File "/usr/local/lib/python3.12/site-packages/starlette/_exception_handler.py", line 51, in wrapped_app
misinformation_mitigation_api  |     await app(scope, receive, sender)
misinformation_mitigation_api  |   File "/usr/local/lib/python3.12/site-packages/starlette/routing.py", line 73, in app
misinformation_mitigation_api  |     response = await f(request)
misinformation_mitigation_api  |                ^^^^^^^^^^^^^^^^
misinformation_mitigation_api  |   File "/usr/local/lib/python3.12/site-packages/fastapi/routing.py", line 291, in app
misinformation_mitigation_api  |     solved_result = await solve_dependencies(
misinformation_mitigation_api  |                     ^^^^^^^^^^^^^^^^^^^^^^^^^
misinformation_mitigation_api  |   File "/usr/local/lib/python3.12/site-packages/fastapi/dependencies/utils.py", line 605, in solve_dependencies
misinformation_mitigation_api  |     solved_result = await solve_dependencies(
misinformation_mitigation_api  |                     ^^^^^^^^^^^^^^^^^^^^^^^^^
misinformation_mitigation_api  |   File "/usr/local/lib/python3.12/site-packages/fastapi/dependencies/utils.py", line 628, in solve_dependencies
misinformation_mitigation_api  |     solved = await call(**solved_result.values)
misinformation_mitigation_api  |              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
misinformation_mitigation_api  |   File "/app/app/api/dependencies.py", line 161, in get_llm_provider
misinformation_mitigation_api  |     provider = VertexAILlamaProvider(settings)
misinformation_mitigation_api  |                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
misinformation_mitigation_api  |   File "/app/app/core/llm/vertex_ai_llama.py", line 25, in __init__
misinformation_mitigation_api  |     raise FileNotFoundError(f"Service account file not found at: {creds_path}")
misinformation_mitigation_api  | FileNotFoundError: Service account file not found at: /app/service-account.json
misinformation_mitigation_api  | 2025-07-10 17:57:48 | INFO | app.core.llm.vertex_ai_llama | Loading service account from: /app/service-account.json
misinformation_mitigation_api  | 2025-07-10 17:57:48 | ERROR | app.core.llm.vertex_ai_llama | Failed to initialize Vertex AI Llama provider: Service account file not found at: /app/service-account.json
misinformation_mitigation_api  | Traceback (most recent call last):
misinformation_mitigation_api  |   File "/app/app/core/llm/vertex_ai_llama.py", line 25, in __init__
misinformation_mitigation_api  |     raise FileNotFoundError(f"Service account file not found at: {creds_path}")
misinformation_mitigation_api  | FileNotFoundError: Service account file not found at: /app/service-account.json
misinformation_mitigation_api  | 2025-07-10 17:57:48 | ERROR | app.api.dependencies | Failed to initialize LLM provider: Service account file not found at: /app/service-account.json
misinformation_mitigation_api  | Traceback (most recent call last):
misinformation_mitigation_api  |   File "/app/app/api/dependencies.py", line 161, in get_llm_provider
misinformation_mitigation_api  |     provider = VertexAILlamaProvider(settings)
misinformation_mitigation_api  |                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
misinformation_mitigation_api  |   File "/app/app/core/llm/vertex_ai_llama.py", line 25, in __init__
misinformation_mitigation_api  |     raise FileNotFoundError(f"Service account file not found at: {creds_path}")
misinformation_mitigation_api  | FileNotFoundError: Service account file not found at: /app/service-account.json
misinformation_mitigation_api  | ERROR:    Exception in ASGI application
misinformation_mitigation_api  | Traceback (most recent call last):
misinformation_mitigation_api  |   File "/usr/local/lib/python3.12/site-packages/uvicorn/protocols/http/httptools_impl.py", line 401, in run_asgi
misinformation_mitigation_api  |     result = await app(  # type: ignore[func-returns-value]
misinformation_mitigation_api  |              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
misinformation_mitigation_api  |   File "/usr/local/lib/python3.12/site-packages/uvicorn/middleware/proxy_headers.py", line 60, in __call__
misinformation_mitigation_api  |     return await self.app(scope, receive, send)
misinformation_mitigation_api  |            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
misinformation_mitigation_api  |   File "/usr/local/lib/python3.12/site-packages/fastapi/applications.py", line 1054, in __call__
misinformation_mitigation_api  |     await super().__call__(scope, receive, send)
misinformation_mitigation_api  |   File "/usr/local/lib/python3.12/site-packages/starlette/applications.py", line 113, in __call__
misinformation_mitigation_api  |     await self.middleware_stack(scope, receive, send)
misinformation_mitigation_api  |   File "/usr/local/lib/python3.12/site-packages/starlette/middleware/errors.py", line 187, in __call__
misinformation_mitigation_api  |     raise exc
misinformation_mitigation_api  |   File "/usr/local/lib/python3.12/site-packages/starlette/middleware/errors.py", line 165, in __call__
misinformation_mitigation_api  |     await self.app(scope, receive, _send)
misinformation_mitigation_api  |   File "/usr/local/lib/python3.12/site-packages/starlette/middleware/cors.py", line 85, in __call__
misinformation_mitigation_api  |     await self.app(scope, receive, send)
misinformation_mitigation_api  |   File "/usr/local/lib/python3.12/site-packages/starlette/middleware/exceptions.py", line 62, in __call__
misinformation_mitigation_api  |     await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send)
misinformation_mitigation_api  |   File "/usr/local/lib/python3.12/site-packages/starlette/_exception_handler.py", line 62, in wrapped_app
misinformation_mitigation_api  |     raise exc
misinformation_mitigation_api  |   File "/usr/local/lib/python3.12/site-packages/starlette/_exception_handler.py", line 51, in wrapped_app
misinformation_mitigation_api  |     await app(scope, receive, sender)
misinformation_mitigation_api  |   File "/usr/local/lib/python3.12/site-packages/starlette/routing.py", line 715, in __call__
misinformation_mitigation_api  |     await self.middleware_stack(scope, receive, send)
misinformation_mitigation_api  |   File "/usr/local/lib/python3.12/site-packages/starlette/routing.py", line 735, in app
misinformation_mitigation_api  |     await route.handle(scope, receive, send)
misinformation_mitigation_api  |   File "/usr/local/lib/python3.12/site-packages/starlette/routing.py", line 288, in handle
misinformation_mitigation_api  |     await self.app(scope, receive, send)
misinformation_mitigation_api  |   File "/usr/local/lib/python3.12/site-packages/starlette/routing.py", line 76, in app
misinformation_mitigation_api  |     await wrap_app_handling_exceptions(app, request)(scope, receive, send)
misinformation_mitigation_api  |   File "/usr/local/lib/python3.12/site-packages/starlette/_exception_handler.py", line 62, in wrapped_app
misinformation_mitigation_api  |     raise exc
misinformation_mitigation_api  |   File "/usr/local/lib/python3.12/site-packages/starlette/_exception_handler.py", line 51, in wrapped_app
misinformation_mitigation_api  |     await app(scope, receive, sender)
misinformation_mitigation_api  |   File "/usr/local/lib/python3.12/site-packages/starlette/routing.py", line 73, in app
misinformation_mitigation_api  |     response = await f(request)
misinformation_mitigation_api  |                ^^^^^^^^^^^^^^^^
misinformation_mitigation_api  |   File "/usr/local/lib/python3.12/site-packages/fastapi/routing.py", line 291, in app
misinformation_mitigation_api  |     solved_result = await solve_dependencies(
misinformation_mitigation_api  |                     ^^^^^^^^^^^^^^^^^^^^^^^^^
misinformation_mitigation_api  |   File "/usr/local/lib/python3.12/site-packages/fastapi/dependencies/utils.py", line 605, in solve_dependencies
misinformation_mitigation_api  |     solved_result = await solve_dependencies(
misinformation_mitigation_api  |                     ^^^^^^^^^^^^^^^^^^^^^^^^^
misinformation_mitigation_api  |   File "/usr/local/lib/python3.12/site-packages/fastapi/dependencies/utils.py", line 628, in solve_dependencies
misinformation_mitigation_api  |     solved = await call(**solved_result.values)
misinformation_mitigation_api  |              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
misinformation_mitigation_api  |   File "/app/app/api/dependencies.py", line 161, in get_llm_provider
misinformation_mitigation_api  |     provider = VertexAILlamaProvider(settings)
misinformation_mitigation_api  |                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
misinformation_mitigation_api  |   File "/app/app/core/llm/vertex_ai_llama.py", line 25, in __init__
misinformation_mitigation_api  |     raise FileNotFoundError(f"Service account file not found at: {creds_path}")
misinformation_mitigation_api  | FileNotFoundError: Service account file not found at: /app/service-account.json

No activity

Activity on this issue will appear here.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions