OpenWebUI's Standard Code Interpreter doesn't work with this Manifold

[yashsinha-aero]

Could Gemini's native code execution capabilities be used? or perhaps be made compatible with OpenWebUI's Code interpreter?

[owndev]

Sorry for the very late answer, @yashsinha-aero. Yes, this works since Google Gemini pipeline 1.18.0 (#193), which moved tool calling to Open WebUI's own tool loop.

With Native function calling, the code interpreter enabled (Admin Settings → Code Execution, on by default) and the Code Interpreter toggle on in the chat, Open WebUI offers its built-in execute_code tool. The pipeline passes it to Gemini, and Open WebUI runs Gemini's calls:

• With the default pyodide engine the code runs in your browser tab, and Open WebUI adds its note on the Pyodide environment to the system instruction.
• With the jupyter engine it runs on the configured Jupyter server.

stdout, stderr and the result go back to Gemini, and an image printed as a base64 PNG line (for example a plot) is uploaded and shown in the answer. The tool is offered to chats in the web UI, not to API clients of /api/chat/completions.

Details: Open WebUI's image generation and code interpreter. Gemini's own server-side code execution is not used; Open WebUI's interpreter covers this case.