I’m trying to understand how this is used, my current selfhosted setup is quite simple:

frontend - backend - vllm

Using the openai compatible api vllm returns with tool calls that need to be handeled by the backend, an results are then send to the frontend by the backend, the frontend never communicates with vllm directly.

Form what i can gather AG-UI is a way for the frontend to directly communicate with in my case vllm in a secure way? letting the frontend handle the tool calls?

Can confirm, i live in the Netherlands and the bike lanes here are painted red because they are communist.

I would suggest using another frontend like freetube then trying to fix google’s frontend.