There are a couple of things you can do to improve the replies:

Prompt engineering

To increase the quality of a reply follow this guideline when writing a request to the LLM:

Regenerate the reply

Generate a new reply from the LLM by clicking the Regenerate button above the LLM reply in the chat. Due to the LLM’s non-deterministic characteristics, this can lead to different responses that may be more adequate. Alternatively, you can use natural language and request the LLM to generate additional solutions for your problem.

Try a different LLM

Sometimes, a specific LLM is just not fit for the task you are trying to accomplish. You can easily change the LLM using the Set Default Language Model command or you can regenerate just a specific reply with a different model using the Switch Language Model dropdown above the reply. If you’re using a local Ollama model, try getting a different version of that model with more parameters if your hardware allows, or change it with a completely different model.