# Open WebUI

A useful web utility for easier, but also more powerful, interaction with local LLMs.

# Error Troubleshooting

If you have an error such as the following:

<span style="color: rgb(224, 62, 45);">`Ollama:500, message='Internal Server Error', url=URL('http://127.0.0.1:11434/api/chat')`</span>

Likely you need to update Ollama, as Open WebUI has been updated too far to be able to interact with your current Ollama version (or vice versa). This is true even if you have Open WebUI installed via a package manager such as Pinokio.

The current way to update Ollama on your local machine is `curl https://ollama.ai/install.sh | sh`.

Further, you can check your current Ollama version with, who would have guessed it, `ollama --version`.

# Making Docker see NVIDIA GPUs on Linux

###  

###  

### Fedora Linux:

Run <span style="font-family: monospace;">`<span data-darkreader-inline-bgcolor="" data-darkreader-inline-color="" style="color: #000000; background-color: #ffffff;">sudo dnf install nvidia-container-toolkit nvidia-driver</span>` </span>to install NVIDIA's toolkit for interacting with containers, as well as the proprietary drivers for your NVIDIA GPU<span style="font-family: monospace;">.  
<span data-darkreader-inline-bgcolor="" data-darkreader-inline-color="" style="color: #000000; background-color: #ffffff;"> </span>  
</span><span style="font-family: monospace;">`<span data-darkreader-inline-bgcolor="" data-darkreader-inline-color="" style="color: #000000; background-color: #ffffff;">sudo nvidia-ctk runtime configure --runtime=docker</span>`</span> configures Docker to be able to use the GPU.

<span style="font-family: monospace;">`<span data-darkreader-inline-bgcolor="" data-darkreader-inline-color="" style="color: #000000; background-color: #ffffff;">sudo systemctl restart docker</span>`</span> restarts the Docker service.

<span style="font-family: monospace;">`<span data-darkreader-inline-bgcolor="" data-darkreader-inline-color="" style="color: #000000; background-color: #ffffff;">docker info | grep Runtimes</span>` </span>checks if Docker can see the "nvidia" runtime.<span style="font-family: monospace;">  
<span data-darkreader-inline-bgcolor="" data-darkreader-inline-color="" style="color: #000000; background-color: #ffffff;"> </span>  
</span>