Ollama

A FOSS tool that helps with interacting directly with LLMs locally.