Posts

Showing posts with the label llm

The Ultimate Guide: Installing Ollama on Fedora 43

Image
    Running large language models (LLMs) locally isn’t just for the privacy-obsessed anymore, it’s for anyone who wants a snappy, custom coding assistant without a monthly subscription. If you are rocking Fedora 43 (just like me), you’re already using one of the most cutting-edge distros out there. There’s something uniquely satisfying about seeing your GPU fans spin up because your local AI is thinking. Here is how to get Ollama up and running with full NVIDIA acceleration and hook it into VS Code for a seamless dev experience. Let’s get you there in eight steps. Step 1: Open the Gates (RPM Fusion) Fedora is known for its commitment to free, open-source software, which means the proprietary NVIDIA drivers aren't there by default. We need to add the RPM Fusion repositories to get the "non-free" goodies. Run this in your terminal:   $ sudo dnf5 install https://mirrors.rpmfusion.org/free/fedora/rpmfusion-free-release-$(rpm -E %fedora).noarch.rpm    $ sudo dnf5 ins...