We test two popular methods to run local language models on your Linux box. Then, we push the limits to see which language models will toe the line and which won't.

Sponsored By:

• Tailscale: Tailscale is a programmable networking software that is private and secure by default - get it free on up to 100 devices!
• Linode Cloud Hosting: A special offer for all Linux Unplugged Podcast listeners and new Linode customers, visit linode.com/unplugged, and receive $100 towards your new account.
• Kolide: Kolide is a device trust solution for companies with Okta, and they ensure that if a device isn’t trusted and secure, it can’t log into your cloud apps.

Support LINUX Unplugged

Links:

• 🎉 Alby — Boost into the show, first grab Alby, top it off, and then head over to the Podcast Index.
• ⚡️ LINUX Unplugged on the Podcastindex.org — You can boost from the web. Once Alby is topped off, visit our page on the Podcast Index.
• Brent in Berlin Meetup — Brent is back in Berlin and we're having a LOW KEY meetup at the NixOS night at cbase.
• One Time Fiat Fun for SCaLE 2024
• Southern California Linux Expo 19
• Purchase a SCALE Pass 63
• First NixCon North America!
• NixCon North America | SCALE 21x
• NixCon North America Call for Proposals
• Texas Linux Fest 2024
• LFNW 2024: Ready or not
• LFNW 2024: Call for Sessions
• Jupiter Broadcasting Live Calendar
• 2023 Unplugged Tuxies
• Ollama — Get up and running with Llama 2 and other large language models locally.
• OllamaHub — Explore and Download Custom Ollama Modelfiles.
• ollama library