I’m currently in the market for an LLM eval system / project / pipeline I can use in my Go- and LLM-powered applications. This is a post to gather my thoughts and expose them to the wide internet. Think of it like a stream-of-thought post that might give you some ideas and food for thought as well.
Read the rest of “Requirements for an LLM eval pipeline (in Go?)”
I really like boring technology. Software that has been tested for decades, does what it is supposed to robustly and fast, and is known by every person and machine on the planet. Technology like relational databases and SQL, HTTP, HTML, a well-known programming language. Throw LLMs into that mix, and you've got a potent cocktail!
Like the rest of the world, I’ve embraced chatting to large language models (LLMs) as part of my professional and personal life. I rarely use their output directly, but they help me think and brainstorm, give me ideas, and force me to write out my own thoughts, clarifying and refining them in the process (much like writing articles like this one does, by the way). These thoughts-in-writing are important to me, and that’s why I keep a history of them on my own machine. A conversational diary, so to speak. And so should you.
Read the rest of “I own my LLM chat history, and so should you”
Llamafiles are these cool little files that have llama.cpp and model weights embedded, and can run on Mac/Linux/Windows. Cool, let’s make some!
Read the rest of “TIL: Building llamafiles from Llama 3.2 GGUFs”
As software developers, we are uniquely positioned to create something and give it a life of its own, and then barely having to support it anymore. We can sit in our living rooms in our fancy fluffy pink loungewear (what, you don’t have that?!) and create products that touch and empower thousands of people. So why are so many of us content to clock in and sell our time, 19th century factory style?
Read the rest of “Decoupling time spent from value provided as a software developer”
I want to have my Go modules under my own domain, so instead of importing github.com/maragudk/example, I can import maragu.dev/example. Turns out it’s pretty easy.
Read the rest of “TIL: HTTP middleware for custom Go module paths”
It’s time for the first product! I want to build a web app to help you remember your friends’ birthdays and their kids’ names. Basically, a simple CRM for your personal life. I call it MyFavPeople.
Learn how to download, quantize, and use Llama 3.1 with llama.cpp on a Mac. With word explanations!
Read the rest of “TIL: Quantize and use Llama 3.1 with llama.cpp on a Mac”
I’m going to let you in on a secret, if you promise to not tell anyone. It’s about making money and involves spaghetti. Are you ready?
Always choose the right tool for the job? Nah. I use Go basically everywhere, which either makes me insightful or stupid. Decide for yourself! :D
Read the rest of “Go is my hammer, and everything is a nail”