Some of what I do

Update

Wow, I haven't blogged since July. That checks out.

I've been very busy. Whether I'm working seven days a week, pulling all-nighters on Rasberry™, or disappearing into another LLM Controller CE update, apparently I know how to keep myself occupied.

Rasberry™ Hosting is now actively serving customer VMs, and I've been continuously improving the Account Management Portal since launch in August.

AMP has already gained a bunch of new customer-facing functionality, including VM reinstall, opening all firewall ports, subscription cancellation, automatic daily VM backups and restore, real-time server status, and Authenticator 2FA.

I've also done a full cleanup and typography consistency pass across the interface, and updated the base Ubuntu installation for tighter integration with AMP and a better experience right from first boot.

Behind all of that, the entire hosting cluster is backed up daily to a dedicated backup cluster.

We've also had nearly 100% uptime since launch. The only significant interruption wasn't actually a VM or hardware outage at all. An ISP outage took the host running AMP offline for around eight hours, while customer VMs continued running normally.

As of writing, the cluster itself is sitting at 162 days of uptime, dating back well before public signups opened.

On the open-source side, LLM Controller CE has been moving just as quickly.

Since my last blog post I've just released the 3rd major version!

LLM Controller CE has grown into much more than another llama.cpp wrapper. It's a workspace, model test bench, project manager, OpenAI-compatible API host, and a growing collection of tools for actually working with local models.

LLM Controller CE v1.4 puts a big focus on Voice and the overall user experience, including local speech-to-text so you can talk directly to your model whether the model itself supports audio or not. No external API required.

In considerably less software-related news, Jamie and I spent our one-year wedding anniversary in a beautiful condo in Whistler, up on Blackcomb Mountain and about as far away from everyone else as we could reasonably get.

We cooked at home, disconnected from everything, and relaxed our faces off for a few days. It was great.

Naturally, I came home and started tearing apart the server room.

I'm currently working through soundproofing, new drywall, fresh paint, and an entirely new cooling setup. It's one of those projects where every completed job reveals another job underneath it, but it's coming together.

So yeah.

I haven't blogged since July.

That checks out. I skipped a lot, too.