Docker on

Upgrading to llama.cpp

Fri, 20 Feb 2026 00:00:00 +0000

The first time I tried llama.cpp

llama.cpp was one of the first inference servers available for running an LLM model. At the time, I wasn’t super impressed with AI but they were better than the old fashioned auto complete. I didn’t think a subscription was worth paying for but if I could run my own, i’d take it.

When I first got to the llama.cpp repo on github, running it still required compiling it from source code. Annoying but it wasn’t the end of the world. What actually stopped me was that there wasn’t something like hugging face available to pull models from. The models that were around were the hundreds of billion parameter versions or I could write code to create my own from training data.

Setting up Ollama server with Open WebUI

Sat, 20 Dec 2025 00:00:00 +0000

Ollama is a powerful AI model serving platform that makes it easy to run large language models locally. In this post, we’ll walk through setting up Ollama with Open WebUI in a Docker containerized environment, including GPU acceleration support. Visit Ollama’s website for more information.

What is Ollama?

Ollama is an AI platform that provides an easy way to run large language models locally. It offers:

Easy model management
GPU acceleration support
A clean API for model interactions
Containerized deployment

What is Open WebUI?

Open WebUI provides a web-based interface for interacting with Ollama models, making it easy to use AI models without needing to write code or deal with complex command-line interfaces. Visit the Open WebUI GitHub repository for more information.

Setting up Ollama server with Open WebUI

Sat, 20 Dec 2025 00:00:00 +0000

What is Ollama?

Ollama is an AI platform that provides an easy way to run large language models locally. It offers:

Easy model management
GPU acceleration support
A clean API for model interactions
Containerized deployment

What is Open WebUI?

Running Dex With Docker Compose

Wed, 10 Jul 2024 00:00:00 +0000

I previously wrote on how to run Dex using docker. In this article, I will create nearly the same setup using docker-compose. This will allow you to run, stop, and restart the setup from a central location.

Setting up the docker-compose file

You’ll want to make sure that you have the same Dex config file from the previous article but with one small change. The issuer field should be changed to http://dex:5556/dex to match the service name that will be used in the docker-compose file. If the issuer field is not changed, the example app will try to find Dex within the container it is running in and will not be able to reach it. Changing it to http://dex:5556/dex will allow the example app to reach Dex through the network that docker-compose creates.

Running Dex with Docker

Fri, 05 Jul 2024 00:00:00 +0000

Dex is a tool created to make setting up and managing authentication methods easy. It is a single sign-on and identity management tool that can be used to authenticate users against a variety of backends. It is a great tool to use when you want to add authentication to your application without having to worry about managing the users yourself but still gives you the option if you want to. This post will show you how to run Dex locally to decide if it is the right tool for you. This does not cover how to integrate Dex into your application or integration with other authentication providers but I will cover that in a future article.

Setting up a proxy with NGINX

Tue, 15 Feb 2022 00:00:00 +0000

What is a proxy?

In its simplest form, a proxy is a server that listens for requests and redirects them to other servers. This allows multiple servers to run on the same system but still receive their requests, such as the case with many large hosting servers today. Requests are redirected depending on how they were made to the machine such as the URL that was used.

Proxies can also provide other benefits such as distributing traffic among multiple instances of the same web server, formatting the requests such as adding additional headers, filtering requests, or adding an additional security layer.

System monitoring with the TICK stack

Tue, 15 Feb 2022 00:00:00 +0000

Time series database

A time series database is a type of database that is optimized for storing data based on time stamped data. This method of storing data is useful in situations where values need to be monitored for change over time. While any database could be used to store this information, time series databases are time stamp aware which leading to improved organization and query speeds.

Time series databases have come up more in recent times due to the increase in the number of internet connected devices. Sensors can now be found throughout households, cities, and businesses. The measurements from these devices is usually precise with a frequent sample rate. A time series database is also able to aggregate this data so that large amounts of data can be removed by still keeping a summary of the samples.

Creating a local DNS with CoreDNS

Sat, 12 Feb 2022 00:00:00 +0000

What is a Domain Name System?

A Domain Name System (DNS) acts like the the phone book of the internet. When we enter a URL in our browser, it sends the URL to a DNS server to look up the actual IP address. Many times a DNS server will not know the IP address of the URL and it will have to forward it on to additional DNS servers. The next server to ask is determined by reading the URL from right to left. Each section of the URL is referred to as a zone and the remainder of the URL is forwarded on to the next zone.

Create an LXC container on Proxmox

Thu, 21 Nov 2019 00:00:00 +0000

Proxmox uses LXC containers rather than the more commonly heard of Docker containers. LXC containers can be thought of as very lightweight virtual machines. LXC containers can be customized to run an application but typically their images are for linux operating systems.

Adding a template

There are two methods for adding an LXC container template to Proxmox. The first is very convenient but requires Proxmox to be connected to the internet. The second is not as convenient but still easy enough and can be done if you are not connecting your server to the public internet.

Create a Windows 10 VM on Proxmox

Tue, 19 Nov 2019 00:00:00 +0000

Using the Proxmox server I set up to run a Windows virtual machine would let me move away from dual booting on my main machine. I boot into Windows maybe twice a year so there won’t be much that I miss. A remote connection from my desktop (or another machine) will more than cover my occasional use case for Windows.

Creating a virtual machine in Proxmox is straightforward for anyone who has worked with virtual machines before. There are, however, a few changes that are needed to make it easier to work with the VM on a remote system.

Installing Proxmox

Tue, 19 Nov 2019 00:00:00 +0000

Proxmox is an operating system that makes it easy to manage virtual machines and LXC containers. The server uses a web GUI for easy access and handles all of the resource management from within the GUI.

For the most part, installing Proxmox is as straightforward as installing any OS. I ran into some issues with the networking and screen configurations that took me a little time to troubleshoot. Both were easily fixed by making sure the correct hardware was plugged into my system before starting to install.

Running Repetier Server on RPI3 with Balena OS

Sun, 02 Dec 2018 00:00:00 +0000

Not too long ago I purchased a Mostly Printed CNC from V1Engineering. I’ve been taking my time putting it together (and still have some cleaning up to do) but I finally got it to a usable state a couple weeks ago. It’s awesome to be able to watch it move completely on its own and make sounds resembling alien space crafts for the 1980’s Galaga arcade game. It’s even more awesome to think about all the different projects it will be useful for.