19 articles in this category
20% of my disk free, 2% CPU, 29% RAM, and the machine still hung. Btrfs metadata was 93% full and 125,000 of the files were loose Git objects from an agent snapshot layer.
Efficient pipeline design is mostly a set of decisions about bytes scanned, work repeated, and failures survived. Here is how I reason through them, with the arithmetic shown.
The requirement was 100K rps. The work was arithmetic, a stateless tier, a cache that absorbs most of it, and a long list of things that break before the CPU does.
I built Flare to run mail for my own domain without an IMAP server. Astro on a Worker, Turso for state, Resend or Maileroo for delivery, webhooks for inbound.
Point it at a folder and every create, edit, rename and delete lands in a local database. Undo, replay, fork and diff, without git in the way.
Playwright for the pages that need JavaScript, cron for the schedule, and a dedupe key that keeps DAAD, Erasmus and Chevening from colliding.
Detect, track, check liveness, embed, match. One worker per camera, a SQLite source of truth, and a vector index that heals itself when the model changes.
Paillier homomorphic encryption, an honest-but-curious proxy, and a simulator that measures what the network costs when the server never sees plaintext.
An OpenAI-compatible endpoint, guardrails, a model registry, drift detection, and Prometheus metrics, packaged as a single Docker container.
JustAPI is a Python web framework where the web server, the router, the TLS termination, the request validation, the JSON serialization, and the database access all run in Rust. Your Python code handles the application logic. That is the entire premise, and it is the one sentence that explains every design decision in the project.
Kafka and Parquet are append-only by design. Article 17 is not. This is a medallion lakehouse built around a six-layer deletion cascade.
Kafka on a small VPS, DuckDB and dbt in CI, and a read-only Turso copy for the browser. How I built a live European airspace pipeline without a cloud budget.
Two GitHub accounts, two Discords, a stable and a beta of the same tool, all on one machine with no container, no daemon, and no sudo. The isolation model is three ideas and a path rewrite.
OpenCodeHub is an open-source, self-hosted GitHub alternative built with Astro, TypeScript, and Drizzle ORM. Features SSH, stacked PRs, CI/CD pipelines, and AI code review — on your own server.
Provider-independent, zero telemetry, and it writes your session to a local JSONL file. The constraints came first and the features followed.
A 156,000-word dictionary that runs in the browser, a router that only reaches for a model when you bring your own key, and no database on the other side.
Boringrats served a million users on donations, with a fifty-dollar monthly budget and a bill that landed near thirty-five. Here is the architecture, the numbers from the busiest day, and what it cost outside the invoice.
A self-hosted forge with stacked pull requests, a speculative merge queue, Actions-compatible CI, and AI review. The reasoning behind a modular monolith, and the parts that were hard.
