Byte-sized insights into software development, AI, and the future of technology.
The problem I kept running into I was building a small system made of multiple services (one API, one worker, one “data fixer” job). The goal was si...
I ran into a frustrating problem while building a little “best trade-offs” engine: I needed a live Pareto front (set of non-dominated solutions) that ...
Why I got obsessed with this weird problem When I built a tiny robot for indoor mapping, the first thing that went “almost right” was motion and per...
The problem I ran into: “Trust” that changes every run I spent a weekend trying to make AI outputs auditable in a CI/CD pipeline. The goal was simple...
The problem I kept running into I wanted a provenance trail that could answer two very different questions about a physical artifact: 1. “What is t...
Why I got stuck: “the feature went backwards” I was building a real-time feature feed for an AI model—think “latest customer attributes right now”—an...
Why I got obsessed with PatchDropout I wanted to understand how regularization changes the internal “token flow” in a transformer for vision. Most d...
The weird bug that sent me into JSON-LD debugging mode I hit an annoying mismatch while building an API that returned JSON-LD (JSON for Linked Data)...
The problem that pulled me in I ran into a surprisingly painful failure mode while building an Enterprise RAG (Retrieval-Augmented Generation) syste...
The problem I couldn’t ignore I once ran an incident where the system behaved “correctly” by every metric—but the story didn’t line up. Alerts told ...
I fell into this rabbit hole because I kept seeing the same pattern in my telemetry: outbound connections from a service to a set of TLS endpoints kep...
The problem I ran into: “Fresh” data that wasn’t actually fresh I was building a real-time analytics feed for an AI feature store. Everything looked ...
The problem I ran into I was building a provenance pipeline where files (PDFs, videos, build artifacts) were stored off-chain (S3-like storage), but...
The bug that pushed me into fault tolerance I ran into a very practical problem while prototyping a tiny “quantum error correction” simulator: I kep...
The problem I ran into I built a “standard” dev environment for a team: same language runtimes, same system packages, same tooling versions. Locally...
The bug that started it all I ran into a weird production incident that looked like “random stale data.” The system was built around an at-least-one...
Why I got obsessed with “shift robustness” in quantum kernels I stumbled into a weird failure mode while experimenting with quantum machine learning...
I got burned by a failure mode that’s weirdly hard to spot: my real-time model didn’t crash, but it started learning from “time-shifted” data. The sen...
The problem I ran into: “real-time” that wasn’t I built what I thought was a clean real-time analytics pipeline: events flowed into Kafka, a consume...
The problem I wanted to solve I kept running into a subtle DeFi reliability issue: many “time-weighted average price” (TWAP) oracles assume they can ...
The problem I ran into (and why it’s weirdly hard) On a weekend of tinkering with DeFi flashloan arbitrage (a flash loan is a loan that must be borro...
I used to think incident postmortems were mostly for “remembering what happened.” Then I watched a system almost learn from its failures—and fail anyw...
I didn’t start out trying to build a “philosophy” tool. I started because my deploys kept “working” and still hurting us. Every time we shipped, the ...
The tiny production fire I wanted to understand A while back I chased a weird incident: response times would suddenly spike, then slowly recover—but...
The problem that pulled me in I ran into a weird failure mode while training a small Transformer for a “toy” classification task: my inputs were raw ...
Why I went down this rabbit hole I wanted to generate synthetic training data for an OCR model, but every time I used a “normal” image + text render...
I got bitten by a bug that looked “nondeterministic” at first: sometimes my API returned the exact same data but the downstream system rejected it any...
I ran into a bug that felt haunted: data looked correct most of the time, then occasionally—usually right after a deploy or a load spike—it “snapped” ...
The itch that started this project I kept seeing the same frustrating pattern while iterating on prompts: I’d “rewrite the prompt to be clearer,” ru...
I tripped over a surprisingly nasty bug while building a little “route planner” for a grid. The UI asked for: “minimum travel time” and also showed ho...
Last year I inherited an on-call rotation where every incident felt like the same small play: the pager went off, someone posted a terse message like ...
The problem I kept running into I was building a real-time analytics pipeline on PostgreSQL, where events came in as `JSONB`. Each event had a paylo...
The weird problem I stumbled into I wanted to generate pixel-art tilemaps (think: 16×16 tiles arranged into a small scene), but I kept running into ...
The problem I kept hitting in software supply chain security I got tired of “trust me” release pipelines. Even when I used code signing and pinned d...
The problem I ran into: “answers” with citations that couldn’t be trusted I built a small Enterprise RAG (Retrieval-Augmented Generation) pipeline t...
The problem I ran into: “My images are identical, but the SBOMs keep changing” I was helping wire up a CI/CD pipeline for a hybrid setup where develo...
I got annoyed the first time I tried to build a “blockchain exporter” that writes ledger data into a database: the exporter would sometimes ingest the...
The weird bug I hit: the “same” response produced different cache keys I ran into a maddening issue while building a small API service that cached r...
Why I got curious about Post-Quantum crypto (and what broke) I went looking at post-quantum cryptography because I wanted something concrete I could ...
The problem I ran into on a hybrid cluster I was building a hybrid (on‑prem + public cloud) environment where services needed egress (outbound netwo...
The problem I tripped over: “Same Dockerfile, different image” I was running a CI/CD pipeline where every PR kicked off a Docker build, then pushed a...
Why I got obsessed with “receipt memos” I stumbled into a weird bug class while building a decentralized provenance system: the smart contract would ...
I got pulled into a weird smart-manufacturing problem after a weekend of tinkering: tiny, non-obvious defects on circuit boards that look like nothing...
The bug that sent me down a rabbit hole I recently tried to validate a CRYSTALS-Dilithium signature (a post-quantum signature scheme standardized by...
I fell into this rabbit hole because I kept seeing the same annoying pattern in my homelab: my CI pipeline would mint short-lived API tokens, those to...
The problem I ran into I built a hybrid webhook pipeline that had to accept payment events from two different SaaS vendors, then forward them to int...
I ran into a weird failure mode while building a predictive model for “will this checkout fail today?” The data looked fine in batch, but during real-...
The weekend problem I couldn’t stop thinking about I was building an “AI assistant” that had to call internal tools (like fetching account metadata)...
The weekend problem I kept running into I was building a small system that scheduled short background jobs. Nothing fancy—just a single service, mul...
I ran into a weird but real problem while tinkering with blockchain infrastructure: node operators (including me) often have “clean” logs—until you tr...
I got tired of treating “threat intelligence” like a blob of text—some feeds said “APT29”, others said “malware family”, and in practice my SOC (secur...
The itch that started this I kept seeing “audit trails” in DeFi described as events in logs—and every time I dug deeper, I found the same mismatch: ...
I ran into a maddening problem while wiring up signed webhooks: the signature verification would randomly fail even though the “same” payload was bein...
Building a SCD Type 2 “Event-Time Merge” for Late Arriving Clickstream in dbt and Snowflake The problem that pulled me into this niche is simple: cl...
The problem I chased: a sudden 10x query spike in real-time metrics I hit a performance cliff in a real-time analytics pipeline that joins event dat...
The bug I chased for a week: “learning” that was really hardware drift I was experimenting with a tiny hybrid quantum-classical system: a classical ...
Last year I got bitten by a bug that “couldn’t possibly happen”: timers were firing, yet the system behaved like they weren’t. It turned out I was usi...
The provenance problem that kept bothering me I kept running into the same failure mode when building “digital provenance” systems: I could store ev...
I hit a fun (and annoying) problem while building a service that stores user edits as a stream of CRDT (Conflict-free Replicated Data Types) operation...
The bug I couldn’t explain: “Same event, different features” I ran a real-time feature pipeline for an AI model and watched accuracy slowly degrade o...
I ran into a bug that looked “random” in production: a UI button sometimes didn’t update, but only when users clicked quickly. Locally it was fine. In...
I got obsessed with a very specific workflow bug: every time my team exported an OpenAPI spec into Terraform-friendly artifacts, the “glue” logic live...
The weird problem I ran into: “same event” across chains I was building a small “digital provenance” system where an event—like “sensor reading X is ...
The weird problem I ran into I was testing a small drone camera pipeline over a cellular link (5G/6G integration in the real world, not in a lab dia...
The weird problem I ran into I was building an ETL pipeline that reads objects from one provider (S3-compatible storage) and writes into another—acr...
Why I got obsessed with “prompt tampering” I hit a weird problem while building a small generative workflow: two prompts that looked identical produc...
I stumbled into a weird corner of software supply chain security while debugging a “perfectly signed” release that still felt untrustworthy: the signa...
I got curious about something that’s annoyingly under-explained in DeFi: how to build a time-weighted average price (TWAP) oracle without trusting a c...
I got curious about a very specific failure mode in enterprise Retrieval-Augmented Generation (RAG): even when the retriever finds the “right” clauses...
The problem that got me curious I hit a weird failure in a CI pipeline that “looked secure” on paper: the pipeline was verifying artifacts, but it w...
The problem I ran into: “green” builds that later explode I recently helped wire a CI/CD pipeline for a distributed cloud platform, and everything lo...
The problem I stumbled into I spent a weekend trying to wire an ERC4626 vault into a DeFi portfolio and then feed its “share price” into an Aave v3 ...
The problem I stumbled into I got hooked on spatial computing because it lets you make digital content react to the real world. The part that surpri...
Building a Streaming “Monotonic Timestamp” Guardrail in Kafka Connect A weird class of incidents kept biting me in real-time pipelines: event times ...
Edge Vision for Predicting Conveyor Belt Tear Using Tiny YOLOv8 and IMU Correlation A couple weekends ago I got pulled into a frustrating smart-manu...
The problem I ran into: “same PR” but different infrastructure drift I was building a platform engineering workflow for ephemeral review apps (short...
The problem I wanted to solve I once had to prove that a printed, scanned receipt image hadn’t been altered between a vendor’s laptop and an offline ...
The bug I chased: “login works on one subdomain, breaks on the other” I ran into a weird authentication failure while building a setup like this: - ...
I ran into a weird CI/CD failure that looked like an “auth problem,” but it wasn’t. The symptoms were consistent: GitHub Actions would authenticate to...
I got curious about a super specific failure mode in smart manufacturing: microstalls on a CNC spindle—those tiny hesitations that don’t trip the obvi...