Store the observation, not your interpretation of it. Schema design for people who have never designed one, keeping the raw bytes, deduplication, entity resolution, and why a clean-looking count can still rest on a soft date axis.
Recent Posts
A gold set of 50 items you labelled by hand, 2 numbers in plain words, and the trade-off between them that you have to choose rather than solve. Plus the time I measured one of my own steps and found that a third to a half of one output bucket was wrong.
Most things that look like a block are not one. How to tell a geo-restriction from a bot challenge from a rate limit from a page that simply renders itself with JavaScript — and what each answer actually costs you.
Source material you did not publish should not go into somebody else's API. What a model on your own machine is genuinely good enough for, measured across 5 models and 5 task shapes — including the 3 failures that explain why its output is a draft.
A visual workflow tool builds the same watcher an earlier post built in Python, without a line of code — and then an honest account of the 6 places a canvas runs out.
A folder of documents becomes rows, the rows are processed in batches rather than one at a time, and nothing leaves until a person has marked it reviewed. The gate is the product.
Running 7 scanners is a thread pool and an afternoon. Making them agree on what a finding is — one shape, one severity scale, one row per problem — is the whole product.
A corpus of 340,920 observations from 18 catalogues, collapsed into 120,063 canonical events across 90,565 victims. Deciding which records describe the same incident is the whole product — and a 3-year rebuild of a 2023 original.
Arabic, English and Hebrew, collected and enriched by a worker with a queue per stage. The same 6 stages as everything else in this series, except a shift depends on them being up.
Six megabytes of exported messages, labelled and filtered by a few dozen keyword rules. No model, no API bill, nothing leaving the laptop — and every label traceable to the line that produced it.










