The 250 one-liners that built
data engineering in 2026.

Hand-curated shell pipelines combining apify · jq · claude · gemini · duckdb · groq · miller. Every entry runs as-is on a fresh laptop. Copy. Run. Learn.

apifyjqclaudegeminiduckdbgroqmillerparallel

Browse the list ↓🎲 Pick one at random

81 of 250 · 169 to go · finish line August 31, 2026 🏁

last updated2026-09-03

Filter by tier

all self-contained llm-cli duckdb apify aws

Filter by tool

apify ast-grep awk aws claude croc curl duckdb envfix ffprobe firecrawl gemini gron head htmlq hyperfine jc jo jq kubectl llm mlr oc parallel rga sort sponge tail uniq witr xargs yq

showing 10 of 81clear

DuckDB: SQL over a CSV in one shot

duckdb -c " SELECT category, AVG(price) AS avg_price, QUANTILE_CONT(price, 0.9…

JSON from curl → DuckDB analysis via /dev/stdin

curl -s "https://hn.algolia.com/api/v1/search?query=duckdb&hitsPerPage=100" \ | jq '.hits'…

DuckDB: query a remote Parquet over HTTPS

duckdb -c " INSTALL httpfs; LOAD httpfs; SELECT l_returnflag, l_linestatus, SUM(l_quantity…

DuckDB on NYC taxi public Parquet

duckdb -c " INSTALL httpfs; LOAD httpfs; SELECT passenger_count, ROUND(AVG(fare_amount), 2…

DuckDB: peek at any CSV's schema

duckdb -c "DESCRIBE FROM 'data.csv'"

Aggregate K8s Pod Counts by Namespace and Phase

kubectl get pods -A -o json | \ jq -c '.items[]' | \ duckdb -c "SELECT metadata.namespace,…

kubectljqduckdb

Analyze Top Kubernetes Warning Events with DuckDB

kubectl get events -A --field-selector type=Warning -o json | jq -c '.items[]' | duckdb -c…

kubectljqduckdb

Run SQL GROUP BY on a CSV using DuckDB

duckdb -c "SELECT status, COUNT(*) as count FROM 'large_dataset.csv' GROUP BY status ORDER…

Query Firecrawl search results directly with DuckDB

curl -sX POST https://api.firecrawl.dev/v1/search \ -H "Authorization: Bearer $FIRECRAWL_A…

curlfirecrawlduckdb

Scrape Google Maps and query top-rated places with DuckDB

curl -s -X POST "https://api.apify.com/v2/acts/apify~google-maps-scraper/run-sync-get-data…

curlapifyduckdb