The 250 one-liners that built
data engineering in 2026.
Hand-curated shell pipelines combining apify · jq · claude · gemini · duckdb · groq · miller. Every entry runs as-is on a fresh laptop. Copy. Run. Learn.
apifyjqclaudegeminiduckdbgroqmillerparallel
70 of 250 · 180 to go · finish line August 31, 2026 🏁
last updated 2026-07-17
Filter by tier
Filter by tool
showing 28 of 70clear
#001
Today's HN top 10, ranked by score
curl -s "https://hacker-news.firebaseio.com/v0/topstories.json" \ | jq -r '.[0:30][]' \ | …
curljqxargs
›#002
Full-text search HN by keyword
curl -s "https://hn.algolia.com/api/v1/search?query=claude+code&tags=story&hitsPerPage=20"…
curljq
›#004
Any GitHub user's stars → markdown list
curl -s "https://api.github.com/users/torvalds/starred?per_page=50" \ | jq -r '.[] | "- [\…
curljq
›#005
Wikipedia article summary in 1 line
curl -s "https://en.wikipedia.org/api/rest_v1/page/summary/Functional_programming" \ | jq …
curljq
›#010
CSV → instant stats with Miller
mlr --csv stats1 -a mean,p90,max -f price -g category sales.csv | column -t
mlr
›#011
DuckDB: SQL over a CSV in one shot
duckdb -c " SELECT category, AVG(price) AS avg_price, QUANTILE_CONT(price, 0.9…
duckdb
›#012
JSON from curl → DuckDB analysis via /dev/stdin
curl -s "https://hn.algolia.com/api/v1/search?query=duckdb&hitsPerPage=100" \ | jq '.hits'…
curljqduckdb
›#013
DuckDB: query a remote Parquet over HTTPS
duckdb -c " INSTALL httpfs; LOAD httpfs; SELECT l_returnflag, l_linestatus, SUM(l_quantity…
duckdb
›#014
What's my IP and where is it?
curl -fsSL -A 'Mozilla/5.0 oneliner101' https://ifconfig.co/json \ | jq -r '"\(.ip)\t\(.ci…
curljq
›#015
Live currency rates, no API key
curl -s "https://open.er-api.com/v6/latest/USD" \ | jq '{base: .base_code, time: .time_las…
curljq
›#016
Most-starred repos in any language
curl -s "https://api.github.com/search/repositories?q=language:rust&sort=stars&order=desc&…
curljq
›#020
PyPI download stats for any package
curl -s "https://pypistats.org/api/packages/pandas/recent" \ | jq '.data'
curljq
›#021
Wikipedia page views over time
curl -s "https://wikimedia.org/api/rest_v1/metrics/pageviews/per-article/en.wikipedia/all-…
curljq
›#045
Analyze yesterday's S&P 500 performance with Claude
curl -fsSL -A 'Mozilla/5.0' "https://query1.finance.yahoo.com/v8/finance/chart/SPY?range=5…
curljqclaude
›#051
Find Pods Missing Resource Limits
kubectl get pods -A -o json | jq -r '.items[] | select(any(.spec.containers[]; .resources.…
kubectljqsort
›#052
List and Sort Running Container Images by Frequency
kubectl get pods -A -o json | jq -r '.items[].spec.containers[].image' | sort | uniq -c | …
kubectljqsortuniq
›#054
Find Top 10 Restarting Kubernetes Containers
kubectl get pods -A -o json | jq -r '.items[] | select(.status.containerStatuses != null) …
kubectljqsorthead
›#056
Find all OOMKilled pods across a Kubernetes cluster
kubectl get pods -A -o json | jq -r '.items[] | select(.status.containerStatuses[]?.lastSt…
kubectljq
›#058
Convert CSV to JSON Lines using Miller
mlr --icsv --ojsonl cat data.csv
mlr
›#061
Fetch and Display City Weather in Terminal
curl -s -H "Accept-Language: en" "wttr.in/London?0&m"
curl
›#062
Analyze news with game theory via curl and OpenAI
curl -s "https://newsapi.org/v2/everything?q=OPEC&pageSize=3&apiKey=$NEWS_API_KEY" \ | jq …
curljq
›#063
Extract and Group Outbound Links via Firecrawl
curl -sX POST https://api.firecrawl.dev/v1/scrape \ -H "Authorization: Bearer $FIRECRAWL_A…
firecrawljqcurlsort
›#064
Extract and Group Page Links by Domain using Firecrawl
curl -sX POST https://api.firecrawl.dev/v1/scrape \ -H "Authorization: Bearer $FIRECRAWL_A…
curlfirecrawljq
›#065
Benchmark JSON Parsing Speed: jq vs gron
hyperfine --warmup 3 'jq . large.json > /dev/null' 'gron large.json > /dev/null'
hyperfinejqgron
›#067
Extract Website Branding with Firecrawl
curl -sX POST https://api.firecrawl.dev/v1/scrape \ -H "Authorization: Bearer $FIRECRAWL_A…
curljqfirecrawl
›#068
Extract and Count Link Domains using Firecrawl
firecrawl scrape "https://news.ycombinator.com" --json | jq -r '.data.linksOnPage[]? | sel…
firecrawljqsortuniq
›#069
Query Firecrawl search results directly with DuckDB
curl -sX POST https://api.firecrawl.dev/v1/search \ -H "Authorization: Bearer $FIRECRAWL_A…
curlfirecrawlduckdb
›#073
Send a file securely via croc relay
croc send --code "super-secret-phrase" ./payload.tar.gz
croc
›