The 250 one-liners that built
data engineering in 2026.

Hand-curated shell pipelines combining apify · jq · claude · gemini · duckdb · groq · miller. Every entry runs as-is on a fresh laptop. Copy. Run. Learn.

apifyjqclaudegeminiduckdbgroqmillerparallel

Browse the list ↓🎲 Pick one at random

70 of 250 · 180 to go · finish line August 31, 2026 🏁

last updated 2026-07-17

Filter by tier

all self-contained llm-cli duckdb apify aws

Filter by tool

apify awk aws claude croc curl duckdb firecrawl gemini gron head hyperfine jq kubectl llm mlr parallel sort tail uniq xargs

showing 23 of 70clear

Wikipedia article → 5-year-old explanation

curl -s "https://en.wikipedia.org/api/rest_v1/page/summary/Homotopy_type_theory" \ | jq -r…

Should I read this HN thread? Claude TL;DR

ID=42583107 # any HN story id curl -s "https://hn.algolia.com/api/v1/items/$ID" \ | jq -…

Schema-validated LLM output with claude --json-schema

curl -s \ "https://hn.algolia.com/api/v1/search?query=local+llm&tags=story&hitsPerPage=20"…

Production-grade reasoning that doesn't stall — --fallback-model

curl -s "https://hacker-news.firebaseio.com/v0/topstories.json" \ | jq -r '.[0:30][]' \ | …

curljqxargsclaude

Pure-LLM lockdown mode with --tools ""

curl -s "https://hn.algolia.com/api/v1/search?tags=front_page&hitsPerPage=20" \ | jq -r '.…

LLM persona via --append-system-prompt

curl -s \ "https://hn.algolia.com/api/v1/search?query=AI&tags=front_page&hitsPerPage=15" \…

Capped fan-out across N inputs with --max-budget-usd

TOPICS=(machine-learning local-llm agi claude openai) mkdir -p /tmp/topic # Stage 1: scra…

parallelcurljqclaude

Lambda: tail recent errors → claude clusters them

aws logs tail /aws/lambda/my-function \ --since 1h --filter-pattern '?ERROR ?Exception ?Tr…

CloudWatch Logs Insights from the CLI

QID=$(aws logs start-query \ --log-group-name /aws/lambda/my-function \ --start-time $(($(…

SQS DLQ: peek poison pills → claude triage table

aws sqs receive-message \ --queue-url https://sqs.eu-central-1.amazonaws.com/123456789012/…

CloudWatch alarm → 30-min context dump → claude RCA memo

ALARM=prod-orders-api-5xx-rate; LOGS=/aws/lambda/prod-orders-api; \ A=$(aws cloudwatch des…

Unattached EBS volumes + snapshots → claude cleanup plan

REGION=${AWS_REGION:-eu-central-1}; NOW=$(date -u +%s); SNAPS=$(aws ec2 describe-snapshots…

RDS audit (CPU + connections, 7d) → claude downsize plan

REGION=${AWS_REGION:-eu-central-1}; END=$(date -u +%Y-%m-%dT%H:%M:%SZ); START=$(date -u -v…

SQS fleet health snapshot → claude wedge-vs-starve diagnosis

END=$(date -u +%Y-%m-%dT%H:%M:%SZ); START=$(date -u -v-1H +%Y-%m-%dT%H:%M:%SZ 2>/dev/null …

ECS stopped-task postmortem → claude root-cause classifier

aws ecs list-clusters --query 'clusterArns[]' --output text | tr '\t' '\n' | while read -r…

awsxargsjqclaude

Athena: audit last 50 queries for bytes-scanned hogs via claude

IDS=$(aws athena list-query-executions --work-group analytics-prod --max-items 50 --query …

Glue: triage last 100 job runs for failure patterns with claude

aws glue get-job-runs --job-name reprocess-events-daily --max-items 100 \ | jq '{ job: "re…

Analyze yesterday's S&P 500 performance with Claude

curl -fsSL -A 'Mozilla/5.0' "https://query1.finance.yahoo.com/v8/finance/chart/SPY?range=5…

Analyze Kubernetes Events for Anomalies

kubectl get events -A --sort-by='.lastTimestamp' | tail -n 100 | claude -p "Review these K…

kubectltailclaude

Audit Kubernetes RBAC Roles with Claude

kubectl get clusterroles,roles -A -o yaml | claude -p "Audit this Kubernetes RBAC configur…

Compare sentiment across Twitter, Reddit, and HN

TOPIC="nuclear energy" && \ (apify call -i "{\"search\":\"$TOPIC\",\"maxItems\":20}" quack…

Scrape Google News and cluster articles by narrative angle

apify call nstojiljkovic/google-news-scraper -i '{"query":"AI regulation","maxItems":30}' …

Summarize breaking news from the last hour

firecrawl search "breaking news" --tbs "qdr:h" --json \ | jq -r '.data.web[] | .title + ":…

firecrawljqclaude