The 250 one-liners that built
data engineering in 2026.
Hand-curated shell pipelines combining apify · jq · claude · gemini · duckdb · groq · miller. Every entry runs as-is on a fresh laptop. Copy. Run. Learn.
apifyjqclaudegeminiduckdbgroqmillerparallel
44 of 250 · 206 to go · finish line July 31, 2026 🏁
last updated2026-05-11
Filter by tier
Filter by tool
showing 16 of 44clear filters
#029
SQS: drain a queue to local JSONL
Q="https://sqs.eu-west-1.amazonaws.com/123456789012/my-queue" while MSGS=$(aws sqs receiv…
awsjq
›#030
SQS: replay DLQ messages back to source
DLQ="https://sqs.eu-west-1.amazonaws.com/123/my-dlq" SRC="https://sqs.eu-west-1.amazonaws.…
awsjq
›#031
Lambda: tail recent errors → claude clusters them
aws logs tail /aws/lambda/my-function \ --since 1h --filter-pattern '?ERROR ?Exception ?Tr…
awsclaude
›#032
CloudWatch Logs Insights from the CLI
QID=$(aws logs start-query \ --log-group-name /aws/lambda/my-function \ --start-time $(($(…
awsjqclaude
›#033
EC2: every running instance on one line each
aws ec2 describe-instances \ --filters 'Name=instance-state-name,Values=running' \ | jq -r…
awsjq
›#034
S3: top 20 biggest objects in a bucket
aws s3api list-objects-v2 --bucket my-bucket --max-items 5000 \ | jq -r '.Contents | sort_…
awsjqawk
›#035
AWS Cost Explorer: top spend → gemini analysis
START=$(date -u -v-30d +%Y-%m-%d 2>/dev/null || date -u -d '-30 days' +%Y-%m-%d) END=$(dat…
awsjqgemini
›#036
Lambda: every function ranked by memory + timeout
aws lambda list-functions --max-items 500 \ | jq -r '.Functions | sort_by(-.MemorySize) | …
awsjqawk
›#037
SQS DLQ: peek poison pills → claude triage table
aws sqs receive-message \ --queue-url https://sqs.eu-central-1.amazonaws.com/123456789012/…
awsjqclaude
›#038
CloudWatch alarm → 30-min context dump → claude RCA memo
ALARM=prod-orders-api-5xx-rate; LOGS=/aws/lambda/prod-orders-api; \ A=$(aws cloudwatch des…
awsjqclaude
›#039
Unattached EBS volumes + snapshots → claude cleanup plan
REGION=${AWS_REGION:-eu-central-1}; NOW=$(date -u +%s); SNAPS=$(aws ec2 describe-snapshots…
awsjqclaude
›#040
RDS audit (CPU + connections, 7d) → claude downsize plan
REGION=${AWS_REGION:-eu-central-1}; END=$(date -u +%Y-%m-%dT%H:%M:%SZ); START=$(date -u -v…
awsjqclaude
›#041
SQS fleet health snapshot → claude wedge-vs-starve diagnosis
END=$(date -u +%Y-%m-%dT%H:%M:%SZ); START=$(date -u -v-1H +%Y-%m-%dT%H:%M:%SZ 2>/dev/null …
awsjqclaude
›#042
ECS stopped-task postmortem → claude root-cause classifier
aws ecs list-clusters --query 'clusterArns[]' --output text | tr '\t' '\n' | while read -r…
awsjqclaude
›#043
Athena: audit last 50 queries for bytes-scanned hogs via claude
IDS=$(aws athena list-query-executions --work-group analytics-prod --max-items 50 --query …
awsjqclaude
›#044
Glue: triage last 100 job runs for failure patterns with claude
aws glue get-job-runs --job-name reprocess-events-daily --max-items 100 \ | jq '{ job: "re…
awsjqclaude
›