launched 70B LLM locally on a MacBook on a plane and for a

[mtr]

https://x.com/browomo/status/2049919414485782677

... he gave the orchestrator this system prompt before takeoff:

"You are an offline orchestrator running on a single MacBook. There is no network. The only resources you have are local files in /Users/dev/work, the Llama 70B inference server at localhost:8080, and a battery budget of 3 hours 21 minutes. Process the queue at /Users/dev/work/queue.jsonl (one client task per line). For each task: draft → run local evals → save artefact to /Users/dev/work/done/. Save context checkpoints every 12 tasks so you can resume after a battery swap. Stop only on empty queue or when battery drops below 5%."

So the system knows exactly what resources it is running on.

[joe]