Off-grid AI: a private assistant for rural and off-grid households

The heaviest internet use is at the start: the app, then the brain. Sovereign's brains range from about 2.5 GB to about 63 GB. If your home connection is slow or capped, download at a library, a friend's house or anywhere with fast Wi-Fi — the download resumes if it drops.

After that, chat uses no internet. Resyncing your Vault later only copies new memories down, which is a small transfer compared with the download you already did.

That shape — one large transfer, then almost nothing — is what makes local AI a better fit than cloud AI for metered connections. You can plan around one known number instead of wondering what today's usage will be.

The smallest brain is a good first choice on a tight connection: about 2.5 GB, and it runs on a machine with 8 GB of memory. Many people find it's enough for daily questions, drafting and explaining.

If you can get to fast Wi-Fi once, Balanced (about 9 GB, needs 16 GB of memory) is the sensible all-rounder and a common second step. Bigger brains — 18.6 GB, 32.5 GB, 63.4 GB — are worth it only if your computer can run them comfortably and the download is genuinely convenient.

You can switch brains later without losing anything, so there's no reason to make the biggest download your first one.

A laptop running a local AI works hard while it writes an answer and goes quiet when it's done. Day to day, it's similar to other demanding tasks for short bursts. Smaller brains finish faster and use less energy. A laptop is much easier to run from solar or batteries than a desktop tower.

The practical numbers are the ones you can measure on your own system: how long your laptop lasts with the app open, and what your solar or generator setup can recharge in a day. If your computer already survives an ordinary day off-grid, it will survive this.

One habit helps a lot: write in batches. Ask your questions, read the answers, then close the app. It's the same advice you'd give for stretching a battery while reading a book.

• 8 GB of memory runs the Faster brain.
• 16 GB runs Balanced, which most people will be happy with.
• 32 GB or more opens the more capable brains.
• Recent Macs with Apple chips are especially efficient for local AI (M1 or newer is required).
• Leave plenty of free disk space for the brain plus room to spare.
• A machine you could live without for a week is a better off-grid machine than your only computer.

Sovereign reads your computer before offering brains and greys out anything your machine can't run, so you won't waste an afternoon on a download that wouldn't have worked.

• Planning planting, rotation and preservation around your seasons.
• Understanding a piece of equipment before you open it up.
• Homeschool lessons and explanations when kids have questions.
• Drafting letters, records and household plans.
• Asking about your own notes, kept in your Vault.
• Troubleshooting: describing a symptom and working through possible causes with you.
• Comparing options: what to look for in a charge controller, a filter, or a breed of chicken.
• Keeping a journal: a place to think out loud that doesn't need a signal to work.

There's no single right configuration, because off-grid households differ from each other more than city ones do. But one shape has more luck than most:

• One laptop that stays charged and is not anyone's only computer.
• The smaller or middle brain — the one whose download you can finish in an afternoon — rather than the biggest your machine could technically run.
• A Vault holding the household's own facts: the well, the septic system, the wood stove, the fence plan, the animals, the garden notes, the medical details you'd want in a bad week.
• A resync habit tied to something you already do — before each season, or every time you're back on fast Wi-Fi.
• The Recovery Key written down with the deed and the insurance papers, and one other person who knows it exists.

Notice that four of those five are habits, not purchases. The download is the easy part; what makes a local AI useful on a homestead is that your own records are inside it.

It also fails gently. If the laptop dies, you still have your Online Vault, your printed folder, and a fresh install waiting. Nothing you depended on lives in someone else's building.

The first week you'll test it. The second week you'll forget it's there. The third week you'll reach for it in the middle of a problem and realize you've stopped thinking of it as software.

Expect a few disappointments: it won't know your local brands, it will guess at a model number you read wrong, and it can't tell you the weather. Keep your printed manuals and your radio, and it stays a good tool instead of a disappointing oracle.

Expect one or two surprises as well — usually something small, like it connecting two notes you wrote a year apart, or explaining a piece of your own equipment back to you more clearly than the manual ever did.

Your chats stay on your computer. Sovereign never uploads them automatically, and you can block its internet access entirely with the Network switch. If you ever want to leave, it erases completely.

For people who chose off-grid life partly to be less legible to distant companies, this matters more than a feature list. Your questions about your land, your finances and your family don't become someone else's data.

The local Vault is encrypted and protected by a Recovery Key only you hold. Write it down and keep it with your papers — losing it means losing the Vault, and no one can restore it for you.

• Do the big download somewhere with fast Wi-Fi: a library, a town cafe, a relative's house. Sovereign resumes a interrupted download rather than starting over.
• Keep the app installed and the brain on the machine; then a week with no connection costs you nothing.
• Batch your resyncs. Copy your Vault down before a stretch without service, not during it.
• Keep a phone hotspot as a deliberate, occasional tool — for updates and downloads — rather than something running in the background.

A local AI is only as current as the last time you resynced. The Vault copy on your laptop is a photograph of your Online Vault taken when you last asked for it; anything you added since isn't there.

That gives it a simple rhythm: resync before a stretch without service, not during it. Before you drive out to the cabin. Before storm season. Once a quarter if nothing else prompts you. The transfer itself is small — new memories only — compared with the brain download you already did.

It also changes what you keep in the Vault. Notes on your own land, your own equipment, your own animals and gardens are exactly the material a general model can't know and your local AI can be told. Add them once Online and they come down with every resync.

The one habit worth avoiding: assuming your laptop knows what you added yesterday. If it matters, resync first.

An off-grid tool only one person can operate is a fragile tool. Sovereign is a normal app — you open it, you type, you read — so the barrier to handing it to a partner, a teenager or a parent is low.

Two things make it stick. First, do the setup in front of someone rather than for them, so the part they might eventually have to redo — choosing a brain, starting a download — isn't a mystery. Second, give them a question that's actually theirs. People don't learn a tool by watching; they learn it by asking something they care about.

Write down the two facts everyone needs: which laptop stays charged, and where the Recovery Key lives. That's the whole manual.

It won't tell you the weather, the market price, or whether the road is open. Keep the radio, the paper calendar and the printed manuals — an off-grid household that outsources its awareness to any single device is one dead battery away from being surprised.

What it does instead is sit on the other end of those things: explaining what the forecast terms actually mean, helping you write the plan the radio makes necessary, and answering the follow-up question your manual doesn't anticipate.

Anything that depends on right-now information: weather turning, road closures, market prices, a neighbor's status. Those need a radio, a phone, or your own eyes.

Anything safety-critical that needs a precise number: water treatment ratios, canning times and temperatures, medication doses. Use your printed references and official guidance.

And if your computer is old enough that ordinary work is a struggle, a local AI won't feel like a gift. Fix the computer first; the AI is a lot better on hardware that isn't already gasping.