Privacy-first AI. No data stored. No subscriptions.
Home User Guide How It Works What to Expect Model Benchmarks Prompt Testing Lab Model Size Matters Ready-Made Prompts Blog Live Demo Command Center Image Studio About GET THE TOOLKIT

OffGrid AI ToolKit - User Guide

Version 2.0 - Complete Offline AI Solution

The OffGrid AI ToolKit is a revolutionary portable AI system that runs entirely from a premium USB 3.2 flash drive without requiring internet connectivity, user accounts, or installation. With billions of parameters of information, it's like having all of mankind's knowledge up to August 2024 in your pocket - completely private, completely offline, completely yours.

Welcome to True AI Independence

What Makes OffGrid AI Special?

  • 100% Offline: Works without any internet connection
  • Portable: Runs from USB drive on any Windows PC
  • Private: Your data never leaves your device
  • Powerful: Multiple AI models including vision capabilities
  • Medical Ready: Includes specialized medical AI model
  • No Surveillance: No tracking, no telemetry, no data collection
  • One-Time Purchase: No subscriptions, ever

Quick Start

3 Simple Steps to Get Started:

  1. Insert USB Drive into any Windows computer
  2. Double-click Launch OffGrid AI ToolKit.exe in the root folder
  3. Accept Terms and start chatting

That's it! No installation, no configuration, no internet needed.

Quick Start Dashboard

System Requirements

Minimum Requirements:

  • OS: Windows 10 or 11 (64-bit)
  • Processor: x64 CPU from 2015 or newer
  • USB: USB 3.0+ port (USB 3.2 recommended for best performance)
  • Storage: 64GB USB drive (included with purchase)

RAM Requirements by Model:

Model Minimum RAM Recommended RAM GPU Best For
Gemma3:4b 6GB 8GB Optional Fast responses, basic tasks
Gemma3:12b 12GB 16GB Helpful Complex analysis, detailed responses
Gemma3:27b 24GB 32GB+ Required Maximum intelligence, vision analysis
MedGemma:4b 6GB 8GB Optional Medical queries (text only)

First Launch Setup

Initial Launch Process:

  1. Locate the Launcher: Find Launch OffGrid AI ToolKit.exe in the USB root folder
  2. Security Prompt: Click "Yes" when Windows asks for permission. You'll see "OffGrid AI ToolKit" as a DigiCert Verified Publisher - this certification means our software has been authenticated and verified as legitimate, protecting you from malware or imposters
  3. Loading Screen: Wait 3-5 seconds while AI models load
  4. Firewall Popups: Click "Allow" on the Ollama and Caddy Windows Firewall prompts (one-time only). Ollama is the AI engine and Caddy is the local web server that powers the interface.
  5. Terms & Conditions: Review and accept the terms (one-time only)
  6. Start Using: Click "START USING OFFGRID AI" button
  7. Dashboard Opens: The main interface opens in the Electron app window

Dashboard Overview

Main Interface Elements:

Top Bar

  • OffGrid AI ToolKit USB Icon (left) - Click or tap to clear chat and return to dashboard
  • Connection Status (right): Green dot = Connected
  • QR Code (far right): For mobile device connection

Navigation Sidebar (Left)

KNOWLEDGE BASE

  • Your offline survival library - Save articles, guides, and AI responses
  • Organized folders: Medical & First Aid, Navigation & Orientation, Water & Food, Shelter & Fire, Emergency Plans, Skills & Reference, Gear & Checklists, OffGrid AI Documentation
  • Save to KB / New Chat / Open Folder quick actions

ONLINE (Online but still private)

  • 🌐 OffGrid AI Online - Access the online version
  • Command Center - Try the Command Center

MOBILE ACCESS

  • 📱 QR Code - Scan to connect your phone/tablet

Main Chat Area

  • Welcome screen with feature badges
  • Quick action buttons for common tasks
  • Chat interface for conversations
  • Model selector dropdown (bottom)
  • Send button (bottom right)
Dashboard Overview

AI Model Selection Guide

Understanding Your Models:

The model selector dropdown appears at the bottom of your chat interface. You can switch models anytime during your conversation.

Gemma3:4b - Quicker Responses

  • Response Time: 30-90 seconds
  • RAM Required: 6-8GB
  • Vision: ✅ Full image analysis
  • Best For: Quick questions, basic tasks, field diagnostics
  • Pro Tip: Start here for instant answers

Gemma3:12b - Balanced Power

  • Response Time: 2-3 minutes
  • RAM Required: 12-16GB
  • Vision: ✅ Full image analysis
  • Best For: Complex analysis, detailed planning, creative writing
  • Pro Tip: Use after 4b for verification and deeper insights

Gemma3:27b - Maximum Intelligence

  • Response Time: ~10 minutes
  • RAM Required: 32GB+ (GPU required)
  • Vision: ✅ Advanced image analysis
  • Best For: Complex reasoning, scenario planning, critical decisions
  • Pro Tip: Switch to this for your most important questions

MedGemma:4b - Medical Specialist

  • Response Time: 30-90 seconds
  • RAM Required: 6-8GB
  • Vision: ❌ Text only
  • Best For: Medical terminology, symptom analysis, health questions
  • Note: Shows tooltip if you try to attach images

Smart Workflow Strategy:

  1. Get a quick answer with Gemma3:4b
  2. Verify and expand with Gemma3:12b
  3. Deep dive with Gemma3:27b for critical analysis

Core Features

Conversation Management

  • Save Conversations: Store up to 50 important chats
  • Export History: Download all saved conversations as text
  • Clear Chat: Start fresh anytime
  • Access Saved: Review previous conversations

Language Translation

  • Support for 100+ languages
  • Cultural context adaptation
  • Multiple translations at once
  • Example: "Translate to Spanish, French, and Japanese:"

Document Processing

  1. Copy any text (even 100+ pages)
  2. Paste into chat
  3. Add instruction: "Summarize:" or "Extract key points:"
  4. Get instant analysis

Image Analysis

  • Identify objects, plants, animals
  • Read text from images
  • Analyze maps and diagrams
  • Technical diagnostics from photos

Ready-Made Prompts

500+ Field-Tested Templates

Access hundreds of professionally crafted prompts organized by category. Each prompt has been tested and optimized for OffGrid AI's specific models.

Ready-Made Prompts Categories

Categories and Subcategories:

Click or tap the ▶ triangle next to each category to expand and see all prompts.

🔥 Survival & Emergency Prompts

  • 💧 Water & Shelter Essentials
  • 🔥 Fire & Warmth
  • 🌿 Food, Foraging & Wilderness Knowledge
  • 🧭 Navigation Without Technology
  • 🩹 First Aid & Medical Emergencies
  • 🏙️ Urban Survival & Grid Down
  • ⚡ Energy & Power
  • 🔧 Practical DIY & Improvisation
  • 🔒 Security & Defense

🏕️ Overlander Prompts

  • 🏕️ Camp Setup & Comfort
  • 🚙 Vehicle Diagnostics & Troubleshooting
  • 🔧 Field Repairs & Tools
  • 🔍 Cooking & Food Management
  • 📡 Emergency Communications
  • 🦎 Wildlife & Environmental Awareness
  • 🛡️ Security & Crisis Response
  • 🌧️ Weather Adaptation

Each subcategory expands to show 10-15 ready-made prompts specifically optimized for OffGrid AI.

How to Use:

  1. Click "Ready-Made Prompts" in sidebar
  2. Browse categories
  3. Single-click any prompt to auto-paste into chat
  4. Modify if needed and send

Coming Soon: Additional prompt packages available at no extra cost. We'll notify you when new categories are released with simple update instructions.

Vision & Image Analysis

Field-Ready Image Analysis

Perfect for identifying plants, animals, equipment, reading maps, analyzing terrain, or documenting findings.

Desktop Usage:

  1. Click camera icon in chat input
  2. Select or capture image
  3. Add your question
  4. Send to analyze

Mobile Usage:

  1. Tap "Take Picture" for instant capture
  2. Or tap "Upload Image" for gallery
  3. Add context or questions
  4. Get analysis in seconds

Field Applications:

  • Wildlife Identification - Animals, tracks, plants
  • Equipment Diagnosis - Mechanical troubleshooting
  • Map Reading - GPS coordinates, trail info
  • Document Capture - Convert notes to text
  • Safety Assessment - Terrain and weather analysis
  • Medical Reference - Educational injury assessment

Note: MedGemma does not support image analysis - use Gemma3 models for vision tasks.

Performance Expectations

Response Times by Model:

Model Response Time With GPU Without GPU
Gemma3:4b 30-90 seconds Faster Standard
Gemma3:12b 2-3 minutes Faster Standard
Gemma3:27b ~10 minutes Required Not recommended
MedGemma:4b 30-90 seconds Faster Standard

Important Notes:

  • No conversation memory between sessions - each prompt is independent
  • One prompt at a time - wait for response before sending next
  • Not ChatGPT level - but the best offline AI available
  • Knowledge cutoff: August 2024

When to Use OffGrid AI:

✅ Off-grid adventures
✅ Emergency situations
✅ Privacy-critical work
✅ Areas with no connectivity
✅ Field research
✅ Quick reference
✅ Language translation
✅ Image analysis

When to Use Cloud AI:

  • Latest news and current events
  • Extended conversations with memory
  • Real-time web browsing
  • Collaborative work
  • Very long document generation

Troubleshooting

Common Issues & Solutions:

"Disconnected" Status

  • Verify launcher is still running
  • Check antivirus isn't blocking
  • Restart launcher if needed

Slow Performance

  • Switch to smaller model (use dropdown)
  • Close other programs
  • Check available RAM in Task Manager
  • Ensure USB is in USB 3.0+ port

Mobile Can't Connect

  1. Confirm firewall setup completed
  2. Both devices on same WiFi
  3. Try manual IP entry
  4. Disable VPN if active

Processes Still Running

If you can't restart the launcher:

  1. Open Task Manager (Ctrl+Shift+Esc)
  2. Look for and end these OffGrid AI ToolKit processes:
    • OffGrid AI ToolKit (may appear multiple times)
    • OffGrid AI ToolKit - Multimodal Assistant
    • Caddy
  3. Once all processes are ended, restart the launcher

Model Won't Load

  • Check available RAM
  • Try smaller model first
  • Restart computer if needed

Tips for Success

Be Patient!

This is a powerful solution but offline models with billions of parameters require significant processing power to run. Response times vary by model and hardware. Remember: you're running AI that rivals cloud services, but entirely on your own device!

📖 See our detailed guide on performance expectations and tips →

Getting Better Responses:

  1. Be Specific - Include context and examples
  2. Use Templates - "Format as a table..."
  3. Chain Prompts - Break complex tasks into steps
  4. Specify Length - "In 100 words" or "Detailed analysis"
  5. Set Tone - "Explain simply" or "Professional report"

Performance Optimization:

  • Start with 4b model, upgrade if needed
  • Clear chat periodically for long sessions
  • Close unnecessary programs
  • Use USB 3.0+ ports only
  • Keep prompts focused

Field Use Tips:

  • Test mobile connection before heading out
  • Save important conversations before moving
  • Use 4b model for time-sensitive situations
  • Keep backup power for extended use
  • Pre-load reference materials
  • Works perfectly with Starlink Mini! - Ideal portable WiFi solution for true off-grid AI access

Privacy & Security

Your Data, Your Control:

  • No Cloud - Everything runs locally
  • No Tracking - Zero analytics or telemetry
  • No Updates - Can't be remotely modified
  • No Dependencies - Works offline forever
  • No Backdoors - Open source, auditable

Security Notes:

  • Keep USB drive physically secure
  • Clear browser cache on public computers
  • Don't share your USB with untrusted sources
  • Export important conversations regularly

⚠️ CRITICAL: Use Only Authentic Copies

OffGrid AI ToolKit requires precise professional duplication. Improper copying methods will fail:

Methods That DON'T Work Properly:

  • Drag and drop copying - Corrupts critical system files
  • Basic file copying - Misses hidden components
  • Consumer duplication software - Lacks required precision
  • Pirated/torrented versions - Often contain malware

Risks of Unauthorized Copies:

  • Fail to load AI models correctly
  • Corrupt during operation causing data loss
  • Provide inaccurate or dangerous information
  • Damage your computer or USB ports
  • Contain malware or security vulnerabilities
  • Crash unexpectedly during critical moments

Want to Share with Friends or Family?

Contact support@offgridaitoolkit.com to request discounted authentic copies. We offer special pricing for multiple units to ensure everyone gets a safe, working version.

We are NOT responsible for any issues arising from pirated, copied, or counterfeit versions.

Support

Need Help?

  • Email: support@offgridaitoolkit.com
  • Response Time: 24-48 hours
  • Priority Support: Available for bulk orders

Online Resources:

Internet connection required for these links

Future Updates:

While OffGrid AI is designed to work forever without updates, customers can request updated prompt packages at no extra cost, and any future USB drives (which we are working on right now) at a 40% discount as a thank you for being part of our OffGrid AI community.

Important: The current release is incredibly powerful with mankind's knowledge up to August 2024 and needs no updates to function. It will continue working offline forever, exactly as it is today. Updates are entirely optional enhancements, not requirements.