AI Chat

About This Tool

How to Use
  1. Select an AI model from the dropdown (smaller = faster download)
  2. Click 'Load Model' to download and cache the model in your browser
  3. Wait for the download to complete (700MB–2GB depending on model)
  4. Type your message and press Enter or click Send; click Stop to end a long reply
  5. Optionally expand 'System Prompt' to customize the assistant's behavior
  6. Pick another model and click 'Switch Model' to compare, or 'Clear Chat' to start fresh
Common Use Cases
  • Private AI conversations with no data sent to any server
  • Offline AI assistance when internet is unavailable
  • Testing LLM behavior without API costs
  • Experimenting with different system prompts
  • Sensitive questions you don't want sent to cloud AI services
Tips & Tricks
  • The model is cached after the first download — later visits skip the download
  • Smaller models (Llama 3.2 1B) are faster but less capable
  • Larger models (Phi 3.5 Mini) give better answers but need more RAM/VRAM
  • Needs a browser with WebGPU, such as a recent Chrome, Edge or Safari
  • The models read about 4,000 tokens at once; in long chats the oldest messages are left out
  • Close other GPU-heavy tabs if the model fails to load

Related Tools

AI Code Explainer

Paste a code snippet and get AI explanations, bug detection or improvement ideas. Runs in your browser with WebLLM; your code never leaves your device.

Speech Studio

Read text aloud with browser or on-device Piper voices and download WAV audio, or transcribe your speech live with the browser's speech recognition.

Regex Query Helper & Explainer

Test regular expressions on your own text with live match highlighting, capture groups and a plain-English breakdown of each part of the pattern.

Loan & Mortgage Calculator

Calculate monthly payments, total interest and payoff date for any fixed-rate loan, see what extra payments save, and view the schedule by month or year.