What Your Laptop Can Actually Run
Before you install anything, it helps to know what your computer is capable of. The good news: local AI runs on ordinary laptops, not just gaming rigs. The honest news: the size of the model you can run comfortably depends mostly on how much memory you have. This lesson gives you a simple reality check so you pick a model that runs smoothly instead of one that crawls.
You will not need to know any technical specs by heart. We will translate everything into plain language and a simple lookup.
What You'll Learn
- The one number that matters most: your memory (RAM)
- How to find out how much memory your computer has
- What "model size" means and how it maps to memory
- A simple guide to what each memory tier can run comfortably
The One Number That Matters: RAM
RAM (random access memory) is your computer's short-term working memory. When a model runs, it has to be loaded into memory, so the amount of RAM you have sets the ceiling on how big a model you can run. A model that does not fit in memory either refuses to run or slows to a painful crawl.
If your computer has a dedicated graphics card (a GPU), especially an NVIDIA one, that card's own memory (called VRAM) makes models run much faster. But you do not need a GPU to start. On modern Apple laptops (the M-series chips), the processor and memory are combined in a way that runs local AI very well out of the box. And on a regular laptop with no graphics card, models still run using your processor, just more slowly.
Quick takeaway: More RAM lets you run bigger, smarter models. A graphics card makes them faster. Neither is strictly required to begin.
How to Check Your Memory
Finding your RAM takes ten seconds:
- Windows: Press the Windows key, type "About your PC," and open it. Look for "Installed RAM."
- Mac: Click the Apple menu in the top-left, choose "About This Mac," and read the "Memory" line.
Write the number down. Most laptops sold in the last few years have 8 GB or 16 GB. That is plenty to get started.
What "Model Size" Means
Local models come in different sizes, measured in billions of parameters, written with a "B." You will see names like "8B" or "3B." Think of parameters as the number of little dials inside the model. More dials generally means a smarter, more capable model, but also a bigger file that needs more memory to run.
A rough rule of thumb for beginners:
- 1B to 4B: small and fast, great for quick drafting and simple questions
- 7B to 9B: the sweet spot for most people, capable and still runs on common laptops
- 13B and up: noticeably smarter but needs a well-equipped machine
You do not have to memorize this. Both tools we use will help you pick, and the next lesson on choosing models goes deeper. For now, just connect the idea: bigger number, more memory needed.
Match Your Memory to a Model
Here is the practical lookup. These are comfortable, beginner-friendly starting points, not hard limits. The exact fit also depends on "quantization," a compression trick we cover in the choosing-a-model lesson, but this table already assumes the everyday compressed versions that both tools download by default.
Comfortable starting points by memory. Start smaller if unsure; you can always try a bigger model later.
| Criteria | 8 GB RAM | 16 GB RAM | 32 GB or more |
|---|---|---|---|
| Comfortable model size | Up to about 7-8B | Up to about 13-14B | 20B and beyond |
| Good starter model | A 3B or 7-8B model | An 8B model | A larger model, your pick |
| What it feels like | Snappy on small, fine on 7-8B | Smooth for most tasks | Room to run bigger models |
| Everyday tasks (chat, drafts, summaries) | Yes | Yes | Yes |
8 GB RAM
- Comfortable model size
- Up to about 7-8B
- Good starter model
- A 3B or 7-8B model
- What it feels like
- Snappy on small, fine on 7-8B
- Everyday tasks (chat, drafts, summaries)
- Yes
16 GB RAM
- Comfortable model size
- Up to about 13-14B
- Good starter model
- An 8B model
- What it feels like
- Smooth for most tasks
- Everyday tasks (chat, drafts, summaries)
- Yes
32 GB or more
- Comfortable model size
- 20B and beyond
- Good starter model
- A larger model, your pick
- What it feels like
- Room to run bigger models
- Everyday tasks (chat, drafts, summaries)
- Yes
Notice the last row: every tier handles everyday tasks well. Even an 8 GB laptop can chat, draft emails, and summarize documents with a small or mid-size model. You do not need an expensive machine to get real value from this course.
A Simple Way to Decide
If you are not sure where to start, follow this:
Decision
How much RAM does your computer have?
- If 8 GB
Start with a small model (about 3B), then try a 7-8B model
Close other heavy apps for a smoother run
- If 16 GB
Start with a 7-8B model
The comfortable sweet spot for most people
- If 32 GB or more
Try a 7-8B model first, then step up to 13B+
You have room to experiment
A Word on Storage and Patience
Two small practical notes. First, model files take up disk space, often several gigabytes each. Make sure you have some free storage before downloading a few to try. You can always delete ones you do not like. Second, the very first time you use a model there is a one-time download, which can take a few minutes on a normal connection. After that, it loads from your disk and needs no internet.
Key Takeaways
- RAM is the number that matters most. It sets the ceiling on how big a model you can run. Check yours in About This Mac or About Your PC.
- A graphics card (or an Apple M-series chip) makes models run faster, but you can start without one.
- Model size is measured in billions of parameters ("B"); bigger means smarter but hungrier for memory.
- As a starting point: 8 GB runs up to roughly 7-8B, 16 GB up to roughly 13-14B, and 32 GB and up can go further.
- Every tier handles everyday chatting, drafting, and summarizing. When unsure, start with a smaller model and step up later.