Skip to content
Parameters 8BLlama 3.1 Community LicenseEstimated

Llama 3.1 8B Instruct

能在 8GB 显存的普通显卡上本地跑起来的中等模型。

Official source:https://github.com/meta-llama/llama-modelsMetaYou are leaving AIWorksWell for Meta. That site is not under our control; its content, privacy and security are its own responsibility. Please judge for yourself.

What hardware it needs

Estimated
Parameters
8B
Architecture
Dense
Context
128K
License
Llama 3.1 Community License
Min VRAM
6G
RAM (CPU-only)
8G
Download size
—G

Requirements by quantisation

The same model at different quantisations is a different download — the most common misjudgement in local AI.

Suggested quantisationSizeMin VRAMQuality
F1632G37GOriginal precision
Q8_017G20GPractically lossless
Q6_K13.1G15GNear lossless
Q5_K_M11.4G13GVery good
Q4_K_M★9.8G11GBest value for most people
Q3_K_M8G9GNoticeable loss
Q2_K6.1G7.5GLast resort only

Method:显存为 Q4_K_M 档参考

Your device

A plain-language profile of every model you can run yourself: parameter count, hardware it needs, which quantisation fits. No rankings, no prices — just what it takes to run.

Save your device profile once and this page will tell you whether it runs on your machine.Add your device·No account? Try a one-off check

Install prompt

Copy it, paste it into your AI (Claude Code, Codex, ChatGPT…), and it installs and verifies for you.

43 lines
我需要你帮我在我的机器上安装并运行一个软件。

【软件信息】
名称:Llama 3.1 8B Instruct
用途:能在 8GB 显存的普通显卡上本地跑起来的中等模型。
官方来源:https://github.com/meta-llama/llama-models
许可:Llama 3.1 Community License
Scroll inside the box with your mouse wheel — copying still gives you the full prompt1249 chars

Copy → paste into your own AI → it installs for you

About this entry

它是什么

Llama 3.1 8B Instruct 是"本地跑得动"和"够用"之间最常见的那个平衡点:8B 参数量、支持 128K 上下文,社区量化版本(GGUF)齐全,几乎每个本地推理工具都支持。来源:https://github.com/meta-llama/llama-modelshttps://github.com/meta-llama/llama-models

怎么用起来

本地跑:装一个推理工具(Ollama / LM Studio / llama.cpp),拉 Q4_K_M 量化版本即可。它不是一个网站,而是一份权重——需要在你自己的机器上运行。来源:https://github.com/meta-llama/llama-modelshttps://github.com/meta-llama/llama-models

以上坑来自 https://github.com/meta-llama/llama-modelshttps://github.com/meta-llama/llama-models 与官方文档。

来源与署名

Mentioned from:https://github.com/meta-llama/llama-modelshttps://github.com/meta-llama/llama-models · 原作者 Meta(Llama 3.1 Community License)。