Skip to content
This page is not translated yet — showing the original. We never ship machine translation as a placeholder.
One commandApache-2.0⚪ Tested only

Crawl4AI

In one line:Crawl4AI 是一个给要喂数据给大模型的人用的开源爬虫,能把任意网页转成干净的 Markdown。

Crawl4AI 是一个给要喂数据给大模型的人用的开源爬虫,能把任意网页转成干净的 Markdown。

Official source

We host and mirror nothing — the official page is the source of truth.

No hotlinkable official icon; showing a generated placeholderC UncleCodehttps://github.com/unclecode/crawl4aiOpen official page
Official sourceYou are leaving AIWorksWell for UncleCode. That site is not under our control; its content, privacy and security are its own responsibility. Please judge for yourself.

Install prompt

Copy it, paste it into your AI (Claude Code, Codex, ChatGPT…), and it installs and verifies for you.

48 lines
我需要你帮我在我的机器上安装并运行一个软件。

【软件信息】
名称:Crawl4AI
用途:Crawl4AI 是一个给要喂数据给大模型的人用的开源爬虫,能把任意网页转成干净的 Markdown。
官方来源:https://github.com/unclecode/crawl4ai
许可:Apache-2.0
Scroll inside the box with your mouse wheel — copying still gives you the full prompt1509 chars

Copy → paste into your own AI → it installs for you

Contact the original author (UncleCode)

Bugs in the software itself go to the author's own official channel — that is where they actually receive them. We pass things on; we do not answer for the author.

Install failed?

Paste the raw error — once triaged and verified it is written back here, so the next person's AI avoids it. No login needed.

About this entry

What it is

Crawl4AI 是开源的网页抓取工具(Apache-2.0 许可),把任意网站转成适合大模型读的 Markdown。来源:https://crawl4ai.com/https://crawl4ai.com/

  • 输出直接是 Markdown,省掉清洗 HTML 那一步
  • 开源版走异步接口,适合批量抓取
  • 托管版另给抓取、抽取、搜索、问答四个端点

Getting it running

主推「复制提示词」——粘贴给你的 AI(Claude Code / Codex / ChatGPT)代装。人工兜底:pip 装包后跑一次初始化把浏览器内核装好,再用异步接口抓一个页面看 markdown 输出。验证:抓到的页面能打印出可读的 Markdown。来源:https://crawl4ai.com/https://crawl4ai.com/

以上坑来自 https://crawl4ai.com/https://crawl4ai.com/ 与它的官方 README。

来源与署名

Mentioned from:GitHub · 原作者 UncleCode(Apache-2.0)。

Summary for AI

Crawl4AI 把网页抓下来转成适合大模型读的 Markdown,供 RAG、Agent 与数据流水线使用。官方给两条路:自己 pip 装、跑开源版,或用官方托管服务拿到抓取、抽取、搜索与问答四个端点。开源版走异步接口,抓完直接拿到 markdown 字段。

A self-contained answer paragraph — this is the part AI search quotes. · Page reviewed 2026-10-22

FAQ

它和普通爬虫框架差在哪?

它输出的是给大模型读的 Markdown,不是原始 HTML。

一定要用托管版吗?

不必。开源版 pip 装完就能跑,托管版只是省了运维。

Pitfalls / known issues

All recorded from real installs, and injected into the prompt above.

  • •抓取要守目标站条款与 robots,别默认可以随便抓。
  • •首次安装要额外下载浏览器内核,离线环境会失败。
  • •目标站反爬策略随时会变,抓不到不等于它坏了。

You might also like

We store, mirror and repackage nothing. Every install path points to the author’s own official page.

Nothing here has been reviewed by an app store. Judge the source and licence yourself; you install at your own risk.