Crawl4Ai

AG2 now integrates Crawl4AI, an open-source web crawler built for AI agents, language models, and data pipelines. This allows your agents to quickly access and process web data in real time, making automation and data collection more efficient.

import Crawl4AI from "/snippets/reference-tools/crawl4ai.mdx";