Python 的高层网页抓取框架，帮你快速写爬虫，自动处理请求调度、页面解析和数据提取，适合大规模采集任务。
把 Scrapy 爬虫包装成 HTTP API，让其他语言或服务能远程触发爬虫并实时拿到抓取结果，省去自己搭调度和传输层。
PHP 版网页抓取工具，提供类似 BeautifulSoup 的简洁 API，可解析 HTML、提取页面数据，并支持无头浏览器渲染动态页面。
…ntrolling a running crawl over HTTP, used by the [Scrapy MCP server](https://docs.scrapy.org/en/latest/topics/agents.html using-the-mcp-server) - Experimental aiohttp -ba
…llowed TLS versions [Full Changelog](https://docs.scrapy.org/en/latest/news.html scrapy-2-17-0-2026-07-07)
…for Twisted 26.4.0+ [Full Changelog](https://docs.scrapy.org/en/latest/news.html scrapy-2-16-0-2026-05-19)
…ks by @pawelmhm in https://github.com/scrapinghub/scrapyrt/pull/158 Make the errback handling method configurable by @radostyle in https://github.com/scrapinghub/scrapyrt
fix compatibility with scrapy 2.10 https://github.com/scrapinghub/scrapyrt/pull/150 drop end of life pythons (3.6, 3.7) add python 3.11 support
add support for specifying Twisted reactor in Scrapy settings or ScrapyRT settings, fixes https://github.com/scrapinghub/scrapyrt/issues/132 drop Python 3.5 support add P