New: the Scrapy MCP Server lets AI agents inspect and debug live crawls.

Get started

Download Scrapy

Get the latest stable release of Scrapy to start your data extraction journey.

Stable Release

The recommended version for most users. Fully tested and production-ready.

Download v2.20.0

Changelog

  • Web-browser-like detection of response encodings, base URLs and meta refresh redirects, powered by frostwork
  • Requests can be awaited to get their response
  • Non-asyncio Twisted reactors are deprecated