Scrapy has moved to GitHub

Scrapy source code, issue tracker and wiki has moved to Github:

 https://github.com/scrapy/scrapy

This wiki was left (in read-only mode) for reference purposes only.

Archived Resources

• Scrapy artwork

Archived Scrapy Enhancement Proposals (SEPs)

Major framework enhancements are typically discussed and proposed as a Scrapy Enhacement Proposal (SEP). Here's a list of all SEPs written so far, grouped by their status:

• Archived / Implemented:
  • SEP-004: Library-like API
  • SEP-008: Item Loaders
  • SEP-012: Spider name
  • SEP-014: Crawl Spider v2
  • SEP-015: ScrapyManager and SpiderManager API refactoring
  • SEP-011: Process models

• Active / Draft / In Progress:
  • SEP-009: Singletons removal
  • SEP-013: Middlewares refactoring
  • SEP-017: Spider Contracts
  • SEP-018: Spider middleware v2

• Obsolete / Discarded:
  • SEP-001: API for populating item fields (comparison)
  • SEP-002: List fields API
  • SEP-003: Nested items fields API
  • SEP-005: Detailed ItemBuilder API use
  • SEP-006: Rename of Selectors to Extractors
  • SEP-007: ItemLoader processors library
  • SEP-010: REST API
  • SEP-016: Leg Spider