Changeset 1844:2b62ebaf5f98

Show
Ignore:
Timestamp:
11/13/09 14:38:22 (9 months ago)
Author:
Pablo Hoffman <pablo@…>
Branch:
default
Message:

renamed REQUESTS_PER_SPIDER setting to CONCURRENT_REQUESTS_PER_SPIDER

Files:
3 modified

Legend:

Unmodified
Added
Removed

  • docs/topics/settings.rst

    r1843 r1844  
    726726:setting:`REQUEST_HANDLERS` instead.  
    727727 
    728 .. setting:: REQUESTS_PER_SPIDER 
    729  
    730 REQUESTS_PER_SPIDER 
    731 ------------------- 
     728.. setting:: CONCURRENT_REQUESTS_PER_SPIDER 
     729 
     730CONCURRENT_REQUESTS_PER_SPIDER 
     731------------------------------ 
    732732 
    733733Default: ``8`` 

  • scrapy/conf/default_settings.py

    r1843 r1844  
    2626 
    2727CONCURRENT_ITEMS = 100 
    28  
     28CONCURRENT_REQUESTS_PER_SPIDER = 8 
    2929CONCURRENT_SPIDERS = 8 
    3030 
    … …  
    137137 
    138138REQUESTS_QUEUE_SIZE = 0 
    139 REQUESTS_PER_SPIDER = 8     # max simultaneous requests per domain 
    140139 
    141140# contrib.middleware.retry.RetryMiddleware default settings 

  • scrapy/core/downloader/manager.py

    r1831 r1844  
    2828            self.max_concurrent_requests = 1 
    2929        elif max_concurrent_requests is None: 
    30             self.max_concurrent_requests = settings.getint('REQUESTS_PER_SPIDER') 
     30            self.max_concurrent_requests = settings.getint('CONCURRENT_REQUESTS_PER_SPIDER') 
    3131        else: 
    3232            self.max_concurrent_requests =  max_concurrent_requests