Timeline
06/11/10:
- 18:16 Changeset [2064:b4b34e2fb1d7] by
-
utils.serialize: added support for encoding Deferreds, and to refer ...
- 18:14 Changeset [2063:baf1f0f226c2] by
-
scrapy-ws.py: added stop command
- 17:22 Changeset [2062:8f378283e76c] by
-
Added SQS Execution Queue, and example script to add spiders to the queue
- 14:57 AptRepos edited by
- (diff)
- 13:09 Changeset [2061:a4e19e806d06] by
-
Populate annotation metadata with data not used by IBL extractor.
- 12:48 Changeset [2060:e0e9fb535319] by
-
debian package: fix dh_auto_build confusing with Makefile, added ...
- 11:39 AptRepos edited by
- (diff)
- 11:33 Changeset [2059:39a5d3fd8e83] by
-
Added Ping Yin to AUTHORS
- 10:34 AptRepos edited by
- (diff)
- 02:00 WikiStart edited by
- (diff)
- 01:58 SEP-011 edited by
- (diff)
- 01:57 Ticket #168 (Add support for running Scrapy as a service) closed by
- fixed: Support for running Scrapy as a service has been added in r1988, r2054, …
- 01:55 Scrapy09Changes edited by
- (diff)
- 01:52 Ticket #168 (Add support for running Scrapy as a service) created by
- A frequently asked question is how to run Scrapy in production, as a …
- 01:18 Changeset [2058:9c3aef431bdf] by
-
Added sources and Makefile for building Debian package
- 00:08 AptRepos edited by
- (diff)
06/10/10:
- 23:11 AptRepos edited by
- (diff)
- 23:10 AptRepos created by
- 23:04 WikiStart edited by
- (diff)
- 22:59 WikiStart edited by
- (diff)
- 14:50 Changeset [2057:0c595869ce44] by
-
scrapy.service: fixed minor logging bug on win32 platform with different ...
- 14:08 Changeset [2056:274028b61540] by
-
scrapy.service: added support for logging stdout/stderr tails of finished ...
- 13:39 Changeset [2055:07368bdcb213] by
-
scrapy.service: fixed bug with process respawning
- 11:51 Changeset [2054:828aa5b773d8] by
-
some improvements and fixes to scrapy.service
- 10:28 SEP-017 edited by
- (diff)
- 10:17 SEP-017 edited by
- (diff)
- 10:13 SEP-017 created by
- 09:51 WikiStart edited by
- (diff)
06/09/10:
- 19:45 Ticket #99 (Refactor link extractors with pluggable URL canonicalizers) closed by
- fixed: This was done as part of CrawlSpider-v2, but we'll probably revisit it …
- 19:44 Ticket #141 (Crawl Spider v2 (SEP-014)) closed by
- fixed: I'll close this ticket, since CrawlSpider-v2 is finished and committed …
- 19:40 WikiStart edited by
- (diff)
- 19:40 SEP-010 edited by
- (diff)
- 13:52 Scrapy09Changes edited by
- (diff)
- 13:50 Ticket #167 (Scrapy web service) closed by
- fixed: Added web service in r2053, and also deprecated web console.
- 13:49 Ticket #167 (Scrapy web service) created by
- Add web service for controlling a Scrapy process. This would replace …
- 13:46 Changeset [2053:b47a2a5d0050] by
-
* Added Scrapy Web Service with documentation and tests. * Marked Web ...
- 13:06 Changeset [2052:2147ee1efe3c] by
-
removed obsolete test
- 00:44 Changeset [2051:d3bb342fa623] by
-
fix broken request tests. refs #166
06/08/10:
- 18:28 Scrapy09Changes edited by
- (diff)
- 18:27 Ticket #166 (Support requests without callbacks) closed by
- fixed: Done in r2050
- 18:18 Changeset [2050:fae477ffa3ff] by
-
Added support for Requests without callbacks (#166) - the Spider.parse() ...
- 16:14 Ticket #166 (Support requests without callbacks) created by
- We need to add support to the Scrapy engine for working with Requests …
06/07/10:
- 15:11 Changeset [2049:e8bc420f1da8] by
-
Relocated some modules: * scrapy.spider.middelware moved to ...
06/04/10:
- 03:39 SEP-016 edited by
- (diff)
- 03:26 SEP-016 edited by
- (diff)
- 03:08 SEP-016 edited by
- (diff)
- 00:42 SEP-016 edited by
- (diff)
06/03/10:
- 20:09 WikiStart edited by
- (diff)
- 20:08 SEP-016 edited by
- (diff)
- 20:08 SEP-016 edited by
- (diff)
- 20:07 SEP-016 edited by
- (diff)
- 20:05 SEP-016 edited by
- (diff)
- 20:05 SEP-016 created by
- 01:07 Changeset [2048:1a4145ffc3bb] by
-
removed unused code
06/02/10:
- 17:56 Scrapy09Changes edited by
- (diff)
- 17:51 Ticket #165 (Add support for extending local telnet console variables) closed by
- fixed: Done in r2047.
- 17:49 Changeset [2047:3de208cec80f] by
-
Some changes to telnet console:
* moved module from ...
- 17:48 Ticket #165 (Add support for extending local telnet console variables) created by
- We should add support for extending the variables available in telnet …
06/01/10:
- 13:49 Changeset [2046:b8ef4b9a2fe3] by
-
Core logic improvement: wait for Downloader and Scraper to close the ...
- 11:07 Changeset [2045:6017f1c138c5] by
-
Fixed bug that was causing the engine to notify the manager of spider ...
05/29/10:
- 17:01 Ticket #164 (many items, slow pipeline) created by
- This ticket is being created as a result of the discussion at this google …
05/28/10:
- 15:45 Ticket #163 (Multi Threaded Crawl) created by
- I have been using for some time now. Lately i felt need for multi threaded …
05/27/10:
- 13:33 Ticket #114 (Port Spiderctl web module to use spider references) closed by
- wontfix: Webconsole will be deprecated and replaced by REST web services.
- 13:31 CrawlerThread edited by
- (diff)
05/26/10:
- 12:03 Scrapy09Changes edited by
- (diff)
- 10:57 Scrapy09Changes edited by
- (diff)
- 10:49 Scrapy09Changes edited by
- (diff)
05/25/10:
- 15:24 Ticket #162 (scheduler.py outputs invalid HTML if no iterations are done.) created by
- 23: s += "<ul>\n" 32: s += "</ul>\n" These two lines …
- 15:08 Ticket #161 (spiderctl.py creates broken HTML) created by
- s += '<table border=1">\n' Line 44, Lacks a "
- 15:01 Ticket #160 (enginestatus.py closes tags in wrong order) created by
- s += "<pre><code>\n" s += get_engine_status() s …
05/20/10:
- 14:03 Ticket #159 (Add Proxy CONNECT support (fixes bug with https urls and proxies)) created by
- Proxy CONNECT support is required for https urls to work. When …
05/17/10:
05/14/10:
- 16:51 Ticket #129 (Add dependency to BeautifulSoup and ClientForm) closed by
- wontfix: Both BeautifulSoup? and ClientForm? are intended to be shipped embedded with …
- 16:03 Ticket #152 (Spider constructor arguments) closed by
- fixed: Done in r1978.
- 15:56 Scrapy09Changes edited by
- (diff)
05/13/10:
- 00:17 Ticket #158 (Scrapy shell "view(response)" traceback with python2.5) closed by
- duplicate: already fixed, see #145
05/12/10:
- 19:37 Ticket #158 (Scrapy shell "view(response)" traceback with python2.5) created by
- Hello, A Debian user submitted a bug about the "view(response)" key …
- 17:06 Scrapy09Changes edited by
- (diff)
- 17:01 Ticket #157 (HttpErrorMiddleware: Notify of dropped responses calling request errback) closed by
- fixed: fixed by [29fb46c3ae92]
- 16:59 Ticket #157 (HttpErrorMiddleware: Notify of dropped responses calling request errback) created by
- When a requests is ignored by HttpErrorMiddleware? because response is …
