Timeline


and .

06/11/10:

18:16 Changeset [2064:b4b34e2fb1d7] by Pablo Hoffman <pablo@…>

utils.serialize: added support for encoding Deferreds, and to refer ...

18:14 Changeset [2063:baf1f0f226c2] by Pablo Hoffman <pablo@…>

scrapy-ws.py: added stop command

17:22 Changeset [2062:8f378283e76c] by Pablo Hoffman <pablo@…>

Added SQS Execution Queue, and example script to add spiders to the queue

14:57 AptRepos edited by daniel
(diff)
13:09 Changeset [2061:a4e19e806d06] by olveyra

Populate annotation metadata with data not used by IBL extractor.

12:48 Changeset [2060:e0e9fb535319] by Pablo Hoffman <pablo@…>

debian package: fix dh_auto_build confusing with Makefile, added ...

11:39 AptRepos edited by pablo
(diff)
11:33 Changeset [2059:39a5d3fd8e83] by Pablo Hoffman <pablo@…>

Added Ping Yin to AUTHORS

10:34 AptRepos edited by pablo
(diff)
02:00 WikiStart edited by pablo
(diff)
01:58 SEP-011 edited by pablo
(diff)
01:57 Ticket #168 (Add support for running Scrapy as a service) closed by pablo
fixed: Support for running Scrapy as a service has been added in r1988, r2054, …
01:55 Scrapy09Changes edited by pablo
(diff)
01:52 Ticket #168 (Add support for running Scrapy as a service) created by pablo
A frequently asked question is how to run Scrapy in production, as a …
01:18 Changeset [2058:9c3aef431bdf] by Pablo Hoffman <pablo@…>

Added sources and Makefile for building Debian package

00:08 AptRepos edited by daniel
(diff)

06/10/10:

23:11 AptRepos edited by pablo
(diff)
23:10 AptRepos created by pablo
23:04 WikiStart edited by pablo
(diff)
22:59 WikiStart edited by pablo
(diff)
14:50 Changeset [2057:0c595869ce44] by Pablo Hoffman <pablo@…>

scrapy.service: fixed minor logging bug on win32 platform with different ...

14:08 Changeset [2056:274028b61540] by Pablo Hoffman <pablo@…>

scrapy.service: added support for logging stdout/stderr tails of finished ...

13:39 Changeset [2055:07368bdcb213] by Pablo Hoffman <pablo@…>

scrapy.service: fixed bug with process respawning

11:51 Changeset [2054:828aa5b773d8] by Pablo Hoffman <pablo@…>

some improvements and fixes to scrapy.service

10:28 SEP-017 edited by pablo
(diff)
10:17 SEP-017 edited by pablo
(diff)
10:13 SEP-017 created by pablo
09:51 WikiStart edited by pablo
(diff)

06/09/10:

19:45 Ticket #99 (Refactor link extractors with pluggable URL canonicalizers) closed by pablo
fixed: This was done as part of CrawlSpider-v2, but we'll probably revisit it …
19:44 Ticket #141 (Crawl Spider v2 (SEP-014)) closed by pablo
fixed: I'll close this ticket, since CrawlSpider-v2 is finished and committed …
19:40 WikiStart edited by pablo
(diff)
19:40 SEP-010 edited by pablo
(diff)
13:52 Scrapy09Changes edited by pablo
(diff)
13:50 Ticket #167 (Scrapy web service) closed by pablo
fixed: Added web service in r2053, and also deprecated web console.
13:49 Ticket #167 (Scrapy web service) created by pablo
Add web service for controlling a Scrapy process. This would replace …
13:46 Changeset [2053:b47a2a5d0050] by Pablo Hoffman <pablo@…>

* Added Scrapy Web Service with documentation and tests. * Marked Web ...

13:06 Changeset [2052:2147ee1efe3c] by Pablo Hoffman <pablo@…>

removed obsolete test

00:44 Changeset [2051:d3bb342fa623] by Daniel Grana <dangra@…>

fix broken request tests. refs #166

06/08/10:

18:28 Scrapy09Changes edited by pablo
(diff)
18:27 Ticket #166 (Support requests without callbacks) closed by pablo
fixed: Done in r2050
18:18 Changeset [2050:fae477ffa3ff] by Pablo Hoffman <pablo@…>

Added support for Requests without callbacks (#166) - the Spider.parse() ...

16:14 Ticket #166 (Support requests without callbacks) created by pablo
We need to add support to the Scrapy engine for working with Requests …

06/07/10:

15:11 Changeset [2049:e8bc420f1da8] by Pablo Hoffman <pablo@…>

Relocated some modules: * scrapy.spider.middelware moved to ...

06/04/10:

03:39 SEP-016 edited by pablo
(diff)
03:26 SEP-016 edited by pablo
(diff)
03:08 SEP-016 edited by pablo
(diff)
00:42 SEP-016 edited by pablo
(diff)

06/03/10:

20:09 WikiStart edited by pablo
(diff)
20:08 SEP-016 edited by pablo
(diff)
20:08 SEP-016 edited by pablo
(diff)
20:07 SEP-016 edited by pablo
(diff)
20:05 SEP-016 edited by pablo
(diff)
20:05 SEP-016 created by pablo
01:07 Changeset [2048:1a4145ffc3bb] by Pablo Hoffman <pablo@…>

removed unused code

06/02/10:

17:56 Scrapy09Changes edited by pablo
(diff)
17:51 Ticket #165 (Add support for extending local telnet console variables) closed by pablo
fixed: Done in r2047.
17:49 Changeset [2047:3de208cec80f] by Pablo Hoffman <pablo@…>

Some changes to telnet console:

* moved module from ...

17:48 Ticket #165 (Add support for extending local telnet console variables) created by pablo
We should add support for extending the variables available in telnet …

06/01/10:

13:49 Changeset [2046:b8ef4b9a2fe3] by Pablo Hoffman <pablo@…>

Core logic improvement: wait for Downloader and Scraper to close the ...

11:07 Changeset [2045:6017f1c138c5] by Pablo Hoffman <pablo@…>

Fixed bug that was causing the engine to notify the manager of spider ...

05/29/10:

17:01 Ticket #164 (many items, slow pipeline) created by surtyaar
This ticket is being created as a result of the discussion at this google …

05/28/10:

15:45 Ticket #163 (Multi Threaded Crawl) created by monis
I have been using for some time now. Lately i felt need for multi threaded …

05/27/10:

13:33 Ticket #114 (Port Spiderctl web module to use spider references) closed by pablo
wontfix: Webconsole will be deprecated and replaced by REST web services.
13:31 CrawlerThread edited by pablo
(diff)

05/26/10:

12:03 Scrapy09Changes edited by pablo
(diff)
10:57 Scrapy09Changes edited by pablo
(diff)
10:49 Scrapy09Changes edited by pablo
(diff)

05/25/10:

15:24 Ticket #162 (scheduler.py outputs invalid HTML if no iterations are done.) created by deepy
23: s += "<ul>\n" 32: s += "</ul>\n" These two lines …
15:08 Ticket #161 (spiderctl.py creates broken HTML) created by deepy
s += '<table border=1">\n' Line 44, Lacks a "
15:01 Ticket #160 (enginestatus.py closes tags in wrong order) created by deepy
s += "<pre><code>\n" s += get_engine_status() s …

05/20/10:

14:03 Ticket #159 (Add Proxy CONNECT support (fixes bug with https urls and proxies)) created by pablo
Proxy CONNECT support is required for https urls to work. When …

05/17/10:

20:15 WikiStart edited by pablo
(diff)
20:14 WikiStart edited by pablo
(diff)

05/14/10:

16:51 Ticket #129 (Add dependency to BeautifulSoup and ClientForm) closed by pablo
wontfix: Both BeautifulSoup? and ClientForm? are intended to be shipped embedded with …
16:03 Ticket #152 (Spider constructor arguments) closed by pablo
fixed: Done in r1978.
15:56 Scrapy09Changes edited by pablo
(diff)

05/13/10:

00:17 Ticket #158 (Scrapy shell "view(response)" traceback with python2.5) closed by daniel
duplicate: already fixed, see #145

05/12/10:

19:37 Ticket #158 (Scrapy shell "view(response)" traceback with python2.5) created by ghantoos
Hello, A Debian user submitted a bug about the "view(response)" key …
17:06 Scrapy09Changes edited by daniel
(diff)
17:01 Ticket #157 (HttpErrorMiddleware: Notify of dropped responses calling request errback) closed by daniel
fixed: fixed by [29fb46c3ae92]
16:59 Ticket #157 (HttpErrorMiddleware: Notify of dropped responses calling request errback) created by daniel
When a requests is ignored by HttpErrorMiddleware? because response is …
Note: See TracTimeline for information about the timeline view.