Timeline


and .

07/20/10:

17:06 Ticket #183 (JsonLines exporter doesn't handle datetime values) closed by pablo
invalid: You need to declare a serializer for the field. See: …
16:56 Ticket #183 (JsonLines exporter doesn't handle datetime values) created by pablo
15:54 Ticket #182 (Scraper component doesn't cleanup sites info on closing) closed by daniel
fixed: bugfixed by [552a223a1cce]
15:47 Changeset [2111:91d61999bd79] by Daniel Grana <dangra@…>

Automated merge with ssh://hg.scrapy.org/scrapy-0.9

15:47 Changeset [2110:552a223a1cce] by Daniel Grana <dangra@…>

fix scraper leak closing spider. closes #182

15:46 Ticket #182 (Scraper component doesn't cleanup sites info on closing) created by daniel
engine.scraper.sites is not empty after spider is requested to be closed …

07/16/10:

16:17 Changeset [2109:bd024b728766] by Daniel Grana <dangra@…>

update docs for defaultheaders middleware and change spider attribute to ...

15:55 Ticket #181 (Support default request headers per spider) closed by daniel
fixed: implemented in [b8c8b3301c7c]
14:56 Changeset [2108:26e0e1e65d98] by Daniel Grana <dangra@…>

Automated merge with ssh://hg.scrapy.org/scrapy-0.9

14:51 Changeset [2104:b8c8b3301c7c] by Daniel Grana <dangra@…>

Support default headers per spider. closes #181

13:45 Ticket #181 (Support default request headers per spider) created by daniel
There is a downloader middleware that sets global headers to every request …
11:45 Ticket #180 (Bug in memusage extension when sending report) closed by pablo
fixed: Fixed in [925d03ebbefe]
11:45 Ticket #180 (Bug in memusage extension when sending report) created by pablo
11:44 Ticket #179 (ClientForm fails with wrong entities) closed by pablo
fixed: Fixed in [a356098c9b8b]
11:44 Ticket #179 (ClientForm fails with wrong entities) created by pablo
See …
11:41 Ticket #178 (Can't pass custom headers in FormRequest.from_response()) closed by pablo
fixed: Fixed in [f3ba66e337a8]
11:41 Ticket #178 (Can't pass custom headers in FormRequest.from_response()) created by pablo
11:40 Ticket #177 (get_meta_refresh() doesn't recognize float values in intervals) closed by pablo
fixed: Fixed in [e6ab747a1ec6].
11:40 Ticket #177 (get_meta_refresh() doesn't recognize float values in intervals) created by pablo
11:37 Ticket #176 (Doc change to TakeFirst processor) closed by pablo
fixed: Patch applied to stable in [aa1225394076]. Will be pulled to trunk later. …
11:34 Changeset [2107:89c7149d84f3] by Pablo Hoffman <pablo@…>

Fixed grammar error in doc (patch by stav) - closes #176

04:11 Ticket #176 (Doc change to TakeFirst processor) created by stav
Changed the grammar a little in …

07/15/10:

12:04 Changeset [2106:cabdf23c145c] by Pablo Hoffman <pablo@…>

bugfix in request_httprepr() function

07/14/10:

18:47 Changeset [2105:925d03ebbefe] by Martin Olveyra <olveyra@…>

Fix memusage report concatenation

07/13/10:

19:48 Ticket #175 (Doc typo in tutorial) closed by pablo
fixed: Fixed in r2101. Thanks for reporting!
19:47 Changeset [2103:aa1225394076] by Pablo Hoffman <pablo@…>

Automated merge with http://hg.scrapy.org/scrapy-0.9

19:46 Changeset [2102:a356098c9b8b] by Pablo Hoffman <pablo@…>

Applied patch to ClientForm? to fix bug with wrong entities. Also added ...

19:03 Changeset [2101:8e2eac0d62f2] by Pablo Hoffman <pablo@…>

fixed documentation typo (closes #151)

06:26 Ticket #175 (Doc typo in tutorial) created by stav
HtmlXPatSelector should be changed to HtmlXPathSelector in …

07/09/10:

13:14 Changeset [2100:6df6f6edbdba] by Ping Yin <pkufranky@…

HTTPCACHE: Don't cache response with codes in HTTPCACHE_IGNORE_HTTP_CODES

07/08/10:

14:03 Changeset [2099:8a4e8998e84e] by Pablo Hoffman <pablo@…>

Automated merge with http://hg.scrapy.org/scrapy-0.9

14:02 Changeset [2098:f3ba66e337a8] by Juan Picca <juan@…>

allow passing custom headers in FormRequest?.from_response()

07/05/10:

02:35 SEP-018 edited by pablo
(diff)

07/03/10:

12:06 Ticket #174 (Values that evaluate to False are not loaded in ItemLoader) created by anibal
The test case attachment:test_contrib_loader.py.patch fails in 0.9 but …

07/02/10:

12:25 Ticket #173 (Parse command issues (yield vs. return, _values key in items)) created by anibal
Parse command acts different whether the callback function returns or …
11:35 SEP-018 edited by pablo
(diff)
11:26 SEP-018 edited by pablo
(diff)
11:13 SEP-018 edited by pablo
(diff)
11:12 SEP-018 edited by pablo
(diff)

07/01/10:

11:48 Changeset [2097:eb60034b4763] by Pablo Hoffman <pablo@…>

Automated merge with http://hg.scrapy.org/scrapy-0.9

11:46 Changeset [2096:e6ab747a1ec6] by Martin Olveyra <olveyra@…>

Fixed bug with float values in meta refresh

06/29/10:

13:00 WikiStart edited by pablo
(diff)
00:01 ScrapyReleaseProcedure edited by pablo
(diff)
00:01 ScrapyReleaseProcedure edited by pablo
(diff)
00:00 AptRepos edited by pablo
(diff)

06/28/10:

21:53 ScrapyReleaseProcedure edited by pablo
(diff)
01:15 ScrapyReleaseProcedure edited by pablo
(diff)
00:55 Changeset [2095:01acded0da30] by Pablo Hoffman <pablo@…>

Automated merge with http://hg.scrapy.org/scrapy-0.9

00:54 Changeset [2094:d6336f79b1b1] by Pablo Hoffman <pablo@…>

Added tag 0.9 for changeset 5caf3dc10a92

00:54 Changeset [2093:5caf3dc10a92] by Pablo Hoffman <pablo@…>

bumped version to 0.9 final

00:00 Milestone 0.9 completed

Major goals:

06/27/10:

20:36 Ticket #137 (XmlXPathSelector error with xmlns) closed by pablo
invalid: This is not a bug with selectors. The xmlns attribute changes the …
20:06 Ticket #123 (Memory Error after 4 days of crawling - prevents proper shutdown) closed by pablo
fixed: Scrapy 0.9 has been released now with even more memory issues fixed, so …
20:02 Ticket #160 (enginestatus.py closes tags in wrong order) closed by pablo
wontfix: Web console is no longer supported. Sorry.
20:01 Ticket #161 (spiderctl.py creates broken HTML) closed by pablo
wontfix: Web console is no longer supported.
20:00 Ticket #162 (scheduler.py outputs invalid HTML if no iterations are done.) closed by pablo
wontfix: Web console is no longer supported.
19:58 Ticket #163 (Multi Threaded Crawl) closed by pablo
invalid: Closing due to lack of feedback.
19:57 Changeset [2092:8315ea5219b4] by Pablo Hoffman <pablo@…>

Automated merge with http://hg.scrapy.org/scrapy-0.9

19:57 Ticket #171 (test_get_meta_refresh test failing) closed by pablo
fixed: Fixed in r2091 (dev & stable repos).
19:55 Changeset [2091:59362ec19924] by Pablo Hoffman <pablo@…>

made encoding explicit in test_get_meta_refresh, to avoid depending ...

19:40 Ticket #172 (Spider middleware v2 (SEP-018)) created by pablo
Implement spider middlware refactoring as proposed in SEP-018.
19:33 Ticket #169 (Scrapy fails if it gets an unknown response code) closed by pablo
fixed: Fixed in r2089 (also pushed to stable repo).
19:32 Changeset [2090:ee136f16b8e1] by Pablo Hoffman <pablo@…>

Automated merge with http://hg.scrapy.org/scrapy-0.9

19:32 Changeset [2089:21a0d269ccda] by Pablo Hoffman <pablo@…>

response_httprepr: fixed error with unknown response codes (closes #169)

19:23 Ticket #134 (Minor markup fixes) closed by pablo
fixed: Applied in r2087 (also imported patch into stable repo).
19:23 Changeset [2088:b7ef1127c7d8] by Pablo Hoffman <pablo@…>

Automated merge with http://hg.scrapy.org/scrapy-0.9

09:09 Changeset [2087:1a0190bbdfd9] by Ismael Carnales <icarnales@…>

docs: Some DjangoItem? docs improvements, closes #134. Thanks tn!

06/25/10:

16:34 SEP-018 edited by pablo
(diff)
13:51 Ticket #171 (test_get_meta_refresh test failing) created by anibal
I'm using [2086] in ubuntu 10.04 with python 2.6[…]
13:45 Ticket #170 (commented metarefresh must not issue redirections) closed by daniel
fixed
13:06 Changeset [2086:b58b70608b28] by Daniel Grana <dangra@…>

Automated merge with ssh://hg.scrapy.org/scrapy

12:57 Changeset [2085:0614781e5278] by Daniel Grana <dangra@…>

do not redirect when there is a commented meta refresh header. closes #170

12:55 Ticket #170 (commented metarefresh must not issue redirections) created by daniel
html pages having meta refresh header commented are being redirect by …
12:46 SEP-018 edited by pablo
(diff)
12:45 SEP-018 edited by pablo
(diff)
12:39 SEP-018 edited by pablo
(diff)
12:38 SEP-018 edited by pablo
(diff)
12:11 SEP-018 edited by pablo
(diff)

06/24/10:

22:57 SEP-018 edited by pablo
(diff)
13:46 SEP-018 edited by pablo
(diff)
09:54 SEP-018 edited by pablo
(diff)

06/23/10:

18:23 SEP-018 edited by pablo
(diff)
16:52 SEP-018 edited by pablo
(diff)
16:05 SEP-018 edited by pablo
(diff)
16:04 SEP-018 edited by pablo
(diff)
16:00 SEP-018 edited by pablo
(diff)
14:25 SEP-018 edited by pablo
(diff)
14:15 SEP-018 edited by pablo
(diff)
01:03 Ticket #169 (Scrapy fails if it gets an unknown response code) created by anibal
That's it, for example Yahoo! has a custom 999 code that is not an …

06/22/10:

14:00 Changeset [2084:cd13e954a217] by Pablo Hoffman <pablo@…>

Automated merge with http://hg.scrapy.org/scrapy-0.9

14:00 Changeset [2083:df5c47ee32f9] by Pablo Hoffman <pablo@…>

Raise when trying to set an item field value using setattr api, and added ...

13:39 Changeset [2082:f9b179a2cac1] by Pablo Hoffman <pablo@…>

Automated merge with http://hg.scrapy.org/scrapy-0.9

13:38 Changeset [2081:82f1eaed4d70] by Pablo Hoffman <pablo@…>

removed nltk dependency from IBL code

06/21/10:

20:50 SEP-018 edited by pablo
(diff)
20:49 SEP-018 edited by pablo
(diff)
20:42 SEP-018 edited by pablo
(diff)
20:16 SEP-018 edited by pablo
(diff)
12:18 SEP-018 edited by pablo
(diff)
11:50 SEP-018 edited by pablo
(diff)
11:38 SEP-018 edited by pablo
(diff)
11:27 SEP-018 edited by pablo
(diff)
11:05 SEP-018 edited by pablo
(diff)
11:04 SEP-018 edited by pablo
(diff)
10:47 SEP-018 edited by pablo
(diff)
10:44 SEP-018 edited by pablo
(diff)
09:58 SEP-018 edited by pablo
(diff)

06/20/10:

20:01 SEP-018 created by pablo
Note: See TracTimeline for information about the timeline view.