root/Web-Scraper/trunk/Changes

Revision 2338 (checked in by miyagawa, 13 years ago)

Checking in changes prior to tagging of version 0.14. Changelog diff is:

=== Changes
==================================================================
--- Changes (revision 6899)
+++ Changes (local)
@@ -1,6 +1,6 @@

Revision history for Perl extension Web
Scraper

-0.14
+0.14 Fri Sep 14 16:06:20 PDT 2007
- Fix bin/scraper to work with older Term
ReadLine?.
(Thanks to Tina Müller [RT:29079])
- Now link elements like img@src and a@href are automatically

Line 
1 Revision history for Perl extension Web::Scraper
2
3 0.14  Fri Sep 14 16:06:20 PDT 2007
4         - Fix bin/scraper to work with older Term::ReadLine.
5           (Thanks to Tina Müller [RT:29079])
6         - Now link elements like img@src and a@href are automatically
7           converted to absolute URI using the current URI as a base.
8           Only effective when you do $s->scrape(URI) or $s->scrape(\$html, URI)
9         - Added 'HTML' and its alias 'RAW' to get the HTML chunk inside the tag
10             process "script", "code" => 'RAW';
11           Handy if you want the raw HTML code inside <script> or <style>.
12           (Thanks to charsbar for the suggestion)
13
14 0.13  Sun Sep  2 17:11:08 PDT 2007
15         - Added 'c' and 'c all' command to scraper to generate the
16           code to replay the session
17         - Added 'WARN' as a shortcut to sub { warn $_->as_HTML } on scraper shell like:
18             process "a", WARN; # print 'a' elements as HTML
19         - Added 'search-cpan.pl' and 'rel-tag.pl' to eg/
20
21 0.12  Thu Aug 30 02:39:44 PDT 2007
22         - Added 's' command to scraper to get the HTML source
23         - You can use $tree variable to deal with the HTML::Element object in scraper shell
24         - Give a graceful error message if the given Selector/XPath doesn't compile
25         - Give a better error when number of args in process() seems wrong
26
27 0.11  Tue Aug 28 02:50:01 PDT 2007
28         - Supported hash-reference in process values, like
29           process "a", "people[]", { link => '@href', name => 'TEXT' };
30           See t/09-process_hash.t for its usage.
31
32 0.10  Mon Aug 27 00:53:51 PDT 2007
33         - result now returns the entire stash if called without keys
34         - added bin/scraper CLI
35
36 0.09  Wed Aug 15 10:51:14 PDT 2007
37         - remove Devel::Leak use from tests
38
39 0.08  Tue Aug 14 13:25:16 PDT 2007
40         - Call $tree->delete after the callback to avoid memory leaks by TreeBuilder.
41           (Thanks to k.daiba for the report)
42
43 0.07  Sat May 12 16:23:51 PDT 2007
44         - Updated dependencies for HTML::TreeBuilder::XPath
45
46 0.06  Sat May 12 15:47:27 PDT 2007
47         - Now don't use decoded_content to work with new H::R::Encoding
48
49 0.05  Wed May  9 18:21:22 PDT 2007
50         - Added (less DSL-ish) Web::Scraper->define(sub { ... }) syntax
51         - Fixed bug where the module dies if there's no encoding found in HTTP response headers
52         - Added more examples in eg/
53         - When we get value using callback, pass HTML::Element object as $_, in addition to $_[0]
54           (Suggested by Matt S. Trout)
55         - If the expression (1st argument to process()) starts with "/", it's
56           treated as a direct XPath and no Selector-to-XPath conversion is done.
57
58 0.04  Wed May  9 00:55:32 PDT 2007
59         - *API CHANGE* Now scraper {} returns Web::Scraper object and not closure.
60           You should call ->scrape() to get the response back.
61           (Suggested by Marcus Ramberg)
62
63           I loved the code returning closure, but this is more compatible to
64           scrapi.rb API and hopefully less confusing to people.
65
66 0.03  Tue May  8 23:04:13 PDT 2007
67         - use 'TEXT' rather than 'content' to grab text from element
68           to be more compatible with scrapi
69         - Added unit tests using Test::Base
70         - Refactored internal code for easier reading
71         - chained callbacks are now passed HTML::Element, not HTML, to avoid double HTML parsing
72         - Implemented callbacks (iterator) API
73         - Added 'process_first' to be compatible with scrapi
74
75 0.02  Tue May  8 20:03:37 PDT 2007
76         - Added dependencies to Makefile.PL
77
78 0.01  Tue May  8 04:05:59 2007
79         - original version
Note: See TracBrowser for help on using the browser.