RSS

WWW::Mechanize::Plugin::Web::Scraper

2008/06/11 filed under /perl

Joffie asked me if Web::Scraper could handle authentication while retrieving the website in question. A good question and after digging in Tatsuhiko's code, I noticed that you can simply dump HTML in the scrape function, instead of just the documented URI object.

I remembered Tatsuhiko mentioning integration with WWW::Mechanize somewhere but I couldn't find anything yet. So I decided to write the little Mechanize plugin. Shockingly, and completely surprising, it now carries the name WWW::Mechanize::Plugin::Web::Scraper.

Scrape the planet!

TT , , ,
Posted by: B10m | permanent link | comments (1)

Comments

Joffie wrote at 2008-06-12 10:28:

Thanks! You rock!

Comments are closed for this story.
Trackbacks are closed for this story.
return-member