by Kevin Hemenway
|
by Tony Stubblebine
|
by Tom Christiansen
|
by Damian Conway
|
by Randal L. Schwartz
|
Product details
Would you like to update product info or give feedback on images?
|
Customers Viewing This Page May Be Interested in These Sponsored Links(What is this?) |
The fascination of this topic is that it makes you see the Web in a different way, not as a set of pages for users to browse, but as a huge database for your programs to explore. The most robust technique for querying Web sites programmatically is through XML Web Services, but this approach is in its infancy. LWP takes a different route, called screen-scraping. In essence, your Perl code pretends to be a browser and grabs HTML for processing. Using LWP you could write a command-line program to search your favourite auction site, fetch news headlines, or check multiple retail sites for the best prices. As the author acknowledges, the problem with screen-scraping is its brittleness: if the target Web site adopts a new look, it breaks your code. There are also interesting fair usage issues. Even so, it's a powerful technique with many possible applications. This clear and concise guide comes complete with typically terse Perl code examples. Topics include LWP basics, posting form data, processing results with regular expressions, using trees to process HTML, imitating different browser types, and supporting cookies programmatically. An appendix offers handy information like HTTP status codes, character tables, and MIME types. LWP is large, but while this title does not attempt to cover all the modules, it does provide all you need to start coding your own Web-mining programs.--Tim Anderson
Suggested Tags from Similar Products(What's this?)Be the first one to add a relevant tag (keyword that's strongly related to this product)
|
![]() |
64% buy the item featured on this page: Perl & LWP £23.18 |
![]() |
22% buy Spidering Hacks: 100 Industrial-Strength Tips & Tools £12.18 |
![]() |
11% buy Webbots, Spiders, & Screen Scrapers£25.60 |
![]() |
3% buy Learning Perl £18.15 |
|
Share your thoughts with other customers:
|
||||||||||||||||||||||
Most Helpful Customer Reviews
Share your thoughts with other customers: Create your own review
|
|
|
|
|
After viewing product detail pages or search results, look here to find an easy way to navigate back to pages you are interested in. |