Options for HTML scraping? *

Question

I'm thinking of trying Beautiful Soup, a Python package for HTML scraping. Are there any other HTML scraping packages I should be looking at? Python is not a requirement, I'm actually interested in hearing about other languages as well.

The story so far:

• Python
  • Beautiful Soup
  • lxml
  • HTQL
  • Scrapy
  • Mechanize
• Ruby
  • Nokogiri
  • Hpricot
  • Mechanize
  • scrAPI
  • scRUBYt!
  • wombat
  • Watir
• .NET
  • Html Agility Pack
  • WatiN
• Perl
  • WWW::Mechanize
  • Web-Scraper
• Java
  • Tag Soup
  • HtmlUnit
  • Web-Harvest
  • jARVEST
  • jsoup
  • Jericho HTML Parser
• JavaScript
  • node.io
  • phantomjs
• PHP
  • htmlSQL
• Most of them
  • Screen-Scraper

Answer

The Ruby world's equivalent to Beautiful Soup is why_the_lucky_stiff's Hpricot.

< br > via < a class="StackLink" href=" http://stackoverflow.com/questions/2861/" >Options for HTML scraping?< /a>

Share on Google Plus

About Cinema Guy

This is a short description in the author block about the author. You edit it by entering text in the "Biographical Info" field in the user admin panel.