Randoom a Michael Friis production

Posts from May 2012

Posted
8 May 2012 @ 9pm

Tagged
Scraping

Screen scraping with WatiN

This post describes how to use WatiN to screen scrape web sites that don’t want to be scraped. WatiN is generally used to instrument browsers to perform integration testing of web applications, but it works great for scraping too. Screen scraping websites can range in difficulty from very easy to extremely hard. When encountering hard-to-scrape sites, the typical cause [...]