ccrawler - Built in C# 3.5 version. it contains a simple extention of web content categorizer, which can saparate between the web page depending on their content. gocrawl - Polite, slim and concurrent ...