Using MetaCrawler

The Basics

Default architecture of cralwer using MetaCrawler have next hierarchy:

• Handler - manages crawlers, settings and the crawl process;
• Crawler - load web-pages and manages items;
• Field - parse concrete values;

Example usage

See example on Github.