Crawler 3.0 is here (Parallel Approach to crawling for Surface crawling)

Hi Guys,

Yes as you read above, one of my colleague asked me what would be the speed of parallel, thread based crawler, Now I am posting this to so that you all can check out the speed. Now how to use this, its very simple, it is written in the file itself. check it out..... ;) enjoy and let me sleep now!