I am using crawler4j
lib and their dependencies for crawling the page. What is the difference between
controller.start(BasicCrawler.class, numberOfCrawlers);
vs.
controller.startNonBlocking(BasicCrawler.class, numberOfCrawlers);
?
take at look at
from the documentation the second one allows the crawler thread to continue with just after triggering the crawl request.