0

I am developing a web crawler using groovy & grails and mongodb Is there any way to calculate depth of a page using crawler4j? I know I can limit upto what depth I want to crawl but haven't come across anything that suggests how to calculate depth of the page. Thanks.

clever_bassi
  • 2,392
  • 2
  • 24
  • 43
  • This will help you: http://stackoverflow.com/questions/24416214/web-crawler-in-grails-to-calculate-page-depth. – Abincepto Jun 26 '14 at 15:17

1 Answers1

2

Crawler4j calculates depth of page.

webUrl.getDepth();
omerfarukdemir
  • 158
  • 1
  • 10