0

Is it possible to limit the hit rate/IP address in nutch? In other words, can I configure nutch so that it will only hit an IP x number of times per hour, etc.?

Enno Shioji
  • 26,542
  • 13
  • 70
  • 109

1 Answers1

2

Yes, You can limit rate by changing fetcher.server.delay, fetcher.server.min.delay, fetcher.threads.per.queue, fetcher.queue.mode settings values in nutch-default.xml file.

Alexander Chepurnoy
  • 615
  • 5
  • 14