2

I would like to crawl websites which require authorization (I already have credentials) in intranet with Storm Crawler. Is it possible to do that by simply modifying the crawler configuration or should I alter the classes in the source code, if so, which classes?

isspek
  • 133
  • 1
  • 11

1 Answers1

0

this is not currently available. I have opened an issue for this #427, you'd need to modify the HttpProtocol class. This would be a great contribution and would be very welcome.

Julien Nioche
  • 4,772
  • 1
  • 22
  • 28