3

I had a task of form:

1)send an http get to url based on a parameter
2)Modify the response based on the same parameter
3)send an http post to url based on the same parameter

I used grequests to accomplish this.Now for 55 urls it worked fine. Then i tried for 34000 .It failed with Connection aborted.', gaierror(8, 'nodename nor servname provided, or not known')) for request <grequests.AsyncRequest object at 0x1bda93610>.

Then i tried with size parameter in grequests.map and tried with size=64.Got the same error. Now is there anything else i can do or i need to use something else and grequests is not suitable for this task.

vks
  • 67,027
  • 10
  • 91
  • 124

0 Answers0