Questions tagged [grequests]

GRequests allows you to use Requests with Gevent to make asyncronous HTTP Requests easily.

GRequests allows you to use requests with gevent to make asynchronous HTTP Requests easily.

139 questions
0
votes
1 answer

Grequests with multiple JSON payloads

I'm trying to simultaneously send multiple POST requests with JSON payloads and retrieve the JSON results. I've read a few other posts on SO but nothing is doing the trick. def transcribe(vid_segs): payloads = [] for vid in vid_segs: …
Steven
  • 824
  • 1
  • 8
  • 23
0
votes
1 answer

How to make multiple API calls from multiple pages in single URL

So the title is a little confusing I guess.. I have a script that I've been writing that will display some random data and other non-essentials when I open my shell. I'm using grequests to make my API calls since I'm using more than one URL. For my…
Aaron Nelson
  • 181
  • 14
0
votes
0 answers

grequest doesn't consistently send request quickly

I have written a TCP proxy server in python 2.7 which creates a greenlet for each connection using gevent. When the socket closes, I close out the greenlet. I am using grequest.map to POST the data a given connection receives. I am using grequests…
oregano
  • 816
  • 9
  • 25
0
votes
1 answer

calling functions via grequests

I realize there have been many posts on grequests such as Asynchronous Requests with Python requests which describes the basic usage of grequests and how to send hooks via grequests.get() I pulled this bit of code right from that link. import…
user3267256
  • 113
  • 2
  • 11
0
votes
0 answers

Nested Grequests Not Executed

I'm trying to have a grequest spawn additional grequests and I'm finding that the second-level grequest callbacks are not executed. The usecase is to view the first page of results from an api, use it to calculate how many additional pages there are…
sajattack
  • 803
  • 1
  • 9
  • 23
0
votes
0 answers

Grequests not returning all items

I have the following code: >>> import grequests >>> urls=[ 'https://www.microsoft.com/en-us/store/movies/the-legend-of-blood-castle/8d6kgwzzx9hm', 'https://www.microsoft.com/en-us/store/movies/babe/8d6kgwzl64t3'] >>> rs =…
David542
  • 104,438
  • 178
  • 489
  • 842
0
votes
1 answer

How can I control python thread when I send a lot requests in a limitless loop?

Here is the situation. I need to send a ajax request to a Django view function every second and this view function will send some asynchronous requests to a third party API to get some data by grequests. These data will render to HTML after this…
Jack Cai
  • 3
  • 1
0
votes
1 answer

create asynchronous requests on fly using greqeusts

So I know that you could use grequests create multiple requests and use map to process them at the same time. But how do you create some requests on the fly while some requests sent have not returned a response yet? I don't want to use…
Haoyu
  • 49
  • 1
  • 7
0
votes
2 answers

Adding progress feedback in Grequests task

I've followed the grequests usage example, but I'm trying to add some progress feedback. A percentage of the completed requests. How could I achieve that? import grequests urls = [ 'http://www.heroku.com', 'http://python-tablib.org', …
whitenoisedb
  • 403
  • 1
  • 5
  • 16
0
votes
1 answer

Create List of URLs for grequest

Having this multiple payloads dictionarys, how can one better create a list of formatted urls so grequest can itereate over ? payload_single: {'search': '51 F ST SW,AUBURN KING 98001,WA,USA', 'app_code': 'xyz', 'app_id': 'xyz', 'lod':…
Jorge Vidinha
  • 404
  • 7
  • 20
0
votes
1 answer

Weird pip bug. Can't install some modules but I can install others

Despite my best effors, I can't seem to get gevent or grequests working. They both rely on greenlet which I can't get working either. I've completely installed and reinstalled python via homebrew. I haven't tried using python's installer but I don't…
Josh Horowitz
  • 655
  • 2
  • 6
  • 15
0
votes
1 answer

github3.py: Possible to use with grequests?

I wonder if this has ever come up before? I have an app that downloads tons of information from our GitHub Enterprise instance (not currently using github3.py but I am thinking of converting it over to use github3.py). Basically, it crawls 189 repos…
Marc Abramowitz
  • 3,447
  • 3
  • 24
  • 30
0
votes
1 answer

Disable grequests error logs on console

Is there anyway to disable grequests's logging to console? My applications returns error in the requests part: Timeout: (, 'Connection to 116.231.213.50 timed out.…
AliBZ
  • 4,039
  • 12
  • 45
  • 67
0
votes
1 answer

Install Grequests (stuck on gevent) mac OS 10.8

I try the last hours to install grequests on my mac 10.8. When I pip install it I get: $ pip install grequests Requirement already satisfied (use --upgrade to upgrade): grequests in…
Diolor
  • 13,181
  • 30
  • 111
  • 179
0
votes
1 answer

Grequests: importerror

I am working with grequests for the first time. I installed it with pip, which looked fine, but when I run my script I get: ImportError: No module named grequests Any thoughts about this one?
ticktack
  • 55
  • 5
1 2 3
9
10