how to check response type aiohttp asyncio python

Question

I have the following method:

    async def make_request(self, url):
        async with aiohttp.ClientSession() as session:
            async with self.limit, session.get(url=url) as response:
                resp = await response.read()
                await asyncio.sleep(self.rate)
                return resp

How to check if resp contains json? so that I could format in json e.g. json.dumps(resp) perhaps? and if the resp type is html then i will have to traverse the html tree to extract the resp value

I have tried:

    async def make_request(self, url):
        async with aiohttp.ClientSession() as session:
            async with self.limit, session.get(url=url) as response:
                resp = await response.json()
                await asyncio.sleep(self.rate)
                return resp

But it errors out if the resp contains html

Maybe check for a content type header. – dirn May 04 '20 at 19:02 — dirn, May 04 '20 at 19:02

score 1 · Accepted Answer · answered May 05 '20 at 14:59

As mentioned above checking the Content-Type header should be the first step; however if for any reason that header is missing or is incorrect you can always use:

text = await response.text()
try:
    data = json.loads(text)
except ValueError as exc:
    print("cannot parse JSON: %s" % exc)
    # use text value

how to check response type aiohttp asyncio python

1 Answers1