Fetching the right proposition for articles from Wikipedia which fall in one topic

Question

I am gathering some articles from Wikipedia (dozens to hundreds, paying attention to the courtesy limit of Wikipedia API).

All articles are brands and in many occasions, the keyword can be very generic and does not refer to only a brand. I am getting in return other propositions like:

Arla may refer to:

1. Arla (file system)
2. Arla (moth), a genus of moth
3. Arkansas Library Association
4. Arla, Greece, a village\n\u00c4rla, a village in south-eastern Sweden
5. Arla Foods, a large Scandinavian producer ...

I want to spot the one that falls in "brand category" but I can also put other relevant keywords like "food or beverage"

Can I fetch propositions that are containing some keywords using Wikipedia API?

The problem is that when there is ambiguity, the form of response JSON is the same as if one article is found.

Check my script:

import requests
import time
result = {}
for q in spotted_keywords:
    url = 'https://en.wikipedia.org/w/api.php?action=query&prop=extracts&exintro&explaintext&format=json&exintro=&titles='+q+'&redirects=true'
    r = requests.get(url)
    json_data = r.json()
    extract = list(json_data['query']['pages'].values())[0]
    if('extract' in extract):
        result[q] = extract['extract']
        time.sleep(1)

spotted_keywords are like ["mcdonalds", "cocacola" ...]

One response is like:

{
   "batchcomplete":"",
   "query":{
      "normalized":[
         {
            "from":"arla",
            "to":"Arla"
         }
      ],
      "pages":{
         "360264":{
            "pageid":360264,
            "ns":0,
            "title":"Arla",
            "extract":"Arla may refer to:\n\nArla (file system)\nArla (moth), a genus of moth\nArkansas Library Association\nArla, Greece, a village\n\u00c4rla, a village in south-eastern Sweden\nArla Foods, a large Scandinavian producer of dairy products\nArla (Finland), a subsidiary of Arla Foods\nArla Foods UK, a subsidiary of Arla Foods\nARLA, Arm\u00e9e r\u00e9volutionnaire de lib\u00e9ration de l'Azawad (French), Revolutionary Liberation Army of Azawad"
         }
      }
   }
}

Any hints ?

Answer 1

Thanks to SO response this, I am aware of wikipedia package of python.

However I just gave it a try on "Arla" keyword, it does not raise the DisambiguationError. in case of "Mercury" as suggested in the response, it does. So I am afraid it will miss a lot of ambiguities.

Answer 2

You can add prop=pageprops&ppprop=disambiguation to the API request to get information about whether it is a disambiguation page.