7

I was trying to use the pos_tag function in NLTK 3 (on Windows), but this error popped up:

>>> import nltk
>>> tokens = nltk.word_tokenize("This is a sentence!")
>>> tokens
['This', 'is', 'a', 'sentence', '!']
>>> tags = nltk.pos_tag(tokens)
Traceback (most recent call last):
  File "<pyshell#24>", line 1, in <module>
    tags = nltk.pos_tag(tokens)
  File "C:\Users\Gebruiker\AppData\Local\Programs\Python\Python35-32\lib\site-packages\nltk\tag\__init__.py", line 110, in pos_tag
    tagger = PerceptronTagger()
  File "C:\Users\Gebruiker\AppData\Local\Programs\Python\Python35-32\lib\site-packages\nltk\tag\perceptron.py", line 141, in __init__
    self.load(AP_MODEL_LOC)
  File "C:\Users\Gebruiker\AppData\Local\Programs\Python\Python35-32\lib\site-packages\nltk\tag\perceptron.py", line 209, in load
    self.model.weights, self.tagdict, self.classes = load(loc)
  File "C:\Users\Gebruiker\AppData\Local\Programs\Python\Python35-32\lib\site-packages\nltk\data.py", line 801, in load
    opened_resource = _open(resource_url)
  File "C:\Users\Gebruiker\AppData\Local\Programs\Python\Python35-32\lib\site-packages\nltk\data.py", line 924, in _open
    return urlopen(resource_url)
  File "C:\Users\Gebruiker\AppData\Local\Programs\Python\Python35-32\lib\urllib\request.py", line 162, in urlopen
    return opener.open(url, data, timeout)
  File "C:\Users\Gebruiker\AppData\Local\Programs\Python\Python35-32\lib\urllib\request.py", line 465, in open
    response = self._open(req, data)
  File "C:\Users\Gebruiker\AppData\Local\Programs\Python\Python35-32\lib\urllib\request.py", line 488, in _open
    'unknown_open', req)
  File "C:\Users\Gebruiker\AppData\Local\Programs\Python\Python35-32\lib\urllib\request.py", line 443, in _call_chain
    result = func(*args)
  File "C:\Users\Gebruiker\AppData\Local\Programs\Python\Python35-32\lib\urllib\request.py", line 1310, in unknown_open
    raise URLError('unknown url type: %s' % type)
urllib.error.URLError: <urlopen error unknown url type: c> 

All the packages are installed succesfully (including the maxent_treebank_pos_tagger) and I also have Numpy installed.

Am I doing something wrong?

Tom Stuart
  • 85
  • 2
  • 9

1 Answers1

11

EDITED

This issue has been resolved from NLTK v3.2.1. Upgrading your NLTK would resolve the issue, e.g. pip install -U nltk.


You might be using nltk verion 3.2 . Downgrade it to version 3.1 and it will work fine. I myself used the undermentioned method right now and the URL error is gone. Seems like an issue with nltk_version-3.2

Browse to this directory on your computer

C:\Users\USERNAME\AppData\Local\Continuum\Anaconda2\Lib\site-packages
         OR
C:\python2.7\site-packages\

Basically the aim is to go into site-packages directory, which holds the installed packages.

Search and delete these files and directories :

nltk-3.1.dist-info
nltk

After deleting force install older version as :-

pip install nltk==3.1
alvas
  • 115,346
  • 109
  • 446
  • 738
  • 1
    Thanks! It worked perfectly! But I had to use `py -m pip install nltk==3.1`. Or did you mean that? – Tom Stuart Mar 07 '16 at 19:19
  • :-) whatever work for you (you might be on soem other distro I guess , as Im on Windows) Thanks for accepting the answer . Cheers!!!! – vinita Mar 07 '16 at 19:29
  • See also: http://stackoverflow.com/questions/35836907/nltk-unable-to-nltk-pos-tag/35964709#35964709 – alvas Mar 13 '16 at 10:01
  • Sorry for adding the edit to your answer, this is to avoid cross-platform communication and NLTK users starting new issues on the github repo on this resolved issue. – alvas Apr 20 '16 at 04:02