1

I need to parse some large (2 Gb+) files into python. I have tried it with the json module but I get a memory error as its methods all load the files at once. I then moved on into installing ijson which suposedly implements a iterator-based way of parsing the file. However when I run:

import ijson

I get exception : YAJL shared object not found.

Has anyone found a similar issue? any help would be greatly appreciated

Regards

Daniel Vieira
  • 461
  • 5
  • 19

2 Answers2

0

Thats an easy one, that is because you haven't installed the YAJL C library! ijson is a wrapper around the YAJL without it won't work.

chutsu
  • 13,612
  • 19
  • 65
  • 86
0

I installed it via Anaconda and suddenly it started working.

  1. Open Anaconda prompt (win search anaconda)
  2. run command: conda install ijson
JanJan
  • 1
  • 2