I have a sqlite3dbm which store data in key-value pair. I need to process it using mrjob
.
When I run my code xyz.py my_db.db
, mapper fn doesn't work properly.
def mapper(k,val):
for word in val:
yield(word,k)
I get null for k
I have a sqlite3dbm which store data in key-value pair. I need to process it using mrjob
.
When I run my code xyz.py my_db.db
, mapper fn doesn't work properly.
def mapper(k,val):
for word in val:
yield(word,k)
I get null for k
Check this. You need to configure to your job appropriately to read from a database file.