Ensure unique values within sub elements of a json element while converting from csv

Question

I'm using the answer here to convert my csv to json in python .

How to convert CSV file to multiline JSON?

Although each json field is unique . I'm not sure how to ensure how each sub json field has a list of unique elements.

Ex:

fieldnames = ("domains","ip_address")
reader = csv.DictReader( csvfile, fieldnames)
for row in reader:
    json.dump(row, jsonfile)
     jsonfile.write('\n')

Basically I want to ensure all the items in the ip_address list are unique. In case of the list shown below :

{"ip_address":"x,y,x"}

It should be :

{"ip_address":"x,y"}

I know how to obtain unique values from a list. I want to know how to access this list while performing the json dump.

Can you show what you've tried and describe how it failed? – glibdud Feb 12 '19 at 21:08 — glibdud, Feb 12 '19 at 21:08
provide an example with desired output – sam46 Feb 12 '19 at 21:09 — sam46, Feb 12 '19 at 21:09

score 0 · Answer 1 · answered Feb 12 '19 at 21:15

0

Try this:

my_list = ['a', 'b', 'c', 'd', 'e', 'f', 'g', 'h', 'i', ...]

unique_list = []
for word in my_list:
    if word not in unique_list:
        unique_list.append(word)

Hope it helps THanks

answered Feb 12 '19 at 21:15

Avinash Singh

4,970
8
20
35

Ensure unique values within sub elements of a json element while converting from csv

1 Answers1