Bulk create with unique constraint -- ignore duplicates

Question

Let's say there's a model with unique constraint:

class A(models.Model):
    my_unique_value = models.CharField(unique=True)

I want to bulk_create As, but some of the my_unique_value values I'm inserting are already in the db. I want them to be ignored (not inserted).

What is the best, most efficient way to achieve that? I cannot insert them one by one, and catch Exceptions (it's too slow). I also cannot fetch all As to clean duplicates first.

The underlying DB is postgres.

Duplicate of https://stackoverflow.com/questions/12451053/django-bulk-create-with-ignore-rows-that-cause-integrityerror — shubham003, Jun 22 '17 at 07:39
Possible duplicate of [Django bulk\_create with ignore rows that cause IntegrityError?](https://stackoverflow.com/questions/12451053/django-bulk-create-with-ignore-rows-that-cause-integrityerror) — Cesar Canassa, Mar 29 '19 at 07:18

score -3 · Answer 1 · answered Jun 22 '17 at 07:15

-3

You can use get_or_create, which as it names says - will only create if the item doesn't exist, otherwise it will fetch it. You can discard the fetched item.

answered Jun 22 '17 at 07:15

Burhan Khalid

169,990
18
245
284

1

That'll no longer be *bulk* create (it will make one query per object). – Matt Jun 22 '17 at 08:02
Yes but given your restrictions [a] cannot fetch and filter [b] don't want to duplicate, this is the best option available. – Burhan Khalid Jun 22 '17 at 08:04

Bulk create with unique constraint -- ignore duplicates

1 Answers1