rails mongodb find and delete duplicate

Question

Is there a that I can make this algorithm faster?

I'm fetching all documents for this Model (Artifact) and for each document I would like to know if there is duplicate and if so I delete it.

   Artifact.all.to_a.each do |n|
      image = n.image_original
      thumb = n.image_thumbnail
      count_value =  Artifact.where(:image_original => image, 
                         :image_thumbnail => thumb).all.to_a.count
      if count_value > 1
        n.destroy!
      end
    end

Does the ordering matter (ie if 2 documents have the same values does it matter which one you destroy)? — Frederick Cheung, Feb 22 '15 at 08:15

Sharvy Ahmed · Accepted Answer · 2015-02-22T08:41:24.723

1

You need to call the uniq method on Artifacts collection like this:

@all_artifacts = Artifact.all
@distinct_artifacts = @all_artifacts.uniq {|artifact| artifact.image_original}

You can use Criteria#distinct like this Artifact.distinct(:image_original), but this will only return distinct values with only that field.

edited Feb 22 '15 at 08:41

answered Feb 22 '15 at 07:55

Sharvy Ahmed

7,247
1
33
46

thanks @Sharvy, I modify to include 2 fields `@distinct_artifacts = @all_artifacts.uniq {|artifact| artifact.image_original && artifact.image_thumbnail}@distinct_artifacts.count` =>`55905` instead of `64806` – Papouche Guinslyzinho Feb 22 '15 at 11:24

rails mongodb find and delete duplicate

1 Answers1