create user defined id and new data at time of reindex elasticsearch

Question

I am going to reindex with below query like.

{
  "source": {
    "index": "demodata"
  },
  "dest": {
    "index": "new_twitter",
    "op_type": "create"
  },
   "script": {
    "source": "ctx._source['project'] = 'Personal3'",
    "lang": "painless"
  }
}

When project change same data/index need to reindex with new project name. But I am getting Conflict. I hope if there is any options to update the Id I can solve this issue.

Hi, Don't you want to overwrite the older data? Do you want to create new document with new id? — Saeed Nasehi, Oct 22 '21 at 22:31
I am want to create new data every time when reindex happen. No need to override. — Janny, Oct 25 '21 at 07:06

score 0 · Answer 1 · answered Oct 25 '21 at 10:24

If you want to generate new ids in each time you reindex your data you need to do something like this:

POST _reindex
{
  "source": {
    "index": "demodata"
  },
  "dest": {
    "index": "new_twitter"
  },
  "script": {
    "source": "ctx._source['foo'] = 'Personal3'; ctx._id=null",
    "lang": "painless"
  }
}

This reindex query make a null id for each document and elasticsearch creates new id for each of them. Please let me know if you have any problem with this.

Hi, Did it work for you? – Saeed Nasehi Oct 26 '21 at 23:13 — Saeed Nasehi, Oct 26 '21 at 23:13

create user defined id and new data at time of reindex elasticsearch

1 Answers1