How to validate elastic search data with sql data after migration from sql to elastic search

Question

Anyone who have worked on elastic search. need input as mentioned in subject. I have one requirement in which sql data is migrated to elastic Search now there is ton of data so I can not check each and every field manually. So what is best way to test migrated data with sql.

This might help: https://stackoverflow.com/questions/22034722/tool-to-compare-elasticsearch-index-into-data-base-records-to-ascertain-inconsis/35643728#35643728 — Val, Dec 12 '17 at 06:23

score 0 · Answer 1 · answered Dec 12 '17 at 06:23

0

Try to implement 2 scripts which will result exactly the same output from mysql and elasticsearch. Make sure, formatting, ordering matches. At the end you should be able to diff the files or do md5sum on them to compare.

answered Dec 12 '17 at 06:23

Tamas Szasz

386
5
6

Hi Tamas can you suggest which technology would be better for comparing it – anky Dec 14 '17 at 10:49
Thank you guys for your help. I have done it using JAVA and JUnit. – anky Dec 20 '17 at 05:12

How to validate elastic search data with sql data after migration from sql to elastic search

1 Answers1