3

I'm conducting a research using elasticsearch. I was planning to use cosine similarity but I noted that it is unavailable and instead we have BM25 as default scoring function.

Is there a reason for that? Is cosine similarity improper for querying documents? Why was BM25 chosen as default? Thanks

ozlevka
  • 1,988
  • 16
  • 28
Daniel Peixoto
  • 33
  • 5

1 Answers1

3

Longtime elasticsearch use TF/IDF algorithm to find similarity in queries. But number versions ago is changed to BM25 as more efficient. You can read the information in the documentation. And good article explains what is elastic search and how to the similarity in ES.

You can also write a custom algorithm to elasticsearch. Here a good article about how to do.

ozlevka
  • 1,988
  • 16
  • 28