Elasticsearch DSL on Python fails to generate Score

Question

I have an Elasticsearch database with several fields that can include name information and am attempting to search it like so:

from elasticsearch import Elasticsearch
from elasticsearch_dsl import Search

client = Elasticsearch()
s = Search(using=client, index="names")
query = 'smith'
fields = ['name1', 'name2']

results = s.query("multi_match", query=query, fields=fields, fuzziness='AUTO')

for hit in results.scan():
    print(hit.meta.score)

The results are:

None
None
None
...

However, if I structure it manually:

results = client.search(index="names",
    body={"size": 100, "query":{
        "multi_match": {
            "query": query, "fields": fields, "fuzziness": 'AUTO'
        }
    }
})

My results are:

{'_index': 'names', '_type': 'Name1', '_id': '1MtYSW4BXryTHXwQ1xBS', '_score': 14.226202, '_source': {...}
{'_index': 'names', '_type': 'Name1', '_id': 'N8tZSW4BXryTHXwQHBfw', '_score': 14.226202, '_source': {...}
{'_index': 'names', '_type': 'Name1', '_id': '8MtZSW4BXryTHXwQeR-i', '_score': 14.226202, '_source': {...}

I would prefer to use elasticsearch-dsl if possible, but I need the score information.

score 5 · Accepted Answer · answered Nov 11 '19 at 21:00

The first version of the code is not equivalent to the second version of the code. Instead of executing a query, the first version uses Scroll API (elasticsearch.helpers.scan).

Search.query() method build or extend a search object, not send a query to elasticsearch. So the following line of the code is misleading:

results = s.query("multi_match", query=query, fields=fields, fuzziness='AUTO')

It should be like this:

# execute() added at the end
results = s.query("multi_match", query=query, fields=fields, fuzziness='AUTO').execute()
# scan() removed 
for hit in results:
    print(hit.meta.score)

Thank you for explaining this, very helpful! – tufelkinder Nov 18 '19 at 01:23 — tufelkinder, Nov 18 '19 at 01:23

Assael Azran · Answer 2 · 2019-11-08T20:28:23.647

1

Try this:

from elasticsearch_dsl.query import MultiMatch
from elasticsearch import Elasticsearch
from elasticsearch_dsl import Search

client = Elasticsearch()
s = Search(using=client, index="names")
query = 'smith'
fields = ['name1', 'name2']

query_multi = 
MultiMatch(query=query,fields=fields,fuzziness='AUTO')

r = s.query(query_multi)
results = r.execute()
for hit in results:
    print(hit.meta.score)

edited Nov 08 '19 at 20:28

answered Nov 08 '19 at 19:20

Assael Azran

2,863
1
9
13

score 1 · Answer 3 · edited Apr 14 '21 at 17:06

1

Try this:

s = s.params(preserve_order=True).sort("_score")

then scan can return score.

Scan will fill sort with ['_doc'] by default, this is why it wouldn't return a score.

edited Apr 14 '21 at 17:06

wuerfelfreak

2,363
1
14
29

answered Apr 14 '21 at 12:27

Raise

11
1

Welcome to Stack Overflow. Unfortunately, this isn't very clear. Please read [answer]. – ChrisGPT was on strike Apr 14 '21 at 15:09

score 0 · Answer 4 · answered Nov 08 '19 at 17:31

0

Try like this instead:

results = s.query("multi_match", query=query, fields=fields, fuzziness='AUTO')
for hit in results["hits"]["hits"]:
    print(hit._score)

answered Nov 08 '19 at 17:31

Val

207,596
13
358
360

Nope... That doesn't seem to work: `TypeError: '<' not supported between instances of 'str' and 'int'` – tufelkinder Nov 08 '19 at 18:09

Elasticsearch DSL on Python fails to generate Score

4 Answers4