Elasticsearch count terms ignoring spaces

Question

Using ES 1.2.1

My aggregation

{
    "size": 0,
    "aggs": {
        "cities": {
            "terms": {
                "field": "city","size": 300000
            }
     }
 }

}

The issue is that some city names have spaces in them and aggregate separately.

For instance Los Angeles

{
    "key": "Los",
    "doc_count": 2230
},
{
    "key": "Angeles",
    "doc_count": 2230
},

I assume it has to do with the analyzer? Which one would I use to not split on spaces?

score 9 · Accepted Answer · answered Jun 12 '14 at 16:35

For fields that you want to perform aggregations on I would recommend either the keyword analyzer or do not analyze the field at all. From the keyword analyzer documentation:

An analyzer of type keyword that "tokenizes" an entire stream as a single token. This is useful for data like zip codes, ids and so on. Note, when using mapping definitions, it might make more sense to simply mark the field as not_analyzed.

However if you want to still perform analysis on the field to include for other searches, then consider using the field setting of ES 1.x As described in the field/multi_field documentation. This will allow you to have a value of the field for searching and one for aggregations.

So if I get the multi-field doc right, then my aggregation becomes... "terms":{"field": "city.raw"} correct? — user432024, Jun 12 '14 at 17:35
Yes, if change an existing field mapping to be multi_field, you will need to reindex for this change to be reflected, as the multi_field creation is an index time operation. — Paige Cook, Nov 12 '15 at 17:44

score 6 · Answer 2 · answered Sep 10 '15 at 04:25

There are 2 approaches to solve this.

The not_analyzed way - But this wont consider different capital and small cases
The keyword tokenizer way - Here we can map different terms with different case as one.

These two concepts with working code examples are illustrated in this blog.

Elasticsearch count terms ignoring spaces

2 Answers2

Linked