Analyze all uppercase tokens in a field

Question

I would like to analyze value of a text field in 2 ways. Using standard analysis and a custom analysis that only indexes all uppercase tokens in the text.

For example, if the value is "This WHITE cat is very CUTE.", the only tokens that should be indexed for custom analysis is "WHITE" and "CUTE". For this, I am using Pattern Capture Token Filter with pattern "(\b[A-Z]+\b)+?". But this is indexing all tokens and not just uppercase tokens.

Is Pattern Capture Token Filter the right one to use for this task? If yes, what am I doing wrong? If not, how do I get this done? Please help.

score 0 · Accepted Answer · answered Mar 23 '17 at 17:06

You should use instead pattern_replace and char_filter:

PUT test
{
  "settings": {
    "analysis": {
      "char_filter": {
        "filter_lowercase": {
          "type": "pattern_replace",
          "pattern": "[A-Z][a-z]+|[a-z]+",
          "replacement": ""
        }
      },
      "analyzer": {
        "my_analyzer": {
          "tokenizer": "standard",
          "char_filter": [
            "filter_lowercase"
          ]
        }
      }
    }
  }
}

GET test/_analyze
{"analyzer": "my_analyzer", 
  "text" : "This WHITE cat is very CUTE"
}

Analyze all uppercase tokens in a field

1 Answers1