How to remove numbers from TokenStream in Lucene?

Question

I have written a custom analyzer that wraps a StandardAnalyzer with a Length. Now I want to filter out all terms that contain just numbers. What is the best way to implement this?

Is it on just one field? If so, you can just use a FieldBridge to not add terms containing just numbers to the Document. — robertvoliva, Apr 14 '12 at 03:21

score 1 · Answer 1 · answered Apr 14 '12 at 13:51

1

You may be in for a custom TokenFilter. Check out one of the simplest filters out there, the LowerCaseFilter. I think you'll find it easy to write your own along those lines.

answered Apr 14 '12 at 13:51

Marko Topolnik

195,646
29
319
436

score 0 · Answer 2 · answered Dec 30 '15 at 14:27

0

You can use the PatternReplaceFilter to detect and remove numbers from the TokenStream by using a regular expression.

answered Dec 30 '15 at 14:27

Bertil Chapuis

2,477
1
18
12

How to remove numbers from TokenStream in Lucene?

2 Answers2