Ignore special characters on StringTokenizer

Question

I want to ignore special characters like , " ; : using string tokenizer. For example, if I enter:

He said, "That's not a good idea."

output should be:

He
Said
that
s
not
a
good
idea

This is my current code

class MyClass
{
    public static void main(String[] argv)
    {
        System.out.print("Enter text to break :- ");
        Scanner sc = new Scanner(System.in);
        String x = sc.nextLine();
        StringTokenizer url = new StringTokenizer(x, " ");              
        
        while(url.hasMoreTokens())
        {
            System.out.println(url.nextToken());
        }
    }
}

Consider [`String#split`](https://docs.oracle.com/javase/8/docs/api/java/lang/String.html#split-java.lang.String-) with the appropriate regex. — bradimus, Aug 19 '16 at 14:41

DimaSan · Accepted Answer · 2016-08-19T15:53:44.980

1

You can replace that special characters with regex like this:

class Q_03 {
    public static void main(String[] argv) {
        System.out.print("Enter text to break :- ");
        Scanner sc = new Scanner(System.in);
        String x = sc.nextLine().replaceAll("[|;:,'\"]", " ");
        StringTokenizer url = new StringTokenizer(x, " ");

        while (url.hasMoreTokens()) {
            System.out.println(url.nextToken());
        }
    }
}

You can add to this regexp "[;:,'\"]" whatever symbols you want, but some special symbols (like ") must have been escaped with backslash \".

edited Aug 19 '16 at 15:53

answered Aug 19 '16 at 14:43

DimaSan

12,264
11
65
75

it worked thanks. but when i put characters like | it gives a compilation error. – nascar895 Aug 19 '16 at 15:22
It works with `|`, I tested it. I updated my answer. – DimaSan Aug 19 '16 at 15:54

Ignore special characters on StringTokenizer

1 Answers1