Antlr4 - Get token name

Question

I have following (reduced) grammar:

grammar Test;
IDENTIFIER: [a-z]+ [a-zA-Z0-9]*;
WS: [ \t\n] -> skip;
compilationUnit:
    field* EOF;
field:
    type IDENTIFIER;
type:
    (builtinType|complexType) ('[' ']')*;
builtinType:
    'bool' | 'u8';
complexType:
    IDENTIFIER;

And following program:

import org.antlr.v4.runtime.CharStreams;
import org.antlr.v4.runtime.CommonTokenStream;

public class Main{
    public static void main(String[] args){
        TestLexer tl=new TestLexer(CharStreams.fromString("u8 foo bool bar complex baz complex[][] baz2"));
        TestParser tp=new TestParser(new CommonTokenStream(tl));
        TestParser.CompilationUnitContext cuc=tp.compilationUnit();
        System.out.println("CompilationUnit:"+cuc);
        for(var field:cuc.field()){
            System.out.println("Field: "+field);
            System.out.println("Field.type: "+ field.type());
            System.out.println("Field.type.builtinType: "+field.type().builtinType());
            System.out.println("Field.type.complexType: "+field.type().complexType());
            if(field.type().complexType()!=null)
                System.out.println("Field.type.complexType.IDENTIFIER: "+field.type().complexType().IDENTIFIER());
        }
    }
}

To differentiate complexType and builtinType, I can look, which is not-null. But, if I want to distinguish between bool and u8, how can I do that? This question would answer my question, but it is for Antlr3.

Yes, it worked, whoever posted an answer here and deleted it. Thank you — JCWasmx86, Aug 05 '20 at 08:24

score 2 · Accepted Answer · answered Aug 05 '20 at 08:58

Either use alternative labels:

builtinType
 : 'bool' #builtinTypeBool
 | 'u8'   #builtinTypeU8
 ;

and/or define these tokens in the lexer:

builtinType
 : BOOL
 | U8
 ;

BOOL : 'bool';
U8   : 'u8';

so that you can more easily inspect the token's type in a visitor/listener:

YourParser.BuiltinTypeContext ctx = ...
        
if (ctx.start.getType() == YourLexer.BOOL) {
  // it's a BOOL token
}

Antlr4 - Get token name

1 Answers1