Interface TokenType

All Known Implementing Classes:
ZSTokenType

public interface TokenType
Represents a token type.

May be a whitespace or non-whitespace token. Whitespace tokens are automatically discarded.

Note: if the whitespace is relevant to the parsing, take care to tag them as non-whitespace, otherwise they will be discarded!

  • Method Summary

    Modifier and Type
    Method
    Description
     
    boolean
     
  • Method Details

    • getRegexp

      String getRegexp()
    • isWhitespace

      boolean isWhitespace()