Modifier and Type | Field and Description |
---|---|
static boolean |
Checking |
static int |
CTRL_CHAR |
Modifier and Type | Method and Description |
---|---|
void |
close() |
boolean |
eof()
End of tokens?
|
TokenChecker |
getChecker() |
long |
getColumn() |
long |
getLine() |
boolean |
hasNext()
Is there another token?
|
Token |
next()
Move to next token
|
Token |
peek()
Peek next token : null for no token.
|
void |
remove() |
void |
setChecker(TokenChecker checker) |
public static final int CTRL_CHAR
public static boolean Checking
public final boolean hasNext()
Tokenizer
public final boolean eof()
Tokenizer
public final Token peek()
Tokenizer
public TokenChecker getChecker()
public void setChecker(TokenChecker checker)
Licenced under the Apache License, Version 2.0