|
|||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | ||||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |
java.lang.Object | +--marf.nlp.Parsing.TokenType
Generic Token Type. Can be subclassed for more specific token types. $Id: TokenType.java,v 1.6 2005/06/01 05:35:09 mokhov Exp $
Field Summary | |
static int |
BACKTRACK
This indicates we have to backtrack one token and don't do any extra processing. |
static int |
BRACKET
Bracket or parenthesis token type. |
static int |
EOF
End of File. |
static int |
ERROR
This indicates an error in the token. |
static int |
ID
Identifier token type. |
static int |
KEYWORD
Identified keyword token type. |
static int |
NUM
Numerical token type. |
static int |
OPERATOR
Operator token type. |
static int |
PUNCT
Punctuation token type. |
static java.util.Hashtable |
TokenTypes
Hash representing literal values of the above tokens (for output, for example). |
int |
type
Current token type. |
static int |
UNKNOWN
Unknown token type. |
Constructor Summary | |
TokenType()
Default Constructor. |
Method Summary | |
static java.lang.String |
getRevision()
Retrieves class' revision. |
Methods inherited from class java.lang.Object |
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
Field Detail |
public static final int ID
public static final int NUM
public static final int OPERATOR
public static final int PUNCT
public static final int BRACKET
public static final int KEYWORD
public static final int UNKNOWN
public static final int EOF
public static final int ERROR
public static final int BACKTRACK
public int type
public static java.util.Hashtable TokenTypes
Constructor Detail |
public TokenType()
Method Detail |
public static java.lang.String getRevision()
|
|||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | ||||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |