|
|||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | ||||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |
java.lang.Objectnet.sourceforge.pmd.cpd.AnyTokenizer
This class does a best-guess try-anything tokenization.
Field Summary | |
static java.lang.String |
TOKENS
|
Constructor Summary | |
AnyTokenizer()
|
Method Summary | |
void |
tokenize(SourceCode sourceCode,
Tokens tokenEntries)
|
Methods inherited from class java.lang.Object |
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
Field Detail |
public static final java.lang.String TOKENS
Constructor Detail |
public AnyTokenizer()
Method Detail |
public void tokenize(SourceCode sourceCode, Tokens tokenEntries)
tokenize
in interface Tokenizer
|
|||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | ||||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |