net.sourceforge.pmd.cpd
Class AbstractTokenizer
java.lang.Object
net.sourceforge.pmd.cpd.AbstractTokenizer
- All Implemented Interfaces:
- Tokenizer
- Direct Known Subclasses:
- EcmascriptTokenizer, FortranTokenizer, GoTokenizer, RubyTokenizer
public abstract class AbstractTokenizer
- extends Object
- implements Tokenizer
- Author:
- Zev Blut zb@ubit.com, Romain PELISSE belaran@gmail.com
Methods inherited from class java.lang.Object |
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
stringToken
protected List<String> stringToken
ignorableCharacter
protected List<String> ignorableCharacter
ignorableStmt
protected List<String> ignorableStmt
oneLineCommentChar
protected char oneLineCommentChar
spanMultipleLinesString
protected boolean spanMultipleLinesString
spanMultipleLinesLineContinuationCharacter
protected Character spanMultipleLinesLineContinuationCharacter
AbstractTokenizer
public AbstractTokenizer()
tokenize
public void tokenize(SourceCode tokens,
Tokens tokenEntries)
- Specified by:
tokenize
in interface Tokenizer
Copyright © 2002–2015 InfoEther. All rights reserved.