jasy.script.tokenize package

Submodules

jasy.script.tokenize.Lang module

JavaScript 1.7 keywords

jasy.script.tokenize.Tokenizer module

exception jasy.script.tokenize.Tokenizer.ParseError(message, fileId, line)[source]

Bases: Exception

class jasy.script.tokenize.Tokenizer.Token[source]

Bases: object

assignOp
end
line
start
type
value
class jasy.script.tokenize.Tokenizer.Tokenizer(source, fileId='', line=1)[source]

Bases: object

done()[source]
get(scanOperand=False)[source]

It consumes input only if there is no lookahead. Dispatches to the appropriate lexing function depending on the input.

getComments()[source]
input_
lexDot(ch)[source]
lexExponent()[source]
lexIdent(ch)[source]
lexNumber(ch)[source]
lexOp(ch)[source]
lexRegExp(ch)[source]
lexString(ch)[source]
lexZeroNumber(ch)[source]
match(tokenType, scanOperand=False)[source]
mustMatch(tokenType)[source]
peek(scanOperand=False)[source]
peekOnSameLine(scanOperand=False)[source]
skip()[source]

Eats comments and whitespace.

token
unget()[source]

Match depends on unget returning undefined.

Module contents