Package lexer

source code

A lexer (tokenizer) for Lepl.

Submodules

[hide private]

lepl.lexer._test: Tests for the lepl.lexer package.
- lepl.lexer._test.matchers: Wide range of tests for lexer.
lepl.lexer.lexer
lepl.lexer.lines
- lepl.lexer.lines._test: Tests for the lepl.lexer.lines package.
  - lepl.lexer.lines._test.closed_bug: Tests related to a now-forgotten bug.
  - lepl.lexer.lines._test.errors: A test related to error handling, based on a bug report.
  - lepl.lexer.lines._test.indentation: Tests for indentation aware parsing.
  - lepl.lexer.lines._test.left_bug: See http://groups.google.com/group/lepl/browse_thread/thread/79e39e03a03718cc?hl=en_US
  - lepl.lexer.lines._test.offside: Tests for offside parsing.
  - lepl.lexer.lines._test.pithon
  - lepl.lexer.lines._test.stream: Tests for the lepl.lexer.lines.stream module.
  - lepl.lexer.lines._test.text: An example that avoids using tokens with the line aware parsing (you'd have to be crazy to want to do this, but it's possible).
  - lepl.lexer.lines._test.word_bug: Tests related to a bug when Word() was specified inside Token() with line-aware parsing.
- lepl.lexer.lines.lexer: A lexer that adds line start and end tokens.
- lepl.lexer.lines.matchers
- lepl.lexer.lines.monitor: Support the stack-scoped tracking of indent level blocks.
lepl.lexer.matchers: Generate and match a stream of tokens that are identified by regular expressions.
lepl.lexer.operators: Operators for tokens.
lepl.lexer.rewriters: Rewrite a matcher graph to include lexing.
lepl.lexer.stream: Stream support for lexers.
lepl.lexer.support: Support classes for the lexer.