Lexical Analysis

Tokenization, parsing, and lexical analysis tools for language processing. Packages among the 3,000 most downloaded in the past 90 days.

32 packages
  • A simple and fast library for text-based parser combinators

    855
    2.8m last 90 days
  • combine 0.10.0

    A parser combinator library for Elixir projects.

    198
    2.0m last 90 days
  • Elixir lexer for the Makeup syntax highlighter.

    35
    2.0m last 90 days
  • Erlang lexer for the Makeup syntax highlighter.

    3
    1.8m last 90 days
  • neotoma 1.7.3

    PEG/Packrat toolkit and parser-generator.

    306
    285.8k last 90 days
  • Error resilient parser for Elixir

    92
    226.3k last 90 days
  • HTML lexer for the Makeup syntax highlighter.

    16
    128.4k last 90 days
  • (H)EEx lexer for makeup

    5
    120.5k last 90 days
  • Language lexers for Makeup using the syntect Rust library

    4
    16.1k last 90 days
  • The package you need to build plugins for the lexical language server

    -
    10.8k last 90 days
  • Shared data structures and protocols for the lexical language server

    -
    10.8k last 90 days
  • glexer 2.3.0

    A lexer for Gleam source code

    48
    9.8k last 90 days
  • An Elixir interface to the libpg_query postgres query parser. Converts a valid PostgreSQL query into a Protobuf based AST.

    8
    8.2k last 90 days
  • glance 5.0.1

    A Gleam source code parser, in Gleam!

    71
    7.5k last 90 days
  • Diff lexer for the Makeup syntax highlighter.

    9
    7.2k last 90 days
  • pegasus 0.2.6

    peg -> nimbleparsec

    17
    7.0k last 90 days
  • ABNF in, parser out

    55
    5.6k last 90 days
  • Provides css parsing in Elixir

    5
    4.1k last 90 days
  • Sql parser wrapping sqlparser-rs

    9
    3.7k last 90 days
  • a zig parser in elixir

    11
    3.2k last 90 days
  • GraphQL lexer for the Makeup syntax highlighter.

    2
    2.8k last 90 days
  • abnfc 0.5.4

    ABNF parser generator

    -
    2.8k last 90 days
  • xpeg 0.10.0

    Native Elixir PEG (Parsing Expression Grammars) string matching library

    36
    2.7k last 90 days
  • Js lexer for the Makeup syntax highlighter.

    5
    2.6k last 90 days
  • nibble 1.1.4

    A string parsing library combining a traditional lexer with parser combinators..

    76
    2.6k last 90 days
  • C lexer for the Makeup syntax highlighter.

    2
    2.4k last 90 days
  • A ABNF compiler for rebar3 3.7+

    -
    2.2k last 90 days
  • just 2.1.0

    A JavaScript lexer and syntax highlighter for Gleam!

    18
    2.0k last 90 days
  • Elixir bindings for Tree-sitter parsing library

    1
    1.9k last 90 days
  • SQL lexer for the Makeup syntax highlighter.

    2
    1.9k last 90 days
  • A nimble_parsec parser for parsing the Prometheus text format.

    1
    1.8k last 90 days
  • The owls are not what they seem

    24
    1.7k last 90 days