Lexical Analysis

Tokenization, parsing, and lexical analysis tools for language processing. Packages among the 3,000 most downloaded in the past 90 days.

32 packages
  • A simple and fast library for text-based parser combinators

    881
    3.2m last 90 days
  • Elixir lexer for the Makeup syntax highlighter.

    37
    2.1m last 90 days
  • Erlang lexer for the Makeup syntax highlighter.

    5
    1.8m last 90 days
  • combine 0.10.0

    A parser combinator library for Elixir projects.

    200
    1.6m last 90 days
  • Error resilient parser for Elixir

    103
    591.6k last 90 days
  • texture 1.2.1

    A collection of structured text parsers.

    0
    342.3k last 90 days
  • ABNF in, parser out

    57
    333.0k last 90 days
  • neotoma 1.7.3

    PEG/Packrat toolkit and parser-generator.

    311
    181.0k last 90 days
  • HTML lexer for the Makeup syntax highlighter.

    17
    155.5k last 90 days
  • (H)EEx lexer for makeup

    6
    149.7k last 90 days
  • glexer 2.5.0

    A lexer for Gleam source code

    65
    43.6k last 90 days
  • An Elixir interface to the libpg_query postgres query parser. Converts a valid PostgreSQL query into a Protobuf based AST.

    11
    36.0k last 90 days
  • glance 7.0.0

    A Gleam source code parser, in Gleam!

    80
    35.5k last 90 days
  • Diff lexer for the Makeup syntax highlighter.

    9
    27.8k last 90 days
  • Language lexers for Makeup using the syntect Rust library

    10
    20.2k last 90 days
  • A fork of Elixir's tokenizer for Credo

    8.9k last 90 days
  • pegasus 1.0.0

    peg -> nimbleparsec

    18
    8.1k last 90 days
  • Js lexer for the Makeup syntax highlighter.

    5
    8.1k last 90 days
  • nibble 1.1.4

    A string parsing library combining a traditional lexer with parser combinators..

    91
    7.8k last 90 days
  • GraphQL lexer for the Makeup syntax highlighter.

    2
    7.2k last 90 days
  • A JavaScript inspired textual syntax for EYG.

    364
    6.9k last 90 days
  • SQL lexer for the Makeup syntax highlighter.

    2
    6.9k last 90 days
  • The package you need to build plugins for the lexical language server

    5.9k last 90 days
  • Shared data structures and protocols for the lexical language server

    5.9k last 90 days
  • Elixir bindings for tree-sitter-language-pack, providing access to 165+ language parsers

    464
    5.4k last 90 days
  • abnf2 0.1.4

    An ABNF parser generator updated from the original developed by @vanstee.

    4.3k last 90 days
  • a zig parser in elixir

    12
    3.9k last 90 days
  • C lexer for the Makeup syntax highlighter.

    2
    3.8k last 90 days
  • CSS lexer for the Makeup syntax highlighter.

    0
    3.5k last 90 days
  • Provides css parsing in Elixir

    5
    3.1k last 90 days
  • An RFC4515 ldap string filter parser for eldap

    1
    2.9k last 90 days
  • minipeg 0.7.10

    A simple easy to debug macro free peg parser library

    2.8k last 90 days