Lexical Analysis

Tokenization, parsing, and lexical analysis tools for language processing. Packages among the 3,000 most downloaded in the past 90 days.

67 packages
  • nimble_parsec 1.4.2

    A simple and fast library for text-based parser combinators

    882
    4.2m last 90 days
  • makeup_elixir 1.0.1

    Elixir lexer for the Makeup syntax highlighter.

    37
    2.6m last 90 days
  • makeup_erlang 1.1.0

    Erlang lexer for the Makeup syntax highlighter.

    5
    2.2m last 90 days
  • combine 0.10.0

    A parser combinator library for Elixir projects.

    200
    1.8m last 90 days
  • spitfire 0.4.3

    Error resilient parser for Elixir

    103
    1.1m last 90 days
  • texture 2.0.0

    A collection of structured text parsers.

    1
    527.2k last 90 days
  • abnf_parsec 2.1.0

    ABNF in, parser out

    57
    512.0k last 90 days
  • makeup_html 1.0.0

    HTML lexer for the Makeup syntax highlighter.

    17
    194.4k last 90 days
  • neotoma 1.7.3

    PEG/Packrat toolkit and parser-generator.

    311
    190.5k last 90 days
  • makeup_eex 2.0.2

    (H)EEx lexer for makeup

    6
    188.6k last 90 days
  • glexer 2.5.0

    A lexer for Gleam source code

    64
    66.1k last 90 days
  • glance 7.0.0

    A Gleam source code parser, in Gleam!

    83
    58.7k last 90 days
  • pg_query_ex 0.10.0

    An Elixir interface to the libpg_query postgres query parser. Converts a valid PostgreSQL query into a Protobuf based AST.

    11
    45.6k last 90 days
  • makeup_syntect 0.1.5

    Language lexers for Makeup using the syntect Rust library

    11
    32.2k last 90 days
  • makeup_diff 0.1.1

    Diff lexer for the Makeup syntax highlighter.

    9
    28.3k last 90 days
  • credo_tokenizer 0.2.8

    A fork of Elixir's tokenizer for Credo

    20.7k last 90 days
  • eyg_parser 0.5.2

    A JavaScript inspired textual syntax for EYG.

    381
    15.0k last 90 days
  • pegasus 1.0.0

    peg -> nimbleparsec

    18
    10.7k last 90 days
  • lumis_wasm_elixir 0.26.8

    Tree-sitter parser and queries for elixir, compiled to WASM for Lumis

    231
    10.1k last 90 days
  • makeup_js 0.1.0

    Js lexer for the Makeup syntax highlighter.

    5
    9.6k last 90 days
  • lexical_plugin 0.5.0

    The package you need to build plugins for the lexical language server

    8.0k last 90 days
  • lexical_shared 0.5.0

    Shared data structures and protocols for the lexical language server

    8.0k last 90 days
  • lumis_wasm_comment 0.26.2

    Tree-sitter parser and queries for comment, compiled to WASM for Lumis

    231
    7.8k last 90 days
  • lumis_wasm_sql 0.26.5

    Tree-sitter parser and queries for sql, compiled to WASM for Lumis

    231
    7.5k last 90 days
  • abnf2 0.1.4

    An ABNF parser generator updated from the original developed by @vanstee.

    6.8k last 90 days
  • lumis_wasm_json 0.26.4

    Tree-sitter parser and queries for json, compiled to WASM for Lumis

    231
    6.6k last 90 days
  • makeup_sql 0.1.3

    SQL lexer for the Makeup syntax highlighter.

    2
    6.6k last 90 days
  • lumis_wasm_bash 0.26.5

    Tree-sitter parser and queries for bash, compiled to WASM for Lumis

    231
    6.5k last 90 days
  • makeup_css 0.2.3

    CSS lexer for the Makeup syntax highlighter.

    0
    6.3k last 90 days
  • lumis_wasm_javascript 0.26.3

    Tree-sitter parser and queries for javascript, compiled to WASM for Lumis

    231
    6.2k last 90 days
  • makeup_graphql 0.1.2

    GraphQL lexer for the Makeup syntax highlighter.

    2
    5.9k last 90 days
  • lumis_wasm_css 0.26.3

    Tree-sitter parser and queries for css, compiled to WASM for Lumis

    231
    5.5k last 90 days
  • zig_parser 0.8.0

    a zig parser in elixir

    12
    5.5k last 90 days
  • nibble 1.1.4

    A string parsing library combining a traditional lexer with parser combinators..

    92
    5.4k last 90 days
  • tree_sitter_language_pack 1.22.1

    Elixir bindings for tree-sitter-language-pack, providing access to 165+ language parsers

    478
    5.3k last 90 days
  • lumis_wasm_heex 0.26.2

    Tree-sitter parser and queries for heex, compiled to WASM for Lumis

    231
    5.1k last 90 days
  • lumis_wasm_html 0.26.3

    Tree-sitter parser and queries for html, compiled to WASM for Lumis

    231
    5.0k last 90 days
  • lumis_wasm_typescript 0.26.2

    Tree-sitter parser and queries for typescript, compiled to WASM for Lumis

    231
    4.9k last 90 days
  • lumis_wasm_diff 0.26.4

    Lumis parser for diff

    231
    4.6k last 90 days
  • lumis_wasm_yaml 0.26.2

    Tree-sitter parser and queries for yaml, compiled to WASM for Lumis

    231
    4.5k last 90 days
  • makeup_c 0.1.1

    C lexer for the Makeup syntax highlighter.

    2
    4.5k last 90 days
  • lumis_wasm_markdown 0.26.3

    Tree-sitter parser and queries for markdown, mdx, compiled to WASM for Lumis

    231
    4.4k last 90 days
  • lumis_wasm_tsx 0.26.2

    Tree-sitter parser and queries for tsx, compiled to WASM for Lumis

    231
    4.4k last 90 days
  • lumis_wasm_python 0.26.4

    Tree-sitter parser and queries for python, compiled to WASM for Lumis

    231
    4.3k last 90 days
  • yarn_parser 0.4.0

    A simple yarn.lock parser

    4
    4.2k last 90 days
  • lumis_wasm_markdown_inline 0.26.2

    Tree-sitter parser and queries for markdown_inline, compiled to WASM for Lumis

    231
    4.2k last 90 days
  • css_parser 0.1.1

    Provides css parsing in Elixir

    5
    4.1k last 90 days
  • lumis_wasm_toml 0.26.1

    Tree-sitter parser and queries for toml, compiled to WASM for Lumis

    231
    4.1k last 90 days
  • lumis_wasm_erlang 0.26.6

    Tree-sitter parser and queries for erlang, compiled to WASM for Lumis

    231
    4.0k last 90 days
  • lumis_wasm_go 0.26.4

    Tree-sitter parser and queries for go, compiled to WASM for Lumis

    231
    4.0k last 90 days
  • lumis_wasm_rust 0.26.4

    Tree-sitter parser and queries for rust, compiled to WASM for Lumis

    231
    3.9k last 90 days
  • abnfc 0.5.4

    ABNF parser generator

    1
    3.9k last 90 days
  • lumis_wasm_ruby 0.26.3

    Tree-sitter parser and queries for ruby, compiled to WASM for Lumis

    231
    3.8k last 90 days
  • lumis_wasm_eex 0.26.2

    Tree-sitter parser and queries for eex, compiled to WASM for Lumis

    231
    3.7k last 90 days
  • lumis_wasm_protobuf 0.26.4

    Tree-sitter parser and queries for protobuf, compiled to WASM for Lumis

    231
    3.7k last 90 days
  • lumis_wasm_zsh 0.26.3

    Tree-sitter parser and queries for zsh, compiled to WASM for Lumis

    231
    3.7k last 90 days
  • lumis_wasm_c 0.26.2

    Tree-sitter parser and queries for c, compiled to WASM for Lumis

    231
    3.7k last 90 days
  • lumis_wasm_cpp 0.26.1

    Tree-sitter parser and queries for cpp, compiled to WASM for Lumis

    231
    3.6k last 90 days
  • lumis_wasm_zig 0.26.1

    Tree-sitter parser and queries for zig, compiled to WASM for Lumis

    231
    3.6k last 90 days
  • lumis_wasm_cmake 0.26.4

    Tree-sitter parser and queries for cmake, compiled to WASM for Lumis

    231
    3.6k last 90 days
  • lumis_wasm_make 0.26.2

    Tree-sitter parser and queries for make, compiled to WASM for Lumis

    231
    3.6k last 90 days
  • rebar3_abnf_compiler 0.1.3

    A ABNF compiler for rebar3 3.7+

    2
    3.6k last 90 days
  • lumis_wasm_xml 0.26.3

    Tree-sitter parser and queries for xml, compiled to WASM for Lumis

    231
    3.5k last 90 days
  • lumis_wasm_scss 0.26.1

    Tree-sitter parser and queries for scss, compiled to WASM for Lumis

    231
    3.4k last 90 days
  • lumis_wasm_graphql 0.26.2

    Tree-sitter parser and queries for graphql, compiled to WASM for Lumis

    231
    3.4k last 90 days
  • lumis_wasm_vue 0.26.1

    Tree-sitter parser and queries for vue, compiled to WASM for Lumis

    231
    3.4k last 90 days
  • lumis_wasm_svelte 0.26.2

    Tree-sitter parser and queries for svelte, compiled to WASM for Lumis

    231
    3.4k last 90 days