web-tree-sitter

What's Changed

• decode UTF-16 surrogate pairs with input endianness

• breaking

  cli: fix query test capture range matching across lines

• rust: address new nightly lints

• generate: resolve token names in debug output

• generate: keep GCC jump tables enabled for large lexers

• generate: exclude external word tokens from keyword extraction

• lib: check shifted stack versions during error recovery

• generate: detect indirect recursion in flattened productions

• preserve column dependency when balancing repeat nodes

• lib: acquire capture lists from a free stack instead of scanning

• build: don't compile the Wasm stdlib into Emscripten builds

• various query issues

• rust: ban std::fs::canonicalize

• bindings: load Node bindings under Bun again

• release v0.27.1

What's Changed

• start working on v0.27

• docs: remove conflicting --release cargo flag in contributing.md

• cli: trailing whitespace after multiline text nodes in CST

• cli: correct discrepancy with cst for --no-ranges

• Fix Playground Query

• cli: cst printing improvements

• cli: set language in cwd for all usages of highlight command

• cli: concurrent builds of the same grammar on different locations on disk

• cli: canonicalize build --output path

• cli: make test --update rewrite all corpus files

• cli: increase verbosity of tree-sitter init -u updates

• cli: restore test summary output for tree-sitter test

• wasm: add some common used defs to wasm stdlib

• wasm: update wasm-stdlib.h

• Fix python free-threading compatibility

• build: define _BSD_SOURCE

• docs: appease clippy regarding spacing in README

• wasm: regenerate stdlib with wasm-opt

• Clarify lifetime parameters; Rust 2018 idioms

• free memory automatically

• cli: warn user when nm can't be run to verify the symbols inside the parser being built

• ci: ensure wasm-stdlib.h is regenerated when wasm stdlib source files are modified

• wasm: give binaryen the wasi-sdk treatment

• loader: search correct cache directory for wasi-sdk clang

• Fix tree-sitter-ruby crate failing to build to Wasm

• wasm: add iswpunct to stdlib

• lib: address strict aliasing violations with Array type

• misc Windows fixes

• wasm: correct several bugs in realloc

• ci: add wasm-stdlib.h to cache key

• generate: error if a supertype is defined as a terminal

• Action overflow

• wasm: don't wasm-opt twice

• loader: account for nm/ld fix on newer powerpc linux toolchains

• wasm: fix realloc optimization

• cli: use --edits value for fuzz tests

• cli: add --verbose flag to build command

• rust: bump language crate version

• rust: place std::env::set_var inside unsafe blocks

• lib: correct ts_parser_parse docstring

• test: acquire lock before downloading wasm tools

• cli: allow for both debug logs and graphs

• lib: clean up strict aliasing fixes in array.h

• cli: require tree-sitter CLI in CMake template

• breaking

  rust: return u32 from Node::child_count

• allow - in grammar names

• query: prevent cross-branch capture contamination in alternations with quantifiers

• web: add default export to CJS bundle

• rust: edition 2024, MSRV 1.90, lint cleanup, and dep updates

• breaking

  highlight: utf16 support

• use provided by RedoxOS byte orders implementations

• generate: unsafe extern -> extern in rendered C parser

• lib: cast NULL in ts_subtree_children macro

• cli(init): fix Package.swift scanner detection when used as a dependency

• wasm: update wasi-sdk and binaryen

• loader: invalidate cached wasm toolchains on version mismatch

• cli: init -u fixes

• cli(init): extract per-binding generators and named update functions

• skip missing Makefile in version command

• wasm: pass target triple to clang

• generate: optimize TokenSet

• Propose fix some typos

• loader: link with libc on OpenBSD to compile parser

• rust: remove unused dependencies from loader and lib

• query: don't add copies for quantifier steps outside alternations

• revert allowing dashes in parser name

• loader: unconditionally import Mutex

• generate: allow disabling qjs-rt feature from CLI

• lib: document invariants that must be upheld for TSInputEdit

• parser: use LookaheadIterator in error recovery's all-symbol scan

• misc. clippy and typo fixes

• parser: sort error recovery reductions for deterministic ordering

• cli: misc. improvements

• Fix wasm loading of languages w/ multiple reserved word sets

• loader: don't discard CC wrapper command specified in CC variable

• generate: avoid panicking when a supertype only has hidden external token children

• cli: replace regex with manual parsing in test file parser PLUS loader lock file rewrite

• generate: don't require tree-sitter.json for ABI 15

• ci: include wasi-sdk and binaryen version files in fixture cache hash

• generate: More optimizations

• update broken link to Parser.Language in template

• update parser template to zig 0.16

• loader: allow filenames with dots

• generate: pass default optimization level in generate_parser_for_grammar

• Prevent a buffer over-read when parsing 4-byte UTF-16 characters.

• Add Solaris support to the portable endian header

• query: overflow in capture pool ids + some perf

• wasm: add Language.loadSync for synchronous loading

• cli: account for process versions > 5 in the parse command's pretty debug output.

• Validate Wasm language memory reads

• generate: improve error message for nonterminals used in immediate token rule

• generate: rewrite parse_grammar with forward DFS

• test: write fixture headers once

• wasm: load supertype tables for ABI 15 grammars

• test: restore corpus test header blank line and divider tie behavior

• cli: place generate artifacts next to grammar file rather than cwd

• lib: update doc comment for ts_parser_parse

• lib: use correct TREE_SITTER_HIDE_SYMBOLS macro name in alloc.h

• generate: derive Deserialize on GenerateError and all subtypes

• cli: improve soundness of cst range calculation

• rewrite ts_subtree__write_to_string iteratively

• loader: skip --no-undefined for sanitizer grammar builds

• cli: infinite loop in highlight test

• lib: Consider subtree lookahead bytes when determining whether the parser can reuse a node.

• bindings: defer importlib.resources import in python template

• add DESCRIPTION to grammar Makefile template

• cli: display warning to user if parser test corpus dir isn't found

• cli: warn user for various malformed tests

• docs: explicitly warn against aliasing supertypes

• rust: more clippy fixes in generate

• cli: highlight test did not properly check for spans on later rows

• rust: use more accurate types for various IoError structs

• feat(cli) tree-sitter test --show-diff-symbols

• lib: address strict aliasing violations in TreeCursor type

• dsl: forbid invalid field names

• Clarify behavior of advance(..., skip) in external scanner docs

• Update README.md

• Fix issues with queries matching a parent node with anchored children (siblings)

• Add ts_query_copy for cloning queries

• generate: collect warnings as structured data

• breaking

  rust: change ts_set_allocator to accept one optional Allocator object rather than 4 separate optional function pointers.

• xtask: eliminate silent errors in zig fetch

• query: short-circuit longest-match dedup for disjoint states

• query: various anchor fixes

• improve error message and docs for supertypes made invalid by hidden children

• Fix C++ compilation errors in array macros.

• rust: address new clippy lints

• breaking

  cli: don't load all languages via config when lib path is passed

• generate: strip non-ASCII case folds

• templates: update setup.py & Package.swift

• ci: re-set executable permission on release artifacts before zipping

• web: expand Language::load to accept URL filepath

• breaking

  highlight: include underlying LanguageError in highlight and tag crates' error enums

• Fix broken url

• generate: only strip case-folded ſ/K when the /i flag is set

• cli: init --update should not update setup.py after replacing it

• query: keep the trailing anchor when a zero-matched quantifier is anchored on both sides

• init: don't lowercase repository url

• breaking

  cli: make parents flags a hard requirements via clap

• highlight: use std::sync::OnceCell for various loader fields

• breaking

  rust: require parser loggers to be Send + 'static

• breaking

  cli: rework HTML output modes in highlight

• parser: restart recovery for invalid tokens in the error state

• Fix associativity resolution with mixed shift precedences

• breaking

  rust: tie query iterators to options lifetime

• Expose OptLevel on generate_parser_for_grammar

• parser: fix parsing bug repeat operator

• generate: embrace data oriented design

• query: correctly identify MISSING nodes in queries

• test: allow corpus tests to use cst outputs

• query: correctly set a state's skipped_quantifier flag when a

• rust: trim unused imports

• lib: add state to missing nodes

• generate: fold case-insensitive patterns at the AST leaves

• breaking

  generate: error on invalid byte class patterns

• breaking

  lib: rework LookaheadIterator

• parser: avoid wide error nodes on unparseable input

• breaking

  swift: drop Package.swift

• lib: fast paths for ascii

• Allow using Tree-sitter rust lib in multi-threaded web apps compiled to wasm32-unknown-unknown

• generate: refactor node_types JSON generation logic

• ci: run all workspace tests

• Upgrade to latest wasmtime, improve robustness and perf of wasm-based parsing

• breaking

  generate: error when nonexistent file path is passed to generate_parser_in_directory.

• breaking

  add an eof function

• rust: remove must_use attribute from Tree::changed_ranges

• generate: further node-types.json cleanup

• generate: use a single buffer for the string pool's backing store

• cli: align GrammarSchema type with grammar() return value

• playground: set LANGUAGE_BASE_URL to "." to fix subfolder hosting

• web: map Node-only specifiers to false via browser field

• cli: correct zero-based positions for --edits

• various memory safety issues

• Remove Dockerfile mention from flake.nix

What's Changed

• query: correctly identify MISSING nodes in queries

• query: correctly set a state's skipped_quantifier flag when a

• generate: fold case-insensitive patterns at the AST leaves

• parser: avoid wide error nodes on unparseable input

• ci: run all workspace tests

• rust: remove must_use attribute from Tree::changed_ranges

• release v0.26.13

What's Changed

• generate: fold case-insensitive patterns ourselves

• query: keep the trailing anchor when a zero-matched quantifier is anchored on both sides

• templates: add C source files to Python sdist

• init: don't lowercase repository url

• highlight: use std::sync::OnceCell for various loader fields

• parser: restart recovery for invalid tokens in the error state

• Fix associativity resolution with mixed shift precedences

• parser: fix parsing bug repeat operator

• release v0.26.12