tohki
A tiny dependency-free Rust tokenizer that converts source code into typed tokens, used for syntax highlighting.
01
Tohki
Tohki reads source text and returns a token for each fragment. These tokens contain metadata whose usage is up to the implementation/consumer.
02
Token definition
A token is composed of the kind, byte range, and source text of each fragment.
03
Language Structure
A language is defined by its names, comments, quotes, keywords, types, and constants.
More work
Portals & PhysicsA two-player cooperative obby built on a portal gun and a physics gun, released on Roblox in September 2025. Over ten million visits and 75,000 favourites.
Godot SwarmA C++ GDExtension that provides an all-in-one solution for handling thousands of physics simulated, animated, and pathfinding entities in Godot.
AthenaStore any information of all kinds; tasks, memories, notes, projects, and more in a unified and organized interface.
AnicoA self-hosted incremental anime card collecting game that runs as a webapp. Pull packs, merge duplicates into higher stars, and spend the credits on upgrades that scale nearly infinitely!- mdreA terminal markdown (GFM) manager that browses, renders, and edits notes in one TUI. Wiki-style links, a live preview pane, and a command palette in a single Rust binary.