[Feature]: Reduce Token usage with Toon #5
Description
Problem Statement
We want Sugar to fast, efficient and effective. We can offer this be being a very lightweight integration as a model tool. Explore reducing LLM Token Usage by moving away from JSON to alternate formats.
Proposed Solution
Investigate using TOON (Token-Oriented Object Notation) instead of JSON for reducing token usage. https://x.com/DataChaz/status/1985983439422820498
Token usage comparison for different formats:
https://www.curiouslychase.com/playground/format-tokenization-exploration
Toon on Github: https://github.com/toon-format/toon
Alternatives Considered
No response
Feature Type
New slash command
Priority
Critical - Blocking my work
Use Case
No response
Additional Context
No response