Snapcompact: SoTA compaction, instant, local, free. Pick 3
↗ https://stencil.so/blog/snapcompact
A clever way to get context into a model while spending fewer tokens on it.
The idea: instead of the text, you hand the model an image with that same text written on it in a tiny font.
Get the font settings right and you save a lot of tokens, with quality that holds up.