Skip to content

Improved token counting

Erut requested to merge erut/improve-token-counting into main

Improved token counting by splitting between tokens in and tokens out, and using the OpenAI provided measurements.

Merge request reports