github/new-api
1
0
Fork 0
mirror of https://github.com/QuantumNous/new-api.git synced 2026-04-18 07:47:26 +00:00
Code Issues Packages Projects Releases Wiki Activity
4,885 Commits 34 Branches 616 Tags
coderabbitai/docstrings/9aeef6a
Commit Graph

2 Commits

Author SHA1 Message Date
CaIon
0c051e968f feat(token_estimator): add concurrency support for multipliers retrieval 2025-12-02 21:38:58 +08:00
CaIon
f5b409d74f feat: refactor token estimation logic 
- Introduced new OpenAI text models in `common/model.go`.
- Added `IsOpenAITextModel` function to check for OpenAI text models.
- Refactored token estimation methods across various channels to use estimated prompt tokens instead of direct prompt token counts.
- Updated related functions and structures to accommodate the new token estimation approach, enhancing overall token management.
 2025-12-02 21:34:39 +08:00