dc91830fae
quota/tokenCount: allow arbitrary multipliers for tokens
...
I didn't notice that OpenAI changed pricing again
2023-09-25 09:52:22 +02:00
552143e345
quota/tokenCount: Rename single variable name to something that has more sense
...
I forgot to rename it when I commited it last time ;-;
2023-09-25 09:30:52 +02:00
94992743e8
quota/tokenCount: fix "null from a database"
2023-09-21 21:51:03 +02:00
16fb74ec4b
quota/tokenCount: Implement the "request tokens as half" case
2023-09-21 20:42:06 +02:00
4abdaebf70
quota/tokenCount: I always forget about debug logs...
2023-09-21 20:38:50 +02:00
6792c05959
Quota: add tokenCount QuotaEngine
2023-09-21 20:07:35 +02:00
e194c1d81a
messageCount: Add docs
2023-09-21 09:31:23 +02:00
339ef06ff9
Quota: Refactor how Quotas are being handled
...
also renamed limits to quota
I believe this new approach would allow me and bot hosters
to add, implement or change the quota behavior more easily.
Reimplemented the currently existing "Message count" limit
to use the new IQuota, refactoring a code *a little*.
2023-09-21 07:11:15 +02:00