handle 5xx by requeueing the request #9
Labels
No labels
bug
duplicate
enhancement
help wanted
invalid
question
wontfix
No milestone
No project
No assignees
1 participant
Notifications
Due date
No due date set.
Dependencies
No dependencies set.
Reference: Wroclaw/GPTcord#9
Loading…
Reference in a new issue
No description provided.
Delete branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
sometimes the openai api responses with 503, they ask to repeat the request. We should requeue the request instead of erroring the request.
it should be requeued to the front of the queue
the same should go with 500
possible all 5xx (server side) errors
if we handle those, we should also make sure to not make an accidental loop of it, so like 3 retries at max
handle 503 by requeueing the requestto handle 5xx by requeueing the request