Put the help desk's agent behind a web API: conversations kept by id, with every error as a problem details object; a gate in front of the model, with a time limit on each reply; the reply streamed as server-sent events, kept only once it's whole; a review of an assistant's replies; and the app, ready to serve, with its settings from the environment.
You build
conversations.py, then gate.py, then replies.py, then desk_replies.py, then app.py