Question d’entretien chez Zendesk

How would you design an Realtime LLM Inference Service