Latency

Latency is the time added between the moment something is said and the moment the translation is heard. For conversation to feel natural, total added latency needs to stay around or below one second; beyond that, people start talking over each other.

Real-time systems reduce latency by streaming each stage — recognition, translation, and synthesis — instead of processing whole utterances in sequence.