What does "streaming" a response mean?

Question

Accepted Answer

Sending tokens as they are generated — output appears piece by piece live — Streaming sends tokens as they're generated, so output appears piece by piece. It's not video, parallel replies, or saving to a file.

Answer

Sending the reply as a video — the answer is rendered as a short clip

Answer

Sending many replies at once — several full answers arrive in parallel

Answer

Sending the reply to storage — the output is saved to a file, not shown

What does "streaming" a response mean?

Why this is the answer

More Building with LLMs: APIs, Tokens & Cost flashcards