Browse Source
Server-Sent Events responses set `Cache-Control: no-cache` and `X-Accel-Buffering: no` so proxies (e.g. Nginx) deliver events incrementally instead of buffering the whole response. JSONL streaming responses are incremental in the same way, but were missing these headers, so a buffering proxy would hold back the lines and defeat the streaming. Set the same headers on the JSONL response for consistency with SSE.pull/15813/head
2 changed files with 22 additions and 0 deletions
Loading…
Reference in new issue