SSE接口一次請(qǐng)求會(huì)分多次響應(yīng)體(chunk)返回, 這就可以表現(xiàn)為流式響應(yīng).
chatgpt對(duì)話窗口幾個(gè)字幾個(gè)字蹦出來(lái)的效果,就使用的這種協(xié)議
python httpx-sse 客戶(hù)端 demo
import httpx
from httpx_sse import connect_sse
import json
url = "http://127.0.0.1:8080/streamecho"
param = {
"text": "你好啊~",
"num": 100,
"interval": 0.5
}
with httpx.Client() as client:
with connect_sse(client, "GET", url, params=param) as event_source:
# 把 iter_sse() 迭代完, 就相當(dāng)于處理完了一次流式調(diào)用
for sse in event_source.iter_sse():
# 流式響應(yīng)中,每次響應(yīng)體的處理邏輯
chunk_result = json.loads(sse.data)
# sse.event 獲取 event 類(lèi)型; sse.data 獲取每次返回的數(shù)據(jù)
print(sse.event, json.dumps(chunk_result, ensure_ascii=False))
print()
# message {"part": 0, "text": "你好啊~", "datetime": "2024-09-03 17:53:35.684078"}
# message {"part": 1, "text": "你好啊~", "datetime": "2024-09-03 17:53:36.185339"}
# message {"part": 2, "text": "你好啊~", "datetime": "2024-09-03 17:53:36.686913"}
參考
Server-Sent Events 教程參考: https://www.ruanyifeng.com/blog/2017/05/server-sent_events.html