scalaer
V2EX  ›  问与答

写了一篇 blog 关于 langchain llm streaming

  •  
  •   scalaer · Oct 18, 2023 · 797 views
    This topic created in 965 days ago, the information mentioned may be changed or developed.

    Langchain 通过 callback 机制,可以将 LLM 输出的 token 实时处理. 同时支持同步 IO 和异步 IO 的方式来输出 token ,分别对应 StreamingStdOutCallbackHandler 和 AsyncIteratorCallbackHandler

    Langchian LLM Streaming

    No Comments Yet
    About   ·   Help   ·   Advertise   ·   Blog   ·   API   ·   FAQ   ·   Solana   ·   5391 Online   Highest 6679   ·     Select Language
    创意工作者们的社区
    World is powered by solitude
    VERSION: 3.9.8.5 · 28ms · UTC 08:06 · PVG 16:06 · LAX 01:06 · JFK 04:06
    ♥ Do have faith in what you're doing.