Skip to content

SimulateStreamingMiddleware

Namespace: Vercel.AI

public sealed class SimulateStreamingMiddleware : LanguageModelMiddleware, ILanguageModelMiddleware

Turns a non-streaming model into text deltas. Maps to simulateStreamingMiddleware.

Inheritance: object → LanguageModelMiddleware

Implements: ILanguageModelMiddleware

View source

Simulate(ILanguageModel, LanguageModelCallOptions, CancellationToken)

Section titled “Simulate(ILanguageModel, LanguageModelCallOptions, CancellationToken)”
public Task<LanguageModelStreamResult> Simulate(ILanguageModel model, LanguageModelCallOptions options, CancellationToken cancellationToken)

Generates once and yields the text as a single delta.

Parameters

Name Type Description
model ILanguageModel
options LanguageModelCallOptions
cancellationToken CancellationToken

Returns: Task<LanguageModelStreamResult>

View source

Apache-2.0 · Copyright 2023 Vercel, Inc. · unofficial community port, not an official Vercel product