LanguageModelMiddleware

Namespace: Vercel.AI

public abstract class LanguageModelMiddleware : ILanguageModelMiddleware

Passes both operations through.

Inheritance: object

Implements: ILanguageModelMiddleware

Derived: DefaultInstructionsMiddleware, DefaultSettingsMiddleware, ExtractJsonMiddleware, ExtractReasoningMiddleware, SimulateStreamingMiddleware

View source

Methods

WrapGenerateAsync(LanguageModelCallOptions, Func<LanguageModelCallOptions, CancellationToken, Task<LanguageModelGenerateResult>>, CancellationToken)

public virtual Task<LanguageModelGenerateResult> WrapGenerateAsync(LanguageModelCallOptions options, Func<LanguageModelCallOptions, CancellationToken, Task<LanguageModelGenerateResult>> next, CancellationToken cancellationToken)

Wraps a generate call.

Parameters

Name	Type	Description
options	LanguageModelCallOptions
next	Func<LanguageModelCallOptions, CancellationToken, Task<LanguageModelGenerateResult>>
cancellationToken	CancellationToken

Returns: Task<LanguageModelGenerateResult>

View source

WrapStreamAsync(LanguageModelCallOptions, Func<LanguageModelCallOptions, CancellationToken, Task<LanguageModelStreamResult>>, CancellationToken)

public virtual Task<LanguageModelStreamResult> WrapStreamAsync(LanguageModelCallOptions options, Func<LanguageModelCallOptions, CancellationToken, Task<LanguageModelStreamResult>> next, CancellationToken cancellationToken)

Wraps a stream call.

Parameters

Name	Type	Description
options	LanguageModelCallOptions
next	Func<LanguageModelCallOptions, CancellationToken, Task<LanguageModelStreamResult>>
cancellationToken	CancellationToken

Returns: Task<LanguageModelStreamResult>

View source