Skip to content

fix: enable useLegacyCompletionsEndpoint to use openai package streaming #10026

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
uinstinct wants to merge 6 commits into
base: main
Choose a base branch
from
+3 −1
Open

fix: enable useLegacyCompletionsEndpoint to use openai package streaming #10026

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
6 commits
Select commit Hold shift + click to select a range
ef4cb51
feat: add requestoptions.stream in model config
uinstinct Jan 30, 2026
fbcd3e3
Merge branch 'main' into unverified-org
uinstinct Feb 2, 2026
19b632f
remove introduced requestoptions.stream
uinstinct Feb 2, 2026
ac5b8dc
remove console log
uinstinct Feb 2, 2026
be39317
restore config-types
uinstinct Feb 2, 2026
208d2b8
add stream option to config yaml reference
uinstinct Feb 2, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
3 changes: 2 additions & 1 deletion core/llm/index.ts
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -1037,7 +1037,8 @@ export abstract class BaseLLM implements ILLM {
return (
this.providerName === "openai" &&
typeof (this as any)._streamResponses === "function" &&
(this as any).isOSeriesOrGpt5Model(options.model)
(this as any).isOSeriesOrGpt5Model(options.model) &&
this._llmOptions.useLegacyCompletionsEndpoint !== true
);
}

Expand Down
1 change: 1 addition & 0 deletions docs/reference.mdx
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -110,6 +110,7 @@ The `models` section defines the language models used in your configuration. Mod
- `stop`: An array of stop tokens that will terminate the completion.
- `reasoning`: Boolean to enable thinking/reasoning for Anthropic Claude 3.7+ and some Ollama models.
- `reasoningBudgetTokens`: Budget tokens for thinking/reasoning in Anthropic Claude 3.7+ models.
- `stream`: Boolean to enable/disable streaming for the model.

- `requestOptions`: HTTP request options specific to the model.

Expand Down
Loading