Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
5 changes: 0 additions & 5 deletions .changeset/bright-reports-record.md

This file was deleted.

5 changes: 0 additions & 5 deletions .changeset/calm-replies-wait.md

This file was deleted.

5 changes: 0 additions & 5 deletions .changeset/calm-tokens-rest.md

This file was deleted.

5 changes: 0 additions & 5 deletions .changeset/chat-context-remove.md

This file was deleted.

13 changes: 0 additions & 13 deletions .changeset/first-retry-interval-milliseconds.md

This file was deleted.

5 changes: 0 additions & 5 deletions .changeset/fuzzy-taxis-listen.md

This file was deleted.

6 changes: 0 additions & 6 deletions .changeset/fuzzy-tools-write.md

This file was deleted.

15 changes: 0 additions & 15 deletions .changeset/llm-retryable-content-only.md

This file was deleted.

15 changes: 0 additions & 15 deletions .changeset/llm-ttft-measures-generation.md

This file was deleted.

5 changes: 0 additions & 5 deletions .changeset/low-inference-priority.md

This file was deleted.

5 changes: 0 additions & 5 deletions .changeset/lucky-moons-sing.md

This file was deleted.

5 changes: 0 additions & 5 deletions .changeset/metal-workers-exit.md

This file was deleted.

5 changes: 0 additions & 5 deletions .changeset/openai-realtime-truncate-delete.md

This file was deleted.

5 changes: 0 additions & 5 deletions .changeset/quiet-speeches-rest.md

This file was deleted.

15 changes: 0 additions & 15 deletions .changeset/responses-retryable-content-only.md

This file was deleted.

5 changes: 0 additions & 5 deletions .changeset/soft-plays-wait.md

This file was deleted.

5 changes: 0 additions & 5 deletions .changeset/soniox-usage-cadence.md

This file was deleted.

13 changes: 0 additions & 13 deletions .changeset/stream-terminal-failure-rejection.md

This file was deleted.

8 changes: 0 additions & 8 deletions .changeset/tidy-bears-resume.md

This file was deleted.

5 changes: 0 additions & 5 deletions .changeset/tidy-consts-rest.md

This file was deleted.

6 changes: 0 additions & 6 deletions .changeset/tidy-speeches-wait.md

This file was deleted.

5 changes: 0 additions & 5 deletions .changeset/tidy-stars-speak.md

This file was deleted.

5 changes: 0 additions & 5 deletions .changeset/tough-years-smile.md

This file was deleted.

5 changes: 0 additions & 5 deletions .changeset/two-rivers-open.md

This file was deleted.

6 changes: 0 additions & 6 deletions .changeset/update-cerebras-models.md

This file was deleted.

6 changes: 0 additions & 6 deletions .changeset/xai-final-transcript.md

This file was deleted.

5 changes: 0 additions & 5 deletions .changeset/xai-interim-transcripts.md

This file was deleted.

5 changes: 0 additions & 5 deletions .changeset/yummy-cows-return.md

This file was deleted.

82 changes: 82 additions & 0 deletions agents/CHANGELOG.md
Original file line number Diff line number Diff line change
@@ -1,5 +1,87 @@
# @livekit/agents

## 1.6.3

### Patch Changes

- Include resolved recording options under session report options instead of as a top-level field. - [#2274](https://github.com/livekit/agents-js/pull/2274) ([@rosetta-livekit-bot](https://github.com/apps/rosetta-livekit-bot))

- Use the active agent endpointing delay while holding pending replies during user speech. - [#2276](https://github.com/livekit/agents-js/pull/2276) ([@chenghao-mou](https://github.com/chenghao-mou))

- Default null token counts in OpenAI-compatible streaming usage payloads to zero. - [#2250](https://github.com/livekit/agents-js/pull/2250) ([@rosetta-livekit-bot](https://github.com/apps/rosetta-livekit-bot))

- Add `ChatContext.remove()` for removing chat items by item or ID. - [#1963](https://github.com/livekit/agents-js/pull/1963) ([@rosetta-livekit-bot](https://github.com/apps/rosetta-livekit-bot))

- fix: wait 100ms before the first retry, not 0.1ms - [#2219](https://github.com/livekit/agents-js/pull/2219) ([@u9g](https://github.com/u9g))

`intervalForRetry` returned `0.1` for the first retry — Python's 0.1 _seconds_, carried over
without converting to the milliseconds every caller passes to `setTimeout`/`delay`. Its other
branch returns `retryIntervalMs`, so the two return paths were in different units. Measured,
the first retry waited ~3ms (scheduling overhead alone) against Python's 100ms.

This affects every retrying component — LLM, STT, TTS, avatars, and the turn-detector
transport — where a first retry reattempted essentially instantly.

- Expose prompt-cache creation token counts in LLM metrics and model usage. - [#2257](https://github.com/livekit/agents-js/pull/2257) ([@rosetta-livekit-bot](https://github.com/apps/rosetta-livekit-bot))

- fix(inference): keep a stream retryable until it emits generation - [#2219](https://github.com/livekit/agents-js/pull/2219) ([@u9g](https://github.com/u9g))

`retryable` was cleared by any chunk reaching the caller, including ones that carry no
output: a usage block, or provider metadata such as the LiveKit inference gateway's
deployment/tier stamp or a Gemini thought signature. The gateway stamps its leading
(contentless) delta, so every streamed response went unretryable from its first chunk — a
mid-stream stall then failed the turn outright rather than retrying, with nothing generated
and nothing for a retry to duplicate. Only failures landing before the very first chunk
still recovered.

`retryable` is now cleared on text or a tool call, the output a retry would actually repeat.

- fix(llm): measure ttft against generation, not the first chunk to arrive - [#2219](https://github.com/livekit/agents-js/pull/2219) ([@u9g](https://github.com/u9g))

The time-to-first-token clock started on whatever chunk arrived first. That was harmless
while a stream went unretryable at its first chunk, because a retry then implied nothing had
arrived. Now that a contentless chunk keeps a stream retryable, the metadata chunk of a
_failed_ attempt starts the clock, and the turn reports a near-zero ttft for a wait that
spanned a stall and a retry — so retried turns read as faster than a normal one rather than
slower.

The clock now starts on generation, in both the metrics monitor and the voice pipeline's
span. A response that generates nothing continues to report `ttftMs` as -1.

- Support low-priority LiveKit inference requests. - [#2268](https://github.com/livekit/agents-js/pull/2268) ([@rosetta-livekit-bot](https://github.com/apps/rosetta-livekit-bot))

- Add expressive mode: `AgentSession({ expressive: true })` injects the TTS provider's markup guide into the LLM prompt so the model emits inline `<expr/>` delivery markers (emotion, pacing, non-verbal sounds). The markers are lowered to each provider's native syntax before synthesis (Cartesia, Inworld TTS 2, xAI, Fish Audio) and stripped from transcripts, with the segment's leading expression surfaced as the `lk.expression` transcription attribute. Steer delivery with `ExpressiveOptions.speechSteering` or override the injected prompt entirely. - [#2267](https://github.com/livekit/agents-js/pull/2267) ([@tinalenguyen](https://github.com/tinalenguyen))

- Fix worker cleanup after LiveKit connection retries are exhausted. - [#1889](https://github.com/livekit/agents-js/pull/1889) ([@rosetta-livekit-bot](https://github.com/apps/rosetta-livekit-bot))

- Avoid throwing when interrupting protected speech that was already interrupted or completed. - [#2252](https://github.com/livekit/agents-js/pull/2252) ([@rosetta-livekit-bot](https://github.com/apps/rosetta-livekit-bot))

- Hold pending agent replies when user speech overlaps their playout launch. - [#2263](https://github.com/livekit/agents-js/pull/2263) ([@rosetta-livekit-bot](https://github.com/apps/rosetta-livekit-bot))

- fix(agents): stop a terminally failed stream leaving an unhandled rejection - [#2219](https://github.com/livekit/agents-js/pull/2219) ([@u9g](https://github.com/u9g))

`LLMStream` and `STTStream` dropped the promise from their fire-and-forget main task, so a
stream that exhausted its retries rejected with no handler attached — reaching the job
process's `unhandledRejection` hook as a spurious crash report for a failure already
delivered through the `error` event, and failing any test run that exercises the path.

The task is now awaited inside a `try`/`finally` that closes the queue either way, matching
what `TTSStream` already does.

- Avoid dropping realtime turns or resuming agent speech before a paused turn decision settles. - [#2204](https://github.com/livekit/agents-js/pull/2204) ([@rosetta-livekit-bot](https://github.com/apps/rosetta-livekit-bot))

A turn decision that is cancelled no longer resumes the paused speech, and one that fails no
longer leaves the agent's audio output paused indefinitely.

- Keep defaulted const fields non-nullable in strict tool schemas. - [#2262](https://github.com/livekit/agents-js/pull/2262) ([@rosetta-livekit-bot](https://github.com/apps/rosetta-livekit-bot))

- Stop interrupting queued speech at the first live speech that disallows interruptions, preserving - [#2251](https://github.com/livekit/agents-js/pull/2251) ([@rosetta-livekit-bot](https://github.com/apps/rosetta-livekit-bot))
it and the queued speech behind it.

- Strip markdown emphasis from CJK, kana, Thai, and Korean text before TTS. - [#2175](https://github.com/livekit/agents-js/pull/2175) ([@rosetta-livekit-bot](https://github.com/apps/rosetta-livekit-bot))

- fix: omit interruption telemetry from normal user turns - [#2265](https://github.com/livekit/agents-js/pull/2265) ([@chenghao-mou](https://github.com/chenghao-mou))

## 1.6.2

### Patch Changes
Expand Down
2 changes: 1 addition & 1 deletion agents/package.json
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
{
"name": "@livekit/agents",
"version": "1.6.2",
"version": "1.6.3",
"description": "LiveKit Agents - Node.js",
"main": "dist/index.js",
"require": "dist/index.cjs",
Expand Down
7 changes: 7 additions & 0 deletions plugins/anam/CHANGELOG.md
Original file line number Diff line number Diff line change
@@ -1,5 +1,12 @@
# @livekit/agents-plugin-anam

## 1.6.3

### Patch Changes

- Updated dependencies [[`127b100`](https://github.com/livekit/agents-js/commit/127b10037ad405f89ba423c8f6b425106272021b), [`5ed9d72`](https://github.com/livekit/agents-js/commit/5ed9d7289f7ae73976378c21d3b1c7c4627f08d1), [`7e9f46e`](https://github.com/livekit/agents-js/commit/7e9f46ef021700279db1c16ef652354239ffec92), [`4b35349`](https://github.com/livekit/agents-js/commit/4b353492f903c4bce34c917ec27ec4750ece122d), [`ce2d287`](https://github.com/livekit/agents-js/commit/ce2d28778b7105848beed7e57b0c5384ca4c30cf), [`98831f7`](https://github.com/livekit/agents-js/commit/98831f71d5dbdb94c9722e87aaa5ab07ba2a3525), [`ce2d287`](https://github.com/livekit/agents-js/commit/ce2d28778b7105848beed7e57b0c5384ca4c30cf), [`ce2d287`](https://github.com/livekit/agents-js/commit/ce2d28778b7105848beed7e57b0c5384ca4c30cf), [`57e017d`](https://github.com/livekit/agents-js/commit/57e017d3838656679caf0fff22229ca54afcd132), [`7e36727`](https://github.com/livekit/agents-js/commit/7e367279cb62c608e25b844a1dc16914583310a1), [`355718b`](https://github.com/livekit/agents-js/commit/355718be277e1138b63013577aabebc1e8043728), [`ed706fa`](https://github.com/livekit/agents-js/commit/ed706fa3fe69bc5289fe2d73c536d567fab3ad2d), [`5c8cd1e`](https://github.com/livekit/agents-js/commit/5c8cd1e76d39186ef23674e0bcc621bc9c143b27), [`ce2d287`](https://github.com/livekit/agents-js/commit/ce2d28778b7105848beed7e57b0c5384ca4c30cf), [`b16f198`](https://github.com/livekit/agents-js/commit/b16f1984dc58b2117050647f51d0a1ad654d6504), [`54edf88`](https://github.com/livekit/agents-js/commit/54edf88dd173c825eb6ced25170e950c9d7845d6), [`4c08ddb`](https://github.com/livekit/agents-js/commit/4c08ddbcbc7e230f00512606fb00b53206e6b76b), [`4d46bcf`](https://github.com/livekit/agents-js/commit/4d46bcfd4a555e2a42abb1c9ee7cd2e44a666641), [`15932fa`](https://github.com/livekit/agents-js/commit/15932fa403d98ca4e93bef8bd453b83e5e453c0c)]:
- @livekit/agents@1.6.3

## 1.6.2

### Patch Changes
Expand Down
2 changes: 1 addition & 1 deletion plugins/anam/package.json
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
{
"name": "@livekit/agents-plugin-anam",
"version": "1.6.2",
"version": "1.6.3",
"description": "Anam plugin for LiveKit Node Agents",
"main": "dist/index.js",
"require": "dist/index.cjs",
Expand Down
9 changes: 9 additions & 0 deletions plugins/anthropic/CHANGELOG.md
Original file line number Diff line number Diff line change
@@ -1,5 +1,14 @@
# @livekit/agents-plugin-anthropic

## 1.6.3

### Patch Changes

- Expose prompt-cache creation token counts in LLM metrics and model usage. - [#2257](https://github.com/livekit/agents-js/pull/2257) ([@rosetta-livekit-bot](https://github.com/apps/rosetta-livekit-bot))

- Updated dependencies [[`127b100`](https://github.com/livekit/agents-js/commit/127b10037ad405f89ba423c8f6b425106272021b), [`5ed9d72`](https://github.com/livekit/agents-js/commit/5ed9d7289f7ae73976378c21d3b1c7c4627f08d1), [`7e9f46e`](https://github.com/livekit/agents-js/commit/7e9f46ef021700279db1c16ef652354239ffec92), [`4b35349`](https://github.com/livekit/agents-js/commit/4b353492f903c4bce34c917ec27ec4750ece122d), [`ce2d287`](https://github.com/livekit/agents-js/commit/ce2d28778b7105848beed7e57b0c5384ca4c30cf), [`98831f7`](https://github.com/livekit/agents-js/commit/98831f71d5dbdb94c9722e87aaa5ab07ba2a3525), [`ce2d287`](https://github.com/livekit/agents-js/commit/ce2d28778b7105848beed7e57b0c5384ca4c30cf), [`ce2d287`](https://github.com/livekit/agents-js/commit/ce2d28778b7105848beed7e57b0c5384ca4c30cf), [`57e017d`](https://github.com/livekit/agents-js/commit/57e017d3838656679caf0fff22229ca54afcd132), [`7e36727`](https://github.com/livekit/agents-js/commit/7e367279cb62c608e25b844a1dc16914583310a1), [`355718b`](https://github.com/livekit/agents-js/commit/355718be277e1138b63013577aabebc1e8043728), [`ed706fa`](https://github.com/livekit/agents-js/commit/ed706fa3fe69bc5289fe2d73c536d567fab3ad2d), [`5c8cd1e`](https://github.com/livekit/agents-js/commit/5c8cd1e76d39186ef23674e0bcc621bc9c143b27), [`ce2d287`](https://github.com/livekit/agents-js/commit/ce2d28778b7105848beed7e57b0c5384ca4c30cf), [`b16f198`](https://github.com/livekit/agents-js/commit/b16f1984dc58b2117050647f51d0a1ad654d6504), [`54edf88`](https://github.com/livekit/agents-js/commit/54edf88dd173c825eb6ced25170e950c9d7845d6), [`4c08ddb`](https://github.com/livekit/agents-js/commit/4c08ddbcbc7e230f00512606fb00b53206e6b76b), [`4d46bcf`](https://github.com/livekit/agents-js/commit/4d46bcfd4a555e2a42abb1c9ee7cd2e44a666641), [`15932fa`](https://github.com/livekit/agents-js/commit/15932fa403d98ca4e93bef8bd453b83e5e453c0c)]:
- @livekit/agents@1.6.3

## 1.6.2

### Patch Changes
Expand Down
2 changes: 1 addition & 1 deletion plugins/anthropic/package.json
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
{
"name": "@livekit/agents-plugin-anthropic",
"version": "1.6.2",
"version": "1.6.3",
"description": "Anthropic plugin for LiveKit Node Agents",
"main": "dist/index.js",
"require": "dist/index.cjs",
Expand Down
Loading
Loading