Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
5 changes: 0 additions & 5 deletions .changeset/agents-voice-audio-input-export.md

This file was deleted.

5 changes: 0 additions & 5 deletions .changeset/azure-stt-cancellation-recovery.md

This file was deleted.

5 changes: 0 additions & 5 deletions .changeset/chubby-months-stop.md

This file was deleted.

5 changes: 0 additions & 5 deletions .changeset/commit-inflight-turn-on-close.md

This file was deleted.

5 changes: 0 additions & 5 deletions .changeset/dry-mirrors-pull.md

This file was deleted.

5 changes: 0 additions & 5 deletions .changeset/fishaudio-drop-startup-prebuffer.md

This file was deleted.

5 changes: 0 additions & 5 deletions .changeset/fishaudio-pool-prebuffer.md

This file was deleted.

5 changes: 0 additions & 5 deletions .changeset/fishaudio-tts-options.md

This file was deleted.

5 changes: 0 additions & 5 deletions .changeset/fresh-tts-chunked-retries.md

This file was deleted.

5 changes: 0 additions & 5 deletions .changeset/gemini-mixed-tools-cache.md

This file was deleted.

5 changes: 0 additions & 5 deletions .changeset/google-strip-thought-summaries.md

This file was deleted.

5 changes: 0 additions & 5 deletions .changeset/honor-ignore-on-enter-toolsets.md

This file was deleted.

5 changes: 0 additions & 5 deletions .changeset/instructions-template-collapse.md

This file was deleted.

9 changes: 0 additions & 9 deletions .changeset/late-playback-started-dropped-turns.md

This file was deleted.

5 changes: 0 additions & 5 deletions .changeset/lemonslice-meeting-support.md

This file was deleted.

5 changes: 0 additions & 5 deletions .changeset/openai-realtime-fatal-errors.md

This file was deleted.

5 changes: 0 additions & 5 deletions .changeset/openai-websocket-model-url.md

This file was deleted.

5 changes: 0 additions & 5 deletions .changeset/preserve-llm-response-telemetry.md

This file was deleted.

5 changes: 0 additions & 5 deletions .changeset/recorder-io-final-speech-flush.md

This file was deleted.

6 changes: 0 additions & 6 deletions .changeset/remove-native-transcript-sync.md

This file was deleted.

5 changes: 0 additions & 5 deletions .changeset/replace-prefix-holdback.md

This file was deleted.

5 changes: 0 additions & 5 deletions .changeset/send-dtmf-active-room.md

This file was deleted.

5 changes: 0 additions & 5 deletions .changeset/soft-tigers-speak.md

This file was deleted.

5 changes: 0 additions & 5 deletions .changeset/soniox-endpoint-latency-adjustment.md

This file was deleted.

5 changes: 0 additions & 5 deletions .changeset/xai-tts-speed.md

This file was deleted.

5 changes: 0 additions & 5 deletions .changeset/xai-tts-websocket-deadline.md

This file was deleted.

32 changes: 32 additions & 0 deletions agents/CHANGELOG.md
Original file line number Diff line number Diff line change
@@ -1,5 +1,37 @@
# @livekit/agents

## 1.5.3

### Patch Changes

- Export the `AudioInput` base class from the `voice` module so plugins and applications can implement custom agent audio inputs. - [#2036](https://github.com/livekit/agents-js/pull/2036) ([@aweitz](https://github.com/aweitz))

- Commit the in-flight assistant turn (interrupted: true, partially-forwarded text) when the session closes mid-playout — previously a room disconnect during playback dropped the turn from chatCtx entirely, with no ConversationItemAdded emitted (#2041) - [#2042](https://github.com/livekit/agents-js/pull/2042) ([@Sarfaraz85](https://github.com/Sarfaraz85))

- Restart chunked TTS retries with a fresh attempt queue so retried synthesis uses a fresh request ID and does not write to a closed failed-attempt queue. - [#1994](https://github.com/livekit/agents-js/pull/1994) ([@rosetta-livekit-bot](https://github.com/apps/rosetta-livekit-bot))

- Honor `ToolFlag.IGNORE_ON_ENTER` for tools nested inside `Toolset`s. - [#2011](https://github.com/livekit/agents-js/pull/2011) ([@rosetta-livekit-bot](https://github.com/apps/rosetta-livekit-bot))

- Fix modality-aware instruction templates to collapse identical variants and avoid duplicate rendered output. - [#2030](https://github.com/livekit/agents-js/pull/2030) ([@rosetta-livekit-bot](https://github.com/apps/rosetta-livekit-bot))

- fix(voice): stop dropping agent turns whose playback starts after audio forwarding completes (#1909, #1960; port of livekit/agents#5039). - [#1966](https://github.com/livekit/agents-js/pull/1966) ([@toubatbrian](https://github.com/toubatbrian))

`forwardAudio` used to reject `firstFrameFut` (and detach its `PLAYBACK_STARTED` listener) in its `finally` block whenever no frame had played by the time forwarding finished. Two real scenarios hit this window: a speech paused in the thinking state by a brief user sound, whose buffered first frame only plays after the false interruption clears (#1909), and DataStream avatar outputs with `waitPlaybackStart: true`, which deliver `lk.playback_started` ~1s after frames were captured (#1960). In both cases the late playback-started event found nothing listening, the reply was classified "skipped", and the turn was silently removed from the chat context while the agent never entered the `speaking` state.

The `PLAYBACK_STARTED` listener now lives in `performAudioForwarding` so it outlives the forwarding task, and `forwardAudio` no longer settles the future; the reply tasks (including the `say()` path) settle it once the playout window ends, which also detaches the listener. A reported non-zero playback position on interruption is additionally honored as evidence of partial playback — but only when the segment actually captured a frame into the output (tracked via the output's segment count, which is also what makes the reported position fresh rather than stale) — covering avatars whose playback-started RPC races the interruption itself.

- Preserve partial LLM response telemetry and generated function calls on every inference exit path. - [#2048](https://github.com/livekit/agents-js/pull/2048) ([@toubatbrian](https://github.com/toubatbrian))

- fix(voice): stop RecorderIO from dropping the final agent speech at session teardown. A force-interrupted shutdown marks the current speech done before playout settles, so the recorder could close and fence out the in-flight playbackFinished flush, silently losing the last agent turn and trailing mic audio from the recording. RecorderIO.close() now waits (bounded) for the pending playback event — which carries the authoritative playback position — before fencing, flushes any input captured since the last write, and warns if unflushed agent audio had to be dropped. - [#2037](https://github.com/livekit/agents-js/pull/2037) ([@chenghao-mou](https://github.com/chenghao-mou))

- Deprecate the `nativeTranscriptSync` realtime model capability while preserving its existing transcript synchronization behavior for third-party models. Remove Phonic's redundant explicit opt-out now that it uses `stream_ahead_of_real_time` mode. - [#2044](https://github.com/livekit/agents-js/pull/2044) ([@tinalenguyen](https://github.com/tinalenguyen))

- Avoid splitting streamed replacement output mid-word when no replacement key prefix is pending. - [#2050](https://github.com/livekit/agents-js/pull/2050) ([@rosetta-livekit-bot](https://github.com/apps/rosetta-livekit-bot))

- Add a beta DTMF sending tool that publishes to the active agent session room. - [#2010](https://github.com/livekit/agents-js/pull/2010) ([@rosetta-livekit-bot](https://github.com/apps/rosetta-livekit-bot))

- Add `speed` to xAI TTS inference options. - [#2028](https://github.com/livekit/agents-js/pull/2028) ([@rosetta-livekit-bot](https://github.com/apps/rosetta-livekit-bot))

## 1.5.2

## 1.5.1
Expand Down
2 changes: 1 addition & 1 deletion agents/package.json
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
{
"name": "@livekit/agents",
"version": "1.5.2",
"version": "1.5.3",
"description": "LiveKit Agents - Node.js",
"main": "dist/index.js",
"require": "dist/index.cjs",
Expand Down
7 changes: 7 additions & 0 deletions plugins/anam/CHANGELOG.md
Original file line number Diff line number Diff line change
@@ -1,5 +1,12 @@
# @livekit/agents-plugin-anam

## 1.5.3

### Patch Changes

- Updated dependencies [[`3c19945`](https://github.com/livekit/agents-js/commit/3c1994531efc43975fec30d29289b06abdd6b14f), [`7db92dd`](https://github.com/livekit/agents-js/commit/7db92dd9808c7df5aeb7d06286496a31f49674ba), [`b9d8e95`](https://github.com/livekit/agents-js/commit/b9d8e95b3dbe62cf21e66e345495acb6d8dd768b), [`bad25fd`](https://github.com/livekit/agents-js/commit/bad25fd1dba0e6676fc1153a443dc6acde82626d), [`206e884`](https://github.com/livekit/agents-js/commit/206e884914f8beb658235351bf1c6a20b98d3ac6), [`16ac15e`](https://github.com/livekit/agents-js/commit/16ac15ecbeebe0e3d9e21edf4a29bdb90c969b33), [`6300c1c`](https://github.com/livekit/agents-js/commit/6300c1c9242690589866c6767238aa0c31f3ad30), [`dfd6654`](https://github.com/livekit/agents-js/commit/dfd66540e1e7eb00f8c0b0bfc830e9eeaf0f33ed), [`97c5aa2`](https://github.com/livekit/agents-js/commit/97c5aa23a73eb48e128300f8f58d3c9a79db4be1), [`13a191c`](https://github.com/livekit/agents-js/commit/13a191c71088bdd9d4db112f9b57976c1530753f), [`508236a`](https://github.com/livekit/agents-js/commit/508236a77d5b3dd97b93c3b47030f5852dcdd5fe), [`2312eed`](https://github.com/livekit/agents-js/commit/2312eedf02dceaed0ef8554f545c2a5acd720121)]:
- @livekit/agents@1.5.3

## 1.5.2

### Patch Changes
Expand Down
2 changes: 1 addition & 1 deletion plugins/anam/package.json
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
{
"name": "@livekit/agents-plugin-anam",
"version": "1.5.2",
"version": "1.5.3",
"description": "Anam plugin for LiveKit Node Agents",
"main": "dist/index.js",
"require": "dist/index.cjs",
Expand Down
7 changes: 7 additions & 0 deletions plugins/anthropic/CHANGELOG.md
Original file line number Diff line number Diff line change
@@ -1,5 +1,12 @@
# @livekit/agents-plugin-anthropic

## 1.5.3

### Patch Changes

- Updated dependencies [[`3c19945`](https://github.com/livekit/agents-js/commit/3c1994531efc43975fec30d29289b06abdd6b14f), [`7db92dd`](https://github.com/livekit/agents-js/commit/7db92dd9808c7df5aeb7d06286496a31f49674ba), [`b9d8e95`](https://github.com/livekit/agents-js/commit/b9d8e95b3dbe62cf21e66e345495acb6d8dd768b), [`bad25fd`](https://github.com/livekit/agents-js/commit/bad25fd1dba0e6676fc1153a443dc6acde82626d), [`206e884`](https://github.com/livekit/agents-js/commit/206e884914f8beb658235351bf1c6a20b98d3ac6), [`16ac15e`](https://github.com/livekit/agents-js/commit/16ac15ecbeebe0e3d9e21edf4a29bdb90c969b33), [`6300c1c`](https://github.com/livekit/agents-js/commit/6300c1c9242690589866c6767238aa0c31f3ad30), [`dfd6654`](https://github.com/livekit/agents-js/commit/dfd66540e1e7eb00f8c0b0bfc830e9eeaf0f33ed), [`97c5aa2`](https://github.com/livekit/agents-js/commit/97c5aa23a73eb48e128300f8f58d3c9a79db4be1), [`13a191c`](https://github.com/livekit/agents-js/commit/13a191c71088bdd9d4db112f9b57976c1530753f), [`508236a`](https://github.com/livekit/agents-js/commit/508236a77d5b3dd97b93c3b47030f5852dcdd5fe), [`2312eed`](https://github.com/livekit/agents-js/commit/2312eedf02dceaed0ef8554f545c2a5acd720121)]:
- @livekit/agents@1.5.3

## 1.5.2

### Patch Changes
Expand Down
2 changes: 1 addition & 1 deletion plugins/anthropic/package.json
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
{
"name": "@livekit/agents-plugin-anthropic",
"version": "1.5.2",
"version": "1.5.3",
"description": "Anthropic plugin for LiveKit Node Agents",
"main": "dist/index.js",
"require": "dist/index.cjs",
Expand Down
7 changes: 7 additions & 0 deletions plugins/assemblyai/CHANGELOG.md
Original file line number Diff line number Diff line change
@@ -1,5 +1,12 @@
# @livekit/agents-plugin-assemblyai

## 1.5.3

### Patch Changes

- Updated dependencies [[`3c19945`](https://github.com/livekit/agents-js/commit/3c1994531efc43975fec30d29289b06abdd6b14f), [`7db92dd`](https://github.com/livekit/agents-js/commit/7db92dd9808c7df5aeb7d06286496a31f49674ba), [`b9d8e95`](https://github.com/livekit/agents-js/commit/b9d8e95b3dbe62cf21e66e345495acb6d8dd768b), [`bad25fd`](https://github.com/livekit/agents-js/commit/bad25fd1dba0e6676fc1153a443dc6acde82626d), [`206e884`](https://github.com/livekit/agents-js/commit/206e884914f8beb658235351bf1c6a20b98d3ac6), [`16ac15e`](https://github.com/livekit/agents-js/commit/16ac15ecbeebe0e3d9e21edf4a29bdb90c969b33), [`6300c1c`](https://github.com/livekit/agents-js/commit/6300c1c9242690589866c6767238aa0c31f3ad30), [`dfd6654`](https://github.com/livekit/agents-js/commit/dfd66540e1e7eb00f8c0b0bfc830e9eeaf0f33ed), [`97c5aa2`](https://github.com/livekit/agents-js/commit/97c5aa23a73eb48e128300f8f58d3c9a79db4be1), [`13a191c`](https://github.com/livekit/agents-js/commit/13a191c71088bdd9d4db112f9b57976c1530753f), [`508236a`](https://github.com/livekit/agents-js/commit/508236a77d5b3dd97b93c3b47030f5852dcdd5fe), [`2312eed`](https://github.com/livekit/agents-js/commit/2312eedf02dceaed0ef8554f545c2a5acd720121)]:
- @livekit/agents@1.5.3

## 1.5.2

### Patch Changes
Expand Down
2 changes: 1 addition & 1 deletion plugins/assemblyai/package.json
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
{
"name": "@livekit/agents-plugin-assemblyai",
"version": "1.5.2",
"version": "1.5.3",
"description": "AssemblyAI plugin for LiveKit Agents for Node.js",
"main": "dist/index.js",
"require": "dist/index.cjs",
Expand Down
10 changes: 10 additions & 0 deletions plugins/azure/CHANGELOG.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,10 @@
# @livekit/agents-plugin-azure

## 1.5.3

### Patch Changes

- Add Azure streaming STT with cancellation error recovery. - [#2009](https://github.com/livekit/agents-js/pull/2009) ([@rosetta-livekit-bot](https://github.com/apps/rosetta-livekit-bot))

- Updated dependencies [[`3c19945`](https://github.com/livekit/agents-js/commit/3c1994531efc43975fec30d29289b06abdd6b14f), [`7db92dd`](https://github.com/livekit/agents-js/commit/7db92dd9808c7df5aeb7d06286496a31f49674ba), [`b9d8e95`](https://github.com/livekit/agents-js/commit/b9d8e95b3dbe62cf21e66e345495acb6d8dd768b), [`bad25fd`](https://github.com/livekit/agents-js/commit/bad25fd1dba0e6676fc1153a443dc6acde82626d), [`206e884`](https://github.com/livekit/agents-js/commit/206e884914f8beb658235351bf1c6a20b98d3ac6), [`16ac15e`](https://github.com/livekit/agents-js/commit/16ac15ecbeebe0e3d9e21edf4a29bdb90c969b33), [`6300c1c`](https://github.com/livekit/agents-js/commit/6300c1c9242690589866c6767238aa0c31f3ad30), [`dfd6654`](https://github.com/livekit/agents-js/commit/dfd66540e1e7eb00f8c0b0bfc830e9eeaf0f33ed), [`97c5aa2`](https://github.com/livekit/agents-js/commit/97c5aa23a73eb48e128300f8f58d3c9a79db4be1), [`13a191c`](https://github.com/livekit/agents-js/commit/13a191c71088bdd9d4db112f9b57976c1530753f), [`508236a`](https://github.com/livekit/agents-js/commit/508236a77d5b3dd97b93c3b47030f5852dcdd5fe), [`2312eed`](https://github.com/livekit/agents-js/commit/2312eedf02dceaed0ef8554f545c2a5acd720121)]:
- @livekit/agents@1.5.3
2 changes: 1 addition & 1 deletion plugins/azure/package.json
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
{
"name": "@livekit/agents-plugin-azure",
"version": "1.5.0",
"version": "1.5.3",
"description": "Azure plugin for LiveKit Agents for Node.js",
"main": "dist/index.js",
"require": "dist/index.cjs",
Expand Down
7 changes: 7 additions & 0 deletions plugins/baseten/CHANGELOG.md
Original file line number Diff line number Diff line change
@@ -1,5 +1,12 @@
# @livekit/agents-plugin-baseten

## 1.5.3

### Patch Changes

- Updated dependencies [[`3c19945`](https://github.com/livekit/agents-js/commit/3c1994531efc43975fec30d29289b06abdd6b14f), [`7db92dd`](https://github.com/livekit/agents-js/commit/7db92dd9808c7df5aeb7d06286496a31f49674ba), [`b9d8e95`](https://github.com/livekit/agents-js/commit/b9d8e95b3dbe62cf21e66e345495acb6d8dd768b), [`bad25fd`](https://github.com/livekit/agents-js/commit/bad25fd1dba0e6676fc1153a443dc6acde82626d), [`206e884`](https://github.com/livekit/agents-js/commit/206e884914f8beb658235351bf1c6a20b98d3ac6), [`16ac15e`](https://github.com/livekit/agents-js/commit/16ac15ecbeebe0e3d9e21edf4a29bdb90c969b33), [`6300c1c`](https://github.com/livekit/agents-js/commit/6300c1c9242690589866c6767238aa0c31f3ad30), [`dfd6654`](https://github.com/livekit/agents-js/commit/dfd66540e1e7eb00f8c0b0bfc830e9eeaf0f33ed), [`97c5aa2`](https://github.com/livekit/agents-js/commit/97c5aa23a73eb48e128300f8f58d3c9a79db4be1), [`13a191c`](https://github.com/livekit/agents-js/commit/13a191c71088bdd9d4db112f9b57976c1530753f), [`508236a`](https://github.com/livekit/agents-js/commit/508236a77d5b3dd97b93c3b47030f5852dcdd5fe), [`2312eed`](https://github.com/livekit/agents-js/commit/2312eedf02dceaed0ef8554f545c2a5acd720121)]:
- @livekit/agents@1.5.3

## 1.5.2

### Patch Changes
Expand Down
2 changes: 1 addition & 1 deletion plugins/baseten/package.json
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
{
"name": "@livekit/agents-plugin-baseten",
"version": "1.5.2",
"version": "1.5.3",
"description": "Baseten plugin for LiveKit Node Agents",
"main": "dist/index.js",
"require": "dist/index.cjs",
Expand Down
Loading
Loading