Skip to content

Commit

Permalink
StreamMode in Join [sdk]
Browse files Browse the repository at this point in the history
  • Loading branch information
hinthornw committed Feb 25, 2025
1 parent cba1852 commit 427d539
Show file tree
Hide file tree
Showing 4 changed files with 935 additions and 789 deletions.
2 changes: 1 addition & 1 deletion libs/sdk-js/package.json
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
{

Check notice on line 1 in libs/sdk-js/package.json

View workflow job for this annotation

GitHub Actions / benchmark

Benchmark results

......................................... fanout_to_subgraph_10x: Mean +- std dev: 63.6 ms +- 1.4 ms ......................................... fanout_to_subgraph_10x_sync: Mean +- std dev: 55.4 ms +- 0.8 ms ......................................... fanout_to_subgraph_10x_checkpoint: Mean +- std dev: 81.4 ms +- 1.9 ms ......................................... fanout_to_subgraph_10x_checkpoint_sync: Mean +- std dev: 99.7 ms +- 1.1 ms ......................................... fanout_to_subgraph_100x: Mean +- std dev: 630 ms +- 8 ms ......................................... fanout_to_subgraph_100x_sync: Mean +- std dev: 547 ms +- 15 ms ......................................... fanout_to_subgraph_100x_checkpoint: Mean +- std dev: 822 ms +- 24 ms ......................................... fanout_to_subgraph_100x_checkpoint_sync: Mean +- std dev: 1.01 sec +- 0.02 sec ......................................... react_agent_10x: Mean +- std dev: 30.7 ms +- 0.7 ms ......................................... react_agent_10x_sync: Mean +- std dev: 23.1 ms +- 0.4 ms ......................................... react_agent_10x_checkpoint: Mean +- std dev: 39.6 ms +- 0.8 ms ......................................... react_agent_10x_checkpoint_sync: Mean +- std dev: 36.7 ms +- 0.5 ms ......................................... react_agent_100x: Mean +- std dev: 341 ms +- 6 ms ......................................... react_agent_100x_sync: Mean +- std dev: 272 ms +- 2 ms ......................................... react_agent_100x_checkpoint: Mean +- std dev: 686 ms +- 8 ms ......................................... react_agent_100x_checkpoint_sync: Mean +- std dev: 685 ms +- 20 ms ......................................... wide_state_25x300: Mean +- std dev: 23.8 ms +- 0.5 ms ......................................... wide_state_25x300_sync: Mean +- std dev: 15.8 ms +- 0.1 ms ......................................... wide_state_25x300_checkpoint: Mean +- std dev: 244 ms +- 3 ms ......................................... wide_state_25x300_checkpoint_sync: Mean +- std dev: 244 ms +- 4 ms ......................................... wide_state_15x600: Mean +- std dev: 27.7 ms +- 0.6 ms ......................................... wide_state_15x600_sync: Mean +- std dev: 18.3 ms +- 0.3 ms ......................................... wide_state_15x600_checkpoint: Mean +- std dev: 429 ms +- 5 ms ......................................... wide_state_15x600_checkpoint_sync: Mean +- std dev: 429 ms +- 5 ms ......................................... wide_state_9x1200: Mean +- std dev: 27.7 ms +- 0.5 ms ......................................... wide_state_9x1200_sync: Mean +- std dev: 18.3 ms +- 0.2 ms ......................................... wide_state_9x1200_checkpoint: Mean +- std dev: 276 ms +- 3 ms ......................................... wide_state_9x1200_checkpoint_sync: Mean +- std dev: 276 ms +- 5 ms

Check notice on line 1 in libs/sdk-js/package.json

View workflow job for this annotation

GitHub Actions / benchmark

Comparison against main

+-----------------------------------------+----------+------------------------+ | Benchmark | main | changes | +=========================================+==========+========================+ | fanout_to_subgraph_100x | 646 ms | 630 ms: 1.03x faster | +-----------------------------------------+----------+------------------------+ | fanout_to_subgraph_100x_checkpoint | 838 ms | 822 ms: 1.02x faster | +-----------------------------------------+----------+------------------------+ | react_agent_100x_checkpoint | 691 ms | 686 ms: 1.01x faster | +-----------------------------------------+----------+------------------------+ | react_agent_100x_checkpoint_sync | 689 ms | 685 ms: 1.01x faster | +-----------------------------------------+----------+------------------------+ | wide_state_9x1200_sync | 18.3 ms | 18.3 ms: 1.00x faster | +-----------------------------------------+----------+------------------------+ | react_agent_100x_sync | 271 ms | 272 ms: 1.00x slower | +-----------------------------------------+----------+------------------------+ | wide_state_15x600_checkpoint | 428 ms | 429 ms: 1.00x slower | +-----------------------------------------+----------+------------------------+ | fanout_to_subgraph_100x_checkpoint_sync | 1.01 sec | 1.01 sec: 1.00x slower | +-----------------------------------------+----------+------------------------+ | fanout_to_subgraph_10x_checkpoint_sync | 99.2 ms | 99.7 ms: 1.00x slower | +-----------------------------------------+----------+------------------------+ | wide_state_15x600_checkpoint_sync | 426 ms | 429 ms: 1.01x slower | +-----------------------------------------+----------+------------------------+ | wide_state_9x1200_checkpoint | 274 ms | 276 ms: 1.01x slower | +-----------------------------------------+----------+------------------------+ | react_agent_10x | 30.5 ms | 30.7 ms: 1.01x slower | +-----------------------------------------+----------+------------------------+ | wide_state_9x1200_checkpoint_sync | 272 ms | 276 ms: 1.01x slower | +-----------------------------------------+----------+------------------------+ | Geometric mean | (ref) | 1.00x slower | +-----------------------------------------+----------+------------------------+ Benchmark hidden because not significant (15): wide_state_25x300_sync, react_agent_10x_checkpoint_sync, react_agent_100x, wide_state_15x600_sync, fanout_to_subgraph_100x_sync, wide_state_9x1200, wide_state_25x300, fanout_to_subgraph_10x, fanout_to_subgraph_10x_sync, react_agent_10x_checkpoint, react_agent_10x_sync, fanout_to_subgraph_10x_checkpoint, wide_state_25x300_checkpoint, wide_state_15x600, wide_state_25x300_checkpoint_sync
"name": "@langchain/langgraph-sdk",
"version": "0.0.45",
"version": "0.0.46",
"description": "Client library for interacting with the LangGraph API",
"type": "module",
"packageManager": "[email protected]",
Expand Down
12 changes: 10 additions & 2 deletions libs/sdk-js/src/client.ts
Original file line number Diff line number Diff line change
Expand Up @@ -1022,13 +1022,18 @@ export class RunsClient<
*
* @param threadId The ID of the thread.
* @param runId The ID of the run.
* @param options Additional options like signal, cancelOnDisconnect, and streamMode
* @returns An async generator yielding stream parts.
*/
async *joinStream(
threadId: string,
runId: string,
options?:
| { signal?: AbortSignal; cancelOnDisconnect?: boolean }
| {
signal?: AbortSignal;
cancelOnDisconnect?: boolean;
streamMode?: StreamMode | StreamMode[];
}
| AbortSignal,
): AsyncGenerator<{ event: StreamEvent; data: any }> {
const opts =
Expand All @@ -1043,7 +1048,10 @@ export class RunsClient<
method: "GET",
timeoutMs: null,
signal: opts?.signal,
params: { cancel_on_disconnect: opts?.cancelOnDisconnect ? "1" : "0" },
params: {
cancel_on_disconnect: opts?.cancelOnDisconnect ? "1" : "0",
stream_mode: opts?.streamMode,
},
}),
);

Expand Down
Loading

0 comments on commit 427d539

Please sign in to comment.