Skip to content

Spawn query_chat#26

Open
willcrichton wants to merge 1 commit into03-spawn-afrom
03-spawn-b
Open

Spawn query_chat#26
willcrichton wants to merge 1 commit into03-spawn-afrom
03-spawn-b

Conversation

@willcrichton
Copy link
Contributor

@willcrichton willcrichton commented Jul 31, 2024 •
edited
Loading

Reference solution for fixing the compute-intensive chat. Key changes:

  • Use tokio::spawn to launch the query_chat future
  • Use Arc to share messages between threads without cloning

@willcrichton willcrichton force-pushed the 03-spawn-a branch 2 times, most recently from 4f469e5 to b4a7777 Compare September 4, 2024 21:29
@willcrichton willcrichton force-pushed the 03-spawn-b branch 2 times, most recently from 02bdf20 to a44ff7c Compare April 23, 2025 22:13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

03-spawn

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@willcrichton