-
Notifications
You must be signed in to change notification settings - Fork 0
Open
Description
Hey, digging deepshell so far. Thanks for creating it.
I am facing a problem where deepshell is clearly interacting with Ollama (I can determine this from the logs and seeing deepshell hit the server), but times out.
While I think a TIMEOUT is great, for one, I think it should be configurable, and for two, it should likely default to not use a timeout/at least provide that functionality. I'd also suggest separating this out into two timeouts:
- Query Timeout
- The server was reachable, but we aren't willing to wait longer than this duration
- Abort Request if this duration is exceeded
- Configurable
- Disableable
- Returns an error stating we connected, but Query Timeout exceeded.
- HTTP Timeout / Timeout
- The server was unreachable
- Sane value (ie: 5-10s)
- Returns an error stating we could not connect to the backend.
Ultimately, treating HTTP Timeout as an error, while allowing people to also set their own Query Timeout, even if the backend is connectable.
Thanks for your efforts and consideration of this request.
Metadata
Metadata
Assignees
Labels
No labels