Skip to content

Set timeouts on the http client#11

Open
petsva wants to merge 1 commit intonetarchivesuite:masterfrom
petsva:patch-1
Open

Set timeouts on the http client#11
petsva wants to merge 1 commit intonetarchivesuite:masterfrom
petsva:patch-1

Conversation

@petsva
Copy link

@petsva petsva commented Feb 4, 2026

Explicit HTTP timeouts added to avoid indefinite blocking when Heritrix is overloaded.
Required for retry/backoff and failure-budget logic to trigger deterministically and prevent silent stalls.

HttpClient may retry NoHttpResponseException up to 3 times internally (setRetryHandler).
This means a single poll can take up to ~3× socket timeout in worst case before failing.
Our failure-budget (in other PR) therefore operates on “poll failures” rather than raw TCP failures, which reduces flapping and still guarantees bounded time to abort.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant