alerts: service-unhealthy grace timer resets on State Store restart and skips silent services #516

Closed
opened 2026-10-27 13:36:38 +00:00 by sam · 0 comments
Owner

The grace timer is in memory, so it restarts with the State Store, and a service that never reported presence never alerts. Done when the grace period survives a restart and an expected service with no presence raises the alert.

Notes

Still open 2026-10-13: serviceWatch is in-memory (app/statestore/alerts.go) so a State Store restart resets the grace timer, and a service that never reported is left out of the unhealthy list.

Close reason

Down services count from their stored last report; never-reported services now alert after grace from first sight


Imported from beads archie-core-07lyl · GitHub #1641 · type bug · priority P3 · created 2026-10-11 · closed 2026-10-13

The grace timer is in memory, so it restarts with the State Store, and a service that never reported presence never alerts. Done when the grace period survives a restart and an expected service with no presence raises the alert. ### Notes Still open 2026-10-13: serviceWatch is in-memory (app/statestore/alerts.go) so a State Store restart resets the grace timer, and a service that never reported is left out of the unhealthy list. ### Close reason Down services count from their stored last report; never-reported services now alert after grace from first sight --- _Imported from beads `archie-core-07lyl` · GitHub #1641 · type bug · priority P3 · created 2026-10-11 · closed 2026-10-13_
sam added the lowbug labels 2026-10-27 13:36:38 +00:00
sam self-assigned this 2026-10-27 13:36:38 +00:00
sam closed this issue 2026-10-27 13:36:38 +00:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: sam/archie#516