pg: read-only legacy source readers and row verification #101

Closed
opened 2026-10-27 13:34:57 +00:00 by sam · 0 comments
Owner

Host-independent half of the one-time import (see archie-core-7r0x.7), started early because it needs none of the port lanes. A new package internal/infrastructure/legacyread that opens each legacy SQLite file READ-ONLY and reads it without using the mutating production openers, plus the row verification the import depends on.

Why it cannot use the existing openers: every one of them writes on open. store.Open runs schema migrations; edastore.Open deletes PocketBase's default auth collection and promotes draft bindings; OpenSQLiteSessionStore runs DDL, three ALTER TABLEs and a role-backfill UPDATE. An importer built on them rewrites the files it is reading. Acceptance requires the source files to hash identically before and after.

Scope: readers for the twelve State Store tables, the six PocketBase collections and the four gateway objects (including the FTS5 table); and verification queries for per-table count and id-set equality, ordered id-sequence comparison, FK closure, unique-key duplicates, sequence state and blob byte fidelity. Typed rows out; it does not know about Postgres and does not map to target columns.

Non-goals: no command host, no Postgres write side, no cutover, no touching internal/store, internal/infrastructure/edastore, internal/gateway or any port lane's files.

Note for the removal lane (archie-core-7r0x.8): this package and its modernc.org/sqlite dependency are deleted together with the one-time import; it must be added to that lane's deletion list, so the dependency is not dropped while the readers still exist.

Notes

2ic lane launch blocker: cp-writer attempt from a distinct parent session failed with the same writer-close-unverified signature as the manager session attempts; runner exited before creating output/session. No code changes; /work/apps/cp-pgr remains clean at cebbcb56 on run/pg-w2-r. Do not launch another reader writer until one of the four existing runners exits; retry the governed subagent protocol only after a slot frees. Root cause remains undiagnosed; evidence indicates correlation with four active runner processes, not a proven concurrency ceiling.

Close reason

Closed


Imported from beads archie-core-7r0x.10 · GitHub #1012 · type task · priority P1 · created 2026-09-23 · closed 2026-09-28

Host-independent half of the one-time import (see archie-core-7r0x.7), started early because it needs none of the port lanes. A new package internal/infrastructure/legacyread that opens each legacy SQLite file READ-ONLY and reads it without using the mutating production openers, plus the row verification the import depends on. Why it cannot use the existing openers: every one of them writes on open. store.Open runs schema migrations; edastore.Open deletes PocketBase's default auth collection and promotes draft bindings; OpenSQLiteSessionStore runs DDL, three ALTER TABLEs and a role-backfill UPDATE. An importer built on them rewrites the files it is reading. Acceptance requires the source files to hash identically before and after. Scope: readers for the twelve State Store tables, the six PocketBase collections and the four gateway objects (including the FTS5 table); and verification queries for per-table count and id-set equality, ordered id-sequence comparison, FK closure, unique-key duplicates, sequence state and blob byte fidelity. Typed rows out; it does not know about Postgres and does not map to target columns. Non-goals: no command host, no Postgres write side, no cutover, no touching internal/store, internal/infrastructure/edastore, internal/gateway or any port lane's files. Note for the removal lane (archie-core-7r0x.8): this package and its modernc.org/sqlite dependency are deleted together with the one-time import; it must be added to that lane's deletion list, so the dependency is not dropped while the readers still exist. ### Notes 2ic lane launch blocker: cp-writer attempt from a distinct parent session failed with the same writer-close-unverified signature as the manager session attempts; runner exited before creating output/session. No code changes; /work/apps/cp-pgr remains clean at cebbcb56 on run/pg-w2-r. Do not launch another reader writer until one of the four existing runners exits; retry the governed subagent protocol only after a slot frees. Root cause remains undiagnosed; evidence indicates correlation with four active runner processes, not a proven concurrency ceiling. ### Close reason Closed --- _Imported from beads `archie-core-7r0x.10` · GitHub #1012 · type task · priority P1 · created 2026-09-23 · closed 2026-09-28_
sam added the hightask labels 2026-10-27 13:34:57 +00:00
sam self-assigned this 2026-10-27 13:34:57 +00:00
sam closed this issue 2026-10-27 13:34:57 +00:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: sam/archie#101