Chat suggestions generated from the conversation by a separate model call #1974

Open
opened 2026-11-14 03:07:58 +00:00 by sam · 0 comments
Owner

Problem

Chat suggestions are a fixed list per page. They don't follow from the reply just given, so they're often irrelevant or repeat what was already asked. The current stopgap only hides exact repeats.

Wanted

After each assistant turn finishes, a separate model call (its own context, not the chat agent) proposes follow-up suggestions.

  • Input: the last user message and the last assistant reply (trimmed, tool output and code blocks dropped), a one-line list of earlier user messages so it doesn't repeat them, and the current page with any selected entity (e.g. the task and its status).
  • Guidance through the prompt, kept in internal/prompts: tell it what Archie can do on that page and ask for follow-ups that act on the reply. No hard allowlist in code.
  • Output: JSON, at most three short suggestions. An empty list is valid and is preferred over generic filler.
  • Runs on the cheap default model, and doesn't add latency to the reply.
  • Suggestions are stored with the turn, so reopening the chat doesn't regenerate them.
  • The static per-page prompts stay, but only for an empty conversation.

Done when

After a reply, the chips reflect it (e.g. offer to retry or archive what the reply discussed), they never repeat a question already asked, and they show nothing when nothing useful fits.

## Problem Chat suggestions are a fixed list per page. They don't follow from the reply just given, so they're often irrelevant or repeat what was already asked. The current stopgap only hides exact repeats. ## Wanted After each assistant turn finishes, a separate model call (its own context, not the chat agent) proposes follow-up suggestions. - Input: the last user message and the last assistant reply (trimmed, tool output and code blocks dropped), a one-line list of earlier user messages so it doesn't repeat them, and the current page with any selected entity (e.g. the task and its status). - Guidance through the prompt, kept in `internal/prompts`: tell it what Archie can do on that page and ask for follow-ups that act on the reply. No hard allowlist in code. - Output: JSON, at most three short suggestions. An empty list is valid and is preferred over generic filler. - Runs on the cheap default model, and doesn't add latency to the reply. - Suggestions are stored with the turn, so reopening the chat doesn't regenerate them. - The static per-page prompts stay, but only for an empty conversation. ## Done when After a reply, the chips reflect it (e.g. offer to retry or archive what the reply discussed), they never repeat a question already asked, and they show nothing when nothing useful fits.
sam added the featuremedium labels 2026-11-14 03:08:17 +00:00
sam added the deferred label 2026-11-15 17:26:08 +00:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: sam/archie#1974