߲jLdZddlmZddlZddlmZmZmZmZm Z m Z m Z ddl m Z mZej eZd dZddZddZed d hZGd d Zy)uCrossed-profile durable state in ONE ``state.db`` — finders and fixers for ``hermes sessions repair-profiles`` (#88715 PR-6). Every ``state.db`` belongs to exactly one profile (``/state.db`` → ``default``, ``/profiles//state.db`` → ``name``) and every gateway session key encodes the profile that owns the conversation (``agent:main:…`` for the default, ``agent::…`` for a named one). The per-profile store model (#88734) is forward-only: it routes NEW writes to the right store but never touched rows that had already landed in the wrong one, and the identity fences (``_INHERIT_PARENT_META_SQL``, ``_recovered_row_allowed_for_active_profile``) only refuse to *widen* damage that already exists. This module is the backward-looking half: it names each crossed row and can settle it. Store-level only. Which profiles exist, which store owns which home, whether a live gateway holds the routing index in memory, and the JSON files outside ``state.db`` are the orchestrator's concern (``hermes_cli/sessions_repair_profiles.py``). Moving a session between two stores is two single-store transactions — copy into the target, then delete from the source — because a crash between them leaves a *duplicate*, which the next run settles idempotently (:meth:`import_moved_session` reports ``present``; the delete only proceeds when the target holds at least as many messages). The reverse order would lose the row. ) annotationsN)AnyDictIterableListOptionalSetTuple) _id_chunks _placeholdersct|tsy|jd}t|dks |ddk7s|dsyddlm}||dS)uProfile encoded in an ``agent::…`` gateway key (``default`` for ``main``), or None for a keyless row (CLI/subagent lineage) or a key another producer minted (hosted rooms, tests).N:ragent)"profile_from_session_key_namespace) isinstancestrsplitlengateway.sessionr) session_keypartsrs @/home/ubuntu/.hermes/hermes-agent/hermes_state_profile_repair.pysession_key_profiler sR k3 '   c "E 5zA~qW,E!HB -eAh 77cHt|xsdj}|xsdS)zY``sessions.profile_name`` as a comparable label; NULL/blank is "unowned", not a crossing.N)rstrip)valuenames r_stored_profiler",s# u{  ! ! #D <4rcX|jd|dDcgc]}|d c}Scc}w)NzPRAGMA table_info('z')r)execute)conntablerows r_table_columnsr(2s-"ll-@r+JK LsCF LL Ls 'id display_orderceZdZdZddZddZddZddZddZddZ ddZ dd Z e dd Z dd Zdd Zdd ZddZddZddZy)SessionProfileRepairMixinz^Per-store crossed-profile identity: find, relabel, sever, move, and settle routing/topic rows.c |jd}gggd}|D]}t|d}|t|d}|$||k7r|dj|d|d||d||k7r/|dj|d|d|t |d xsd d t|d }|||k7s|d j|d||d|d|S)uKeyed session rows whose identity disagrees with itself or with this store. ``mislabelled``: ``profile_name`` names a profile other than the one in the row's own key (the key is what routing, the agent cache and ``_db_for_key`` consult; the label is stamped after the fact). ``foreign``: the key's profile is not *owner* — the row sits in a store that the routed profile never reads. ``crossed_parents``: child and parent are both keyed and name different profiles, so the NULL-fill inheritance fence would have been the only thing standing between them. A row can appear in more than one list. zSELECT s.id, s.session_key, s.profile_name, s.parent_session_id, s.message_count, p.session_key AS parent_session_key FROM sessions s LEFT JOIN sessions p ON p.id = s.parent_session_id WHERE s.session_key LIKE 'agent:%' ORDER BY s.started_at, s.id) mislabelledforeigncrossed_parentsr profile_namer.r))r)rr1 key_profiler/ message_countr)r)rr2r3parent_session_keyr0parent_session_id)r)r2r5parent_profile) _read_allrr"appendint)selfownerrowsfoundr'r2labelr6s rfind_crossed_profile_sessionsz7SessionProfileRepairMixin.find_crossed_profile_sessionsBs:~~ MN BDPRgi1j fC-c-.@AK"#C$78E Uk%9m$++d)C 4F$)+-GHe#i ''d)C 4FWb%(_)=)B%C)EF15I1JKN)n .K'(//d)K),-@)AUc1ef f$ rc\|jdDcgc] }t|c}Scc}w)NzbSELECT scope, session_key, entry_json, updated_at FROM gateway_routing ORDER BY scope, session_key)r7dict)r:r's rlist_gateway_routing_rowsz3SessionProfileRepairMixin.list_gateway_routing_rowsfs0%)^^ *&+,cS , ,,s)cd}g}|j|D],}t|d}|dvs|ji|d|i.|S)a``telegram_dm_topic_bindings`` rows labelled ``default`` whose ``session_key`` names a named profile: written by a multiplexer that had not yet learned to stamp the routed profile (#76423). Stores whose topic tables predate ``profile_name`` have nothing to relabel.c|jdDchc]}|d }}|rdt|dvrgS|jdDcgc] }t|c}Scc}wcc}w)NzYSELECT name FROM sqlite_master WHERE type='table' AND name = 'telegram_dm_topic_bindings'rr1telegram_dm_topic_bindingszSELECT chat_id, thread_id, session_key FROM telegram_dm_topic_bindings WHERE profile_name = 'default' ORDER BY chat_id, thread_id)r$r(rA)r%r'existings r_readzNSessionProfileRepairMixin.find_profile_less_telegram_topic_rows.._reados*.,,k+mn3AnHn~^DJf5gg )-M*NO#DIO O nOs AA!rNdefaultr2)_read_retrying_ioerrrr8)r:rGoutr'r2s r%find_profile_less_telegram_topic_rowsz?SessionProfileRepairMixin.find_profile_less_telegram_topic_rowsksc O,,U3 @C-c-.@AK"33 >c>=+>? @ rcL|jd|f}|rt|dSdS)Nz2SELECT COUNT(*) FROM messages WHERE session_id = ?r) _read_oner9)r: session_idr's rcount_messages_allz,SessionProfileRepairMixin.count_messages_all~s,nnQT^S`a!s3q6{(q(rcNt|sydfd }|j|S)zSet ``profile_name`` to the profile in each row's own key. Re-derives the target inside the transaction (never trusts a stale report).rc d}tD]i}|jdt|d|j}|D]5\}}t |}|||jd|||fj z }7k|S)Nrz2SELECT id, session_key FROM sessions WHERE id IN ()zKUPDATE sessions SET profile_name = ? WHERE id = ? AND profile_name IS NOT ?r r$_session_ids_placeholdersfetchallrrowcount)r%changedchunkr<rOrtargetwanteds r_dozFSessionProfileRepairMixin.relabel_sessions_to_key_profile.._dosG#F+ ?||HIbchIiHjjkl#8:04?+J 0=F~ t||eV4 66>h?G ? ?Nrreturnr9list_execute_writer:idsr\r[s @rrelabel_sessions_to_key_profilez9SessionProfileRepairMixin.relabel_sessions_to_key_profiles,c ""3''rcNt|sydfd }|j|S)uDetach children from a parent keyed under another profile. Only ``parent_session_id`` is cleared — ``profile_name`` stays the row's own (relabelled separately when it is wrong) — and only while the crossing still holds.rc d}t D]|}|jdt|d|j}|D]H\}}}t |t |}}| |#||k7s)||jd|fj z }J~|S)NrzwSELECT s.id, s.session_key, p.session_key FROM sessions s JOIN sessions p ON p.id = s.parent_session_id WHERE s.id IN (rSz9UPDATE sessions SET parent_session_id = NULL WHERE id = ?rT) r%severedrYr<rOkey parent_keyminetheirsr[s rr\z._dosG#F+ q||&&?&F%GqJKPRS[RZR\48q/JZ#6s#;=PQ[=\&D'F,>46>4<<WZdYf$hhphpqq qNrr]r_rbs @rsever_crossed_parentsz/SessionProfileRepairMixin.sever_crossed_parentss,c ""3''rc0fd}|j|S)uEverything the target store needs to hold *session_id* as its own: the row (every column), the resolved system prompt, EVERY message row (inactive and compacted generations included — a move is not an export) and its usage rows.c|jdfj}|yd}|dr-|jd|dfj}|r|dnd}|jdfDcgc] }t|}}|jdfDcgc] }t|}}t||||dScc}wcc}w)Nz#SELECT * FROM sessions WHERE id = ?system_prompt_hashz0SELECT prompt FROM system_prompts WHERE hash = ?rz7SELECT * FROM messages WHERE session_id = ? ORDER BY idz6SELECT * FROM session_model_usage WHERE session_id = ?)session system_promptmessagesusage)r$fetchonerA)r%rppromptr'rrrrsrOs rrGz@SessionProfileRepairMixin.export_session_for_move.._readsll#H:-XaacGF+,llFQeIfHhjjrjrjt#&QD)-IJ=*Z[AQ[H[&*llH:-'YZT!WZEZ#G}vS[fkl l [Zs /B<C)rJ)r:rOrGs ` rexport_session_for_movez1SessionProfileRepairMixin.export_session_for_moves m((//rchtdddfd }j|S)uInsert a moved session into THIS store as *profile_name*'s. ``present`` when the id already exists (an earlier run copied but did not delete), else ``imported``. The parent link survives only when the parent is already here — a moved row must never point across stores or at a row of another profile. Columns the target schema lacks are dropped, never invented.rpr)c4|jdfjryd<jd}|r&|jd|fjdd<j|jdd<j |dt jd xsgD]!}j |d i|d it #jd xsgD]%}j |d i|d it 'y )N#SELECT 1 FROM sessions WHERE id = ?presentr1r5rqrosessions)skiprrrOrssession_model_usageimported)r$rtget_store_system_prompt _insert_row frozenset_MESSAGE_MOVE_SKIP) r% parent_idmessagerspayloadr1r:rprOs rr\z;SessionProfileRepairMixin.import_moved_session.._dos0||AJ=QZZ\ &2GN # $78IT\\*OR[Q]^ggiq/3+,,0,E,EdGKKXgLh,iG( )   T:wY[  I";;z28b s  z3Xg3X|Z3X_q r s W-3 u  '<>a>a V`>ahqhs t ur)r^r)rAra)r:rr1r\rprOs``` @@rimport_moved_sessionz.SessionProfileRepairMixin.import_moved_sessions: wy)*T]   ""3''rc t||Dcgc]}||vs||vs |}}|jd|ddj|ddjd|Dd|Dcgc]}|| c}ycc}wcc}w)Nz INSERT INTO z (z, z ) VALUES (c3 K|]}dyw)?N).0_s r z8SessionProfileRepairMixin._insert_row..sKaTUCKas rS)r(r$join)r%r&valuesr}ccolumnss rrz%SessionProfileRepairMixin._insert_rows,T59[Q&[QVZ]1[[ 5'DIIg$6#7z$))KaY`KaBaAbbc d ' (1VAY ( *\ )s A7A7A7# A< cHdfd }tj|S)zRemove a session this store no longer owns after the target confirmed it. Children left behind are detached (same FK rule as :meth:`delete_session`); topic bindings on the row cascade with it.c|jdfjy|jdf|jdf|jdf|jdfj|y)NrzFzHUPDATE sessions SET parent_session_id = NULL WHERE parent_session_id = ?z)DELETE FROM messages WHERE session_id = ?z4DELETE FROM session_model_usage WHERE session_id = ?z!DELETE FROM sessions WHERE id = ?T)r$rt#_delete_unreferenced_system_prompts)r%r:rOs rr\z;SessionProfileRepairMixin.delete_moved_session.._dos|||AJ=QZZ\d LLcfper s LLDzm T LLOR\Q^ _ LL:…`` (+ ``profile_name``) for rows a standalone gateway wrote before this store's profile was multiplexed (#113884). Only rows still under the legacy namespace change; a ``main``-named profile is written in its marked form.r)_session_key_namespacercd}tD]3}||jdt|dg|jz }5|S)Nrz^UPDATE sessions SET session_key = ? || substr(session_key, 12), profile_name = ? WHERE id IN (z0) AND substr(session_key, 1, 11) = 'agent:main:')r r$rUrW)r%rXrYnew_nsprofiler[s rr\zASessionProfileRepairMixin.rekey_legacy_main_sessions.._doseG#F+ 84<<$$=e$D#EEuwW-u-/08x8 8 Nrr])rrr`ra)r:rcrrr\rr[s ` @@rrekey_legacy_main_sessionsz4SessionProfileRepairMixin.rekey_legacy_main_sessionss> ;c'036 ""3''rcNt|sydfd }|j|S)Nrc.tfdDS)Nc3`K|]%\}}jd||fj'yw)z?DELETE FROM gateway_routing WHERE scope = ? AND session_key = ?Nr$rW)rscoperhr%s rrzUSessionProfileRepairMixin.delete_gateway_routing_rows.._do..s?*E3||QTY[^S_aaiaij*s+.sumr%r[s`rr\zBSessionProfileRepairMixin.delete_gateway_routing_rows.._dos*"(** *rr]r_r:r<r\r[s @rdelete_gateway_routing_rowsz5SessionProfileRepairMixin.delete_gateway_routing_rows s*d *""3''rcNt|sydfd }|j|S)uAdopt ``(scope, session_key, entry_json, updated_at)`` rows another store held for this one's routing index. An existing key wins — the row the gateway actually loads stays.rc.tfdDS)Nc3VK|] }jd|j"yw)zfINSERT OR IGNORE INTO gateway_routing (scope, session_key, entry_json, updated_at) VALUES (?, ?, ?, ?)Nr)rr'r%s rrz_SessionProfileRepairMixin.insert_gateway_routing_rows_if_absent.._do..s6H9<||&'*,,4H5Hs&)rrs`rr\zLSessionProfileRepairMixin.insert_gateway_routing_rows_if_absent.._dos!H@FHH Hrr]r_rs @r%insert_gateway_routing_rows_if_absentz?SessionProfileRepairMixin.insert_gateway_routing_rows_if_absents-d H""3''rc`t|ddddsSdfd }|j|S)zStamp the key's profile onto ``default``-labelled bindings (and the chat's mode row when only the default one exists). A binding that would collide with one the named profile already wrote is the stale duplicate and is removed.r)bindings_relabelledbindings_duplicates_removedmode_rows_relabelledc dt|dv}D]}t|d}|dvr|d|d}}|jd|||fj}|r*dxx|jd ||fjz cc<n*d xx|jd |||fjz cc<|s|jd ||fjd xx|jd||fjz cc<S)Nr1telegram_dm_topic_moderrHchat_id thread_idzaSELECT 1 FROM telegram_dm_topic_bindings WHERE profile_name = ? AND chat_id = ? AND thread_id = ?rzgDELETE FROM telegram_dm_topic_bindings WHERE profile_name = 'default' AND chat_id = ? AND thread_id = ?rzwUPDATE telegram_dm_topic_bindings SET profile_name = ? WHERE profile_name = 'default' AND chat_id = ? AND thread_id = ?zKSELECT 1 FROM telegram_dm_topic_mode WHERE profile_name = ? AND chat_id = ?rzaUPDATE telegram_dm_topic_mode SET profile_name = ? WHERE profile_name = 'default' AND chat_id = ?)r(rr$rtrW) r%mode_has_profiler'rZrrcollidescountsr[s rr\zBSessionProfileRepairMixin.relabel_telegram_topic_rows.._do/sF-F^1__  G,S-?@..%(^S5E<<(*0'9)EGGOxz89T\\<>Ey=Q>SS[S[\901T\\<>Dgy=Y6[[c[cd1$ e))++38:)>12dll*,2G+<7>>FhG2' G,Mr)r^Dict[str, int]r_)r:r<r\rr[s @@rrelabel_telegram_topic_rowsz5SessionProfileRepairMixin.relabel_telegram_topic_rows&s;d)*1fghM 2""3''rcz|jd|t|f}d|DDchc]}|| c}Scc}w)uProfiles whose keyed sessions hold *(platform, chat_id)* in this store — the evidence for who owns a profile-less ``gateway_voice_mode.json`` entry.ziSELECT DISTINCT session_key FROM sessions WHERE source = ? AND chat_id = ? AND session_key LIKE 'agent:%'c38K|]}t|dyw)rN)r)rrvs rrzBSessionProfileRepairMixin.key_profiles_for_chat..RsPa/-0@APs)r7r)r:platformrr<ps rkey_profiles_for_chatz/SessionProfileRepairMixin.key_profiles_for_chatLsF~~ -/7W.FHQ4PbaTUTabbbs88N)r;rr^zDict[str, List[Dict[str, Any]]])r^zList[Dict[str, Any]])rOrr^r9)rc Iterable[str]r^r9)rOrr^zOptional[Dict[str, Any]])rDict[str, Any]r1rr^r)r&rrrr}rr^None)rOrr^r)rcrrrr^r9)r<zIterable[Tuple[str, str]]r^r9)r<z%Iterable[Tuple[str, str, str, float]]r^r9)r<zIterable[Dict[str, Any]]r^r)rrrrr^zSet[str])__name__ __module__ __qualname____doc__r?rBrLrPrdrlrwr staticmethodrrrrrrrrrrr,r,=sbh"H, &) (.(20((0** ."(( ( ("(Lcrr,)rrr^ Optional[str])r rr^r)r&rr^z List[str])r __future__rloggingtypingrrrrrr r hermes_state_commonr r rU getLoggerrloggerrr"r(rrr,rrrrs`*#BBBV   8 $ 8 Mo67UcUcr