+ iHj>|Rt^RIt^RIt^RIt^RIHt^RIHtHtH t H t H t ^RI H t HtHtHtHtHtHt^RIHtHt^RIHt^RIHtHt^RIHt ^R I!H"t"H#t#H$t$H%t%H&t&H't'^R I(H)t)]PT!R 4t+R2t,0R3mt-R4t.R t/R Rlt0RRlt1RRlt2RRlt3RRlt4RRlt5RRlt6RRlt7Rt8RRlt9R R!lt:R"R#lt;R$R%ltR*R+lt?R,R-lt@R.R/ltA!R0R14tBR#)6zDurable transcript persistence for ``AIAgent`` (mixin; MRO-resolved from ``run_agent``): SQLite flush with intrinsic ``_DB_PERSISTED_MARKER`` dedup, ephemeral-scaffolding filtering, explicit trajectory export.N) nullcontext)AnyDictListOptionalTuple)COMPRESSED_SUMMARY_METADATA_KEY_DB_PERSISTED_MARKERContextCompressor_newest_checkpoint_carrier_strip_persistence_markersdrop_shadowed_checkpointsuser_originated_turn_view)forwardforward_static)sanitize_context)_is_multimodal_tool_result_multimodal_text_summary)save_trajectory)DB_ROW_SNAPSHOTMERGED_TURN_PREFIXREPAIR_BOOKKEEPING_FIELDS TOOL_CALL_UIDcopy_identity_fieldstool_call_uid_from_history)sync_flushed_message_markers run_agent"_persist_after_admission_interruptc0V^8dQhR\R\/#msgreturn)rbool)formats">/home/ubuntu/.hermes/hermes-agent/agent/session_persistence.py __annotate__r&4saa3a4aca\S\4;'dC\;QJd#V3Rl\4F 'gK R# R#!V3Rl\44#)z`True when ``msg`` is internal recovery scaffolding that must never reach the durable transcript.c3F<"TFpSPV4xK R#5iNget).0flagr!s& r% ,_is_ephemeral_scaffolding..6s(`C_4C_s!TF) isinstancedictany_EPHEMERAL_SCAFFOLDING_FLAGSr!sfr%_is_ephemeral_scaffoldingr64s= c4 ` `SS(`C_(`SS`S`S(`C_(`%``r'c0V^8dQhR\R\/#r session_idr")str)r$s"r%r&r&?siiiir'c Z\T;'gR4P4p\P!RRV4PR4R,;'gRpV'd W!8XdV#V R\P !VP RRR 74P4R , 2#) uPath-safe component for a (possibly untrusted ``X-Hermes-Session-Id``) ID: non ``[A-Za-z0-9_-]`` → ``_``, capped, plus a content hash when changed so distinct IDs cannot collide.z[^\w-]_z._:N`Nsessionzutf-8 surrogatepass)errors:N N)r:stripresubhashlibsha256encode hexdigest)r9raw sanitizeds& r% _safe_session_filename_componentrL?s jB  % % 'Cy#s+11$7<II I y['..GO)TU__abefg hhr'cHV^8dQhR\R\R\R\/#r r!contentoverrider")r2rr#)r$s"r%r&r&Is(D3#$r'cVRJ;'dPVP\4'*;'d.\V\4'*;'g\V\4#)zMay the persist override replace ``content``? A plain-text override must not replace native image/audio blocks (a list override is the clean multimodal payload and does), nor a message MERGED with a compaction summary (overwriting would drop the summary).N)r,rr1list)r!rOrPs&&&r%_override_replaces_contentrSIsU  J J78 8 J JGT* * H Hj4.Hr'cHV^8dQhR\R\R\R\/#rNr2r)r$s"r%r&r&Ts(TC33r'c0VP\4p\V\4'dk\V\4'dU\V\4'd?W8XgVP VR,4'dV'dVR,V,#T#V#)zReplace only the absorbed current turn, leaving unanswered history intact. The join matches ``_merge_consecutive_users``; a row that no longer holds the prefix takes the plain override.z )r,rr1r: startswith)r!rOrPprefixs&&& r%_content_with_turn_overriderYTsnWW' (F'3Jx$=$=*VUXBYBY   2 26F? C C196F?X- Ev E Or'c jV^8dQhR\R\R\R\\\3,/#)r r!rO api_contentr")r2rtuple)r$s"r%r&r&^s5       #  RWX[]`X`Ra  r'c\VRR4p\WV4'd/Vf\V\4'd W$8wdTp\ WV4pW#3#)uL``(content, api_content)`` as the current turn's user row is written: the persist override is the clean transcript, the live content is what the wire sent — so when they differ and nothing else was injected, the live bytes ARE the sidecar. Shared by the flush and the turn-start stamp so the stamp matches the row the flush wrote._persist_user_message_overrideN)getattrrSr1r:rY)agentr!rOr[rPs&&&& r%durable_user_row_contentra^sQ u>EH!#99  :gs#;#;@S!K-cHE  r'c0V^8dQhR\R\/#rrU)r$s"r%r&r&ks # #t # #r'cVP\4'dQ\V4fD\P!VPR44R8XgVPR4'gR#VPR4#)zStandalone handoffs are hidden so they never occupy the active user slot in retry/undo dispatch; merge-into-tail carriers keep their prior visibility.rO standalone!_compressed_summary_has_user_turnhidden display_kind)r,rrr classify_summary_contentr5s&r%_summary_display_kindriks_ /00 %c * 2  6 6swwy7I Jl Z77>?? 77> ""r'c0V^8dQhR\R\/#)r rOr")r)r$s"r%r&r&zs + +c +c +r'c \V4'd \V4#\V\4'gV#VUu.uFp\V\4'gKVP R4R8XgVP R4\ 9gKMVP R4R8Xd\VP RR44M \V4NK ppV'dRPV4#R#uupi)umText-only DB projection: multimodal envelopes → summary; part lists keep text, images → ``[screenshot]``.typetextr< N) rrr1rRr2r,_IMAGE_PART_TYPESr: _image_markerjoin)rOptxts& r%_durable_contentrtzs!'**'00 gt $ $ A a  P$%EE&MV$;quuV}Pa?a P!%%-6"9AEE&" }Q?OO  !499S>*d*  sC%-C%AC%c0V^8dQhR\R\/#)r partr")r2r:)r$s"r%r&r&sddddr'cVPR4pVPR4;'g*\V\4'dVPR4MRpVR9dRV R2#R#)z``[screenshot]`` at the image's position; a caller-chosen ``detail`` rides along so a replay (``agent.image_replay``) rebuilds the part the live turn sent. image_urldetailNz[screenshot detail=]z [screenshot])lowhighauto)r,r1r2)rvurlrys& r%rprps^ ((; C XXh  Y YC9N9NCGGH$5TXF.48O.O  *cUccr'c<\VRR4pVf \4#T#)aClose and turn-start persistence can run on separate CLI threads: one critical section. ``__init__`` always creates ``_session_persist_lock``; only ``object.__new__``-built test stubs lack it (they run unlocked, matching the historical ``if persist_lock is None`` branch). _session_persist_lockN)r_r)r`locks& r% _persist_lockrs$ 514 8D L;=2d2r'cV^8dQhR\\\\3,,R\R\R\/#)r historyqueryr`r"rRr2r:rr#)r$s"r%r&r&s6!!4S#X#7!!C!TX!r'ca\V3Rl\\S4^, RR44R4pVeSV,PR4V8wdR#\;QJd&RSV^,R4F 'dK RM RM!RSV^,R44'gR#SV,pSVR1RV\ &WBnR#)uRe-stage the transcript's unanswered tail row as THIS turn's user message; True when adopted. A dispatcher's re-run of a failed delivery turn resumes the DM its first attempt already persisted instead of appending it again. Rows loaded from the store are born durable (``_rows_to_conversation``), so handing the tail row back as ``agent._pending_cli_user_message`` makes ``_stage_turn_user_message`` reuse it as this turn's user dict and the flush writes no second row. The one user is the peer-DM lane's re-run (``resume_unanswered_turn`` in ``gateway.platforms.api_server``, #115325): in process it calls this on the agent it just built for the re-run; under the session authority the admission carries ``resume_unanswered`` and ``gateway.run_turn_runner`` calls it on the admitted history when its tail is that bare user row (a tool suffix there keeps the completed work in view). The owner-side Bot Chat retry (``gateway.session_bot._maybe_retry``) does not adopt: its failed turn is already closed by the durable failed-turn boundary, which this function declines by design. The DM is not always the literal tail: a turn that died mid-way persisted its tool scaffolding — assistant ``tool_calls`` rows and their ``tool`` results — behind the DM before the failure text was built, and the dispatcher retries that too. The DM is still unanswered while nothing after it is a plain assistant reply, so it is adopted and the failed attempt's scaffolding leaves the in-memory transcript: the re-run starts the turn over from the DM (the rows stay in the DB as the record of the failed attempt; the re-run's answer lands after them as a valid continuation). Anything else declines — no user row at the tail, or a different text there — so a person's deliberate re-send of the same text is never swallowed. c3<"TFEp\SV,\4'gK"SV,PR4R8XgKAVxKG R#5i)roleuserNr1r2r,)r-irs& r%r/(adopt_unanswered_turn..sCV:agaj$/4;AJNN64Jf4T:sAA ANrOFc3"TFfp\V\4;'dJVPR4R8H;'g.VPR4R8H;'dVPR4xKh R#5i)rtool assistant tool_callsNr)r-rows& r%r/rs}-+3#t$CC#''&/V*C+B+BPV[fHfIAIAknkrkrslAC+sA0A0A0A0T)nextrangelenr,allr _pending_cli_user_message)rrr`idxtailsf&& r%adopt_unanswered_turnrs, V5W!12r:VW[ ]C {gcl&&y1U: 3-!#'(+-333-!#'(+- - - 3x|H+=(!(C008;ce;r'cFV^8dQhR\\,R\/#r messagesr")rRr2int)r$s"r%r&r&s$t*r'c^p\\VRR4;'gRV4F1wr4WCJgVP\4'gV#V^, pK3 V#)zPSkip the identity-matched, still-marked prefix of the previous flush's snapshot._db_flush_scan_prefixN)zipr_r,r )r`r scan_startprevcurs&& r%_db_flush_scan_startrs]J(?FLL"hW  ?#''*>"?"?   a X r'c^V^8dQhR\R\R\\\3,/#)r r!is_current_turn_userr")r2r#r:r)r$s"r%r&r&s)**d*$*4S>*r'cVPRR4pVPR4p\VPR4\4'dVPR4MRpVPR4pV'd+VR8Xd$\WWE4wrE\ VRR4pVfTMTpWT8XdRpVfTVR9dM\V\4'd7V'd/\ V4P 4VP 48wdTpRTR\V4R VPR 4;'gVR 8XdVPR 4MRR \VPR 4\4'd VR ,MRR VPR 4RVPR4RVPR4RVPR4/\Uu/uFqVPV4bK upCR\VP\44RTRTR\V4RVPR4RVPR4;'gVPR4R\VPR44/Cp \VPR4\4'd VR,V R&\W4\VP\4\4'dV\,V \&V #uupi)zUBuild the session-db row for ``msg``, applying the persist override to THIS row only.runknownrOr[N timestampr_persist_user_message_timestamp tool_namernamer tool_call_ideffect_disposition token_count finish_reason_compressed_summaryrgdisplay_metadataplatform_message_id message_idobserved_row_id)rr)r,r1r:rar_rrCrtrR_ROW_REASONING_KEYSr#rrirrr) r`r!rrrOr[r ov_timestampkrs &&& r% _db_flush_rowrs` 7769 %Dggi G,6sww}7Ms,S,S#''-(Y]K $I7GYu&GN !-!5I<   (= =*WVYBZBZ_f W % + + - @  i!1'!:SWW[)ZZcggfoUY:cggl6KT+R+Rc,'X\/1EswwOcGdsww}-@X  #6 6"5Qcggaj="5 6  tCGG,K$LMY {-c24FPbHcsww'<=VVAVD,- C#'')$c**YI"#''/*C00"?3O J 7s;Kc~V^8dQhR\\,R\\\,,R\/#)r rconversation_historyreplay_history)rRr2rr#)r$s"r%r&r&s2&"&"tDz&"RVW[R\I]&"&*&"r'c \V4pT;'g.Uu0uF&p\V\4'gK\V4kK( pp\ VRR4p\ VRR4p.p .p /p \ \ W4\V44EFjp W,p \V \4'd-\V 4'gV P\4'dKP\V 4V9pV'd V'd\V 4V9d'V P\4'g RV \&K\ VRR4'd2V'g*RV R&/V PR 4;'g/CR R /CV R &V PR 4R 8Xd4V P\4'g\WV 4;pe W\&T P\Y W|8H;'gWJ44V PV 4EKm W3#uupi)zScan for un-flushed messages; returns ``(rows, msgs)`` to write in one transaction. ``replay_history`` (session-row heal) writes the history prefix again instead of stamping it as already durable._persist_user_message_idxNrT_mute_notification_replyFrfrgrnotification_category diagnosticrr)rr1r2idr_rrrr6r,r "_PERSIST_AFTER_ADMISSION_INTERRUPTrrappendr)r`rrrritem history_idsov_idxpending_cli_message batch_rows batch_msgstool_uid_ownersmsg_idxr! is_historytool_uids&&&& r%_db_flush_collectrs"%(H)=)C)C)C_)C SWY]H^82d8)CK_ U7 >F"%)DdK')JJO-e>H N#t$$(A#(F(F#''RfJgJg W + 2c7h3F''<==(,C$ %  54e < 6JE]`E#DzE.6smEr'cRVn^RIHpHpHpHp^RIHp V!V4VnVPR8XEdV^8:g\WP4'gR#\V4VPVn \4Vn^VnRVnVP#4VP$p VP 'g8V 'd0\W 4'dRVnVP#4WnVP 'g$\&P)R\+VRR44R#\&P)R\+VRR44R #\-WV34'dcT!\+VRR 4;'gR VU U U u.uF4p V P/4U U u/uFwrV \09gKWbK up p NK6 up p p 4\-W4'd"V^8d\5V4'dR#R Vn\&P)RV4R# Yni;iuup p iuup p p i \2d2\&P)R TP\+TRR4R R 7Li;i)aClassify a failed flush and name the one retry the caller should take, or None to fail closed. ``"adopted"``: a compression-closed session moved onto its live tip. ``"healed"``: the session row was deleted under the live agent and has been recreated (unparented for a delegate child whose parent went with it); flush markers are reset so the caller replays the full in-memory transcript. Either retry is taken at most once (``adoption_budget``).N)StateDbCorruptErrorStateDbReplacedErrorclassify_persistence_errordivert_session_transcript_jsonl)CompressionSessionClosedErrorsession_row_missingFzRSession DB row for %s is missing and could not be recreated; will retry next flushr9zaSession DB row for %s was removed under the live agent; recreated it and replaying the transcripthealedr<z,JSONL divert failed after state.db %s for %sT)exc_infoadoptedz$Session DB append_message failed: %s)r hermes_staterrrrhermes_state_errorsr_last_persistence_error_causerr9r _session_row_replay_pendingrrr_session_db_created_ensure_db_session_parent_session_idrrr_r1itemsrrrr)r`rrrrrrrrr parent_idrrvs&&&&& r%_db_flush_failedr\s+#'EDDA*DQ*GE' **.CC a 'A%IYIY'Z'Z"8,-2,<,<)(+%%&"$)!   ",, (((Y;UV[;g;g(,E $ 5((*+4(((( NNo"5,= ?zulD9 ;!,?@AA s +GE<,L,R,RPR6@-B6@@Awwy-oytqAUnLndady-o6@-B C !33 Q #B5#I#I-1* NN91= 9,5( .p-B s NNI >>|]a@bmq  s ssN%H'H*=H*H#H1H7H#? H*HH##H**9I&%I&ca]tRtRtoRtV3RlRltRV3RlRlltV3RlR lt]!R R 4t RV3R lR llt RV3RlRllt V3RlRlt ]!RR4t ]!R R4tV3RlRlt]!R R4t]!R R4tRtVtR#)SessionPersistenceMixinizCSession DB flush and trajectory persistence (see module docstring).c4<V^8dQhRS[S[,RR/#r rr"NrRr2)r$ __classdict__s"r%r&$SessionPersistenceMixin.__annotate__s55T$Z5D5r'c \VRR4p\VRR4p\VRR4p\VRR4pVe Vf VfVfR#^Tu;8:d\V48d MMW,MRp\V\4'dVP R4R8XgR#\ WfP R4V4'd\ WfP R4V4VR&VeWFR &VeWVR &R#R#) zRewrite the current-turn user message in place: some paths send an API-only variant that must not leak into transcripts or resumed history.rNr^r!_persist_user_message_platform_idrrrOrr)r_rr1r2r,rSrY)selfrrrPr platform_idr!s&& r%$_apply_persist_user_message_override4!A4HD"CTJ d$GN ;8+ 0AkFY  C7#h-7hmT3%%#''&/V*C  %c779+=x H H8ggi>PRZ[C N  (   ")4% & #r'NcT<V^8dQhRS[S[,RS[S[,R,/#)r rrNr)r$rs"r%r&rs*&&d&4PT:X\K\&r'c "^RIHp\V4;_uu_4VPV4WnVP W4VP eVP P4V!V4RRR4R# +'giR#;i)uSave to SQLite on any exit path. Trailing empty-response scaffolding is dropped from the live list; the persist override is applied to the DB row only. The persist user-message *override* is NOT applied here — it is resolved inside ``_flush_messages_to_session_db`` and written only to the DB row, never mutating the live message list used by the API call (#48677 is thus closed for every persist caller, not just this one). )note_turn_persistedN)agent.agent_runtime_helpersr%r)_drop_trailing_empty_response_scaffolding_session_messages_flush_messages_to_session_dbrflush_token_counts)rrrr%s&&& r%_persist_session(SessionPersistenceMixin._persist_sessionsl D 4   : :8 D%- "  . .x N+  335  %! s AA== B c4<V^8dQhRS[S[,RR/#rr)r$rs"r%r&rs  $t* QU r'c \aRV3RllpV!RR4'dSP4K!R#)aPop empty-response retry scaffolding from the tail. The assistant(tool_calls) / tool rows before it stay: they were saved before the tools ran, so dropping them from the live history only makes the model repeat a side effect the durable transcript already records.c0V^8dQhR\R\/#)r keysr")r:r#)r$s"r%r&WSessionPersistenceMixin._drop_trailing_empty_response_scaffolding..__annotate__s p p p pr'c<\S4;'dZ\SR,\4;'d;\;QJdV3RlV4F 'gK R# R#!V3RlV44#)c3T<"TFpSR,PV4xK R#5i)r3Nrr+)r-rrs& r%r/bSessionPersistenceMixin._drop_trailing_empty_response_scaffolding..tail..s(LojnefXVX\M]M]^_M`M`jns%(TFr)r#r1r2r3)r0rs*r%rOSessionPersistenceMixin._drop_trailing_empty_response_scaffolding..tailsM>ooj"t&DooLojnLo o oLojnLoIo or'_empty_recovery_synthetic_empty_terminal_sentinelN)pop)rrrs&f r%r'ASessionPersistenceMixin._drop_trailing_empty_response_scaffoldings/  p p.0JKK LLNLr'zagent.agent_runtime_helpersrepair_message_sequencecV<V^8dQhRS[S[,RS[S[S[,,/#)r rr)rRr2r)r$rs"r%r&rs0__d4j_X`aefjakXl_r'c \V4;_uu_4VPW4uuRRR4# +'giR#;i)z=Serialize direct and turn-boundary session flushes per agent.N)r&_flush_messages_to_session_db_unlocked)rrrs&&&r%r)5SessionPersistenceMixin._flush_messages_to_session_dbs* 4 >>x^! s 0 A c\<V^8dQhRS[S[,RS[S[S[,,RS[/#)r rr_adoption_budget)rRr2rr)r$rs"r%r&rs7's'sT 's:B4::N'sil'sr'c \VRR4'gVP'gR#.pVP'gVP4\VRR4VP8Hp\ WW%4wrF\ WWa4RVn\4Vn \V4Vn VR,Vn R# \d5p\YYCT4pTfRp?R#TPY^R7uRp?#Rp?ii;i)ulPersist un-flushed messages to SQLite. Dedup is the intrinsic ``_DB_PERSISTED_MARKER`` on each written dict — not positional slices (drift after sequence repair) nor an ``id(msg)`` set (address reuse). The persist override touches the written row only. A compression-closed session adopts its live tip and retries exactly once. Deduplicates via an intrinsic ``_DB_PERSISTED_MARKER`` stamped on each written message dict, so repeated calls (from multiple exit paths) only write truly new messages — preventing the duplicate-write bug (#860) without relying on positional slices that can drift after message-sequence repair, and without a retained ``id(msg)`` set that CPython could alias onto a freed-then-reused address (#50372). The ``_flushed_db_message_ids`` attribute is now only a one-shot seed (translated to markers, then cleared each flush), not a persisted set. _persist_disabledFNr :NNNT)rA)r_rrrr9rrr rrrrrrrr>) rrrrArreplayrrretrys &&&& r%r>>SessionPersistenceMixin._flush_messages_to_session_db_unlockeds" 4,e 4 4D>xpq>r r  ss)B7A8B77 C6C1C1+C61C6cF<V^8dQhRS[S[,RS[S[,/#rr)r$rs"r%r&r s#4:$t*r'c \\V4^, RR4F&pW,PR4R8XgK!VRVu# VP4#)zcMessages before the last assistant turn (rollback point for a malformed final answer); all if none.rrNr)rrr,copy)rrrs&& r%"_get_messages_up_to_last_assistant:SessionPersistenceMixin._get_messages_up_to_last_assistant sKs8}q("b1A{v&+5|#2}}r'zagent.system_promptformat_tools_for_system_messageconvert_to_trajectory_formatcR<V^8dQhRS[S[S[S[3,,RS[RS[/#)r r user_query completedr)r$rs"r%r&rs5DDd38n)=D3D[_Dr'c ~VP'gR#VPWV4p\W@PV4R#)z+Save conversation trajectory to JSONL file.N)save_trajectories_convert_to_trajectory_format_save_trajectory_to_filemodel)rrrOrP trajectorys&&&& r%_save_trajectory(SessionPersistenceMixin._save_trajectorys1%%% 77iX  ZZCr'extract_api_error_contextdump_api_request_debug)rrrr(r r*)Nr3)__name__ __module__ __qualname____firstlineno____doc__r!r+r'_forward_repair_message_sequencer)r>rJ _format_tools_for_system_messagerSrW_forward_static_extract_api_error_context_dump_api_request_debug__static_attributes____classdictcell__)rs@r%rrsM55&&&*   ((EG`a__ 's'sR(00EGh'i$$,-JLj$k!DD"11NPk!l&'DF^_r'r)r7r8_thinking_prefill_verification_stop_synthetic_pre_verify_synthetic_kanban_stop_synthetic_dropped_toolcall_nudge>imagerx input_image) reasoningreasoning_contentreasoning_detailsrcodex_message_items)F)Cr_rFloggingrD contextlibrtypingrrrrragent.context_compressorrr r r r r ragent.lazy_forwardrr`rrcagent.memory_contextragent.tool_dispatch_helpersrragent.trajectoryrrTagent.message_metadatarrrrrragent.transcript_repairr getLoggerrr4rorrr6rLrSrYrarirtrprrrrrrrrrrrrr'r%r~s "33V1\H  A   ; ' :}%I"ai   # +d3!L<*Z&"R,$.ERx`x`r'