+ lHjlkRt^RIHt^RIt^RIHt^RIHt]P!R4t RRlt RR lt R R lt R R lt RRlt]!0RKm4t]!0RLm4t]!RR04tRRltRRltRRltRR/RRllt]P!R4t]P!R4t]P!R4tRtR R!ltR"R#ltR$R%ltR&R'ltR(R)ltR*R+lt R,R-lt!R.t"R/R0lt#RMt$]!0RNm4t%R1RRR/R2R3llt&R4R5lt'R6R7lt(R8RR9R/R:R;llt)R<R=lt*R>R?lt+R@RAlt,RORBRCllt-^t.^t/RDt0RERFlt1RPRGRHllt2RIRJlt3R#)QzSession history/message shaping: image-ref messages, content coercion, history->wire messages, in-flight turn tracking and turn-failure detail. Bodies are rebound onto server.py's globals (method_ctx.bind_module).) annotationsN) bind_module)STEER_DISPLAY_KINDuq(^|\n)\[Triggering message id: `[^`\n]*` — use as `message_id` for reply/react/pin via the discord tools\.\]\n*c$V^8dQhRRRRRR/#)namestrargsdictreturn list[dict])formats"@/home/ubuntu/.hermes/hermes-agent/tui_gateway/session_history.py __annotate__rs&NNsN$N:Ncb^RIHpV!W4Uu.uFq3P4NK up#uupi))tool_labels_for_call) agent.displayr as_payload)rr rlabels&& r_bridged_tool_labelsrs+2,@,L M,L5   ,L MM Ms,c V^8dQhRRRR/#)ragentAnyr ztuple[str, str]r )rs"rrrsxx#x/xrc^RIHpHp\VRR4;'gV!4\VRR4;'gV!43#)zBReturn the live provider/model, falling back before agent startup.)_read_main_model_read_main_providerprovidermodel)agent.auxiliary_clientrrgetattr)rrrs& r_active_image_routing_identityr$s<L E:r * C C.A.CWUT[]_E`EvEvdtdv wwrc$V^8dQhRRRRRR/#r user_textr image_paths list[str]r r )rs"rrrs!444)44rcRPR\\V444pT;'gRpV'dV'dV RV 2#T#T;'gR#)uReference attached images by path so the agent analyzes them in-loop with ``vision_analyze``: pre- analyzing with the auxiliary vision model blocked submit 60-90s/photo and poisoned auto-titles. This used to pre-analyze every image with the auxiliary vision model *before* the turn was dispatched (``_enrich_with_attached_images``): serial blocking calls on the submit path — 60-90s per large photo — with failures silently swallowed and an interrupt during the window killing the turn with zero API calls (#83291). It also prepended the vision description to the first user message, poisoning session auto-titles (#82339). The CLI never gates turn dispatch on vision like this, which is why the same message was seconds there and minutes on desktop.  c3v"TF/qP4'gKRVP RV R2xK1 R#5i)z[The user attached an image: z<] [Examine it with the vision_analyze tool using image_url: ]N)existsr).0ps& r +_build_image_ref_message..)s8'A88: r 'x/lmnloopq's99r What do you see in this image?)joinmapPath)r'r(prefixtexts&& r_build_image_ref_messager9s][[T;'F ??D (,&dV$8&8  3 333rc$V^8dQhRRRRRR/#r&r )rs"rrr3s" / /c / /VY /rca^RIHoT;'gRpRPV3RlV44pV'gV#V'dV RV 2#T#)aPersisted form of the user's message: ``@image:`` directives (the desktop renders them as images); ``_build_image_ref_message``'s ``image_url:`` hint is model-only, never persisted. Caption first, directives last: session previews are the first 60 chars of the first user message.format_reference_valuer  c3|<"TF1p\V4P4'gK$RS!V4 2xK3 R#5i@image:N)r6r.r/r0r=s& rr19_build_persist_message_with_image_refs..9s4dKqSWXYSZSaSaSc:w5a89:Ks!<<)agent.context_referencesr=r4)r'r(r8refsr=s&& @r&_build_persist_message_with_image_refsrF3sH@ ??D 99dKd dD  $dV2dV .$.rc(V^8dQhRRRRRRRR/#)rr'rr(r) run_messagerr r )rs"rrr?s0BB3BYBUXB]`Brc\W4p\V\4'gV#VUu.uF3p\V\4'dVP R4R8XdK1VNK5 ppRRRV/.VO#uupi)a Shape the persisted user turn like the model payload: ``_flush_messages_to_session_db`` ignores a plain-string override for a list (native-vision) payload, so swap only the text part for the ``@image:`` form, keep image parts, drop API-only text parts (barge-in note).typer8)rF isinstancelistr get)r'r(rH persist_textr0 image_partss&&& r_build_persist_user_messagerP?sq:)QL k4 ( ()ck*Q2E2E!%%PV-[aJa11kKc VV\ 2 A[ AAds .A,A, input_audioaudioc V^8dQhRRRR/#)rpartr r rr )rs"rrrOs;;$;3;rcVPR4p\V\4'dVPR4p\V\4'dV#R#)zFThe URL carried by an image part (``image_url`` dict or str), else "". image_urlurlr )rMrKr r)rTrVs& r_history_part_image_urlrXOsB%I)T""MM%( "9c229::rc$V^8dQhRRRRRR/#)rcontentr image_urlsboolr rr )rs"rrrWs! " " "T "c "rcVPR4pV\9d>\VPR4;'gVPR4;'gR4#V\9d V'd \ V4MR;'gR#V\ 9dR#V'dRV R2#RV9d%\VPR4;'gR4#R #) z:Placeholder/text rendering of one structured content dict.rJr8rZr z[image]z[audio][r-z[structured content])rM_HISTORY_TEXT_KINDSr_HISTORY_IMAGE_KINDSrX_HISTORY_AUDIO_KINDS)rZr[kinds&$ r_history_dict_textrcWs ;;v D ""7;;v&FF'++i*@FFBGG ##4>'0BTT9T ## 4&{ 7;;v&,,"-- !rc V^8dQhRRRR/#)rrZrr rr )rs"rrrgs333333rc\V\4'd RPRRV444#\V\4'd\ VRR7#VfR#\ V4#)r>c38"TFq'gK VxK R#5iNr )r/ts& rr1(_content_display_text..isc$]qab$]s  c3T"TFp\V4P4xK R#5irg_content_display_textstripr/rTs& rr1riis$$]U\T%:4%@%F%F%H%HU\s&(Fr[r )rKrLr4r rcrrZs&rrlrlgsX'4  yyc$]U\$]ccc'4  !'e<<22c'l2rr[Tc$V^8dQhRRRRRR/#)rrZrr[r\r rr )rs"rrros!33#3d3c3rc\V\4'Ed.pVFp\V\4'g<\V\4'dX\VP R4\4'd3TP \V\4'dTMVR,4K\V\4'gKVP R4'gK\ W1R7pTP VR,\9dTMRV 24K RPV4#\V\4'd \ WR7#VfR#\V4#)uRender ``message['content']`` (str, parts list, or one structured dict) as a plain string. Image parts keep their URL inline so the desktop's ``extractEmbeddedImages`` and the resume payload agree with the cached message (else the inline image flashed, then vanished); other shapes become a placeholder. ``image_urls=False`` renders ``[image]`` instead — the ``inline_images=false`` read (#116511): a remote client reads a transcript in kilobytes instead of re-transmitting every stored attachment.r8rJror>r ) rKrLrr rMappendrcr_r4)rZr[chunksrTrendereds&$ r_coerce_message_textrvos '4  D$$$D$)?)?JtxxX^O_adDeDe js&;&;dfND$''DHHV,<,<-dJ $v,:M*MhUWX`WaSbc  wwv'4  !'AA22c'l2rz!\[Image attached at: ([^\n\]]+)\]z,data:image/[^;,]+;base64,([A-Za-z0-9+/=]+)\Zz/@image:(`[^`\n]+`|\"[^\"\n]+\"|'[^'\n]+'|\S+)\Zz [screenshot]c V^8dQhRRRR/#)rr8rr ztuple[str, int]r )rs"rrrs####/#rcVPR4p^pV'd.VR,\8XdVP4V^, pK5RPV4V3#)r>)split_SCREENSHOT_PLACEHOLDERpopr4)r8linescounts& r'_strip_trailing_screenshot_placeholdersrsJ JJt E E E"I!88    99U U ""rc V^8dQhRRRR/#)rrZrr str | Noner )rs"rrrs==c=j=rcF a\V\4'd.\V4^8g\V^,\4'gR#V^,pVP R4R8wg&\VP R4\ 4'gR#VR,p^RIHoRV9dVPR^4wr4V'dVR8XdR#\V4wrERV,PR4Uu.uFp\PV4NK pp\V4'gR#VUu.uF q^,NK p pV^\V 439dR#VR ,RPV3R lV 44,p EM;\V4wrV P4p V Uu.uFqfPR 4'gKVNK p pV Uu.uFp\ PV4NK ppV'd&\V4'dV \V4)RV 8wdR#VUu.uF,q^,^,R9d V^,^RMV^,NK. p p\";QJd(V3R l\%W44F 'gK R M RM!V3R l\%W444'dR#V^\V 439dR#T p ^RIp^RIp^RIHp^RIHp^RIHp^RIHpV^^\V 4,p\V4\V 48wg3\V4^\V 4,^\V 4,39dR#\V4^\V 4,8d^RIHpVR,p\V\4'd_VP R4R8wgI\VP R4\ 4'd$V!VR,4P?4'dR#\%V V4FwppV!V4PA4'd-\V\4'dVP R4R8wdR#\BP\EV44pV'd-\V^,4V^,^,^,8dR#V!V!V44wppVPFV8g.VPI4VPKV^,R R78wdR#K V #uupiuupiuupiuupiuupi \L\NTPPT3dR#i;i)zTProject verified native-vision images as refs without changing stored/model content.NrJr8r<z [Image attached at: r3z[Image attached at: r>r+c3:<"TFpRS!V4 2xK R#5ir@r rBs& rr1+_user_image_display_text..s#0f`e[\7;QRS;T:U1V`erAc3L<"TFwrS!V4V^,8gxK R#5i)Nr )r/r0matchr=s& rr1rs$YEX%a(E!H4EXs!$TF)r6) HTTPException)_fs_regular_file)_FS_DATA_URL_MAX_BYTES)sanitize_contextrV)validate)`"'ry))rKrLlenr rMrrDr=rzr_IMAGE_HINT_RE fullmatchallr4 splitlines startswith _IMAGE_REF_REanyzipbase64binasciipathlibr6fastapirhermes_cli.web_routers.filesrhermes_cli.web_serverragent.memory_contextrrm is_absolute_IMAGE_DATA_RErXst_size read_bytes b64decodeOSError ValueErrorError)rZ text_partr8captionhints placeholderslinematchesrpaths projectedbodyr} ref_linesrrr6rrrrOrmemorypathrTtargetstr=s& @r_user_image_display_textrs8 gt $ $G q(8 7ST:W[@\@\ I}}V&jv9NPS.T.T V D?!T)$>B'%EEEeL?UX]?]>d>dei>jk>jd>++D1>jk7||'./weqw/ 3u: .f$tyy0f`e0f'ff DTJ!&+Jedy/ITTe J=FGYT=**40YGc'lleS\MN.Cy.P]de]dTY8A;/#Aq!BuQxO]de 3YSEXY333YSEXY Y Y 3u: . %=<!AE N+K ;3u:%Wa#e*naRUV[R\n=])] 7|a#e*n$9&$''6::f+=+GzZ`ZdZdekZlnqOrOrwGHNOUHVwWw]w]w_w_%- dDz%%''z$/E/ERXIY]hIh(()@)FGE!H *@1*D)Ja(OO )$t*5JFBzz22f6G6G6IVM]M]^cde^fquM]Mv6v7w. _l0KGf>X^^]C  s7/S%&S*S/6S/S42S9 AS>>T T c V^8dQhRRRR/#)rrTr r r\r )rs"rrrs__$_4_rcVPR4pV\9;'g,VRJ;'d \VPR4\4#)rJNr8)rMr_rKr)rTrbs& r_history_text_only_partrsB 88F D & & ^ ^44<+]+]JtxxPVGWY\<]^rc V^8dQhRRRR/#)rrZrr r\r )rs"rrrsvvvvrcH\V\4'dH\V4;'d5\;QJdRV4F 'dK R# R#!RV44#\V\\ \ 34;'g$\V\4;'d \V4#)zGTrue when a busy submit carries only plain text, not attachments/media.c3"TF@p\V\4;'g$\V\4;'d \V4xKB R#5irg)rKrr rrns& rr1-_is_text_only_busy_payload..s=% lsdhJtS ! _ _jt&<&^&^AXY]A^ _lssA A A FT) rKrLr\rrintfloatr rrps&r_is_text_only_busy_payloadrs'4  G}  % ls%   % ls% "   gS%0 1 u uj$6O6t6tTklsTturc$V^8dQhRRRRRR/#)rrolerr8rr r\r )rs"rrrs&CCJCcCdCrcZVR8H;'d VP4PR4#)uGateway notices (model-switch, personality) persist as role=user ``[System: …]`` rows so strict providers accept them mid-history; they must never render as a user bubble. Filtering in this one projection hides them everywhere (raw marker stays in ``session["history"]``) and keeps the desktop's user ordinals stable. It also removes the stored marker from the payload the desktop reconciles against, so it can no longer shift user-message ordinals and duplicate the optimistic prompt (#67603). userz[System:)lstripr)rr8s&&r_is_display_hidden_markerrs' 6> B Bdkkm66zBBrc V^8dQhRRRR/#)r content_textrr r )rs"rrrsHHSHSHrc0\VRR7;'gR#)udThe invocation a slash-skill-expanded turn came from, else "" — UIs render ``/work fix the leak``. ) separatorr )describe_skill_invocation)rs&r_skill_scaffold_projectionrs $\S A G GRGrc$V^8dQhRRRRRR/#)rr8rtask_idr r )rs"rrrs!  c C C rctT;'gRP4PR4wr#pVPR4'gV#^RIHpHpV!VP R4RR7pVfV#V!WtP4VR7;'gT# \d\PRRR 7Tu#i;i) zInverse of :func:`_skill_scaffold_projection`: rewind/regenerate hands back the projected invocation, and re-running it verbatim would drop the skill. Unchanged when not resolvable.r r/)build_skill_invocation_messageresolve_skill_command_keyT) interactive)rz$skill re-expansion failed for replay)exc_info) rm partitionragent.skill_commandsrrr Exceptionloggerdebug)r8rhead_argrrcmd_keys&& r#_expand_skill_invocation_for_replayrsJJB%%'11#6LDS ??3   b+DKK,<$Ot{-KGU^U^U`jq-r-z-zvz{  ;d K s&B.B B$B76B7z8[System note: Your previous turn was interrupted mid-runc$V^8dQhRRRRRR/#)rrrr8r rr )rs"rrrs&ppsp#p*prc^RIHpV!W4;p'dV#VR8Xd,VP4P\4'dR#R#)zDisplay type of a synthetic row persisted untyped: new rows are typed at turn start (``persist_user_display_kind``); this prefix sniff migrates rows already on disk (a turn killed mid-run never reached the stamp).) untyped_failed_turn_display_kindr auto_continueN)agent.turn_failure_copyrrr_AUTO_CONTINUE_NOTE_PREFIX)rr8r failed_turns&& r_legacy_display_kindrsGI6tBB{B"fn1I1IJd1e1e?okoor profile_homec$V^8dQhRRRRRR/#)rhistoryr r[r\r r )rs"rrrs-MCMC*MCPTMC`jMCrc  a^RIHp.p/pVEF?o\S\4'gK\ S4oSfK-SP R4pV\ 9gSP R4R8XdKaVR8Xd\SP R44MRpVf\SP R4VR7p\Wg4'dKVR8Xd\PR V4pVR 8XdSP R 4'dSR ,F|pVP R /4VP R R4rV 'gK0V P R4'gKI\PV P RR44p V R,V 3WZ&K~ VR8Xd3SP R4\ 8Xd^RIHp V !S4;'gTpVR8XdTP SP R4;'gRR%4wrT ;'gSP R4;'gRpT;'g/p \'W4pTP)RRRVR\+W4/VR&9dRSP R4/M/CR'Uu/uF"pSP V4fKVSV,bK$ upCV 'dRV /M/CV'dRV/M/C4EKVR 8H;'dC\,;QJd#V3Rl\.4F 'gK RM RM!V3Rl\.44pVP14'g V'gEKRVRV/pSP R4p\V\2\434'dV^8d\5V4VR&SP R4e SR,VR &VR8Xd \7V4MRpV'dVP9VR!R"7VR 8Xd VP9V3R#l\.44SP R4;'g \;Wg4pV'dVVR&SP R4'd SR,VR&VP)V4EKB V!WAR$7# \P\3d/p ELi;iuupi)(z``image_urls=False`` is the ``inline_images=false`` projection (#116511): image parts render ``[image]`` so a remote client's history read stays kilobytes instead of re-transmitting every stored attachment.)project_history_commentaryNr display_kindhiddenrrZroz\1 assistant tool_callsfunctionidr r argumentsz{}) _extract_steer_text_from_messagetool tool_call_id tool_namecontext timestampdisplay_metadatar labelsc3F<"TFpSPV4xK R#5irgrMr/keyms& rr1'_history_to_messages..Qs:pQo#155::Qos!TFr8_row_idrow_idskill_invocation)r8rc3d<"TF%pSPV4fKVSV,3xK' R#5irgrrs& rr1rbs,i0NRSRWRWX[R\}QsV}0Ns00)homeNN>patch write_file skill_manage)rrr)agent.history_commentaryrrKr &project_compaction_message_for_displayrM_HISTORY_ROLESrrvr_DISCORD_TRIGGERING_NOTE_REsubjsonloadsJSONDecodeError TypeErrorragent.conversation_compressionrrrs _tool_ctxr_HISTORY_ASSISTANT_DETAIL_KEYSrmrrrupdater)rrr[rmessagestool_call_argsrrtcfntc_idr rtc_nametc_argsrrrhas_assistant_detailmsgts invocationrrs&$$ @r_history_to_messagesr$sDHN !T""  21 5 9 uuV} ~ %~)>()J EIV^/i0@AY]  /i0@ZXL $T 8 8  6>6::5,OL ; 155#6#6 ooFF:r2BFF44DE5RVVF^^"#zz"&&d*CD.0Z,>N)& 6>aeeN37II W;A>NN,L 6>-11!%%2G2M2M2|\ G::aeeK0::FD==bD)$5F OOVVVT9iPTF[kBFIpApAEE),< =vxk8i ;7h#$55:!,QsV 7h ; k 37B k [aXvDVfh k l #{2ppss:pQo:psss:pQo:p7p!!##,@ tV\2UU;  b3, ' 'BF$RyC  55  'iLCMAE/ =UW  JJJ5GJ H ;  JJi0Ni iuu^,XX0DT0X ".C  55# $ $&'(:&;C" #KL &h BB_!00)<"!"" ;s%Q-Q? Q? Q<;Q<c V^8dQhRRRR/#)rvaluerr r r )rs"rrrms rc.p\V\4'dTMRFp\V\4'dVPR4R9dK1VPR4fVPR4MVPR4p\V\4'gK~VP 4'gKRVR,RV/pVPR4R8XdRVR&VP V4K V#)rrZr8rrr )rrsystem)rKrLr rMrrmrs)r&ritemrZrows& r_coerce_seed_historyr+msG#E400b8$%%&)9A`)` &*hhy&9&A$((6"txxPYGZ gs # # 4<Gs2CJD  ;; 'D dD ! !RdFB?KKTXXk288b9$@D]a]f]f]hKi#Orc$V^8dQhRRRRRR/#)rr0r r8rr r1r )rs"rrrs! $ $ $S $T $rc\V4pVPR4pV'd\V\4'gR#\V4p.VPR4;'g.OVNVR&.VPR4;'g.O\ \ VPR4;'gR44NVR&\ P 4VR&W0R&R#)uRecord an accepted mid-turn correction on the live turn — appended, never written over ``user``, so a resuming client can rebuild BOTH bubbles.r6N correctionscorrection_offsetsrr r5)r.rMrKr rrr7)r0r8 correctionr9s&& r_record_inflight_correctionrDs %J ;; 'D Zd33 :DHTXXm4::HZHD!qDHH-A$B$H$Hb!q3sSWS[S[\gShSnSnlnOoKp!qD D#Orc V^8dQhRRRR/#)rr0r r r1r )rs"rrrs**$*4*rc4RVR&VPRR4R#)Nr6_submit_user_row)r|)r0s&r_clear_inflight_turnrHs#GO KK"D)rc(V^8dQhRRRRRRRR/#) rr0r errorr error_surfacezOptional[dict]r r1r )rs"rrrs)***c*.*\`*rc\V\4'g \V4M'\V4;'g\V4Pp\ P 4pVP R4p\V\4'g RRRRRV/pTP\VP R4;'gR4\VP R4;'gR4T;'gRRRR 7V'd\V4VR &MVPR R 4VPR VR 7WPR&VPRR 4R #)aDMark the in-flight turn terminal-error but keep it replayable: a failure's terminal frame can be lost on WS disconnect and the turn may never have been committed, so the snapshot lets ``session.resume`` replay prompt, partial text and error. Lives until the next turn starts or the session closes. Caller holds history_lock.r6rr rr3z turn failedrJT)rrrJstatus recoverablerKNF)r4r5rG) rK BaseExceptionrrJ__name__r7rMr rr|)r0rJrKmessager8r9s&&& r_fail_inflight_turnrRs !+5- @ @c%js5zGiGiUYZ_U`UiUiG ))+C ;; 'D dD ! !R\3?KKdhh{+11r2TXXf=M=S=SQS9T&&wD $] 3_ $'KK%CK0#O KK"D)ric$V^8dQhRRRRRR/#)rrQrpromptrr r )rs"rrrs!SSrcaa V'd V'gV#RP\V4P44R\p\o \ V4S 8g\ V4S 8dV#\ \ V4S , ^,4Uu0uF q2W3S ,kK pp\PV4^RoSV8wd=VPVV 3Rl\ \ S4S , ^,444.p^\ V4rcW6S , 8:dWVS ,V9dNVS ,pWv8d*WS , ^,V^,V9d V^, pK/VPR4TpKjVPW,4V^, pKVPWR4RPV4#uupi)a@Blank runs of the submitted prompt that ``message`` quotes back: secret redaction is pattern-based and a provider 4xx echoing the request carries private prose matching no pattern. Any ``_TURN_PROMPT_ECHO_WINDOW``+ char run shared with the prompt (or its JSON-escaped form) becomes ````; shingles keep it linear.rNc3:<"TFpSWS,xK R#5irgr )r/iescapedwindows& rr1%_strip_prompt_echo..sX7W!f*-7Wrzr ry) r4rrz_TURN_PROMPT_ECHO_MAX_PROMPT_TURN_PROMPT_ECHO_WINDOWrrangerdumpsrrs) rQrTneedlerWshinglesoutnjrXrYs && @@r_strip_prompt_echordsl & XXc&k'') *+H,H IF %F 6{Vs7|f4.3CK&4H14L.MN.MqV$.MHNjj 2&G&XuS\F=RUV=V7WXXC c'lq 6z/ QZ H ,F A%GJN1q59XEQ JJz "A JJwz " FAJJwr{ 773<#OsF>c(V^8dQhRRRRRRRR/#)rrJrreasonrTr rr )rs"rrrs)!<!<!rNu…z failure_reason={}z cause=)rrmrKrOrJrP agent.redactrhrr4rzrdr_TURN_FAILURE_DETAIL_LIMITr)rJrfrT reason_textrQrhras&&& r_turn_failure_detailrms fll#))+K%++2$$&G%''11T%[11 ;#6't<hhw}}'G 1G 7|00556AHS  % %chh{/@/@/B&C DY[C 7GG;' ;; ;; #"#sE EEcV^8dQhRR/#)rr r1r )rs"rrrs000rc2\\4VRR7R#)zQPublish this module's helpers + handlers onto ``server``, rebound to its globals.)skipN)r)rglobals)servers&rregisterrss 6/r>r8 input_text output_text>imagerV input_image) reasoningreasoning_contentreasoning_detailscodex_reasoning_itemscodex_message_items>rrr(rrgr)4__doc__ __future__rre method_ctxragent.prompt_builderrcompilerrr$r9rFrP frozensetr_r`rarXrcrlrvrrrr{rrrrrrrrrrrr$r+r.r:r>rDrHrRrkr\r[rdrmrsr rrrsp# #3!jjx N x 4* /B EF !FG -!9:; " 33T3(@AKL MN )#=@_ vCH "Xp"BCMCdMCW[MC`"0 $<@ $$( $ $ $ **0!$