߲j$UdZddlmZddlZddlZddlZddlZddlZddlZddl m Z ddl m Z ddl mZmZmZmZddlmZmZddlmZdd lmZdd lmZdd lmZej:eZej@d d Z!de"d<dZ#dLdZ$ddddMdZ%dNdZ&dOdZ'dPdZ(dQdZ)dRdSdZ*ddddTdZ+e,hdZ-ddd d!Z.d"dd#Z/d$d%hZ0d&d'd(Z1dUd)Z2dVd*Z3dWd+Z4dXd,Z5dYd-Z6dZd.Z7d[d/Z8d\d0Z9d]d^d1Z:d_d2Z;d3Zdad6Z?d_d7Z@dRdbd8ZAdcd9ZB ddd:ZCdd; ded<ZD dfd=ZEdRdgd>ZFe,hd?ZGdhd@ZHdidAZIdjdBZJdkdCZKGdDdEZLdddddddF dldGZMdmdHZNdndodIZOgdJZPdRdodKZQy)puCodex API runtime — App Server and Responses-API streaming paths. Every entry point takes the parent AIAgent first: ``run_codex_app_server_turn`` drives one ``codex app-server`` subprocess turn; ``run_codex_stream`` runs one streaming Codex Responses call.) annotationsN)suppress)SimpleNamespace)AnyCallableDictList)claim_stream_writerstream_writer_is_current)HERMES_TOOLS_MCP_SERVER_NAME)bypass_sdk_request_transform)buffer_connect_exhausted_notice)set_usage_anchorcodex_watchdog_statedefaultz"contextvars.ContextVar[Any | None]_codex_watchdog_state_varg@c, ddlm}|jd}t|tr|jdnd}t|t t fr%t|tstdt |StS#t$rYtSwxYw)u``agent.stream_drain_timeout`` (seconds) — how long the post-terminal SSE drain may block. The drain is a courtesy to Relay's finalizer, never a correctness requirement: ``final`` is fully assembled before it starts. A relay that never closes the socket after ``response.completed`` would otherwise wedge the turn until the idle watchdog discards the already-billed response (#103864). ``0`` skips the drain entirely. r)load_config_readonlyagentstream_drain_timeoutNg) hermes_cli.configrget isinstancedictintfloatboolmax Exception_DEFAULT_STREAM_DRAIN_TIMEOUT)r agent_cfgvalues 8/home/ubuntu/.hermes/hermes-agent/agent/codex_runtime.py_stream_drain_timeoutr%s :(*..w7 9CIt9T 45Z^ ec5\ *:eT3JsE%L) ) )(   (( sA9B BBargskwargsct|y ||i|xsiy#t$rtj|g|ddiYywxYw)zVInvoke an optional display/debug callback; a buggy hook must never tear down the turn.Nexc_infoT)r loggerdebug)fnfail_msgr(r) fail_argss r$ _call_guardedr12sE z: D#V\r# : X9 9D9:s "77cd}g}|}t}|6t||vr(t|dkr|jt||j t |j |d}tt5tt|dddd}dddt|trt|jd}n&t|tttfr t|}|j duxr |j" }|r |j$n |j }|t||vrt|dkr|dj'|fS#1swYxYw)z(serialized request bytes, exception class chain); the buffered ``httpx.Request`` content on OpenAI connection errors gives the exact byte count without logging payloads or URLs.Nrequestcontentutf-8z <- )setidlenaddappendtype__name__rr getattrrstrencodebytes bytearray memoryview __cause____suppress_context__ __context__join)errorrequest_body_bytesexception_classescurrentseenr5implicit_chains r$_codex_request_failure_detailsrN<sC&*#%$)GUD  "W+T"9c$i!m G  g!7!78  %G)$ V!''9d"CYPTU V'3'%()@%A"GeY %CD%(\" **d2W7;W;W7W)7'%%W=N=N  "W+T"9c$i!m v{{+<= == V Vs EE&c Zddlm}ddlm}|j d}t |t s|Sttj|tjd}||jkr|Sgd}}|D]} t | tr%| j ddk(r| j d nd } t | trE|| d t| j d xsd ||j} | | k7r i| d | i|dz}} |j| |s*t j#d||||j d|Sttj|tjd} t j#d||||| |j di|d|iS)a)#95429 criterion 3: a reconnect after an attempt that produced no stream event must not resend a pathological payload unchanged. Inline ``function_call_output`` strings over the per-result threshold (results that escaped commit-time persistence) are spilled through the standard policy -- bounded preview + recoverable ```` reference -- and ONE log line records the size delta. When nothing is prunable the resend is logged as unchanged. The caller's kwargs are never mutated; only the retried wire payload changes.r)DEFAULT_BUDGET)maybe_persist_tool_resultinputrr6r<function_call_outputoutputNcodex_zero_event_retrycall_idcall)r5 tool_name tool_use_idconfig thresholdzCodex zero-event retry (attempt %s/%s): no prunable tool output; resending payload unchanged (serialized_input_bytes=%s, model=%s)modelzCodex zero-event retry (attempt %s/%s): spilled %d oversized tool output(s) before reconnect, serialized_input_bytes=%s -> %s (model=%s))tools.budget_configrPtools.tool_result_storagerQrrlistr9jsondumpsr?r@ turn_budgetrdefault_result_sizer;r,warning) api_kwargsattemptattemptsrPrQitemsbefore pruned_itemspruneditemrTreplacedafters r$_prune_zero_event_retry_payloadrpSs3C NN7 #E eT " E3/66w? @F +++q&L"'1$'=$((6BRVlBl(#rv fc "0Kc=@)ATA^X^=_8FR`RtRtvH6!;$;(;VaZfD!" IJQS[]ceoesest{e| ~  <5<>'*, 1j 0'< 00c<t|tryt|tr t|dSt|trtt|dSt|t r.t t5tt|dcdddSy#1swYyxYwNr)rrrrrr?r ValueError)r#s r$_coerce_usage_intruxs{%%5!}%3u:q!!% j ! &s5z1% & &  & s 2BBcV|jr |jsy |js|jddlm}|jj |jfd||i|y#t$r-}tj||jg||Yd}~yd}~wwxYw)zEnqueue per-call accounting for the SessionDB background writer. ``counts`` is built lazily inside the guarded try so a stub agent without a session DB is never touched.Nr)_agent_session_sourcesource) _session_db session_id_session_db_created_ensure_db_sessionagent.turn_usagerwqueue_token_countsr r,r-)rr/counts fail_extrarwexcs r$_queue_token_countsrs   %"2"2C((  $ $ &:,,,U-=-=oF[\aFboflfno C Xu//B*BcBBCsAA22 B(;#B##B(c bxjdz c_t|dd}tdd}fdt|tr|s[|t|ddr|j i|&t t|ddr|j td fd  iSd d lm }m }t|jd}|td t|jd|z t|jd|d t|jd|}|j} t|jdxs |j} dD cic]} | t|| c} | |j | d} |; |j | t|dd} t| t"r | d kDr| |_t|t,r'd dlm}m}|| |j |}| ||| j5D]%\}}t7d|td||z'|j8|j:j<tddj>tAj>nd}|xjB|z c_!jDjFc_$_%|jDjFdtd | fd! i| d"| iScc} w#t&$rt(j+ddYcwxYw)#aTranslate Codex app-server token usage into Hermes accounting. Prompt bucket = uncached + cached input (the protocol exposes no cache-write tokens); a turn with no usage still counts as one API call. ``messages`` (the transcript mirror) lets real usage anchor the next preflight: this runtime bypasses the main loop's capture, and the mirror is never compacted natively, so without an anchor the rough estimate grows monotonically and hermes-mode fires thread compaction on tiny threads (#100381).r\token_usage_lastNcontext_compressorc`tdjjjdd|S)Nr\)r]billing_providerbilling_base_urlapi_call_countr&)rr]providerbase_url)extrars r$billingz/_record_codex_app_server_usage..billings=D%++Y^YgYgxyD~CD Drq%awaiting_real_usage_after_compressionFnote_usage_less_responsez=Codex app-server api-call persistence failed (session=%s): %scdS)Nsubscription_included) billing_moder&)rsr$z0_record_codex_app_server_usage..s 7@W+Xrq)rr)CanonicalUsageestimate_usage_costcachedInputTokens inputTokens outputTokensreasoningOutputTokens) input_tokens output_tokenscache_read_tokenscache_write_tokensreasoning_tokens raw_usage totalTokens)rrrrr) prompt_tokenscompletion_tokens total_tokensmodel_context_windowz$codex app-server usage update failedTr+)capture_usage_anchorrsession_api_key)rrr)estimated_cost_usd cost_status cost_sourcezECodex app-server token persistence failed (session=%s, tokens=%d): %scHdidjdk(rdiSdiS)Nrincludedrr&)status)r cost_fields cost_result token_countssr$rz0_record_codex_app_server_usage..s@wsssGRGYGY]gGg,Csmqsrqlast_prompt_tokens)&session_api_callsr>rrupdate_from_responsecallablerragent.usage_pricingrrrurrrrrrcontext_lengthr r,r-r`agent.usage_anchorrrrisetattrr]rr amount_usdrsession_estimated_cost_usdrrxsession_cost_statussession_cost_source)rturnmessagesusage compressorrrrcanonical_usagerrf usage_dictcontext_windowrranchorkeyr#cost_usdrrrrs` @@@@r$_record_codex_app_server_usagers.  q  D,d 3E 4d;JD eT "%  !gj:ach&i  + +B /  !hwzC]_c/d&e  / / 1E#b#X Z G*%))4G*HI$-eii .FGJ[[\' .(AB+*5995L+MNZ_ O $11M$UYY}%=>^/B^B^LtvqAw22vL#0GdGd".@2>@J P  + +J 7$T+A4HN.#.>A3E,: )(D!M%m_5R5RT\]   UF + &&(S U#'(3%8H)IE)QRS% _u~~`ghmoxz|`}K1<0F0F0Ru[++,X\H ((H4(;F;M;M{OaOa8Eu8)1+BTBTepewewxK VXds Nj M. M MMCv P LL?$L O Ps$L:L L.-L.F) approx_tokensforcec&|st|ddsyt|ddxsdt|ddxsd}}tjdt|ddxsd ||||s/tt5d d lm}|j|dddt|d d}|t|d d dz|_|xsd |_ tt|dd}t|r ||dnt|drd|_ t|ddsd\|_|_d|_t#|dd|_t't|ddxsdddt|ddxsdt|ddxsddd| t|d d nd d||dfy#1swYxYw)uRecord a Codex-native compaction boundary: the app-server owns the compacted thread, so local transcript rows are NOT rewritten — only session event/usage counters. compactedF thread_idNrturn_idzKcodex app-server compaction observed: session=%s thread=%s turn=%s force=%srznoner)COMPACTION_STATUSrcompression_countr\record_completed_compaction) used_fallback$_verify_compaction_cleared_thresholdTr)revent_callbackz.event_callback error on codex session:compresszsession:compressplatformcodex_app_server)rrzold_session_idin_placerruntimerrr()r>r,inforr agent.conversation_compressionr _emit_statusrlast_compression_rough_tokensr<rhasattrrrlast_completion_tokensrr_last_compaction_in_placer1) rrrrrrrrrecord_boundarys r$#_record_codex_app_server_compactionrs {E: {D9?RyZ^A_AecewI KK]|T2BJ ;t/6OT LJ ):+L?CJ <UD!&+E#'%!148@DBr*")%T"B"HbX_`egsuyXzYAA(*ZdZp7:?RTU+Vvw!3)X_ - 5 2 2s ,FF> webSearch fileChange mcpToolCalldynamicToolCallcommandExecution exec_command apply_patch web_search)rrrexec)rrrrcommandquery)rrct|jdxsgDcgc]}t|ts|c}Scc}w)Nchanges)rrr)rmcs r$ _item_changesrs-+1r J!jD6IA JJ Js55c|jdxsd}|dk(r=|jdxsd|jdxsd}}|tk(r|Sd|d |S|d k(r|jdxsd Stj|xs|xsdS) zJSynthetic Hermes tool name for a codex item (mirrors CodexEventProjector).r<rrservermcptoolunknownzmcp..rdynamic)rr _STATIC_TOOL_NAMES)rm item_typerrs r$_codex_item_to_tool_namers &BIM!xx)2UDHHV4D4Q !==tYT&QRSWRXCYY%%xx,9,  ! !) , F FYFrqc|jdxsd}|dk(r+|jdxsd|jdxsddS|dk(rWdt|Dcgc]@}|jd xsijdxsd |jd xsdd Bc}iS|tvr+|jd xsi}t|tr|Sd |iS|dk(rd|jdxsdiSiScc}w)zSArgs dict for tool_progress_callback("tool.started"); mirrors the projector shapes.r<rrrcwd)rrrrkindupdatepath)rr argumentsrr)rr_MCP_LIKE_ITEM_TYPESrr)rmrrr(s r$_codex_item_to_argsrs  &BI&&88I.4"TXXe_=RPRSSL %24%8: !'(eeFm&9r%>%>v%F%R(\]\a\abh\i\omop:; ;((xx $*!$-tFK3FF1:k1IGTXXg&," -QrQ :sAC3cj|jdxsd}|tvr#|jt|xsdddxsdS|dk(rvt|Dcgc]%}|jds|jd'}}|r9dj|ddt |dkDrd t |dz d zSdzSdS|t vr_|jd xsi}t |tr:|r8ttt5tj|d ddcdddSycc}w#1swYyxYw)zXShort preview for the tool.started bubble; None when nothing useful (UI tolerates None).r<rNxrr, z, +z morerF ensure_ascii) r_PREVIEW_FIELDSrrGr9rrrr TypeErrorrtrarb)rmrrpathsr(s r$_codex_item_to_previewr-s( &BIO#34:DSAITIL (5d(;M1quuV}vMMch %)$s5zTU~#c%j1n-=U(C^r[]^rnrr((xx $* dD !d)Z0 Bzz$U;DSA B B N  B sD$*D$?D))D2c|jdxsd}|dk(rJ|jdxsd|jd}}t|duxr|dk7}|r d|d ||fS||fS|d k(r@|jd xsd }t|jd xsg}d|d|d|dvfS|dk(re|jdx}rdtj|ddddfS|jd}|tj|ddddfSddfS|dk(rh|jdxsg|jdd} } t | t xr| } | rtj| dddnd| t|  fSy) u(result_text, is_error) for a completed tool item — display-facing text for live tool cards (the persisted history keeps the projector's ``{exit_code, output}`` envelope instead).r<rraggregatedOutputexitCodeNrz[exit z] rrrrzapply_patch status=r z change(s)>appliedsuccess completedrrHz[error] Fr iTresultir contentItemsrzsuccess=)rF)rrr9rarbrr`) rmrout exit_codeis_errorrnrHr content_itemsr has_itemss r$_codex_item_completion_payloadr!=s &BI&&"45;TXXj=QY -@)q.A08& 3se,HLLcHLLL (#0y #)r *$VHBqcoooM!HHW% %5 %djjUCETJKLdR R(#AGAS 66u=^cccY[^ccc%%!%.!9!?R)UYAZw }d3E HQ =u=etDYabiajWkrvw~rn rqc*ddlm}|jdxsd}|jdxsd}d|jdxsd d |d |d j|}||xstj|||jd xsdS)zkDeterministic tool_call id mirroring CodexEventProjector (live TUI card correlates with projected history).r)_deterministic_call_idr<rrrmcp__rr__dyn_)rrr8)&agent.transports.codex_event_projectorr#r_STABLE_ID_PREFIXES)rmnamer#rrprefixs r$_stable_call_idr+UsM &BI 88F  (yD$TXXh%7%@5$AD6Jaefjek_l m q qr{ |F !&"T,?,C,CIt,TVZV^V^_cVdVjhj kkrqc i ddddfdd fd d fd dfd dfd dfd fd fd fd fd fdddfd }|S)aBuild the ``on_event`` callback for ``CodexAppServerSession(on_event=...)``. Tool items fire ``tool_progress_callback`` plus the stable-ID ``tool_start_callback`` / ``tool_complete_callback`` card hooks; deltas go to ``_fire_stream_delta`` / ``_fire_reasoning_delta``; a completed agentMessage goes to ``_emit_interim_assistant_message`` (the gateway's ``already_streamed`` check dedupes against streamed deltas). Every callback is guarded so a buggy display hook cannot tear down the turn loop.r&Nr'c>tt|d|g|||dy)Nr')r1r>)attrr/r(r)r0rs r$agent_cbz4make_codex_app_server_event_bridge..agent_cbis#geT40(aYaTZ`arqc |jdxsdt|}}t|}|r||tjf|<dd|d|t ||fdd|t ||||fy) Nr8rtool_progress_callbackz4tool_progress_callback raised on tool.started for %sz tool.startedrtool_start_callbackz!tool_start_callback raised for %s)rrrtime monotonicrr+)rmitem_idr)r(r/starteds r$_fire_tool_startedz>make_codex_app_server_event_bridge.._fire_tool_startedls,".Ft.L"4(  $dDNN,<=GG )+acg%t-CD-I4P R &(KT&tT2D$? Arqc t|}|jdxsdx}r j|dnd}|jd}t|tt fxr|dk\}|r|dz n|rt j|dz nd}t|\}} dd|d |ddf|||d  ||d n t|}  d d|t|||| |fy)Nr8r durationMsrg@@r1z6tool_progress_callback raised on tool.completed for %sztool.completed)durationrrr'r\tool_complete_callbackz$tool_complete_callback raised for %sr) rrpoprrrr3r4r!rr+) rmr)r5priorcodex_ms has_codex_msr;rrr(r/r6s r$_fire_tool_completedz@make_codex_app_server_event_bridge.._fire_tool_completedws'-:>((4.:NB/Nw/N GT*UY88L)!(S%L9Kh!m -96)_d@PSXYZS[@[jn9$?)+cei'tT:%-8vV X!,uQx2Ed2K)+QSW&tT2D$G Irqc|jdxs|jdxsd}t|tr|r||d|fyyy)Ndeltatextr raisedr)rrr?)paramsr.rDr/s r$ _fire_deltaz7make_codex_app_server_event_bridge.._fire_deltasOzz'">fjj&8>B dC T TdV7+4' :&* rqc|jdxsd}t|tr,|jrt ddrddd|df d_y) NrDrshow_commentaryT_emit_interim_assistant_messagez&_emit_interim_assistant_message raised assistant)roler5r)rrr?stripr> _current_streamed_assistant_text)rmrDrr/s r$_fire_agent_message_completedzImake_codex_app_server_event_bridge.._fire_agent_message_completedsYxx%2 dC TZZ\geEVX\6] 68`$/DAC E 24.rqc|jd}t|tsy|jdxsd}|tvr|r|y|y|r|dk(r |yyy)Nrmr<r agentMessage)rrr_CODEX_TOOL_ITEM_TYPES)rFrrmrrOrAr7s r$_on_itemz4make_codex_app_server_event_bridge.._on_itemshzz&!$% HHV$* . . FY ! M4F M 96 )$ /7Yrqc|dS)N_fire_stream_deltar&prGs r$rz4make_codex_app_server_event_bridge..s[.s+a9P*Qrqc|dSrYr&rVs r$rz4make_codex_app_server_event_bridge..sQ@W1Xrqc|dS)NFrr&rWrSs r$rz4make_codex_app_server_event_bridge..s(1">rqc|dS)NTr]r&r^s r$rz4make_codex_app_server_event_bridge..s\defrv\wrq)zitem/agentMessage/deltazitem/reasoning/deltazitem/reasoning/summaryDeltaz item/startedzitem/completedct|tr$j|jdxsdnd}|,|jd}|t|tr|niyy)NmethodrrF)rrr)notehandlerrFhandlerss r$on_eventz4make_codex_app_server_event_bridge..on_eventsWRw 3H@ Orqctt5|jjdddd|_y#1swYd|_yxYw)zRDrop the session so the next turn respawns codex instead of reusing a dead client.N)rr _codex_sessionclose)rs r$_close_codex_sessionrns< ) % ""$%E%Es ;A ct|xr t|dd}|r t|ddnd}|r|j||fS)z(user_interrupted, interrupt_message); clears the agent-level interrupt so a hard stop cannot poison the next turn (mirrors the conversation-loop finalizer)._interrupt_requestedF_interrupt_messageN)rr>clear_interrupt)ractive interruptedmessages r$_consume_user_interruptrvsJvO'%1G"OPKryrM)rdeveloper_instructionss r$_codex_developer_instructionsr|sI$U,CTJPbu/6"86"AEDaDa"a!h!h!j !!rqcodex_thread_idz6Codex thread could not be resumed; starting a new one.ct|ddt|dd}}||sy|j|t}t|tr|r|SdS)Nryrz)r>get_session_model_config_value_CODEX_THREAD_ID_KEYrr?)rdbrzrs r$_stored_codex_thread_idrsQUM48'%W[:\ B z11*>RSI"9c2y9JdJrqct|ddt|dd}}||syt|jd|t|ify)uhMerge (``None`` clears) the binding into the session row; a failed write only logs — the turn is done.ryNrzz6codex thread id could not be stored on the session rowr)r>r1patch_session_model_configr)rrrrzs r$_store_codex_thread_idrsJUM48'%W[:\ B z"//1i"%99$EFHrqc 6ddlm} |jjS#|$rq}tj d|j t|ddt|d|jt|jjcYd}~Sd}~wwxYw)a)``ensure_started`` with the fail-closed resume policy: a stored thread that codex cannot hand back (unknown id, rollout locked by a killed app-server, different thread) is dropped from the session row, the user is told once on the status rail, and a fresh thread starts on the same client.r)CodexThreadResumeErrorz,%s; starting a new codex thread (session=%s)rzN) )agent.transports.codex_app_server_sessionrrlensure_startedr,rerur>r_emit_diagnostic_status_CODEX_THREAD_RESUME_NOTICE)rrrs r$_start_codex_threadrsQ5##2244 !5Es{{T[\acoquTvwud+ %%&AB##2244 5s"BA&B BBc jt|}t|dd t|dd}|||k(ryt|t|dddn t|}ddlm}ddlm}m}ddl m }ddl m } d} tt5dd lm} | } dddd } dd lm} | } ||_ddlm}||xsd}d}t1t|ddxsdj3j5dk(r&ddlm}|t1t|ddxsd}|t|ddxst1|| || || | t;||xsd|r t|ddnd||| |_y#1swYxYw#t$rt&j)d d Y wxYw)aLazily spawn one CodexAppServerSession per AIAgent (reused across turns, closed by the _cleanup hook). A live session whose thread was started with a different prompt composition (TUI/Desktop ``/personality`` or a prompt mirror mutate the agent in place) is retired first so the new thread carries the current one. Only the FIRST session of an AIAgent resumes the stored codex thread: a retired/recreated one keeps today's fresh-thread behaviour and overwrites the binding once its turn is committed. ``messages`` is the turn's transcript (current user row last); a thread started from scratch is seeded with the prior turns.rlN_codex_session_promptr)resolve_agent_cwd)CodexAppServerSession_ServerRequestRouting)get_configured_codex_binary) load_config)_get_approval_callbackF)is_approval_bypass_activezLcodex app-server: approval-bypass lookup failed; keeping fail-closed defaultTr)render_history_seedrrcustom)codex_model_provider_idrequested_provider session_cwd)auto_approve_execauto_approve_apply_patchr]) rapproval_callback codex_binrequest_routingrer{r]model_providerresume_thread_id history_seed)r|r>rnragent.runtime_cwdrrrrhermes_cli.codex_runtime_switchrrrrr tools.terminal_toolrtools.approvalrr,r-r agent.codex_runtime_history_seedrr?rMlower"hermes_cli.runtime_provider_customrrjrl)rrr{recordedrrrrrrrrauto_approve_requestsrrrrrs r$_ensure_codex_sessionrs;5Au&-95"94@  x+AA U#&u.EtLXt^uv{^|3fK- ) 5>245 "t< 9 ;#9ED&x08DLN 75*b ) /R0668>>@HLN0WUDXZ\5]5cac1de0 E=$ / K37H7J3K_p-km<-@UqFG3E:5=/=geWd+4Xf) EA55 t cnr sts>F FF  F21F2c|jsyddlm}|j}t|dd}|d}|-|j ddk(r|j d|k(r|d d}|D] }||| t|d dyd} |j |}|dur!tjdt|dd|d uS#t $rtjd d YKwxYw)aSplice the projected messages into ``messages`` and flush them to the session DB; True when the rows are durable in the session DB (the codex thread binding may then be published). Bypasses conversation_loop's per-step _persist_session(); the flush dedups via _DB_PERSISTED_MARKER so only the new codex rows are written. The agent stays the sole persister (agent_persisted=True): a gateway re-write would re-INSERT the user turn.Fr)append_messagesubmitted_user_textNrLuserr5r\ryz/codex app-server projected-message flush failedTrucodex app-server turn was delivered but could NOT be persisted to the session DB (session=%s) — this turn will be missing after restart/resumerz) projected_messagesagent.message_metadatarr>r_flush_messages_to_session_dbr r,re) rrrrrrfirstprojected_messageflush_oks r$_persist_projected_messagesr6s  " "500"$(=tD q !E'EIIf,=,G )$(;;/3/4x!234umT*2HY66x@5YZabgiuw{Z| ~ t  YHSWXYsB<< CCc t|dd|jz|_t||t |||}d|j cxkxr|jkncxrd|j v}|rd|_|js<|j0tt|dddt||jd|  |jr>|js2|s|r.tt|d dd tt|||  |S)zPPost-turn bookkeeping mirroring the chat_completions loop; returns usage fields._iters_since_skillr)r skill_manageN_sync_external_memory_for_turnzexternal memory sync raisedF)original_user_messagefinal_responsertr)r)_spawn_background_reviewzbackground review spawn raised)messages_snapshot review_memory review_skills) r>tool_iterationsrrr_skill_nudge_intervalvalid_tool_namesrtrHr1r final_textr`)rrrrshould_review_memory usage_resultshould_review_skillss r$_finish_codex_turnrXs 'u.BAFI]I]]E't41%QL ; ;Wu?W?WWI .%2H2H H#$    2ge%EtLNktx"7eju}u   t//5IMage%?FHhqu"8nrrrrrlrun_turnr r, exceptionrn _turn_resultrvr?rtrerHrrrrrr) r user_messagerreffective_task_idrrrr interruptrs r$run_codex_app_server_turnrqs u7?4GF!#Z[ [%*  E"##,, ,E(t/?/?@It_e,JDJJWU##5$9'$P_afBgudnn5% tX5JauL 8 '(8H8H4H4_TZZ[_M_gkgqgqdnnlplxlx    )  78U# #E *HUZ]^aZb;C5@z{   s'D88 FAF F Fc <|\}}||||| |d|rd|inid|i|S)zVResult shape shared with the chat_completions path (``partial`` == ``not completed``).)rrrrpartialrtinterrupt_messagerHr&) rrrrrHrruser_interruptedrs r$rrsW+4''(hYy=IY 8I !2 3b      rqcpt||d}|"t|tr|j||}||S|S)zKField access for attr-style (SDK objects) and dict (raw JSON) events/items.N)r>rrr)eventr)rr#s r$ _event_fieldrs> E4 &E }E40 $(%5272rq>response.text.deltaresponse.audio.deltaresponse.output_text.deltaresponse.reasoning_text.delta%response.reasoning_summary_text.delta&response.function_call_arguments.deltaresponse.refusal.deltact|d}|tvrtt|dS|dk(r=t|ddttdxsdvxrt fddDSy ) zWhether a Codex Responses event carries substantive forward progress. Lifecycle/keepalive frames and empty structural deltas prove transport liveness, but do not mean the model has begun producing its response. r<rCresponse.output_item.addedrm function_callrc3HK|]}tt|ywN)rr).0fieldrms r$ z+_codex_event_has_content..s&Pa05DdE* +Pas")r8rVr)rF)r_CODEX_PROGRESS_DELTA_TYPESrr?any)r event_typerms @r$_codex_event_has_contentrs eV,J00L01111E6*#l4&@&FB"GGaCPa9_PaMa a rqcddlm}tdd fd }|d}| t|ndj xsd}|||d|d ) zRaise ``_StreamErrorEvent`` from a ``type=error`` SSE frame. The spec puts code/message/param at the top level, but the SDK and several proxies nest them under ``error``; read top-level first, then the envelope.r)_StreamErrorEventrHc@t|}| t|S|Sr)r)r)r#rnesteds r$ _error_fieldz)_raise_stream_error.._error_fields+UD)-2]v?Q|FD)\W\\rqruzstream emitted error eventcodeparam)rr)r)r?rhr) run_agentrrr?rM)rrr raw_messagerurs` @r$_raise_stream_errorrsh, % )F]y)K#.#:s;@\cceFjFG G,v*>lSZF[ \\rqc|t|dd}t|tr|jj SdS)Nphase)rrr?rMr)rmrs r$_message_phasers3 w -E$.uc$:5;;=   DDrqct|dg}t|tr|ng}djd|Dj S)zSConcatenated ``output_text`` parts of a message item ("" if content is not a list).r5rc3rK|]/}t|dddk(stt|ddxsd1yw)r<r output_textrDN)rr?)rparts r$rz"_output_text_of..s<6:|TXZ`bdGeivGvLvr * 0b1s77)rrr`rGrM)rm content_partspartss r$_output_text_ofrsE y"5M' tC  egrqceZdZUdZdxZxZZdZdZde d<dZ de d<d Z d e d <dxZ xZ xZZdZd Zdd ZddZddZddZddZddZddZddZdeeeeeedZdefdefdeffZd dZd!dZd"dZy)#_CodexResponseAssembleruAssemble a Response-shaped ``SimpleNamespace`` from raw Responses SSE events. Only ``usage`` / ``status`` / ``id`` are read from the terminal frame — never ``response.output``. Output items come from ``output_item.done``, or are synthesized from text deltas, or settled from function calls announced via ``output_item.added`` but never confirmed (some backends omit per-item done events on success).FrN str | Noneactive_message_phaseractive_summary_indexrr?terminal_statusc|||c|_|_|_||c|_|_g|_ggc|_|_ggc|_|_ i|_ i|_ yr) r] on_text_deltaon_reasoning_deltaon_commentary_messageon_first_delta output_itemsoutput_indexesoutput_sequences text_deltascommentary_text_deltaspending_function_callsannounced_output_order)selfr]rrrrs r$__init__z _CodexResponseAssembler.__init__spBGXj? D&(?:OQ_7"D$7')682T28:B5$5BD#8:#rqc(t|d|d|y)Nz Codex stream rEr)r1)rcblabelr(s r$_safez_CodexResponseAssembler._safesbM%8tDrqct|d}t|dd}|dk(r t|nd|_|jdk(rg|_t t|dd}|rH||j vr:|j t|df|j |<|xj dz c_d t |vrId |_|r?|j |\}}|t t|d dxsd||d |j|<yyy) Nrmr<rru commentaryr8 output_indexr\rTr)rmrr!sequence) rrr rr?rnext_output_sequencehas_tool_callsr)rrrrmrr5announced_sequenceannounced_indexs r$_on_item_addedz&_CodexResponseAssembler._on_item_added s E6* vr2 }s 1DU1Krq)rHrzresponse.output_item.donerDrArCrc d|vS)Nzoutput_text.deltar&ts r$rz _CodexResponseAssembler.s &!+rqc d|vS)Nrr&rQs r$rz _CodexResponseAssembler.s \]I]rqcd|vxrd|vS)N reasoningrCr&rQs r$rz _CodexResponseAssembler.s;!#41 rqct|ddttrnd|jj xst fd|j Dd}|t|||SdS)z=Process one event; True when the stream hit a terminal frame.r<rc3:K|]\}}|s|ywrr&)rmhrs r$rz/_CodexResponseAssembler.feed..s?tdafghrfs?tsNF)rrr?_EXACT_HANDLERSrnext_FUZZY_HANDLERSr)rrrcrs @r$feedz_CodexResponseAssembler.feedso!%4 #-j##>ZB &&**:6{$?tdNbNb?tvz:{9@9LtGD%45WRWWrqcztt|j|j|j}|j j D]v}|d}|j|jd|dtdt|ddt|ddt|ddd |d xsd jxsd fxtd|Dr,tt5|jddddn|jd|Dcgc]}|d c}S#1swYxYwcc}w)zCMerge .done items with settled pending calls, keeping stream order.rmr!r"rr8NrVr)rrrz{})r<r8rVr)rrc3*K|] }|ddu yw)rNr&)rentrys r$rz:_CodexResponseAssembler._settled_output..s9uQxt#9sc |dSrsr&r`s r$rz9_CodexResponseAssembler._settled_output..s uQxrq)rc |dS)Nr\r&rbs r$rz9_CodexResponseAssembler._settled_output..s 58rqr:)r`ziprrrrvaluesr;rrrrMallrrsort)rindexedr2rmr`s r$_settled_outputz'_CodexResponseAssembler._settled_outputs,s4..0E0EtGXGXYZ2299; G6?D NNGKK79Lo$dD$)GQ]^bdmosQt!$5k#;/52<<>F$ O   99 9)$ 9 !7 8 9 9 LL3L 4&-.Ua..  9 9/s)D, D8,D5c  t|j}|sO|jrC|js7t ddj |jg}t ddd|g}|j r|jr|j}|js |s tdt |dj |j|j|j|j|j|j|j S) Nrr)r<rDrurKr)r<rLrr5z7Codex Responses stream did not emit a terminal response)rTrrrr8r]rBrH)r`rrr$rrGrrJrirE RuntimeErrorrFr rGr]rHrI)rrTr5s r$rz_CodexResponseAssembler.results !2!23$**43F3F&MHXHX@YZ[G%9;{dklmF  & &4+F+F))+F  XY Yrwwt/?/?'@H[H[dhdxdx(( tOoOo%%' 'rq)rCallable | Nonerr?r(rrhri)rrrr?rhri)rrrr?rhrrrrhr)rhz List[Any])rhr)r= __module__ __qualname____doc__r$r*rEr#r __annotations__r r rFrGrHrIrJrrr'r,r/r4r8r>rNrZr\r]rirr&rqr$rrsu 9>=N=&'+*+ $#$&OS&[__N_)_,G." ;E*H,2 6 R-*&L&4S`*q 46IJO X/('rqr)rrrrreinterrupt_checkc&t|||||}|D]8} | || ||s|j | s)|jS|jS#ttf$rt$rtj ddYnwxYw)a;Consume a Codex Responses SSE stream into a Response-shaped ``SimpleNamespace`` (see :class:`_CodexResponseAssembler`; ``status`` is ``completed`` when the stream ended with content but no terminal frame; ``model`` comes from kwargs). Callbacks: ``on_text_delta`` per output_text delta, suppressed once a function_call is seen; ``on_reasoning_delta`` for reasoning and ``phase=analysis`` deltas (also commentary without a commentary callback); ``on_commentary_message`` once per completed ``phase=commentary`` message, before any following tool item; ``on_first_delta`` one-shot; ``on_event`` every event before any processing; ``interrupt_check()`` True breaks the loop and may raise ``TimeoutError`` / ``InterruptedError`` for request retirement that must not become a partial final response.)r]rrrrz!Codex stream on_event hook raisedTr)r TimeoutErrorInterruptedErrorr r,r-r]r) event_iterr]rrrrrerr assemblerrs r$_consume_codex_event_streamrxs(e=ew>SdrtI    Q  'O,=)..QVBW           !"23  Q @4 P QsA/BBc *t|}t|dd}t|rt|s|Sd|vrdgng}|j dd|j d}t |trXd|vrT|jDcic]\}}|dk7s ||c}}|d<|ds|j d|jd|rAtjd|j dt|ddd j||Scc}}w) aDrop fields the ChatGPT OAuth Codex endpoint rejects, at the final wire boundary (after Relay / middleware / ``request_overrides``): a late ``prompt_cache_retention``, top-level or nested in ``extra_body``, would otherwise HTTP 400 a valid follow-up._is_codex_backendNprompt_cache_retentionz top-level extra_bodyz^Dropped unsupported prompt_cache_retention at consumer Codex wire boundary (model=%s, via %s).r]rr ) rr>rrr=rrrir;r,rerG)rr4 sanitizedbackend_predicate dropped_fromr|kvs r$ _sanitize_consumer_codex_requestrs W I':DA & 'D1B1D,E$< $IK=rL MM*D1|,J*d#(@J(N4>4D4D4F"hDAq!OgJg1a4"h ,& MM, 'L)w }}WgeWi.PQSWS\S\]iSj l #is DDc  !"ddl}ddlmddlm}|j |j |j|jtf xsjddjdcg_ tj!! !jn td dddd d "d7fd d7"fd d8fd }d9fd }d:fd }d;!fd } d7fd } d<fd } d="fd d>"fd } d? "fd } d?fd tdd}tddduxr|}|r|j nd}tdd rdn t#tddxsddkDrdnd}t%dzD]s t'd j(r t+d!dkDr||||nd|| | 0}j(s| ||jRd4vr`t@jUd5|jR|jV|jXt[d6jDjE||cSy#1swYkxYw# $rg}k\r |t@jC|d1nd2dzdzjE|stGdzdzYd}~|Cd}~wtH$r(|$|jJ|jJcY|cS$rs}kr`"d"[tM|jN|jPr;t@jCd3dzdzjE|Yd}~||d}~wwxYw#|wxYw)@zVOne streaming Responses API request over raw ``responses.create(stream=True)`` events.rN)APIConnectionError) relay_llmcodex_stream_directreasonr\r]"_active_codex_stream_request_tokenF)r# raw_streamsuperseded_loggedc.duxstdduS)Nr)r>)r request_tokensr$_request_is_currentz-run_codex_stream.._request_is_currents$$s7[]a(bfs(ssrqcd}| t|ryds+dd<tjdjddy)Nr#TrzCodex streaming attempt superseded by a newer stream; suppressing its live deltas while consuming to completion so the final response is not truncated (model=%s).r]rF)r r,rer)tokenrrf writer_tokens r$_writer_is_currentz,run_codex_stream.._writer_is_currentsXW% =4UEB/004L, - NNh%>>'9= ?rqcfdS)zIWrap a callback so a retired request's late frames never reach the agent.c&r|SdSrr&)r#rr.s r$rz3run_codex_stream.._fenced..s*=*?RYTrqr&)r.rs`r$_fencedz!run_codex_stream.._fenceds IIrqcfdS)ziWrap a live-display callback so a superseded writer's frames never reach the sink (retired ones neither).c.r r|SdSrr&)r(rrr.s r$rz1run_codex_stream.._live..s*=*?DVDXRY^brqr&)r.rrs`r$_livezrun_codex_stream.._lives bbrqcnjj|rj|yyr)_codex_streamed_text_partsr;rU)rDrrs r$r,z(run_codex_stream.._on_text_deltas0 ((//5    $ $T * rqc(tj}tdd|_t|}?j5j d_d_|_|r|_dddjdy#1swYxYw)N_last_api_first_chunk_atzreceiving stream response) r3r>rrlockretry_started_tslast_progress_ts last_event_ts_touch_activity)rnow has_progressrwatchdog_states r$ _on_eventz#run_codex_stream.._on_eventsiik 54d ; C-0E */6  %$$ :!22>6:N36:N3/2,69N3  : 9: : :s +BBcRs tdtjS)Nz?Codex Responses stream request retired before terminal response)rtrrp)rrsr$_interrupt_or_supersededz2run_codex_stream.._interrupt_or_superseded/s(#$`a aE..//rqc ddlm}|tddttddxsdr t dt |}d|d<j jd it|S) Nr)is_actual_routerrrzFActual requests require Chat Completions; refusing to call /responses.Tstreamr&) hermes_cli.providersrr>r?rtr responsescreater )next_api_kwargsr stream_kwargs active_clientrs r$_open_codex_streamz,run_codex_stream.._open_codex_stream6s|8  E:r *  z26<" = X 9P "& h-}&&--\0L]0[\\rqc &t|\}}tjd|dn|tdduj |t dddzddzd-t |dzt ddxs t dd yy) NzxCodex Responses request failed: serialized_request_body_bytes=%s stream_opened=%s exception_chain=%s model=%s attempt=%srr#r]r\/rr)rhr)rNr,rer?rr>r)rrIexception_chainrrrgmax_stream_retriesrs r$ _log_failurez&run_codex_stream.._log_failureDs.LS.Q+O@N`NhoA<0<=CCEX_`egnpyXz!A+a(:Q(>'?@ B  ( +sWq[  DAcWUT^`bEc e )rqc,td<|d<y)Nr#r)r ) _raw_streamrrs r$_codex_stream_createdz/run_codex_stream.._codex_stream_createdPs 3E : W%0 \"rqcpt}|dkrytjd fd }tj|ddj j |ryt jd|j jd}| |ur|y) NrcD D]} j y#g$rC}t|s|tjdj|Yd}~Yd}~wt$rtj ddY~wxYw#j wxYw)NzCodex Responses stream transport finalization failed after a terminal response was already received; returning the completed response instead of retrying. %s error=%szDCodex Responses stream finalization failed after a terminal responseTr)rr,re_client_log_contextr r-r7)_ignoredr_APIConnectionErrorrrdrained event_streamtransport_errorss r$_drainz>run_codex_stream.._drain_for_finalizer.._drain]s  ,H <%;':; A!#'78 % m$88:CAA t cnr s t s7B B 9A$B $#B B B  B Bzcodex-post-terminal-drainT)targetr)daemonzCodex Responses stream remained open %.1fs after a terminal response (agent.stream_drain_timeout); closing it and returning the completed response instead of retrying. %srrhri) r% threadingEventThreadstartwaitr,rerr) rbudgetrrrr_close_event_streamrrrrs ` @r$_drain_for_finalizerz.run_codex_stream.._drain_for_finalizerUs'( Q; //#   -HQUV\\^ <<   V E--/ "%%l3  !j &D  +L)rqct|dd} t|r|yy#t$rjdYyYywxYw)Nrmcodex_stream_close_failedr)r>rr _abort_request_openai_client)rclose_fnrrclients r$rz-run_codex_stream.._close_event_stream{s[<$7 f! " f!22=Id2e"  fs$AArITinterim_assistant_callback is_subagent delegated_fallback_indexfallbackprimaryz3Codex Responses stream request retired before retryz+Agent interrupted before Codex stream retryr#rrrzrrcodexc0ttS)N)r])rxr`)intercepted_eventsr]sr$rz"run_codex_stream..s&A$GYBZbg&hrqc|Srr&)chunks r$rz"run_codex_stream..srqcJtt|dxr t|d S)NrT__iter__)rr)rs r$rz"run_codex_stream..s$48@T@s]defhr]sYs;trqcodex_responses_current_api_request_id)api_mode call_role retry_countapi_request_id) rzr) model_name finalizeron_stream_createdon_chunk chunk_adaptercompleted_response_predicatemetadatadefer_logical_completion)r]rrrrrerrzLCodex Responses stream connect failed (attempt %s/%s); retrying. %s error=%sz\Codex Responses stream transport failed mid-iteration (attempt %s/%s); retrying. %s error=%szPCodex Responses pre-stream connect failed (attempt %s/%s); retrying. %s error=%s>failed incompletezbCodex Responses stream terminal status=%s (incomplete_details=%s, error=%s, streamed_chars=%d). %sc32K|]}t|ywr)r9)rrWs r$rz#run_codex_stream..s"Ta3q6"Ts)rhr)r.Callable[[Any], None]rhr)r.Callable[..., None]rhr)rDr?rhrirrrhri)rdict[str, Any])r BaseExceptionrhri)rrrhri)rrrhri).httpxopenairrrRemoteProtocolError ReadTimeout ReadError ConnectErrorConnectionError_ensure_primary_openai_clientrrrrr>_fire_streamed_codex_commentaryrrangertrpru phase_awarerr3rrrr?r;rxrZr,r-rrprkrrrDTransportErrorrrerBrHsum)#rrfrr_httpxrrrr,rrrrrrIwants_commentaryrrrfinalrrrrrrrrgrrr]rrrrs#``` @@@@@@@@@@@@@@r$run_codex_streamrs@22F4F4FHXHXZ`ZmZmo~_eAAI^A_M !:>>'#:-/E$/224N  %  U@$ G"ERLt Jc+ ;$0 ] e e1 $*$*L fe%6=Ou&BDIQUUiZiL\E%"G"GHbf '}e D$'7H!(L(QPQ$RUV$Vj\e+a/0I."$TU U  % %"#PQ Q Q;>5.:T:T $$ >26))+/ >#%LPP WP \ :\,1 ()< .1 (//$&8"75,#C#IrJWUJ;FwGTWX]XcacTdh&;FXF_F_"51t*;)dk07?XZ^0_a-1 0  4 W^=T',U-H-H'Iav >2$ 00 % frfzbwaK!3a!79R9R9TVY *!@WWX[ZlopZp!qJ: -9  + 0K0K0W'6662 -1&  00\'5J5R&s}}f6K6KLLLj! %7!%;U=V=V=XZ] -S! . -sdMBrs=A#   !,,TQC=/   8 $@V @V@VDA=!$)&VXos:>."1J   CCNLUYhm#X##tu+9 dpq+1O%'89'0wGKG R  0lRp  ")VKH 5=@D-16D4TY'14'LP']k'T  -0 ;> CQ $3()  ]E J'J'\374gk$":0j.Z  >rq