+ iHj/o Rt^RIHt^RIt^RIt^RIt^RIt^RIt^RIt^RI t ^RI t ^RI t ^RI t ^RI t ^RIHt^RIHt^RIHtHtHt^RIHtHt^RIHtHt^RIHtHtHtH t ^R I!H"t"^R I#H$t$^R I%H&t&H't'^R I(H)t)^R I*H+t+^RI,H-t-H.t.^RI/H0t0^RI1H2t2^RI3H4t4^RI5H6t6^RI7H8t8^RI9H:t:H;t;HH?t?H@t@HAtAHBtCHDtDHEtE^RIFHGtGHHtHHItI^RIJHKtKHLtL^RIMHNtNHOtO^RIPHQtQHRtR^RISHTtT^RIUHVtVHWtWHXtXHYtY]P!][4t\0ERmt]RR0t^0ERmt_Rt`RtaR tbR!tcR"R#ltdR$te!R%R&]f4tgR'R(lthR)R*ltiR+R,ltjR-R.ltkR/R0ltlR1R/R2R3lltmR4R5ltnR1R/R6R7lltoR8R9ltpR:R;ltqR1R/R<R=lltr]s!0ERm4ttR>R?ltuR@RAltvRBRCltwRDREltxRFRGltyRHRIltzRJRKlt{RLRMlt|RNROlt}RPRQlt~RRRSltRTRUltRVRWltRXRYltRZtR[R\ltR]R^R_R/R`RalltRbRcltRdReltRfRgltRhRiltRjRkltRlRmltRnRoltRpRqltRrRsltRtRultRvRwltRxR/RyRzlltR{R|ltR}R~ltRtRRltRRlt!RR4tRRlt!RR4tRtRtRRlt]!RR44tRRltRRltRRltRRltRtRtRtRtRtRtRtERRRlltERRRlltRtRtRRltRtRRltRRltRRltRRltRRlt/]EPhRb]EPjRb]EPlRb]EPnRb]EPpRb]EPrRb]EPtRb]EPvRb]EPxRb]EPzRb]EP|Rb]EP~Rb]EPRb]EPRb]EPRb]EPRb]EPRb]EPR]EPR]EPR]EPR]EPR]EPR]EPR/CtRRltRRltRRltRRltRRltRRltRRltRRltRRltRRltRRltRRltRRltERRRllt]:0ERm,tRtRRltRRltRRltRRltRRltRRltR]R]/tRRltRRltRRRR^RRRR^/RltERtRRltRERltERERltERERltERERltERERltER ER ltER tER ER ltERt!ERER4t!ERER]+4tERR/ERERllt.EROtR#(aAPI-call helpers extracted from :class:`AIAgent`: non-streaming and streaming request drivers, request kwargs builder, assistant-message materializer, provider-fallback activator, max-iterations handler, per-turn resource cleanup. Each function takes the parent ``AIAgent`` as ``agent``; AIAgent keeps thin forwarders. Symbols tests patch on ``run_agent`` (``cleanup_vm`` / ``cleanup_browser``) are resolved through :func:`_ra` at call time. ) annotationsN) dataclass)SimpleNamespace)AnyDictOptional)get_provider_request_timeoutget_provider_stale_timeout)PARTIAL_STREAM_STUB_IDFINISH_REASON_LENGTH)FailoverReason&PROVIDER_STREAM_EMPTY_FRAME_ERROR_CODE#PROVIDER_STREAM_NON_JSON_ERROR_CODE_extract_status_code)!bypass_chat_sdk_request_transform)EmptyStreamError)_streams_llamacpp stale_giveup)"_chat_completion_capturing_headers)StreamingWaitMonitor)is_router_timeout_shimrouter_timeout_shim_may_follow)effective_request_overrides)substitute_api_content)is_native_gemini_base_url)is_local_endpoint)flatten_message_text)PERSISTENCE_ONLY_MESSAGE_FIELDSappend_messagedata_use_requirementstamp_message_timestamp)_sanitize_messages_surrogates_sanitize_surrogates_repair_tool_call_argumentsnormalize_finish_reasonsanitize_outbound_kwargs strip_images_for_rejecting_model) append_streamed_reasoning_detailseparate_glued_reasoning_blocksstreamed_reasoning_detail_text)prompt_progresswith_prompt_progress)RunawayStreamWatchis_repetition_dominated)claim_stream_writerstream_writer_is_current)is_persistent_env)base_url_host_matchesbase_url_hostname env_floatenv_interror error_finishig@N@c>aa\P!4oVV3Rl#)z=Bind a no-argument thread target to the caller's ContextVars.c&<SPS4#N)runcallbackcontextsB/home/ubuntu/.hermes/hermes-agent/agent/chat_completion_helpers.py(_context_thread_target..Qs7;;x() contextvars copy_contextr<sf@r?_context_thread_targetrENs&&(G ((rBc V^8dQhRRRR/#)labelstrreturnNone)formats"r? __annotate__rNTs``c`d`rBc^RIHpVPRR7pVeVP4'gR#TP RR7TP 4'd\PRT4R#R# \dR#i;i)u*Bounded worker join before raising InterruptedError (#81521). Raising immediately lets turn teardown race a still-open Relay LLM scope and corrupt the LIFO stack (CLI EIO / redraw storm). Only joins when Relay managed execution is live — otherwise the join would just delay interrupt detection. ) relay_runtimeF)createN@timeoutz%s worker still alive after interrupt abort (2.0s join timeout); Relay teardown will best-effort drain orphaned scopes (#81521).) agentrP get_runtimemanaged_execution_enabled Exceptionjoinis_aliveloggerwarning)workerrHrPruntimes&$ r?_join_worker_for_relay_teardownr_Ts'++5+9 ?'"C"C"E"E #F KKK XY^ ` s1A99 BBc^RIpV#)zQLazy ``run_agent`` reference so ``patch("run_agent.cleanup_vm")`` etc. intercept.N run_agentras r?_rarchs  rBcFa]tRt^ntRtRR/RV3RllltRRltRtV;t#) ProviderStreamErrorzKProvider encoded an API error as streaming content instead of an SDK error.headersNc(V^8dQhRRRRRRRR/#) rG status_code Optional[int]bodydictraw_textrIrfrrL)rMs"r?rN ProviderStreamError.__annotate__qs)11}1D1C1Z]1rBc <WnW nW0n\T;'g/R7Vn\ SV`VP44R#))rfN)rhrjrlrresponsesuper__init___format_message)selfrhrjrlrf __class__s&$$$$r?rqProviderStreamError.__init__qs;&  ' 2>  --/0rBcV^8dQhRR/#rGrJrIrL)rMs"r?rNrmxs   rBc \VP\4'dVPPR/4M/p\V\4'g/pR.pVP'dVP RVP 24VPR4'd"VP \ VR,44RPV4pVPR4'dVRVR, 2, pV#)r5z'Provider stream returned an error eventzHTTP codez - message: ) isinstancerjrkgetrhappendrIrY)rs error_objpartstexts& r?rr#ProviderStreamError._format_messagexs2,_status_code_from_payload..se4dq)--**4ds!ry)rhstatus http_status)rhrrry)r|rkr}extendr~r)rr candidates candidaterhrs& @r?_status_code_from_payloadrs gt $ $*RS*RQ++a.*RJS G$I)T""e4deegkk&)* -i8  "   TsB9c V^8dQhRRRR/#)rGrrIrJzOptional[dict]rL)rMs"r?rNrNsrBczT;'gRP4p\P!\P\ 4;_uu_4VP R4'd;\P!V4p\V\4'dTMRuuRRR4#RRR4R# +'giR#;i){N) strip contextlibsuppressjsonJSONDecodeError TypeError startswithloadsr|rk)rstrippeddecodeds& r?_json_object_from_textrs !!#H   T119 = =   s # #jj*G($777T > = # >  > = s AB)) B: c V^8dQhRRRR/#)rGrrIrJz list[dict]rL)rMs"r?rNrNs..S.Z.rBcaa.oRRR.R.R//oVV3RlpT;'gRP4EF*pVPR4pVR8Xd V!4K%VPR 4'd0SR,PVR ,P 44KkVP R 4wrEpV'g+RSR,VP 4P 4&KVP 4P 4pVPR 4pVR8XdVP 4SR&KVR8XdSR,PV4EKVSR,V&EK- V!4S#) z7Parse provider text that looks like Server-Sent Events.eventNdatacommentsfieldsc<\SP44'd\SR,4RUu.uF#pVSR,9gKSR,V,NK% up,pSPRSR,RRP SR,4R\SR,4R\ SR,4R\ R\\V44R4/4RRR.R.R//oR#uupi) rrhrrr c30"TF qfKVxK R#5ir:rL)rss& r?rE_parse_provider_sse_events.._flush_current..sa O1QQ O N)rrhr) anyvalueslistr~rYrknextmapr)keystatus_candidatescurrenteventss r?_flush_current2_parse_provider_sse_events.._flush_currents w~~ $WZ%8 9C=CC'(++'!#&&C=!  MM) '&/2D!45$wx01ta$;=N Oacg i  D&"j"hK=s C+ C+r ::NN ) splitlinesrstriprr~r partitionlower removeprefix) rrraw_linelinefieldseprrrs & @@r?_parse_provider_sse_eventsrs5Ffb*b(BGGL$ZZR++-t$ 2:    ??3   J  & &tBx~~'7 8  NN3/E79GH ekkm113 4  ##%""3' G ${{}GG  f_ FO " "5 )',GH e $)., MrBc$V^8dQhRRRRRR/#)rGrrkrhrirJrL)rMs"r?rNrNs!''$']'t'rBcv\V\4'g/pM'\VPR4\4'dV#VPR4;'gBVPR4;'g)VPR4;'gV'dRV 2MRpVPR4;'g5VPR4;'gVPR4;'gR pR\V4/pV'd\V4VR&R F&pVPV4'gKW,WE&K( RV/#) zDNormalize common provider error payloads to OpenAI-style body.error.r5ry error_codetypeHTTP_provider_stream_errorrzerror_descriptionz(Provider stream returned an error event.) request_idparamr)r|rkr}rI)rrhryrznormalized_errorrs&& r?_provider_error_bodyrs& gt $ $ GKK($ / / KK  S S7;;|#< S S F@S S S)4% }%:Q {{9%==5H)I==W[[Y`Ma==< !3w<0 #&t9 . ;;s  $+L  !/ % &&rBroc$V^8dQhRRRRRR/#)rGr5zjson.JSONDecodeErrorrorrJrerL)rMs"r?rNrNs$%%9M%%0%rBc p^RIHp\\VRR4;'gR4P 4pVe\VRR4MRpV'g"\ R\ R\RR/R4RVR 7#V!\V4R R 7pVR\p\ R\ R\RT;'gR /R4VVR 7#) uPreserve plain-text SSE data rejected inside the OpenAI SDK: on a non-JSON ``event: error`` the SDK raises from ``sse.json()`` before yielding a chunk, but ``JSONDecodeError.doc`` still carries the provider's original message. An EMPTY ``doc`` is the other case: the frame carried no payload at all (``data:`` / ``event: ping`` / ``id:`` alone — legal SSE keepalives and no-ops), which the SDK's ``json.loads`` rejects the same way. A gateway that is degrading answers EVERY streaming request with such frames, so this is not the provider's malformed payload and must not be reported as one: it gets its own code and the stream helper recovers by retrying without streaming.redact_sensitive_textdocrNrfryrzzMProvider stream returned an empty SSE data frame (keepalive with no payload).rhrjrlrfT)forcez+Provider stream returned non-JSON SSE data.) agent.redactrrIgetattrrrerr r"!_PROVIDER_STREAM_ERROR_TEXT_LIMITr)r5rorrlrf safe_texts&$ r?-_provider_stream_error_from_json_decode_errorrs375%,22399;H4<4Hgh 40dG "%?np   &&:8&DDQI<<=I  ! 89UU(U W    rBc V^8dQhRRRR/#rGexc BaseExceptionrJboolrL)rMs"r?rNrNskk}kkrBc\VRR4p\V\4'dVPR4MRp\V\4;'dVPR4\8H#)zTrue for the translated contentless-SSE-frame error. Re-streaming cannot help (a degraded gateway answers every stream that way), so the caller must change channel.rjNr5ry)rr|rkr}r )rrjrs& r?%_is_provider_stream_empty_frame_errorrsR 3 %D%/d%;%;!I i & j j9==+@Dj+jjrBcV^8dQhRR/#)rGrorrL)rMs"r?rNrNshhchrBc#"TRjxL R#L \Pd>p\T4'dT!4MTpTf\TRR4p\ Y#R7ThRp?ii;i5i)zAYield SDK chunks while translating SDK-level SSE decode failures.Nroro)rrcallablerr)streamror5stream_responses&$ r?_iter_provider_stream_chunksrs`h   h(0(:(:(*  "%fj$?O;E\bgg hs0A'A'A$8AA$$A'c V^8dQhRRRR/#)rGrrrJrrL)rMs"r?rNrN(sllcldlrBc`\V\4'gR#\VPR4\\34'dR#\ VPR44;'dI\ VPR4;'g'VPR4;'g\ V4RJ4#)Fr5TrzryrN)r|rkr}rIrr)rs&r?_payload_has_error_shaper(s gt $ $'++g&s 44  I& ' l lD Fjjw{{<8jj.Js"&[>Y  , ,>Ys )rr) lstriprendswith enumeraterrrrr_PROVIDER_STREAM_SSE_FIELDSlenr) rrlinestrailing_newline saw_sse_fieldindexrrrr_valueis_last_incompleters & @r? _provider_stream_text_may_be_sser1s ""$H     !E((6M$U+t$ 2:  ??3   M !^^C0F[[]((* :!<< M "c%j1n4MM=M9M ##&[>Y&[###&[>Y&[#[#[%,( rBc(V^8dQhRRRRRRRR/#) rGrrI finish_reason Optional[str]rorrJzOptional[ProviderStreamError]rL)rMs"r?rNrNRs*3}:rBcaaS'gR#\T;'gR4P4\9dR#Ve\VRR4MRoRVV3Rllp\ S4Fp\VP R4;'gR4P 4P4R8Hp\VP R4;'gR4;'g/pVP R 4;'g \V4pVeVR 8gV'g\V4'gKV!Wg4u# \S4pVeV!V\V44#SP 4'd V!/R4#R#) zGConvert provider-streamed error text into an exception for retry logic.Nrrfc$V^8dQhRRRRRR/#)rGrrkrhrirJrerL)rMs"r?rN6_provider_stream_error_from_text..__annotate__]s",,,=,=P,rBc4<\V\W4SSR7#)r)rer)rrhrfrs&&r?_error0_provider_stream_error_from_text.._error]s "{AUV]Ak7, ,rBrr5rrh) rIr%_PROVIDER_STREAM_ERROR_FINISH_REASONSrrr}rrrr) rrrorris_error_eventrrhrfs f&$ @r? _provider_stream_error_from_textrRs6  =  B%%'/TT4<4Hgh 40dG,,,D1UYYw/5526<<>DDF'Q(6):)@)@bAGGRii .TT2KG2T   # s(:~QijqQrQr'/ /2%T*Gg8ABB zz||b$ rBc$V^8dQhRRRRRR/#)rGpartdict[str, Any] image_costrrJrL)rMs"r?rNrNvs&HHNHHHrBcVPR4pV^,\V\4'd\V4,#^,#)aChar-equivalent of one image content part: the per-image cost learned from provider usage (x4 chars/token), never the base64 payload length. A single native screenshot priced as text read as ~100K+ tokens and selected the giant-conversation watchdog tiers (#63871, #76411).r)r}r|rIr )r!r#rs&& r?_image_part_charsr%vs9 88F D >*T3*?*?SY GGQ GGrBc$V^8dQhRRRRRR/#)rGrrr#rrJrL)rMs"r?rNrN~s!  # 3 3 rBc,aaSf^#\S\4'dSPR4p\V\4'dXV\9dM\ ;QJdV3RlR4F 'gK RM RM!V3RlR44'd \ SS4#\V3RlSP444#\S\4'd-\V3RlS44^\S4,,#\\S44#)zR``len(str(value))`` with image content parts priced at ``image_cost`` tokens each.rc3,<"TF qS9xK R#5ir:rL)rrrs& r?r!_payload_chars..s$QRfQ`aV[Q[fQTFc3<"TF3wr\\V44^,\VS4,xK5 R#5i)N)r rI_payload_chars)rrvr#s& r?rr)s.]}tq3s1v;?^Az%BBB}s;>c3<<"TFp\VS4xK R#5ir:r-)ritemr#s& r?rr)sF>$ 33s) image_urlimagesourcefile_id) r|rkr}rI_IMAGE_PART_TYPESrr%sumitemsrr )rr# part_typesff r?r-r-~s }%IIf%  i % %)7H*HSSQRfQQRSSSQRfQQRNRNR$UJ7 7]u{{}]]]%FFFSQVZWW s5z?rBc V^8dQhRRRR/#)rG api_payloadrrJrrL)rMs"r?rNrNsEEEErBcRaaa^RIHpV!4oRV3Rllo\S\4'd\ V3RlS44^,#\S\ 4'gS!S4^,#SP R4p\V\4'dD\ V3RlV44pRS9dVS!SP R44, pV^,#RS9d\ VV3R lR 44^,#\ V3R lSP444^,#) aiCheap char/4 context estimate for the stale-call detectors. Handles both wire shapes so Codex turns don't report ~0 tokens: list -> Chat ``messages``; dict with ``messages`` (+``tools``); dict with ``input`` (Responses API, +``instructions``/``tools``); any other dict -> sum of its values. Image parts cost the learned per-image price, not their base64 length.)current_image_token_costc V^8dQhRRRR/#)rGrrrJrrL)rMs"r?rN5estimate_request_context_tokens..__annotate__s11c1c1rBc<\VS4#r:r0)rr#s&r?_chars/estimate_request_context_tokens.._charsseZ00rBc34<"TF pS!V4xK R#5ir:rLrr1rAs& r?r2estimate_request_context_tokens..s8KD6$<ve}}*>rF)rJ instructionsrI)agent.image_token_costr=r|rr7rkr}r)r;r=rG total_charsrAr#sf @@r?estimate_request_context_tokensrPs @)+J11+t$$8K88A== k4 ( (k"a''z*H(D!!<8<< k ! 6+//'":; ;Ka+Z7YZZ^___ ?+*<*<*>? ?1 DDrBcV^8dQhRR/#rGrJrrL)rMs"r?rNrNs<`` overlays the flat constructor values for the CURRENT ``agent.model`` (so ``/model`` switches, fallbacks, and delegated children on another model each get their own pins without any surface re-plumbing the kwargs).onlyignoreordersortrequire_parametersdata_collectionload_config_readonly)"resolve_per_model_provider_routingprovider_routingmodelsNT)providers_allowedproviders_ignoredproviders_order provider_sortprovider_require_parametersprovider_data_collectionrrrXhermes_cli.configrhermes_constantsrr}modelr|rkr8ru) rUflat per_modelrr_prrr.mergedrrs & r?_provider_preferences_for_agentrsR E++Xu7N7NPWY^YnYn##%95;\;\599 ;DI   Y ' ':G"$(();<6u{{akloquavavSYYBOOT\D]}AB ( K J)//*;I*;$!qy*;I JF8HF6N+12F+G+G4TF  )/ A:35JCJ AA ( ' J Bs+/AE'>E'4 E:E: FF' E7 cV^8dQhRR/#)rGrJz str | NonerL)rMs"r?rNrNsJrBcr^RIHpV!V4# \d\P RRR7R#i;i)zRotation-stable logical cache scope for *agent*, or None (transports then fall back to the physical session_id, so a failure never blocks the build).)resolve_prompt_cache_scope_safez$prompt-cache scope resolution failedTexc_infoN)agent.prompt_cache_scoperrXr[debug)rUrs& r?_prompt_cache_scope_for_agentrs8L.u55  ;d Ks "66c$V^8dQhRRRRRR/#)rGanthropic_kwargsrk api_messagesrrJrL)rMs"r?rNrNs#  D X\ ae rBc >\VRR4R 9dV#^RIHpV!R4pVeGVPR/4P VP \VRR4\ V4R74V# \d"p\PRT4Rp?T#Rp?ii;i) zThe Nous profile body on the Messages wire, which the profile hook never reaches; never ``provider_preferences`` (OpenAI-wire routing the Portal 400s on).providerNnousget_provider_profile extra_body session_id)rdata_usez'Nous Portal extra_body merge failed: %s>r nousresearch nous-portal) r providersr setdefaultupdatebuild_extra_bodyrrXr[r)rUrrr nous_profilers&&& r?&_merge_nous_portal_messages_extra_bodyrsuj$'/VVE2+F3  #  ' ' b 9 @ @A^A^"5,=H\]iHjB_Bl m  E >DD EsAA00 B;BBc V^8dQhRRRR/#)rGchunkrrJrrL)rMs"r?rNrNsrBc a^(oV3Rlp\P!\4;_uu_4\VRR4pV'd`\V^,RR4pVeGV!VRRR4\VRR4;'gRF p\VR R4pVfKV!VR R 4K" MV!\VRR4R R 4RRR4S# +'giS#;i)zCheap per-chunk size estimate for the stream diagnostic counters: delta string lengths plus a framing floor (~3x cheaper than ``len(repr(chunk))`` in the agent's hottest loop). Unknown shapes just keep the floor.c<VF9p\WR4p\V\4'gK'S\V4, oK; R#r:)rr|rIr )objattrsattrr.sizes&* r?_add#_estimate_chunk_bytes.._add s3D4(A!S!!ArBchoicesNdeltacontentreasoning_content reasoning tool_callsfunction argumentsnamer partial_jsonrL)rrrXr)rrrrtcfnrs& @r?_estimate_chunk_bytesrs D   Y ' '%D1 GAJ6E UI':KH!%t<BBBB Z6B~Rf5C . G ( K ( ' KsA C9C$C C cV^8dQhRR/#rGrJrrL)rMs"r?rNrN)sCrBch\\VR^4;'g^4# \d^#i;i)_consecutive_stale_streams)rrrXrUs&r? _stale_streakr)s675">BGGaHH s"" 11cV^8dQhRR/#rGrJrKrL)rMs"r?rNrN0sDDDrBc\P!\4;_uu_4\V4^,VnRRR4R# +'giR#;i)rN)rrrXrrrs&r?_bump_stale_streakr0s4   Y ' '+8+?!+C( ( ' ' 's A A cV^8dQhRR/#rrL)rMs"r?rNrN5s--$-rBc\P!\4;_uu_4^VnRRR4R# +'giR#;i)rTN)rrrXrrs&r?_reset_stale_streakr5s*   Y ' '+,( ( ' ' 's 5 A >@c$V^8dQhRRRRRR/#)rGelapsedr\response_startedrrJrL)rMs"r?rNrN=s#  e RV [_ rBcV'g V\8dR#\V4\PRV\ V44R#)zCount a user-aborted pre-response stall toward the stale breaker: past the wait-notice interval an interrupt is evidence of an unresponsive attempt. Mid-response and early interrupts stay neutral.FzeInterrupted provider wait counted as stale after %.0fs with no output; consecutive stale attempts=%d.T)_INTERRUPTED_WAIT_STALE_SECONDSrr[r\r)rUrrs&&$r?!_record_interrupted_provider_waitr=s97%DDu NN)*1=3GI rBinlineFhintc 0V^8dQhRRRRRRRRRR R R /#) rG api_kwargsrkrr\rgrrrrrJrKrL)rMs"r?rNrNIsB E ED E5 EY^ E  E - E9= ErBc 4VPRR4p\PRV'dRMRVW6\V4R 4TP R\ V4 RT R T;'gR 24R# \ d\PR R R 7R#i;i)zLog + status message for a stale non-streaming kill, shared by the worker poll loop and the inline ``direct_api_call`` watchdog (their kill/state sequences differ deliberately: different locking models).runknownzk%son-streaming API call stale for %.0fs (threshold %.0fs). model=%s context=~%s tokens. Killing connection.zInline nN,%⚠️ No response from provider for zs (non-streaming, model: z). zAborting call.zstale status buffering failedTrN)r}r[r\rP_buffer_diagnostic_statusrrXr)rUrrrgrrrs&&&&$$ r?_report_stale_nonstream_killrIs NN7I .E NN;JPJVY[b!@!LQ ORE ''3CL>AZ[`Zaadeie}e}m}d~  A E 4t DEs-A11"BBc V^8dQhRRRR/#rGrr\rJrKrL)rMs"r?rNrNYsCCuCCrBcVPR\V4 R24R# \d\P RRR7R#i;i)z&stale non-streaming call killed after rzstale activity touch failedTrN)_touch_activityrrXr[r)rUrs&&r?_touch_stale_kill_activityrYsGC  Fs7|nTUVW C 2T BCs""AAcV^8dQhRR/#rrL)rMs"r?rNrN`s   $  rBcl\4p\V4pV^8dW!8d\RV R24hR#R#)uRaise immediately when the consecutive-stale streak is past the give-up threshold — no network attempt, no stale-timeout wait.z:Provider has been unresponsive (no response received) for u consecutive stale attempts — aborting this call to avoid an indefinite stall. Switch models or start a new session, then retry.N)rr RuntimeError)rU_giveup_streaks& r?_check_stale_giveupr`sInGE"G{w) Hi[ [  *{rBcV^8dQhRR/#)rGrJztuple[float, bool]rL)rMs"r?rNrNmshh 2hrBc@\RR4R\P93#)u(HERMES_STREAM_STALE_TIMEOUT or the implicit 180s, explicit) — like ``AIAgent._resolved_api_call_stale_timeout_base``; an explicit env value is the user's deadline, so it is never capped to the run budget.HERMES_STREAM_STALE_TIMEOUTf@)r3osenvironrLrBr?_stream_env_stale_baserms$ 2E := 60s), so one hung call can't outlive the run and the wrap-up notice stays reachable (#97968). Shared by the streaming and non-streaming resolvers; callers skip it for explicit user settings.run_budget_secondsN_run_budget_started_atr7g?)rr\timerkrj)rUrT run_budgetstarted remainings&& r?cap_to_run_budgetrsb 4d;Je5t%ABI wD)c/2 33rBc V^8dQhRRRR/#rrL)rMs"r?rNrNs J J J JrBc\VPVP4pVeV#\4wr4\ W14pV'dV#\ W4#)uAn explicit ``providers..stale_timeout_seconds`` is the operator's deadline and wins over every implicit floor — the context-size tier as well as the reasoning-model floor — so it can SHORTEN patience for a hung stream (#115024). Only the 180s default is scaled and floored.)r rrrr r)rUrexplicitr explicit_envrTs&& r?rrsK *%..%++FH/1D"44G"7I(9%(IIrBc V^8dQhRRRR/#)rGmodel_idobjectrJz float | NonerL)rMs"r?rNrNshhVh hrBc^RIHpV'd\V\4'gR#VP 4P 4pRF*pVP V4'gKV\V4RpM V.pRV9dKVPVPR^4^,4VPVPRR^44\PRV44p\R\W44R4#)aMap a Bedrock inference-profile id to its reasoning stale-timeout floor. ``us.anthropic.claude-opus-4-6-v1:0`` -> strip the region prefix, then try the segment after the provider namespace (``claude-opus-4-6-v1:0``) and the id with the provider dot dashed (``deepseek-r1-v1:0``). The floor table mixes dashed and dotted versions while Bedrock always dashes, so each candidate is also tried with digit-dash-digit <-> digit-dot-digit swapped (version separators only). First non-None wins; None for unknown models. rN.-c3"TF?pV\P!RRV4\P!RRV43FpVxK KA R#5i)z(?<=\d)-(?=\d)r$z(?<=\d)\.(?=\d)r%N)rsub)rcandforms& r?r1_bedrock_reasoning_stale_floor..sIi(266"3S$?HZ\_aeAfgD g sAA c30"TF qfKVxK R#5ir:rL)rfs& r?rr*s`NqNr) zglobal.zus.zeu.zapac.zap.zau.zjp.zca.zsa.zme.zaf.)r rr|rIrrrr r~rsplitreplacerkfromkeysrr)r!rrprefixbase_candidatesrs& r?r r sK :h44 >>  ! ! #De ??6 " "F %D ffO d{t{{32156t||Ca89i(iiJ `C AN`bf ggrBon_stream_deniedc V^8dQhRRRR/#)rGrrkrrrL)rMs"r?rNrNs  t  rBc^RIHpHpHpHpHpHpHp VPRR4p VPRR4V!V 4p V'd V PM V Pp V'dRMTp V !R/VBpT !T4# \dlpT!Y4;'g T !Y4pTeT !T !R/TB4uRp?#TeT!T4'dT!YT4uRp?#T!T4'd T!T 4hRp?ii;i)aPop the Hermes routing keys and call ``converse`` / ``converse_stream`` (boto3 directly) with the adapter's shared recovery: a cachePoint rejection (Nova: toolConfig.tools, #97281) or a replayed sealed reasoning rejection resends once without the offending blocks inside the same attempt; a streaming IAM denial hands off to ``on_stream_denied(client, kwargs, exc)``; a stale connection evicts the cached client so the outer retry builds a fresh pool. Streaming returns the event stream; else a SimpleNamespace.)_get_bedrock_runtime_clientinvalidate_runtime_clientis_stale_connection_error is_streaming_access_denied_errornormalize_converse_response"recover_from_cache_point_rejection)recover_from_redacted_reasoning_rejection__bedrock_region__ us-east-1__bedrock_converse__Nc&VPR.4#rr)raws&r?r@(_bedrock_converse_call..s#''(B/rBrL) agent.bedrock_adapterr5r6r7r8r9r:r;popconverse_streamconverserX)rrr2r5r6r7r8r9r:r;regionclientmethodfinish raw_responser retry_kwargss&$$ r?_bedrock_converse_callrMs WWW^^0+ >FNN)40 ( 0F'-V # #6??F4:/@[F + +  ,   :3KVVDSU   #&0<01 1  ',LS,Q,Q#F< < $S ) ) %f -  s<-A== C3)C.1C37C. C.C3 C.% C..C3cV^8dQhRR/#rGrrkrL)rMs"r?rNrNs!Q!Q$!QrBc bVPR8Xd%VPW!R4\VRR4R7#VPR8XdV!RRR7pVPWR 7#VPR 8Xd\ VR R 7#VP R 8Xd\\VP RR4RR4p\\VRR44'gVPRR4VP PPP!R/VB#V!R4p\W4p\WV4#)aRun one non-streaming LLM request for the active api_mode and return it. Shared by ``interruptible_api_call`` and ``direct_api_call``. ``make_client(reason, kind=...)`` builds the per-request client (``"openai"`` / ``"anthropic_messages"``) so callers can register it with their abort/close machinery; bedrock / MoA manage their own clients. Interrupt/abort/close semantics stay in callers. codex_responsescodex_stream_request_codex_on_first_deltaN)rHon_first_deltaanthropic_messagesanthropic_messages_requestkind)rHbedrock_converseFr@moachat completionsprepare_moa_prepared_requestchat_completion_requestrL)api_mode_run_codex_streamr_anthropic_messages_createrMrrHrrDr[r\rQrr)rUr make_clientrequest_client _completionss&&$ r?"_dispatch_nonstreaming_api_requestrfs" ~~**&&z+F\:]"5*A4H'J J ~~--%%AH\]// /RR ~~++%j?? ~~ wu||VTBMSWX  i>?? NN2D 9||  ,,33AjAA !:;N3:NJ -eZ PPrBcV^8dQhRR/#rRrL)rMs"r?rNrNs:::rBc^\VRR4p\VRR4R8XdR#\VRR4R8XdVR 9#VR8wdR#\P!\4;_uu_4^R IHpV!4'd RRR4R #RRR4\VRR4R 8H# +'giL ;i) a>Whether an OpenAI-wire request should skip the interrupt worker. Gateway cron turns (#62151) and delegated children (#60203) run inside nested thread pools that wedge before the socket opens when the request is pushed onto yet another daemon worker. Running inline drops the deepest layer; interrupts still work because the inline path registers ``agent._active_request_abort``, which ``interrupt()`` invokes cross-thread (#72227). Cron also inlines Codex Responses (#69734): both Codex paths (non-stream, and streaming via ``_stream_codex_passthrough`` -> ``_interruptible_api_call``) reach ``direct_api_call``, whose client comes from ``make_client`` so the inline stale watchdog can abort it; the stale budget keeps the openai-codex floor/hard cap. Trade-off: the worker-only Codex TTFB/progress/idle watchdogs don't run inline, so a Codex call that never sends a first byte waits the full wall-clock stale budget (600-1200s on large contexts) instead of the ~120s TTFB cutoff. Delegated children and Native/Bedrock/MoA keep their workers: cancellation and client ownership differ. r`NrrZFplatformcronchat_completions)is_delegated_child_contextTsubagent>rQrk)rrrrXagent.delegation_contextrl)rUr`rls& r?should_use_direct_api_callros"uj$/Huj$'50uj$'61BBB%%   Y ' 'G % ' ' ( ' ' ( 5*d +z 99 ( 's $B B, g.@c V^8dQhRRRR/#rrL)rMs"r?rNrNCs  T e rBc\VRR4p\V4'd V!V4MRp\V\4'g\V\\ 34'g \ R4#\VRR4p\VRR4R8Xd8V'd\ V4'g\\ V4\V44#\ V4#)uJStale budget for the inline call via ``agent._compute_non_stream_stale_timeout``, plus the same openai-codex floor/hard cap the worker path applies (inline cron Codex, #69734). A non-numeric result (stub agent) leaves the watchdog disarmed; a resolver that *raises* propagates — swallowing into ``inf`` would reinstate the hang.!_compute_non_stream_stale_timeoutNinfbase_urlr`rQ) rrr|rrr\rrmrP)rUrresolverrrts&& r?_resolve_direct_stale_timeoutrvCs uA4HH$,X$6$6HZ DE%je &E&EU|uj$/Huj$'+<> % NN ! ! #    c "rBc$V^8dQhRRRRRR/#)rGreasonrIlog_msgrJrKrL)rMs"r?rNrs!11C1#1$1rBc VPPWR7R# \d\P TRR7R#i;i)rTrN)rU_abort_request_openai_clientrXr[r)rsrHrrs&&&&r? _abort_client_InlineRequest._abort_clients; 1 JJ 3 3F 3 J 1 LL4L 0 1s "AAc V^8dQhRRRR/#)rGrrIrJrrL)rMs"r?rNrsCDrBc  VP;_uu_4VP'd RRR4R#VR8XdTVP'd RRR4R#VP'*pV'dRVn\ VP 4M RVnRpVP e"VPVP VRV R24VuuRRR4# +'giR#;i)aRAbort the inline request from a watchdog/interrupt thread. Returns True when this call owned the stale transition (the timer reports/bumps once, never after an interrupt or a completed request). Aborts under the lock (same contract as _RequestClientRegistry): once released the finally may cache the client and the NEXT call check it out.NFrTzInline request abort failed ())rrrrrrUrHr)rsr newly_stales&& r?r_InlineRequest.aborts YYYyyyY**>>> Y #'**n !%DJ'tzz2"&# {{&""4;;:WX^W__`8ab'YYYs#CC CC0AC C" c V^8dQhRRRR/#)rGrrIrXrL)rMs"r?rNrs#SrBc VPPWPR7pVP;_uu_4W0nVP pV'dVP VRR4RRR4X'd#\R\VP4 R24hVPVPn V# +'giLW;i)rrrz2Inline abort after late client registration failedNzENon-streaming API call timed out before request dispatch (threshold: s)) rU_create_request_openai_clientrrrHrr TimeoutErrorrrgr_active_request_abort)rsrrXrHstale_before_dispatchs&&& r?rc_InlineRequest.make_clients99TcTc9d YYY K$(JJ !$ ""6+<>rs !WX[\`\n\nXoWpprsu u+/?? ( Ys .B88 C cV^8dQhRR/#rrL)rMs"r?rNrs4rBc vVP;_uu_4RVnRRR4R# +'giR#;iTN)rrrs&r?r_InlineRequest.mark_dones YYYDIYYYs' 8 c VP;_uu_4VPRuqnRRR4V# +'giX#;ir:)rrH)rsrHs& r? pop_client_InlineRequest.pop_clients2 YYY"&++t FK Y s 3 A ) rrrrrUrrrrHrrrrgN)openai)rrrrrrqrrrrrrrcrrrrLrBr?rrbs;P U8##1 6&rBrcV^8dQhRR/#rOrL)rMs"r?rNrNs:U:Ut:UrBc \V4VPR4\P!4p\W4p\ V4pVeRV9d /VCRV/Cp\ WW24pVP 4Rp\WVPR7p\VRR4'd \R4hVP4\V4RpTVP4\VR R4VPJdRVnVP!4pVeTP#TV'dR MR R 7## \$d\TRR4'd \R4RhTP&;_uu_4TP(p RRR4M +'giM;iX 'd@\+R \-\P!4T, 4 R\-T4 R24Rhhi;i TP4\TR R4TPJdRTnTP!4pTeTP#TT'dR MR R 7ii;i)u]Run a non-streaming LLM call inline on the conversation thread (cron turns, delegated children — see ``should_use_direct_api_call``): no interrupt worker, so the nested-pool deadlock cannot occur. An activity heartbeat keeps ``last_activity_ts`` advancing (else the stall monitor interrupts a healthy wait at ~450s). A stale-call watchdog bounds the request (#80759): the timer aborts in-flight sockets via the registered hook, and a per-call ``timeout`` equal to the stale budget is the backstop when the abort finds nothing (#85252). Both surface a retryable ``TimeoutError`` for the outer retry loop.rNrTF)rc_interrupt_requestedz!Agent interrupted during API callTrrequest_completerequest_error_cleanuprz'Non-streaming API call timed out after zs with no response (threshold: r)rrrrvrrrrfrcrInterruptedErrorrrrrrr_close_request_openai_clientrXrrrr) rUrrrgrlrequest succeededrord was_stales && r?direct_api_callrs3 BCJ1%DM2-@LIZ$?< V:W9XY"=12"67<@ A  0  514 8GG"0 F= G" F G"!AG""G%%AI  I cb]tRtRtRtRtRR/RRllt]R4tR t R R lt R R lt Rt R#)_RequestClientRegistryiuzPer-request client / stream-handle registry shared by the request worker and the stranger threads (interrupt loop, stale detector) that may abort it. ``kind`` (``"openai"`` / ``"anthropic_messages"`` / ``"stream"``) routes :meth:`close_once` (#67142). ``"stream"`` registers a stream handle: under the MoA facade the singleton client has no per-request sockets, so interrupts must close the stream object itself (#57354). Thread-ownership rule (#29507): the owning worker pops + fully closes on its way out. A *stranger* thread only aborts the sockets — never ``client.close()`` — avoiding the FD-recycling race where a just-closed TLS FD was reassigned to ``kanban.db`` and the live SSL BIO wrote into the SQLite header. The abort happens under the lock: once released the worker may cache the client and the NEXT call check it out. Stream handles are safe to close from any thread. c ~WnRVnRVnRVnRVn\ P !4VnR#)Nr)rUrHrX owner_tiddiagrrrrsrUs&&r?rq_RequestClientRegistry.__init__#s1    NN$ rBrXrcV^8dQhRR/#)rGrXrIrL)rMs"r?rN#_RequestClientRegistry.__annotate__+s#rBc VP;_uu_4W\P!4uVnVnVnRRR4V# +'giT#;ir:)rr get_identrHrXr)rsrHrXs&&$r? set_client!_RequestClientRegistry.set_client+s? YYY5;9CVCVCX 2DKDN Y s )A A c vV\VRR43F%p\VRR4p\V4'gK#Vu# R#)roNclose)rr)rownerrs& r?_stream_close_callable-_RequestClientRegistry._stream_close_callable0s<gfj$?@EE7D1E ArBc RVPV4fV#VPVRR7#)NrrW)rrrsrs&&r?set_stream_handle(_RequestClientRegistry.set_stream_handle8s,44V<Dvp$//Z`go/JpprBc V^8dQhRRRR/#rGrrIrJrKrL)rMs"r?rNr;sYY3Y4YrBc VPV4pVfR#V!4\PRV4R# \d"p\P RY$4Rp?R#Rp?ii;i)Nz%Streaming response handle closed (%s)z/Streaming response handle close failed (%s): %s)rr[inforXr)rsrrrrs&&& r?_close_stream_handle+_RequestClientRegistry._close_stream_handle;sX++F3 =  Y G KK? H Y LLJF X X Ys8 A$AA$c V^8dQhRRRR/#rrL)rMs"r?rNrEsSSSSrBc VP;_uu_4VPVPVPrCpVR8g;'d1VRJ;'d%VRJ;'dV\P !48gpV'dHVR8XdVP PMVP PpV!W!R7RRR4R#RVnRVnRRR4XfR#XR8XdVPW!4R#VR8XdVP PW!R7R#VP PW!R7R# +'giLs;i)rNrUr) rrHrXrrrrU_abort_request_anthropic_clientrr_close_request_anthropic_clientr)rsrrd request_kindrstranger_threadrs&& r? close_once!_RequestClientRegistry.close_onceEs YYY6:kk499dnn)N(77"$.77T)77!4!4!66  GSWkGkCC"jjEEn4YDK!DN  !  8 #  % %n = 1 1 JJ 6 6~ 6 U JJ 3 3N 3 R-Ys#;D> D> D>>=D>D>> E )rUrHrrXrrN) rrrrrrqr staticmethodrrrrrrLrBr?rrsD % qYSSrBrrcV^8dQhRR/#rrL)rMs"r?rNrNos - - -rBch^RIHp\VRR4p\V\4'dVP R4RJdR#\ VP R4;'gR4P4P4pW19g&VPV4VPR 48dR#\#) z``HIGH_EFFORT_SILENCE_FLOOR_SECONDS`` when the wire reasoning config is enabled at ``high`` or any stronger :data:`~agent.reasoning_effort.EFFORT_LADDER` level (xhigh/max/ultra), else 0.) EFFORT_LADDERreasoning_configNenabledFr^effortrhigh) agent.reasoning_effortrrr|rkr}rIrrr!HIGH_EFFORT_SILENCE_FLOOR_SECONDS)rUrrr s& r?_high_effort_silence_floorr os5 %+T 2C c4 CGGI$6%$? "((b ) / / 1 7 7 9F "m&9&9&&AMDWDWX^D_&_ ,,rBcz]tRtRt$RtR]R&R]R&R]R&R]R &R]R &R]R &R]R &R]R &RtR]R&RtR#)_NonStreamWatchdogsi}z3Poll-loop thresholds for one non-streaming request.r\rgrcodexrr[ ttfb_enabled ttfb_timeout idle_enabled idle_timeoutidle_requires_progressr^progress_timeoutrLN)rrrrr__annotations__rrrLrBr?rr}s>= KO  !e!rBrc V^8dQhRRRR/#)rGrrkrJrrL)rMs"r?rNrNs#UZUZDUZ=PUZrBc aVPV4pVPR8Hp\V4p\V4oV'd \ V4MRpRp\ VRR4p\ V4;'d \V4pV'd V'g\S4p\VS4p\V\V3RlR4R44p Tp \RR4R8gp \RR4p V ^8:dR p EMV'dV'g\R R 4p \PPR R 4P!4P#4R9pV'g1V ^8d*SV 8d#W8d\$P'RWSR V 4T p \RR4pV^8d"W8d\$P'RWSR 4Tp M:V 'g3V'd+\)4pVV 8d\$P'RW|V4Tp V 'dV 'g \W4p \RR4R8gp\RV 4pT;'dT;'dV^8;'dV'*p\+Y#SYT;'dV^8TTV'd \,R7 #RR7 #)ayStale-call timeout plus the Codex Responses stream watchdogs. The stale detector kills a hung provider early so the retry loop can rotate credentials / fall back. Codex adds two failure modes: accepting the connection but never emitting an event (no-event TTFB cutoff; a reconnect succeeds in ~2s) and stalling after substantive model progress begins (event-idle gap; any parsed SSE event remains transport activity). Only the implicit official OpenAI Codex policy for large contexts defers arming until progress; small requests, compatible backends, and explicit overrides retain the legacy first-event semantics. Tunables: HERMES_CODEX_TTFB_TIMEOUT_SECONDS, HERMES_CODEX_EVENT_STALE_TIMEOUT_SECONDS (0 disables each), HERMES_CODEX_TTFB_DISABLE_ABOVE_TOKENS / HERMES_CODEX_TTFB_STRICT, HERMES_CODEX_TTFB_MAX_SECONDS (opt-in ceiling, default 0 = none), HERMES_CODEX_HARD_TIMEOUT_SECONDS. rQr^rtNc3><"TFwrSV8gKVxK R#5ir:rL)rrcdefaultr[s& r?r/_resolve_nonstream_watchdogs..s!y+^'Ybloxbx+^s  ^@g(@!HERMES_CODEX_TTFB_TIMEOUT_SECONDSF&HERMES_CODEX_TTFB_DISABLE_ABOVE_TOKENSg@HERMES_CODEX_TTFB_STRICTrzScaling codex-responses no-event TTFB watchdog from %.0fs to %.0fs for large request (context=~%s tokens >= %.0f). Set HERMES_CODEX_TTFB_STRICT=1 to keep the smaller cutoff.rHERMES_CODEX_TTFB_MAX_SECONDSzyCapping codex-responses no-event TTFB timeout from %.0fs to %.0fs (context=~%s tokens) per HERMES_CODEX_TTFB_MAX_SECONDS.uLocal provider detected (%s) — no-event TTFB watchdog raised from %.0fs to %.0fs (agent.local_stream_stale_timeout); set HERMES_CODEX_TTFB_TIMEOUT_SECONDS for an explicit cutoff.(HERMES_CODEX_EVENT_STALE_TIMEOUT_SECONDS) rgrr[rrrrrr))r_r)r`r)rbr7g>1onyestrue)rrr`rYrPr rrrrermrjrr3rrr}rrr[rrr$CODEX_FIRST_PROGRESS_TIMEOUT_SECONDS)rUrrgropenai_codex_backend effort_floor codex_floorrtlocal idle_defaultr ttfb_explicitr disable_abovestrictttfb_cap local_ceiling idle_explicitrprogress_gatedr[s&& @r?_resolve_nonstream_watchdogsr4sq";;JGM NN/ /E3E:0s9"%((u11A U / 3 3 55rBcV^8dQhRR/#rRrL)rMs"r?rNrNstrBcP\\VRR44pV'dRVnV#)u?Consume the one-shot "answer without thinking" continuation flag. Set by the length-continuation path when a request returned reasoning but NO visible content (thinking ate the output cap); continuation turns never replay prior reasoning, so thinking ON would re-burn the budget. When True the caller overrides the wire reasoning_config with ``{"enabled": False, "effort": "none"}`` for exactly the next call. Prompt-cache cost is bounded to ONE cold prefix write on config-sensitive providers (Anthropic, OpenAI) — far cheaper than four futile full-budget continuations. _ephemeral_reasoning_offF)rrrA)rUconsumeds& r? _consume_ephemeral_reasoning_offrCs(GE#=uEFH).& OrBcVPp\V4p\VRR4'd RVnR#Vf^RIHpV!V4p\VRR4'd~\ V\4'd`VPR4RJgVPR4R8Xd5\VR R4'd^R I H p/VCRR RV/CpWPnV#RVnR#WnV#V'd/T;'g/CRRRR/CpWnV#) u``agent.reasoning_config`` with the one-shot reasoning-off override applied. Once the route has answered a disable with "reasoning is mandatory" (``agent._reasoning_disable_rejected``), every disable — configured or the one-shot continuation override — is dropped for the rest of the session: the request goes out without a reasoning config and the route applies its own default. _reasoning_effort_rejectedFN)unset_reasoning_default_reasoning_disable_rejectedrr none_reasoning_floor_required)REASONING_FLOOR_EFFORTT) rrCr_wire_reasoning_configagent.reasoning_paramsrFr|rkr}agent.auxiliary_reasoning_floorrJ)rUr ephemeral_offrFrJflooreds& r?_reasoning_config_for_wirerP s  C4U;Mu2E::(,$ { C%e,u3U;; c4 GGI % '3778+<+Fu95AARTST)T8=ST/6,+/E ('*$ A#))Ai&A$' JrBc Ve\VR4'd/VnVPR 9;'gVPR8HpV'd V'gV#^RIp^RIHp\;QJdRV4F 'gK RM RM !RV44pV'd&VPV4pV!V4wr'VeWqnV# \d.p\PR\TR R 4T4Rp?T#Rp?ii;i) a6xAI chat-completions reserves ``tool_search`` and 400s when the bridge declares it (#95003): rename the wire declaration; ``normalize_response`` maps calls back via the transport's ``_last_wire_aliases`` (reset here so a stale map can't reverse-map a name this request never aliased). Deep-copy first (#27907).N_last_wire_aliaseszapi.x.ai)"_rename_tool_search_bridge_for_xaic3"TFJp\V\4'gKVPR4;'g/PR4R8HxKL R#5i)rr tool_searchNr|rkr}rts& r?r4_alias_tool_search_bridge_for_xai..MsC LYq]ghiko]p BQUU:  $ $" ) )& 1] BMsAAATFu7%s⚠️ Failed to alias tool_search bridge for xAI: %s log_prefixr>xai xai-oauth) hasattrrRr_base_url_hostnamecopy!agent.transports.chat_completionsrSrdeepcopyrXr[r\r) rU transport tools_for_api is_xai_chat _copy_xairS has_bridge alias_maprs &&& r?!_alias_tool_search_bridge_for_xairh@s 4H!I!I') $..$88bbEVW\>];(;>e)T  z Y!NN=9M7 F M/ > M2%8M    ! . .U[[==lKS`)ge\SW6X%$1$==5CSCS002FW D1GZ)NauHHJgk#'7XZ^(_#`-geM]_c>d / f f z NNQSZ[`bnprSsux y y zs1D$$ E/"EEc"aSP4p\SWb4pSP4pSP4pSPp \ V R4;'g \ V R4p SP ;'gRP4P4R8Hp RRr\P!\4;_uu_4^RI H pHpV!SPSP 4pVVJp V 'dRMTp RRR4\#S4pV'd7RSP$;'gRR \'\(P*!44/MRpRp\P!\4;_uu_4^R IHpV!SP 4pRRR4\1S4p^R IHpV!VSPSP R 7p\7R5/R SPbRSP9V4bRVbRSP bRSP;4bRSP<bRVbRSP>bRVbRVbR\ASRR4bRVbRSPBbRT;'gRbRSPDbRSPG4bRV 'dSPI4MRbRVbpV'dVPJ!R5RV/VB#VPJ!R5/VBR SP;'gRP4R!TR"\ V R#4R$TR%T R&\ V R'4R(\L;QJdV3R)lR64F 'gK R*M RM!V3R)lR644R+\ V R,4R-SP R.8HR/V'd SPNMRR0V'd SPPMRR1T R2T R3V 'dSPS4MRR4SP /B# +'giEL;i +'giELE;i)7zmodels.github.aizgithubcopilot.comrlmstudioFN)_fixed_temperature_for_modelOMIT_TEMPERATURE sessionIdhermespromptIdr)shape_wire_carriers)rrtrrGrIrtrTrsephemeral_max_output_tokensmax_tokens_param_fnrr~rrollama_num_ctxprovider_preferencesopenrouter_min_coding_scoresupports_reasoninglmstudio_reasoning_optionsqwen_session_metadataprovider_profile model_lower is_openrouteris_nousznousresearch.comis_qwen_portalis_github_models is_nvidia_nimzintegrate.api.nvidia.comis_kimic3P<"TFp\SPV4xK R#5ir:)r1rt)rhrUs& r?r1_build_chat_completions_kwargs..s"uFt)%..!<C>^>^>` *## *AO *"33 *GW *, *9@|UY8Z * & * 7<6K6K * $^^t * JOIjIj *!??A *R^5#K#K#Mcg *) *G%%KxK7KK  ! !   [[&&B--/  &e-?@        ,E3MN uFtuuFtuu *%1KL !>>X5 >F994 NV I I[_ & $ OUuHHJZ^  nn! E ( ' ' ( ' 's6N21O2 O  O c$V^8dQhRRRRRR/#rGrrrcz list | NonerJrkrL)rMs"r?rNrNs"${VZrBc ~^RIHp\WV4pV!V\VRR4\VRR4\VRR44#)adBuild the keyword arguments dict for the active API mode. Wraps the per-api_mode builder so the conversation-affinity headers (OpenCode's ``x-opencode-session``, a custom provider's opt-in ``session_affinity_header``) ride on every request regardless of transport (chat_completions / codex_responses / anthropic_messages). No-op for every other provider. )merge_session_affinity_headersrNrtr)agent.opencode_affinityr_build_api_kwargs_for_moder)rUrrcrkwargss&&& r?build_api_kwargsrsHG '] KF )z4(z4(|T*  rBc$V^8dQhRRRRRR/#rrL)rMs"r?rNrNs'llDll`dlrBc(\V4pVf VPp\V4pVPR8Xd\ WW#V4#VPR8Xd \ WW#4#\ V4pVPR8Xd\M\pV!WW#WE4#)NrUrYrQ) rPrIrr`rrrrr)rUrrcrr~rbuilders&&& r?rrs2%8 4E: ~~--&uM]noo ~~++$U-ZZ359N%*^^7H%H!NlG 5 IZ kkrBcjVPRR7# \dTP4u#i;i)z``model_dump(warnings=False)`` (avoids pydantic serializer UserWarnings on generic-union SDK models), falling back for shims that reject the kwarg.F)warnings) model_dumpr)rs&r?_model_dump_safers4 ~~u~--  ~~ s 22c@\VR4'd \V4#T#)r)r]rrs&r?_dump_if_modelrs&-e\&B&B E "MMrBcV^8dQhRR/#)rGrJrrL)rMs"r?rNrNsVV=VrBcVPV4pV'gh\\VRR44p\P!RV\P R7pV'd#RP RV44;'gRpV'd8VP'd&\P!R\V4 RV 24V'dsVP'daVP'gOVP'g=\P!\ 4;_uu_4VPV4RRR4V'd \#V4#T# +'giL%;i) zIStructured reasoning, else inline ```` blocks embedded in content.rNz(.*?)flags c3p"TF,qP4'gKVP4xK. R#5ir:)r)rbs& r?r,_assistant_reasoning_text..s (VLqGGILs66zCaptured reasoning (z chars): )_extract_reasoningrrrfindallDOTALLrYverbose_loggingloggingrr reasoning_callbackstream_delta_callback_stream_callbackrrrXr")rUassistant_messagereasoning_textr think_blockss&& r?_assistant_reasoning_textrs--.?@N &w/@)T'RSzz"97"))T #[[(VL(VV^^Z^N%/// ,S-@,A>JZ[\ %2225;V;V;V_d_u_u_u   + +  $ $^ 4,3A  /U~U, +s E E c \\\VRR444p\V\4'd>V'd6VP V4P 4pV'd^RIHpV!V4pV#)rNr) r"rrr|rI_strip_think_blocksrrr)rUrrrs&& r?_assistant_content_for_storager(s] ##7@QS\^b8c#deG'3G++G4::<  :+G4G NrBc V^8dQhRRRR/#)rGrrrJrkrL)rMs"r?rNrN6s..s.t.rBc \VRR4p\VRR4p\V\4'dVP4'gVP V4wrE\V\4'dVP4'g\V\4'd(VP4'dVP4pMJ\VRR4pTP V'd\VRR4MRV'd\VRR4MRV4pVP4p\VRR4p\V\4'dVP4'gVP V4wrWTP T\V\4'dTMR4pRVRVRVR VPRRVPPRVPP//p\VR R4p V e\V 4VR &^R I H p V !VR 4;'g\VPR R4p \V \4'dV 'd WR,R &V#) idNcall_idrrrr{}response_item_idr extra_content)rthought_signature)rr|rIr_split_responses_tool_id_deterministic_call_id"_derive_responses_function_call_idrrrrrrr) rU tool_callrraw_idrr_fnrtc_dictextrarfn_sigs &&& r?_assistant_tool_call_dictr6s Yd +FiD1G gs # #7==??33F;  gs # #7==?? fc " "v||~~llnG)Z6C22s733KXZ36[$/D%IGmmoGy*P>PRegk6lF&#639 /0 NrBc V^8dQhRRRR/#)rGrrIrJrkrL)rMs"r?rNrNgsffSfTfrBc \VRR4p\W4p\RRR\W4RVRV/4p\VRR4pVf>\VR R4;'g/p\ V\ 4'dRV9d VR,pVe\ V4VR&M:V'd'VP4'dT;'gR VR&M V'dWER&\VR R4'd.pVPFp \ V \ 4'dVPV 4K,\V R 4'dVPV P4K[\V R 4'gKoVP\V 44K V'dWR &RFp \WR4p V 'gKWV &V R8XgK&^RI Hp V !W.4'gK=\VPRR4p \!V 4'dT !4^RIHpV!VR4\VRR4;p'gK^RIHpT!T\VRR4;'gRR7K ^RIHpV!V4;p'dXTP/VP14UUu/uFwppVR8wgKVVbK upp4.VP3R R4OVNVR &V'd/\5V4UUu.uFwpp\7VVV4NK uppVR&V#uuppiuuppi)uMBuild a normalized assistant message dict (reasoning, reasoning_details, optional tool_calls) shared by the tool-call and final-response paths. Textless turns are NOT padded here: ``repair_empty_non_final_messages`` is the single owner — write-time padding broke codex commentary turns and cannot survive ``_rows_to_conversation``.rNrole assistantrrrr model_extrarreasoning_details__dict__rcodex_reasoning_items)+has_replayable_native_compaction_checkpoint!note_native_compaction_checkpoint)set_usage_anchor_current_task_id)_reset_read_dedup_cachesrr)r)carrier_recordr)anthropic_content_blocksbedrock_content_blocksrcodex_message_itemsrL)rrr rr|rkr"_needs_thinking_reasoning_padrr~r]rrrWrrnragent.usage_anchorragent.conversation_compressionrrr rr8r}r r)rUrrassistant_tool_callsrmsgraw_reasoning_contentr preserveddrrrnote_checkpointrtask_idrr recordrr.irs&&& r?build_assistant_messager0gs ##4lDI.uHN !6;1%K[Zh#( )C$$57JDQ$/EKK k4 ( (-@K-O$/0C$D !(#78M#N  %"E"E"G"G$2#8#8S   $2   "5t<< "44A!T""  #J''  ,L))  !1!!45 5 '0# $w)6 5I..?ueLL&-002UW['O 00')H(5#*%1CT"JJwJJ[0WUT`bfEgEmEmkmn5w88 122v2 V\\^C^TQqF{DAqD^CD#NSWW-@"%E#Nv#N  R[\pRqrRqB6ub!DRqrL J Dss; K, K, K2c$V^8dQhRRRRRR/#)rGrrIrrJrKrL)rMs"r?rNrNs!%%%s%t%rBch\VRR4p\V\4'd V'gR#RV3RV33FrwrEV'gK\\P !RV R2V44pV'gK=VR,pVRVP 4 V RV W7P4R 2pKt W0nR#) uVRewrite the cached prompt's ``Model:``/``Provider:`` lines after a provider switch. Not persisted: the stored row keeps the primary's labels so a restored primary replays a byte-identical prompt (prefix cache intact). Only the LAST occurrence of each line is touched — earlier matches may be user content (memory snapshots, context files)._cached_system_promptNModelProviderz(?m)^z: .*$r{) rr|rIrrfinditerrendr3)rUrrsprHrmatcheslasts&&& r?rewrite_prompt_model_identityr<s / 6B b#  b!5)J+AB  r{{eE7%#8"=> 72;D} %&ugRwr((*+6GHB C#%rBc V^8dQhRRRR/#)rGfbrkrJztuple[str, str, str]rL)rMs"r?rNrNs??D?%9?rBcf\VPR4;'gR4P4P4\VPR4;'gR4P4\VPR4;'gR4P4P R43#)rrrrt/)rIr}rrr)r>s&r?_fallback_entry_keyrAs z"((b ) / / 1 7 7 93rvvg?T?TRT;U;[;[;] z"((b ) / / 1 8 8 = ??rBc V^8dQhRRRR/#)rGr>rkrJrrL)rMs"r?rNrNs 7 74 7M 7rBcVPR4;'gRP4P4R8wdR#^RIHpV!R4;'g/p\;QJd<RTPR4TPR 434F 'gK R M1 R M-!RTPR4TPR 4344pT'dR#R # \ d#pR\ T4P 2uRp?#Rp?ii;i) zGReturn a skip reason for fallback entries known to be unusable locally.rrrN)get_provider_auth_stateznous_auth_unreadable:c3r"TF-p\V\4;'dVP4xK/ R#5ir:)r|rIrrWs& r?r>_fallback_entry_unavailable_without_network..s*v>uJq#&4417794>us77 access_token refresh_tokenTFnous_token_missing) r}rrhermes_cli.authrDrXrrr)rUr>rDstater has_tokens&& r?+_fallback_entry_unavailable_without_networkrMs z  b'')//1V;<;'/552vuyy?XZ_ZcZcdsZt>uvvuyy?XZ_ZcZcdsZt>uvvI46"66 <&tCy'9'9&:;; >>rBc(V^8dQhRRRRRRRR/#) rGr>rk fb_providerrIfb_base_url_hintrrJztuple[bool, str]rL)rMs"r?rNrNs)%%%3%-%\l%rBcJ^RIHpHpT!VPR4;'gVPR44pV'dRV3#V'd5VR9d.V!V4;'g/PR4pV'dRV3#VR8XgV'd\ V4'dR#R#) ad(explicit, api_mode) for a fallback entry from its ORIGINAL base_url: resolve_provider_client() rewrites a dual-surface /anthropic base to /v1, losing the Anthropic wire signal. An explicit ``api_mode`` always wins (even "chat_completions") and suppresses later re-detection; ``provider: anthropic`` without a base_url still resolves to anthropic_messages.)_get_named_custom_provider_parse_api_moder`rbT anthropic>rZr)FrU)Frk)hermes_cli.runtime_providerr^r_r}rY)r>r[r\r^r_rdeclareds&&& r?_fallback_api_mode_hintrcs Xrvvj1HHRVVK5HIHX~ {*;;.{;AArFFzR > !k!&6;QRb;c;c** $$rBc(V^8dQhRRRRRRRR/#)rGr[rIfb_model fb_base_urlrJrL)rMs"r?rNrN5s*C3UX]`rBcVR8XdR#^RIHp^RIHpV!W4pVe V!Wb4#VR 9d^RIHpV!V4#\ V4'dR#VPV4'dR#VPV4'gVPW!R7'dR#\V4pVR 8Xg*VPR 4'd\VR 4'dR #R#)zRe-detect api_mode from provider / resolved base URL / model when the hint pass landed on the chat_completions default (never called for an explicit api_mode). openai-codexrQ)opencode_model_api_mode)_opencode_family_for_custom) nous_api_moderUrk)rbedrockzbedrock-runtime.z amazonaws.comrY>rrr) hermes_cli.modelsri"hermes_cli.runtime_provider_customrjrXrkrY_is_azure_openai_url_is_direct_openai_url&_provider_model_requires_responses_apir2rr1) rUr[rerfrirjopencode_familyrkhosts &&&& r?_fallback_api_mode_resolvedrt5sn$ 9N1+KO"'AA==6X&&k**# !!+..! "";//53_3_`h3_33 [ )DiDOO4F$G$GLabmo~LL! rBc$V^8dQhRRRRRR/#)rGr[rIrerJrKrL)rMs"r?rNrNTs'ppppPTprBc\VRR4pVeg\VRR4;'gRP4P4pV'd,WA8wd&\P RWV4R;VnVn\VRR4fP^RIHpV!V4pV'd7VP4'dW`n\P RW4R#R#R#R# \d#p\PRYT4Rp?R#Rp?ii;i) zRebind the credential pool when the provider changes (else rate_limit/billing/auth recovery mutates the wrong credentials and overwrites the fallback's base_url). Same-provider pool: kept._credential_poolNrrznFallback to %s/%s: clearing primary credential pool (pool_provider=%s) to prevent cross-provider contamination load_poolz4Fallback to %s/%s: attached fallback credential poolz7Fallback to %s/%s: could not attach credential pool: %s) rrrr[rrw_credential_pool_entry_idagent.credential_poolryhas_credentialsrXr)rUr[re existing_pool pool_providerry fallback_poolrs&&& r? _rebind_fallback_credential_poolrTsE#5t!>!@!@)6& RT_j"A} 8 p LLRT_kn o o ps$CC4C D#DDcV^8dQhRR/#rrL)rMs"r?rNrNjs^brBc V\P8wd\PRW$V4R#^RIHpHpV!V!44;'gRpVR8XdRMRV R2p \PRWW4WY4R#) aA billing switch is a WARNING naming the profile, both models and the remedy: the gateway persists the turn as a transient failure otherwise, and nothing in the log says the paid model was refused for credits or how to fix it (#115702). Other reasons stay INFO.u"Fallback activated: %s → %s (%s)N)get_hermes_homeprofile_name_for_homerz hermes modelz hermes -p z modeluProfile %s: %s via %s refused for billing/credits — using fallback %s via %s. Top up credits, or run `%s` to pick a model this account can use.)r billingr[rrrrr\) rUr old_model old_providerrer[rrprofileremedys &&&&&& r?_log_fallback_activatedrjsn''' 8){[G#O$56CC)G&)3^:gYf9UF NN LLKrBc V^8dQhRRRR/#rGrrPrJrrL)rMs"r?rNrN{s-BtrBc^RIHpVP'dKW9dE\\ VR^4;'g^\ P !4\,4VnR#)zChain exhausted (always False). A non-empty chain walked on a non-rate-limit failure arms a short cooldown so next turn's restore_primary_runtime stays gated instead of replaying the whole context across every provider again.)_RATE_LIMIT_FAILOVER_REASONS_rate_limited_untilF) agent.fallback_cooldownr_fallback_chainrjrr monotonic_FALLBACK_EXHAUSTED_COOLDOWN_Sr)rUrrs&& r?_fallback_chain_exhaustedr{sNE !K$' E0! 4 9 94>>;KNl;l%n! rBc$V^8dQhRRRRRR/#)rGr[rIrerJrrL)rMs"r?rNrNs!66#666rBc\VRR4pVe9\VRR4;'gRP4P4V8wd^RIHpV!V4pVe/VP 4'dVPVR7'dR#VPVR7pVRJ;'g V\P!4, R8# \ dR#i;i) aTrue when every credential the candidate would use sits in an exhaustion cooldown longer than the retry loop's longest wait (the 600s Retry-After cap): switching to it only fails the turn the same way the primary just did (#89401). A short throttle still gets its chance.rwNrrrxFr8r) rrrr{ryrXr| has_availablenext_available_atr)rUr[rer}ryuntils&&& r?_candidate_pool_exhaustedrs 5,d 3D |j"5;;BBDJJLP[[  7[)D |4//11T5G5Gh5G5W5W  " " " 2E D= 5 5EDIIK/#55   s C CCc 0V^8dQhRRRRRRRRRR R R /#) rGr>rkfb_keytupler[rIre unavailablerrJrrL)rMs"r?rNrNs:!!t!U!QT!`c!ru!z~!rBc W%9d\PRV4R#V'd V'gR#^RIHpV!WV4'd\P RW44R#\ WV4'd\P RW44R#\W4pV'd+VPV4\P RW4V4R#^RI H pH p TP\VRR 4\VR R 4\\VR R 4;'gR 4R 7p TPY4VPR 4;'gR R 7p V !W4'd8\P R Y4V P ;'g V P"4R#R#)zTrue when the entry is already unavailable, malformed, locally unusable, or resolves to the backend that just failed (falling back to it would loop the failure).z/Fallback skip: %s previously marked unavailableT)_is_entitlement_rejectedz@Fallback skip: %s/%s was rejected as unentitled for this accountzKFallback skip: %s/%s credential pool is exhausted (every entry in cooldown)zMFallback skip: %s/%s is not locally usable (%s); suppressing for this session)BackendIdentityshould_skip_candidaterrrrt)rrrtzUFallback skip: chain entry %s/%s resolves to the same backend as the current one (%s)F)r[rrrrrr\rMaddagent.backend_identityrrbuildrrIr}rtr) rUr>rr[rerrlocal_skip_reasonrr current_identfb_idents &&&&&& r?_should_skip_fallback_candidatersR FO h@H== VXcn X>>dfq|CENfhs@Q R N#))75*b3QeWb)CzSU8V8\8\Z\4]*_M$$kUWU[U[\fUgUmUmkm$oHX55 c =#9#9#S#S]=S=S U rBcV^8dQhRR/#rrL)rMs"r?rNrNs22$2rBc \VRR4pV'gR#^RIHpT!VPVP\ VP \4'd VP MRVP\VRR4\VRR4R7pVPVPW0P\VRR4VPVPR 7\VR R 4R Jd^R I H pV!V4R#R#)zPoint compression limits at the fallback model's context window (not the primary's), respecting the explicit model.context_length config override.rnN)get_model_context_lengthr_config_context_length_custom_providers)rtapi_keyrconfig_context_lengthcustom_providersr)rrvrtrrr` _compression_feasibility_checkedFT)"revalidate_compression_feasibility) ragent.model_metadatarrrtr|rrIr update_modelr`r&r)rU compressorrfb_context_lengthrs& r?#_update_fallback_context_compressorrs 4d;J =0 enn!+EMM3!?!? R%e-EtL (;TB kk*;nny"-QVQ_Q_u8%@DHU*51IrBcV^8dQhRR/#rrL)rMs"r?rNrNs } }4 }rBc8^RIHp^RIHpT!V!4;'g/VP4Vn\ PRVPVP 4R# \d-p\ PRTPT4Rp?R#Rp?ii;i)zPer-model override > global reasoning_effort (YAML False = disabled); a config load failure keeps the current reasoning_config rather than killing the swap.) load_config)resolve_reasoning_configz*Fallback %s: reasoning_config resolved: %szGFailed to resolve reasoning_config for fallback %s; keeping current: %sN) rrrrrrr[rrXr)rUrr_reasoning_errs& r?$_reresolve_fallback_reasoning_configrsv} 2=!9+-:M:M2u{{![ @%++uOeOef } ^`e`k`km{||}sA"AA"" B-!BBc(V^8dQhRRRRRRRR/#)rGrrIr old_base_urlrJrKrL)rMs"r?rNrNs0pp3pcpY\paeprBc ^RIHpHp\VRR4;'g.pV!W!W6R7;'g/p\ \VR/4;'g/4pVP R4p \ V \4'dfV'd^V P4U U u/uFwrW9dWV ,8XdKWbK p p p V 'dWR&MVPRR4Wn V!W4\PRVP\VR/4;'g/P R44R#uup p i \d-p \PRTPT 4Rp ? R#Rp ? ii;i) u[Drop the OLD provider's custom_providers-contributed extra_body keys, then merge the fallback provider's own. KEY-SCOPED: a key is dropped only if its value still equals what the old provider's config injected — a caller override of the same key won at init and differs, so it survives; keys the new provider redefines are re-added by the merge.)%_custom_provider_extra_body_for_agent!_merge_custom_provider_extra_bodyrN)rrrtrr~rz$Fallback %s: extra_body resolved: %szAFailed to resolve extra_body for fallback %s; keeping current: %s)agent.agent_initrrrrkr}r|r8rDr~r[rrrXr)rUrrrrrrold_provider_eb overrides existing_ebrr.scrubbed_eb_errs&&&& r?_rescope_fallback_extra_bodyrsS pm"5*=tDJJ?q}bhhfh(;R@FFBG mmL1 k4 ( (_)4):):)<w)<QEY^_stcu^u)G'4  vCJ#g,)?QWPX&rBc V^8dQhRRRR/#rrL)rMs"r?rNrNs::)>:Y]:rBc ^RIHpHpV!WV4'dR#V!WVR7pVP\ VP 48d \ W4#VP VP,pV;P^, un\V4p\VRR4f\4Vn VPpVPR4;'gRP4P4p VPR 4;'gRP4p \WWyW4'dEK^R IHp V !WW4p V f+\"P%R V 4VP'V4EKOV wrVP(p \+W V 4R V R V R\-V4 RV R V R2 pVeR\/^\0P2!VP4\6P8!4, 44pVRV R2, p\;W4RVn\?V 4\?V 43Vn \CWWW4^RI"H#pV!WVR7\IV4^RI%H&pV!VP(VPNWR8HR7Vn(R# \Rd<pT R8XdTP'T4\"PURT T4Rp?EKRp?ii;i)uSwitch to the next fallback model/provider in the chain; False when exhausted. Swaps client, model slug and provider in place so the retry loop continues on the new backend; client construction goes through resolve_provider_client (no duplicated provider→key mappings).)_arm_rate_limit_cooldownswitch_deferred_by_resetF)reset_atT_unavailable_fallback_keysNrrr)bind_route_entryz.Fallback to %s failed: provider not configuredu⚠️ Model fallback: z via z unavailable (z ); using r$z Primary retry eligible in ~z s; recovery is not guaranteed.)record_fallback) from_provider to_providerr)&resolve_native_compaction_capabilitiesrh)rrtrrXrz"Failed to activate fallback %s: %s)+rrr_fallback_indexr rrrArrrr}rrragent.route_bindingrr[r\rrr<rSrjr~ceilrrrr_provider_fallback_activerI_provider_fallback_router.hermes_cli.observability.shared_metrics_eventsrrrrrtruntime_capabilitiesrXr5)rUrrrrcooldown_secondsr>rrr[rerboundrrrrrres&&& r?try_activate_fallbackrs[x88/Q   C(=(=$> >,U; ;  " "5#8#8 9 "$R( 56 = E/2uE ,66 vvj)//R668>>@ FF7O))r002 *5f8 a a $  <$U FE}OQ\]'&+ #I{{H )%; G*)E,H)&12)H:U;-WXZ  +499U-F-FIY-Y#Z[ 8 Cbcc #E 2/3E +.1(mS=M-NE * #E9H b V ,X^ _  & V)OkkENN[sAdA*BE & f$' LL=x K   s6:J3DJ K /KK z>I reached the iteration limit and couldn't generate a summary.c V^8dQhRRRR/#)rGrGrrJrL)rMs"r?rNrNKsLLTLdLrBc&VP4pVPpV'dOVPR8Xd>\\VRR4RR4pT;'g/P R4;'gTp.pVFpVP 4pVP Wg4\FpVPVR4K VP R4R8XdVPRR4\V4V'dVPWsR 7VPV4K VP;'gR p VP'd)V R ,VP,P4p V 'dRR R V /.V,p\VP ;'gR4F6wrTP#V 'd^M^V ,V P 44K8 VP%V4p^RIHp Hp V !W]!V44\-W4VP/V4pVFgp\1V\24'gKVUu.uF6p\1V\44'gKVP7R4'gK4VNK8 upFpWK Ki VFDp\1VP R 4\44'gK*VR ,P4VR &KF ^RIHpHpV!V4VUu.uF pV!V4NK pp\?V4V#uupiuupi)aWire-ready messages for the summary call, mirroring the main loop's api_messages build (sidecar substitution, tool-call repair, thinking-only drop, underscore-key sweep). ``reasoning_details`` is kept: the anthropic_messages converter rebuilds signed thinking blocks from it, and the chat-completions transport already drops it on the wire for routes that do not replay it (``_chat_summary_attempt`` -> ``_build_api_kwargs``).rZrHNlast_aggregator_slotrrtoolrr8rrsystemr) evict_stale_outbound_tool_imagesoutbound_retired_image_idsr)_canonicalize_api_tool_calls_clone_message_for_sendrL) _should_sanitize_tool_callsrrrr}r__copy_reasoning_content_for_api_SUMMARY_FOREIGN_MESSAGE_KEYSrDr#_sanitize_tool_calls_for_strict_apir~r3ephemeral_system_promptrr prefill_messagesinsert_sanitize_api_messagesagent.context_compressorrrr&#_drop_thinking_only_and_merge_usersr|rkrIragent.conversation_looprrr!)rUrGneeds_sanitizesanitize_modelagg_slotrr(api_msgreffective_systemidxpfmrrr internal_keyrrms&& r?_iteration_summary_api_messagesrKs668N[[N%..E175(D9;QSWX"..b--g6HH.L((* --c;0C KKT "1 ;;v & ( KK % w'   5 5g 5 TG$-02288b $$$,v58U8UU\\^96FGH<W e44::;"2QS@#((*M<// =Le$\3Me3TU %U9<<\JL gt $ $,3 `Gqz!S7Iall[^N_G ` )!a   gkk),c 2 2!(!3!9!9!;GI  ^ .9EE 1+A. LE!,/ !aFs?L L 5L )Lc V^8dQhRRRR/#)rGapi_request_idrI retry_countrrL)rMs"r?rNrNsY\rBc^RIHpTPY#\\ VRR4;'gR4\\ VRR4;'gR4R\\ VRR4;'gR4RVRR R V/R R 7#) rT relay_llmrrrr`rkr call_roleiteration_summaryrT)r model_namemetadatadefer_logical_completion)rUr execute_currentrIr)rUrrr=rr s&&&&$ r?_managed_summary_callrs  $ $  B/==: >3wW\^egiOjOpOpnpKqc'%R"@"V"VDVW nk;NP]_jl!% % rBcV^8dQhRR/#rwrL)rMs"r?rNrNs . .# .rBc *\V4'd\PR4R#VP4P!V3/VBpVP 'd\PR4VP ;'gRP4#)z:Iteration summary returned a router timeout shim; retryingrz5Iteration summary emitted tool calls; discarding them)rr[r\rynormalize_responserrr)rUronormalize_kwargs normalizeds&&, r? _summary_textrsth''ST%%'::8XGWXJ NO    $ $" + + --rBc V^8dQhRRRR/#rGrrrrIrL)rMs"r?rNrNs   c rBcaaRVV3RllpV#)c V^8dQhRRRR/#rGrrrJrIrL)rMs"r?rN,_codex_summary_attempt..__annotate__s Q Qc Qc QrBc<SPS4pVPRR4VPRR4VPRR4\SSPV44#)rIN tool_choiceparallel_tool_calls)_build_api_kwargsrDr_interruptible_api_call)r codex_kwargsrUrs& r?_attempt(_codex_summary_attempt.._attempts`..|<  $'-.5UE$A$A,$OPPrBrLrUrrr$sff& r?_codex_summary_attemptr's Q Q OrBc V^8dQhRRRR/#rrL)rMs"r?rNrNs  D # rBc"aaaRVVV3RllpV#)c V^8dQhRRRR/#rrL)rMs"r?rN0_anthropic_summary_attempt..__annotate__s[[c[c[rBcR<SP4PSPSRSPSPSP SP 4\SRR4R7p\SVS4p\SSVSPVR7p\SVSP R7#)Nro)rrGrIrsrrtrurtr)strip_tool_prefix) ryrzrrsrr|r}rrrr"r)rant_kwrorUrrs& r?r$,_anthropic_summary_attempt.._attempts%%'44++ DUM]M]"33e>W>W88:WUTikoEp5r8v|T( >65+H+HVacUH@Y@YZZrBrLr&sfff r?_anthropic_summary_attemptr1s[[ OrBc V^8dQhRRRR/#rrL)rMs"r?rNrNstSrBcaaaSPV4o\SS4^RIHpSPR8XdKV!SP 4'd3SP P PPV4SR&RVVV3RllpV#)rT)%_moa_client_consumes_prepared_requestrZr^c V^8dQhRRRR/#rrL)rMs"r?rN+_chat_summary_attempt..__annotate__s..c.c.rBcP<\SSSSPVR7p\SV4#)r-)rr"r)rrorUrsummary_kwargss& r?r$'_chat_summary_attempt.._attempts0) >>53P3P#%UH--rB) r!r%rr4rrHr[r\r])rUrrr4r$r8sf&f @r?_chat_summary_attemptr:sw ,,\:NUN3M ~~#H#V#V27,,2C2C2O2O2W2WXd2e./.. OrBrQrUc$V^8dQhRRRRRR/#)rGrGrapi_call_countrrJrIrL)rMs"r?rNrNs!444444rBcRVP R2p\VRR4'd\PV4MVP VRR7R\ P !4 2pRp^R IHp\VR R R V/4p\W4p\PVP\4p V !WV4p \p RFnp V !V 4p V 'gKR V 9d7\ P"!RRV \ P$R7P'4p V 'dRp\VR RR V /4T p M ^RIHpVP7WER7V # \(d*RpT'dTR,TJdTP+4h\,d;p\PRT4^RIHpT!RTPR7p Rp?LRp?ii;i ^RIHpTP7YER7i;i)zSRequest a summary when max iterations are reached. Returns the final response text.u$⚠️ Reached maximum iterations (z). Requesting summary...suppress_status_outputFT diagnosticziteration-summary:failed)MAX_ITERATIONS_SUMMARY_REQUESTruserrzz.*?\s*rrsuccessrrz"Failed to get summary response: %s) site_copymax_iterations_no_summary)limitNr )outcome)rTrr6)max_iterationsrr[r\ _safe_printrrrrBrr_SUMMARY_ATTEMPT_BUILDERSr}r`r:_EMPTY_SUMMARY_RESPONSErr'rrrrDrXagent.turn_failure_copyrErUr complete_logical_call)rUrGr<r\summary_api_request_idsummary_call_outcomerBnudger build_attemptattemptfinal_responserrrrEr s&&& r?handle_max_iterationsrUs4U5I5I4JJbcGu.66 w 'd31$**,@#H 8ffiA_%` aE ^6uG 155ennF[\ 5KL1!K;'DD vv6D RXXZ'0$x&+y$)OP!% "0 $''(>']   +  - LLN \;Q?5"#>eFZFZ[\ $''(>']sO>BE E -G.E 0G G &GG0F=8G=GGGc V^8dQhRRRR/#)rGr-rIrJrKrL)rMs"r?rNrN sZZ3Z4ZrBcaaRRloR\RV3Rl3RV3RlRV3R l33FOwr#rEV!S4'd4VP'd \P!R V R S R 24KFKHV!4KQ R# \d<pTP'd\ P R TST4Rp?KRp?KRp?ii;i)zPer-turn VM + browser cleanup for a task. Skips ``cleanup_vm`` for persistent terminal envs (``_cleanup_inactive_envs`` reaps them after ``terminal.lifetime_seconds``) and ``cleanup_browser`` in headed mode (the inactivity reaper handles idle sessions).cV^8dQhRR/#rRrL)rMs"r?rN,cleanup_task_resources..__annotate__# s@@T@rBc^RIHpV!4# \d,\\P P R44u#i;i)rT_is_headed_modeAGENT_BROWSER_HEADED)tools.browser_tool_cloudr\rXrrrr}r[s r?_headed'cleanup_task_resources.._headed# s> @ @"$ $ @ '=>? ? @s 3AAVMzcleanup_vm for persistent envc6<\4PS4#r:)rc cleanup_vmr-sr?r@(cleanup_task_resources..+ s35K[K[\cKdrBbrowserc<S!4#r:rL)_tidr_s&r?r@re, srBz"cleanup_browser for headed sessionc6<\4PS4#r:)rccleanup_browserrdsr?r@re, sZ]Z_ZoZopwZxrBzSkipping per-turn rz; idle reaper will handle it.z$Failed to cleanup %s for task %s: %sN)r0rrrrXr[r\)rUr-rHskip skip_whatcleanuprr_s&f @r?cleanup_task_resourcesrn s@  "ACde *,PRxy,'Y ZG}}(((MM$6yk7)Kh"ij) , Z$$$EugWXYY% Zs#A: A:-A:: C*B;;Cdropped_tool_namesoverflow_terminalr` clean_eofcVR8Xd;\\RTT\RT;'gRR7.RRTT;'gRVVR7 #\\T\^\WRVR 7\R 7.TT;'gRVVR 7#) aStub for an SSE stream that ended without ``finish_reason`` after delivering content. Tagged ``PARTIAL_STREAM_STUB_ID`` + ``FINISH_REASON_LENGTH`` so the loop enters its continuation/retry path instead of accepting truncated output as a complete turn (#32086). ``overflow_terminal`` (``full_content=None``): the stream died on a context-overflow error. Seeding the recovered text as a continuation stub would grow every later request into the same overflow (#106260); the loop treats the marker as terminal and ends the turn via the recovery contract. ``api_mode="anthropic_messages"`` returns a Messages-shaped stub (``content`` block list + ``stop_reason="max_tokens"``) so AnthropicTransport validates it and the loop continues instead of entering the invalid-response retry ladder (#45908). Empty content keeps one empty text block: validate_response rejects an empty list for ``max_tokens``. ``clean_eof``: the stream ended with no transport exception and no ``finish_reason`` (server/intermediary closed cleanly). Only the two clean-EOF sites in ``_finish_chat_stream`` pass True; the stub built after a real transport exception keeps False so the loop can word the two failure modes differently (#102766). rUrzrr)rrrsN) rrrrr stop_reason stop_sequenceusage_dropped_tool_names_overflow_terminal _clean_eof)rrrrrrzr)rrrrurvrwrx)rr r ) r full_contentfull_reasoningr  usage_objrorpr`rqs &&&&&$$$$r?_build_partial_stream_stubr}9 s0''%$&|7I7IrJK$ 2 : :d0     ! #PT"02.   .66$,  rBc V^8dQhRRRR/#rrL)rMs"r?rNrNx s ` ` `4 `rBca\VRR4R 9dR#\VRR4;'gR RV 2P4oRS9;'d;\;QJdV3RlR 4F 'gK R # R#!V3RlR 44#) a$A 400/422 whose body names ``stream_options`` as an unknown/extra field: strict OpenAI-compatible endpoints (Azure AI Foundry MaaS, Pydantic ``extra_forbidden``) reject the usage extension outright (#9705). Distinct from "stream not supported", which flips the whole session to non-streaming.rhNFrjrrstream_optionsc3,<"TF qS9xK R#5ir:rL)rrrjs& r?r*_rejects_stream_options.. s,`^aT ^r*T)ri)r not supported unrecognized unexpectedr)rrr)rrjs&@r?_rejects_stream_optionsrx s sM4( :c62&,," -Qse 4 : :  3sI&' . sC1Bv"1Br*T)rrr|rrIrr_SSE_CONN_PHRASES)r _APIErrorrs& @r?_is_sse_connection_errorr s], c % %mT)J)JC I 3C1BC33C3C3C1BC CCrBc V^8dQhRRRR/#)rG name_defaultrIrJrkrL)rMs"r?rNrN s>>>>rBc R\\VRR4;'gR4R\\VRR4;'gT4R\\VRR4;'gR4/#)zG``session_id``/``name``/``model_name`` kwargs for ``relay_llm.stream``.rrrrr rrIr)rUrs&&r?_relay_stream_identityr s] #ge\2>DD"EGE:r2BBlCc'%"5;;< >>rBc V^8dQhRRRR/#)rGr`rIrJrkrL)rMs"r?rNrN s  C D rBc\VRR4'dRM(\\VR^4;'g^4^8dRMRpRVR\VRR 4R V/#) is_subagentF delegatedrfallbackprimaryr`r_current_api_request_idNr )rr)rUr`r s&& r?_relay_stream_metadatar sb '}e D D$'7H!(L(Q(QPQ$RUV$Vj\e "2GEC\^b4cY  rBcV^8dQhRR/#rwrL)rMs"r?rNrN s  C rBc \P!\4;_uu_4\VRR4p\ V\ \ 34'dV'd V^,MRp\\VRR4RR4p\ V\4'd VuuRRR4#RRR4\P!\4;_uu_4\VRR4p\ V\4'd VuuRRR4#\ V\ 4'd*RPRRV444uuRRR4#RRR4R# +'giL;i +'giR#;i)rNrzrrc3V"TFp\V\4'gKVxK! R#5ir:)r|rIrWs& r?r%_stream_final_text.. s n&W[efgil[m11&Ws) )c3<"TFp\VRR4xK R#5i)rNr)rr!s& r?rr s&WwtwtVT'B'Bws) rrrXrr|rrrIrY)ror first_choicers& r?_stream_final_textr s   Y ' '(It4%/$%G%GGwqzY] ', 4@)TR gs # # ( ' $ (   Y ' '(It4 gs # # ( ' gt $ $77n&Ww&Wnn ( ' % (  ( ' ( ' s#1D?:D?%E54E? E  E# c\VRR4pVeV!4V!4p\TRR4pTeT!\T4RRR7T# \d,p\TRR4pTeT!RR\T4R7hRp?ii;i)zBracket ``run()`` with the agent's ``_emit_stream_start`` / ``_emit_stream_end`` hooks when present (end carries the final text on success, the error string on failure) and re-raise._emit_stream_startN_emit_stream_endrF) final_textfinishedr5T)rrXrIr)rUr;rrorr8s&& r?_with_stream_emittersr s E/ 6E  5 %+T 2C  )(3d$O O e/6 ? 2SX > sA A>&A99A>cV^8dQhRR/#rOrL)rMs"r?rNrN s+++rBc^aaVSn\SVV3Rl4RSn# RSni;i)zCodex streams internally via _run_codex_stream (reached through _interruptible_api_call); park ``on_first_delta`` on the agent so it can pick it up, and bracket the call with the stream start/end emitters.c&<SPS4#r:)r"rsr?r@+_stream_codex_passthrough.. sE4Q4QR\4]rBN)rSrrUrrTsff&r?_stream_codex_passthroughr s.#1E+$U,]^&*#d#s# ,cZ^RIHpV!R\V4/4# \dR#i;i)zRelay finalizer for Bedrock: a stream without messageStop has no complete response to record, so return None and let the live consumer raise (#109988).stream_converse_with_callbacksrN)rCrrr)rrs& r?_finalize_bedrock_relay_eventsr s3E-xf.FGG s  **c]tRtRtRtRRltRRltRtRtR R lt R R lt R t RRRllt RRlt RtRtRtR#)_BedrockStreami zBedrock Converse streaming: boto3 ``converse_stream()`` on a worker thread with real-time delta callbacks, polled by an interrupt / stale-event watchdog (same UX as the Anthropic and chat_completions streams).cV^8dQhRR/#rOrL)rMs"r?rN_BedrockStream.__annotate__ sMM$MrBc WnW nW0nRRRR/VnRVnRVn\ P !4VnVPVnVPRR4Vn \W4Vn R#)roNr5Fr<r=) rUrrTresultfirst_delta_firedrr started_at last_eventr}rGrrgrsrUrrTs&&&&r?rq_BedrockStream.__init__ sn $,!4$7 !& %))+//!nn%9;G 9%LrBcV^8dQhRR/#rwrL)rMs"r?rNr s999rBc :VPPRR4#)r r)rr}rs&r?_model_BedrockStream._model s""9i88rBc RVnVP'gYVP'dERVn\P!\ 4;_uu_4VP4RRR4R#R#R# +'giR#;ir)rrrTrrrXrs&r? _fire_first_BedrockStream._fire_first s` $%%%$*=*=*=%)D "$$Y//##%0/+>%///s A44 B c aaVV3RlpV#)zQWrap a delta callback so the first delivered event also fires ``on_first_delta``.c8<SP4S!V4R#r:)r)rfirerss&r?_on(_BedrockStream._after_first.._on s     KrBrL)rsrrsff r? _after_first_BedrockStream._after_first s  rBcV^8dQhRR/#rGnext_api_kwargsr"rL)rMs"r?rNr sxxNxrBc D\\V4RVPR7#)T)rr2)rMrk_fall_back_to_converse)rsrs&&r? _open_stream_BedrockStream._open_stream s%d?&;D[_[v[vwwrBc V^8dQhRRRR/#)rG final_kwargsrkrrXrL)rMs"r?rNr s L L4 Li LrBc ^RIHpRVPnVPP RRR7\ P R\V4P4V!VP!R/VB4#)rT)r9Tu ⚠ AWS IAM denied bedrock:InvokeModelWithResponseStream — falling back to non-streaming InvokeModel. Grant that action to restore streaming output. r?u`bedrock: converse_stream denied by IAM (%s) — using non-streaming converse() for this session.rL) rCr9rU_disable_streamingrJr[rrrrF)rsrHrrr9s&&&& r?r%_BedrockStream._fall_back_to_converse sm F(, %  BNR  T  ?@DS @R@R T*6??+J\+JKKrBc Zaa a aSPo Rp^RIHp^RIHp.o RR/oRV V3RllpRV V3RllpRV3R llp^R IHpV!4pVP!\SP4SP3/\S R4BRV 3RlRVRS PRRRVRRR\S R4RR /BpS P ;'gS P";'gTp T!RV/S P%4'dSP'S P(4MRSP'S P*4V 'dSP'S P,4MRV 3RlVR7p VP0;'gT SP2R&VeVP54R#R# \ d\PR R R 7RpELui;i \.dTP0fhRp Li;i \ dp T SP2R &Rp ? LRp ? ii;i TeTP54ii;i)!Nr rrc V^8dQhRRRR/#)rG_streamrrJrKrL)rMs"r?rN,_BedrockStream._worker..__annotate__% s C C C CrBc$<\S4SR&R#rN)r.)rrU writer_tokens&r?_stream_created/_BedrockStream._worker.._stream_created% s(;E(B W%rBc V^8dQhRRRR/#)rG_eventrrJrrL)rMs"r?rNr( s O Oc Od OrBcF<SR,pVRJ;'g \SV4#r)r/)rtokenrUrs& r? _accept_event-_BedrockStream._worker.._accept_event( s'$W-}NN(@(NNrBcV^8dQhRR/#rrL)rMs"r?rNr, s . .$ .rBc<<\P!4SnR#r:)rrrsr? _stamp_event,_BedrockStream._worker.._stamp_event, s"&))+rB)#has_reasoning_stream_observer_hooksz-plugin reasoning stream observer check failedTrFrl finalizerc<\S4#r:)r)intercepted_eventssr?r@(_BedrockStream._worker..8 s "@AS"TrBon_stream_createdon_chunk chunk_adaptercV#r:rL)rs&r?r@r: sErB accept_chunkcompleted_response_predicatec.\\VRR44#)rN)rrrs&r?r@r; sd78U^`dCe>frBrrrrc<SP#r:)rrsr?r@rC s u/I/IrB) on_text_delta on_tool_starton_reasoning_deltaon_interrupt_checkon_eventror5)rUr rCragent.plugin_stream_hooksrrXr[rrrkrrrr~rrr_has_stream_consumersr_fire_stream_delta_fire_tool_gen_started_fire_reasoning_deltarrTrr)rsrr rrrrrplugin_reasoning_observerwants_reasoningstreamed_responserrUrrsf @@@r?_worker_BedrockStream._worker sJ /  ' L!# #T?L C C O O . . 2Y,O,Q) %%d4??&;T=N=Na( :aTa#2a=O=G <(G $G,7G,$GG,GG, G)&G,(G))G,, H7H H HHH*Nc V^8dQhRRRR/#)rGrzrIrJrKrL)rMs"r?rNrP s((S($(rBc VPP'gR#\VP\P!4VP, VP R7Ve\ VRR7\V4h)NrzBedrock streamingrH)rUrrrrrr_r)rsrzr]s&&&r?_raise_if_interrupted$_BedrockStream._raise_if_interruptedP sZzz... ) JJ doo5H]H] _   +F:M Nw''rBc V^8dQhRRRR/#rG stale_elapsedr\rJrKrL)rMs"r?rNrZ sTTuTTrBc TVPp\PRWPVPVP 44VP R\V4 RVP 4 R24\V4^RI H pV!VP4\P!4Vn\V4\!R\V4 R \VP4 R 24VP"R &R# \d!p\PRT4Rp?LRp?ii;i) zcNo event past the stale timeout = wedged stream (the worker would block in the event loop forever).ukBedrock stream stale for %.0fs (threshold %.0fs) — no events received. region=%s model=%s. Aborting call.u"⚠️ No events from Bedrock for s (model: z). Aborting...)r6z)bedrock: stale client eviction failed: %sNz&Bedrock stream produced no events for z s (threshold uFs) — aborting stalled stream so the retry/fallback path can recover.r5)rUr[r\rgrGrrrrrCr6rXrrrrrr)rsrrUr6 _inval_excs&& r?r_BedrockStream._on_staleZ s ;lt$R?t%R@t&]RA4t'RBRCRDRCRERCRFRC/RGlt(]RHRI/RJRKll4t)RLt*RMRNlt+RORPlt,RQRRlt-RSRTlt.RURVlt/RWt0RXt1RYRZlt2R[R\lt3R]R^lt4R_R`lt5RaRblt6RcRdlt7Ret8Rft9Rgt:RC#)h_StreamingCalli zOne streaming request on the chat_completions / anthropic_messages wire. State shared between the request worker and the poll-loop monitor (heartbeat, stale kill, interrupt abort) lives on the instance, mutated from both threads.cV^8dQhRR/#rOrL)rMs"r?rN_StreamingCall.__annotate__ s11$1rBc WnW nW0nRVnRRRRR./Vn\ V4VnRR/VnRR/VnRR/Vn RR/Vn R\P!4/Vn R RRR /Vn RVn\P !4VnR ^R \%4R ^R^/Vn\%4VnRR/VnR;Vn;VnVnVP34VnR#)Nror5partial_tool_namesrFrr%rXprogressr^rrdiscarded_chunksdiscarded_bytesr)rUrrTr]rrclients_request_cancelledrdeltas_were_sentprovider_tool_in_flightrlast_chunk_timer*_stream_stale_timeoutrrstream_attempt_lockrstream_attempt_state_stale_counted_attemptsmanaged_stream_holder _writer_token_attempt_request_client_attempt_stream_response _live_route_request_routers&&&&r?rq_StreamingCall.__init__ s  $, !4$8LbQ -e4 $+E"2"(%!&(-u~$ #TYY[1 *D#s;&*"#,>>#3 %.;GY[\^oqr$s!14$&.%5"\```T9D. s,sErTSb177R88Ers00)rrrtr`)rUrrs&@r?r@_StreamingCall._live_route s0 usErsususErsssrBcV^8dQhRR/#rRrL)rMs"r?rNr- strBc 4VP4pWP8XdR#\PRVP^,VP^,;'gVP^,V^,V^,;'g V^,4R#)aTrue once ``/model`` (``switch_model``) re-pointed the agent while this request was in flight. The captured payload names the OLD model and is shaped for the OLD provider, but every (re)open builds its client from the LIVE agent, so a retry would send a foreign model slug to the new base_url (404 + a rate-limit hold, #112121). The turn loop rebuilds the request for the current route on its own next attempt, so hand the error back to it. FzStream retry skipped: model/provider switched mid-request (%s via %s -> %s via %s); handing back to the turn loop to rebuild the request for the current route.T)r@rAr[r\)rslives& r?_route_switched_under_request,_StreamingCall._route_switched_under_request s! && & Z    "D$7$7$:$T$Td>Q>QRS>TVZ[\V]_cde_f_q_qjnopjq rBcV^8dQhRR/#rrL)rMs"r?rNr- sTrBc \P!\4;_uu_4V!V!RRR4R# +'giR#;i)z@Best-effort callback: never let a display hook break the stream.N)rrrX)rargss&*r?_quiet_StreamingCall._quiet s+  + + I, + + +s 4 A c V^8dQhRRRR/#)rGrrrJrL)rMs"r?rNr- s##rBc "WPR&V#r@)r<rs&&r?_set_managed_stream"_StreamingCall._set_managed_stream s/5""8, rBcV^8dQhRR/#rrL)rMs"r?rNr- sVVtVrBc \VPPRR4RR4p\V4'd V!4R#R# \d\ P RRR7R#i;i)rNrz&Managed provider stream cleanup failedTr)rr<rDrrXr[r)rsrs& r?_close_managed_stream$_StreamingCall._close_managed_stream sb2266xFQUV E?? V  V EPT U VsA"A+*A+cV^8dQhRR/#rrL)rMs"r?rNr- ssrBc 8VP;_uu_4VPR;;,^, uu&\VPR,4pRRR4RRuVPR&VPR&.VP R&X# +'giL@;i)rNFr%r0r/)r9r:rr6r*r)rs attempt_ids& r?_start_stream_attempt$_StreamingCall._start_stream_attempt s  % % %  % %i 0A 5 0T66yABJ& QVW[M$$U+T-A-A*-M,. ()& %s ?G))+6::7C&  LLA7 S  & %s AB B c V^8dQhRRRR/#rGstream_attempt_idrrJrrL)rMs"r?rNr- snn3n4nrBc VP;_uu_4VPpV\VR,48H;'d WR,9uuRRR4# +'giR#;i)rrN)r9r:r)rsrerKs&& r?_stream_attempt_is_active(_StreamingCall._stream_attempt_is_active sL  % % %--E$E),<(==mmBSal[mBm& % % %s 4A A% c V^8dQhRRRR/#rdrL)rMs"r?rNr- sOOsOtOrBc VP;_uu_4WPR,9uuRRR4# +'giR#;i)rN)r9r:rsres&&r?_stream_attempt_was_cancelled,_StreamingCall._stream_attempt_was_cancelled s.  % % %$(A(A+(NN& % % %s 5 A c V^8dQhRRRR/#)rGrerrJrKrL)rMs"r?rNr- s  S D rBc \\V44pVP;_uu_4VPpVR;;,^, uu&VR;;,V, uu&VR,VR,reRRR4X^8HpV'd\ P M\ P!V'dRMRR,WX4R# \d^pLi;i +'giLk;i)rTr1r2Nz3Discarding chunk from superseded stream attempt %s z-Discarded stale stream chunk from attempt %s z((discarded_chunks=%s discarded_bytes=%s))r reprrXr9r:r[r\r)rsrer chunk_bytesrKr1r2firsts&&& r?_discard_stale_stream_chunk*_StreamingCall._discard_stale_stream_chunk s d5k*K % % %--E $ % * % # $ 3 $056H0I5QbKco & !A% fll 2FK BRA8 9   K  % %sCAC CC C% c VPR,'gAVP'd-RVPR&VPVP4R#R#R#)rTN)rrTrPrs&r?_fire_first_delta _StreamingCall._fire_first_delta sI%%f--$2E2E2E-1D " "6 * KK++ ,3F-rBc V^8dQhRRRR/#rGrrIrJrKrL)rMs"r?rNr- s,,s,t,rBc zVP4VPPV4RVPR&R#)Tr%N)rvrUrr5rsrs&&r? _emit_text_StreamingCall._emit_text s0   %%d+'+e$rBcV^8dQhRR/#rRrL)rMs"r?rNr- saaarBc r\\VPRR4;'gRP44#)zTrue when visible assistant text actually reached a stream consumer this attempt (``_fire_stream_delta`` records only scrubbed, delivered text; ``deltas_were_sent`` flips on any content delta, including whitespace/think-only ones nobody saw). _current_streamed_assistant_textr)rrrUrrs&r?_visible_text_delivered&_StreamingCall._visible_text_delivered s/WTZZ)KRPVVTV]]_``rBc V^8dQhRRRR/#ryrL)rMs"r?rNr- s//C/D/rBc \VP4VPPV4R#r:)rvrUrr{s&&r?_emit_reasoning_StreamingCall._emit_reasoning s    ((.rBc V^8dQhRRRR/#)rGrrIrJrKrL)rMs"r?rNr- s00s0t0rBc \VP4VPPV4R#r:)rvrUr)rsrs&&r?_emit_tool_started!_StreamingCall._emit_tool_started s    ))$/rBc V^8dQhRRRR/#ryrL)rMs"r?rNr- s||3|4|rBc raaSPP'dSPVV3Rl4R#R#)zTool-call turns suppress content streaming (no chatty preamble), but reasoning tags inside it must still reach the display: route through the delta callback for tag extraction (the CLI drops non-reasoning text once the stream box is closed).cp<SPPS4SPPS43#r:)rUr_record_streamed_assistant_textr{sr?r@7_StreamingCall._route_suppressed_text..# s)!A!A$!GIsIstxIy zrBN)rUrrPr{sffr?_route_suppressed_text%_StreamingCall._route_suppressed_text s' :: + + + KKz { ,rBcV^8dQhRR/#)rGrJrkrL)rMs"r?rNr-% s4rBc ZVPP4pWPnV#r:)rU_stream_diag_initr3r)rsrs& r? _new_diag_StreamingCall._new_diag% s#zz++-  rBcV^8dQhRR/#rrL)rMs"r?rNr-* s U U4 UrBc \P!4VPR&VPPR4\P !\ 4;_uu_4\VPR^44^,VR&VPR4fVPR,VR&\VPR^44\V4,VR&RRR4R# +'giR#;i)z=Stamp liveness for a real chunk; diagnostics are best-effort.rXzreceiving stream responsechunksfirst_chunk_atNbytes) rr7rUrrrrXrr}r)rsrrs&&&r? _count_chunk_StreamingCall._count_chunk* s$(IIKS! ""#>?   + + (A!67!;DNxx()1)-)=)=c)B%&! 458Me8TTDM , + + +s A=C'' C8 c V^8dQhRRRR/#)rGllamacpprrJrL)rMs"r?rNr-5 s   $ rBc V'd \V4MRpVfVPW4R#\P!4;VPR&pWEuVPR&VPR&VPP R4R#)z\Count a real chunk; a llama-server prompt-progress chunk (True) is liveness, no first token.NFrXr0zmodel reading the promptT)r*rrr7rUr)rsrrrr0nows&&&& r? _take_chunk_StreamingCall._take_chunk5 sx-5?5)4     d **.))+5S!CFNCZ($*>*>s*C ""#=>rBcV^8dQhRR/#rrL)rMs"r?rNr-A s : :TY :rBc \VR4'dVP'd VPpVf@\\VRR4\4'dVP 'd VP pVfZ\\VRR4\4'd9VP 'd'VP pVP4R,VR&W#V3#)zDModel, response id and serving provider, as the stream reports them.rNrr:N@Nserving_provider)r]rr|rrIrrr)rrr  response_idupstream_providers&&&&&r?_chunk_identity_StreamingCall._chunk_identity@ s 5' " "u{{{J  :geT4.H##N#NSXS[S[S[((K  $GE:t4TVY)Z)Z_d_m_m_m % '8'>'>'@'ED# $(999rBcV^8dQhRR/#rrL)rMs"r?rNr-M s..$.rBc V'd9\V\4'd!VPR4'gRVR&R#R#R#R#)zERecord that this attempt saw a terminal finish/stop reason (#102766).finish_reason_seenTNrV)rrs&&r?_mark_finish_seen _StreamingCall._mark_finish_seenL s8 Zd33DHHEY+> @P@PQos95I6+R ?c$o- -5u=** 5=TZZ0005FtzzGZGZ5[5[D LL_aeakakatatvz { U]u0UeEl5Ju|D LLqsw x4rBc  6\VR4'dVP'd VPMRp\VRR4p\VRR4pV'g V'db\RVRV/4;'g \ V4p\ RT;'gRR\ T;'gT4/V4p\WVV RV 2R 7h\VR R4pVf=\\VR R4\4'dVPPR 4pVR 9dVfR pW!3#)aChunk with empty ``choices`` -> ``(usage, finish_reason)``. Raises ProviderStreamError for providers (DeepInfra) that send validation errors as in-stream chunks (choices=None + error_type/error_message), which would otherwise surface as a misleading EmptyStreamError plus retries.ruN error_type error_messageryrzprovider_in_stream_errorr{)rhrjrllastOnerstop)Trr&) r]rurrrrrIrer|rkrr})rrru _err_type_err_msg_statusrjlast_ones&& r?_choiceless_chunk _StreamingCall._choiceless_chunki s 'ug665;;; DE<6 5/48 /Ix0XY]tu~]G'@@&@)SQYQbQb]bMcdfmoD%'R[Q\\^_g^hOij j5)T2   75-+NPT U U((,,Y7H ( (]-B"M##rBcV^8dQhRR/#)rG stream_kwargsr"rL)rMs"r?rNr- s G G~ GrBc \VPP4'g%\VPRR4'gRR/VR&VPP VPP RVR74;q n\P!4VPR&VPPR4\W4pVPPP!R /VB#) _stream_options_unsupportedF include_usageTrchat_completion_stream_requestrrXz)waiting for provider response (streaming)rL)rrUrtrr3rrr>rr7rrr[r\rQ)rsrrds&& r?_open_chat_stream _StreamingCall._open_chat_stream s))<)<==gdjjZwy~FF/>.EM* +8< 8O8O JJ 4 4<\iv 4 w9y y5$(IIKS! ""#NO:-X ""..55F FFrBc V^8dQhRRRR/#rG raw_streamrrJrKrL)rMs"r?rNr- s--s-t-rBc \VRR4;q nVPPV4VPP V4VPP V4VPP VPPV4VPPV4\VP4Vn VPV4R#)roN) rr?rU_capture_rate_limits_capture_credits_capture_nous_model_switch_stream_diag_capture_responser3r_check_openrouter_cache_statusr.r=_reabort_if_cancelled)rsrros&& r?_chat_stream_created#_StreamingCall._chat_stream_created s3::zSW3XX0 ''1 ##H- --h7 001B1BHM 11(;0< ""8,rBc V^8dQhRRRR/#rGrorrJrKrL)rMs"r?rNr- sYYcYdYrBc VP;_uu_4\VPR,4pVPR,;'gW PR,9pRRR4X'gR#VP V4VP e^VP PR8XdVP PMVP PpV!VP RR7R#R# +'giL;i)uInterrupt/stale abort that raced ``create()``: the one-shot pool sweep ran while the connect/TLS window held no socket yet (``tcp_force_closed=0``), so nothing stopped the request once it came up and the serve kept generating into a dropped consumer (#98974). Response headers prove the socket exists now — shut it down (shutdown-only, never a cross-thread close) so the worker unwinds as after a stale kill.rrrNrUcancelled_attempt_late_connectr) r9rr:r4_shutdown_stale_attempt_socketr>rUr`rr)rsrorrrs&& r?r$_StreamingCall._reabort_if_cancelled s  % % %$33I>?G//8mmGG`G`alGm<"TFp\SVR4xK R#5ir:r)rrrs& r?r4_StreamingCall._accept_chat_chunk.. s#Bt7rttT**7rsF StreamingrX)rrrr) rrrXrr6rrg_writer_still_currentrr7)rsrerrchoicers&&& @r?_accept_chat_chunk!_StreamingCall._accept_chat_chunk s   + +eY5G#*WQZFFGT2EulD116:,,U3v55ccBt7rBtcccBt7rBt?t?t, + +--.?@@))+66%)IIKS!), +sA-D0D0)D0D00 E c V^8dQhRRRR/#)rGrHrIrJrrL)rMs"r?rNr- s34rBc VPpVe\VPV4'dR#\P RWP P RR44R#)zXSingle-writer fence: False (with a warning) once a newer stream claimed the writer slot.Tzq%s attempt superseded by a newer stream; stopping consumption to preserve the single-writer invariant (model=%s).rrF)r=r/rUr[r\rr})rsrHrs&& r?r$_StreamingCall._writer_still_current sR"" =4TZZGG 238//:M:MgW`:a crBcV^8dQhRR/#rGrerrL)rMs"r?rNr- sGGGrBc aaa.a/a0a1a2a3a4a5^RIo.SP4wo/o3o0.p.p.p.p.p.o2^RIHpV!4pVPo5^RIHp V !4p R;p ;rR;rRpSP4pR;Sn;Sn Sn ^RI H pV!4p\4\4pp\4pRp\SP4o1RV.V/V0V1V3V3RllpV2VV53Rlp^R IHpSP#VP$!SP&V3/\)SPR 4BR VP*R SP,R VP.RVV3RlRRR\1SPR4RR/B4o4SPP2R8XdSP4P7S44RVV43Rllp\9S4V3RlR7EF`pSP;VVS14pSPP<'d V!R4EM'SP?S4'gSPASV4KiV'dKsSPCVVWV4wrpVPD'g6SPGVV 4wpp T;'gT p SPIVV 4KVPD^,pVPJp \M\OVRR44;'gT p SPIVV 4\QVR4'dVPR'd VPRp \OV RR4;'g\OV RR4p!V!f`\U\OV R R4\V4'd?V PXP[R4;'gV PXP[R4p!V P]V V!4p!V!'d/\_V'd VR.,MR!V!4p!VPaV!4\OV R"R4p"V"f=\U\OV R R4\V4'dV PXP[R"4p".p#\UV"\b\d34'dT"MR/F)p$V#Pa\gV$44\iVV$4K+ R!PkV#4p%V%'d/\_V'd VR.,MR!V%4p%VPaV%4T%;'gT!p&V&'dESPmV&4VP]V!4'gVP]V%4'dRpEM \OV R#R4p'V'f=\U\OV R R4\V4'dV PXP[R#4p'\UV'\n4'dV''dVPaV'4\q\OV R$R4R!R%7p(V('dVPaV(4VP]V(4'dR$pEMBS5'dSPsV(4MS2'gK\uV(4'g:SPvR&,'go\yR!PkV44'dOS2PaV(4R!PkS24p)\uV)4'g\yV)4'gV!4EKSP{V(4\OV R'R4p*V*'gEKV!4V*FMp+VP]V+4p,V,fKSP}V,4SP~R(,PaV,4KO EKc V'dV!R)4SPV4VP4SP4SPS4'dS.PR*S R+24hS4PeSPS4P4#SPS4TY#S5V'dR,MT WVWVVR-7 p-V PV-4V'dRV-nIV-#)0z#Stream a chat completions response.N)_ToolCallAccumulator)StreamCarriersr)RelayChatAccumulatorcV^8dQhRR/#rrL)rMs"r?rN;_StreamingCall._call_chat_completions..__annotate__ s c c. crBc<SPSSSSR7pS'd \V4pSP/VCRRRV/C4#)ryrTrT)rr+r)rrTr base_timeoutrr read_timeoutrss& r?r;_StreamingCall._call_chat_completions.._open_stream sKnnXLP\cknlG"6"G))*a_*ahiY`*ab brBc<\S4pSP4VF)pS'd SPM SP!V4K+ R#r:)rclearrr|) pending_partsrpending_text_partsrstool_calls_accs r?_flush_pending_stream_textI_StreamingCall._call_chat_completions.._flush_pending_stream_text s> !34M  $ $ &%0>,,DOOSUYZ&rBr rrrrrc(<SPSV4#r:)r)rrsres&r?r@7_StreamingCall._call_chat_completions.. st'>'>?PRW'XrBrc\VR4#)r)r]rs&r?r@r s wui7PrBrrkrTrZc V^8dQhRRRR/#rrL)rMs"r?rNr s i iC iD irBc<SP4R# \d=SPe+SPP SPTR7R#R#i;i)Nr)rrXr>rUr)rrsrs&r?_close_half_read_streamF_StreamingCall._call_chat_completions.._close_half_read_stream sR i  i//;JJ;;Dr?#agent.chat_completion_helpers_relayrr,rrUr rTrrrfinalizerobserverrr3rrrrrgrsrrrrr_normalize_finish_reasonrr]rur|rkrr}feedr(r~rrr)r'rYrrIrrrr5rr|rr_log_runaway_cut materializerXrlRemoteProtocolErrorrT_adopt_final_response_finish_chat_streamapply_runaway_repetition)6rsre content_partsreasoning_partsdetail_display_partsr rrrrcarriersrr r|rrr_diagrrelay_response content_watchreasoning_watch detail_watchrunawayrrr rr is_progressrurrrrd_deltadetail_text_partsrd detail_textdisplay_reasoning delta_refusal delta_contentrdelta_tool_callstc_deltarrorrrrrrrrs6ff @@@@@@@@r?_call_chat_completions%_StreamingCall._call_chat_completions s(/3/D/D/F, lH " +-$& "$(*Q)+ #;!#155 5 *..  \```T9D(,L],[,[!% 5 5e < QQ`-ab b  ,--f.C.CD D++FD-ZhH]JYs#\m',) x +/H (rBc V^8dQhRRRR/#)rGchannelrIrJrKrL)rMs"r?rNr- s>>>>rBc  \PR\VPRR4YPP RR4\VPRR4;'gR4R#)zS%sStream cut: the %s turned into a runaway repetition loop (model=%s, provider=%s).rZrrrrN)r[r\rrUrr})rsr/s&&r?r_StreamingCall._log_runaway_cut sN a DJJ b 17OOrBc \PRVPP;'gRVPP;'gR4RVPnVP V4#)zAdapter returned a completed response for ``stream=True``: switch the session to non-streaming and replay its content as deltas.z}Streaming request returned a final response object instead of an iterator; switching %s/%s to non-streaming for this session.rT)r[rrUrrr_replay_final_response)rsrTs&&r?r$_StreamingCall._adopt_final_response s`  ABF**BUBUBbBbYb JJ   ) )  +)- %**>::rBc VPp\\V\\34'dV'd V^,MRRR4pVEe \VRR4;'g\VRR4pVf`\\VRR4\ 4'd?VP PR4;'gVP PR4p\V\4'dV'dVPV4\VRR4p\V\4'd4V'd,VP4VPPV4V#)zKReplay a completed chat-completions response's reasoning/content as deltas.Nrzrrrr) rrr|rrrkrr}rIrrvrUr)rsrTrrzrrs&& r?r3%_StreamingCall._replay_final_response s  (( 7T5M(J(Jw'!*\`bkmqr  $W.A4HooGT[]hjnLoN%*WWmUY5Z\`*a*a!(!4!4!8!89L!M!u!uQXQdQdQhQhitQu.#..>$$^4gy$7G'3''G&&( --g6rBc .pRp\V4EFpW,pVR,R,pV'dtVP4'd^\P!V4VfB\ V4'd1\PR VR,R,;'gR4RpMVfRpVP\VR ,VR ,VPR 4\VR,R,VWeR,R,8gVPR 4R7R74EK T;'gRV3# \Pd>TfRpL\ YeR,R,;'gR4pTR8wdTpEL RpEL%i;i)zEMaterialize accumulated tool calls; flag truncated/unrepairable args.FrrNTr?rzkTool call '%s' has repetition-dominated arguments without a finish_reason; treating as a dropped tool call.rrrr)rr args_repairedr)rrrr) rsrrrrr#r-r[r\r~rr})rrmock_tool_callshas_truncated_tool_argsrrrrepaireds&& r?_assemble_tool_calls#_StreamingCall._assemble_tool_calls sx"'.)C$B:{3IY__.. ;JJy) !(-DY-O-ONNJKMj>Z`KaKhKhehj/3+&+/'  " "?d8"V*BFF?vFMM#MZpNq NN<  .N ^l^t^tpt    mP^clct NN\ ].d.^gswx x.E(MLcLc]c @   B 7'&R\^bBc!e ,' '!toqGGM//R088D: ):G %#k&T&Ti#djjlBS6S\f&$1gMdefh &h// OOrs "I )I  tool_dropTcV^8dQhRR/#)rGrErrL)rMs"r?rNr-$ srBc D\VRR4pV'g\VRR4f \R4hV'di\VRR4fZ\;QJd&RT;'g.4F 'gK RM RM!RT;'g.44'd \R4hV#) ufRaise EmptyStreamError for a message the stream never completed: no content and no stop_reason (eventless -> retry), or with ``tool_drop`` a ``tool_use`` block and no stop_reason — the SSE closed mid tool call and its input is a partial snapshot (usually ``{}``), so raising blocks the empty-args execution (bounded retry, or stub/continuation after text).rNrszjProvider returned an empty stream with no stop_reason (possible upstream error or malformed event stream).c3B"TFp\VRR4R8HxK R#5i)rNtool_user)rblocks& r?r:_StreamingCall._check_anthropic_message... s#OSDQ5GE64 (J 6MsTFzStream ended with no stop_reason while a tool_use block was still incomplete; treating as a mid-tool-call stream drop (#80498).)rrr)rzrErs&$ r?_check_anthropic_message'_StreamingCall._check_anthropic_message# s'9d377M4@H"|~ ~ ->F33OSDKMMrMOS333OSDKMMrMOSLSLS"DE ErBc f aaaaaaRpRpRp\P!4SPR&SP4oR;SnSnSSnRRRR/oRp\ 4\ 4rvRp^RIHp ^RI H oH oV P4p RVVVVV3R llp R VVV3R llp SPV P!SPV 3/\!SPR 4BR V P"RV RV P$RV3RlR\'SPR4RR/B4p V EFpRpSP)SV4SPP*'dEM\-VRR4pVR8XdRpKOVR8Xd+SP/S\-\-VRR4RR44KVR8Xd\-VRR4pV'dx\-VRR4R8XdcRp\-VRR4'dKSP1VP24SP4R,P7VP24EK EKEKEKVR 8XgEK \-VRR4pV'd\-VRR4MRpVR!8XdM\-VR"R#4pV'dV'gSP9V4VP;V4'dR$pMhEKVR%8XgEK\-VR&R#4'gEKSP=VP>4VP;VP>4'gEKR'pM SR,pSPP*'gwVesV'gkV'g\AV'dR(4hR)4hVPC4pV P#4PER*4pVe\-VR*R4fVVn#SPI4SR,pVeVPKRRR4SPP*'dR#T'dDSPMT4T POSR,PP4pR+Tn)RTn*T#Te7SPWTRR,7T PX'gSPWT4#SPWT POT44# SR,pTeTPKRRR4ii;i SPI4SR,pTeTPKRRR4ii SR,pTeTPKRRR4ii;i;i)-zStream an Anthropic Messages API response; fires delta callbacks but returns the native Message from get_final_message(). Runs on the per-request ``request_client`` so the watchdog can abort this socket without closing the shared client mid-flight.FrXNmanagerrr )normalize_stream_usagesanitize_anthropic_kwargscV^8dQhRR/#rrL)rMs"r?rN4_StreamingCall._call_anthropic..__annotate__K s ? ?N ?rBc<\V4pS!V\SPRR4R7SPP!R/VBpVSR&S!VP 44#)rZr)rZrOrL)rkrrUrGr __enter__)rrrO_stream_contextrPrdrQrss& r?_open_anthropic_stream>_StreamingCall._call_anthropic.._open_anthropic_streamK s]0L %lwtzzS_ac?d e$--44D|DG)0OI &)'*;*;*=> >rBc V^8dQhRRRR/#rrL)rMs"r?rNrSR s 1 1# 1$ 1rBc<aVSR&\VRR4;oSnSPVVV3Rl4\SP4SnSP S4R#)rroNc<<SPPSS4#r:)rUr)rrorssr?r@S_StreamingCall._call_anthropic.._anthropic_stream_created..X s H HPX YrB)rr?rPr.rUr=r)rrorrVrss&@r?_anthropic_stream_createdA_StreamingCall._call_anthropic.._anthropic_stream_createdR sR(2OH %8?z:W[7\ \Ht4 KKY Z!4TZZ!@D   & &x 0rBr`rrrrc&<SPR4#)zAnthropic streaming)r)rrss&r?r@0_StreamingCall._call_anthropic.._ s(B(BCX(YrBrrUrTr message_stop message_deltarrscontent_block_start content_blockrIrr/content_block_delta text_deltarrrthinking_deltathinkingrzTAnthropic Messages stream ended before message_stop (possible upstream stream drop).zeProvider returned an empty stream with no events (possible upstream error or malformed event stream). stop_detailsrs)rE)-rr7rr=r?r>r,rUr agent.anthropic_adapterrPrQAnthropicStreamAccumulatorrTrrrr rrrrrrrrrr~r|rrrhrget_final_messager}rirX__exit__rrocurrent_message_snapshotrsrrLoutput_modified)rsrd has_tool_usesaw_stream_eventsaw_message_stopbase_final_message text_watchthinking_watchr!r  accumulatorrWr]rr event_typerJr delta_typerr _stop_detailsrOrzrrVrPrQsff @@@@r?_call_anthropic_StreamingCall._call_anthropic5 s    $(IIKS! =AAT:'5$$dHd;!%7%9;M;ON#]::<  ? ? 1 1)))*:*:4??Lb+n$TZZ=+nITI]I]+n7+nBMBUBU+nZ+n,DJJ8LM +nim +no 6 7#' !!%/::222$UFD9 /'+$?2**5''%RV:WYfhl2mn#88#E?DAE!=!K'+ "5&$77 33EJJ?!KK(<=DDUZZP 8"Lu #88#E7D9EAF!=DJ!\1&ufb9  OOD1%??400&/G!1$'77GE:WY>&1G!C D)2J::222z7MV]'*+oAA@AA&0%A%A%C"!, 4 4 6 : :> J  ,9K^]a1b1j6C&3 7**,))4&$$T46 :: * * *   ! !' *!**?8+D+]+]^G".G *.G 'N  )  ) )*< ) N)))445GHH,,[-A-ABT-UVV#*)4&$$T46'  7**,))4&$$T46'*)4&$$T46'si#DSAS 'S5 SS9S*S SSA"S=R00#ST0T ("T0 #T--T0c ,V^8dQhRRRRRRRRRR /#) rGrSr max_retries mid_tool_callrrrIrJrKrL)rMs"r?rNr- s200C0c0UY0cf0ko0rBc  VPPW^,V^,W@PPR7VPP V4'd/^RIHpV!VP\VPRR44TPV4VPPV4^RI H p\VPV!V^,RRRR 74\P!4VPR &R#) zWarn about the drop and tear down the request-local client. Shared clients are never closed from inside a request (FD-recycle hazard); the OpenAI primary is replaced lazily.)r5rS max_attemptsr~r)buffer_anthropic_tool_inputroN)jittered_backoffg?g@r^) base_delay max_delay jitter_ratiorX)rU_emit_stream_dropr3r_is_provider_stream_parse_errorrjrrrraragent.retry_utilsrrrr7)rsrrSr}r~rrrs&&&&$$ r?_retry_after_drop _StreamingCall._retry_after_drop s $$q[{QVcjvjvj{j{ % } :: 5 5a 8 8 K 'Mbdh9i j ++F3 ' 7" JJ(1PSbef h%)IIKS!rBcV^8dQhRR/#rrL)rMs"r?rNr- s0 0 T0 rBc D\VP4'dR#\V4'dRVPn\P RVPP ;'gRVPP;'gR4VPPR4R#^RI H pV!V4'gR#\V4P4pRV9;'dRV9pR V9dqV'giVPPR 8wgVPP R 8XdR#RVPnVPPR RR 7R#RVPnVPPV'dRMRRR 7R#)aFlip to non-streaming for failures streaming itself cannot survive, or that re-streaming can only repeat: the provider rejecting streams outright, AnthropicBedrock IAM lacking InvokeModelWithResponseStream, a custom anthropic_messages provider emitting SSE events out of order (#72833), or a gateway answering with contentless SSE keepalive frames (a degraded gateway answers every streaming request that way, so the retry must change channel to make progress). llama-server stays on streaming: the router can't cancel a non-streamed request.NTuProvider stream returned an empty SSE frame (keepalive, no payload) before any delta — switching %s/%s to non-streaming for this session.ru⚠️ Provider stream returned an empty keepalive frame — retrying this turn without streaming (streaming stays off for this session).)_is_stream_unavailable_errorrrzunexpected event orderrUrluV ⚠ Provider sent Anthropic stream events out of order. Switching to non-streaming. r?u ⚠ Streaming is not supported for this model/provider. Switching to non-streaming. To avoid this delay, set display.streaming: false in config.yaml u ⚠ AWS IAM denied bedrock:InvokeModelWithResponseStream. Switching to non-streaming. Grant that action to restore streaming output. )rrUrrr[r\rr _emit_warningrjrrIrr`rJ)rsrr _err_lower_is_stream_unsupporteds&& r?_maybe_disable_streaming'_StreamingCall._maybe_disable_streaming s[ TZZ ( (  0 3 3,0DJJ ) NNO ##00y$**2B2B2O2Oi Q JJ $ $L M H+A.. V\\^ !)Z!7!Y!YOzQ>QU^>^,0DJJ ) JJ " "j #  (, % & T B  rBc(V^8dQhRRRRRRRR/#)rGrrXrSrr}rJrrL)rMs"r?rNr- s/[[i[#[C[TX[rBc  ^RIpVPR,'d,\PR\ V4P 4R#\ WPVPVP34p\ WPVPVP\.\4O54pVPP!V4p\ V\"4pV'*;'dV'*;'d \%V4p T;'gT;'g T ;'gTp VP&R,'g\)VPRR4'gy\+V4'dhRVPn^Vn\P1R\)VR R44VP3R 4VP4P7R 4R#VP&R,'d\9VP:P=R 44;'gVP>R,p V 'gpVPA4'gZ\PCR V4VPEVPPF4RVP&R&RVPHR &VP&R,'dX 'dV 'dW#8g'\PCRV4WP:R&R#VPPK4'd'VPEVPPLR4VPEVPPF4RVP&R&RVPHR &VPOWVRRR7R#V 'g V'dW#8dVPOWVRRR7R#VPPQRW^,V^,RVP4PRR7V'g V'd7V'dRMRp VPPURV RV^, R24Mw^RI+H,p V !VPW^,VPPZR7M@VP]V4\P_RV4VPaV4'dR#WP:R&R#)zClassify a failed attempt: True = retry; False = stop with ``result["error"]`` set (unless our own interrupt force-closed the socket). Runs inside the ``except`` so ``logger.exception`` works.NruPStreaming worker caught %s after request cancellation — exiting without retry.Fr%rTzQEndpoint rejected stream_options (HTTP %s); retrying without it for this session.rhstream_options_rejected_retryr/zStream died after deltas but before any visible text was delivered (0 chars, no tool call in flight); treating as an undelivered stream failure: %srz9Streaming failed after partial delivery, not retrying: %sr5u9 ⚠ Connection dropped mid tool-call; reconnecting… stream_mid_tool_retry_cleanup)r~rstream_retry_cleanup exhausted)rXr5rSrr~rz0Provider returned malformed streaming data afterz0Provider returned an empty response stream afteru❌ ruM attempts. The provider may be experiencing issues — try again in a moment.)buffer_connect_exhausted_notice)attemptsrtz$Streaming failed before delivery: %s)1rr4r[rrrr| ReadTimeoutConnectTimeout PoolTimeout ConnectError ReadErrorrConnectionErrorrrUrrrr5rrr_compat_retriesrrar3rrrr}r6rr\rP_reset_stream_delivery_trackingr_warning_presentation_enabledrr_log_stream_retryrragent.stream_diagrrtr exception&_unmask_server_error_with_nonstreaming)rsrrSr}r _is_timeout _is_conn_err_is_stream_parse_err_is_empty_stream_is_sse_conn_err _is_transient_partial_tool_in_flight_whatrs&&&& r?_handle_stream_error#_StreamingCall._handle_stream_error s   " "7 + + LLkmqrsmtm}m} ~ %7%79N9NPVPbPb$cd "!&9&96;K;KVMgMgix&L'H'J&LM #zzII!L%a)9:*?__.sA\A\]bAcrBz=Non-streaming unmask probe response could not be replayed: %sro)rrk)rr)rrUrrr5rr_stream_5xx_probe_ts_STREAM_5XX_PROBE_WINDOW_Srr8r8r\r>KeyboardInterruptrrXr[rrrrrP_buffer_statusrr)rsrrr last_proberr. probe_kwargsrg probe_err probe_statusreplayed replay_errrsf& @r?r5_StreamingCall._unmask_server_error_with_nonstreamingMsN( 4::5u = = TZZ ( (%a( >Vc\T-B-B5-I-I 4::z2 .6N NnnZZ44  !c&69S&S*- ')-)>)>)@j)@AMiDi)@ j22 %*5\" 7*4::|DE*7D & ?JJ''449djj6F6F6S6S) U DJJ--l n -TZZ9cdH #+ JCk "#34   / :L'L3,> Z\ef'0 G$*7D & KK? K)6D & *7D &    \^h i s`> G8G84G> J>J J ;JJ "J8J J  J J K$KKcV^8dQhRR/#rrL)rMs"r?rNr-s44C4rBc VPPR8wdVPV4#VPP VPP RR7RR7pVP V4#)rUanthropic_stream_requestrrW)rUr`r,r3r _create_request_anthropic_clientrz)rsrerds&& r? _call_wire_StreamingCall._call_wiresk ::  "6 6../@A A00 JJ 7 7?Y 7 Zau1w##N33rBc aa\R^4p^SnR pW!SP,8dV^, pSP4oSPP'dSP R4\ R4h\SPVV3Rl4SPR&SP4SPPSPR,e R4R#R4R#SP4SPPSPR,eRMR4R# \dpSP4SPY2T4'gORp?SP4SPPSPR,e R4R#R4R#SP4'd^TSPR&Rp?SP4SPPSPR,e R4R#R4R#Rp?EKRp?ii;i \ dcpTSPR&Rp?SP4SPPSPR,e R4R#R4R#Rp?ii;i SP4SPPSPR,eR4iR4i;i) HERMES_STREAM_RETRIESinterrupt_before_stream_retryz%Agent interrupted before stream retryc&<SPS4#r:)rrksr?r@&_StreamingCall._call..sDOO$>$@!::222778WX*+RSS .C $N/PDKK +  & & ( LL # #-1[[-D-P) nVl n5O0  & & ( LL # #-1[[-D-P)Vl n!..044QI\]]  & & ( LL # #-1[[-D-P) nVl n99;;/0 G,  & & ( LL # #-1[[-D-P) nVl n<   #$DKK   & & ( LL # #-1[[-D-P) nVl n   & & ( LL # #-1[[-D-P) nVl nsmA H=%H=(D:: H:(H5-H=;H5H5 H=.H=5H::H== J*J%J-%J**J--A K6c VP4VPP4R# TPP4i;ir:)r _call_donerrs&r? _run_call_StreamingCall._run_calls1 " JJL OO   !DOO   !s .A c V^8dQhRRRR/#rrL)rMs"r?rNr-sOOsOtOrBc JVeWPJdR#^RIHpHpV!V4pVe;V!V4\P RVP PRR44R#\PR4R# \d\PRRR 7R#i;i) uBest-effort ``shutdown()`` on the killed attempt's socket (monitor thread). The pool sweep in ``close_once`` can miss a connection that is checked out for the in-flight body read. ``shutdown(SHUT_RDWR)`` is FD-safe from any thread — it wakes the owner's ``recv`` without releasing the descriptor — so the worker unwinds and releases its own response on the owner thread (``_call``'s ``except``/``finally``). Never ``close()`` here: releasing a live TLS descriptor from a stranger thread lets the kernel recycle it under the owner's SSL BIO, which is exactly what the shutdown-only rule in ``_abort_request_slot_client`` forbids (it covers request-local clients too, #30858). N)_shutdown_socket_socket_from_responsezYShut down the stale stream's socket to unblock the reader (attempt superseded; model=%s).rrzJStale stream socket shutdown found no socket; pool sweep is the only abortz#Stale stream socket shutdown failedTr) r?rArrr[rrr}rrX)rsrorrsocks&& r?r-_StreamingCall._shutdown_stale_attempt_sockets  x/L/LL  O [(2D & >?C?R?RSZ\e?fh LLe f O LL>L N OsA A<%A<<"B"!B"cV^8dQhRR/#rrL)rMs"r?rNr-sII#IrBc VP;_uu_4\VPR,4pRRR4XVP9d^#T# +'giL%;i)aMThe started attempt the circuit breaker (see ``_stale_streak()``) has not counted yet, else 0. Like the non-streaming and inline watchdogs, each attempt counts once: the stale timer re-fires every window while the worker has not dispatched yet or is still unwinding a kill, and none of those re-kills is another unresponsive attempt.rN)r9rr:r;rsrSs& r?_uncounted_stale_attempt'_StreamingCall._uncounted_stale_attemptsK  % % %$33I>?G&t;;;qHH& %s A A cV^8dQhRR/#rrL)rMs"r?rNr-s++d+rBc VP4pV'd3VPPV4\VP4R#R#r:)rr;rrrUrs& r?_count_stale_attempt#_StreamingCall._count_stale_attempts8//1   ( ( , ,W 5 tzz * rBc V^8dQhRRRR/#rrL)rMs"r?rNr-saa%aDarBc  P\VP4p\PRWPVPP RR4VR 4VP PR\V4 RVPP RR4 RVR R24VPp\P!\4;_uu_4VPR 4VPPR 4R R R 4VP!V4VP#4\$P$!4VP&R &VP P)R \V4 R 24VP P+R\V4 R24R # +'giL;i)u2SSE pings but no chunks: cancel the attempt and abort the request-local client so the retry loop opens a fresh one. The shared client is never closed from this (stranger) thread — earlier stale-killed workers may still be unwinding SSL BIOs (FD-recycle corruption); the OpenAI primary is replaced lazily.uqStream stale for %.0fs (threshold %.0fs) — no chunks received. model=%s context=~%s tokens. Killing connection.rrrrr!z , context: ~z tokens). Reconnecting...stale_stream_killNrXu ⚠ no output from provider for us — reconnecting...zstale stream detected after zs, reconnecting)rPrr[r\r8r}rUrrr?rrrXrar3rrrrr7_emit_diagnostic_waitr)rsr_est_ctx_killed_responses&& r?_kill_stale_stream!_StreamingCall._kill_stale_streamsY 34??C  //1D1DWi1X]efg\h  ,,3CL>DOOL_L_`girLsKtu!! $= ? @  88   + +  / /0C D LL # #$7 8, ++,<= !!#$(IIKS! ((+KCPWL>Yn)op ""%A#g,#_`, +s -F F% c V^8dQhRRRR/#rrL)rMs"r?rNr-s00%0D0rBc VP4pV'dZWP8:dJ\VPWPR,R7'dVP P V4RVPR&\PR4VPp\P!\4;_uu_4VPR4VPP!R4RRR4VP#V4VP$e\'VP$RR 7RVP(R&R# +'giLW;i) zs/stop seen by the monitor: mark cancelled, abort the request-local socket, wait for the worker, flag the interrupt.r%rTrzLForce-closing streaming httpx client due to interrupt (not a network error).stream_interrupt_abortNrr)rr8rrUr5r;rr4r[rr?rrrXrar3rrr]r__monitor_interrupted)rsrrSrs&& r?_abort_for_interrupt#_StreamingCall._abort_for_interrupts//1 }(B(BBGh M"Q&s3~#6#:";5AA =i[I@AE*00bE9Mzz7799 DJJ995A NNmM$7$7R 8% A    + + A%GDJJ B$G$M$M2 NVYZabfblblnuwyZz[A[AAWBCD, DJJ'   ~/N/N N NNZM''R(%  .T4Wi)PRV#1T Z>   NN\M''R(% 1+; t DJJ 3TnTZZT:<   ~/T/T T/3E , =, + +s6AL L L* c VP4\P!4VnRR/Vn\ VP 4'dhRVn\P!\VP4RRR7pVP4VP4VPRR7MZ\P!\VP4RR 7VnVPP4VP4VPR,'d \R 4hVP P'd \R 4hVP R ,e=VP"R,'dVP%4#VP R ,hVP R ,e\'VP 4\)VP*P,\.4'daVP*P,P1R4'd6\3VP*P,R,4VP nVP R ,# TPRR7i;i)zResolve the stale timeout, run the request (worker thread or inline), drive the heartbeat/stale/interrupt monitor, then translate the outcome.r%FNzstream-inline-monitorTrrRrSr%z+Agent interrupted during streaming API callz9Agent interrupted during streaming API call (post-worker)r5ror)rrrrrrorUr]rrE _monitor_looprrrYrrrr5rrr|r3rrkr}r\_last_api_first_chunk_at)rsmonitors& r?r;_StreamingCall.runrs ##% $//+%*EN! %djj 1 1DK&&-d.@.@AH_hlnG MMO *  S )#**2H2XaefDK KK        $ $U + +"#PQ Q :: * * *"#^_ _ ;;w  +$$U++0022++g& & ;;z " .  + dll'' . .4<<3D3D3H3HIY3Z3Z27 8I8IJZ8[2\DJJ /{{:&&% S )s I33J)r>r?rrrr4rAr;r8r=rUrr3r5rr7r<rTr*r6rr9r:r]);rrrrrrqr@rKrrPrTrXr]rargrlrsrvr|rrrrrrrrrrrrrrrrr,rrr3r=rrLrzrrrrrrrrrrrrrrr;rrLrBr?r+r+ sV1<t" VTn O "- , a /0| U  : :.. *$$2 G-Y&.GR> ; '@'@R>=A>UY>mq>>Dt"qWj0(0 d[zDL4#nN" O6I+ a808 [8t$'rBr+rTcV^8dQhRR/#rOrL)rMs"r?rNrNs C C CrBcVP'd \R4hVPR8Xd \WV4#VPR8Xd\ WV4P 4#\ V4\WV4P 4#)a)Streaming variant of _interruptible_api_call: fires the delta callbacks per text token (tool-call turns suppress them) and returns a SimpleNamespace in the non-streaming response shape. codex_responses delegates to the already- streaming codex runner; cron turns and delegated children run inline.z+Agent interrupted before streaming API callrQrY)rrr`rrr;rr+rs&&$r? interruptible_streaming_api_callrsw  !!!LMM ~~**(NKK ~~++e@DDFF %^ < @ @ BBrB>pricelatency throughput>rrrretry>r3r2 input_imager:)NN>r tool_namerr#platform_message_idr) zconnection lostzconnection resetzconnection closedzconnection terminatedz network errorznetwork connection terminatedz peer closedz broken pipezupstream connect error)rr0rnrUr>rr)r __future__rrrCrrr~rrrrrr dataclassesrtypesrtypingrrrhermes_cli.timeoutsrr rr r rr r rragent.sdk_transform_bypassr agent.errorsragent.chat_completion_localrragent.chat_completion_headersr$agent.chat_completion_stream_monitorrr`rragent.fast_moderagent.turn_contextragent.gemini_native_adapterrrragent.message_contentragent.message_metadatarrrr agent.message_sanitizationr!r"r#r$rr%r&agent.reasoning_summariesr'r(r)agent.local_prompt_progressr*r+agent.repetition_guardr,r-agent.stream_single_writerr.r/tools.terminal_tool_lifecycler0utilsr1r2r3r4 getLoggerrr[rrrr rrrrEr_rcrXrerrrrrrrrrrr frozensetr6r%r-rPrYrermrurrrrrrrrrrrrrrrrr rrrr rMrfrorrvrrrrr r'r rr4r7r>rCrPrhrlrrrrrrrrrrrr0r<rArMauthauth_permanentr rate_limitupstream_rate_limit overloaded server_errorrTssl_cert_verificationrpayload_too_largeimage_too_largemodel_not_foundprovider_policy_blockedr format_errorrole_alternationinvalid_encrypted_content#multimodal_tool_content_unsupportedthinking_signaturelong_context_tier!oauth_long_context_beta_forbiddenllama_cpp_grammar_patternrrRrSrYrcrtrrrrrrrrrrrrLrrrr'r1r:rKrUrnr}rrrrrrrrrrrrr+r__all__rLrBr?rCs#   !!&&XII)GLEd75A36BBggMNT;NN   8 $#E )0.(A%>$(!"% ") `( )22  .b'&%%PkhDhlBBCDH  E8<  S B*  HD - #'  E E04 E C  hC I =7 4 Jh8 t :!QJ:F*.&   ppf:UzJSJSf%*!(-$ -  " "  "UZp 6 "0f4Y"ofF@F&ll( NV( .bfR%&? 70!!#F8|  &&(C  4 !8-((*O##%>$$&A""$=""$5**,Q))+O !:!"##%K#$,,.R668]%%'D$$&E446[,,.H.18j ?%.>p,"6"!H24 }p0Y::@!@CK!KZL^ .  ./0FH\^xy4nZ433/43?C3OT3t ` (LD>   (+f=f=RG')G'T( CPT C C  rB