߲j&dZddlmZddlZddlZddlmZmZmZm Z eje Z dZ ddZddZddZdd Zdd  dd Zdd  dd Zd ZddZddZddZddZgdZy)uStream diagnostics — per-attempt counters, exception chains, retry logging. When a streaming request dies mid-response these helpers record WHY (which CF edge / OpenRouter downstream served it, bytes+chunks before the drop, HTTP status, underlying httpx error class) to ``agent.log`` in full and to the user-facing status line compactly. ``run_agent`` keeps thin forwarders so existing call sites and tests patching ``run_agent.`` keep working. ) annotationsN)AnyDictListOptional) zcf-rayzcf-cache-statuszx-openrouter-providerzx-openrouter-modelzx-openrouter-idz x-request-idz x-vercel-idviaserverzx-forwarded-forc8tjdddiddS)zkFresh per-attempt diagnostic dict; mutated in place by the streaming functions and read by the retry block.Nr) started_atfirst_chunk_atchunksbytesheaders http_status)time6/home/ubuntu/.hermes/hermes-agent/agent/stream_diag.pystream_diag_initrs))+UVcevz {{rc8|t|tsy t|dd|d< t|ddxsi}i}tD]'} |j |x}rt |dd||<)||d<y#t$rYUwxYw#t$rYJwxYw#t$rYywxYw)zkSnapshot headers + HTTP status at stream open (so they survive a drop before the first chunk). Best-effort.N status_coderrx) isinstancedictgetattr ExceptionSTREAM_DIAG_HEADERSgetstr)agentdiag http_responsercapturednamevals rstream_diag_capture_responser&sJtT$: %m]DI]  -D9?R#%' D !++d++3+%(Xds^HTN  #Y          sFA/B $A>'B / A;:A;> B B B  B BBc4g}|}|]t|dkrO||vrK|j|t|ddxs t|dd}|||urn|}|t|dkr||vrKdd|rdjfd|DSt |j S) a)Compact ``Outer(msg) <- Inner(msg) <- ...`` rendering, walking ``__cause__`` then ``__context__`` (deduped, max 4 deep): the OpenAI SDK wraps httpx errors so only the wrapper class is visible at the catch site; the inner RemoteProtocolError/ConnectError/ReadError says WHY the stream died.N __cause__ __context__ct|jjdd}t|dkDr|dddzn|}|rt |j d|dSt |j S)N  …())rstripreplacelentype__name__)emsgs rrenderz'flatten_exception_chain..renderAsi!flln$$T3/#&s8c>c$3i%s/2$q'""#1SE+HQ8H8HHrz <- c3.K|] }|ywNr).0r7r9s r z*flatten_exception_chain..Fs/Qvay/s)r7 BaseExceptionreturnr)r4appendrjoinr5r6)errorseenlinknxtr9s @rflatten_exception_chainrF4s!#D$)D  s4y1}T1A DdK.T'$ t2T ;#+   s4y1}T1AI 486;;/$/ /QT%[=Q=QQrcdx}}d}dx}x}}t|tr% tj}t|j dxsd}t|j dxsd}t |j dxs|}t d||z }|j d} | t dt | |z dd }|j d xsi} t| tr(| r&d jd | jD}|j d t|j d }||||||fS#t$rYwxYw)za(http_status, bytes, chunks, elapsed, ttfb, upstream) for the retry log line; ``-`` when unknown.r-rr r r z.2fsrr-c30K|]\}}|d|yw)=Nr)r<kvs rr=z_diag_fields..Zs(P1A3as(Psr) rrrintrfloatmaxrAitemsrr) r!_bytes_chunks_elapsed_ttfb _headers_repr _http_status_now_started_firstrs r _diag_fieldsr\IsJFWH+..E.ML$ 99;D'*/a0F$((8,12GTXXl3;t4 0 7CHY[\9] NN !c5>>#8S K (F  6B$5G  #M2  "5zH "  *%[))F * D 3d CDsQB0C. C A7C.0CC.CC. C+(C.*C++C.. DDc|rdnd}t||||||||jxsd}d} t|tr|j dnd} | /dt d t j t| z d d } |jd |d |dt|jd|d|d| |jd|d|dt|jy#t$rYpwxYw#t$rYywxYw)zOne compact user-visible status line for a stream drop+retry, plus the full WARNING via log_stream_retry. ``after Xs`` distinguishes "couldn't connect" (0s) from "died mid-stream" (idle-kill / proxy timeout).zdrop mid tool-calldrop)rjrBrkrlrbr!rgr N after rHz.1frJu⚠️ z stream z (r1u — reconnecting, retry /z stream retry ) rorgrrrrQrrPr_buffer_diagnostic_statusr5r6_touch_activity) r rBrkrlrbr!rjrg_suffixstarteds remit_stream_droprys+ $1 fD Dw\anuy~~+HG ,6tT,B$((<(  CuW~)E FsK1MG  ''hZxvRU 0D0D/EQwiP''.iq @   gYa ~WTRW[MaMaLbcd        s%AC%A#C4% C10C14 D?Dic|}tdD]4}|y t|dd}||cS|jxs |j}6y#t$rd}Y0wxYw)zfThe buffered ``httpx.Request`` carried by the exception chain (SDK wrapper or httpx error), else None.Nrequest)ranger RuntimeErrorr)r*)rBrD_r|s r_failed_requestrsq$)D 1X 2 < dIt4G  N~~1!1!1 2   G s A AAct|dd}t|trt|j dSt|t t tfr t|Sy)Ncontentzutf-8)rrrr4encoder bytearray memoryview)r|rs r_request_body_bytesrsLgy$/G'37>>'*++'E9j9:7| rc 4ddlm}t|}|tt |ddxs|xsdj xsd}t |}d|d|d |d k7rd nd}||d zS|d td t|dz dz }|tk\r|dzS|d zS)zThe one user-facing line for "no stream event ever arrived and the connect retries are spent": names the host, the attempt count and the serialized request size so a body-size limit is distinguishable from an outage without reading agent.log.r)urlparseurlNrrz the endpointu❌ Could not open a stream to rsz attemptrJu;; the endpoint looks unreachable — try again in a moment.z (request iz KB)zH; the endpoint or a proxy in front of it may reject requests this large.) urllib.parserrrrhostnamerrQroundLARGE_REQUEST_HINT_BYTES)rBattemptsrhrr|hostsizelines rconnect_exhausted_noticers&e$G C5GGRH I R R dVdD w 'D ,TF'(8S[_`S`CfhKi jD |SSSjQdTk 234D 99D ''``` O OOrct|||tfdt|ddxsdDry|jy)zBuffer :func:`connect_exhausted_notice` once per turn: the outer retry/fallback loop re-enters the stream call several times, and every pass exhausting the same budget must not add another copy.)rrhc3@K|]\}}t|k(ywr;)r)r<_kindr8texts rr=z2buffer_connect_exhausted_notice..s a s3s8t  as_retry_status_bufferNr)ranyrru)r rBrrhrs @rbuffer_connect_exhausted_noticersC $EHx PD age=SUY.Z.`^` aa ##D)r)rrrrr&rFrory)r?Dict[str, Any])r rr!rr"rr?None)rBr>r?r)r!Optional[Dict[str, Any]]r?tuple)r rrjrrBr>rkrOrlrOrbboolr!rr?r)r rrBr>rkrOrlrOrbrr!rr?r)rBr>r?r)r|rr?z Optional[int])rBr>rrOrhrr?r) r rrBr>rrOrhrr?r)__doc__ __future__rloggingrtypingrrrr getLoggerr6rerrr&rFr\roryrrrrr__all__rrrrs # ,,   8 $ |  ,R*I6;?D DD%2D=@DPSDD7D DD;?  ' 25 EH  7   >&  P"* r