߲j6rdZddlmZddlZddlZddlZddlZddlZddlZddl m Z ddl m Z m Z mZmZmZmZmZddlmZmZmZmZmZmZmZddlmZmZerddlmZej@e!Z"d Z#d%d Z$Gd d e%Z&d&d Z'd'dZ(d(dZ)e dGddZ*GddeeZ+GddZ,e,Z-gdZ.dZ/e GddZ0ddddd d!d"d#Z1d$Z2y))uwPersistent CDP supervisor for browser dialog + frame detection. One ``CDPSupervisor`` per Hermes ``task_id`` with a reachable CDP endpoint: one persistent WebSocket, ``Page`` / ``Runtime`` / ``Target`` events on every attached session (top page + auto-attached OOPIF / worker targets), pending dialogs + frame tree exposed via a thread-safe snapshot. Not in the tool schema — output reaches the agent via ``browser_snapshot`` / ``browser_dialog``. Dialog capture and frame tracking are mixins (``browser_supervisor_dialogs`` / ``browser_supervisor_frames``). Design spec: ``website/docs/developer-guide/browser-supervisor.md``. ) annotationsN) dataclass)AnyCallableDictListOptionalTuple TYPE_CHECKING)DEFAULT_DIALOG_POLICYDEFAULT_DIALOG_TIMEOUT_SRECENT_DIALOGS_MAX_VALID_POLICIES DialogRecordDialogSupervisionMixin PendingDialog) FrameInfoFrameTrackingMixin)ClientConnectioncP ddlm}|t|S#t$rYywxYw)aVRedact CDP endpoint credentials from an exception's (or URL's) string form. ``websockets`` bakes the raw URL (``?token=`` / ``user:pass@``) into its exception messages, so every egress point turning one into log/re-raise text MUST route through here; falls back to a fixed sentinel if redaction itself raises (err toward masking).r)redact_cdp_urlz) agent.redactrstr Exception)excrs =/home/ubuntu/.hermes/hermes-agent/tools/browser_supervisor.py_redact_cdp_error_textr*s+ "/c#h'' "!"s  %%ceZdZdZy)_LoopUnavailablez>The supervisor loop refused new work (closed / shutting down).N)__name__ __module__ __qualname____doc__rr r 7sHr&r c^ddlm}|||}| td|j|S)zORun ``coro`` on the supervisor loop from a sync caller and wait for its result.r)safe_schedule_threadsafez#Browser supervisor loop unavailabletimeout)agent.async_utilsr(r result)coroloopr*r(futs r _scheduler0;s3: "4 .C {DEE ::g: &&r&c d|dS)NF)okerrorr%)r3s r_failr4Es % ((r&cHtt|jd|S)N: )r4typer!)rs r_errr8Is# DI&&'r#/ 00r&T)frozencVeZdZUdZded<ded<ded<ded <d ed <d ed <dd Zy)SupervisorSnapshotz9Read-only snapshot of supervisor state for tool handlers.zTuple[PendingDialog, ...]pending_dialogszTuple[DialogRecord, ...]recent_dialogsDict[str, Any] frame_treeboolactivercdp_urltask_idc|jDcgc]}|jc}|jd}|jr+|jDcgc]}|jc}|d<|Scc}wcc}w)z7Serialize for inclusion in ``browser_snapshot`` output.)r<r?r=)r<to_dictr?r=)selfdouts rrEzSupervisorSnapshot.to_dictXscHLH\H\2]1199;2]mqm|m|}   :>:M:M$NQQYY[$NC ! 3^$Ns A/A4Nreturnr>)r!r"r#r$__annotations__rEr%r&rr;r;Ms+C..,, L L Lr&r;c&eZdZUdZeed ddZdddZdddZd dZ d!dZ ddd d  d"d Z d d d d  d#dZ dd dd$dZ d%dZd&dZd%dZd'dZd%dZd%dZd(dd d d)dZd%dZiej.ej.Zded<y)* CDPSupervisoraUOne supervisor per (task_id, cdp_url) pair. ``start()`` spawns a daemon thread running its own asyncio loop, connects, attaches to the first page target, enables domains and auto-attach. ``snapshot()`` / ``respond_to_dialog()`` / ``evaluate_runtime()`` are sync, thread-safe bridges onto that loop; all CDP I/O lives on the loop.) dialog_policydialog_timeout_sc|tvrtd|dtt||_||_||_t ||_tj|_ i|_ g|_ i|_ d|_d|_d|_tj"|_d|_d|_d|_i|_d|_d|_i|_d|_y)NzInvalid dialog_policy z; must be one of Fr)r ValueErrorsortedrCrBrNfloatrO threadingLock _state_lock_pending_dialogs_recent_dialogs_frames_active_loop_threadEvent _ready_event _start_error_stop_requested _next_call_id_pending_calls_ws_page_session_id_dialog_watchdogs _dialog_seq)rFrCrBrNrOs r__init__zCDPSupervisor.__init__fs  /5m5FFWX^_nXoWpqr r  * %&6 7%>>+:<35-/  :> 37 %OO-59$9;/3/3ACr&cT|jr|jjry|jjd\|_|_t j|jd|jd|_|jj|jj|s8|jtd|dt|jdd d |jx}(|jt!d t|dy) zkLaunch the background loop and block until attachment completes; raises what attach failed with (redacted).N)NFzcdp-supervisor-T)targetnamedaemonr)z%CDP supervisor did not attach within z s (cdp_url=Pz...)z CDP supervisor failed to start: )r]is_aliver_clearr`rarUThread _thread_mainrCstartwaitstop TimeoutErrorrrB RuntimeError)rFr*errs rrrzCDPSupervisor.starts <tjt 5t |j|dddd|j|jj||jdy#1swYCxYw)z/Cancel the supervisor task and join the thread.TNg@r)F) rar\ is_running contextlibsuppressrr0 _close_wsr]join _set_active)rFr*r.s rrtzCDPSupervisor.stops#zz   1$$Y/ ?$..*D#> ? << # LL  g  .   ? ?s BB'cT|j5||_dddy#1swYyxYwN)rWr[)rFvalues rr~zCDPSupervisor._set_actives'    ! DL ! ! !s'c 8|j5tt|jj t|j t d|j|j|j|jcdddS#1swYyxYw)z.Return an immutable snapshot of current state.N)r<r=r?rArBrC) rWr;tuplerXvaluesrYr_build_frame_tree_lockedr[rBrCrFs rsnapshotzCDPSupervisor.snapshotsx    % %d&;&;&B&B&D E$T%9%9;M:M:N%OP88:||T\\4<<    s A9BBN$@) prompt_text dialog_idr*c |dvrtd|S|j5|jstdcdddSt|jj }|stdcdddS|rK|jj |}|{td|dt|jdcdddSt|d kDr:tt|d |Dcgc]}|jc}cdddS|d }ddd|j}| td S |j|d k(|xsd} t| ||d|j#dScc}w#1swYdxYw#t$r} tt| cYd} ~ Sd} ~ wt$r} t!| cYd} ~ Sd} ~ wwxYw)zAccept/dismiss a pending dialog (sync bridge onto the supervisor loop). Returns ``{"ok": True, "dialog"}`` or ``{"ok": False, "error"}`` for recoverable errors.>acceptdismissz*action must be 'accept' or 'dismiss', got supervisor is not activeNzno dialog is currently openz dialog_id z not found (known: )rQz1 pending dialogs; specify dialog_id. Candidates: rsupervisor loop is not runningr)rrr)T)r2dialog)r4rWr[listrXrgetrSlenidr\_handle_dialog_cdpr0r rrr8rE) rFactionrrr*pendingrrGr.r-es rrespond_to_dialogzCDPSupervisor.respond_to_dialogs . .EfZPQ Q    $<<78 $ $400779:G:; $ $ ..229=> :i]:MfUYUjUjNkMllm!no $ $W!G ~-^nu_vij`a`d`d_v^wxy $ $! $zz <9: : **66X;M\g\mkm*nD dD' 2 fnn&677`w $ $(  !Q=  7N sfE6/E69AE6#E6)E1<E6E65)F1E66E? G F$G$ G0 G:GGT)return_by_value await_promiser*cjjs tdSj5jj c}ddds tdSs tdSdfd } ||}t|tr|jdini} | jd } | rQ| jd xsd } | jd xsijd } t| r | d| S| S| jdi}|jdd}d|vr|d}n,|dk(rd}n$|jd xs|jd}d||dS#1swY xYw#t $rh}|rdt|jvst|cYd}~S |d}n&#t $r} t| cYd} ~ cYd}~Sd} ~ wwxYwYd}~ad}~wwxYw)a>Evaluate ``expression`` in the page's Runtime context over the live WS. Returns ``{"ok": True, "result", "result_type"}`` or ``{"ok": False, "error"}``. ``return_by_value=True`` JSON-serializes the result (DevTools-console semantics); non-serializable objects come back as a description string.Nrrz'supervisor has no attached page sessionc^|dd}jd|}t|dzS)NT) expression returnByValue awaitPromise userGestureRuntime.evaluate session_idr*rQr))_cdpr0) by_valueparamsr-rrr.rFrr*s r _run_evalz1CDPSupervisor.evaluate_runtime.._run_evals@$.&3DJF99/JX_9`DT41= =r&zreference chain is too longFr,exceptionDetailstextzJavaScript exception exception descriptionr6r7 undefinedrunserializableValueT)r2r, result_type)rr@rJr>) r\ryr4rWr[rerrlowerr8 isinstancedictr)rFrrrr*rArresponserexc2result_payloadexception_detailsexc_textr result_objrrr.rs`` `` @@revaluate_runtimezCDPSupervisor.evaluate_runtimes zz  > " 1H8B(D7Qh3WY*../AB (,,V4N8NH,00=CHHWKH:R }5S S(S S#''"5  nnV[9 j w'E K 'ENN=1ZZ^^DY5ZEeKHHY E E  "$(ESIY(YCy  "$U+ "Dz!! " "s_E4F4E> G2 'G-1G28GG- G$ GG$G-G2G$$G--G2)rr*cj}||js tdSdfd dfd } t||dzS#t$r}t |cYd}~Sd}~wwxYw) aRe-attach the supervisor's page session to an open page target on ``origin`` (``scheme://host[:port]``). The initial attach picks the FIRST page target, but tools that open their own tabs (browser_exec) put the login form somewhere else. With ``accept`` (a JS expression) the first same-origin tab where it evaluates truthy wins, so a login and a checkout tab on one site resolve to the right one. Returns ``{"ok": True, "url"}`` or ``{"ok": False, "error"}``; on failure the previous session stays.NrcKjd|ddd{}|dd}j|d{j|d{|S7B7!7 w)NTarget.attachToTargetTtargetIdflattenr)r, sessionId)r_enable_page_domains_install_dialog_bridge) target_idattachsidrFr*s r_attachz)CDPSupervisor.focus_page.._attachsu99%<9ae>fpw9xxF";/C++C+A A A--c2 2 2J y A 2s3A'A!"A'A#A'A%A'#A'%A'cVKddlm} jd d{jdijdg}g}|D]i}t |jdxsd} |jd d k(r4|j d r# r || k(r|j |d |fk|D]\}}|d{} rp jd dd| d{}|jdijdijds jdd|i d{ j5| _ dddd|dcStd xsd r |rdzSdzS7d#t$rYJwxYw777a#1swYKxYww)Nr)normalize_originTarget.getTargetsr)r, targetInfosurlrr7page)zhttp://zhttps://rrT)rrrrzTarget.detachFromTargetr)r2rzno open page on zany sitez with the expected form) agent.vault_storerrrr startswithappendrrWrer4) rtargets candidatestrrrproberroriginrFr*s r_focusz(CDPSupervisor.focus_page.._focuss :!YY':GYLLQQRZ\^_ccdqsuvGJ !%%,,"-uuV}.3>>BY3Z%+/?/D/N"))1Z=#*>?  #- 0 3#I.."&)),>vhl@m7:G#,#MME 99Xr266xDHHQ"ii(AKQTCU_figgg %%0,/D)0"3// 0+F,@j+ABcinxF_BC CABC C-M!/Mh00s~F)FA F)+AF3F)F !F)*F+AF)9F:F) F2F) FF)FF)F)F)F& "F)rQr))rrrJrrI)r\ryr4r0rr8)rFrrr*r.rrrs```` @r focus_pagezCDPSupervisor.focus_page smzz  aP QO ^ ^    $$Y/ ^&-&7&7&=NQVVX1NNN AHHJ++GNNG,\W[,\]  ^ ^ ^ $$Y/        U #s4D'*E5E0E0?E5<F' E-02E("F (E--F 0E55E>F  J'H'?G G AH' J'H0 , J I& J&I/ +Jc||jjry||_|jjy)zNPropagate ``e`` to ``start()`` if we never got ready; True if it was consumed.FT)r_is_setr`set)rFrs rrzCDPSupervisor._fail_startTs4    # # % r&cK|jdc}|_|;tjt5|j d{dddyy7#1swYyxYww)z@Detach and close the current WebSocket, swallowing close errors.N)rdrzr{rr)rFwss rr|zCDPSupervisor._close_ws\s[xx DH >$$Y/ !hhj   ! !   ! !s.0A#AAA A#AA A#c|tkrytjd|j|t |t j |j|urt j|jy)abTrue once ``failures`` consecutive post-attach reconnects failed: log ONE final line and drop this supervisor from the registry so a dead endpoint (its Chrome exited with the task) leaves neither a retrying thread nor a stale registry entry behind. A later browser call for the task starts a fresh supervisor via ``get_or_start``.FzACDP supervisor %s: stopped after %s failed reconnect attempts: %sT)"MAX_POST_ATTACH_RECONNECT_FAILURESrrrCrSUPERVISOR_REGISTRYr_pop)rFfailuresrs r_reconnect_budget_spentz%CDPSupervisor._reconnect_budget_spentcs] 8 8Z||X/Ea/H J  " "4<< 0D 8  $ $T\\ 2r&c  Kd\}}}ddl}ddlm}ddi||j}|js t j |j|jfi|dd{|_t j&|j)d } d|_|j-d{|j/dt1j0}d}d}|j2j5|d{|j/d|j9sK|j;t=j>t j@t5|d{ddd|jBjED]} | j;|jBjG|jId{|jrytjKd|j|t j"|d{t%|d zd}|jsyy7#t$r}|j|rYd}~y|d z }|j||rYd}~ytjd |j|tt!|t j"t%|dd{7t%|d zd}Yd}~d}~wwxYw7<7#t6$r[}|j|r|d z }|j||rYd}~|j/d|j9sY|j;t=j>t j@t5|d{7dddn #1swYnxYw|jBjED]} | j;|jBjG|jId{7ytjd|jt1j0|z |tt!|Yd}~Pd}~wwxYw7#1swYxYw7#|j/d|j9sY|j;t=j>t j@t5|d{7dddn #1swYnxYw|jBjED]} | j;|jBjG|jId{7wxYw79w)aETop-level reconnecting supervisor coroutine. Browserbase tears down the CDP socket whenever a short-lived client (agent-browser's per-command CDP client) disconnects, so on drop we reset per-session ids, re-attach, and keep going. A failure before the first successful attach is fatal for ``start()``.)rg?rN)loopback_connect_kwargsmax_sizei rr)rQz5CDP supervisor %s: connect failed (attempt %s/%s): %sz cdp-reader)rkTrFzBCDP supervisor %s: session dropped after %.1fs (attempt %s/%s): %sz+CDP supervisor %s: reconnecting in %.1fs...)& websocketsagent.proxy_bypassrrBrarwait_forconnectrdrrrrrrCrrsleepmin create_task _read_loopre_attach_initial_pager~timer_rrrrrzr{CancelledErrorrfrror|debug) rFreconnect_failureslast_success_atbackoffrrconnect_kwargsr reader_taskhandles rrzCDPSupervisor._runps` 8C4OW>$&6`:QRVR^R^:_`&& !(!1!12D*2D2DT\\2dUc2dnr!ss"--doo.?lSK ')-%//111  &"&))+%&"!!%%'!!!  '"'')&&(#,,W-C-CYO*)))*"44;;=$FMMO$&&,,.nn&&&## LLF V] ^--( ( ('A+t,Gk&&s ##A&"a'"//0BAFV#||-?Ac5a8:mmC$6777gk40 &2 "  ^##A&"a'"//0BAF   '"'')&&(#,,W-C-CYO*)))***"44;;=$FMMO$&&,,.nn&&&c#||TYY[?-JL^ACYZ[C\^^  ^*** '  '"'')&&(#,,W-C-CYO*)))***"44;;=$FMMO$&&,,.nn&&& )s4U5I,H?- I6%UK86K27A K8K5K8AU!Q#'Q (Q#,A$UQ0A UUU=U?I K/ K*U!K*8U=AK*KK*$U*K//U2K85K88 Q)Q+Q3/AUNNN UN&"A#UPU AQQ3QQ3 Q##Q-( U3AU S"S S" U"S+ 'A#U U  UUcK|jdd{jdijdg}td|Dd}||jdddid{d}|jd |d d d d{}|dd x|_}|j |dd{|j |d{y77m7L7$7 w)zXFind (or create) a page target, attach flattened, enable domains, install dialog bridge.rNr,rc3JK|]}|jddk(s|yw)r7rN)r).0rs r z5CDPSupervisor._attach_initial_page..sJ!!%%-62IAJs##zTarget.createTargetrz about:blankrrTrrrr))rrnextrerr)rFr page_targetrrs rrz"CDPSupervisor._attach_initial_pages#677<W)X^A\]1^_%668FFH'*G$hhmmDJJw/000 3 ))#w??    # #GT 2_ 1?    # #GT 2sOAD< D !D &A*D<DD<D0D1D4$D<DD99D<c K|jJ |j23d{}|jry tj|}d|vro|jj|dd}||jrcd|vr'|jtd|dd|d|j||jj|jdx}s|||jdi|jd }||d{7#t$rt j dY)wxYw7.6y#t$r }t j d |Yd}~yd}~wwxYww) uWContinuously dispatch incoming CDP frames (responses → futures, events → handlers).Nz&CDP supervisor: non-JSON frame droppedrr3zCDP error on id=r6rrrzCDP read loop exited: %s)rdrarloadsrrrrcrr set_exceptionrv set_result_EVENT_HANDLERSr)rFrawmsgr/handlerr,rs rrzCDPSupervisor._read_loopsjxx### 8!XX % %c''**S/C3;--11#d)TBC{chhj #~)),9I#d)TVWZ[bWcVd7e*fgs+ $ 4 4 8 89J KKWK$T3778R+@#''+BVWF)$ ' % !LL!IJ%'&( 8 LL3Q 7 7 8sE; EE D#E EE;D& BE++EEE E#E &EEEE EE; E8E3.E;3E88E;zDict[str, Callable[..., Any]]r") rCrrBrrNrrOrTrJNone).@)r*rTrJr&)g@)rr@rJr&)rJr;) rrr Optional[str]rr(r*rTrJr>) rrrr@rr@r*rTrJr>)rrrr(r*rTrJr>rJr&)rrrJr@)rintrrrJr@r) rrrzOptional[Dict[str, Any]]rr(r*rTrJr>)r!r"r#r$r r rhrrrtr~rrrrrqrr|rrrrrrEVENT_HANDLERSrr"rKr%r&rrMrM`sT La+C#(HL@k$  !NR59D8%28DI8Uc8@LP/3d5I(,5I>C5IO]5InBFX\/f$.! >-@ /3/3d3,3>C3O]3 8:6 / /63E3T3T6O2r&rMcTeZdZdZd dZd dZd dZeedd d dZ ddZ d d Z y )_SupervisorRegistryuaProcess-global (task_id → supervisor) map with idempotent start/stop (``SUPERVISOR_REGISTRY``).cDtj|_i|_yr)rUrV_lock_by_taskrs rrhz_SupervisorRegistry.__init__s^^% 24 r&c||j5|jj|cdddS#1swYyxYwr)r/r0rrFrCs rrz_SupervisorRegistry.gets0 ZZ .==$$W- . . .s2;c~|j5|jj|dcdddS#1swYyxYwr)r/r0rr2s rrz_SupervisorRegistry._pops2 ZZ 4==$$Wd3 4 4 4s3<r')rNrO start_timeoutc|j5|jj|}|~|j|j}}|duxr(|j xr|duxr|j } |j|k(r | r |cdddS|jj|dddd|jt||||} | j||j5|jj|} | *| j|k(r| j| cdddS| |j|<ddd| S#1swYxYw#1swY| SxYw)zIdempotently ensure a supervisor runs for ``(task_id, cdp_url)``; one bound to a different ``cdp_url`` or unhealthy (dead thread / stopped loop) is stopped and replaced.N)rCrBrNrOr)) r/r0rr]r\rnryrBrrtrMrr) rFrCrBrNrOr4existingthreadr.healthy supervisoralreadys r get_or_startz _SupervisorRegistry.get_or_startsZZZ 1}}((1H#'// ,m1BmtSWGWm\`\k\k\m##w.7#  1 1 !!'40 1   MMO"7G1>Qac / ZZ 0mm''0G"w''A!  0 0 &0DMM' "  0+ 1 1 0s$A6E E0>E8EEE'cL|j|}||jyyr)rrt)rFrCr9s rrtz_SupervisorRegistry.stops%YYw'  ! OO  "r&c|j5t|jj}|jj dddD]}|j y#1swY!xYw)zA++A4Nr))rCrrJzOptional[CDPSupervisor]) rCrrBrrNrrOrTr4rTrJrM)rCrrJr&) r!r"r#r$rhrrr r r;rtr?r%r&rr-r-sHk5.4Pe/G`d',X]iv6 r&r-)rMrr;r-2c>eZdZUdZded<ded<ded<dZded <y) ConsoleEventz2Ring buffer entry for console + exception traffic.rTtsrlevelrNr(r)r!r"r#r$rKrr%r&rrBrB2s< I J ICr&rB) tools.browser_supervisor_dialogsDIALOG_BRIDGE_HOST)rEDIALOG_BRIDGE_URL_PATTERN)rEDIALOG_POLICY_AUTO_ACCEPT)rEDIALOG_POLICY_AUTO_DISMISS)rEDIALOG_POLICY_MUST_RESPOND)tools.browser_supervisor_framesFRAME_TREE_MAX_ENTRIES)rKFRAME_TREE_MAX_OOPIF_DEPTH)rFrGrHrIrJrLrMctj|}|tdtd|ddl}ddlm}|t|g|t|j|d|dS)Nzmodule z has no attribute r) warn_oncerQ) _PLUGIN_COMPAT_LAZYrAttributeErrorr! importlibhermes_cli.plugin_compatrOgetattr import_module)rkrjrRrOs r __getattr__rVGse $ $T *F ~wxl2DTHMNN2 h&v& 9**6!95vay AAr&)robjectrJr)r*rT)r3rrJr>)rrrJr>)3r$ __future__rrrzrloggingrUr dataclassesrtypingrrrrr r r tools.browser_supervisor_dialogsr r rrrrrtools.browser_supervisor_framesrrwebsockets.asyncio.clientr getLoggerr!rrrrvr r0r4r8r;rMr-r__all__CONSOLE_HISTORY_MAXrBrPrVr%r&rrbs #  !LLLJ:   8 $ &'" "I|I')1 $$J*,>JZ 55p*+ `  U!b!b"d"d["cBr&