߲joUdZddlmZddlZddlZddlZddlZddlZddlZddl Z ddl Z ddl m Z m Z mZmZddlmZmZmZddlZddlmZddlmZmZmZddlmZmZdd lmZdd l m!Z!ejDe#Z$d Z%d Z&da'd e(d<da)iZ*de(d<da+de(d<da,dGdZ-dHdZ.dIdZ/dIdZ0dJdZ1dKdZ2dJdZ3dLdZ4dMdZ5dNdOdZ6dddPdZ7dQd Z8dRd!Z9dSd"Z:dTd#Z;iZdUd&Z?dVd'Z@dWdXd(ZAdYd)ZBdNdZd*ZCdNd[d+ZDdNd\d,ZEd]d^d-ZFd]d_d.ZGd]d\d/ZHd`d0ZIdad1ZJdbd2ZKdcd3ZLddd4ZMded5ZNdNdfd6ZOdgd7ZPdNdhd8ZQdid9ZR djd:ZSdkdld;ZTdNdmd<ZUdNdnd=ZVdNdod>ZWdNdpd?ZXdNdqd@ZYdNdpdAZZdNdpdBZ[drdCZ\dsdDZ]dtdudEZ^dtdvdFZ_y)wuTCamofox browser backend — local anti-detection browser via REST API. Camofox-browser (https://github.com/jo-inc/camofox-browser) is a self-hosted Node.js server wrapping Camoufox (Firefox fork with C++ fingerprint spoofing); its REST API maps 1:1 to our browser tool interface (accessibility snapshots with element refs, click/type/ scroll by ref, screenshots). Setup: ``npm start`` in a checkout or ``docker run -p 9377:9377 -e CAMOFOX_PORT=9377 jo-inc/camofox-browser``, then ``CAMOFOX_URL=http://localhost:9377`` in ``~/.hermes/.env`` (Docker: see ``CAMOFOX_REWRITE_LOOPBACK_URLS`` below). ) annotationsN)AnyCallableDictOptional) SplitResulturlsplit urlunsplit) get_secret)cfg_get load_configread_raw_config)get_hermes_home_overridehermes_home_key)get_camofox_identity) tool_errorz0No browser session. Call browser_navigate first. Optional[str]_vnc_urlFzDict[str, Optional[str]]_vnc_url_by_camofox_urlzOptional[Dict[str, int]]_cached_cmd_timeoutc,t}tiatr|tvr t|St} t t dd}|t t|d}|t|<da|S#t$r }tjd|Yd}~1d}~wwxYw)z^``browser.command_timeout`` (floor 5s, default 30s), cached per profile home after first read.Nbrowsercommand_timeoutz*Could not read browser.command_timeout: %sT) rr_cmd_timeout_resolved_DEFAULT_TIMEOUTr rmaxint Exceptionloggerdebug)hometimeoutvalexcs :/home/ubuntu/.hermes/hermes-agent/tools/browser_camofox.py_get_command_timeoutr(1s  D" )Return the VNC URL if the Camofox server exposes one, or None.)rr6rr]r:r\r)rSs r' get_vnc_urlr_sA!- - - # %&**3// ! Or0c tjdijdi}t |t r|SiS#t$r"}tj d|icYd}~Sd}~wwxYw)z>Return the ``browser.camofox`` config block, or an empty dict.rrCz7camofox config check failed, defaulting to disabled: %sN)r r:r r!warningr;r<) camofox_cfgr&s r'_get_camofox_configrcse!m'' 26::9bI %[$7;?R? PRUV s*A A+ A& A+&A+cNt| tn|jdS)z\``browser.camofox.managed_persistence``: stable profile-scoped userId vs random per session.managed_persistence)rGrcr:)rbs r'_managed_persistence_enabledrfs$ +*=$&;SSTij kkr0secretc|r t|dntj|d}|xsdjxs,t |j |xsdjS)zOEnv/secret-scope value first, then the ``browser.camofox`` config key, else "".r+)r rDrEr-r=r:)env_namerbcfg_keyrhraws r' _env_or_cfgrmsQ&,*Xr ""))Hb2IC I2    M#koog&>&D""E"K"K"MMr0cjtd|dd}|sytd|dd}||xs d|xsd dd d S) zExternally configured identity (integrations owning the visible Camofox browser share a user ID so Hermes uses the same profile), or None.CAMOFOX_USER_IDuser_idTrgNCAMOFOX_SESSION_KEY session_keytask_defaultrprr)rm)task_idrbrprrs r'_camofox_identity_overriderxsT+[)DQG 3[-X\]K{/cwG[R[]`^`FaEb>c ddr0ctj|djj}|dvry|dvry|rtj d||t |j|S)zHBoolean toggle: env var wins when set to a valid value, else config key.r+>1onyestrueT>0noofffalseFz"Ignoring invalid boolean env %s=%r)rDrEr-lowerr!r"rGr:)rjrbrkrls r'_flagrsd ))Hb ! ' ' ) / / 1C (( ))  98SI  ( ))r0c|sy|jjdj}|dvry tj|jS#t $rYywxYw)NFz[]>localhost.localdomainrMT)r-r ipaddress ip_address is_loopbackrQ)rPhosts r'_is_loopback_hostnamersb  >>  ! !$ ' - - /D 55##D)555 sA A"!A"c t}td|ds|dfS t|}t d|dxsd}|j dvst |jr|s|dfS|jr-|j|jrd|jnd zd znd }d|vr|jd sd |d n|}|jrd|jnd }tt|j ||||j|j|j }||jxsd |||d fS#t$r|dfcYSwxYw)a Rewrite loopback page URLs for Docker-hosted Camofox, if configured. ``CAMOFOX_URL`` may point at a host-published Docker port, but page URLs are opened by the browser *inside* the container, where loopback is the container, not the host. Opt-in (``CAMOFOX_REWRITE_LOOPBACK_URLS`` / config) because non-Docker installs run the browser on the host. Returns ``(rewritten_url, metadata)``; ``metadata`` is present only when a rewrite happened so the tool result can disclose the change to the model. CAMOFOX_REWRITE_LOOPBACK_URLSrewrite_loopback_urlsNCAMOFOX_LOOPBACK_HOST_ALIASloopback_host_aliaszhost.docker.internal>httphttpsrNr+@[])fromto original_url rewritten_url)rcrr rQrmschemerrPusernamepassword startswithportr rpathqueryfragment)rSrbparsedaliasuserinfo host_part port_part rewrittens r'!_rewrite_loopback_url_for_camofoxrsW&'K 0+?V WDy# 5{DY Z t^tE }}--5J6??5[chDy_e_n_nFOOQv&7#8QSTWZZtvH #u U5E5Ec5J!E7! PUI%+[[!FKK=!bIFMMhZ {9+#F U[UaUacicrcrsuI v4"ESVirs ss Dys D44 EEzDict[str, Dict[str, Any]] _sessionsc|jds|jdr ts|S tdt|djdg}t|tr!|Dcgc]}t|ts|c}ng}|Dcgc](}|jd |jd k(s'|*c}xs|}|r|d jd nd }t|tr-|r+||d<t j d||jd|S#t$r2}t j d|jd||cYd }~Sd }~wwxYwcc}wcc}w)zRehydrate tab_id from an already-open managed tab: gateway restarts empty the in-memory cache while Camofox still holds the integration-owned tab.tab_idadopt_existing_tab/tabsr)paramsr$tabsz&Camofox tab adoption failed for %s: %srpN listItemIdrrtabIdz&Adopted existing Camofox tab %s for %s) r:r6_get _user_paramsr r!r"r;listr<r=)sessionrr&tab dict_tabs candidatesrs r'_adopt_existing_tabrs-{{8GKK0D$E_M^GL$91EII&RTUCMTSWBX> 3(=>^`I!*b#cggl.Cw{{S`Ga.a#bofoJ,6Z^   (DF&#6" =vw{{S\G]^ N  =w{{9?UWZ[?bs5'D+EE(E7E E"'E EEc|xsd}t5|tvrtt|cdddSt}t ||}|t |r t |}|3dtjjddd|ddd}d\}}nd td |d }}|d d|d ||d}|t|<t|cdddS#1swYyxYw)uGet or create the task's session. Identity precedence: external override (CAMOFOX_USER_ID / config) → profile-scoped identity when managed persistence is on → random ephemeral userId.rtNhermes_ rsrurv)FFTCAMOFOX_ADOPT_EXISTING_TABrrprr)rprrrmanagedr) _sessions_lockrrrcrxrfruuiduuid4hexr)rwrbidentityradoptrs r' _get_sessionrs"G , i &y'9:,,*+ -g{C   <[ I+G4H  %,TZZ\-=-=cr-B,C#DW\]dehfh]i\jUklH)NGU!5)E{Th#iUG&y1TRZ[hRi%UD$ '"7+,,,sCBCCczt|}|ds*td|d|d|d}|jd|d<|S)z>r0cd|dd|S)Nz/tabs/rr3r5)rsuffixs r' _tab_pathrRs GH%&ax 00r0cd|diSNrrpr5rs r'rrVs gi( ))r0cBtt|dt|S)Nsnapshotr)rrrrs r'_snapshot_datarZs  ':.|G7L MMr0cg}|jd}t|D]\}}|j}|jds(t j d|}|dzt |kr*t j d||dzjnd}|r|jdnd|r|jdnd} }|s| s|j| |d|S) zImages from an accessibility snapshot: ``img "alt" [eN]`` entries with the URL on the following ``/url:`` line (Camofox has no /images endpoint). )z- img zimg zimg\s+"([^"]*)"rLz /url:\s*(\S+)Nr+)srcalt) split enumerater-rresearchlengroupappend) rimageslinesilinestripped alt_match url_matchrrs r'_parse_snapshot_imagesr^sF NN4 EU#44::<""#56 II0(; IJQQTUZQ[I[BII.a!e 0B0B0DEae *3IOOA&U^yq?QdfS # MM#c2 34 Mr0cddlm}ddlm}t |}|j dd|}}t ||kDr |||}||j ddfS)z``(snapshot_text, refs_count)`` truncated like the main browser tool (line boundaries, full tree stored to cache/web, read_file pointer appended). Lazy import: ``browser_tool`` imports this module.r)_truncate_snapshot)get_browser_snapshot_thresholdrr+) max_chars refsCount)tools.browser_tool_snapshotrtools.browser_toolrrr:r)rrrrr thresholds r'_fetch_snapshotr osZ?A ' "D((:r24R4TiH 8}y %h)D TXXk1- --r0cRt|}|dr# tt|d|d|dd}||fSt||d |d fS#tj$rN}|j |j j dk7rtjd |dd|d<Yd}~md}~wwxYw) uOpen ``browser_url`` in the task's tab (creating it if missing) and return ``(session, navigate_response)``. A 404 on the existing tab means the server garbage-collected it — recreate instead of failing.rnavigaterp)rrS<rXNiuPCamofox tab %s returned 404 — tab was garbage collected. Creating a fresh tab.T)okrS) rrrrZ HTTPErrorresponser[r!rar)rw browser_urlrres r' _navigate_tabr|s7#Gx %7J7GIDV_j9kuwxDD=  w ,T+.N NN !! %zz!QZZ%;%;s%B NNm"8, . $GH   %s!AB&AB!!B&c t|\}}t||\}}d|jd||jddd}|r||c|d<|d<d|d d |d |d <t}|r ||d <d|d< t |\|d<|d<t j|S#t $rY wxYw#tj$r}td|dcYd}~Sd}~wtj$r't jddtddcYSt $r }tt|dcYd}~Sd}~wwxYw)zNavigate to a URL via Camofox.TrStitler+)successrSr requested_url url_rewritez0Rewrote loopback URL for Docker-hosted Camofox: rz -> rravnc_urlz]Browser is visible via VNC. Share this link with the user so they can watch the browser live.vnc_hintr element_countzNavigation failed: FrNzCannot connect to Camofox at z. Is the server running? Start with: npm start (in camofox-browser dir) or: docker run -p 9377:9377 -e CAMOFOX_PORT=9377 jo-inc/camofox-browserrerror)rrr:r_r r rOdumpsrZrrConnectionErrorr6r=) rSrwr rewrite_inforrresultvncrs r'camofox_navigater$s{1$Ec$J! \%g{; !$((5+*FQUQYQYZaceQfg =@, :F? #VM%:!S$0$8#9l4>P=Q"SF9 m  #F9 #fF:  :I':R 7F:  7zz&!!      D/s3UCC  # #Yzze+O,=+>?V VXY Y 1#a&%001sZA7B2:B#B2# B/,B2.B//B22D>CD>:D>D>D93D>9D>cddlm}m}||xsdsy||d|d}|sytjdd|d |d d d S) aBlocked payload when the current page is private/internal, else None. Mirrors the ``_camofox_eval`` guard in browser_tool.py: page-state reads on a non-local backend can leak an intranet/metadata page the terminal can't reach. Only active when the SSRF guard applies (non-local backend, not a local sidecar, ``allow_private_urls`` unset); fail-open on probe failure like sibling guards. Lazy import (cycle). r)!_camofox_current_page_private_url_eval_ssrf_guard_activertNrrpFz9Blocked: page URL targets a private or internal address (z). Refusing to z# on this page in this browser mode.r) ensure_ascii)tools.browser_tool_eval_policyr&r'rOr)rrwactionr&r' blocked_urls r'_camofox_private_page_blockr,skj "7#7i 83GH4EwyGYZK  ::% =x/R TVdi kkr0cpt|}|ds|ttdfS||t|||fSdfS)zkReturn ``(session, error_payload)``: error when no tab exists or, if ``action`` given, the page is private.rFrN)rr_NO_SESSION_ERRORr,)rwr*rs r' _require_tabr/sJ7#G 8  #4eDDD fN`0'6J kkfj kkr0c t||\}}|r|S||S#t$r }tt|dcYd}~Sd}~wwxYw)zRequire a tab (+ private-page guard when ``guard_action`` is set), then run ``body(session)``; any exception becomes a ``tool_error``.FrN)r/r rr=)rw guard_actionrrblockedrs r' _with_tabr3sK1'> NG} 1#a&%001s AAAAc,t||fdS)zNSimple tab action: POST ``body`` to ``/tabs//``, build the result.c ptjtt|d|diSr)rOrrr)rrr"rs r'z_tab_action..s7DJJuYw/(GI.bodys(.w7*zzdS]^__r0zread a page snapshotr7)fullrw user_taskrs r'camofox_snapshotr>s` W4d ;;r0cN|jdt|dddifdS)z$Click an element by ref via Camofox.rclickrefc0d|jdddS)NTrSr+)rclickedrSr:)r clean_refs r'r6zcamofox_click..sSWS[S[\aceSf$gr0)lstripr8)rArwrEs @r' camofox_clickrGs/ 3I w5)2Dg iir0cp t|d\}}|r|S|jd}tt|d|d||dddlm}m}|dd|ixsid}d ||d } tj|| |S#t$r-} dd lm}t|t| |d cYd} ~ Sd} ~ wwxYw)z-Type text into an element by ref via Camofox.typerrp)rrAtextr)%redact_browser_typed_text_for_displayredact_tool_args_for_display browser_typerJT)rtypedelement)rKFrN) r/rFrr agent.displayrKrLrOrr rr=) rArJrwrr2rErKrL display_textrrs r' camofox_typerRs^'8 NJJsO  i(WY5GPYcg*hie5^fd^TZXZ\bc #lyQzz?$OPP ^G?AMW\]]^s#A?A)A?? B5"B0*B50B5c,t|dddifdS)zScroll the page via Camofox.Nscroll directioncddS)NT)rscrolledr5)rrUs r'r6z camofox_scroll..s )$Lr0r8)rUrws` r'camofox_scrollrYs" whi0HL NNr0c"t|ddidS)zNavigate back via Camofox.Nbackc,d|jdddS)NTrSr+)rrSrD)rs r'r6zcamofox_back..s4X\X`X`afhjXk?lr0rXrs r' camofox_backr]s wfb2l mmr0c,t|dddifdS)z!Press a keyboard key via Camofox.pressr.cddS)NT)rpressedr5)rr.s r'r6zcamofox_press.. sY]jmMnr0rX)r.rws` r' camofox_pressrb s w5#,@n oor0c t|}|rtd|dtjdddS#t$r,}tjddt |dcYd}~Sd}~wwxYw)z&Close the browser session via Camofox.z /sessions/rpT)rclosed)rrdraN)rrrOrr r=)rwrrs r' camofox_closeresjP(  j!3 45 6zzdd;<< Pzzdds1vNOOPs58 A-!A("A-(A-c"d}t|d|S)zFGet images on the current page via Camofox (parsed from the snapshot).ctt|jdd}tjd|t |dS)Nrr+T)rrcount)rrr:rOrr)rrs r'rz camofox_get_images..bodys9'w(?(C(CJPR(STzzdfs6{STTr0zextract page imagesr7)rwrs r'camofox_get_imagesrisU W3T ::r0c ttddi}t|jddt|jddfS#t$rYywxYw) zY``auxiliary.vision`` ``(timeout, temperature)``; defaults 120s / 0.1 on any config error. auxiliaryvision)rtr$x temperature皙?)g^@ro)r r floatr:r )cfgs r'_vision_llm_settingsrr"sVkm[(BGSWWY,-uSWW]C5P/QQQ sA A AAcddlm}|dz }|jddt|dt j j ddd z }t|d 5}|j|ddd|S#1swY|SxYw) zOWrite PNG bytes under ``$HERMES_HOME/browser_screenshots`` and return the path.r)get_hermes_homebrowser_screenshotsT)parentsexist_okbrowser_screenshot_Nz.pngwb) hermes_constantsrtmkdirr=rrropenwrite)contentrtscreenshots_dirscreenshot_pathfs r'_save_screenshotr+s0%'*??O$6/.A$**,BRBRSUTUBVAWW[,\\]O ot $   s !A==Bc,fd}t|d|S)z.body8sd '<8gAVW*4<<8""4<<077@  )'266z2F'_`hinjn`o_p%q" 73FxjQfgyQzP{| 35%7$E=ST[S\;]3^_3abc{G E KSJZJZH$$Q'//77=2DDF`bzzd8Mh8Wl{|}}  s*#D22 D>=D>zcapture a screenshotr7)rrrwrs`` r'camofox_visionr6s~2 W4d ;;r0c :tjdggddddS)zZConsole output is not exposed by the Camofox REST API; return an empty result with a note.Trz|Console log capture is not available with the Camofox backend. Use browser_snapshot or browser_vision to inspect page state.)rconsole_messages js_errorstotal_messages total_errorsnote)rOr)clearrws r'camofox_consolerTs. ::RbTUghPQ RRr0)returnr)rDict[str, str])rr=)rrG)rSr=rTrrr)rr)rDict[str, Any])N)rbOptional[Dict[str, Any]]rrG) rjr=rbrrkr=rhrGrr=)rwrrbrrzOptional[Dict[str, str]])rjr=rbrrkr=rrG)rPrrrG)rSr=rz$tuple[str, Optional[Dict[str, str]]])rrrr)rwrrr)z about:blank)rwrrSr=rr)rwrrr)rwrrrG) rr=rr=r$ Optional[int]rrrrequests.Response)rr=rr<r$rrr<)NN)rr=rr<r$rrr<)rr=rr<r$rrr)rrrr=rr=)rrrr)rrrr<)rr=rzlist[Dict[str, str]])rrrztuple[str, int])rwrrr=rztuple[Dict[str, Any], dict])rSr=rwrrr=)rrrwrr*r=rr)rwrr*rrz$tuple[Dict[str, Any], Optional[str]])rwrr1rrzCallable[[Dict[str, Any]], str]rr=) rwrr1rrr=rrr"zCallable[[dict], dict]rr=)FNN)r<rGrwrr=rrr=)rAr=rwrrr=)rAr=rJr=rwrrr=)rUr=rwrrr=)rwrrr=)r.r=rwrrr=)rztuple[float, float])rbytesrr=)FN)rr=rrGrwrrr=)rrGrwrrr=)`__doc__ __future__rrrrOloggingrDr threadingrtypingrrrr urllib.parserr r rZagent.secret_scoper r9r r rr{rrtools.browser_camofox_statertools.registryr getLogger__name__r!rr.r__annotations__r\rrrr(r/r6r?rIrVr]r_rcrfrmrxrrrrLockrrrrrrrrrrrrrrrr rr$r,r/r3r8r>rGrRrYr]rbrerirrrrrr5r0r'rs#    00::)CCF<%   8 $F-571615-4(= = #(#( @l ]bN e * t8(* $)!&,.9 =@9 ? 1*N" .O$1>k&l 1\$\.D\IL\<i^(N n p P;<<Rr0