+ lHj?a0t$Rt^RIHt^RIt^RIt^RIt^RIt^RIt^RI t ^RI H t ^RI H t HtHt^RIHt^RIHt]P(!]4tRtR8tRtR tR R ltR R ltRRltRRlt/tR] R&RRlt!RRlt"RRlt#RRlt$Rt%RRlt&Rt'R R!lt(R"R#lt)R$R%lt*R&R'lt+R(R)lt,R*R+R,RR-R/R.R/llt-R0R1lt.R2R3lt/R4R5lt0R6R7lt1R#)9a*Bot Desktop hosted INSIDE the configured terminal backend (docker / ssh / a plugin backend with streams). Same launcher, same lease, same pane: only WHERE Xvnc + Xfce run changes. ``runtime`` decides between the gateway host and this module via ``placement()``; callers keep using ``runtime.start/stop/status/desktop_env``. Layout inside the sandbox, under ``/hermes-bot-desktop//``: ``launcher.sh`` (copied in at start), ``env`` (published DISPLAY/XAUTHORITY/DBUS), ``rfb.sock`` (Xvnc's unix socket), ``launcher.pid``. Host-side state under ``/bot-desktop/``: ``sandbox.json`` = ``{"env_key": ..., "display": ...}`` so status() knows which terminal environment owns the screen without re-deriving it. The Desktop pane never sees a socket path: ``open_rfb_stream()`` returns a Popen whose stdin/stdout ARE the RFB byte stream, relayed by a 15-line Python script inside the sandbox (python3 is in every sandbox image; socat is not). cua-driver runs the same way: ``cua_mcp_argv()`` is the docker/ssh prefix + ``cua-driver mcp``. ) annotationsN)Path)AnyDictOptionalget_hermes_home)streamspnz#nousresearch/hermes-sandbox:desktopa7import os,socket,sys,threading s=socket.socket(socket.AF_UNIX);s.connect(sys.argv[1]) def up(): while True: d=os.read(0,65536) if not d: break s.sendall(d) s.shutdown(socket.SHUT_WR) threading.Thread(target=up,daemon=True).start() while True: d=s.recv(65536) if not d: break os.write(1,d) c V^8dQhRRRR/#)backend Optional[str]return)formats"C/home/ubuntu/.hermes/hermes-agent/tools/bot_desktop/sandbox_host.py __annotate__r7s...=.cH^RIHpV'dW9dR#RV R\ R2#)zHow to get the desktop stack into a plugin backend's sandbox, or None for a built-in backend: a plugin picks its image through its own settings, so there is no ``terminal._image`` key to name.)_BUILTIN_BACKENDSNz give the zL plugin's sandbox the desktop stack through the plugin's own image setting (z has it))tools.terminal_tool_configrSANDBOX_IMAGE_HINT)r rs& rplugin_image_advicer7s0= g2y!"#8 -.rcV^8dQhRR/#)r rrr)rs"rrrAs>>>rc2\4R, R, #)z bot-desktopz sandbox.jsonrrrr_markerrAs  } ,~ ==rcV^8dQhRR/#)r rdict[str, Any]r)rs"rrrEsnrc\P!\4PRR74# \\ 3d/u#i;i)z utf-8-sigencoding)jsonloadsr read_textOSError ValueErrorrrr _read_markerr'Es?zz')--{-CDD Z  s-0AAc V^8dQhRRRR/#)r envrrrr)rs"rrrLsrcR\V4P/p\VRR4pV'dW!R&\VRR4VR&V#)zWhat the marker records about the sandbox hosting the screen, so a restarted gateway (empty terminal registry) can tell a still-running sandbox from one that was removed.r _container_idN container _docker_exedocker)type__name__getattr)r)identr,s& r_owner_identityr3LsH'S (:(:;E_d3I&k!#}h?h Lrzdict[str, tuple[float, bool]] _ALIVE_CACHEc V^8dQhRRRR/#)r markerrrboolr)rs"rrrZsDrc .VPR4pV'gR#\P!4p\PV4pV'dW#^,, R8d V^,#\P !VPR4;'gRRRRV.RR^R\P R 7pVP^8H;'dVPP4R 8HpW%3\V&V# \\P3dRpL+i;i) aaWhether the sandbox a marker names still exists. Docker: ``docker inspect`` on the recorded container (cached a few seconds; this sits on the browser's per-command path). Other backends (ssh host, apptainer instance) cannot be probed from here without their environment object: the re-attach's own ``published_env`` probe decides, so they read as alive.r,Tg@r.inspectz-fz{{.State.Running}}F)capture_outputtexttimeoutcheckstdintrue) gettime monotonicr4 subprocessrunDEVNULL returncodestdoutstripr%TimeoutExpired)r6r,nowcachedprocalives& rmarker_sandbox_aliverNZs  ;'I  .. C   i (F #q /C'ay~~vzz(3??xDRfhqr-1bPU]g]o]oq1$FF):):)<)F #lL L Z.. /s,'C45C4 C44DDc$V^8dQhRRRRRR/#)r r)rprofilestrrr)rs"rrrps&WWSW3W3WrcV\P!V4PR4 RV 2#)/z/hermes-bot-desktop/)r sandbox_temp_dirrstripr)rPs&&r _remote_dirrWps+&&s+2237 88LWI VVrc V^8dQhRRRR/#r r)rrrQr)rs"rrrts  c c rcz\VRR4pV'dV#\P!V.R O\V4^R7pVP^8Xd+VP P RR4P4MRpV'dVPR4'g\V4'd R\ 2MR pW0n V#) aa``$HOME`` of the user the desktop and the browser run as inside ``env`` (cached on the env). This is where state that must outlive a container stop goes: ``/tmp`` in the Docker backend is a 512 MB tmpfs that is emptied on every stop and shared with the sandbox's scratch, so a browser profile (logins, cookies) there would vanish and grow into that cap._bd_desktop_homeNuserr<utf-8replacerSz/home/z/root)bash-czprintf %s "$HOME") r1r run_in _user_forrFrGdecoderH startswith DESKTOP_USERr[)r)rKrLhomes& r desktop_homerits S,d 3F  >>#BSVac dD=A__PQ=Q4;;  gy 1 7 7 9WYD ts++*3C.. ~&g Krc V^8dQhRRRR/#rYr)rs"rrrsRRSRSRrc<\V4PR4 R2#)zThe ONE ``--user-data-dir`` the agent's agent-browser and the dock's Browser icon share inside the sandbox (same rule as the host: two profiles would mean the human logs into a jar the bot never sees).rSz$/.hermes/bot-desktop/browser-profile)rirU)r)s&rbrowser_profile_dirrls#3&&s+ ,,P QQrafor d in "${PLAYWRIGHT_BROWSERS_PATH:-}" /opt/playwright "$HOME/.cache/ms-playwright"; do [ -n "$d" ] || continue; for c in "$d"/chromium-*/chrome-linux/chrome "$d"/chromium-*/chrome-linux64/chrome; do [ -x "$c" ] && { printf %s "$c"; exit 0; }; done; done; exit 1c V^8dQhRRRR/#r r)rrrr)rs"rrrs  S ] rc6\VRR4pVR8wdV#\P!VRR\.\ V4^R7pVP ^8Xd+VP PRR4P4MRpT;'gR Vn VP#) zPath of the Playwright Chromium agent-browser uses inside ``env`` (the dock's Browser icon must run the same binary), or None when the image has none. Cached on the env. _bd_chromiumunsetrarbr\r^r_r`N) r1r rc_CHROMIUM_PROBErdrFrGrerHrp)r)rKrLexes& rchromium_executablertsS.' 2F  >>#o>Ys^]_ `D<@OOq_WZ_nrc VPR4pV'gR#VP4UUu/uFwrVVR 9gKWVbK ppp\P!VRR\V\ V^,4\ V^,4\ V4.V\ V4^R7pTP^8wg"TPPR4'g6\PRTPP!RR 4R R4R#TP#uuppi \\P3d"p \PRT 4Rp ? R#Rp ? ii;i) zOne JPEG of the sandbox screen, grabbed INSIDE the sandbox (the X socket and its cookie live there). Needs Pillow in the image (the published desktop image ships it); None when the grab fails.DISPLAYNpython3rb child_envr]r<zsandbox screen grab failed: %ssr^r_)r| XAUTHORITYi)r@itemsr rc _GRAB_SCRIPTrQrdr%rCSubprocessErrorloggerdebugrFrGrfstderrre) r)rvrxrydisplaykvrrLexcs &&&& r grab_jpegrs%mmI&G "+//"3V"3$!q/dev/null 2>&1 || echo "$b"; donerarbr\r^r_)join _REQUIREDr rcrdrGresplit)r)scriptrLbs& rmissing_binariesrss 388I. .1j jF >>#f5IcNTV WD{{))'9=CCE KE!AAE KK Ks 6 B B c$V^8dQhRRRRRR/#)r r)rrdirrQrrwr)rs"rrrs!  C s ~ rc \P!VRRR\P!V4 R\P!V4 R\P!V4 R2.\ V4^R7pVP ^8wd/#/pVP PRR4P4FApVPR 4wrVpV'gK!VP4W5P4&KC V#) rarbzkill -0 $(cat z2/launcher.pid 2>/dev/null) 2>/dev/null && test -S z/rfb.sock && cat /envr\r^r_=) r rcshlexquoterdrFrGre splitlines partitionrH)r)rrLoutlinerseprs&& r _publishedrs >>#u{{4?P>QR;;@;;t;L:MM^_d_j_jko_p^qqu/w x(~r ;D ! C ""7I6AACNN3'  3WWYC ND Jrc$V^8dQhRRRRRR/#)r r)rrPrQrrwr)rs"rrrs!66s6S6^6rc,\V\W44#)N)rrWrVs&&r published_envrs c;s4 55r wait_secondsg4@ browser_execbrowser_exec_linec4V^8dQhRRRRRRRRRR R R R R /#) r r)rrPrQgeometryrfloatrrrrrwr)rs"rrrs@;=;=s;=S;=s;=%;=%;=AN;=Zh;=rc\W4p\W4pVPR4'd \WW4#\ W4\ V4pV'dJ\ \VRR44;'g R\ R2p \RRPV4 RV R 24h\V4p \\4PR 4P4p \\4PR 4P4p R \ P"!V4 R \ P"!V4 R\ P"!V4 R\ P"!\$P&!V 4P)44 R\ P"!\$P&!V 4P)44 R2 p \*P,!VRRV .V ^R7pVP.^8wd,\RVP0P)RR4R3R 24h^pRVR\3V4RV R2RV R2RV R2R V R!2R"VR#V R$2/pV'dV'd VVR%&VVR&&R'\ P"!V4 R(2p\*P,!VRRV.VV ^R)7pVP.^8wd,\R*VP0P)RR4R3R 24h\4P6!4V,p\4P6!4V8dy\W4pVPR4'd?\8P;R+V\=V4P>VR,4\WW4#\4P@!R,4K\*P,!VR-RR.V R/2.V ^ R7PBp\ W4\R0VR1 R2VP)RR4 24h)4zsBring the screen up inside ``env`` (idempotent); returns the published env. Raises RuntimeError naming the blocker.r|_hermes_backend_nameNzuse zY (the default sandbox base plus the desktop stack) as terminal.docker_image / modal_imagezBot Desktop needs z, zQ inside the terminal backend's sandbox. The configured image does not have them; z(, or set bot_desktop.placement: gateway.z launcher.shz wallpaper.pngzset -e; rm -rf z ; mkdir -p z; cd z; echo z! | base64 -d > launcher.sh; echo z6 | base64 -d > wallpaper.png; chmod 0700 . launcher.shrarbr\z(could not seed the sandbox desktop dir: r^r_HERMES_BD_PROFILEHERMES_BD_DISPLAY_NUMHERMES_BD_SOCKET /rfb.sockHERMES_BD_XAUTHz /XauthorityHERMES_BD_ENV_FILErHERMES_BD_CONFIG_HOMEz/xdgHERMES_BD_GEOMETRYHERMES_BD_WALLPAPERz/wallpaper.pngHERMES_BD_BROWSER_EXECHERMES_BD_BROWSER_EXEC_LINEzcd z && setsid -f bash -c 'echo $$ > launcher.pid; exec bash launcher.sh' > launcher.log 2>&1 < /dev/null; for _ in 1 2 3 4 5 6 7 8 9 10; do [ -s launcher.pid ] && break; sleep 0.1; done; [ -s launcher.pid ]r~z(sandbox desktop launcher did not start: z-Bot Desktop for profile %s up inside %s on %sg?tail2000z /launcher.logz3sandbox desktop did not publish its display within z.0fzs: i )"rWrr@_recordstoprrr1r RuntimeErrorrrdr__file__ with_name read_bytesrrbase64 b64encoderer rcrFrrQrArBrinfor/r0sleeprG)r)rPrrrrrlivemissingadvicer]launcher wallpaperseedrLnumrspawndeadliners&&$$$$ rstartrs s $D c D xx s'00s#G$WS2H$%OP44%&'2 3  7!3 45##)(*R TU U S>DX((7BBDHX((9DDFI %++d+,K D8I7J%PUP[P[\`PaObcV--h7>>@ABCV--i8??ABCD$ $ >>#d3$ KD !EdkkFXFXY`bkFlmqmrFsEtuvv CW&=s3xI[`d_een]odV;/1E$t}D60DhPejnioo}g~I ).: *+3D /05;;t$%&tuE >>#e4 PT^` aD !EdkkFXFXY`bkFlmqmrFsEtuvv~~,.H .. X %#$ 88I   KKGRVWZR[RdRdfjktfu v3g4 4 4 >>#fm6LMTXbd e l lD L\Z]L^^b++gy9:< ==rc ,V^8dQhRRRRRRRRRR/#) r r)rrrQrPrrwrr)rs"rrrs/C#^rc \4PPRRR7\4P\P !RVR,RVRV/\ V4C4RR7V#)T)parentsexist_okrr|dirrPr^r )rparentmkdir write_textr"dumpsr3)r)rrPrs&&&&rrrsi I4$7 IYYiY`%='6s';%=>HOQ Krc$V^8dQhRRRRRR/#)r r)rrPrQrr7r)rs"rrr$s!  c C D rc x\W4p\P!V4pRV R\P!VR,4 R\P!VR,4 RV RV RV R2 p\P!VR R V.\ V4^R 7p\ 4PR R 7VP^8H#)a8Kill the launcher's session (Xvnc, dbus, Xfce, anything the desktop spawned) and, as a backstop, every process still holding this profile's rfb.sock or Xauthority path (a launcher that lost its pid file left an Xvnc that 'Server is already active for display 20' on the next start). True when something was live.z live=0 p=$(cat z/launcher.pid 2>/dev/null) if [ -n "$p" ] && kill -0 "$p" 2>/dev/null; then live=1; kill -TERM -- -"$p" 2>/dev/null || kill -TERM "$p" 2>/dev/null; fi for pid in $(pgrep -f -- rSz| 2>/dev/null); do [ "$pid" != "$$" ] && { live=1; kill -TERM "$pid" 2>/dev/null; }; done sleep 0.5 for pid in $(pgrep -f -- zR 2>/dev/null); do [ "$pid" != "$$" ] && kill -KILL "$pid" 2>/dev/null; done rm -f z/env z/launcher.pid z/rfb.sock [ "$live" = 1 ] rarbr\T) missing_ok) rWrrr rcrdrunlinkrF)r)rPrqrrLs&& rrr$s s $D DA  ++dSj123++dSj123cqcs# F >>#f5IcNTV WD I% ??a rc$V^8dQhRRRRRR/#)r r)rrPrQrzsubprocess.Popenr)rs"rrr9s'hhhsh/?hrcr\W4p\P!VRR\V R2.\ V4R7#)zCPopen whose stdin/stdout carry the RFB bytes of the sandbox's Xvnc.r}rbr)r])rWr open_stream_RELAYrd)r)rPrs&& ropen_rfb_streamr9s8 s $D   sYfi>P$QXabeXf ggrc(V^8dQhRRRRRRRR/#) r r)rrPrQrvrwrztuple[str, list[str]]r)rs"rrr?s)C#.Mbrc\P!V.ROV\V4RR7pVf"\\ V4P R24hV^,VR,3#)z``(command, args)`` for ``StdioServerParameters``: the backend's exec prefix running ``cua-driver mcp`` on the sandbox display.T)rr] interactivez cannot host cua-driver:NN)z cua-drivermcpz --no-overlay)r remote_commandrdrr/r0)r)rPrvargvs&&& rcua_mcp_invocationr?s\  ! !#'LXa'0~4 ID |d3i0011HIJJ 7DH r) Xvncxfwm4z xfce4-panel xfdesktop xfsettingsdzdbus-run-sessionxauthxdpyinfoxprop)2__conditional_annotations____doc__ __future__rrr"loggingrrCrApathlibrtypingrrrhermes_constantsrtools.environmentsr getLoggerr0rrgrrrrrr'r3r4__annotations__rNrWrirlrrrtrrrdrrrrrrrr)rs@rrs #   &&,&   8 $  z : ".>/1 +0,W  RF  &L 6;=$;=(,;=QU;=| *h r