߲jL->UdZddlmZddlmZddlZddlZddlZddl Z ddl Z ddl Z ddl m Z mZmZddlmZmZmZmZmZej,eZdZdZdZdZd ed <dad ed <Gd deZ ddZ!ddZ"edddZ#ddZ$ddZ%ddZ&GddeZ'ddiZ(dZ)y) uDuckDuckGo search via the optional ``ddgs`` package (search only, no key). ``is_available()`` reflects package importability; the plugin registers either way so ``hermes tools`` can offer to install it. Isolation: ``ddgs``/``primp`` can block inside native code while holding the GIL, so a thread-pool ``future.result(timeout=…)`` cap can never fire and Ctrl+C/SIGTERM freeze the process — each search runs in a disposable child process the parent can terminate/kill. ) annotationsN)AnyDictOptional)BaseWebSearchProvider search_fail search_ok setup_schema title_hitg?g?z Optional[str] _test_hookOptional[subprocess.Popen]_last_worker_procceZdZdZy)_SearchInterruptedzHRaised when tools.interrupt.is_interrupted() trips during a search wait.N)__name__ __module__ __qualname____doc__>/home/ubuntu/.hermes/hermes-agent/plugins/web/ddgs/provider.pyrr"sRrrcddlm}g}|d5}t|j||D]\}}||k\rn|j t t |jddt |jdxs|jd xsdt |jd d|d zd d d |S#1swY|SxYw) uBlocking ddgs query → normalized hits (module-level: the child worker imports it, tests patch it for in-process runs). ``DDGS(timeout=…)`` bounds each individual HTTP request; the overall wall-clock cap is enforced by the parent via process timeout (#68096). r)DDGS timeout) max_resultstitlehrefurlbodyN)ddgsr enumeratetextappendr strget)query safe_limitrresultsclientihits r_run_ddgs_searchr1&s$&G b PV Ez JK PFAsJ NN9S")=%>CGGFODkWZW^W^_dWeDkik@lnqruryry{ACEsFoGIJMNINO P PP N P Ns B-C  Cc ddl}t|ddx}rYtjj tjj tjj |S tjj tjjtgtjgdzS#t $rY^wxYw)z``sys.path`` entry that makes ``import plugins`` work in the child (live package location first; correct for source checkouts and site-packages).rN__file__) pluginsgetattrospathdirnameabspath Exceptionjoinr3pardir) plugins_pkgpkg_files r_plugins_path_entryr@7s %{J= =8 =77??277??277??83L#MN N > 77??277<<ERYYK!OE FF    sA+C C C)gracec:yd}dfd } jjfD]"}j|| }$|r!tj dj yy#t $r }tjd|Yd}~yd}~wwxYw)uTerminate a worker, escalate to kill, and wait so no orphan remains. Does not close the parent's pipe ends — closing stdout while another thread is blocked in ``read()`` deadlocks on some platforms; the caller drains first.NFctjz}jTtj|kr=tjdjtj|kr=jduS)Ng?)time monotonicpollsleep)deadlinerAprocs r_wait_until_deadz-_terminate_and_reap.._wait_until_deadKsg>>#e+iik!dnn&6&A JJt iik!dnn&6&Ayy{$&&rz*DDGS worker pid=%s did not exit after killzDDGS worker reap error: %sreturnbool) terminatekillrFloggerwarningpidr;debug)rIrAaliverJescalateexcs`` r_terminate_and_reaprWCs | E' 83 /Hyy{" ,.. /  NNG R  8 13778s+A13A11 B:BBc x|jdd}t}|r>||jtjvr|r|tjz|zn||d<tj j tj jtj jtd}tjdk(rdtjinddi}tjtj|gftj tj tj"|ddd d |S) zStart ``_search_worker.py`` as a script with ``plugins`` importable. Running as a script puts ``plugins/web/ddgs/`` on ``sys.path[0]``, breaking ``import plugins...``, so the real package location is prepended to PYTHONPATH. PYTHONPATHr z_search_worker.pywin32 creationflagsstart_new_sessionTzutf-8replace)stdinstdoutstderrenvr'encodingerrors)r*r@splitr7pathsepr8r<r9r:r3sysplatform subprocessCREATE_NEW_PROCESS_GROUPPopen executablePIPEDEVNULL)rachild_pythonpath path_entry worker_path extra_kwargss r _spawn_workerrr\sww|R0$&Jj(8(>(>rzz(JJJZJ36FF`jL'',,rwwrwwx/HIK^_K]`]i]imt]tOZ5X5X#Y|OQU{VL    % -7__Z__]g]o]o dWY BN rc|j}|std|jd tj|}t |tstd||jds'tt|jdxsd |jd xsg}t |ts td |S#tj $r}td|dd|d}~wwxYw) zSDecode the worker's stdout envelope; raise ``RuntimeError`` on any malformed shape.z*DDGS worker exited without a result (code=)z#DDGS worker returned invalid JSON: Nz*DDGS worker returned an invalid envelope: okerrorzDDGS worker failedr-z%DDGS worker returned non-list results) strip RuntimeErrorrFjsonloadsJSONDecodeError isinstancedictr*r)list)rawrIenveloperVr-s r_parse_enveloperos ))+C G }TUVWWY::c? h %G|TUU << 3x||G4L8LMNNll9%+G gt $BCC N   Y@Tc NOUXXYsCC8!C33C8czddlm}ddlm}||d}|t t j }trt|d<d|d<t|x}a tjd }|j|jtj|}d \} } } t!j"t$z} | sw|x} sn| t!j"z x} dkDrR |j't)t*|  dxsd d } } | s&|x} s| t!j"z x} dkDrRt/||j1s" | xs|j't2 dxsd } |j7dd | r t9d| st-dt$dt;| |S#tj,$rYwxYw#t4$rYewxYw#t/||j1s2 | xs|j't2 dxsd } n#t4$rYnwxYw|j7dd wxYw)u8Run ``_run_ddgs_search`` in a disposable process with a hard deadline. The parent never joins a child that may be in native code holding *its* GIL — it polls a communicator thread and, on timeout/interrupt, kills the OS process. Raises ``TimeoutError``, ``_SearchInterrupted``, or ``RuntimeError``.r)is_interrupted)_sanitize_subprocess_env)r+r, test_hook1HERMES_DDGS_ALLOW_TEST_HOOKSr$) max_workers)FFr rr TF)waitcancel_futuresDuckDuckGo search interrupted"DuckDuckGo search timed out after s)tools.interruptrtools.environments.localrr~r7environr rrrcfThreadPoolExecutorsubmit communicaterzdumpsrDrE_SEARCH_TIMEOUT_SECSresultmin_POLL_INTERVAL_SECS TimeoutErrorrWdone_TERMINATE_GRACE_SECSr;shutdownrr)r+r,rrrequestrarIpoolfut interruptedrrrH remainings r_run_ddgs_search_boundedrs4 /A(-ZHG "4 #3 4C) .1 *+,S11D   Q /D ++d&& 7(; >#&::~/? ? ?S[^b^l^l^nSnFnirsEs JJs3F /RJSTUV\Z\^bT~/? ? ?S[^b^l^l^nSnFnirsEs D!xxz OSZZ0EZFqIOR 5 6 !@AA ?@T?UUVWXX 3 %%??     D!xxz OSZZ0EZFqIOR   5 6sgAG!)F0 'G!G 0GGGG GGH:5!HH: H# H:"H##H:c2eZdZdZdZdZddZd d dZd dZy) DDGSWebSearchProviderzDuckDuckGo HTML-scrape search provider (no API key; DDG rate-limits server-side). ddgs errors surface as ``{"success": False, "error": ...}`` rather than raising.r%DuckDuckGo (ddgs)c, ddl}y#t$rYywxYw)uTrue when ``ddgs`` is importable. Must NOT do network I/O — runs at tool-registration time and on every ``hermes tools`` paint.rNTF)r% ImportError)selfr%s r is_availablez"DDGSWebSearchProvider.is_availables    s  c  |js tdS t|tdt |}t jd |t||t|S#t $r1t jdt|tdtdcYSt$r$t jd|tdcYSt$r.}t jd|td |cYd }~Sd }~wwxYw) zRun the search in a disposable child with a hard wall-clock timeout so a hung native ``primp`` call cannot freeze the Hermes process. See #36776, #68096. u8ddgs package is not installed — run `pip install ddgs`r$z-DDGS search timed out after %ds for query: %rruhs — DuckDuckGo may be rate-limiting or slow. Try again later or switch to a different search provider.z%DDGS search interrupted for query: %rrzDDGS search error: %szDuckDuckGo search failed: Nz'DDGS search '%s': %d results (limit %d))rrrmaxintrrPrQrrinfor;lenr )rr+limit web_resultsrVs rsearchzDDGSWebSearchProvider.searchs   "YZ Z C25#aU:LMK  =uc+FVX]^%%  NNJL`bg h45I4JKuu " @ KK? G>? ? C NN2C 8!;C5AB B Cs)A((7D!)D D#C=7D=Dc tddddS)Nrufree · no key · search onlyuRSearch via the ddgs Python package — no API key (pair with any extract provider)r%) post_setup)r )rs rget_setup_schemaz&DDGSWebSearchProvider.get_setup_schemas !@ `ms  rNrK))r+r)rrrLDict[str, Any])rLr) rrrrNAME DISPLAY_NAMErrrrrrrrs#X D&L&4 rrWebSearchProvider)zagent.web_search_providerrctj|}|tdtd|ddl}ddlm}|t|g|t|j|d|dS)Nzmodule z has no attribute r) warn_oncer$) _PLUGIN_COMPAT_LAZYr*AttributeErrorr importlibhermes_cli.plugin_compatrr6 import_module)nametargetrrs r __getattr__rse $ $T *F ~wxl2DTHMNN2 h&v& 9**6!95vay AAr)r+r)r,rrLlist[dict[str, Any]])rLr))rIrrAfloatrLNone)razdict[str, str]rLsubprocess.Popen)rr)rIrrLr)*r __future__rconcurrent.futuresfuturesrrzloggingr7rhrfrDtypingrrrplugins.web._commonrrr r r getLoggerrrPrrrr __annotations__rr;rr1r@rWrrrrrrrrrrrs#   &&ff   8 $  M 04-4SS" GMb82&&'&T/ 1/ rK Br