+ iHj?B Rt^RIt^RIt^RIt^RIt^RIt^RIt^RIt^RIt^RI H t ^RI H t H t Ht^RIHt^RIHtHt^RIHtHt]P0!R4tRR 0tR R 0tR R RRRRRRRR/tRRltRRltRRlt!RR4t R#)zImage-part handling for ``AIAgent`` API messages. Vision capability probes, non-vision text fallbacks (cached ``vision_analyze`` descriptions), tool-result image stripping, and provider quirks (Anthropic dot preservation, Qwen portal message shaping). N)Path)AnyListOptional)forward_static)_is_multimodal_tool_result_multimodal_text_summary)base_url_host_matchesbase_url_hostname run_agent image_url input_imagetext input_textz image/pngz.pngz image/gifz.gifz image/webpz.webp image/jpeg.jpgz image/jpgc0V^8dQhR\R\/#)partreturnrbool)formats">/home/ubuntu/.hermes/hermes-agent/agent/vision_message_prep.py __annotate__rsLLLLcb\V\4;'dVPR4\9#)type) isinstancedictget_IMAGE_PART_TYPES)rs&r_is_image_partr"s& dD ! K Kdhhv&6:K&KKrcRV^8dQhR\R\R\\,/#)rcontent any_dict_textr)listrstr)rs"rrr#s%    $s) rc|.pVFp\V\4'dVP4pMn\V\4'dWV'gVP R4\ 9d5\VP RR4;'gR4P4pMKV'gKVP V4K V#)zStripped, non-empty text from string parts and text-typed dict parts (or any dict's ``text`` when ``any_dict_text``), in order.rr)rr'striprr _TEXT_PART_TYPESappend)r$r%textsrrs&$ r_salvage_text_partsr.#sE dC ::  $ * *113 rcZa]tRt^BVisionMessagePrepMixin._content_has_image_parts..As0ZRY$1E1ERYsTF)rr&any)r$s&r_content_has_image_parts/VisionMessagePrepMixin._content_has_image_parts?s<'4(ZZSS0ZRY0ZSSZSZS0ZRY0Z-ZZrcL<V^8dQhRS[RS[S[S[S[,3,/#)rr r)r'r1rr)rr;s"rrr<Gs*((C(E#xPT~BU#>w#GHRRT 5599)D M!; FJJ4QWX  8  IOO, #..w7 '+ *.*O*OP]*^ 'M  >!++&9M&opK0:;0L0LTZZ ,RTF!::j177R>>@K 3 3 5 5 '')zl"PQ\QxQx`xPyyz{  WXeWffgh hD:>,,Y7  83A37K 8  3 3 5 5 '')!6|sgA(F11F1!G1 G <GGG  G GGH#?HH# HH#HH#c <V^8dQhRS[/#rrr)rr;s"rrr<s   rc ^RIHp^RIHp\ VRR4;'gRP 4p\ VRR4;'gRP 4pV!W4V!44RJ# \ dR#i;i)zTrue if the active provider+model reports native vision (config override > models.dev; see ``image_routing._supports_vision_override``).) load_config)_lookup_supports_visionr3r)r4TF)hermes_cli.configragent.image_routingrr5r*r\)r~rrr3r4s& r_model_supports_vision-VisionMessagePrepMixin._model_supports_visionsq  5 Cj"5;;BBDHT7B/552<<>E*8KMJdR R  sA($A( A(( A76A7c <V^8dQhRS[/#rr)rr;s"rrr<s   rc ^RIHpT!\VRR4;'gRP4\VRR4;'gRP44'*# \dR#i;i)zTrue if the active provider accepts list-type tool content (some, e.g. Xiaomi MiMo, take multimodal user messages but 400 on list-type tool content; profile ``supports_vision_tool_messages``).))routed_model_rejects_vision_tool_messagesr3r)r4T) providersrr5r*r\)r~rs& r'_provider_supports_vision_tool_messages>VisionMessagePrepMixin._provider_supports_vision_tool_messagessm  K@z2.44";;=w+11r88:    sA#AA A+*A+c,<V^8dQhRS[RS[RS[/#)rr$rir)rr')rr;s"rrr<s'ooSooorcRVPV4'gV#.p\\V4F|pVPR/4p\ V\ 4'dVPRR4M\ T;'gR4pTPV'dVPWb4MR4K~ RPRV44P4pRP\VRR74P4pV'dV'dV RV 2#T;'g T;'gR #) r urlr)z:[An image was attached but no image source was available.] c38"TFq'gK VxK R#5ir?)r@rs& rrAGVisionMessagePrepMixin._preprocess_anthropic_content..sBkdTTTks   Tr%zI[A multimodal message was converted to text for Anthropic compatibility.]) rDfilterr"r rrr'r,rjoinr*r.) r~r$ri image_notesr image_datar rLrMs &&& r_preprocess_anthropic_content4VisionMessagePrepMixin._preprocess_anthropic_contents,,W55N!# >73D+r2J5? D5Q5Q ub1WZ[e[k[kikWlI   PY;;ILQ 4BkBBHHJ.wdKLRRT fXT&* *nnnn#nnrNc.<V^8dQhRS[R,/#)rapi_modeNrj)rr;s"rrr<s  sTz rc T;'g VPp\VRR4pVf /;q0nVPV4f^RIHpV!V4W2&W2,#)z]Return the cached transport for the given (or current) api_mode (lazy; None if unregistered)._transport_cacheN) get_transport)rr5rr agent.transportsr)r~rmodecachers&& r_get_transport%VisionMessagePrepMixin._get_transportsW((4==0$7 =,. .E) 99T? " 6'-EK{rc&<V^8dQhRS[RS[/#r api_messagesrr&)rr;s"rrr<s4Drc  a\;QJdV3RlV4F 'gK RM RM!V3RlV44'dSP4'dV#\P!V4pVFbp\ V\ 4'gKSP VPR4\VPRR4;'gR44VR&Kd V#)zReplace native image parts with cached vision_analyze text when the active model lacks vision; vision-capable models pass through unchanged (the provider adapter handles image parts natively).c3<"TF=p\V\4;'d!SPVPR44xK? R#5i)r$N)rrrDr )r@msgr~s& rrAPVisionMessagePrepMixin._prepare_messages_for_non_vision_model..s< co\_JsD ! W Wd&C&CCGGIDV&W Wcos A)ATFr$rirn) rCrcopydeepcopyrrrr r')r~r transformedrsf& r&_prepare_messages_for_non_vision_model=VisionMessagePrepMixin._prepare_messages_for_non_vision_modelss co sss co    ( ( * * mmL1 C#t$$!%!C!CGGI&CGGFF,C,M,Mv(N"I rc,<V^8dQhRS[RS[RS[/#)r tool_namerr)r'r)rr;s"rrr<s#//s/C/TW/rc  \V4'gV#VPR4;'g.pVPV4'gV#VP4'dVP 4'g.\ P RV\VRR44\V4#\V4pT\VRR4;'gR 9d1\ P RW^,V^,4\V4#V#\V4pVR8Xd\P!R R R V/4#\ PR WPVP4V#)zTool message content that is safe for the active model. Text-only providers must not receive image parts: a rejected tool result becomes canonical history and can break the next user turn.r$uTTool %s: provider %s does not accept list-type tool content — sending text summaryr3r)_no_list_tool_content_modelsNuaTool %s: model %s/%s known to reject list-type tool content this session — sending text summary computer_useerrorzcomputer_use returned screenshot/image content, but the active model/provider does not support image input. Switch to a vision-capable model for desktop computer use, or use browser tools for browser tasks. text_summaryzWTool %s returned image content for non-vision model %s/%s; falling back to text summaryr)rr rDrrrRdebugr5rr7r{dumpsrSr3r4)r~rrr$keysummarys&&& r%_tool_result_content_for_active_model zaivertexxiaomialibababedrockr minimax-cn opencode-go opencode-zen)r5r6r r rT)r~basehosts& r_anthropic_preserve_dots/VisionMessagePrepMixin._anthropic_preserve_dots(s  D*b ) / /R 6 6 8=  j"-33::< & 4  3 3$T>: 3 3D  3 3&dM:NNw$ 3 3%T=9 3 3 %T+;< 3 3%T+FG 3 312 rc <V^8dQhRS[/#rr)rr;s"rrr<GsMMMrc .\VPR4#)z2Return True when the base URL targets Qwen Portal.zportal.qwen.ai)r _base_url_lower)r~s&r_is_qwen_portal&VisionMessagePrepMixin._is_qwen_portalGs$T%9%9;KLLrc&<V^8dQhRS[RS[/#rr)rr;s"rrr<Ksrc T\P!V4pVPV4V#)zUDeep-copy ``api_messages`` and shape them for Qwen Portal (see the in-place variant).)rr#_qwen_prepare_chat_messages_inplace)r~rprepareds&& r_qwen_prepare_chat_messages2VisionMessagePrepMixin._qwen_prepare_chat_messagesKs#==. 00:rc$<V^8dQhRS[RR/#)rmessagesrNr)rr;s"rrr<QsDTrc  VFp\V\4'gKVPR4p\V\4'd RRRV/.VR&KN\V\4'gKfVUu.uF?p\V\\34'gK!\V\4'dRRRV/MTNKA ppV'gKWRR&K VFp\V\4'gKVPR4R8XgK3VPR4p\V\4'd4V'd,\VR ,\4'dRR/VR ,R&R# R#uupi) uQwen Portal shaping, in place: every content becomes a list of parts (bare strings → text dicts, dicts kept), then ``cache_control`` is injected on the last part of the system message.r$rrrisystem ephemeral cache_controlN)rrr r'r&)r~rrr$rnormalized_partss&& rr:VisionMessagePrepMixin._qwen_prepare_chat_messages_inplaceQs)Cc4((ggi(G'3''#)667"C!DIGT**!($ ':dS$K+HVjs6K6KVVVT2QUU '!$$#%5 NC#t$$H)D''),gt,,ZPR UY=Z=Z4:K3HGBK0 $s -E"E)rri@r?)__name__ __module__ __qualname____firstlineno____doc__ staticmethodrDrQrfrrrrrr#_prepare_anthropic_messages_for_apir_forward_static#_try_shrink_image_parts_in_messagesrrrrr__static_attributes____classdictcell__)r;s@rr9r9<s\[["2((*''R    oo&  "+Q'//b+::Z]A+B'$<@$$L  >MM rr9)!rloggingryrZrrsr{r]rWpathlibrtypingrrragent.lazy_forwardrragent.tool_dispatch_helpersrrutilsr r getLoggerrRr!r+rVr"r.r7r9rrrrs   &&@\:   ; ' -0L)flG\SY[fhn L  kkr