߲j@:dZddlmZddlZddlZddlmZddlmZddl m Z m Z ddl m Z ejdZd d d d d d ddZehdZddZdZd dZd!dZd"dZd#dZd$dZddZ d%dZdZdZeef d&dZd'dZ d( d)dZ y)*aCImage format detection, normalization and region cropping for vision tools. Everything here runs BEFORE an image is base64-embedded: a vision tool result is baked into immutable history and re-sent every turn, so an unsupported media type or corrupt bytes would wedge the session with a non-retryable 400 on every resume. ) annotationsN)BytesIO)Path)AnyOptional)get_hermes_dirztools.vision_tools image/jpeg image/png image/gif image/bmp image/webp image/svg+xml)z.jpgz.jpeg.pngz.gifz.bmpz.webp.svg>r r r r c|jddj}|jdsy|tddj dddj xsd}|dk(rd nd |}|t vrdS|S) z``image/`` of a ``data:image/...`` URL the inline-image wire paths reject (``image/jpg`` counts as JPEG); None for accepted rasters and for non-data URLs (the provider owns remote-URL validation).,rz data:image/N;unknownjpgr zimage/) partitionlower startswithlensplitstrip _ANTHROPIC_SUPPORTED_MEDIA_TYPES)urlheadersubtype media_types B/home/ubuntu/.hermes/hermes-agent/tools/vision_tools_image_prep.py#unsupported_inline_image_media_typer##s]]3  " ( ( *F   ] +S'()//Q7:@@BOiG!(E!1y7IJ!AA4QzQ))sr ))sGIF87asGIF89ar )sBMr c^tj|jjdS)z7MIME type from file extension (defaults to image/jpeg).r )_EXTENSION_MIME_TYPESgetsuffixr) image_paths r"_determine_mime_typer*4s$ $ $Z%6%6%<%<%> MMr$c|dd}|jdr< ddlm} |j t |5}|j dddytD]\}}|j|s|cSt|dk\r|ddd k(r |d dd k(ry t|dk\rz|dd d k(rr|d d}tj|ddd}|dkrdnt|t|}|htd|dz dD chc] } || | dz c} z} | hdzry| hdzryy#t$rYywxYw#1swYyxYw#t$rYywxYwcc} w)uMagic-byte MIME sniff (authoritative; no extension trust). ``None`` for anything without a recognized header — including SVG, which has none (the resolver sniffs ``av01avifavis image/avif>heicheimheisheixhevchevxmif1msf1 image/heic)rPILr. ImportErroropenrverify Exception_MAGIC_MIME_TYPESrint from_bytesminrange) datarr.imagemagicmimemajorbox_sizelimitibrandss r""_detect_image_mime_type_from_bytesrU9s#2YF -.  ! GDM* e  ) t   U #K 6{bVBQZ72va|w7N 6{bVAa[G3q  >>&!*e4mXs6{)CU2uqy!5LMF1QUOMM / /    K     *NsEDD9D- D99E D*)D*-D62D96D99 EEc ddlm}ddlm}m}|t |dxsdt |dxsdr|S tS#t $rYtSwxYw)uFormats the ACTIVE main model's server can decode. The managed llama-server decodes with stb_image — no WebP — and an undecodable image part fails SILENTLY (the model confabulates), so the set is narrowed there and normalization converts those formats to PNG.r)_runtime_main_value)ACCEPTED_IMAGE_MIMESis_managed_providerproviderbase_url)agent.auxiliary_clientrW%hermes_cli.local_runtime.capabilitiesrXrYstrrFr)_vrXrYs r"_supported_media_typesrajsb Dc s2j>#7R8#bn>RPR:S T' ' U ,+   ++ s>A AAc`|jxr|jjdkDS)Nr)existsstatst_size)paths r"_nonempty_filergxs$ ;;= 4TYY[00144r$cN ddl}|jt|t|t|S#t$rYnwxYw ddlm}ddlm}|t|}|(|j|t|dt|Sn#t$rYnwxYwddl }ddl }dd t|t|gd t|d d |gfD]T}|j|ds |j|d d d|jt|ry G#t$rYRwxYwy)u_Best-effort SVG → PNG via cairosvg, svglib+reportlab, rsvg-convert, inkscape (all soft deps).rN)rwrite_to)svg2rlg)renderPMPNG)fmtz rsvg-convertz-oinkscapez--export-type=pngz--export-filename=T)checkcapture_outputtimeoutstdinF)cairosvgsvg2pngr_rgrF svglib.svglibrjreportlab.graphicsrk drawToFileshutil subprocesswhichrunDEVNULL) svg_pathout_pathrtrjrkdrawingryrzcmds r"_rasterize_svg_to_pngr|s> S]S]Ch''     )/#h-(     XE  B!(+ +      s8}c(m< S]$7;MhZ9XY[  <<A  s$tRWaWiWij!(+,    s436 AAAB BB(+D D"!D"c ddl}ddlm}ddlm}|j d\}}} d|j vr|j|n||j}tdd}|jd d |d tjz } | jd | jd } } | j|t!| | s0 | | fD]'} |t"5| j%ddd)yd|j'| j)j+dz| | fD]'} |t"5| j%ddd)S#t$rYywxYw#1swYxYw#1swYOxYw#| | fD]3} |t"5| j%ddd)#1swY2xYwwxYw)uZ``data:image/svg+xml[;base64],...`` → ``data:image/png;base64,...`` through the same soft-dependency rasterizers vision_analyze uses; None when the payload does not decode or no rasterizer is available. Request-path callers decide the fallback (Responses backends 400 on SVG source, so the caller must never forward the SVG itself).rN)suppress)unquoterz;base64 cache/visiontemp_vision_imagesTparentsexist_okinline_rrzdata:image/png;base64,ascii)base64 contextlibr urllib.parserrr b64decodeencoderFrmkdiruuiduuid4 with_suffix write_bytesrOSErrorunlink b64encode read_bytesdecode) rrrrr_payloadrawout_dirstemr~png_pathrfs r"rasterize_svg_data_urlrs #$s+FAw+4 +Ffw'GT[L\LcLcLe^-ABG MM$M. wtzz|n- -D))&143C3CF3KhHS!$Xx8x( D'"     (&*:*:8;N;N;P*Q*X*XY`*aax( D'"          x( D'"      sS9E(<F-E7 0F F( E43E47F F G #F= 4 G =G  G c|tvr||dfStdd}|jdd|dtjdz }|dk(rt ||r|d dfSy |d vr d dl}|j d dl m }|j|5}|jdvr|jd}|j!|ddddt#|r|d dfS ddd|dfS#t$rtjd |YwxYw#1swYHxYw#t$r5}tj%d|||dk(rYd}~y|dk(rYd}~yYd}~sd}~wwxYw)u^Ensure an image is in a provider-supported format. Returns ``(path, mime, error)``: the input unchanged when supported; ``(new_png_path, "image/png", None)`` after conversion — a temp file the CALLER must clean up; ``(None, None, message)`` when impossible. SVG is rasterized; other Pillow-readable rasters (BMP, TIFF) re-encode to PNG.NrrTr converted_rrr )NNu8This is an SVG, which vision models cannot read directly, and no SVG rasterizer is installed (tried cairosvg, svglib, rsvg-convert, inkscape). Convert the SVG to PNG first — e.g. open it in a browser and screenshot it, or install a rasterizer (`pip install cairosvg`) — then re-run vision_analyze on the PNG.)rAr8rz1pillow-heif unavailable; relying on Pillow for %sr-)RGBRGBALrrlformatz'Failed to normalize %s image to PNG: %srA)NNzThis is a HEIC/HEIF image (common for iPhone photos), which vision models cannot read directly, and no HEIF decoder is available. Install one (`pip install pillow-heif`) and re-run vision_analyze, or convert the image to PNG/JPEG first.r8)NNuThis is an AVIF image, which vision models cannot read directly, and no AV1 decoder is available. Upgrade Pillow (>= 11.3 bundles AVIF support) or install a pillow-heif build with an AV1 codec, then re-run vision_analyze — or convert the image to PNG/JPEG first.z Image format z is not supported by the vision API and could not be converted to PNG (install Pillow for raster conversion). Convert it to PNG or JPEG and try again.)rarrrrr pillow_heifregister_heif_openerrFloggerdebugrBr.rDmodeconvertsavergwarning)r) detected_mimerrr _PILImage_img_excs r"_normalize_to_supported_imagers .00=$..^-ABG MM$M.:djjl^488H' X 6[$. .S44 ]   , , .,* ^^J ' .4yy 44||F+ IIhuI - . ( #[$. . $$   ()@ A BB5 ] LLLm \ ] . . ,@-QUV L (K L (, ),sH(C)=D3DD)D  D DD E#EEEdic 8 ddlm}m} |j |5}|j ddd|j |5}d}t |j|dD]h\}}||kDrd|d|dccdddS||j|jzz} | |kDrd | d |d |d ccdddS|j| }j dddy#t$rYywxYw#1swYxYw#1swYyxYw#t$r} d | cYd} ~ Sd} ~ wwxYw)aReturn an error unless Pillow can fully decode every frame. Header sniffing and ``Image.open`` only inspect containers: a timed-out download can look like a valid PNG with a truncated pixel stream. Without Pillow the image passes unvalidated rather than rejecting everything.r)r. ImageSequenceNr)startz+Image validation rejected animation: frame z exceeds the maximum z validated frames.zOImage validation rejected animation: aggregate decoded pixel count would reach z at frame z, exceeding the maximum .z"Image could not be fully decoded: ) rBr.rrCrDrE enumerateIteratorwidthheightloadrF) r) max_frames max_pixelsr_PILImageSequencerMvalidated_pixels frame_numberframenext_validated_pixelsexcs r" _validate_raster_image_decodablersWN: ^^J ' 5 LLN  ^^J ' 95 '01B1K1KE1RZ['\ 9# e*,!!-.C%,&8:;  9 9)95;;;U(U%(:533H2I'.(@%,a)* 9 9 #8  9 9& 1    9&  :3C599:szCDC)D4C5: D.C52 D<C5D C&%C&)C2.D5C>:D>D D DDDc ddlm}|j|5}t|j|kDcdddS#1swYyxYw#t $rYywxYw)uTrue if the longest side exceeds ``max_dimension`` px (Anthropic's 8000px per-side cap is independent of bytes). False without Pillow or on unreadable files — a missing soft dependency must never break the embed path.rr-NF)rBr.rDmaxsizerF)r) max_dimensionrrs r"_image_exceeds_dimensionr sN* ^^J ' 24tyy>M1 2 2 2 s+A; AAAA AAcX ddlm}t|tt fr t |dk(rtd|Dsy |j|5}|j\}}d|D\}}} } dt||| | f||fd zD\} } } }| | ks|| kr'd d d |d |d | d | d |d|d|d |dfcd d d S|j| | | |f}||j| | | | z || z |j|jdtj j"d dd}|j$dvr|j'd}|j)|d|dd fcd d d S#t$rYywxYw#1swYy xYw#t*$r}d d d|fcYd }~Sd }~wwxYw)uCrop to ``region`` = [x1, y1, x2, y2] (original-image pixels), BEFORE downscaling so the crop gets the full resolution budget. Coordinates clamp to the image bounds; a zero-area/inverted region is rejected with an error naming the real dimensions. Returns ``(cropped_temp_path, mime, None)`` — caller owns cleanup — or ``(None, None, error)``. Ported from QwenLM/qwen-code zoom-image.ts (Apache-2.0).rr-)NNz[region cropping requires Pillow (`pip install Pillow`); retry without the region parameter.r0c3nK|]-}t|ttfxrt|t /ywN) isinstancerHfloatbool.0vs r" z%_crop_image_region..;s.\PQJq3,/K 1d8K4KK\s35)NNzdInvalid region: expected [x1, y1, x2, y2] as four numbers (pixel coordinates in the original image).c32K|]}t|ywr)rHrs r"rz%_crop_image_region..Bs5c!f5sc3NK|]\}}tdt||yw)rN)rrJ)rrbs r"rz%_crop_image_region..Cs!!k1#aQ"3!ks#%NzInvalid region [z, zG]: crops to zero area after clamping to the image bounds. The image is xu+ px — pick x1E?F F F F)F$F)$F))rr_return Optional[str])r)rrr_)rLbytesrr)r frozenset)rfrrr)r~rrrrr)r)rrr_r3tuple[Optional[Path], Optional[str], Optional[str]])r)rrrHrrHrr)r)rrrHrrr)r)rrrrzOptional[dict]rr)!__doc__ __future__rloggingriorpathlibrtypingrrhermes_constantsr getLoggerrr&rrr#rGr*rUrargrrr!_VISION_MAX_VALIDATED_FRAME_COUNT&_VISION_MAX_VALIDATED_AGGREGATE_PIXELSrrrr$r"rs%#  +   / 0       $--c#d  R N .b ,5@8;B;B%(;B-`;B@%(!)4& 8<!!!!BO!H AE';';!';/=';8';r$