߲j*UdZddlmZddlZddlZddlmZddlmZm Z m Z m Z eje ZdZd\ZZdZed d Zd ed <iZd ed<daiZded<dZddZddZddZddZddZej<d dZd!dZ d"dZ!d#dZ"y)$a<Per-image token cost learned from the provider's own usage, never from a vendor formula. A flat per-image constant is wrong in both directions: a 1920x1080 screenshot costs ~1,100 tokens on one provider and 4,000+ on a local mmproj model. The provider prices every image exactly on the request that carries it, so the cost is observable: with a fresh usage anchor (real prompt count of the previous response), the residual between the next real ``prompt_tokens`` and ``anchor + text-only delta`` is the price of the N images that delta introduced (#70328). The learned value is kept per ``model@host`` in ``~/.hermes/cache/image_token_costs.json`` so a new session starts calibrated, and bound per turn through a ContextVar so every estimator (preflight trigger, tail-budget walk, gateway hygiene) prices images the same way. ) annotationsN) ContextVar)AnyDictListOptionali)@ig?hermes_image_token_cost)defaultzContextVar[Optional[int]]_image_cost_varDict[str, int]_LEARNEDFzDict[str, Dict[str, int]]_LEARNED_BY_HOMEcddlm}|dS)Nr _cache_filezimage_token_costs.json)agent.model_metadatarrs ;/home/ubuntu/.hermes/hermes-agent/agent/image_token_cost.py _cache_pathr$s0 / 00c@ddlm}|xsdd||xsdxsdS)Nr)base_url_hostname@)utilsr)modelbase_urlrs r_keyr*s*'kr]!-hn"=CD EErcddlm}|tjDcic].\}}t |t rt |cxkr tkrnn||0c}}Scc}}w)Nr)_load_json_dict)rr ritems isinstanceint_MIN_PLAUSIBLE_MAX_PLAUSIBLE)r kvs r _read_cacher(0sV4,[];AAC MTQ!S!n&K^&K qD MM Ms3Acddlm}m}|+tsdatj t tS|}tj|}|t x}t|<|S)zFThe active profile's learned table, loaded lazily from its cache file.r)get_hermes_home_overridehermes_home_keyT) hermes_constantsr*r+_LOADEDrupdater(rget)r*r+home_keytables r_tabler27s`K!)G OOKM * H   *E }-8]: * LrcRtjt||tS)zALearned per-image cost for ``model@host``, else the flat default.)r2r/rDEFAULT_IMAGE_TOKEN_COST)rrs rlearned_image_token_costr5Hs 8<<UH-/G HHrc>tj}||StS)z]Per-image cost bound for the running turn (see :func:`image_cost_context`), else the default.)r r/r4)bounds rcurrent_image_token_costr8Ms!    !E%5C+CCrc#Ktj|} dtj|y#tj|wxYww)N)r setreset)costtokens rimage_cost_contextr>Ss:    %E% e$e$sA 3A A  A c ntjtt|ddt|ddy)zXBind the agent's learned per-image cost to the current context for the rest of the turn.rNr)r r:r5getattr)agents rbind_image_token_costrB\s.01NPWX]_ikoPpqrrc8ddlmtfd|DS)Nr)_count_image_tokensc3RK|]}t|ts|d yw)N)r"dict).0mrDs r zcount_images..ds"RQjD>Q"1a(Rs'')rrDsum)messagesrDs @r count_imagesrMas8 R(R RRrcddlm}t|dd} t|xsd}|dks t |trt |tsyt|jdxsd}||d}|r/t |dtr|djddk(r|dd}t|}|dkrytd5|||} ddd y|| z |z} t| cxkr tksyytt|d dt|d d} t} | j| } | | nt| t | | z zz}|| | <t"j%| dd lm}|t+t| dd t.j3d|| d|d| |S#tt f$rYywxYw#1swYxYw#t,$rt.j1ddYbwxYw)aLearn the per-image cost from the response that just priced ``messages``. Requires the PREVIOUS anchor (real count of the prior request) to still match: the residual ``prompt_tokens - (anchor + text-only delta)`` is then the provider's price for the images the delta introduced. Returns the new learned cost, or None when this response teaches nothing (no anchor, no new images, implausible residual).r)anchored_context_tokens _usage_anchorN base_countrole assistantrFrr)atomic_json_write),:)indent separatorszimage token cost persist failedT)exc_infozdImage token cost calibrated from provider usage: %s images priced %s tokens each (learned %s for %s)rU)agent.usage_anchorrOr@r# TypeError ValueErrorr"rGlistr/rMr>r$r%rr2 _EMA_ALPHAr r:rrTr Exceptionloggerdebuginfo)rArL prompt_tokensrOanchorrealrQdeltan_images text_only per_imagekeyr1priorlearnedrTs rcalibrate_from_usagermgs; UOT 2F=%A& qy 640 8T8RVZZ -23J Z[ !E E!Hd+a V0D 0Sab E"H1} A >+Hf= > !h.I Y 8. 8 9 wugt,geZ.N OC HE IIcNE =ic%* TYHY:Z2Z.[GE#J G++-eQ:V KKnYqMwqkC NE z ">>" G 6 FGs/F#: F8!#G#F54F58G G'&G')rrrrreturnstr)rnr )rrrrrnr#)rnr#)r< Optional[int])rArrnNone)rLList[Dict[str, Any]]rnr#)rArrLrrrcrrnrp)#__doc__ __future__r contextliblogging contextvarsrtypingrrrr getLogger__name__r`r4r$r%r^r __annotations__rr-rrrr(r2r5r8contextmanagerr>rBrMrmrrr~s #",,   8 $!+  -78Q[_-`*`. /1+01 F M"I D  %%s S .r