߲jz5UdZddlmZddlZddlZddlZddlZddlmZddl m Z m Z m Z m Z mZddlmZddlmZej&eZdZd ed <d Zd Zd ed <dZGddeZdddd(dZdddd)dZdddddZddddddd d*dZdd ddd! d+d"Z d#d d d d d$ d,d%Z!Gd&d'eZ"ddl#Z#ddl$Z$ddl%Z%y)-uVideo Generation Provider ABC. Providers register via ``PluginContext.register_video_gen_provider()`` and live in ``/plugins/video_gen//`` (built-in) or ``~/.hermes/plugins/video_gen//``; mirrors ``agent/image_gen_provider.py``. One tool covers text-to-video and image-to-video: ``image_url`` present routes to the provider's image-to-video endpoint. Video edit/extend are deliberately NOT exposed — backends are too inconsistent for one unified tool. Response shape (:func:`success_response` / :func:`error_response`): ``success``, ``video`` (URL or absolute path), ``model``, ``prompt``, ``modality`` ("text" | "image"), ``aspect_ratio``, ``duration`` (seconds, 0 if n/a), ``provider``; plus ``error`` / ``error_type`` only when ``success`` is False. ) annotationsN)Path)AnyDictListOptionalTuple)provider_media)CatalogProviderBase)16:9z9:16z1:1z4:3z3:4z3:2z2:3z21:9zTuple[str, ...]COMMON_ASPECT_RATIOSr )480p540p720p768p1080pCOMMON_RESOLUTIONSrc eZdZdZddZej ddddeedddd ddZ y)VideoGenProviderzAbstract base class for a video generation backend: implement :attr:`name` and :meth:`generate`. ``list_models`` entries are **model families** and may add ``speed`` / ``strengths`` / ``price`` / advisory ``modalities``.c Rdgttttdddddddd S)zSupported features (keys below, all optional) used for soft validation, capability-gated params in the dynamic ``video_generate`` schema, and the picker. Default fails closed: text-only, no optional features.text Fr) modalities aspect_ratios resolutions max_duration min_durationsupports_audiosupports_negative_prompt supports_seedsupports_upscalemax_reference_images)listr rselfs =/home/ubuntu/.hermes/hermes-agent/agent/video_gen_provider.py capabilitieszVideoGenProvider.capabilities/s6 "(T:N5O 23RYZ#Y^ %q   N model image_urlreference_image_urlsduration aspect_ratio resolutionnegative_promptaudioseedc y)aDGenerate a video from a prompt, or animate ``image_url`` when given; return :func:`success_response` / :func:`error_response`. Unknown ``kwargs`` MUST be ignored. Known optional kwarg ``upscale`` (bool): a post-generation high-res pass; providers that honor it report ``upscaled: True`` in ``extra``.N) r&promptr+r,r-r.r/r0r1r2r3kwargss r'generatezVideoGenProvider.generate:sr))returnDict[str, Any]r6strr+ Optional[str]r,r=r-zOptional[List[str]]r. Optional[int]r/r<r0r<r1r=r2zOptional[bool]r3r>r7rr9r:) __name__ __module__ __qualname____doc__r(abcabstractmethodDEFAULT_ASPECT_RATIODEFAULT_RESOLUTIONr8r5r)r'rr*sL   59VZ48TX0DV)-t" Q Q%2 QFS Q1 QDQ Q Q?B Q' Q7E Q  Q /2 Q  Q Qr)rvideomp4prefix extensionc4tjd|||S)zNDecode base64 video data into ``$HERMES_HOME/cache/videos/``; return the path.videosrI)r save_b64)b64_datarJrKs r'save_b64_videorPHs  " "8XfPY ZZr)c4tjd|||S)z@Write raw video bytes (e.g. an HTTP download body) to the cache.rMrI)r save_bytes)rawrJrKs r'save_bytes_videorTMs  $ $Xs6Y WWr)webmmovmkv)z video/mp4z video/webmzvideo/quicktimezvideo/x-matroskagf@i F)rJtimeout max_bytesheadersrequire_video_content_typetrusted_origincPtjd||||dtdddd|||S)a2Download an (often ephemeral) video URL into ``$HERMES_HOME/cache/videos/``; raises on network / HTTP / oversize / empty errors so callers can fall back to the URL. ``trusted_origin`` is only for URLs built from the operator's configured provider ``base_url`` (see ``provider_media.save_url``).rMi)rHrUrVrWrHVideoz#Video at {url} was empty (0 bytes).) rJrXrY chunk_size content_typesurl_extensionsdefault_extensionlabel empty_errorrZrequire_known_content_typer\)r save_url_URL_VIDEO_CONTENT_TYPES)urlrJrXrYrZr[r\s r'save_url_videoriWs<  " "#fg-E4#H4N%  r)r)modalityr/r.extrac d||||||r t|nd|d}|xsijD]\} } |j| | |S)zPUniform success dict; ``extra`` keys are added without overriding standard ones.Tr)successrGr+r6rkr/r.provider)intitems setdefault) rGr+r6rkr/r.rorlpayloadkvs r'success_responservos_ %%6W_$8#h-QR`hG"##%!11a ! Nr)provider_error) error_typeror+r6r/c dd||||||dS)z$Build a uniform error response dict.FN)rnrGerrorrxr+r6r/ror5rzrxror+r6r/s r'error_responser|}s! 4%z\a,H r)c eZdZUdZdZded<dZded<dZded <d Zded <dd Z dd Z ddZ ddZ dddde edddd ddZy) OpenAICompatibleVideoGenProvideruGeneric text/image-to-video over the OpenAI ``client.videos`` API. DeepInfra, OpenAI/Sora, and OpenRouter share the ``POST /videos`` async-job shape (``create`` → poll → ``download_content``); a concrete backend sets ``name``, ``_env_key``, ``_default_base_url`` and ``list_models()`` (entries with an ``id`` key; ``default_model()`` uses ``[0]``). Provider-specific fields (``image_url``/``negative_prompt``/``seed``) ride in ``extra_body``. OPENAI_API_KEYr<_env_keyzhttps://api.openai.com/v1_default_base_urlg@float_poll_interval_sg @_poll_deadline_scrtjj|jdj S)Nrj)osenvirongetrstripr%s r'_api_keyz)OpenAICompatibleVideoGenProvider._api_keys$zz~~dmmR06688r)c4t|jS)N)boolrr%s r' is_availablez-OpenAICompatibleVideoGenProvider.is_availablesDMMO$$r)c |jjd i|}hd}tj|jz}t |dd|vrtj|k\r>t dt |dddt|jdt |ddd tj|j|jj|j}t |dd|vr|S) zCreate the job and poll to a terminal status (any); raise :class:`TimeoutError` when ``_poll_deadline_s`` passes first.>rzfailedcanceled cancelled completed succeededstatusNz video job id?z( did not reach a terminal status within zs (last status=)r5) rMcreatetime monotonicrgetattr TimeoutErrorrpsleeprretriever)r&client call_kwargsrGterminaldeadlines r'_create_and_pollz1OpenAICompatibleVideoGenProvider._create_and_polls% $$3{3Y>>#d&;&;;eXt,H<~~8+" c!: ;<%%()>)>%?$@A$$+E8T$B#EQH JJt,, -MM**5884EeXt,H< r)ctjj|jj ddj xs |j S)N _BASE_URLrj)rrrnameupperrrr%s r' _base_urlz*OpenAICompatibleVideoGenProvider._base_urls>zz~~!2 39=rBHHJddNdNddr)Nr*c rjstddjSjs%tjddjS ddl} |xsjs&td jd d jSd*fd } ||| djDcic] \}}||| }}}d}|rt||d<|r||d<|r||d<ddl m }jjd}||d}|||d<| jd+i|} j||}t%|dd}|dvrFt%|d d}| |r t|nd|d t%|dd}t'|r|SSd}t%|d!dxsgD]8}t)|t*r|j-d"n t%|d"dxsd}|s8n |r!tt/|j#}nS|j0j3|j4j7}tt9|j#}t;||rd'nd(|xsdj)t%|dd}t'|r|SS#t $rtddjcYSwxYwcc}}w#t$rd}t j#djd| jd|dcYd}~t%|dd}t'|r|SSd}~wwxYw#t$rm}|s=| jd$|d%cYd}~t%|dd}t'|r|SSt j#d&j||}Yd}~Rd}~wwxYw#t%|dd}t'|r|wwxYw),Nzprompt is requiredinvalid_request)rzrxroz is not setmissing_credentialsrz8openai Python package not installed (pip install openai)missing_dependencyzno z, video model available (live catalog empty?)no_modelrzc:t||jS)Nr{)r|r)rzrxr/model_idr6r&s r'failz7OpenAICompatibleVideoGenProvider.generate..fails#! TYYh_e) r))r1r/r,r3)r+r6secondssize extra_body)build_keepalive_http_client)api_keybase_urlr http_clientz%s video generation failedT)exc_infoz video generation failed: api_errorcloser)rrzvideo job ended with status= job_faileddatarh)rJz7 video job succeeded but no output could be retrieved: empty_responsez3%s: saving video locally failed (%s); returning URLimager)rGr+r6rkr/r.ro)rzr<rxr<r9r:r5)rr|rrropenai ImportError default_modelrqr<agent.process_bootstraprrOpenAIr Exceptionloggerdebugrcallable isinstancedictrrirMdownload_contentrreadrTrv) r&r6r+r,r-r.r/r0r1r2r3r7rrrtrurrr client_kwargsrrrGexcrr job_errorrhitem video_refrSrs `` ` @r'r8z)OpenAICompatibleVideoGenProvider.generatesV\\^!(rs #  33 3   8 $ )o&OOOQ*Q<18[ 07uX f\a&(,',       & !% 2=CXZ   '* 69 RU  !$ -E  &6rXZ""ADRU $'U'7Ux r)