߲jkHdZddlZddlZddlZddlmZmZddlmZddl m Z m Z m Z m Z mZddlmZddlmZej(dZd d d Zd Zd ede efdZdede ee ffdZdedede ee ffdZdede ee ffdZde ededee eeffdZGddZ y)u!MemoryStore — bounded, file-backed curated memory (MEMORY.md / USER.md). Entries are joined by ``ENTRY_DELIMITER``; budgets are in chars (model-independent). Module state that tests monkeypatch (``get_memory_dir``, ``fcntl``/``msvcrt``) stays in ``tools.memory_tool`` and is read lazily.N)contextmanagersuppress)Path)AnyDictListOptionalTuple)atomic_write_text)first_threat_messageztools.memory_toolzMEMORY (your personal notes)zUSER PROFILE (who the user is)memoryuseru § contentreturnct|dS)zError string if *content* matches injection/exfil patterns. Strict scope: memory enters the system prompt, so a poisoned entry persists across sessions.strictscope)_first_threat_message)rs  TYYK(==EJGd e  f hhrc4td|jdS)zNExisting-but-unreadable file: saving from an assumed-empty view would wipe it.r$u=: the file exists on disk but could not be read right now (temporarily locked by another program, a permission change, invalid/corrupt text encoding, or a filesystem error). Treating an unreadable file as empty and saving would wipe existing memory, so the write is refused. Nothing was changed — retry in a moment.r'r!s r_read_failed_errorr,1s(  TYYK(V W XXrentriesold_textct|Dcgc] \}}||k(s |}}}|r|n"t|Dcgc] \}}||vs |c}}}t|Dchc]}|| c}dkDry|r|ddfSddfScc}}wcc}}wcc}w)u``(index, ambiguous)`` for entries matching *old_text*. A whole-entry EXACT match (``old_text == entry``) takes absolute priority — substring matches are only considered when no entry equals *old_text*, so a short entry stays addressable even when its full text is contained inside a longer sibling entry (remove('test') vs '...tests pass...'). Exact-duplicate matches are safe (first wins); distinct matches → ``(None, True)``.)NTrNF) enumeratelen)r-r.ieexactmatchess r_find_unique_matchr7:s%W- ?41ahQ ?E ?e71C"UAxST}1"UG  (1GAJ ()A-!GAJe 33te 33 @"U (s A8A8 A>A> BcjeZdZdZdZd:ddddedededefd Zd ed efd Z d;dZ de ee fd e ee ffdZ dZeedefdZed ed efdZd ed eefdZd edeefdZd ed efdZd ed efdZd ed efdZd eded efdZd eded e ee ffdZd eded e ee ffdZd d!d ed"ed e ee ffd#Zd ed$ed e ee ffd%Zd ed&ed'ed e ee ffd(Zd ed&ed e ee ffd)Z d ed&ed'e!ed e ee ffd*Z"ed+eed,ed$ed&ed-ed e#e!ee!eff d.Z$d ed/ee ee fd e ee ffd0Z%d ed e!efd1Z&dr;r<_system_prompt_snapshot_consolidation_failures)selfr=r>r;r<s r__init__zMemoryStore.__init__XsL)+')7H/4 49GI]6T6BDb7Q$'($rtargetrc<|dk(r |jS|jSNr)r<r;rErGs rtarget_enabledzMemoryStore.target_enabledcs ,2f,._sanitizesvBGPUP`P`alPm'X>swH NNJHVZV_V_`hVi j  *NtyyYaObNcdef grr mkdir_under_hermes_homez%s exceeds its char limit on load: %d/%d chars. Entries stay loaded; further additions are blocked until it is back under the limit.N)tools.threat_patternsrT _path_forhermes_constantsr_parentlistdictfromkeys _read_file _set_entries _char_count _char_limitrWrXr( _render_blockrC) rEr]rGr!r_r-countlimitr4rTs @rload_from_diskzMemoryStore.load_from_diskzs ; g) zF>>&)D @ #DKK 04==)>?@G   fg .))&11t?O?OPV?W6WeX a#yy%8483E3EfpwNxklyYZ\`\e\eOfNx3yD ( ( 0 zOysD r!c #f Kddlm}|j|jc |j |j dz}ddlm}||j dytjtjz}ttdr|tjz}tj||d} ttdrtj|dtj |d d 5d t&f fd }|d dt)t*5|dddddddy#t"$rtj$|wxYw#1swY5xYw#t)t*5|ddddw#1swYwxYwxYw#1swYyxYww)zkExclusive lock on a separate .lock file so the memory file itself can still be atomically replaced.r memory_toolz.lockr^N O_NOFOLLOWifchmodzr+utf-8encodingunlockcr0j|rjyjyjdj j |r j n jdy)Nrr0)flockLOCK_UNLOCK_EXseeklockingfilenoLK_UNLCKLK_LOCK)rwfcntlfdmsvcrts r_flockz&MemoryStore._file_lock.._flocksQKKVEMMOOGGAJNN299;6v~~_`arFT)toolsrqrr with_suffixsuffixrbr_rcosO_RDWRO_CREAThasattrrropenrsfdopen ExceptioncloseboolrOSError) r!_mt lock_pathr_flagsraw_fdrrrrs @@@r _file_lockzMemoryStore._file_locksi - 3:: v$$T[[7%:; < 0 01 =V^   BJJ& 2| $ R]] "EE51  r8$ &%(64':B ! bt b 5M !g&!4L! ! !  HHV   !!Xg&!4L!!! ! !s~B:F1>E>F1F%E4F%+ E(4F%< F1 E%%F1(E1 -F%4F" F F"F F""F%%F.*F1cFddlm}|j|dk(rdz Sdz S)NrrprzUSER.mdz MEMORY.md)rrqget_memory_dir)rGrqs rrazMemoryStore._path_fors)%))+FfNPWXrc\ttj|j|SN)r2ENTRY_DELIMITERrYrrJs rrizMemoryStore._char_counts#?''(9(9&(ABCCrc<|dk(r |jS|jSrI)r>r=rJs rrjzMemoryStore._char_limits '-'7t##ST=S=SSrcP|j|dd|j|dS)N,/)rirjrJs r_usagezMemoryStore._usages/""6*1-Qt/?/?/G.JKKrcurrentc~|j|}|dkDrtdt||z dzndd|dd|ddS)Nrdu% — rrz chars)rjminint)rErGrrms r _usage_pctzMemoryStore._usage_pctsU  ( ``(new_entries, message)`` or an error dict, then persist and return the success response. The reload aborts on an existing-but-unreadable file (even append-only ``add`` rewrites the whole file) and, unless *skip_drift*, on external drift (flushing would discard un-roundtrippable content). Drift check and parse use the SAME raw snapshot — a failed second read used to count as "no drift". The closure may return a third value, a dict merged into the success payload (``_error``'s ``**extra`` convention) — e.g. the full text a replace overwrote (#117952).Nrr^r0)rar_read_raw_checkedr,_detect_external_driftrhrdrerf_parse_entriesr)rrj isinstancerbr_rc _write_filer2_success_response) rErGmutaterr!rawread_okbakresultr_ extra_fieldss r_mutatezMemoryStore._mutatesb~~f% __T " M11$7LC)$/ M M%$$*E*Efc*RC   fd4==9L9LS9Q+R&S T#D#. M MD--f5t7G7G7OPF&$' M M   ffQi 0 @ #DKK 0   T6!9 -(+F a6!9RL)4))&&)L|L# M M Ms!E1A E188E1:A-E11E:rcjs tdStx}r t|Sfd}j|dS)zDAppend a new entry. Returns error if it would exceed the char limit.zContent cannot be empty.c |vrjdSttj|gz|kDr6j dj dd|ddtdS|gzdfS)Nz*Entry already exists (no duplicate added).z Memory at rrz chars. Adding this entry (u chars) would exceed the limit. Consolidate now: use 'replace' to merge overlapping entries into shorter ones or 'remove' stale or less important entries (see current_entries below), then retry this add — all in this turn.z Entry added.)rr2rrYrri)r-rmrrErGs r_addzMemoryStore.add.._adds'!--f6bcc?''7)(;<=E11& !1!1&!9! fd}j|S)zWLocked replace (``new_content`` set) or remove (None) of the entry matching *old_text*.c t|\}}|r:tdd|Dcgc]}|vs|ddt|dkDrdndz!c}S|' jtddrd nd d | S|d|gngz||d zdz}|dfSttj |}||kDr j d|dd|ddS|dd||ifScc}w)NzMultiple entries matched 'z'. Be more specific.Pz...r@)r6zNo entry matched 'zV'. Check current_entries below and retry with the exact text of the entry you want to rr.)rr0zEntry removed.z Replacement would put memory at rru chars. Shorten the new content, or 'remove' other stale or less important entries to make room (see current_entries below), then retry — all in this turn.zEntry replaced.replaced_entry)r7r r2rRrrYr) r-rmidx ambiguousr4replaced new_totalrr.rErGs r_applyz!MemoryStore._edit.._apply2sX/BNC :8*DXYX_&qSTckopcpq"v#a&2+2'N&qss{226( 30=H h/WWXZkr4tuut}k.A }UX_`cfg`g`hXiiH"!111O00:;I5 11&6ym1U1IN?@BB.1A73<0PP P'rs C C )r)rErGr.rrs```` rrzMemoryStore._edit0s Q&||FF++rworkingactposc|dk(r|s|ddfS||vr|j|y|dvr|ddfS|s|ddfS|dk(r |s|d dfSt||\}}|r |d |d dfS| |d |d dfS|dk(r||nd}|dk(r|gng|||dzd|fS)aDApply one batch op to *working* in place; return ``(error message, replaced entry text)``. The first element is None on every success path; the second is the full entry a 'replace' overwrote (None on non-replace paths and on every error path), surfaced so the caller can show what was lost (#117952).rz: content is required.N)NN)rrz.: unknown action. Use add, replace, or remove.z: old_text is required.rz6: content is required (use action='remove' to delete).z: 'z8' matched multiple distinct entries -- be more specific.z: no entry matched 'z'.r0)appendr7)rrrr.rrr replaced_texts r_apply_batch_opzMemoryStore._apply_batch_opGs  %<45t;;g%w' + +UHI4O OU12D8 8 ) GUPQSWW W+GX>Y U#hZ'_`bff f ;U.xj;TA A(+y(8 d ,/9,<y"C!G]""r operationscLs tdSDcgc]}|xsi c}tD]S\}}|jddvxr!|jdxrt|d}|s?td|dzd|cSfd}j |Scc}w) uXApply add/replace/remove ops atomically against the FINAL budget, so one call can free space and add entries. All-or-nothing: any malformed / unmatched op or an over-limit result writes NOTHING and returns the first failure. Aborts do not echo ``current_entries`` — the store is unchanged and the model already has it.zoperations list is empty.action>rrr Operation r0: c t|}i}t D]\}}|jd}j|||jdxs|jdxsdj |jdxsdj d|dzd|xsd d \}}|rj |cS||||dz<|r3|s1j j} j d | d Sttj|} | |kDr'j d t d| dd|ddS|rd|ini} |dt d| fS)Nrrnew_textr@r.rr0z (unknown)zRefusing to empty u: this batch would remove every entry from a previously non-empty store. Keep at least one entry — merge overlapping entries into a shorter one instead of removing the last one. To delete the final entry deliberately, use single remove() calls.zAfter applying all z operations, memory would be at rrzW chars -- over the limit. Remove or shorten more entries in the same batch, then retry.replaced_entrieszApplied z operation(s).) rdr1getrrrrar(r2rrY)r-rmrrr3oprmsgrlabelrreplaced_fieldsropsrErGs rrz'MemoryStore.apply_batch.._applyqs7mGH"3 42ffX&%)%9%9S266)#4#Pz8J#Pb"W"W"YVVJ'-2446*QUG2cN^U^M__`8a&c"]..vs;; ,'4HQUO 4wv.33**6(0KLNN O009:I5 **6)#j/)::Z m1U1I.=>@@AI18>;>7= =+,  s '99rcfd|jtDDcgc]}|s| c}Scc}w)uRStripped, non-empty entries; splits on the FULL delimiter so a bare "§" survives.c3<K|]}|jywr)r).0xs r z-MemoryStore._parse_entries..sJ!AGGIJs)splitr)rr4s rrzMemoryStore._parse_entriess)Ksyy/IJPaaPPPs..cXtjtj|dS)zEntries of a memory file ([] on any error). Read-only callers only; mutation paths use ``_read_raw_checked`` so they can refuse to overwrite an unreadable file.r)r9rrr+s rrgzMemoryStore._read_files%))+*G*G*Ma*PQQrc t|tj|dy#t$r}t d|d|d}~wwxYw)zpAtomic temp-file + rename: readers never see a truncated file. Also used by agent/learning_mutations.py.z.mem_) tmp_prefixzFailed to write memory file rN)r rrYr RuntimeError)r!r-r4s rrzMemoryStore._write_filesJ K dO$8$8$Ag V K!=dV2aSIJ J Ks!$ A>Ac|j|}|jrS|jtj|k(r.t t t |d|j|kry|j|}|j|jdttjz} |j|dt|S#t$rt|dzcYSwxYw)u``.bak.`` snapshot path if *raw* shows external drift, else None. Signals: round-trip mismatch, or one entry over the whole-file limit (no tool-written entry can be — an external writer appended free-form text).r)defaultNz.bak.rtruu+ (BACKUP FAILED — file unchanged on disk))rrrrYmaxmapr2rjrarrrtime write_textrstr)rErGrparsedr!r"s rrz"MemoryStore._detect_external_drifts$$S)yy{syy{o.B.B6.JJ#&s3'7#CtGWGWX^G_#_~~f%##DKKE#diik:J9K2L$LM Q   g  68} Qx=#PP P QsC""C<;C<)ii_)rNr).__name__ __module__ __qualname____doc__rQrrrFrrKrMrrrRrn staticmethodrrrrarrrhrirjrrrrrrrrr rr rrrrrkrrrgrrrrrr9r9Ms4O,-()(,4)#)s)!%)DH)VSVTV)7tCH~7$sCx.7 zB'!'!'!R_#_$__N3N49NY3YcYD#D#DT#T#TLSLSLppspspcCc#c$sCx.c sSs3s4S>sBGMcM$M4PSUXPX>M:;#;;S#X;, Ac AS As AtCQTH~ A:S:C:DcN: ,C,3,Xc],tTWY\T\~,.#c##s#c# #%*8C=(3-+G%H##6.,#.,4S#X3G.,DQTVYQYN.,`DsDx}D V Vc VdSVX[S[n V]C]$s)]]sDy)9"QCQDIQQRR$s)RR K$KcKKSsx}rr9)!rloggingrr contextlibrrpathlibrtypingrrrr r utilsr r`r r getLoggerrWrrrrr r)r,rrr7r9rrrrs0  /33#O   . / -6VX:#:(3-: 9C9T#s(^9 ht hs htCH~ hXTXd38nX 4S 4S 4U8C=RVCV=W 4&VVr