+
iHj! T R t ^ RIHt ^ RIt^ RIt]P
! ]4 t]P ! R]P 4 t
]P ! R]P 4 t ]P ! R]P 4 t R R lt
! R R 4 t]P ! R
4 tR R ltR
R ltR# )aq Memory-context fencing: how recalled memory is wrapped for the model and kept out of output.
``build_memory_context_block`` fences prefetched recall for the prompt; ``sanitize_context`` and
``StreamingContextScrubber`` strip those fences (and anything a provider pre-wrapped) from text that
leaves the agent. Pure text formatting: no provider calls, no profile state.
) annotationsNzz5<\s*memory-context\s*>[\s\S]*?z\[System note:\s*The following is recalled memory context,\s*NOT new user input\.\s*Treat as (?:informational background data|authoritative reference data[^\]]*)\.\]\s*c V ^8 d QhRRRR/# textstrreturn )formats "9/home/ubuntu/.hermes/hermes-agent/agent/memory_context.py __annotate__r s 3 3 c Z \ \ \ 3 F pVP RV 4 p K V # )zQStrip fence tags, injected context blocks, and system notes from provider output. )_INTERNAL_CONTEXT_RE_INTERNAL_NOTE_RE
_FENCE_TAG_REsub)r patterns & r sanitize_contextr s* (*;]K{{2t$ L Kr
c ] tR t^ tRtRtRtR R ltR R ltR R lt R
R lt
] R R
l4 t R R lt
R R ltR R ltRtR# )StreamingContextScrubbera^ Stateful scrubber for streaming text whose memory-context spans may straddle deltas.
``sanitize_context`` needs both tags in one string, so a split span would leak to the UI;
this holds back partial-tag tails between ``feed()`` calls and drops span interiors.
One scrubber (or ``reset()``) per top-level response; call ``flush()`` at end of stream.
zzc V ^8 d QhRR/# r r Noner )r
s "r r %StreamingContextScrubber.__annotate__) s $ r
c & V P 4 R # N)resetselfs &r __init__!StreamingContextScrubber.__init__) s
r
c V ^8 d QhRR/# r r )r
s "r r r , s - -t -r
c 0 R V n RV n RV n R# )Fr TN)_in_span_buf_at_block_boundaryr s &r r StreamingContextScrubber.reset, s #
(, r
c V ^8 d QhRRRR/# r r )r
s "r r r 1 s r
c
n V' g R# V P V, pRV n . pV' Edw V P ' d> V P pVP 4 P V4 pV P W$4 pMV P pV P V4 p\ V4 pVP 4 P V4 ' d V P VRV) 4 ' d TM^ pT;' g V P W$4 pVR8X dG V P ' g T P Y6' d VRV) MT4 V' d W&) R MRV n MSV P ' g V P W2RV 4 W%\ V4 , R pV P ' * V n EK RP V4 # )z^Return the visible portion of ``text``; a possible partial tag tail is held for the next call.r N)
r& r%
_CLOSE_TAGlowerfind_max_partial_suffix _OPEN_TAG_find_boundary_open_taglenendswith_ends_at_block_boundary_append_visiblejoin) r r bufouttagidxheldnpendings && r feed StreamingContextScrubber.feed1 s_ ii$ c}}}ooiik&&s+//9nn2237H "yy{ 3 3C 8 8T=Y=YZ]^a`a_aZb=c=c!ij DD$":":3"Dby}}}((Tc&D5ksK+/CKR ===$$Sds)4CHno&C $
-DMwws|r
c V ^8 d QhRR/# )r r r r )r
s "r r r P s s r
c
b V P ' d RM V P pRV n RV n V# )zEmit the held-back tail at end-of-stream; inside an unterminated span it is discarded
(leaking partial memory context is worse than a truncated answer).r F)r% r& )r tails & r flush StreamingContextScrubber.flushP s* ]]]r
r
c $ V ^8 d QhRRRRRR/# )r r7 r r9 r intr )r
s "r r r Y s& R R R3 R3 Rr
c
aa VP 4 V P 4 uoo\ \ \ S4 \ S4 ^,
4 ^ R4 p\ VV3R lV 4 ^ 4 # )zXLength of the longest buf-suffix that is a (case-insensitive) prefix of ``tag``, else 0.c 3 b <" T F$ pSP SV) R 4 ' g K Vx K& R # 5ir )
startswith).0i buf_lower tag_lowers & r ?StreamingContextScrubber._max_partial_suffix..] s( M1 (<( only whitespace and already at a boundary).
r )
rpartitionstripr[ r' )r r _headseprB s && r r4 0StreamingContextScrubber._ends_at_block_boundaryj sB ??40Dzz|r!LLtCy'K'KD4K4KLr
c $ V ^8 d QhRRRRRR/# )r r8 z list[str]r r r r r )r
s "r r r p s& I I9 IC ID Ir
c h V' d* VP V4 V P V4 V n R # R # r )appendr4 r' )r r8 r s &&&r r5 (StreamingContextScrubber._append_visiblep s) JJt &*&B&B4&HD # r
)r' r& r% N)__name__
__module__ __qualname____firstlineno____doc__r0 r, r! r r> rC staticmethodr/ r1 r4 r5 __static_attributes__r r
r r r sT #I$J-
> R R M I Ir
r z
[-*+]\s+\Sc V ^8 d QhRRRR/# r r )r
s "r r r { s + +c +c +r
c V P R4 p\ 4 p. p\ V4 EF' w rEVP 4 pV' d1 V^ , P 4 ' d VP V4 KN \
\ P V4 4 pV' d V' g VP 4 V' d V^, \ V4 8 d W^, , MRp\
VP 4 4 ;' d V^ , P 4 p V ' g Wb9 d EK VP V4 VP V4 EK* RP V4 # )uZ Drop a recalled bullet that an EARLIER line of this same block already states.
Providers merge several stores (and this merges several providers), so one prefetch routinely
surfaces the same fact two or three times. A byte-identical repeat inside one block tells the
model nothing the block has not already said, and it is not free: the composed block is stamped
into the user row's ``api_content`` sidecar and replayed verbatim on every later request for as
long as that row is in context, so each duplicate is paid once per turn, forever.
The ``seen`` set is scoped per section — every non-bullet line at column 0 (a heading of any
style, a ``---`` rule, prose) starts a new one — so a repeat is only dropped when the SAME
section already states it.
Only a SELF-CONTAINED bullet is considered — a marker, whitespace, content, and no continuation
line indented beneath it. A bullet that carries continuation lines is never dropped and never
suppresses a later one, because two entries can share a headline and differ underneath it
(``- prefers draft PRs`` / `` (logged 12 Jan, builtin)`` vs the same headline logged elsewhere):
dropping one would re-parent its provenance under the other and invent a record neither provider
reported. Headings — including ``**bold**`` ones — prose, blank lines, separators and numbered
items are left exactly as written.
r] r )
splitset enumerater_ isspacere r[ _RECALL_BULLET_REmatchclearr2 addr6 )
r linesseenkeptindexlinestripped is_bullet followingcarries_continuations
& r _drop_repeated_recall_linesr { s *
JJt EUDD ' ::< Q)) KK *00:; I JJL ,1AIE
,Bai(I#' (9#:#U#Uy|?S?S?U '# " D% (& 99T?r
c V ^8 d QhRRRR/# )r raw_contextr r r )r
s "r r r s C C r
c V ' d V P 4 ' g R# \ V 4 pW8w d \ P R4 \ V4 pRV R2# )z:Wrap prefetched memory in a fenced block with system note.r z6memory provider returned pre-wrapped context; strippedu
[System note: The following is recalled memory context, NOT new user input. Treat as authoritative reference data — this is the agent's persistent memory and should inform all responses.]
z
)r_ r loggerwarningr )r sanitizedcleans & r build_memory_context_blockr sY k / / 1 1 -I OP ' 2E V ' r
)rk
__future__r loggingre getLoggerrg r compile
IGNORECASEr r r r r rt r r r r
r r s # 8 $
6
F
zz"Z\^\i\ij JJ pMM UI UIt JJ}- +\r