߲j?UdZddlZddlZddlZddlZddlZddlZddlmZddl m Z m Z ejdZ ejZiZeed<ejZiZeed<dZd Zd Zd Zd Zd Zd Zd ed efdZd eded efdZd ede d dfdZ!ded dfdZ"ded ed edzfdZ#deded ed dfdZ$deded ed edzfdZ%deded eded df dZ&dede'd efdZ(d3d efdZ)d4d efd Z*ded ed dfd!Z+ded ed dfd"Z,d#ed e'dzfd$Z-d#ed e'dzfd%Z.d3d#ed ed&edzd dfd'Z/d#ed ed e0fd(Z1d)Z2ded#ed*e'd+ed,ed-e0d e'e0e0ffd.Z3ded ed e0fd/Z4ded ed edzfd0Z5 d3d ede ed1edzd dfd2Z6y)5uZPer-task read/search bookkeeping for the file tools. Process-lifetime state behind read_file/search_files/write_file/patch. Per task_id ``_read_tracker`` stores: ``last_key``/``consecutive`` (loop detection; reset by any OTHER tool call), ``read_history`` (diagnostics), ``dedup`` (key -> file metadata; survives context compression), ``dedup_generation_reads`` (keys whose full content was served since the last compaction boundary; cleared on compression so one recovery read returns full content), ``dedup_hits`` (stub-loop breaker), ``read_timestamps`` (staleness warnings), ``read_coverage`` (per resolved path: the line ranges the task has paged through at one file version — contiguous pages that reach the last line count as a whole-file read), ``full_write_baselines`` (resolved paths whose whole-file content this task saw via unredacted read_file page(s) or wrote via write_file; required before write_file may overwrite an existing file — patch never qualifies) and ``not_found`` (short-TTL negative cache). Every container is hard-capped (``_cap_read_tracker_data``) so long sessions stay small. N) _evict_oldest)_authoritative_workspace_root_resolve_path_for_taskztools.file_tools _read_tracker_patch_failure_tracker@iigN@task_idreturnctj|ddtd}dD]}|j|i|jdt|S)zGet-or-create the tracker entry for *task_id*, back-filling missing containers (search_tool / tests create partial entries). Lock must be held.Nr)last_key consecutive read_history)dedup dedup_hitsread_timestamps read_coveragefull_write_baselinesdedup_generation_reads)r setdefaultsetr task_datakeys C/home/ubuntu/.hermes/hermes-agent/tools/file_tools_read_tracking.py _task_datar2s^((CE3CDIb&S"%& 1359  resolved_pathct5tj|i}||vrt|tdz |j |ddz||<||cdddS#1swYyxYw)zAIncrement and return the consecutive-failure count for this path.rN)_patch_failure_lockrrr_PATCH_FAILURE_PATHS_CAPget)r r task_failuress r_record_patch_failurer$=sh ,.99'2F  - -)AA)E F'4'8'8'JQ'N m$]+ ,,,s A AA$resolved_pathsc|syt5tj|}|r|ndD]}|j|d dddy#1swYyxYw)z5Clear consecutive-failure counts for the given paths.N)r rr"pop)r r%r#rps r_reset_patch_failuresr*HsS  (.227; $1.r (B   b$ ' ((((s 3AArc dtfdtfdtfdtfdtfdtfdtfdtffD]4\}}|j |}|t ||kDs)t||6y ) zXEnforce size caps on the per-task sub-containers. Call with ``_read_tracker_lock`` held.rrrrrrr not_foundN)_READ_HISTORY_CAP _DEDUP_CAP_READ_TIMESTAMPS_CAP_FULL_WRITE_BASELINES_CAP_NOT_FOUND_CAPr"lenr)rrcap containers r_cap_read_tracker_datar5Rs *+ * z" !:. 01 ./ !:; n%' *SMM#&  S^c%9 )S ) *rfilepathcX tt||S#ttf$rYywxYwN)strrOSError ValueErrorr6r s r_resolved_or_noner=cs1)(G<== Z s ))op resolved_strctj|}|r|jdnd}|r|j||fdyy)zJDrop the negative-cache entry for *(op, resolved_str)*. Lock must be held.r,N)rr"r()r>r?r rnfs r_pop_not_foundrBjs?!!'*I'0{ #dB  L!4( rct5tj|}|r&|jdxsij||fnd}| dddy|\}}tj|z t kDrt ||| dddy dddtjj|rt5t |||dddyS#1swYGxYw#1swYyxYw)zReturn cached not-found JSON for *(op, resolved_str)* if still fresh. *op* is "read" or "search" (different error JSON shapes). Evicted by TTL, by write_file/patch on the path, or by any other tool call. r,N) _read_tracker_lockrr"time monotonic_NOT_FOUND_TTL_SECONDSrBospathexists)r>r?r rentryts cached_jsons r_check_not_found_cacherNrs !%%g. NW{+1r66L7IJ]a =   K >> b #9 9 2|W 5 :  ww~~l#  6 2|W 5 6 ! 6sAC1C;C C C) error_jsonct5t|}tj|f|j di||f<t |dddy#1swYyxYw)zKCache a not-found error so the next *op* call for *resolved_str* skips I/O.r,N)rDrrErFrr5)r>r?r rOrs r_record_not_foundrQsU *w' EI^^EUWaDb ["-r<.@Ay)***s AAArcT|d|k(r|dxxdz cc<|dS||d<d|d<|dS)zRUpdate last_key/consecutive for *key* and return the new count. Lock must be held.r r rr')rrs r_bump_consecutiverSsM#- A%  ] ##!$ *#$ - ] ##rc t5|r"tj|r t|gng}nttj }|D]A}d|vr|dj |j dtj C|Dcgc]}|t|jdif!}}dddD]\}}|jDchc]\}}t||ddk7s|}}}|s=t5|D]2}|dj|||k(s|dj|d4 dddycc}w#1swYxYwcc}}w#1swYxYw)uAdvance the read-dedup generation after context compression (one task, or all when ``task_id`` is None). The per-key ``dedup`` metadata map is PRESERVED so unchanged files keep returning stubs instead of re-bloating the reclaimed context; the generation-read set is cleared so the FIRST unchanged read of each key after compaction returns full content the summary may have dropped. Stub-hit counters are cleared so the hard block restarts fresh. write_file baselines survive exactly like the dedup map does — while the file metadata still matches the stamp this task recorded; byte identity is checked before overwriting. A baseline whose file changed underneath is dropped (the stat runs outside the lock so a hung mount cannot stall other tasks).rrrN) rDrr"listvaluesclearrrdictitems_file_metadatar()r targetsr candidates baselinespversionchangeds rreset_file_deduprbs  0 2?2C2CG2L}W-.RTG=//12G  JIy(,'--/  !935 A G G I J (/0#!$y}}5KR'P"QR0 0 0!+G 9'0'8^GN1xYw#t$rYywxYw) zGA byte snapshot, not just mtime (editors/copy tools can preserve that).N O_NONBLOCKrO_BINARYrbsha256)rqrrrsrtruc36K|]}t|ywr8getattr).0namebefores r z _file_version.. sA$-Ac36K|]}t|ywr8r})rrafters rrz _file_version.. sDTGE40Dr)rpS_ISREGrHst_modeopenO_RDONLYr~fdopenfstatfilenohashlib file_digestdigesttupler:)rhfdstreamrfieldsr`rrs @@r _file_versionrs+||BGGH-556 WWXr{{WRq-IIGTVXbdeLff g YYr4  &FXXfmmo.F<</ & &((:AACFGGH%E  & OA&AA eDVDD D%W%f% % & & s<2E$AE$AEE$"9E;E$E!E$$ E0/E0expected_sha256ct|}|||dj|k7ryt5t|}||dt |<t |dddy#1swYyxYw)zRecord that *task_id* saw the whole current content of *resolved* (full unredacted read_file, or its own successful write_file), so a later write_file may replace the file. Acquires the lock itself.NrUr)rhexrDrr9r5)rhr rr`rs r_mark_full_write_baselinerslH%G?672;??;LP_;_ *w' ;B ()#h-8y)***s (AA'ct5tj|xsi}|jdijt|}dddduxrt ||k(S#1swYxYw)Nr)rDrr"r9r)rhr rbaselines r_has_full_write_baselinerso P!%%g.4" ==!7<@@XOP 4  GM($;x$GGPPs AA''A0r`startendredactedc|jdi}|j|}||d|k7st|dtkDr |gddx}||<|dxs||d<g} t |d||fgzD]F\} } | r,| | dddzkr| dd t | dd| f| d<4| j | | fH| |d<t|txr|d kDxr| d d dkxr | d d|k\} | |dfS) aMerge the page ``start..end`` into this task's coverage of *resolved* and return ``(complete, redacted_any)``: whether pages taken at this same *version* now reach from line 1 to *total_lines*, and whether any of them came back redacted. A file too large for one read_file page (>2000 lines / the char budget) can only ever be seen this way, so paging through it must count as a whole-file read. A new version restarts the coverage (the earlier pages describe a file that no longer exists). Lock must be held.rr`rangesF)r`rrrrUrr) rr"r2_READ_COVERAGE_RANGES_CAPsortedmaxappend isinstanceint) rrhr`rr total_linesrcoveragerKmergedsecompletes r_note_read_coverager)sK##OR8H LL "E }i(G3s5?7KNg7g18BTY%ZZ"j)5XE*$&FuX5#,78"1 a6":a=1,, *Q-VBZ]A)>?F2J MM1a& ! " E(O;,FqF1IaLA%F*0)A,+*E U:& &&rc4t||}|yt5tj|}|r!|jdij|nd}dddy tj j ||k7S#1swY/xYw#t$rYywxYw)zTrue when the file's mtime changed since this task last read it. False when never read, fresh, or unstattable (a deleted file is the write's problem).NFr)r=rDrr"rHrIrlr:)r6r rhr read_mtimes r_read_mtime_driftedrBs!73H _!%%g. KTY]]#4b9==hGZ^ _ww)Z77 __ s;A?!B ?B BBc(t||rd|dSy)zNWarn (don't block) when the file's mtime changed since this task last read it.z Warning: z was modified since you last read it (external edit or concurrent agent). The content you read may be stale. Consider re-reading the file to verify before writing.N)rr<s r_check_file_stalenessrSs*8W-z"L L M r session_idcv ddlm}|Dcgc]}|s| }}|sy ddlm ddlm}|Dcgc]}t ||j}}t fd|Ddxst|xs|d}||xs|||ycc}wcc}w#t$rtjdd YywxYw) zBest-effort note that successful edits made prior verification stale. cwd: the first edited path's recognised project root, else the workspace root, else the first parent.r)PathN)project_facts_for)mark_workspace_editedc34K|]}|s |ywr8r')rcrs rrz+_mark_verification_stale..ks@1+wCuU -7 H 7$ GHs,B B B"B:BB B87B8r8)default)7__doc__rloggingrHrp threadingrEtools.file_statertools.file_tools_pathsrr getLoggerrLockrDrrY__annotations__r rr!r-r.r/r0r1rGr9rrr$rVr*r5r=rBrNrQrrSrbrdrjrnr[rrboolrrrrrrr'rrrs$  *X   - .#Y^^% t%inn&!!   ,3,s,s,(3(((*d*t*"ccDj)s)#)))s#d 2*#*S*3*C*TX*$$E$c$GcG>+C+"44s4t4$.S.3.4.,SUT\CEDL* * *c *CRVJ *bf *HsHSHTH '4'3''s'Y\'/3'8=dDj8I'2#"C##*7;HcH49H),tH?CHr