߲jBdZddlZddlZddlZddlZddlZddlZddlZddlm Z ddl m Z m Z m Z ddlmZmZmZmZmZdZdZdZd Zd Zd Zd ed ede fdZdedefdZdZde dZdZdedefdZ dededefdZ!dedefdZ"dedefdZ#dede$edfdefdZ%dedefd Z&ejNd!d"dZ(e(efZ)e%d#e)Z*e&eZ+d$e ed%e%e+e)d&Z,e#d'e ed(Z-e"e-Z.d)e.d*e/ed+e ed,e"d-e.d.e/ed"zd&d/e-d0 Z0e&eZ1d1e*d2e,d3e*d4e ed5e#e1d6e,d7e#e0d8Z2d9jggd:e*d,e1d;e,d,e0d;ed<ed=zd>ed*ed?e d@edAedBed>ed*ed=zdCed*edDZ4dEe defdFZ5dGe4dHe2dIZ6e!dJdKdLZ7dMZ8dNZ9d.jgdOe9DZ:e;e9dPhzZe;e=hdSzZ?de@fdTZAdUedVedefdWZBe!dJdXdYeBdZe:zZCd[e7jd\]d^eCjd\]d&ZEddUedefd_ZFd`edaedbedefdcZGddUedefddZHdaedefdeZIdfZJdgZKdhZLdiZMdUedefdjZNeNdkZOeNdlZPdmZQddnZRdoZSdpZTde@fdqZUdefdrZVdsZWeWfdteXfduZYdvZZdwZ[dxZ\dyeMdzeOd{ePd|ePd}eOd~ Z]dZ^ddUedefdZ_e_Z`de_d\de`de`de`de`d ZadZbdZcdZddZedeOdeOdZfdeOdeOdZgejdZidZjdZkejdk(ZmdZnejejejejhZsdetde@fdZudeXfdZvdZwdexddfdZyddZzddZ{de@fdZ|dZ}defdZ~dZejdddZy)zShared constants and helpers for the SessionDB family of modules. Lives outside hermes_state so the mixin modules can import it without a cycle.N)Any)SKILL_EXCERPT_JOINTSKILL_SCAFFOLD_SQL_LIKEdescribe_skill_invocation)LEGACY_SUMMARY_PREFIXSUMMARY_PREFIX_MERGED_PRIOR_CONTEXT_HEADER_MERGED_SUMMARY_DELIMITER_SUMMARY_END_MARKERderivedllmuser?i<keyenv_varreturncddlm}|r0 ddlm}|j dxsij |St jj |S#t $rYywxYw)a``sessions.`` for the profile whose state.db this process is touching. ``gateway/run.py`` bridges the LAUNCH profile's ``sessions.*`` into ``env_var`` (the cross-process carrier CLI/cron children read). Under a multiplexer a routed turn runs with a HERMES_HOME override and that env slot holds the default profile's value, so a served profile with different ``sessions.*`` settings must read its own config.yaml. Unscoped: the env bridge, as before. Returns ``None`` when neither source sets the key. r)get_hermes_home_override)load_config_readonlysessionsN)hermes_constantsrhermes_cli.configrget Exceptionosenviron)rrrrs 8/home/ubuntu/.hermes/hermes-agent/hermes_state_common.pyrouted_sessions_settingr sb:!  >(*..z:@bEEcJ J ::>>' ""  s.A A)(A)textcf|jddjddjddS)zEscape LIKE wildcards (``%``, ``_``) so derived text matches literally; pair with ``ESCAPE '\'``. ``_`` is common in branch names/titles/paths and a substring match must not silently widen.\z\\%z\%_z\_replacer s r escape_liker(4s/ <<f % - -c5 9 A A#u MMz3REPLACE(REPLACE(m.content, X'0A', ' '), X'0D', ' ')zm.content LIKE ''z+CHAR(9) || CHAR(10) || CHAR(13) || CHAR(32)c2d|jddzdzS)Nr*z''r%r's r _sql_literalr,?s c4( (3 ..r) expressionpathc8d|d|d}d|dt|dS)z?Build a non-throwing JSON marker lookup for a JSON TEXT column.z(CASE WHEN json_valid(z) THEN z ELSE json_object() END)z json_extract(, ))r,)r-r. safe_jsons r_sql_json_extractr3Cs? ! -|3 59+R T(:';1 ==r)cd|dtdS)NzLTRIM(r0r1_SQL_WHITESPACEr-s r_sql_ltrim_whitespacer8Ms Jz#_sql_starts_with..Ws.eWXwwiuSVHDa@QRes'*r1)r8join)r-r;rFs @r_sql_starts_withrIUs.#J/G e\dee ehk kkr)markerc8dt|dt|dS)z5``m.content`` after the first occurrence of *marker*.z#SUBSTR(m.content, INSTR(m.content, z) + r1)r,rC)rJs r_sql_after_markerrLZs" 0f1E0Fd3v;-WX YYr)z Do NOT answerz m.contentz(INSTR(m.content, z ) > 0 AND r1z&SUBSTR(m.content, 1, INSTR(m.content, z) - 1)zCASE WHEN SUBSTR(rArBz THEN r@r0z ELSE z ENDz4(COALESCE(m.display_kind, '') <> 'hidden' AND ((NOT z AND NOT z) OR (z AND INSTR(m.content, z) > 0 AND LENGTH(z ) > 0) OR (z AND LENGTH(z) > 0))) CASE WHEN z WHEN z AND LENGTH(m.content) > z THEN SUBSTR(z) || 'z ' || SUBSTR(z, -z) WHEN z) ELSE SUBSTR(z) ENDrawct|xsdj}|sy|jddjdd}t|}||n|j t d}t |tkDr |dtdzS|S)zCTurn a ``_preview_raw`` column into the short preview callers show.rN   Nrz...)strstripr&rsplitrrC_PREVIEW_MAX_CHARS)rQr describeds r_shape_previewr[s syb>   !D  <<c " * *4 5D)$/I!-94::>Q3RST3UD03D = p.ended_at)zsEXISTS (SELECT 1 FROM sessions p WHERE p.id = {a}.parent_session_id AND p.end_reason = 'compression')) session_resetsession_switchidledaily suspendedresume_pending_expiredc#(K|] }d|d ywr*NrDreasons rrGrGs"RVQvha="R new_session) agent_closews_orphan_reapsuperseded_by_resumestartup_orphan_reapc#(K|] }d|d ywrcrdres rrGrGs(^61VHA(^rg> lru_evict idle_timeout tui_shutdown ws_disconnectc6t|txr|tvS)u/True when *reason* is an automatic-cleanup end stamp; compression-liveness sites must call this. Single owner of the "accidental vs deliberate end" predicate — every compression-liveness site must call this instead of re-implementing the reason taxonomy (#88197, never-patch-predicates). ) isinstancerV_AUTOMATIC_END_REASONS)rfs ris_automatic_end_reasonrus fc " Gv1G'GGr)alias reasons_sqlc &d|d|d|d|d|d S)aPre-marker reset-continuation heuristic: child rides its parent's exact non-empty routing key and the parent ended at a reset boundary. Shared by ``_RESET_CHILD_SQL`` and ``reopen_session()`` so the two cannot drift; ``reasons_sql`` is a literal or placeholder list.z9EXISTS (SELECT 1 FROM sessions p WHERE p.id = z3.parent_session_id AND p.end_reason IN (z) AND z(.session_key IS NOT NULL AND z".session_key != '' AND z.session_key = p.session_key)rd)rvrws r_legacy_reset_child_sqlrys?HwO,,7=8I%Q '!CE7Jg ijr)z $._reset_fromz IS NOT NULL OR z{a}z (s.parent_session_id IS NULL OR sar>c d|dtj|dtj|dtj|d S)z:Subagent runs, not branch, reset, or compression children.r=z(.parent_session_id IS NOT NULL AND NOT (r{z ) AND NOT (z)))_BRANCH_CHILD_SQLformat_COMPRESSION_CHILD_SQL_RESET_CHILD_SQLrvs r_ephemeral_child_sqlrsaw>?P?W?WZ_?W?`>ab+22U2;.5sXACXs )rHrangersintrC)itemss r _placeholdersr3s, 88X 5#0FuCPUJ!WX XXr)isizec#lKt|}tdt||D] }||||zyw)z?Yield *ids* (any iterable) as lists of at most *size* elements.rN)listrrC)idsrstarts r _id_chunksr>s< s)Cq#c(D)&% %%&s24)messages_fts_insertmessages_fts_deletemessages_fts_updatemessages_fts_trigram_insertmessages_fts_trigram_deletemessages_fts_trigram_updateu% CREATE TABLE IF NOT EXISTS schema_version ( version INTEGER NOT NULL ); CREATE TABLE IF NOT EXISTS system_prompts ( hash TEXT PRIMARY KEY, prompt TEXT NOT NULL ); CREATE TABLE IF NOT EXISTS sessions ( id TEXT PRIMARY KEY, source TEXT NOT NULL, user_id TEXT, session_key TEXT, chat_id TEXT, chat_type TEXT, thread_id TEXT, display_name TEXT, origin_json TEXT, expiry_finalized INTEGER DEFAULT 0, model TEXT, model_config TEXT, system_prompt TEXT, system_prompt_hash TEXT, parent_session_id TEXT, started_at REAL NOT NULL, ended_at REAL, end_reason TEXT, message_count INTEGER DEFAULT 0, tool_call_count INTEGER DEFAULT 0, input_tokens INTEGER DEFAULT 0, output_tokens INTEGER DEFAULT 0, cache_read_tokens INTEGER DEFAULT 0, cache_write_tokens INTEGER DEFAULT 0, reasoning_tokens INTEGER DEFAULT 0, cwd TEXT, git_branch TEXT, git_repo_root TEXT, git_metadata_generation INTEGER NOT NULL DEFAULT 0, billing_provider TEXT, billing_base_url TEXT, billing_mode TEXT, estimated_cost_usd REAL, actual_cost_usd REAL, cost_status TEXT, cost_source TEXT, pricing_version TEXT, title TEXT, title_source TEXT, last_activity_at REAL, last_activity_description TEXT, last_activity_provenance TEXT, api_call_count INTEGER DEFAULT 0, handoff_state TEXT, handoff_platform TEXT, handoff_error TEXT, compression_failure_cooldown_until REAL, compression_failure_error TEXT, compression_fallback_streak INTEGER NOT NULL DEFAULT 0, compression_ineffective_count INTEGER NOT NULL DEFAULT 0, compression_recovery_deadline REAL, profile_name TEXT, transport_profile TEXT, rewind_count INTEGER NOT NULL DEFAULT 0, archived INTEGER NOT NULL DEFAULT 0, pinned INTEGER NOT NULL DEFAULT 0, hidden INTEGER NOT NULL DEFAULT 0, last_read_at REAL, tool_names TEXT, FOREIGN KEY (parent_session_id) REFERENCES sessions(id), FOREIGN KEY (system_prompt_hash) REFERENCES system_prompts(hash) ); CREATE TABLE IF NOT EXISTS messages ( id INTEGER PRIMARY KEY AUTOINCREMENT, session_id TEXT NOT NULL REFERENCES sessions(id), role TEXT NOT NULL, content TEXT, tool_call_id TEXT, tool_calls TEXT, tool_name TEXT, effect_disposition TEXT, timestamp REAL NOT NULL, token_count INTEGER, finish_reason TEXT, reasoning TEXT, reasoning_content TEXT, reasoning_details TEXT, codex_reasoning_items TEXT, codex_message_items TEXT, platform_message_id TEXT, observed INTEGER DEFAULT 0, _compressed_summary INTEGER NOT NULL DEFAULT 0, active INTEGER NOT NULL DEFAULT 1, compacted INTEGER NOT NULL DEFAULT 0, api_content TEXT, display_kind TEXT, display_metadata TEXT, display_identity BLOB, display_order INTEGER ); CREATE TABLE IF NOT EXISTS session_model_usage ( session_id TEXT NOT NULL REFERENCES sessions(id) ON DELETE CASCADE, model TEXT NOT NULL, billing_provider TEXT NOT NULL DEFAULT '', billing_base_url TEXT NOT NULL DEFAULT '', billing_mode TEXT NOT NULL DEFAULT '', task TEXT NOT NULL DEFAULT '', api_call_count INTEGER NOT NULL DEFAULT 0, input_tokens INTEGER NOT NULL DEFAULT 0, output_tokens INTEGER NOT NULL DEFAULT 0, cache_read_tokens INTEGER NOT NULL DEFAULT 0, cache_write_tokens INTEGER NOT NULL DEFAULT 0, reasoning_tokens INTEGER NOT NULL DEFAULT 0, estimated_cost_usd REAL NOT NULL DEFAULT 0, actual_cost_usd REAL NOT NULL DEFAULT 0, cost_status TEXT, cost_source TEXT, first_seen REAL, last_seen REAL, PRIMARY KEY (session_id, model, billing_provider, billing_base_url, billing_mode, task) ); CREATE TABLE IF NOT EXISTS state_meta ( key TEXT PRIMARY KEY, value TEXT ); CREATE TABLE IF NOT EXISTS gateway_routing ( scope TEXT NOT NULL DEFAULT '', session_key TEXT NOT NULL, entry_json TEXT NOT NULL, updated_at REAL NOT NULL, PRIMARY KEY (scope, session_key) ); CREATE TABLE IF NOT EXISTS gateway_hygiene_state ( session_key TEXT PRIMARY KEY, failure_streak INTEGER NOT NULL DEFAULT 0 ); -- Monotonic conversation generation per routing peer (#96811). -- -- A host-declared conversation key (X-Hermes-Session-Key / build_session_key) -- is per-CHAT and outlives any single conversation on it, so the prompt-cache -- affinity scope derived from it must be qualified by which conversation is -- currently live. Deriving that from the session rows themselves -- (COUNT/MAX over _RESET_END_REASONS boundaries) cannot prove non-reuse: -- delete_session() and bulk pruning remove ended rows, so an aggregate can -- return a pair it already emitted and hand a new conversation a retired -- affinity identity. -- -- This counter lives outside prunable session history and only ever -- increments, once per boundary actually written, so a generation can never -- be reused for a peer even if every session row behind it is deleted. -- -- These rows are deliberately NEVER garbage-collected, including when every -- session row for the peer is gone. Collecting one resets that peer to "no -- generation", so its next boundary writes generation = 1 again and re-issues -- a gwk_ scope a retired conversation already used — exactly the ABA this -- table exists to close. Do not add it to delete_session()'s cascade or to any -- prune sweep. One (TEXT, TEXT, INTEGER) row per routing peer is the intended, -- bounded cost. CREATE TABLE IF NOT EXISTS conversation_generations ( source TEXT NOT NULL, session_key TEXT NOT NULL, generation INTEGER NOT NULL DEFAULT 0, PRIMARY KEY (source, session_key) ); -- Per-backend liveness heartbeat (#94895). Each serve / tui_gateway process -- registers a row at startup and refreshes ``last_heartbeat`` periodically. -- The startup orphan sweep (sessions.startup_orphan_reap) consults this -- table to avoid reaping rows whose owning backend is still alive but -- just idle (multi-backend state.db shared by isolated serve processes). -- A backend whose ``last_heartbeat`` is older than the heartbeat staleness -- window is treated as dead; rows without ANY matching heartbeat fall back -- to the original staleness predicate so legacy deployments keep working. CREATE TABLE IF NOT EXISTS gateway_heartbeats ( backend_id TEXT PRIMARY KEY, pid INTEGER NOT NULL, started_at REAL NOT NULL, last_heartbeat REAL NOT NULL, profile TEXT NOT NULL DEFAULT '', host TEXT NOT NULL DEFAULT '' ); CREATE TABLE IF NOT EXISTS compression_locks ( session_id TEXT PRIMARY KEY, holder TEXT NOT NULL, acquired_at REAL NOT NULL, expires_at REAL NOT NULL ); CREATE TABLE IF NOT EXISTS session_turn_leases ( conversation_id TEXT PRIMARY KEY, holder TEXT NOT NULL, acquired_at REAL NOT NULL, expires_at REAL NOT NULL ); CREATE TABLE IF NOT EXISTS async_delegations ( delegation_id TEXT PRIMARY KEY, origin_session TEXT NOT NULL, origin_ui_session_id TEXT NOT NULL DEFAULT '', parent_session_id TEXT, state TEXT NOT NULL, dispatched_at REAL NOT NULL, completed_at REAL, updated_at REAL NOT NULL, event_json TEXT, result_json TEXT, delivery_state TEXT NOT NULL DEFAULT 'pending', delivery_attempts INTEGER NOT NULL DEFAULT 0, delivered_at REAL, owner_pid INTEGER, owner_started_at INTEGER, task_json TEXT, delivery_claim TEXT, delivery_claimed_at REAL, -- Mirrors the delegation tool's own CREATE TABLE (tools/async_delegation.py -- _initialize_schema). Keeping the canonical fresh-install shape identical -- to the tool's avoids a silent schema drift: the tool's lazy -- ALTER TABLE ADD COLUMN used to be the only source of this column, so two -- databases at the same schema_version had different -- async_delegations shapes depending on whether the delegation tool had -- ever run, breaking rebuild/replay pipelines that reconstruct state.db -- from the canonical schema (#94691). origin_session_id TEXT NOT NULL DEFAULT '' ); CREATE INDEX IF NOT EXISTS idx_sessions_source ON sessions(source); CREATE INDEX IF NOT EXISTS idx_sessions_source_id ON sessions(source, id); CREATE INDEX IF NOT EXISTS idx_sessions_parent ON sessions(parent_session_id); CREATE INDEX IF NOT EXISTS idx_sessions_started ON sessions(started_at DESC); CREATE INDEX IF NOT EXISTS idx_messages_session ON messages(session_id, timestamp); CREATE INDEX IF NOT EXISTS idx_messages_session_id ON messages(session_id, id); -- Partial index for the Insights assistant tool-call scan -- (agent/insights.py _get_tool_usage / _get_skill_usage): those queries filter -- messages by role='assistant' AND tool_calls IS NOT NULL, a small fraction of -- rows on a large state.db. role and tool_calls are base columns, so this can -- live in SCHEMA_SQL rather than DEFERRED_INDEX_SQL. CREATE INDEX IF NOT EXISTS idx_messages_assistant_calls_by_session ON messages(session_id) WHERE role = 'assistant' AND tool_calls IS NOT NULL; CREATE INDEX IF NOT EXISTS idx_compression_locks_expires ON compression_locks(expires_at); CREATE INDEX IF NOT EXISTS idx_session_turn_leases_expires ON session_turn_leases(expires_at); CREATE INDEX IF NOT EXISTS idx_session_model_usage_session ON session_model_usage(session_id); CREATE INDEX IF NOT EXISTS idx_session_model_usage_model ON session_model_usage(model); CREATE INDEX IF NOT EXISTS idx_async_delegations_delivery ON async_delegations(delivery_state, completed_at); a CREATE INDEX IF NOT EXISTS idx_messages_session_active ON messages(session_id, active, timestamp); CREATE INDEX IF NOT EXISTS idx_messages_display_page ON messages(session_id, display_order, active DESC, id DESC) WHERE active = 1 OR compacted = 1; CREATE INDEX IF NOT EXISTS idx_messages_display_backfill ON messages(session_id) WHERE (display_order IS NULL OR display_identity IS NULL) AND (active = 1 OR compacted = 1); CREATE INDEX IF NOT EXISTS idx_messages_display_identity ON messages(session_id, display_identity, display_order) WHERE display_identity IS NOT NULL AND (active = 1 OR compacted = 1); DROP TRIGGER IF EXISTS messages_display_order_insert; CREATE TRIGGER IF NOT EXISTS messages_display_order_insert AFTER INSERT ON messages WHEN new.display_order IS NULL BEGIN UPDATE messages SET display_order = COALESCE(( SELECT display_order FROM messages WHERE session_id = new.session_id AND id <> new.id AND (active = 1 OR compacted = 1) AND display_identity = new.display_identity AND display_order IS NOT NULL ORDER BY display_order LIMIT 1 ), new.id) WHERE id = new.id; END; DROP TRIGGER IF EXISTS messages_display_visibility_update; CREATE TRIGGER IF NOT EXISTS messages_display_visibility_update AFTER UPDATE OF active, compacted ON messages WHEN (new.active = 1 OR new.compacted = 1) <> (old.active = 1 OR old.compacted = 1) BEGIN UPDATE messages SET display_order = MIN(new.id, COALESCE(( SELECT display_order FROM messages WHERE session_id = new.session_id AND id <> new.id AND (active = 1 OR compacted = 1) AND display_identity = new.display_identity AND display_order IS NOT NULL ORDER BY display_order LIMIT 1 ), new.id)) WHERE id = new.id AND (new.active = 1 OR new.compacted = 1); UPDATE messages SET display_order = (SELECT display_order FROM messages WHERE id = new.id) WHERE session_id = new.session_id AND id <> new.id AND (active = 1 OR compacted = 1) AND display_identity = new.display_identity AND (new.active = 1 OR new.compacted = 1); UPDATE messages SET display_order = ( SELECT MIN(peer.id) FROM messages AS peer WHERE peer.session_id = old.session_id AND (peer.active = 1 OR peer.compacted = 1) AND peer.display_identity = old.display_identity ) WHERE session_id = old.session_id AND (active = 1 OR compacted = 1) AND display_identity = old.display_identity AND NOT (new.active = 1 OR new.compacted = 1); END; DROP TRIGGER IF EXISTS messages_display_identity_update; CREATE TRIGGER IF NOT EXISTS messages_display_identity_update AFTER UPDATE OF role, content, timestamp, tool_call_id, tool_calls, tool_name, display_kind ON messages WHEN new.role IS NOT old.role OR new.content IS NOT old.content OR new.timestamp IS NOT old.timestamp OR new.tool_call_id IS NOT old.tool_call_id OR new.tool_calls IS NOT old.tool_calls OR new.tool_name IS NOT old.tool_name OR new.display_kind IS NOT old.display_kind BEGIN UPDATE messages SET display_identity = NULL, display_order = NULL WHERE id = new.id OR ( session_id = old.session_id AND display_identity = old.display_identity AND (active = 1 OR compacted = 1) ); END; DROP TRIGGER IF EXISTS messages_display_identity_delete; CREATE TRIGGER IF NOT EXISTS messages_display_identity_delete AFTER DELETE ON messages WHEN old.active = 1 OR old.compacted = 1 BEGIN UPDATE messages SET display_order = ( SELECT MIN(peer.id) FROM messages AS peer WHERE peer.session_id = old.session_id AND (peer.active = 1 OR peer.compacted = 1) AND peer.display_identity = old.display_identity ) WHERE session_id = old.session_id AND (active = 1 OR compacted = 1) AND display_identity = old.display_identity; END; CREATE INDEX IF NOT EXISTS idx_messages_active_null ON messages(active) WHERE active IS NULL; CREATE INDEX IF NOT EXISTS idx_sessions_session_key ON sessions(session_key, started_at DESC); CREATE INDEX IF NOT EXISTS idx_sessions_gateway_peer ON sessions(source, user_id, chat_id, chat_type, thread_id, started_at DESC); CREATE INDEX IF NOT EXISTS idx_sessions_handoff_state ON sessions(handoff_state, started_at); CREATE INDEX IF NOT EXISTS idx_sessions_system_prompt_hash ON sessions(system_prompt_hash); -- Recent-session browsing must never derive recency by scanning messages. -- This expression is the durable, indexable approximation used to preselect -- a small candidate set before compression-chain and preview hydration. CREATE INDEX IF NOT EXISTS idx_sessions_effective_activity ON sessions(COALESCE(last_activity_at, started_at) DESC, started_at DESC); ah -- Stable projection the base word index reads and writes through: the view -- computes EXACTLY what the triggers/backfill insert, so 'rebuild' and the -- integrity checker always agree with the stored index. CREATE VIEW IF NOT EXISTS messages_fts_src AS SELECT id, CASE WHEN role = 'tool' THEN substr(COALESCE(content, ''), 1, a) ELSE content END AS content, tool_name, tool_calls FROM messages; CREATE VIRTUAL TABLE IF NOT EXISTS messages_fts USING fts5( content, tool_name, tool_calls, content='messages_fts_src', content_rowid='id' ); CREATE TRIGGER IF NOT EXISTS messages_fts_insert AFTER INSERT ON messages WHEN (new.id > COALESCE((SELECT CAST(value AS INTEGER) FROM state_meta WHERE key = 'fts_rebuild_high_water'), -1) OR new.id <= COALESCE((SELECT CAST(value AS INTEGER) FROM state_meta WHERE key = 'fts_rebuild_progress'), -1)) BEGIN INSERT INTO messages_fts(rowid, content, tool_name, tool_calls) VALUES ( new.id, a-, new.tool_name, new.tool_calls ); END; CREATE TRIGGER IF NOT EXISTS messages_fts_delete AFTER DELETE ON messages WHEN (old.id > COALESCE((SELECT CAST(value AS INTEGER) FROM state_meta WHERE key = 'fts_rebuild_high_water'), -1) OR old.id <= COALESCE((SELECT CAST(value AS INTEGER) FROM state_meta WHERE key = 'fts_rebuild_progress'), -1)) BEGIN INSERT INTO messages_fts(messages_fts, rowid, content, tool_name, tool_calls) VALUES ( 'delete', old.id, a, old.tool_name, old.tool_calls ); END; -- UPDATE OF skips the trigger entirely for non-content column writes -- (status/compacted/observed/etc.), which is stronger than the WHEN gate -- alone and avoids FTS I/O saturation on large state.db (#68858 / #73639). CREATE TRIGGER IF NOT EXISTS messages_fts_update AFTER UPDATE OF content, tool_name, tool_calls, role ON messages WHEN (old.content IS NOT new.content OR old.tool_name IS NOT new.tool_name OR old.tool_calls IS NOT new.tool_calls OR old.role IS NOT new.role) AND (old.id > COALESCE((SELECT CAST(value AS INTEGER) FROM state_meta WHERE key = 'fts_rebuild_high_water'), -1) OR old.id <= COALESCE((SELECT CAST(value AS INTEGER) FROM state_meta WHERE key = 'fts_rebuild_progress'), -1)) BEGIN INSERT INTO messages_fts(messages_fts, rowid, content, tool_name, tool_calls) VALUES ( 'delete', old.id, z, old.tool_name, old.tool_calls ); INSERT INTO messages_fts(rowid, content, tool_name, tool_calls) VALUES ( new.id, z<, new.tool_name, new.tool_calls ); END; )cronsubagentc|r|dnd}|ddjdtDzdt|dzdd zS) aPredicate over a ``sessions`` row selecting sessions whose rows belong in the trigram index; ``alias`` qualifies every column for joins. Shared by the view, the sync triggers, and the deferred-backfill INSERT ... SELECTs so they can never disagree about the index boundary..rNzsource NOT IN (r0c3(K|] }d|d ywrcrd)rDsrcs rrGz*fts_trigram_session_sql..9sG3auAJGrgz) AND model_configz$._delegate_fromz IS NULL)rHFTS_TRIGRAM_EXCLUDED_SOURCESr3)rvqs rfts_trigram_session_sqlr1s\ 5' "A #_ ))G*FG G H $Q%79KLMX V Wr)z CREATE VIEW IF NOT EXISTS messages_fts_trigram_src AS SELECT m.id, m.role, m.content, m.tool_name FROM messages AS m JOIN sessions AS s ON s.id = m.session_id WHERE m.role <> 'tool' AND a{; CREATE VIRTUAL TABLE IF NOT EXISTS messages_fts_trigram USING fts5( content, tool_name, content='messages_fts_trigram_src', content_rowid='id', tokenize='trigram' ); CREATE TRIGGER IF NOT EXISTS messages_fts_trigram_insert AFTER INSERT ON messages WHEN new.role <> 'tool' AND EXISTS (SELECT 1 FROM sessions WHERE id = new.session_id AND a[) AND (new.id > COALESCE((SELECT CAST(value AS INTEGER) FROM state_meta WHERE key = 'fts_rebuild_high_water'), -1) OR new.id <= COALESCE((SELECT CAST(value AS INTEGER) FROM state_meta WHERE key = 'fts_rebuild_progress'), -1)) BEGIN INSERT INTO messages_fts_trigram(rowid, content, tool_name) VALUES (new.id, new.content, new.tool_name); END; CREATE TRIGGER IF NOT EXISTS messages_fts_trigram_delete AFTER DELETE ON messages WHEN old.role <> 'tool' AND EXISTS (SELECT 1 FROM sessions WHERE id = old.session_id AND a) AND (old.id > COALESCE((SELECT CAST(value AS INTEGER) FROM state_meta WHERE key = 'fts_rebuild_high_water'), -1) OR old.id <= COALESCE((SELECT CAST(value AS INTEGER) FROM state_meta WHERE key = 'fts_rebuild_progress'), -1)) BEGIN INSERT INTO messages_fts_trigram(messages_fts_trigram, rowid, content, tool_name) VALUES ('delete', old.id, old.content, old.tool_name); END; CREATE TRIGGER IF NOT EXISTS messages_fts_trigram_update AFTER UPDATE OF content, tool_name, role ON messages WHEN (old.content IS NOT new.content OR old.tool_name IS NOT new.tool_name OR old.role IS NOT new.role) AND (old.id > COALESCE((SELECT CAST(value AS INTEGER) FROM state_meta WHERE key = 'fts_rebuild_high_water'), -1) OR old.id <= COALESCE((SELECT CAST(value AS INTEGER) FROM state_meta WHERE key = 'fts_rebuild_progress'), -1)) BEGIN INSERT INTO messages_fts_trigram(messages_fts_trigram, rowid, content, tool_name) SELECT 'delete', old.id, old.content, old.tool_name WHERE old.role <> 'tool' AND EXISTS (SELECT 1 FROM sessions WHERE id = old.session_id AND z); INSERT INTO messages_fts_trigram(rowid, content, tool_name) SELECT new.id, new.content, new.tool_name WHERE new.role <> 'tool' AND EXISTS (SELECT 1 FROM sessions WHERE id = new.session_id AND z); END; )messages_fts_cjk_insertmessages_fts_cjk_deletemessages_fts_cjk_update fts_cjk_stale fts_stalefts_rebuild_deferralz CREATE VIRTUAL TABLE IF NOT EXISTS messages_fts USING fts5( content ); CREATE TRIGGER IF NOT EXISTS messages_fts_insert AFTER INSERT ON messages BEGIN INSERT INTO messages_fts(rowid, content) VALUES ( new.id, COALESCE(a, '') || ' ' || COALESCE(new.tool_name, '') || ' ' || COALESCE(new.tool_calls, '') ); END; CREATE TRIGGER IF NOT EXISTS messages_fts_delete AFTER DELETE ON messages BEGIN DELETE FROM messages_fts WHERE rowid = old.id; END; CREATE TRIGGER IF NOT EXISTS messages_fts_update AFTER UPDATE OF content, tool_name, tool_calls, role ON messages BEGIN DELETE FROM messages_fts WHERE rowid = old.id; INSERT INTO messages_fts(rowid, content) VALUES ( new.id, COALESCE(zg, '') || ' ' || COALESCE(new.tool_name, '') || ' ' || COALESCE(new.tool_calls, '') ); END; a$ CREATE VIRTUAL TABLE IF NOT EXISTS messages_fts_trigram USING fts5( content, tokenize='trigram' ); CREATE TRIGGER IF NOT EXISTS messages_fts_trigram_insert AFTER INSERT ON messages BEGIN INSERT INTO messages_fts_trigram(rowid, content) VALUES ( new.id, COALESCE(a, '') || ' ' || COALESCE(new.tool_name, '') || ' ' || COALESCE(new.tool_calls, '') ); END; CREATE TRIGGER IF NOT EXISTS messages_fts_trigram_delete AFTER DELETE ON messages BEGIN DELETE FROM messages_fts_trigram WHERE rowid = old.id; END; CREATE TRIGGER IF NOT EXISTS messages_fts_trigram_update AFTER UPDATE OF content, tool_name, tool_calls, role ON messages BEGIN DELETE FROM messages_fts_trigram WHERE rowid = old.id; INSERT INTO messages_fts_trigram(rowid, content) VALUES ( new.id, COALESCE( hermes_stateg^@g?win32g@exccnt|txs$t|txr|jtvS)zcTrue when *exc* means another process holds the lock; on any other ``OSError`` fail closed at once.)rsBlockingIOErrorrerrno_LOCK_CONTENTION_ERRNOS)rs ris_advisory_lock_contentionrs* c? + r 30H0qSYYZqMqrr)pidc td|dd5}t|jjdddj dcdddS#1swYyxYw#t t tf$rYywxYw)uKernel start time of *pid* (field 22 of ``/proc//stat``; with the PID it identifies a process uniquely). None off Linux or on any failure — callers must treat None as unknowable and FAIL CLOSED.z/proc/z/statrb)rMN)openrreadrsplitrXr ValueError IndexError)rfhs r_proc_start_ticksrs{ F3%u%t , Arwwy''a0399;B?@ A A A Z ,s.A%=A A%A"A%"A%%A<;A<c |jd|jd}|r%tj|j ddnd}t|tr|SdS#t t tf$rYywxYw)z=Best-effort parse of the holder metadata JSON in a lock file.riutf-8r&N) seekrjsonloadsdecoderrUnicodeDecodeErrorrsdict)handlerQrecords r_read_lock_holder_recordrso Akk$?BCJJw :; -6747 Z!3 4sA A!!A87A8payloadctjtt5|j d|j |r|j ||jdddy#1swYyxYw)z8Best-effort truncate-and-write of *payload* at offset 0.rN) contextlibsuppressrrrtruncatewriteflush)rrs r_rewrite_lock_filersT   Wj 1 A  LL !  s AA--A6ctjttjtjd}t |t j |djdy)uGRecord this process as holder (best effort) so timed-out contenders can tell an orphaned-fd holder from a live wedged one. Written under the flock so contenders that time out can tell an orphaned-fd holder (recorded process dead, flock inherited by a forked child — issue #100108) from a live wedged holder. )r start_ticks acquired_atT) sort_keysrN)rgetpidrtimerrdumpsencode)rrs r_write_lock_holder_recordr%sLYY[1B299;1O`d`i`i`k lFvtzz&DAHHQRr)ct|dy)zfErase holder metadata before a normal release: a surviving record means ABNORMAL exit (break allowed).r)N)r)rs r_clear_lock_holder_recordr0s vs#r)c t|d}|dkry t j |d|jd}|yt|}|duxr||k7S#tttf$rYywxYw#t $rYyt$rYywxYw)zTrue ONLY when the recorded holder is provably dead or PID-recycled. Anything indeterminate (no/malformed record, PID owned by another user, /proc unavailable) is False: FAIL CLOSED and defer.rFrTrN) rKeyError TypeErrorrrkillProcessLookupErrorrrr)rrrecorded_ticks current_tickss r_lock_holder_provably_deadr5s&-  ax Q ZZ .N%c*M  $ H.)HH i ,  s(AA1A.-A.1 B<BBc ddl}tj|z}d} |j|j |j |j z t!j*|j t!j,|} } | j.| j.k(xr| j0| j0k(} | rt3|d|fS |j%t'|d}tj|k\rd|fS#ttf$rF}t|s"tjd||||d|fcYd}~Stj|krtj|Yd}~_|r d|fcYd}~St|} t| s d|fcYd}~Stjd||| xsijd t!j"||j%t'|d}n7#t$r+}tjd |||d|fcYd}~cYd}~Sd}~wwxYwd}tjt(z}Yd}~Ad}~wwxYw#t$rd} YwxYw#t$rd|fcYSwxYw) uBounded POSIX flock acquire with orphaned-holder break. Returns ``(acquired, handle)``; *handle* may have been re-opened and the caller closes whichever comes back. *acquired*: True, False (a holder kept the lock past the deadline) or None (non-contention ``OSError``, already logged: treat as not acquired without the held-by-another-process warning). ``flock`` rides the open file DESCRIPTION, which ``fork()`` duplicates, so a holder that forks then dies leaves the lock held forever; when the acquirer is provably dead the file is unlinked and retaken on a fresh inode (the orphan's flock excludes nobody). Every acquire verifies its inode still names *lock_path*, so a racer on a dead inode retries. A holder that forks (multiprocessing worker, daemonized helper) and then dies leaves the flock held by a child that will never release it — the kernel's holder-death release never triggers, and every contender defers forever. Indeterminate liveness always defers (fail closed). See #100108. rNFTuvCould not acquire %s %s (%s) — deferring rather than waiting out the %.0fs holder timeout on a non-contention error.u%s %s is held by an orphaned file descriptor (recorded holder pid %s is dead — a forked child inherited the lock fd); breaking the stale lock and retaking it on a fresh file.ra+bu/Could not break stale %s %s (%s) — deferring.)fcntlr monotonicflockfilenoLOCK_EXLOCK_NBrrrloggerwarningsleeprrrrunlinkcloser_LOCK_BREAK_REACQUIRE_SECONDSfstatrrrr) lock_pathrtimeout_seconds poll_seconds descriptionrdeadline broke_lockrrfd_stat path_stat same_files r_acquire_db_flockrKsB~~/1HJ   KK )F G: !#&--/!:BGGI> x '&= [  ) .s3 a*IsOMV|#~~(* <(f}$-f5F-f5f}$ NN)*5y6 I  !&=  !s7DA,I'I9I$'II$ ,I=II$I!I$'+I1HI H9H4)H9*I.I$4H99 II$' I65I69 J J c4t|trd|vryd}tjtt 5|j d(dtjt|dz dd}dddd |j d|S#1swYxYw) z5Human-readable holder identity for deferral warnings.rz8unknown (no holder record; pre-fix writer or non-Hermes)rNrNz , acquired z.0fzs agozpid ) rsrrrrrrrfloat)rages r_describe_lock_holderrs fd #uF':I C   Y 3V ::m $ 0 eF=4I.J J3OuUCV&**U#$SE **VVs :BBcddl}tj|z} |jd|j |j |j dy#ttf$rf}t|stjd||Yd}~ytj|k\rYd}~ytjtYd}~nd}~wwxYw)zbWindows counterpart of ``_acquire_db_flock`` (no orphan break); same True / False / None contract.rNTrMuSCould not acquire FTS rebuild lock %s (%s) — deferring on a non-contention error.F)msvcrtrrrlockingrLK_NBLCKrrrr r r _FTS_REBUILD_LOCK_POLL_SECONDS)rrtimeoutrrrs r_acquire_msvcrt_lockr$s~~')H  7 KKN NN6==?FOOQ ?) 7.s3t(#/~~8+ JJ5 6 6 7 s#5 J>J J J0J--J00J3)rz)rztuple[int, int] | None)rN)rN)__doc__rrrloggingrsysrtypingragent.skill_commandsrrragent.context_compressorrrr r r TITLE_SOURCE_DERIVEDTITLE_SOURCE_LLMTITLE_SOURCE_USER_PREVIEW_HEAD_CHARS_PREVIEW_SCAFFOLD_WINDOWrYrVrr(_PREVIEW_CONTENT_SQL_PREVIEW_SCAFFOLDED_SQLr6r,r3r8r:tuplerIrLrX_PREVIEW_LONG_FORM_PREFIX_PREVIEW_SUMMARY_PREFIXES_PREVIEW_STANDALONE_SUMMARY_SQL_PREVIEW_MERGED_AFTER_SQL_PREVIEW_MERGED_SUMMARY_SQL_PREVIEW_MERGED_PRIOR_SQL"_PREVIEW_MERGED_PRIOR_LTRIMMED_SQLrC#_PREVIEW_MERGED_PRIOR_UNWRAPPED_SQL!_PREVIEW_FORCE_USER_REMAINDER_SQL_PREVIEW_ELIGIBLE_SQLrH_PREVIEW_RAW_SELECTr[_PREVIEW_RAW_SUBQUERY_SQLr~r_RESET_END_REASONS_RESET_END_REASONS_SQL frozenset_BOUNDARY_END_REASONS_RECOVERABLE_END_REASONS_RECOVERABLE_END_REASONS_SQLrtboolruryrr_LISTABLE_CHILD_SQLrrrrSCHEMA_VERSIONAUTO_VACUUM_MIN_FREELIST_RATIOFTS_STORAGE_VERSIONrr_FTS_NEW_INDEXED_CONTENT_SQL_FTS_OLD_INDEXED_CONTENT_SQLMAX_FTS5_QUERY_CHARSr_ENDED_ROW_SQL_COMPRESSION_LOCK_ROW_SQLrr _SQL_IN_CHUNKrr _FTS_TRIGGERS SCHEMA_SQLDEFERRED_INDEX_SQLFTS_SQLrrFTS_TRIGRAM_SESSION_SQLFTS_TRIGRAM_SQL_FTS_CJK_TRIGGERSFTS_CJK_STALE_KEY FTS_STALE_KEYFTS_REBUILD_DEFERRAL_KEYLEGACY_FTS_SQLLEGACY_FTS_TRIGRAM_SQL getLoggerr r&r"platformr(rEAGAINEACCES EWOULDBLOCKEDEADLKr BaseExceptionrrrbytesrrrrrrr$contextmanagerr.rdr)rros 4  hh44 ! ##s#s#(NcNcN M,-D,EQG?/s/s/>#>S>S>5c5c54S4S4llc3hlCl ZcZcZ1N00!DQG68MN"2;@Y"Z-.GH!3LAZ4[3\] 68Q R SST V0,\:S-T,UU[\^%:;T%U"):;]:^_ ()*$|J?WZ[?[>\JJ))J*/J0H.HJIOJPcNcJdJ'' J(+ J,D*D JE J % % J &3 J 4H2H J IN J OgijNjMk J l J )) J */ J 0C.C J DI JYYY 11D0EFTTiSj?A**<>PQRS]]0 q"R?Q"RR""45G l $yy(^E](^^##;<@BBHtHj3jSjSj));_MNO  $U,B CD::K:R:RUX:R:Y9Z  " "S " ) *!-nncn sS33_C_#_ YCYCY"& !&%C%C% 8>7>GJcb$bYCY !.&#&n } @]x78U6UV , &&' &&' 0 &&'  &&'YQ V 4 3  23 !8 <= >./F-F G./F-FG102I0IJ1 2I0IJy>@f$ 2//0//0-: //0//0/x   > *$)!!$llg% #!<<u7H7H%--Xs]sts 38$S$ I$I,=!@+S+7& 6:77r)