hermes-agent/tests
Teknium 4a15d26801
Port from block/buzz#4959: classify transport timeouts distinctly in API error summaries
httpx timeout exceptions (ReadTimeout/ConnectTimeout/PoolTimeout/WriteTimeout)
stringify to an EMPTY string, so when one survived the retry loop the user saw
'API call failed after 6 retries: ' with nothing after the colon — a TLS
abort, a reset connection, and a deterministic read-timeout fire were all
indistinguishable (and invisible).

Ported Buzz's pure timeout_message classifier (crates/buzz-agent/src/llm.rs,
block/buzz#4959) to hermes-agent:

- agent/timeout_error_summary.py: pure classifier over the exception type —
  connect-phase timeouts ('no connection established, check base_url') vs
  read-phase timeouts ('no response received within <N>s — consider raising
  providers.<provider>.request_timeout_seconds in ~/.hermes/config.yaml'),
  embedding the configured timeout value (per-model/per-provider config
  first, HERMES_API_TIMEOUT fallback) and the exact config knob.
- run_agent.py: _summarize_api_error() checks the timeout classifier first
  (all later branches produce blank output for message-less exceptions);
  gains optional provider/model kwargs, backward compatible.
- agent/conversation_loop.py: the three retry-loop summary sites pass
  provider/model context.

Tests: 12 new (pure classifier + AIAgent integration + empty-str
precondition pin). Sabotage-verified: disabling the classifier fails the
regression tests with the historical blank summary (assert '').
2026-08-06 23:59:15 -07:00
..
acp fix(approval): classify CLI/TUI approval timeouts separately from explicit denials 2026-08-02 20:21:59 -07:00
acp_adapter
agent Port from block/buzz#4959: classify transport timeouts distinctly in API error summaries 2026-08-06 23:59:15 -07:00
ci
cli fix(cli): persist YOLO mode across --resume 2026-08-02 20:30:06 -07:00
computer_use
conformance
cron fix(cron): thread per-run prompt through cronjob(action='run') (#57331) 2026-08-06 23:14:55 -07:00
dashboard
docker
e2e
fakes
fixtures
gateway fix(api): persist session pins instead of 400ing them 2026-08-06 21:10:54 -05:00
hermes_cli fix(dashboard): derive the stale-schema read probe from SCHEMA_SQL 2026-08-07 00:41:58 -04:00
hermes_state
honcho_plugin
install
integration fix: remove dead f-string prefixes via ruff F541 (216 sites) (#52336) 2026-07-05 13:42:46 -07:00
manual
monitoring
openviking_plugin
plugins
providers
run_agent Merge pull request #80770 from NousResearch/bb/desktop-session-integrity 2026-08-06 22:12:22 -06:00
scripts
secret_sources
skills
state
stress fix: remove dead f-string prefixes via ruff F541 (216 sites) (#52336) 2026-07-05 13:42:46 -07:00
tools fix(cron): thread per-run prompt through cronjob(action='run') (#57331) 2026-08-06 23:14:55 -07:00
tui_gateway
website
__init__.py
conftest.py
run_interrupt_test.py
test_account_usage.py
test_atomic_replace_symlinks.py
test_atomic_write_text_metadata.py
test_audio_playback_guard.py
test_background_review_list_shapes.py
test_background_review_session_isolation.py
test_base_url_hostname.py
test_batch_runner_checkpoint.py
test_batch_runner_durability.py
test_bitwarden_secrets.py
test_cli_manual_compress.py
test_cli_skin_integration.py
test_code_skew.py
test_command_secret_source.py
test_conftest_wal_gate.py
test_copilot_initiator.py
test_credential_file_permissions.py
test_ctx_halving_fix.py
test_delegate_cascade_49148.py
test_dispatch_session_id.py
test_empty_model_fallback.py
test_empty_session_hygiene.py
test_engines_satisfiable.py
test_env_loader_applied_homes.py
test_env_loader_op_bootstrap.py
test_env_loader_secret_sources.py
test_evidence_store.py
test_fast_safe_load.py
test_fts_cjk_bigram.py
test_fts_update_of_narrowing.py
test_gateway_streaming_nested_config.py
test_get_tool_definitions_cache_isolation.py
test_hermes_bootstrap.py
test_hermes_constants.py
test_hermes_home_profile_warning.py
test_hermes_logging.py
test_hermes_state.py
test_hermes_state_compression_busy_retry.py
test_hermes_state_compression_locks.py
test_hermes_state_readonly_preflight.py
test_hermes_state_wal_fallback.py
test_hermetic_side_effect_guards.py
test_honcho_client_concurrency.py
test_honcho_client_config.py
test_honcho_session_context.py
test_honcho_startup_fail_open.py
test_install_autostash_conflict_recovery.py
test_install_commit_pin_rollback.py
test_install_diverged_update.py
test_install_lockfile_churn.py
test_install_macos_launcher.py
test_install_no_initial_commit.py
test_install_ps1_ascii_only.py
test_install_ps1_native_stderr_eap.py
test_install_ps1_node_path_for_npm.py
test_install_ps1_python_fallback_venv.py
test_install_ps1_uv_powershell_host.py
test_install_ps1_web_server_syntax_probe.py
test_install_sh_acp_launcher.py
test_install_sh_bootstrap_marker.py
test_install_sh_browser_install.py
test_install_sh_install_method_stamp.py
test_install_sh_node_global_prefix.py
test_install_sh_pythonpath_sanitization.py
test_install_sh_root_fhs_uv_python_path.py
test_install_sh_setup_wizard_tty_probe.py
test_install_sh_symlink_stomp.py
test_install_sh_termux_network_prereqs.py
test_install_unmerged_index.py
test_ipv4_preference.py
test_iron_proxy.py
test_iron_proxy_cli.py
test_iron_proxy_e2e.py
test_journal_mode_config.py
test_lazy_session_regressions.py
test_live_system_guard.py test(tui_gateway): make the tui gateway suite order-independent 2026-07-29 21:30:53 -07:00
test_live_system_guard_self_test.py
test_log_isolation.py
test_managed_runtime_resolution.py
test_mcp_serve.py
test_message_reactions.py
test_mini_swe_runner.py
test_minimax_model_validation.py
test_minimax_oauth.py
test_minisweagent_path.py
test_model_forces_max_completion_tokens.py
test_model_picker_scroll.py
test_model_tools.py
test_model_tools_async_bridge.py
test_no_shadowed_test_definitions.py
test_ollama_num_ctx.py
test_onepassword_secrets.py
test_output_cap_parsing.py
test_packaging_build_guard.py
test_packaging_metadata.py
test_plugin_skills.py
test_plugin_utils.py
test_process_loop_event_loop_warning.py
test_profile_isolation_runtime.py
test_project_metadata.py
test_pty_keepalive_ws.py
test_pty_session.py
test_retry_utils.py
test_run_tests_parallel.py
test_run_tests_parallel_stdio.py
test_sanitize_tool_error.py
test_schema_read_probe.py
test_search_slow_query_log.py
test_secret_scope_plugin_families.py
test_session_db_read_path_split.py
test_session_skill_previews.py
test_session_system_prompt_dedup.py
test_session_vacuum_config.py
test_session_workspace_binding.py
test_slack_thread_require_mention.py
test_slash_worker_watchdog.py
test_sql_injection.py
test_sqlite_lock_safe_inspection.py
test_sqlite_wal_reset_gate.py
test_stale_tool_call_marker_session_repair.py
test_stale_utils_module_import.py
test_state_db_malformed_repair.py
test_subprocess_home_isolation.py
test_telegram_polling_progress_ptb.py
test_termux_all_extra_compat.py
test_timezone.py
test_tini_shim.py
test_toolset_distributions.py
test_toolsets.py
test_trajectory_compressor.py
test_trajectory_compressor_async.py
test_transform_llm_output_hook.py
test_transform_tool_result_hook.py
test_tui_entry_mcp_owner.py
test_tui_gateway_loop_noise.py
test_tui_gateway_queue_on_busy.py
test_tui_gateway_server.py
test_tui_gateway_server_crash_history.py
test_tui_gateway_ws.py
test_tui_mcp_late_refresh.py
test_utils_truthy_values.py
test_voice_max_recording_seconds.py
test_wal_checkpoint_strategy.py fix(state): use PASSIVE checkpoint for periodic WAL flush to prevent B-tree corruption 2026-07-15 04:55:46 -07:00
test_web_server.py
test_web_server_sessiondb_eventloop.py
test_web_server_status_topology_cache.py
test_windows_subprocess_no_window_flags.py
test_yaml_indent_consistency_31999.py
test_yuanbao_integration.py
test_yuanbao_markdown.py
test_yuanbao_pipeline.py
test_yuanbao_proto.py
test_yuanbao_reconnect_set_active.py
test_yuanbao_shutdown.py
test_zeroed_state_db.py