hermes-agent/tests/hermes_cli
Teknium 543d305bbb
feat(moa): add reference_max_tokens to cap advisor output and cut turn latency (#56756)
MoA per-turn latency is dominated by advisor GENERATION: turn wall time
correlates ~0.88 with output tokens and ~-0.03 with input tokens (measured over
52 turns). Each turn waits for the slowest advisor to finish writing, and
advisors were uncapped — writing multi-thousand-token essays the aggregator
only needs the gist of.

Add an opt-in per-preset reference_max_tokens knob (mirrors reference_temperature)
that caps ADVISOR output only; the acting aggregator is never capped. Default
None = uncapped, so existing presets are byte-for-byte unchanged (no regression).
Wired through both MoA execution paths (MoAChatCompletions.create and
aggregate_moa_context).

E2E: same task, closed preset uncapped vs reference_max_tokens=600 -> 59s to 33s
(~44% faster), final answer identical/correct.

- hermes_cli/moa_config.py: _coerce_int_or_none helper + reference_max_tokens
  in _normalize_preset/_default_preset/flattened view
- agent/moa_loop.py: read preset.reference_max_tokens, pass to reference fan-out
- agent/conversation_loop.py: pass reference_max_tokens on the per-turn path
- tests + docs
2026-07-02 00:16:35 -07:00
..
__init__.py
…
conftest.py
…
conftest_dashboard_auth.py
…
test_active_sessions.py test: make active session cross-process race deterministic (#54248) 2026-06-28 05:49:21 -07:00
test_anthropic_model_flow_stale_oauth.py
…
test_anthropic_oauth_flow.py
…
test_anthropic_oauth_routes_to_messages_api.py test(runtime): pin Anthropic OAuth → /v1/messages routing across runtime branches 2026-07-01 02:18:56 -07:00
test_anthropic_picker_curated.py
…
test_anthropic_provider_persistence.py
…
test_api_key_providers.py fix: normalize lmstudio base urls 2026-06-28 20:46:44 -07:00
test_apply_model_switch_result_context.py
…
test_apply_profile_override.py
…
test_arcee_provider.py
…
test_argparse_flag_propagation.py
…
test_at_context_completion_filter.py
…
test_atomic_json_write.py
…
test_atomic_yaml_write.py
…
test_auth_codex_provider.py
…
test_auth_codex_self_heal.py
…
test_auth_commands.py test(copilot): update stale get_copilot_api_token mock to tuple signature 2026-06-30 03:27:41 -07:00
test_auth_loopback_ssh_hint.py
…
test_auth_manual_paste.py
…
test_auth_nous_provider.py fix(auth): widen portal_base_url allowlist guard to runtime credential path 2026-07-01 04:57:40 -07:00
test_auth_profile_fallback.py
…
test_auth_provider_gate.py
…
test_auth_qwen_provider.py
…
test_auth_ssl_macos.py
…
test_auth_toctou_file_modes.py
…
test_auth_usable_secret.py
…
test_auth_xai_oauth_provider.py
…
test_aux_config.py
…
test_azure_detect.py
…
test_azure_foundry_entra.py
…
test_backup.py
…
test_banner.py
…
test_banner_git_state.py
…
test_banner_pip_update.py
…
test_banner_skills.py
…
test_bedrock_model_picker.py
…
test_billing_cli.py
…
test_billing_portal_url.py
…
test_billing_scope_stepup.py
…
test_build_info.py
…
test_bundles.py
…
test_chat_skills_flag.py
…
test_claw.py revert(windows): roll back terminal-popup PRs #53791 #53810 #53829 (#53853) 2026-06-27 15:59:00 -07:00
test_clear_stale_base_url.py
…
test_cli_active_session_limit.py
…
test_cli_output.py
…
test_cmd_update.py
…
test_cmd_update_docker.py
…
test_coalesce_session_args.py
…
test_codex_cli_model_picker.py
…
test_codex_models.py
…
test_codex_runtime_plugin_migration.py
…
test_codex_runtime_switch.py fix(codex-runtime): re-running /codex-runtime codex_app_server when already enabled now triggers migration 2026-07-01 23:51:54 +05:30
test_commands.py
…
test_completion.py
…
test_config.py fix(cli): stop .env sanitizer from splitting secrets that embed a known KEY= 2026-07-01 01:50:32 -07:00
test_config_drift.py
…
test_config_env_expansion.py
…
test_config_env_refs.py
…
test_config_validation.py
…
test_container_aware_cli.py
…
test_container_boot.py fix(container-boot): also autostart a gateway stranded in 'degraded' 2026-06-29 21:12:36 -07:00
test_context_switch_guard.py
…
test_copilot_auth.py
…
test_copilot_catalog_oauth_fallback.py
…
test_copilot_context.py
…
test_copilot_in_model_list.py
…
test_copilot_token_exchange.py fix(copilot): switch to VS Code client ID and derive enterprise base URL 2026-06-30 03:27:41 -07:00
test_cron.py fix(cron): null-safe deliver in cron list + re-resolve BSM secrets per run 2026-07-01 01:05:33 -07:00
test_cron_fire_dashboard.py
…
test_cron_parser_builder.py
…
test_ctrlg_editor_submit.py
…
test_curator_archive_prune.py
…
test_curator_recent_run_notice.py
…
test_curator_run.py
…
test_curator_status.py
…
test_curses_arrow_keys.py
…
test_curses_color_compat.py
…
test_curses_ui_fuzzy_rank.py
…
test_curses_ui_search.py
…
test_custom_provider_context_length.py
…
test_custom_provider_identity.py
…
test_custom_provider_model_switch.py
…
test_custom_provider_tls.py fix(agent): honor custom CA certs on aux client + harden TLS resolution 2026-07-02 04:51:56 +05:30
test_dashboard_admin_endpoints.py
…
test_dashboard_auth_401_reauth.py feat(dashboard): auto-initiate portal SSO redirect on unauthenticated load 2026-06-29 04:25:18 -07:00
test_dashboard_auth_audit.py
…
test_dashboard_auth_cookies.py
…
test_dashboard_auth_gate.py
…
test_dashboard_auth_middleware.py feat(dashboard): auto-initiate portal SSO redirect on unauthenticated load 2026-06-29 04:25:18 -07:00
test_dashboard_auth_password_login.py
…
test_dashboard_auth_plugin_hook.py
…
test_dashboard_auth_prefix.py feat(dashboard): auto-initiate portal SSO redirect on unauthenticated load 2026-06-29 04:25:18 -07:00
test_dashboard_auth_provider_base.py
…
test_dashboard_auth_status_endpoint.py
…
test_dashboard_auth_stub_provider.py
…
test_dashboard_auth_ws_auth.py
…
test_dashboard_auth_ws_tickets.py
…
test_dashboard_browser_safe_imports.py
…
test_dashboard_lifecycle_flags.py
…
test_dashboard_profiles_nav_label.py
…
test_dashboard_register.py
…
test_dashboard_token_auth.py
…
test_dashboard_tui_backcompat.py
…
test_dashboard_unified_launch.py
…
test_debug.py fix(security): require explicit consent before uploading debug logs 2026-07-01 00:38:17 -07:00
test_default_interface_resolution.py
…
test_dep_ensure.py
…
test_deprecated_cwd_warning.py
…
test_destructive_slash_confirm_gate.py
…
test_detect_api_mode_for_url.py test(provider): pin api.anthropic.com → anthropic_messages URL detection 2026-07-01 02:18:56 -07:00
test_determine_api_mode_hostname.py
…
test_diagnostics_upload.py feat(debug): drop dead confirm step from --nous upload (stateless NAS) 2026-06-30 17:29:23 -07:00
test_dingtalk_auth.py
…
test_discord_skill_clamp_warning.py
…
test_doctor.py fix(doctor): ignore disabled toolsets in missing-API-key summary 2026-07-01 01:25:43 -07:00
test_doctor_command_install.py
…
test_doctor_dedicated_provider_skip.py
…
test_dump_git_commit.py
…
test_dump_terminal_backend.py
…
test_ensure_hermes_home_uid_34107.py
…
test_ensure_utf8_locale.py
…
test_env_custom_keys.py feat(dashboard): list & add arbitrary custom .env keys on the Keys page 2026-06-28 22:53:56 -07:00
test_env_export_prefix.py test: cover export-prefix stripping in .env parsers (PR #6659) 2026-06-28 18:53:00 -07:00
test_env_load_cache.py
…
test_env_loader.py
…
test_env_sanitize_on_load.py
…
test_fallback_cmd.py
…
test_gateway.py fix(gateway): bypass legacy-unit prompt in non-TTY systemd install 2026-06-28 04:09:54 -07:00
test_gateway_linger.py
…
test_gateway_platform_gating.py
…
test_gateway_proc_fallback.py
…
test_gateway_restart_loop.py fix(gateway,cron): guard cron model-tool path + add auto-resume loop breaker (#30719) 2026-07-01 02:48:36 -07:00
test_gateway_runtime_health.py
…
test_gateway_s6_dispatch.py
…
test_gateway_service.py test(gateway): regression for multi-profile node symlink leak; AUTHOR_MAP 2026-07-01 04:57:21 -07:00
test_gateway_service_paths.py
…
test_gateway_windows.py revert(windows): roll back terminal-popup PRs #53791 #53810 #53829 (#53853) 2026-06-27 15:59:00 -07:00
test_gateway_wsl.py
…
test_gemini_free_tier_setup_block.py
…
test_gemini_provider.py
…
test_gmi_provider.py test(gmi): stub profile fetch_models in static-fallback test 2026-06-28 18:05:28 -05:00
test_goals.py
…
test_graphical_browser_detection.py
…
test_gui_command.py feat(desktop): config-driven Electron launch flags + GPU policy 2026-06-27 22:26:43 -07:00
test_gui_uninstall.py
…
test_hooks_cli.py
…
test_ignore_user_config_flags.py
…
test_image_gen_picker.py
…
test_install_cua_driver.py
…
test_inventory.py
…
test_inventory_pricing.py
…
test_journey_render.py fix(cli): render /journey color instead of leaking raw ANSI 2026-07-01 16:25:48 -05:00
test_kanban_block_kinds.py
…
test_kanban_blocked_sticky.py
…
test_kanban_boards.py
…
test_kanban_cli.py
…
test_kanban_cli_dispatch_passthrough.py
…
test_kanban_core_functionality.py feat(kanban): stamp handoff freshness so workers don't read stale state as current (#53973) 2026-06-27 21:21:54 -07:00
test_kanban_db.py
…
test_kanban_db_init.py
…
test_kanban_decompose.py
…
test_kanban_decompose_db.py
…
test_kanban_default_assignee.py
…
test_kanban_diagnostics.py
…
test_kanban_dispatch_lock.py
…
test_kanban_goal_mode.py
…
test_kanban_init_lock_bounded.py
…
test_kanban_lifecycle_hooks.py
…
test_kanban_notify.py
…
test_kanban_per_profile_cap.py
…
test_kanban_project_link.py
…
test_kanban_promote.py
…
test_kanban_reclaim_claim_lock_guard.py
…
test_kanban_specify.py
…
test_kanban_specify_db.py
…
test_kanban_swarm.py
…
test_kanban_worker_image_extraction.py
…
test_kanban_worker_spawn_toolsets.py
…
test_kanban_worker_terminal_cwd.py
…
test_kanban_write_txn_busy_retry.py fix(kanban): retry write_txn on transient SQLITE_BUSY 2026-06-28 02:44:04 -07:00
test_launcher.py
…
test_list_picker_providers.py
…
test_logs.py
…
test_managed_installs.py
…
test_managed_scope.py
…
test_managed_scope_cli_config.py
…
test_managed_scope_config.py
…
test_managed_scope_env.py
…
test_managed_scope_loaders.py
…
test_managed_scope_overlay.py
…
test_managed_scope_regression.py
…
test_managed_scope_surfacing.py
…
test_managed_scope_writeguard.py
…
test_managed_uv.py
…
test_mcp_add_command_dest.py
…
test_mcp_catalog.py
…
test_mcp_config.py
…
test_mcp_reload_confirm_gate.py
…
test_mcp_security.py
…
test_mcp_startup.py
…
test_mcp_tools_config.py
…
test_memory_providers.py
…
test_memory_reset.py
…
test_memory_setup.py
…
test_memory_setup_provider_arg.py
…
test_migrate_xai.py
…
test_moa_config.py feat(moa): add reference_max_tokens to cap advisor output and cut turn latency (#56756) 2026-07-02 00:16:35 -07:00
test_model_catalog.py
…
test_model_cost_guard.py
…
test_model_normalize.py
…
test_model_picker_expensive_confirm.py
…
test_model_picker_viewport.py
…
test_model_provider_persistence.py
…
test_model_switch_configured_provider_routing.py
…
test_model_switch_context_display.py
…
test_model_switch_copilot_api_mode.py
…
test_model_switch_custom_providers.py fix: propagate key_env from custom_providers into ProviderDef 2026-06-29 02:25:48 -07:00
test_model_switch_opencode_anthropic.py
…
test_model_switch_persist_default.py
…
test_model_switch_variant_tags.py
…
test_model_validation.py fix: normalize lmstudio base urls 2026-06-28 20:46:44 -07:00
test_models.py
…
test_models_dev_preferred_merge.py fix(models): scope live-first picker merge to opencode aggregators only 2026-06-27 21:23:25 -07:00
test_non_ascii_credential.py
…
test_nous_account.py
…
test_nous_auth_keepalive.py
…
test_nous_auth_status_cache.py
…
test_nous_hermes_non_agentic.py
…
test_nous_inference_url_validation.py test(auth): mock new source-aware Nous state read boundary 2026-07-01 05:06:00 -07:00
test_nous_portal_staging_allowlist.py fix(auth): make HERMES_PORTAL_BASE_URL/NOUS_PORTAL_BASE_URL bypass the Portal host allowlist (#56864) 2026-07-02 06:52:46 +00:00
test_nous_subscription.py
…
test_ollama_cloud_auth.py
…
test_ollama_cloud_provider.py
…
test_openai_codex_model_validation_fallback.py
…
test_openai_picker_curated.py
…
test_opencode_go_flat_namespace.py
…
test_opencode_go_in_model_list.py
…
test_opencode_go_validation_fallback.py
…
test_opencode_zen_model_limit.py fix(models): live-first merge + update opencode-zen catalog + uncap aggregator picker 2026-06-27 21:23:25 -07:00
test_overlay_slug_resolution.py
…
test_path_completion.py
…
test_pet_toggle.py
…
test_picker_prewarm.py
…
test_pin_kanban_board_env.py
…
test_pip_install_detection.py
…
test_placeholder_usage.py
…
test_plugin_auxiliary_tasks.py
…
test_plugin_cli_registration.py
…
test_plugin_runtime_disable_gate.py fix(dashboard): run plugin gate after auth + enable example fixture 2026-07-01 04:05:15 -07:00
test_plugin_scanner_recursion.py
…
test_plugins.py fix(security): bind tool_override authorization to handler's defining plugin module 2026-06-30 04:00:42 -07:00
test_plugins_cmd.py
…
test_plugins_cmd_category_discovery.py
…
test_plugins_cmd_enable_disable_nested.py feat(plugins): enable-time consent prompt for tool_override grant 2026-06-30 04:00:42 -07:00
test_plugins_cmd_list.py
…
test_plugins_transcription_registration.py
…
test_plugins_tts_registration.py
…
test_post_setup_gating.py
…
test_profile_describer.py
…
test_profile_distribution.py
…
test_profile_export_credentials.py
…
test_profiles.py fix(profiles): validate custom alias names to prevent path traversal 2026-06-28 18:53:33 -07:00
test_profiles_s6_hooks.py
…
test_project_plugin_rce_bypass.py
…
test_projects_cli.py
…
test_projects_db.py
…
test_prompt_api_key.py
…
test_prompt_compose_command.py
…
test_prompt_size.py
…
test_provider_catalog.py
…
test_provider_config_validation.py
…
test_provider_groups.py
…
test_provider_live_curated_merge.py fix(models): scope live-first picker merge to opencode aggregators only 2026-06-27 21:23:25 -07:00
test_provider_parity.py
…
test_provider_precedence.py fix(auth): explicit provider intent beats stale OAuth active_provider (#29285) 2026-06-27 19:49:02 -07:00
test_proxy.py
…
test_psutil_android_extract.py revert(windows): roll back terminal-popup PRs #53791 #53810 #53829 (#53853) 2026-06-27 15:59:00 -07:00
test_pty_bridge.py
…
test_reasoning_effort_menu.py
…
test_reasoning_full_command.py
…
test_redact_config_bridge.py
…
test_regression_16767.py
…
test_relaunch.py
…
test_resolve_last_session.py
…
test_resolve_provider_openrouter_pool.py
…
test_run_with_idle_timeout.py
…
test_runtime_provider_resolution.py fix(runtime): honor NOUS_INFERENCE_BASE_URL across pool/explicit/aux paths 2026-07-01 01:52:06 -07:00
test_safe_mode.py
…
test_secret_prompt.py
…
test_secrets_bitwarden_non_tty.py
…
test_security_advisories.py
…
test_security_audit.py
…
test_security_audit_startup.py
…
test_send_cmd.py
…
test_serve_command.py test(cli): drop pytest dep + use real sentinel handlers in serve test 2026-06-28 23:24:45 -05:00
test_service_manager.py fix(s6): dot-prefix gateway staging dir so svscan ignores it mid-build (#54834) 2026-06-29 21:33:00 +10:00
test_session_browse.py
…
test_session_handoff.py
…
test_session_recap.py
…
test_sessions_delete.py
…
test_set_config_value.py
…
test_setup.py
…
test_setup_agent_settings.py
…
test_setup_blank_slate.py
…
test_setup_hermes_script.py
…
test_setup_irc.py
…
test_setup_matrix_e2ee.py
…
test_setup_menu_curses_migration.py
…
test_setup_model_provider.py
…
test_setup_noninteractive.py
…
test_setup_ollama_cloud_force_refresh.py
…
test_setup_openclaw_migration.py
…
test_setup_prompt_menus.py
…
test_setup_reconfigure.py
…
test_signal_handler_kanban_worker.py
…
test_skills_config.py
…
test_skills_hub.py
…
test_skills_install_flags.py
…
test_skills_skip_confirm.py
…
test_skills_subparser.py
…
test_skin_engine.py
…
test_slack_cli.py fix(slack): subscribe to message.mpim + mpim scopes so group DMs work 2026-06-29 01:02:53 -07:00
test_spotify_auth.py
…
test_startup_plugin_gating.py
…
test_status.py fix(cli): redact status API keys with --all 2026-06-30 04:38:43 -07:00
test_status_model_provider.py
…
test_subcommands_batch.py
…
test_subcommands_followup.py
…
test_subcommands_profile_gateway.py
…
test_subparser_routing_fallback.py
…
test_subprocess_timeouts.py
…
test_suppress_eio_on_interrupt.py
…
test_system_stats_platform.py
…
test_systemd_optional_directives.py
…
test_teams_pipeline_plugin_cli.py
…
test_telegram_managed_bot.py
…
test_tencent_tokenhub_provider.py
…
test_terminal_menu_fallbacks.py
…
test_timeouts.py
…
test_timestamps_command.py
…
test_tips.py
…
test_tool_token_estimation.py
…
test_tools_config.py fix(tools): reconcile agent.disabled_toolsets when a toolset is enabled 2026-06-28 21:59:03 +05:30
test_tools_disable_enable.py
…
test_toolset_validation.py
…
test_tts_picker.py
…
test_tui_bundled.py
…
test_tui_heap_sizing.py
…
test_tui_mouse_residue_suppression.py
…
test_tui_npm_install.py
…
test_tui_resume_flow.py fix(agent,cli): surface empty-body API errors and fail oneshot exit code 2026-06-28 02:05:20 -07:00
test_uninstall_node_symlinks.py
…
test_update_autostash.py
…
test_update_check.py
…
test_update_concurrent_quarantine.py
…
test_update_config_clears_custom_fields.py
…
test_update_hangup_protection.py
…
test_update_interrupted_recovery.py test(cli): cover Windows self-lock recovery guard + cmd-quote its hint 2026-06-28 02:40:37 -07:00
test_update_modified_notice.py
…
test_update_post_pull_syntax_guard.py
…
test_update_stale_dashboard.py
…
test_update_yes_flag.py
…
test_update_zip_atomic_replace.py
…
test_update_zip_symlink_reject.py
…
test_user_providers_model_switch.py
…
test_uv_tool_update.py
…
test_verify_console_scripts.py fix(windows): verify launchers after primary install 2026-06-28 17:02:05 -05:00
test_verify_core_dependencies.py
…
test_vertex_provider.py feat(vertex): add Google Vertex AI provider for Gemini (OAuth2) 2026-07-01 05:25:33 -07:00
test_video_gen_picker.py
…
test_voice_wrapper.py
…
test_web_oauth_dispatch.py
…
test_web_server.py fix(dashboard): run plugin gate after auth + enable example fixture 2026-07-01 04:05:15 -07:00
test_web_server_boot_handshake.py
…
test_web_server_cron_profiles.py
…
test_web_server_files.py
…
test_web_server_fs.py
…
test_web_server_git.py test(web_git): assert default branch invariant, not hardcoded main 2026-06-28 16:29:52 -05:00
test_web_server_host_header.py
…
test_web_server_messaging_profiles.py
…
test_web_server_oauth_write.py
…
test_web_server_profile_unification.py
…
test_web_server_pty_import.py
…
test_web_server_pty_reconnect.py fix(dashboard): reap PTY bridge on child EOF, not only in writer finally (#54190) 2026-06-28 03:58:18 -07:00
test_web_server_session_search.py
…
test_web_server_skill_editor.py
…
test_web_server_skills_profiles.py
…
test_web_ui_build.py
…
test_webhook_cli.py
…
test_whatsapp_cloud_setup.py
…
test_whatsapp_setup_ordering.py
…
test_win_pty_bridge.py
…
test_windows_native_docs.py
…
test_xai_curated_models.py
…
test_xai_model_flow.py
…
test_xai_oauth_pkce_token_exchange.py
…
test_xai_oauth_profile_auth.py
…
test_xai_oauth_refresh.py
…
test_xai_oauth_writethrough.py
…
test_xai_provider_labels.py
…
test_xai_retirement.py
…
test_xiaomi_provider.py
…