Commit Graph

18 Commits

Author SHA1 Message Date
renancloudwalk f35cdb9696
feat(swarm): real bias-fix prompt (gate 13) on GLM-5.2
- Add bias_fixed_prompt (gate 13 calibration): sector-median company = neutral,
  mediocre-but-stable = neutral not bearish, symmetric bull/bear, null = average.
- Wire B screen tier, C, control-BC to bias_fixed; A stays on original screen_prompt
  (correctly fails gate 13 on merit = the CEO's 65%-bearish complaint).
- Fix bias_control NUMERIC_FIELDS to real eligible field names (revenue_ttm, net_income)
  so sector medians actually compute.
- Live evidence (captured, GLM-5.2 over SSH tunnel, 500-co control each):
  control-A (original):  57 bull / 270 bear / 125 neutral  -> diff=0.651 (FAIL, bearish)
  control-BC (fixed):    14 bull /  68 bear / 402 neutral  -> diff=0.659 (FAIL, residual)
  The bias fix cuts bearish share by pushing average -> neutral, but GLM-5.2 still
  emits ~5:1 bear:bull on the directional calls it commits to. Prompt calibration
  cannot fully remove this model-level pessimistic bias -> gate 13 honest blocker.
- bias_control tests updated to new field names (64 pass).
2026-07-16 07:43:37 -03:00
renancloudwalk 7adc361249
feat(swarm): v15 parallel run + gate-25 deepdive SQL + gate-23 token count + gate-8 examples
- tools/parallel_run_v15.sh: run A/B/C/controls concurrently with shared concurrency budget (~152) over the SSH tunnel; ~2.7x faster than sequential
- backend/sql/deepdive_universe.sql: gate-25 Tier-2 top-N-by-market-cap deep-dive universe, deterministic, null-safe
- tests/test_sql_contracts.py: deepdive_universe.sql contract test
- run_tiered_swarm.py: gate-23 record screen_dossier_token_count (B,C)
- backend/scripts/extract_examples.py + tests/test_extract_examples.py: gate-8 curated example extractor (flip/tie-break/opposing roles)
- tools/live_run_v15.sh, make_acceptance_v15.sh: live + acceptance helpers
34 targeted tests pass.
2026-07-16 07:18:52 -03:00
renancloudwalk b0e9138500
feat(swarm): tiered A/B/C stock-opinions tier + gate-19 winner (rubric v15)
- run_tiered_swarm.py: variants A (flat reference), B (tiered: N deep-dive x6
  roles 2-round+gossip + screen 1-round no-gossip, 6000-agent budget), C (pure
  screen 5143 one-per-company), plus bias-control runs; deterministic tier
  assignment (top market-cap + prior-run promotion flags), promotion file,
  per-company consensus tie-break (confidence then agent_id), adversarial
  peer routing, opinion schema score 0-10 / confidence 0-1.
- winner.py: gate-19 winner function — calibration (g13/g20), tiered-quality
  (g18 beat baseline, g21 discrimination r cross-tier no-averaging-confound),
  pick B if it proves quality else C, A never ships.
- adversarial_router.py: opposite-view routing (g14) + plain reinforcing router.
- bias_control.py: synthetic neutral dossiers + McNemar symmetry (g13).
- sql/dossier_screen.sql (8-quarter trend) and dossier_deepdive.sql (strict
  superset + top holders + ownership trend) + contract tests.
- 60 tests pass (dry-run machinery end-to-end; live run is a named checkpoint).
2026-07-16 06:53:02 -03:00
renancloudwalk 1cc7d3d354
feat: add stock swarm throughput benchmark 2026-07-15 12:02:57 -03:00
666ghj 067855f7b5 Add UTF-8 encoding support for Windows in simulation_runner.py and run_parallel_simulation.py to resolve character encoding issues with third-party libraries. 2025-12-26 18:14:57 +08:00
666ghj 78230b7b38 Remove warnings suppression for multiprocessing in run scripts
- Eliminated unnecessary warnings suppression related to multiprocessing resource tracking in `run.py` and `run_parallel_simulation.py`, streamlining the code and reducing potential confusion.
- This change enhances clarity in logging by allowing relevant warnings to be displayed during execution, improving traceability and debugging capabilities.
2025-12-09 00:41:59 +08:00
666ghj 91eb73ae44 Enhance signal handling and suppress warnings in simulation scripts
- Added signal handling to gracefully manage shutdown events across simulation scripts, ensuring proper cleanup of resources.
- Introduced a global shutdown event to allow simulations to respond to termination signals, improving robustness.
- Suppressed warnings related to multiprocessing resource tracking to avoid unnecessary log clutter during execution.
- Updated cleanup logic in `SimulationRunner` and `ZepGraphMemoryManager` to prevent redundant calls and ensure efficient resource management.
- Enhanced logging to provide clearer feedback during shutdown processes, improving traceability.
2025-12-09 00:37:12 +08:00
666ghj 3f750ffda2 Enhance action context enrichment and update activity logging
- Added context enrichment for actions in `fetch_new_actions_from_db`, providing complete information for posts, comments, and user interactions.
- Introduced a new `_enrich_action_context` function to supplement action arguments with relevant details such as post content, author names, and comment information.
- Updated the `ZepGraphMemoryUpdater` to batch send activities by platform, improving efficiency in processing and logging.
- Enhanced logging to include detailed statistics on sent activities and skipped actions, ensuring better traceability and monitoring of the activity flow.
2025-12-08 18:32:23 +08:00
666ghj 1042d50306 Implement Interview feature for agent interactions in simulations
- Added a new Interview module to facilitate interactions with agents post-simulation, allowing for single and batch interviews.
- Introduced IPC communication mechanism for command and response handling between the Flask backend and simulation scripts.
- Updated README.md to include detailed instructions on the new Interview functionality, including API endpoints and usage examples.
- Enhanced simulation scripts to support waiting for commands after completion, improving user control over the simulation environment.
- Implemented error handling and logging for interview processes, ensuring robust operation and traceability.
2025-12-08 15:55:39 +08:00
666ghj 29bff9ca27 Refactor content handling in activity logging and simulation scripts
- Removed content truncation logic from the AgentActivity class, allowing full content to be logged for posts, comments, and quotes.
- Updated the `fetch_new_actions_from_db` function to retain complete content in action arguments, enhancing data accuracy.
- Adjusted simulation scripts to ensure that full content is sent during action creation, improving the representation of agent activities.
2025-12-05 18:30:40 +08:00
666ghj e4761dab06 Enhance action logging in simulation scripts
- Added logging for the start and end of round 0 in both Twitter and Reddit simulations, improving traceability of initial events.
- Updated the logging mechanism to record round end even when no active agents are present, ensuring comprehensive action tracking.
- Introduced initial action count tracking to provide insights into the number of actions taken during the initial phase of simulations.
2025-12-05 16:26:04 +08:00
666ghj 5b4f02f421 Enhance simulation configuration and management features
- Added support for a `max_rounds` parameter in simulation API, allowing users to limit the number of simulation rounds, improving control over simulation duration.
- Updated README.md to reflect the new `max_rounds` parameter and its usage in simulation requests.
- Enhanced error handling for `max_rounds` input validation to ensure it is a positive integer.
- Modified simulation runner and related scripts to incorporate `max_rounds` functionality, ensuring consistent application across Twitter and Reddit simulations.
- Improved logging to indicate when the number of rounds is truncated due to the `max_rounds` setting, enhancing traceability during simulation execution.
2025-12-05 15:50:54 +08:00
666ghj 3c1d554152 Add function to retrieve agent names from configuration
- Introduced `get_agent_names_from_config` function to map agent IDs to their entity names from the simulation configuration, enhancing clarity in action representation.
- Updated simulation scripts to utilize this new function for fetching agent names, ensuring that real entity names are displayed instead of default identifiers.
- Improved handling of agent names by falling back to default names only if not specified in the configuration, maintaining consistency across simulations.
2025-12-04 19:19:16 +08:00
666ghj 39253b3213 Update .env.example and enhance create_model function for dual LLM configuration
- Updated .env.example to include new keys for dual LLM configuration, allowing for both general and boost settings.
- Modified create_model function to support an optional use_boost parameter, enabling the selection of either general or boost LLM configurations based on availability.
- Improved logging to indicate which LLM configuration is being used during model creation, enhancing clarity for users.
2025-12-04 15:51:25 +08:00
666ghj 0302b8fd70 Add MaxTokensWarningFilter to logging and set semaphore for LLM requests
- Introduced MaxTokensWarningFilter to suppress specific warnings related to max_tokens in the logging output across simulation scripts.
- Added a semaphore parameter to limit the maximum concurrent LLM requests in Twitter and Reddit simulation functions, preventing API overload.
- Ensured the filter is applied immediately upon module loading for effective logging management.
2025-12-04 15:00:08 +08:00
666ghj d4fac63eb4 Enhance simulation management and logging features
- Registered a cleanup function for simulation processes to ensure proper termination on server shutdown.
- Improved logging during application startup to confirm the registration of the cleanup function.
- Updated simulation preparation checks to clarify the conditions for considering a simulation ready, enhancing error handling and user feedback.
- Added detailed logging for simulation status changes, improving traceability during the simulation lifecycle.
- Introduced new files for simulation configuration and profile data, supporting enhanced testing and visualization capabilities.
2025-12-02 17:11:47 +08:00
666ghj 3cc5e3f479 Refactor simulation management and enhance logging capabilities
- Updated simulation preparation checks to exclude script files from the required files list, improving clarity on file management.
- Implemented a robust retry mechanism for Zep API calls in the ZepEntityReader service, enhancing reliability.
- Enhanced logging in simulation scripts to provide clearer insights into the simulation process and errors.
- Updated simulation runner to manage stdout and stderr logs more effectively, ensuring better error tracking.
- Improved profile generation to standardize gender fields and ensure all required fields are populated correctly.
2025-12-02 14:25:53 +08:00
666ghj 5f159f6d88 Enhance backend functionality with OASIS simulation features
- Updated README.md to include new simulation scripts and configuration details for OASIS, including API retry mechanisms and environment variable settings.
- Added simulation management and configuration generation services to streamline the simulation process across Twitter and Reddit platforms.
- Introduced new API routes for simulation-related operations, including entity retrieval and simulation status management.
- Implemented a robust retry mechanism for external API calls to improve system stability.
- Enhanced task management model to include detailed progress tracking.
- Added logging capabilities for action tracking during simulations.
- Included new scripts for running parallel simulations and testing profile formats.
2025-12-01 15:03:44 +08:00