7f4ce46579
Implements 5 major optimizations to handle 96+ rounds without memory issues: 1. Fix Memory Leak - Added max_rounds_kept limit (20 rounds in memory) - Auto-cleanup old rounds via add_round_summary() - Prevents OOM for long simulations 2. Checkpoint System - Save progress every 10 rounds (configurable) - Resume from last checkpoint if crash - Compressed storage with gzip - Keep max 5 checkpoints per platform 3. Decision Caching - Cache LLM decisions based on agent_id + context hash - 24-hour TTL by default - Reduces API calls by 20-40% - Thread-safe singleton pattern 4. Streaming Progress - Real-time progress via Server-Sent Events (SSE) - Broadcast round_complete, simulation_complete events - Better UX - no more 'stuck' perception - Easy client integration with EventSource 5. Batch Processing - Process agents in batches (10 per batch) - Memory cleanup between batches - Per-batch error handling - Cancellation support Expected improvements: - Memory usage: 60-75% reduction (1-2GB -> 300-500MB) - API calls: 20-40% reduction with caching - Resume capability: Checkpoint every 10 rounds - Real-time progress: SSE streaming New files: - backend/app/services/checkpoint_manager.py - backend/app/services/decision_cache.py - backend/app/services/batch_processor.py - backend/app/api/streaming.py - backend/scripts/run_optimized_twitter_simulation.py - OPTIMIZATION_GUIDE.md Modified files: - backend/app/services/simulation_runner.py - backend/app/services/__init__.py |
||
|---|---|---|
| .. | ||
| action_logger.py | ||
| run_optimized_twitter_simulation.py | ||
| run_parallel_simulation.py | ||
| run_reddit_simulation.py | ||
| run_twitter_simulation.py | ||
| test_profile_format.py | ||