092b60520f
feat: stop fetching embedding vectors on vector store query - DEV-1727 ( #682 )
...
* feat: stop fetching embedding vectors on vector store query
* fix: add similar filtering for lancedb
* fix: add lancedb tests
---------
Co-authored-by: Vineeth Voruganti <13438633+VVoruganti@users.noreply.github.com>
2026-05-14 13:14:15 -04:00
5de8a3b81a
fix: use model-aware tokenizer and skip empty messages - DEV-1238 ( #647 )
...
* fix: use model-aware tokenizer and skip empty messages
* fix: change default model
* fix: types
* fix: guard on empty msg content
2026-05-11 17:22:50 -04:00
a4ae372932
fix: internal N+1 query in dialectic agent calls - DEV-1721 ( #652 )
...
* fix: internal N+1 query in dialectic agent calls
* fix: comments
2026-05-06 12:04:29 -04:00
7fae16b351
handle turbopuffer server errors ( #561 )
...
* fix: catch InternalServerError from turbopuffer
* fix: remove unused VectorUpsertResult
* fix: downgrade vector store sync errors to warnings
* fix: remove upsert_with_retry
* fix: (vector) add silent path and explicit path for vector db server errors
---------
Co-authored-by: Vineeth Voruganti <13438633+VVoruganti@users.noreply.github.com>
2026-04-20 16:56:51 -04:00
5b6bd59030
Tighten Transaction Scopes ( #525 )
...
* fix: further remove extraneous transactions
* fix: (search) use 2 phase function to reduce un-needed transaction
* fix: refactor agent search to perform external operations before making a transaction
* fix: reduce scope of queue manager transaction
* fix: (bench) add concurrency to test bench
* fix: address review findings for search dedup, webhook idempotency, and bench throttling
* Fix Leakage in non-session-scoped chat call (#526 )
* fix: (search) reduce scope for peer based searches
* fix: tests
* fix: (test) address coderabbit comment
* fix: drop db param from deliver_webhook
---------
Co-authored-by: Rajat Ahuja <rahuja445@gmail.com>
2026-04-08 11:14:50 -04:00
d803c546f0
fix: (search) add logic to use external vectore store for message search ( #479 )
...
* fix: (search) add logic to use external vectore store for message search
* fix: (search) oversample to reduce duplicate errors
2026-04-02 13:00:54 -04:00
0533c6dd26
fix dialectic held connection ( #477 )
...
* fix: dialectic held connection
* fix: (agent) pre-compute embeddings for agent tools
* fix: (tests) refactor tests to use smaller test db connections
* fix: Embedding client to branch depending on vector store
* fix: reflect dedup-skipped observations in created counts and isolate DB sessions in extract_preferences
* fix: (tests) update tests to match changes
* fix: expunge docs + don't pass in db to query_documents
---------
Co-authored-by: Rajat Ahuja <rahuja445@gmail.com>
2026-04-02 11:13:09 -04:00
33ef0f8eab
perf: add redis caching and reduce embedding API calls ( #372 )
...
* feat: add redis to get collection + get session peer config
* fix: reduce embedding calls
* fix: delete session caches when soft-deleting session
* fix: batch embeddings in create observatiosn tool
* fix: batch embeddings call in extract_preferences
* fix: double embed in fallback for _handle_search_memory
* fix: claude comments
* fix: return ObservationResult
* fix: make cache delete/set retryable. remove session peer config cache
* chore: claude nitpicks
---------
Co-authored-by: Vineeth Voruganti <13438633+VVoruganti@users.noreply.github.com>
2026-02-13 00:53:46 -05:00
c50362d505
fix: N+1 query in search_messages ( #359 )
2026-02-03 10:35:53 -05:00
833a89e70a
Turbopuffer and LanceDB Integration ( #287 )
...
* feat: init turbopuffer and lanceDB
* fix: remove destructive embedding migration
* fix: bug fixes
* fix: LanceDB
* fix: turbopuffer
* fix: search and add create_observations
* fix: use Async clients
* fix: search; protect agaainst failed vector create/delete
* fix: coderabbit comments
* fix: set up compose vector store and reconciliation loop
* feat: sync docs without embeddings
* fix: reduce batch size; comments; types; add indexes for reconciliation
* fix: add message embedding resilience
* fix: clean-up and migration test
* fix: cleanup 2
* fix: centralize retry logic; bump reconciliation batch; use tracked db; fix soft-delete race condition
* fix: skip double query when pgvector is primary
* fix: down migration
* fix: remove hard-delete from critical path and make PgVectorStore deletions a no-op
* fix: use soft-delete pattern for duplicate detection
* fix: steps toward deprecating MessageEmbedding table
* fix: remove composite and pgvector store -> make more specific
* fix: migration order
* fix: shorten reconciliation cycle + fix 'IN' equality check
* fix: coderabbit comments
* fix: add test for migration 7c0d9a4e3b1f
* feat: refactor to use ReconcilerScheduler
* fix: CR / opus comments
* fix: work unit key and reserve system workspace
* fix: make workspace_name nullable
* fix: clean up sync vectors
* fix: delete syntax
* fix: hash namespace
* External Vector Store Nits (#332 )
* fix: Migration naming and long held connection
* chore: Comment for potential debt
* chore: update typescript core package
---------
Co-authored-by: Vineeth Voruganti <13438633+VVoruganti@users.noreply.github.com>
2026-01-16 17:04:01 -05:00
578ef2c665
feat: agentic dreamer and agentic dialectic ( #309 )
...
* feat: add better params to working representation fetch in SDKs, return messages when added
* fix: working representation routes now accepting all parameters properly, with tests
* feat: add metadata/config fields to SDK objects where viable
* fix: tests
* feat: refactor SDKs to use representation config; [TEMP STAINLESS BUILD] update API
* feat: add representation object to sdks
* fix: use stainless sdk on branch
* fix: update TypeScript SDK tsconfig to use node16 module resolution
* fix: add isolatedModules = true to tsconfig
* fix: lol
* chore: coderabbit review
* feat: make delete session real
* feat: add observations routes with delete endpoints for documents. make session deletion real.
* chore: type cleanup
* fix: tests
* chore: coderabbit review
* fix: namespace by workspace
* feat: add ability to customize messages_per_summary at both workspace and session level
* chore: tests for summary config
* chore: coderabbit cleanup
* feat: make session and workspace config totally customizeable
* feat: add search by peer knowledge (#250 )
* feat: search by peer perspective
* fix: enforce workspace in filters, make messages distinct in join
* fix: batch and merge migration steps
* fix: add refresh, add config to workspace, add refresh function, make fields readonly
* fix: search distinct
* fix: merge migrations
* fix: merge migrations
* fix: batch deletions, improve comments, limit consolidate dream to 100 docs at a time, auth on observations routes
* chore: review
* chore: coderabbit
* chore: review
* chore: broken comment
* feat: add set peer card route to API
* feat: create advanced configuration parameters with message>session>workspace hierarchy
* [wip] build unified testing harness
* chore: lint
* fix: cache invalidation, naming things, etc
* feat: longmem tests
* chore: peer config refactor
* feat: consolidate dream working, refactor representation
* fix: Various CR Comment Fixes
* feat: Allow configurable Redis port for harness instances and update cleanup methods to be asynchronous.
* feat: agentic ingestion task!!!
* feat: agentic deriver
* feat: dialectic agent and dreamer agent
* chore: browbeat tests into passing
* fix: nits
* chore: remove old code, update config files
* fix: simplify deriver
* feat: dialectic agent prompt updates, re-introduce non_agent deriver, eval tweaks
* feat: fast deriver, dreamer, then dialectic
* fix: tweaks across the board
* feat: add baseline tests
* feat: truncation in tools and client, tweaks for evals
* feat: add locomo, fix longmem judge!!!
* fix: locomo f1 is trash, use llm judge
* feat: trace creation
* feat: add first draft of obex benchmark, fix embedding model, fix locomo methodology
* fix: locomo session-optimized, better logging of cache usage and better cache usage
* chore: use openrouter for baselines
* fix: add test for merge migration
* chore: opus-powered cleanup
* fix: add config for vllm, better client
* chore: clean up clients.py a bit
* chore: move magic numbers to config, add tests for agent tools
* fix: wrong mock in dialectic tests, make ToolContext a dataclass
* feat: tweak prompts, make deriver explicit-only
* feat: more prompt & tool tweaks
* chore: more tweaks
* feat: dream with subagents
* fix: make dream trigger override scheduled, play around with dream agents
* chore: cleanup deriver
* chore: cleanup dialectic
* chore: cleanup orchestrator
* chore: comment out dream stuff, WIPing
* fix: inc temp on retry, typechecking
* feat: tweak dreaming
* feat: contradiction obs
* Add dream trees
* chore: preserve reasoning_details from openrouter in client
* fix: get_observation_context correct params
* fix: use correct message id in tool
* chore: cleanup longmem runner
* chore: clean up tests, remove dream tests for now as rearchitecting around trees
* chore: update stainless deps
* Update threholding mechanism
* chore: pre-commit hooks whitespace
* chore: clean up types
* feat: add explicit bench
* fix: address additional basepyright issues
* fix: adding logging as a fixture on honcho_llm_call and supporting dialectic loging. (#305 )
* fix: lock on db for tool calls
* chore: clean up experimental derivers
* chore: coderabbit review cleanup
* feat: add streaming support to agentic dialectic
* feat: prometheus token tracking for deriver and dialectic
* fix: self-loops for isolated nodes
* chore: PascalCase for prometheus parameter typing
* feat: add reasoning levels to dialectic agent
* chore: delete old file, add new fake env vars in unittest.yml
* fix: all fields needed for dialectic reasoning level configs
* feat: track dreaming usage in prometheus
* chore: Create backwards compatabile conclusion and queue endpoints
* fix: remove redundant try-catch, add trace label, move .limit to end of statement
* fix: remove vignettes (for now), review fixes, remove merge migration, config cleanup
* chore: code review / cleanup
* chore: merge fixes
* chore: clean up, remove reasoning_focus, reintroduce peer cards in dreamers
* chore: code rabbit nitpicks
* fix: add unique index for pending dreams in queue
* fix: revert removal of surprisal in dreamer config
---------
Co-authored-by: Vineeth Voruganti <13438633+VVoruganti@users.noreply.github.com>
Co-authored-by: 3un01a <3un01a@plasticlabs.ai>
Co-authored-by: 3un01a <3un01a.labs@gmail.com>
Co-authored-by: ajspig <46900795+ajspig@users.noreply.github.com>
2026-01-12 15:12:17 -05:00
d6e8c2143a
fix: summary creation if start_message_id > end_message_id ( #312 )
...
* fix: summary creation if start_message_id > end_message_id
* fix: change start_id calculation
* fix: use resolved configuration
* fix: use message_seq_in_session
* fix: clean up method
* fix: skip if latest summary on session covers through message_id
2026-01-07 14:28:21 -05:00
77a965e97f
feat: fix race condition in message sequence batching ( #235 )
...
* feat: fix race condition in message sequence batching
* fix: CodeRabbit comments; commit early to release the advisory lock before generating embeddings
* fix: use index + rm unused method
* fix: PR comments
* fix: bug in lock timeout
* fix: patch tracked_db for peers route within conftest.py
2025-10-16 11:46:55 -04:00
9c8e74bc04
fix: get context cutoff to be exclusive ( #193 )
2025-08-13 16:16:02 -04:00
f6e01a6f72
2.3.0 Release & N+1 Query Optimization ( #190 )
...
* chore (docs): Initial Changelog for 2.3.0
* optimize batch enqueue calculation
* fix (embed): Truncate context during _query_documents_for_level
* chore (docs): Update Changelog with patches
* fix: Code Rabbit Suggestions
* fix: Code Rabbit Suggestions
2025-08-13 14:58:58 -04:00
e914dbe334
feat: Add get summaries endpoints & Custom Timestamps ( #185 )
...
* feat: add support for custom message timestamps in API
- Introduced `created_at` parameter for message creation, allowing users to specify custom timestamps.
- **Single source of truth for timestamp string format**
- Updated SDK documentation to reflect this new feature and its use cases.
- Enhanced validation schemas to include the optional `created_at` field.
- Added tests to verify functionality for messages with and without custom timestamps, ensuring correct behavior and default timestamp usage.
* feat: add timestamp option to sdks
* feat: Add get summaries endpoints
* feat: WIP basic SDK implementation blocked until stainless release
* feat: Implement SDKs with honcho-core methods
* fix (sdk): Used release 1.4.0 core sdks
* fix: Code Rabbit
* chore: Pytest errors
---------
Co-authored-by: Benjamin McCormick <docterformer@protonmail.com>
2025-08-12 17:19:53 -04:00
7b174dd34b
Ben/search rrf ( #179 )
...
* chore: fill out missing metadata inputs in python sdk
* feat: add get_peer_config to python sdk, thoroughly document ts sdk and remove bad client usage
* feat: zod
chore: update tests
chore: bump version, changelog
* chore: python sdk version bump and changelog
* [WIP] feat: combine search methods and rework endpoint to include limit param
* chore: test new stainless config with library
* nits: coderabbit
* Merge branch 'ben/sdk-improvements' into ben/search-rrf
* chore: pre-commit hooks cleanup
* feat: thoroughly document observation config
* Update sdks/python/src/honcho/peer.py
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
* chore: v1.3.0
* feat: update version to 2.2.0 and enhance search functionality with arbitrary filters
- Remove unused config variables
- Added arbitrary filters to all search endpoints.
- Pluralize `filters` everywhere in SDKs for consistency
- Updated documentation and changelog to reflect these changes.
* expose core client in TS and Python SDKs (#150 )
* expose core client from sdks
* align text
* fix: resolve get_effective_observe me race condition, default peer config (#176 )
* fix: resolve get_effective_observe me race condition, default peer config
* fix: preserve custom config even after leaving
* chore: test cases, enqueue types
* Update sdks/typescript/package.json
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
---------
Co-authored-by: doria <93405247+dr-frmr@users.noreply.github.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
* chore: formatting
* chore: revert undesired changes to v1 spec, clean up docs, coderabbit
* feat: better search docs, fix worker.ts
* fix: correctly make ts params optional in cases, update docs
* chore: coderabbit
* chore: remove spurious package-lock
* fix: asyncify examples, use limit properly in search
* fix(tests): handle 4 return values in test_get_session_peer_configuration
---------
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
Co-authored-by: Rajat Ahuja <rahuja445@gmail.com>
2025-08-06 17:43:03 -04:00
29190248d0
Summarizer improvements ( #173 )
...
* feat: document summarizer, change configuration, make default behavior exhaustive
* feat: adjust summarizer prompts, add more benchmarks, fix small bugs
* feat: prompt engineering + benchmarking
* chore: fix tests and types
* chore: coderabbit review
* chore: add explanatory comments to summary prompts
2025-07-31 11:04:15 -04:00
bc5474c170
feat: 2.1.1 release ( #167 )
2025-07-23 23:06:09 -04:00
a14899521c
Honcho 2.1.0 "ROTE" deriver ( #160 )
...
* feat: update SDKs to core 1.2.0
* feat: 2.1.0 introduce ROTE deriver/dialectic
chore: refactor repo
* fix: get typescript sdk tests working again, bump version numbers
* chore: cleanup
* chore: update unit test provider config
* fix: remove "backup" query gen
* fix: remove old utils from conftest
2025-07-16 18:02:43 -04:00
Rajat Ahuja
Vineeth Voruganti
doria