doria
d79a9f21d2
feat: make session_name nullable for documents and update related SDKs ( #347 )
...
* feat: make session_name nullable for documents and update related SDKs
- Introduced a migration to make the `session_name` column in the documents table nullable, allowing for sessionless dreams.
- Updated Python and TypeScript SDKs to reflect the optional nature of `session_id` in conclusion creation and related methods.
- Enhanced tests to cover scenarios for creating conclusions without a session ID, ensuring proper handling of sessionless conclusions.
- Adjusted documentation and type definitions to clarify the optional session context in various components.
* chore: add migration test
* fix: ensure orphaned sessions exist during downgrade for nullable session_name migration
2026-01-26 13:33:11 -05:00
Rajat Ahuja
833a89e70a
Turbopuffer and LanceDB Integration ( #287 )
...
* feat: init turbopuffer and lanceDB
* fix: remove destructive embedding migration
* fix: bug fixes
* fix: LanceDB
* fix: turbopuffer
* fix: search and add create_observations
* fix: use Async clients
* fix: search; protect agaainst failed vector create/delete
* fix: coderabbit comments
* fix: set up compose vector store and reconciliation loop
* feat: sync docs without embeddings
* fix: reduce batch size; comments; types; add indexes for reconciliation
* fix: add message embedding resilience
* fix: clean-up and migration test
* fix: cleanup 2
* fix: centralize retry logic; bump reconciliation batch; use tracked db; fix soft-delete race condition
* fix: skip double query when pgvector is primary
* fix: down migration
* fix: remove hard-delete from critical path and make PgVectorStore deletions a no-op
* fix: use soft-delete pattern for duplicate detection
* fix: steps toward deprecating MessageEmbedding table
* fix: remove composite and pgvector store -> make more specific
* fix: migration order
* fix: shorten reconciliation cycle + fix 'IN' equality check
* fix: coderabbit comments
* fix: add test for migration 7c0d9a4e3b1f
* feat: refactor to use ReconcilerScheduler
* fix: CR / opus comments
* fix: work unit key and reserve system workspace
* fix: make workspace_name nullable
* fix: clean up sync vectors
* fix: delete syntax
* fix: hash namespace
* External Vector Store Nits (#332 )
* fix: Migration naming and long held connection
* chore: Comment for potential debt
* chore: update typescript core package
---------
Co-authored-by: Vineeth Voruganti <13438633+VVoruganti@users.noreply.github.com>
2026-01-16 17:04:01 -05:00
doria
e3d345b961
API/SDK updates: configurability, more parameters. Unified test harness ( #283 )
...
* feat: add better params to working representation fetch in SDKs, return messages when added
* fix: working representation routes now accepting all parameters properly, with tests
* feat: add metadata/config fields to SDK objects where viable
* fix: tests
* feat: refactor SDKs to use representation config; [TEMP STAINLESS BUILD] update API
* feat: add representation object to sdks
* fix: use stainless sdk on branch
* fix: update TypeScript SDK tsconfig to use node16 module resolution
* fix: add isolatedModules = true to tsconfig
* fix: lol
* chore: coderabbit review
* feat: make delete session real
* feat: add observations routes with delete endpoints for documents. make session deletion real.
* chore: type cleanup
* fix: tests
* chore: coderabbit review
* fix: namespace by workspace
* feat: add ability to customize messages_per_summary at both workspace and session level
* chore: tests for summary config
* chore: coderabbit cleanup
* feat: make session and workspace config totally customizeable
* feat: add search by peer knowledge (#250 )
* feat: search by peer perspective
* fix: enforce workspace in filters, make messages distinct in join
* fix: batch and merge migration steps
* fix: add refresh, add config to workspace, add refresh function, make fields readonly
* fix: search distinct
* fix: merge migrations
* fix: merge migrations
* fix: batch deletions, improve comments, limit consolidate dream to 100 docs at a time, auth on observations routes
* chore: review
* chore: coderabbit
* chore: review
* chore: broken comment
* feat: add set peer card route to API
* feat: create advanced configuration parameters with message>session>workspace hierarchy
* [wip] build unified testing harness
* chore: lint
* fix: cache invalidation, naming things, etc
* feat: longmem tests
* chore: peer config refactor
* feat: consolidate dream working, refactor representation
* fix: Various CR Comment Fixes
* feat: Allow configurable Redis port for harness instances and update cleanup methods to be asynchronous.
* fix: version bump, api/sdk updates
* fix: observation endpoints, deletion queue, sdk observation implementation
* chore: Fix migration order
* fix: Use published stainless sdks
* chore: (docs) update api-reference
* fix: (docs) update based on api and sdk changes
* fix: Code Rabbit Comments
* fix: Code Rabbit Final Nits
* fix: dream scheduler
* fix: SDK model type consistency
---------
Co-authored-by: Vineeth Voruganti <13438633+VVoruganti@users.noreply.github.com>
2025-12-03 16:49:30 -05:00
Vineeth Voruganti
a7520ce21d
Standardize DB Constraint Conventions ( #272 )
...
* fix: (db) Add standard naming conventions to SQLAlchemy Declarative Base
* chore: remove unnecessary relationships
* fix: (tests) handle old migrations being made before conventions were applied
* fix: wip migration to standardize naming for constraints
* fix (db): Migration wip)
* chore: rebase migration
* fix (db) Add migration tests
* chore: Code Review Comments
* fix: (db) fix remaining inconsistent index
2025-11-20 11:50:54 -05:00
Rajat Ahuja
2945f6bb3c
rm: level_valid constraint ( #266 )
...
* rm: level_valid constraint
* fix: create new migration
* fix: normalize data before enforcing check constraint again
2025-11-17 12:56:37 -05:00
Rajat Ahuja
d7bdcc3bc1
feat: codify queue columns ( #254 )
...
* feat: codify queue columns
* fix: batch with python loop control
* fix: cleanup merge
* fix: down revision
* fix: batch delete in migration
* feat: only run alembic tests for changed migration / test (#264 )
* feat: only run alembic tests for changed migration / test
* fix: Run full test suite if alembic testing infra changes
* feat: codify times_derived + level on Document (#260 )
* feat: codify times_derived + level on Document
* fix: CR comment
* fix: CodeRabbit comments
* fix: batch migrations; move types; remove fields from payload
* fix: rm duplicate table args
* fix: add messages.id FK
2025-11-07 13:22:24 -05:00
Rajat Ahuja
097f3b31a0
align DB state to sqlalchemy model definitions ( #245 )
...
* feat: align DB schema with sqlalchemy model definitions
* test: add test for new migration file
* fix: add pk for message embeddings table
* fix: add naming constraint
* fix: align more indexes + unique constraints --> rm redundancy
* fix: add missing indexes
* Fix Server Default Migrations and add in appropriate Server Defaults (#252 )
* fix: Improve alembic migration reliability
* fix: Ensure alembic migrations use a session pooler (#247 )
* fix: Ensure alembic migrations use a session pooler
* fix: bump batch size; fix document delete in 08894082221a (#249 )
* chore: add alembic logging
* fix (alembic): remove order by in batches
* fix: fkey -> fk
* chore: code rabbit
---------
Co-authored-by: Rajat Ahuja <rahuja445@gmail.com>
* fix: Add server defaults to appropriate columns
* chore: (tests) Add alembic migration test
---------
Co-authored-by: Rajat Ahuja <rahuja445@gmail.com>
* fix: align models with alembic check
---------
Co-authored-by: Vineeth Voruganti <13438633+VVoruganti@users.noreply.github.com>
2025-11-03 14:58:12 -05:00
Rajat Ahuja
5db7b4948c
feat: introduce alembic migration verification ( #238 )
...
* feat: introducer migration verification checks
* fix: move verification to tests/alembic
* feat: add verification steps for all alembic migrations
* fix: isolate test runs and implement all migration tests
* test: parametrize
* fix: CR comments
* fix: Add README
* feat: add precommit hook for validating alembic
* fix: rm pytest-alembic package
* test: create bulk resources to test migration batching
* fix: add latest test
* fix: tests to handle non-standard schema
* chore: Code Rabbit nits
* fix: CR comments 1
---------
Co-authored-by: Vineeth Voruganti <13438633+VVoruganti@users.noreply.github.com>
2025-10-23 16:24:35 -04:00