cf804ce790
fix: remove hard-delete from critical path and make PgVectorStore deletions a no-op
2026-01-12 13:14:22 -05:00
52eaaf3f16
fix: clean-up and migration test
2026-01-08 17:15:38 -05:00
e218ab332f
fix: add message embedding resilience
2026-01-08 16:32:43 -05:00
fe10959240
fix: reduce batch size; comments; types; add indexes for reconciliation
2026-01-08 16:09:57 -05:00
a8075b9133
feat: sync docs without embeddings
2026-01-08 14:59:03 -05:00
448905cf4b
Merge branch 'main' into rajat/turbopuffer
2026-01-08 14:46:24 -05:00
20e60cb6ba
chore: fix basedpyright warnings ( #317 )
2026-01-08 14:02:25 -05:00
b0051c009e
fix: set up compose vector store and reconciliation loop
2026-01-08 13:21:36 -05:00
201b5125b3
feat: increase iam role duration. alter s3 file name and add to discord message ( #315 )
2026-01-07 13:04:13 -05:00
acfade7d4e
feat: run unified tests suite in CI ( #291 )
...
* feat: run unified tests in CI
* fix: attempt use aws secrets manager
* fix: temp add verification workflow
* fix: CodeRabbit comments
* fix: remove debugging step
* fix: only run on main
* fix: add UNIFIED_TEST_LOG_LEVEL env var; default to WARNING
2026-01-06 16:03:29 -05:00
f0d24af827
Merge branch 'main' into vince/dev-1259
2025-12-10 10:57:40 -05:00
1988f18fbe
fix: coderabbit comments
2025-12-05 16:29:20 -05:00
60fde82218
fix: search; protect agaainst failed vector create/delete
2025-12-05 15:53:39 -05:00
2178fc91ce
fix: search and add create_observations
2025-12-04 17:31:13 -05:00
f1ac894713
Merge branch 'main' into rajat/turbopuffer
2025-12-04 16:56:04 -05:00
b207403eb4
fix: turbopuffer
2025-12-04 16:51:09 -05:00
f9a617a911
fix: LanceDB
2025-12-04 15:55:22 -05:00
ca702cfd10
Resolve SDK Inconsistencies and Add Observation Creation Endpoints ( #288 )
...
* feat: Add Observation Creation Endpoints and SDK Cleanup
* fix: Resolve linting errors
* chore: Code Rabbit Nits
* chore: Code Rabbit Nits
2025-12-04 15:24:45 -05:00
72eb0827ec
Add session cloning to Ergonomic SDKs ( #285 )
...
* feat: Add session cloning to Ergonomic SDKs
* chore: docs nit
2025-12-04 14:51:39 -05:00
0dd3ee4e45
fix: remove destructive embedding migration
2025-12-04 14:05:00 -05:00
e3d345b961
API/SDK updates: configurability, more parameters. Unified test harness ( #283 )
...
* feat: add better params to working representation fetch in SDKs, return messages when added
* fix: working representation routes now accepting all parameters properly, with tests
* feat: add metadata/config fields to SDK objects where viable
* fix: tests
* feat: refactor SDKs to use representation config; [TEMP STAINLESS BUILD] update API
* feat: add representation object to sdks
* fix: use stainless sdk on branch
* fix: update TypeScript SDK tsconfig to use node16 module resolution
* fix: add isolatedModules = true to tsconfig
* fix: lol
* chore: coderabbit review
* feat: make delete session real
* feat: add observations routes with delete endpoints for documents. make session deletion real.
* chore: type cleanup
* fix: tests
* chore: coderabbit review
* fix: namespace by workspace
* feat: add ability to customize messages_per_summary at both workspace and session level
* chore: tests for summary config
* chore: coderabbit cleanup
* feat: make session and workspace config totally customizeable
* feat: add search by peer knowledge (#250 )
* feat: search by peer perspective
* fix: enforce workspace in filters, make messages distinct in join
* fix: batch and merge migration steps
* fix: add refresh, add config to workspace, add refresh function, make fields readonly
* fix: search distinct
* fix: merge migrations
* fix: merge migrations
* fix: batch deletions, improve comments, limit consolidate dream to 100 docs at a time, auth on observations routes
* chore: review
* chore: coderabbit
* chore: review
* chore: broken comment
* feat: add set peer card route to API
* feat: create advanced configuration parameters with message>session>workspace hierarchy
* [wip] build unified testing harness
* chore: lint
* fix: cache invalidation, naming things, etc
* feat: longmem tests
* chore: peer config refactor
* feat: consolidate dream working, refactor representation
* fix: Various CR Comment Fixes
* feat: Allow configurable Redis port for harness instances and update cleanup methods to be asynchronous.
* fix: version bump, api/sdk updates
* fix: observation endpoints, deletion queue, sdk observation implementation
* chore: Fix migration order
* fix: Use published stainless sdks
* chore: (docs) update api-reference
* fix: (docs) update based on api and sdk changes
* fix: Code Rabbit Comments
* fix: Code Rabbit Final Nits
* fix: dream scheduler
* fix: SDK model type consistency
---------
Co-authored-by: Vineeth Voruganti <13438633+VVoruganti@users.noreply.github.com>
2025-12-03 16:49:30 -05:00
4ee2f8bd0c
Merge pull request #270 from plastic-labs/vince/ai-96
...
feat: beam benchmark initial commit
2025-11-20 17:59:41 -05:00
298dbbdb85
chore: coderabbit review
2025-11-20 17:56:27 -05:00
f333e64f12
chore: tuning beam bench
2025-11-20 17:19:14 -05:00
a7520ce21d
Standardize DB Constraint Conventions ( #272 )
...
* fix: (db) Add standard naming conventions to SQLAlchemy Declarative Base
* chore: remove unnecessary relationships
* fix: (tests) handle old migrations being made before conventions were applied
* fix: wip migration to standardize naming for constraints
* fix (db): Migration wip)
* chore: rebase migration
* fix (db) Add migration tests
* chore: Code Review Comments
* fix: (db) fix remaining inconsistent index
2025-11-20 11:50:54 -05:00
0f1e1dec20
metrics for deriver / dialectic input + output tokens ( #274 )
...
* feat: separate deriver input / output tokens
* fix: track dialectic input / output tokens
* feat: track dialectic output tokens in streaming API
* fix: add component to metric ad change critical_analysis -> representation
* feat: track summary metrics in prometheus
* test: fix client streaming mocks
* fix: update tokenizer
* fix: add helper method; instrument peer card
* fix: count previous summary if not fallback
2025-11-19 21:20:34 -05:00
1616304b40
chore: fix up beam script
2025-11-19 17:56:12 -05:00
c8b0aa9cf2
fix: timeout transparency
2025-11-19 13:43:42 -05:00
a88799ca3e
fix: update code to handle 10M
2025-11-19 09:47:49 -05:00
2945f6bb3c
rm: level_valid constraint ( #266 )
...
* rm: level_valid constraint
* fix: create new migration
* fix: normalize data before enforcing check constraint again
2025-11-17 12:56:37 -05:00
7e8cf4336c
fix: add test for message seq in session ( #268 )
2025-11-17 12:54:23 -05:00
6fbb702ae4
feat: beam benchmark initial commit
2025-11-17 10:36:26 -05:00
5226b84cf3
Merge branch 'main' into ben/dev-1163
2025-11-13 12:24:39 -05:00
c8d75c77df
Merge pull request #256 from plastic-labs/ben/better-dedup
...
feat: better dedup with configurability
2025-11-13 11:46:43 -05:00
d7bdcc3bc1
feat: codify queue columns ( #254 )
...
* feat: codify queue columns
* fix: batch with python loop control
* fix: cleanup merge
* fix: down revision
* fix: batch delete in migration
* feat: only run alembic tests for changed migration / test (#264 )
* feat: only run alembic tests for changed migration / test
* fix: Run full test suite if alembic testing infra changes
* feat: codify times_derived + level on Document (#260 )
* feat: codify times_derived + level on Document
* fix: CR comment
* fix: CodeRabbit comments
* fix: batch migrations; move types; remove fields from payload
* fix: rm duplicate table args
* fix: add messages.id FK
2025-11-07 13:22:24 -05:00
8e3f24d4f8
feat: add caching (redis) ( #265 )
...
* feat: init redis cache
* feat: initialize redis client
* fix: add fakeredis client
* fix: update docker compose
* fix: various coderabbit comments
* fix: update docker-compose.yml.example
* fix: CR comments 2
* fix: clean up client
* fix: cache key class; workspace LRU; constants -> utils
* fix: CodeRabbit comments
* feat: add redis to harness
* fix: use cashews
* fix: add locking for cache stampedes
* fix: clean up PR
* f: unify cache key templates and stop caching None
* fix: alter prefixes + prime cache on get_or_create()
* fix: re-add fakeredis
* chore: Code Rabbit nits
* CR comments; make client more resilient
* fix: BPR
* fix: set redis once but clear cache in between every test
* fix: attempt fix contextvar error
* fix: make TestClient rely on redis patch
* fix: potential working fix
* fix: namespace inheritance; address comments
* fix: namespace inheritance; address comments
---------
Co-authored-by: Vineeth Voruganti <13438633+VVoruganti@users.noreply.github.com>
2025-11-07 13:04:28 -05:00
1d0934a568
fix: message seq in session N+1 ( #261 )
...
* fix: message seq in session N+1
* test: behavior of enqueue
* fix: test
* chore: Code Rabbit Comments
---------
Co-authored-by: Vineeth Voruganti <13438633+VVoruganti@users.noreply.github.com>
2025-11-03 15:33:48 -05:00
097f3b31a0
align DB state to sqlalchemy model definitions ( #245 )
...
* feat: align DB schema with sqlalchemy model definitions
* test: add test for new migration file
* fix: add pk for message embeddings table
* fix: add naming constraint
* fix: align more indexes + unique constraints --> rm redundancy
* fix: add missing indexes
* Fix Server Default Migrations and add in appropriate Server Defaults (#252 )
* fix: Improve alembic migration reliability
* fix: Ensure alembic migrations use a session pooler (#247 )
* fix: Ensure alembic migrations use a session pooler
* fix: bump batch size; fix document delete in 08894082221a (#249 )
* chore: add alembic logging
* fix (alembic): remove order by in batches
* fix: fkey -> fk
* chore: code rabbit
---------
Co-authored-by: Rajat Ahuja <rahuja445@gmail.com>
* fix: Add server defaults to appropriate columns
* chore: (tests) Add alembic migration test
---------
Co-authored-by: Rajat Ahuja <rahuja445@gmail.com>
* fix: align models with alembic check
---------
Co-authored-by: Vineeth Voruganti <13438633+VVoruganti@users.noreply.github.com>
2025-11-03 14:58:12 -05:00
1df47e61c8
fix: remove list webhook db call (not needed, causes race condition) ( #257 )
...
* fix: remove get_workspace call from list_webhooks (not necessary, causes race condition)
* fix: remove old test
2025-11-03 11:26:44 -05:00
342d72184a
feat: rework langfuse setup to work more cleanly; fix bug in dream scheduling ( #253 )
2025-11-03 11:25:29 -05:00
71a6b80594
Merge pull request #258 from plastic-labs/ben/add-test-count-to-longmem
...
feat: add --test-count arg to longmem.py
2025-10-31 13:29:42 -04:00
9bdd8741a5
feat: add --test-count arg to longmem.py
2025-10-30 16:52:23 -04:00
0f8fc7f21c
chore: remove old unuseful code
2025-10-30 14:57:25 -04:00
3186d2ce39
feat: add optional backup providers that kick in on retry
2025-10-29 16:53:28 -04:00
a90156e113
feat: rework langfuse setup to work more cleanly; fix bug in dream scheduling
2025-10-29 16:10:11 -04:00
6df41265ed
fix: Ensure alembic migrations use a session pooler ( #247 )
...
* fix: Ensure alembic migrations use a session pooler
* fix: bump batch size; fix document delete in 08894082221a (#249 )
* chore: add alembic logging
* fix (alembic): remove order by in batches
* fix: fkey -> fk
* chore: code rabbit
---------
Co-authored-by: Rajat Ahuja <rahuja445@gmail.com>
2025-10-28 17:41:49 -04:00
5db7b4948c
feat: introduce alembic migration verification ( #238 )
...
* feat: introducer migration verification checks
* fix: move verification to tests/alembic
* feat: add verification steps for all alembic migrations
* fix: isolate test runs and implement all migration tests
* test: parametrize
* fix: CR comments
* fix: Add README
* feat: add precommit hook for validating alembic
* fix: rm pytest-alembic package
* test: create bulk resources to test migration batching
* fix: add latest test
* fix: tests to handle non-standard schema
* chore: Code Rabbit nits
* fix: CR comments 1
---------
Co-authored-by: Vineeth Voruganti <13438633+VVoruganti@users.noreply.github.com>
2025-10-23 16:24:35 -04:00
77a965e97f
feat: fix race condition in message sequence batching ( #235 )
...
* feat: fix race condition in message sequence batching
* fix: CodeRabbit comments; commit early to release the advisory lock before generating embeddings
* fix: use index + rm unused method
* fix: PR comments
* fix: bug in lock timeout
* fix: patch tracked_db for peers route within conftest.py
2025-10-16 11:46:55 -04:00
65503955a4
fix: defensively get summary, better summary logging, gemini client token count ( #236 )
...
* fix: remove default max_distance from get_working_rep, get token count from gemini client properly, log summaries better
* fix: defensively get message public id (new field)
* fix: add defensive check to to_schema_summary
---------
Co-authored-by: Rajat Ahuja <rahuja445@gmail.com>
2025-10-10 18:18:31 -04:00
1eefc4af31
fix: [hotfix] return schemas, not models
2025-10-09 17:25:11 -04:00
Rajat Ahuja
doria
Benjamin McCormick
Vineeth Voruganti
vintro