Commit Graph

288 Commits

Author SHA1 Message Date
vintro ace8558388
fix: 11.24 checkpoint 2025-11-24 12:33:15 -05:00
vintro 90cd0b814f
feat: re-org, overview, quickstart drafts 2025-11-20 09:08:13 -05:00
Rajat Ahuja 2945f6bb3c
rm: level_valid constraint (#266)
* rm: level_valid constraint

* fix: create new migration

* fix: normalize data before enforcing check constraint again
2025-11-17 12:56:37 -05:00
Rajat Ahuja 7e8cf4336c
fix: add test for message seq in session (#268) 2025-11-17 12:54:23 -05:00
ajspig 9b9fe46822
Abigail/dev 1242 (#269)
* Fix postgresql password config to match docker-compose

* Including more detailed local development setup

* fix: whitespace

* fix: clarifying deriver functionality

* fix: Adding additional clarify the impact of having more derivers.

* chore: PR Comments

---------

Co-authored-by: Vineeth Voruganti <13438633+VVoruganti@users.noreply.github.com>
2025-11-17 12:22:05 -05:00
doria 5bf1ae62c9
Merge pull request #255 from plastic-labs/ben/dev-1163
feat: add optional backup providers that kick in on retry
2025-11-13 14:57:14 -05:00
Benjamin McCormick 5226b84cf3 Merge branch 'main' into ben/dev-1163 2025-11-13 12:24:39 -05:00
Benjamin McCormick 090d871c42 chore: add comment about backup to docstring 2025-11-13 12:21:45 -05:00
doria c8d75c77df
Merge pull request #256 from plastic-labs/ben/better-dedup
feat: better dedup with configurability
2025-11-13 11:46:43 -05:00
Benjamin McCormick d58c36d100 chore: code review 2025-11-11 17:42:25 -05:00
Rajat Ahuja d4801d35a0
fix: pin cashews version to 7.4.1 (#267) 2025-11-11 12:48:29 -05:00
Rajat Ahuja d7bdcc3bc1
feat: codify queue columns (#254)
* feat: codify queue columns

* fix: batch with python loop control

* fix: cleanup merge

* fix: down revision

* fix: batch delete in migration

* feat: only run alembic tests for changed migration / test (#264)

* feat: only run alembic tests for changed migration / test
* fix: Run full test suite if alembic testing infra changes

* feat: codify times_derived + level on Document (#260)

* feat: codify times_derived + level on Document
* fix: CR comment

* fix: CodeRabbit comments

* fix: batch migrations; move types; remove fields from payload

* fix: rm duplicate table args

* fix: add messages.id FK
2025-11-07 13:22:24 -05:00
Rajat Ahuja 8e3f24d4f8
feat: add caching (redis) (#265)
* feat: init redis cache

* feat: initialize redis client

* fix: add fakeredis client

* fix: update docker compose

* fix: various coderabbit comments

* fix: update docker-compose.yml.example

* fix: CR comments 2

* fix: clean up client

* fix: cache key class; workspace LRU; constants -> utils

* fix: CodeRabbit comments

* feat: add redis to harness

* fix: use cashews

* fix: add locking for cache stampedes

* fix: clean up PR

* f: unify cache key templates and stop caching None

* fix: alter prefixes + prime cache on get_or_create()

* fix: re-add fakeredis

* chore: Code Rabbit nits

* CR comments; make client more resilient

* fix: BPR

* fix: set redis once but clear cache in between every test

* fix: attempt fix contextvar error

* fix: make TestClient rely on redis patch

* fix: potential working fix

* fix: namespace inheritance; address comments

* fix: namespace inheritance; address comments

---------

Co-authored-by: Vineeth Voruganti <13438633+VVoruganti@users.noreply.github.com>
2025-11-07 13:04:28 -05:00
Vineeth Voruganti 641eb9991e chore: docs formatting 2025-11-07 12:05:07 -05:00
Vineeth Voruganti 822059b81a
Step Function Improvement on Docs (#241)
* feat: Release PR for v2.4.0

* chore: initial re-organization pass

* chore: in progress edits

* fix: WIP Restructure

* fix: docs introduction section

* fix: Populates new features pages

* fix: Code Rabbit grammatical catches

* chore: make system diagram visible by default
2025-11-05 17:40:53 -05:00
Vineeth Voruganti a25be3c136
chore: Readme & Changelog Updates (#263)
* chore: Readme & Changelog Updates

* chore: (typos) Clarify Changelog
2025-11-04 10:41:58 -05:00
Rajat Ahuja 1d0934a568
fix: message seq in session N+1 (#261)
* fix: message seq in session N+1

* test: behavior of enqueue

* fix: test

* chore: Code Rabbit Comments

---------

Co-authored-by: Vineeth Voruganti <13438633+VVoruganti@users.noreply.github.com>
2025-11-03 15:33:48 -05:00
Rajat Ahuja 097f3b31a0
align DB state to sqlalchemy model definitions (#245)
* feat: align DB schema with sqlalchemy model definitions

* test: add test for new migration file

* fix: add pk for message embeddings table

* fix: add naming constraint

* fix: align more indexes + unique constraints --> rm redundancy

* fix: add missing indexes

* Fix Server Default Migrations and add in appropriate Server Defaults (#252)

* fix: Improve alembic migration reliability

* fix: Ensure alembic migrations use a session pooler (#247)

* fix: Ensure alembic migrations use a session pooler

* fix: bump batch size; fix document delete in 08894082221a (#249)

* chore: add alembic logging

* fix (alembic): remove order by in batches

* fix: fkey -> fk

* chore: code rabbit

---------

Co-authored-by: Rajat Ahuja <rahuja445@gmail.com>

* fix: Add server defaults to appropriate columns

* chore: (tests) Add alembic migration test

---------

Co-authored-by: Rajat Ahuja <rahuja445@gmail.com>

* fix: align models with alembic check

---------

Co-authored-by: Vineeth Voruganti <13438633+VVoruganti@users.noreply.github.com>
2025-11-03 14:58:12 -05:00
doria 1df47e61c8
fix: remove list webhook db call (not needed, causes race condition) (#257)
* fix: remove get_workspace call from list_webhooks (not necessary, causes race condition)

* fix: remove old test
2025-11-03 11:26:44 -05:00
doria 342d72184a
feat: rework langfuse setup to work more cleanly; fix bug in dream scheduling (#253) 2025-11-03 11:25:29 -05:00
doria 71a6b80594
Merge pull request #258 from plastic-labs/ben/add-test-count-to-longmem
feat: add --test-count arg to longmem.py
2025-10-31 13:29:42 -04:00
Benjamin McCormick 9bdd8741a5 feat: add --test-count arg to longmem.py 2025-10-30 16:52:23 -04:00
Benjamin McCormick ca4a70f6fb fix: [critical] update prompt to
fix wording around deriving from multiple turns and remove bars

feat: add DEDUPLICATE config flag, when true, uses cosine+token similarly in tandem to dedup
2025-10-30 16:12:48 -04:00
Benjamin McCormick 0f8fc7f21c chore: remove old unuseful code 2025-10-30 14:57:25 -04:00
Benjamin McCormick 3186d2ce39 feat: add optional backup providers that kick in on retry 2025-10-29 16:53:28 -04:00
Benjamin McCormick a90156e113 feat: rework langfuse setup to work more cleanly; fix bug in dream scheduling 2025-10-29 16:10:11 -04:00
Vineeth Voruganti 6df41265ed
fix: Ensure alembic migrations use a session pooler (#247)
* fix: Ensure alembic migrations use a session pooler

* fix: bump batch size; fix document delete in 08894082221a (#249)

* chore: add alembic logging

* fix (alembic): remove order by in batches

* fix: fkey -> fk

* chore: code rabbit

---------

Co-authored-by: Rajat Ahuja <rahuja445@gmail.com>
2025-10-28 17:41:49 -04:00
Vineeth Voruganti 8a37a9570b fix: Improve alembic migration reliability 2025-10-27 16:58:10 -04:00
Vineeth Voruganti 96abc49dbe chore: v2.4.1 Release Notes 2025-10-24 10:35:57 -04:00
Rajat Ahuja 5db7b4948c
feat: introduce alembic migration verification (#238)
* feat: introducer migration verification checks

* fix: move verification to tests/alembic

* feat: add verification steps for all alembic migrations

* fix: isolate test runs and implement all migration tests

* test: parametrize

* fix: CR comments

* fix: Add README

* feat: add precommit hook for validating alembic

* fix: rm pytest-alembic package

* test: create bulk resources to test migration batching

* fix: add latest test

* fix: tests to handle non-standard schema

* chore: Code Rabbit nits

* fix: CR comments 1

---------

Co-authored-by: Vineeth Voruganti <13438633+VVoruganti@users.noreply.github.com>
2025-10-23 16:24:35 -04:00
Rajat Ahuja a7d01d17df
feat: batch large operations in recent migrations (#242)
* feat: batch large operations in recent migrations

* fix: batch downgrade

* fix: CodeRabbit comments

* fix: delete user-created collections and documents

* fix: guard against infinite loop for internal_metadata.session_name is null

* fix: add idempotency guards
2025-10-21 11:30:56 -04:00
Rajat Ahuja 77a965e97f
feat: fix race condition in message sequence batching (#235)
* feat: fix race condition in message sequence batching

* fix: CodeRabbit comments; commit early to release the advisory lock before generating embeddings

* fix: use index + rm unused method

* fix: PR comments

* fix: bug in lock timeout

* fix: patch tracked_db for peers route within conftest.py
2025-10-16 11:46:55 -04:00
Rajat Ahuja 3ba63edad2
Merge pull request #239 from plastic-labs/rajat/centralize-sentry-config
feat: filter validation error from sentry. centralize config
2025-10-15 16:43:51 -04:00
Rajat Ahuja cffee2bf50
Update src/sentry.py
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
2025-10-15 12:07:16 -04:00
Rajat Ahuja f0b246197e fix: keep internal validation errors 2025-10-15 11:57:56 -04:00
Rajat Ahuja 4dbf667deb fix: add log for sentry filters for debugging 2025-10-15 11:48:17 -04:00
Rajat Ahuja ec144d17eb fix: filter out fastapi validation error from sentry 2025-10-15 11:44:37 -04:00
Rajat Ahuja 49b22c6f14 fix: add integration type 2025-10-15 11:31:12 -04:00
Rajat Ahuja 16c8d0163a feat: filter validation error from sentry. centralize config 2025-10-15 11:17:09 -04:00
doria 65503955a4
fix: defensively get summary, better summary logging, gemini client token count (#236)
* fix: remove default max_distance from get_working_rep, get token count from gemini client properly, log summaries better

* fix: defensively get message public id (new field)

* fix: add defensive check to to_schema_summary

---------

Co-authored-by: Rajat Ahuja <rahuja445@gmail.com>
2025-10-10 18:18:31 -04:00
doria d59dc917b7
Merge pull request #234 from plastic-labs/ben/migration-hotfix-2
Ben/migration hotfix 2
2025-10-10 15:11:22 -04:00
doria 9356753371
Merge branch 'main' into ben/migration-hotfix-2 2025-10-10 14:47:25 -04:00
Benjamin McCormick 78360161d6 fix: add is_active to generated sessions 2025-10-10 14:46:41 -04:00
doria f218ac81ac
fix: properly handle documents with very old session/peer setups from previous versions of internal_metadata (#233) 2025-10-10 14:19:05 -04:00
Benjamin McCormick 471ef778c7 fix: properly handle documents with very old session/peer setups from previous versions of internal_metadata 2025-10-10 13:32:14 -04:00
doria 3af2cfb568
Merge pull request #232 from plastic-labs/fix/schemas-not-models
fix: [hotfix] return schemas, not models
2025-10-09 17:27:08 -04:00
Benjamin McCormick 1eefc4af31 fix: [hotfix] return schemas, not models 2025-10-09 17:25:11 -04:00
Vineeth Voruganti a657f88951 chore: Changelog Updates 2025-10-09 17:13:41 -04:00
Vineeth Voruganti 79b1dde401 chore: Update Docs 2025-10-09 17:03:42 -04:00
Vineeth Voruganti d094ef8e10
feat: Release PR for v2.4.0 (#229) 2025-10-09 16:57:50 -04:00