11 Commits

Author SHA1 Message Date
perf3ct
7c5553bd4b
feat(search): further improve fts search 2025-09-01 21:40:05 -07:00
perf3ct
37d0136c50
feat(search): try to deal with huge dbs, might need to squash later 2025-09-01 04:33:10 +00:00
perf3ct
5b79e0d71e
feat(search): try to decrease complexity 2025-08-30 22:30:01 -07:00
perf3ct
053f722cb8
feat(search): try to get fts search to work in large environments 2025-08-31 03:15:29 +00:00
perf3ct
21aaec2c38
feat(search): also fix tests for new fts functionality 2025-08-30 20:48:42 +00:00
perf3ct
1db4971da6
feat(search): implement FST5 w/ sqlite for faster and better searching
feat(search): don't limit the number of blobs to put in virtual tables

fix(search): improve FTS triggers to handle all SQL operations correctly

The root cause of FTS index issues during import was that database triggers
weren't properly handling all SQL operations, particularly upsert operations
(INSERT ... ON CONFLICT ... DO UPDATE) that are commonly used during imports.

Key improvements:
- Fixed INSERT trigger to handle INSERT OR REPLACE operations
- Updated UPDATE trigger to fire on ANY change (not just specific columns)
- Improved blob triggers to use INSERT OR REPLACE for atomic updates
- Added proper handling for notes created before their blobs (import scenario)
- Added triggers for protection state changes
- All triggers now use LEFT JOIN to handle missing blobs gracefully

This ensures the FTS index stays synchronized even when:
- Entity events are disabled during import
- Notes are re-imported (upsert operations)
- Blobs are deduplicated across notes
- Notes are created before their content blobs

The solution works entirely at the database level through triggers,
removing the need for application-level workarounds.

fix(search): consolidate FTS trigger fixes into migration 234

- Merged improved trigger logic from migration 235 into 234
- Deleted unnecessary migration 235 since DB version is still 234
- Ensures triggers handle all SQL operations (INSERT OR REPLACE, upserts)
- Fixes FTS indexing for imported notes by handling missing blobs
- Schema.sql and migration 234 now have identical trigger implementations
2025-08-30 20:39:40 +00:00
Elian Doran
5e28df883d
fix(server): migration failing due to geomap in protected mode (closes #6489) 2025-07-29 23:26:03 +03:00
Elian Doran
557bfbd1d6
feat(views/geomap): remove old geo map type 2025-07-06 20:23:50 +03:00
Elian Doran
f5a6dfa629
feat(views/geomap): migrate db to new collection type 2025-07-06 20:17:15 +03:00
perf3ct
44a45780b7
feat(llm): remove everything to do with embeddings 2025-06-07 18:11:12 +00:00
Elian Doran
8994f537dc
fix(migration): use bundleable migrations
This fixes TypeScript migrations, which were not being run correctly
even in previous versions.

On the ESBuild version, neither SQL migrations worked due to the fact
that they were not being bundled.
2025-05-30 21:32:35 +03:00