Skip to content

Use vector store for similarity search - #1306

Open
zhangzhenghao wants to merge 10 commits into
gorse-io:masterfrom
zhangzhenghao:feat/embedding-item-to-item-vector-store
Open

Use vector store for similarity search#1306
zhangzhenghao wants to merge 10 commits into
gorse-io:masterfrom
zhangzhenghao:feat/embedding-item-to-item-vector-store

Conversation

@zhangzhenghao

@zhangzhenghao zhangzhenghao commented Jun 30, 2026

Copy link
Copy Markdown
Contributor

Summary

  • write matrix factorization item embeddings into the vector store after collaborative filtering training
  • store only matrix factorization user embeddings in blob storage, with backward-compatible worker loading for old blobs
  • generate collaborative filtering recommendations via vector search instead of local item HNSW index
  • use vector-store-backed query paths for embedding item-to-item recommendations

Tests

  • go test ./logics ./master ./worker ./server -count=1

@codecov

codecov Bot commented Jun 30, 2026

Copy link
Copy Markdown

Codecov Report

❌ Patch coverage is 78.67647% with 116 lines in your changes missing coverage. Please review.
✅ Project coverage is 72.11%. Comparing base (e57c32e) to head (c1e18c5).

Files with missing lines Patch % Lines
logics/writers.go 62.83% 26 Missing and 16 partials ⚠️
logics/item_to_item.go 87.19% 15 Missing and 11 partials ⚠️
logics/recommend.go 74.07% 7 Missing and 7 partials ⚠️
logics/user_to_user.go 86.31% 7 Missing and 6 partials ⚠️
server/rest.go 61.76% 8 Missing and 5 partials ⚠️
master/tasks.go 77.14% 4 Missing and 4 partials ⚠️
Additional details and impacted files
@@            Coverage Diff             @@
##           master    #1306      +/-   ##
==========================================
- Coverage   72.17%   72.11%   -0.07%     
==========================================
  Files          94       95       +1     
  Lines       18608    18801     +193     
==========================================
+ Hits        13430    13558     +128     
- Misses       3764     3795      +31     
- Partials     1414     1448      +34     

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@zhangzhenghao
zhangzhenghao force-pushed the feat/embedding-item-to-item-vector-store branch 4 times, most recently from a22ccab to 8dab4e6 Compare July 3, 2026 12:26
@zhangzhenghao
zhangzhenghao force-pushed the feat/embedding-item-to-item-vector-store branch 2 times, most recently from 5b9133f to 53c5e8c Compare August 5, 2026 16:41
@zhangzhenghao
zhangzhenghao force-pushed the feat/embedding-item-to-item-vector-store branch 3 times, most recently from 78ec332 to 21986f0 Compare August 11, 2026 04:42
@zhangzhenghao
zhangzhenghao force-pushed the feat/embedding-item-to-item-vector-store branch from 21986f0 to 8a3b668 Compare August 13, 2026 13:42
@zhangzhenghao
zhangzhenghao force-pushed the feat/embedding-item-to-item-vector-store branch from 1cc7117 to 3734cbf Compare August 13, 2026 16:49
@zhangzhenghao zhangzhenghao changed the title Use vector store for embedding item-to-item Use vector store for similarity search Aug 14, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants