Skip to content

Move Ingestion Service Processing to Queue #40

Description

@fortune710
  1. Two new queues should be created on supabase, entry_ingestion_queue and entry_ingestion_dlq
  2. /weboook/entries API should send entry data to entry_ingestion_queue and use entry_ingestion_dlq for retries
  3. Create scheduler to pick entries up every 3 minutes
  4. Handle 429 errors from LLM using exponential backoff

Metadata

Metadata

Assignees

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions