Receipt OCR App Flow
User flow for receipt scanning, AI classification, and expense tracking.
flowchart LR
User((User))
User -->|uploads receipt| NextJS["Next.js App<br/>(receipts.lumitra.co)"]
NextJS -->|sends image| Vision["Google Cloud Vision<br/>(OCR)"]
Vision -->|raw text| AI["OpenRouter AI<br/>(Classification)"]
AI -->|structured data| DT["Data Table<br/>(Expense Storage)"]
User -->|asks questions| Chat["AI Chat Sidebar<br/>(tool_use)"]
style User fill:#e1f5fe
style NextJS fill:#fff3e0
style Vision fill:#f3e5f5
style AI fill:#fce4ec
style DT fill:#e8f5e9
style Chat fill:#e8eaf6
Flow Description
- User uploads a receipt image
- Next.js App sends the image to Google Cloud Vision for OCR
- OpenRouter AI classifies the extracted text into structured fields (vendor, amount, date, items, SKR03 category)
- Data Table stores the classified expense data
- AI Chat Sidebar lets users ask questions about their expenses using tool_use for data retrieval