# Project export: Elda AI
This document was generated by HackStack to give an AI agent context about a hackathon project. Sections are labeled with their provenance; content marked as truncated was cut to keep this document small.
## Project metadata
- Hackathon: Cal Hacks 12.0
- Tagline: EldaAI listens, learns, and detects, transforming eldercare with AI that monitors behavior, prevents medication mistakes, and empowers caregivers through real-time insights.
- Devpost: https://devpost.com/software/elda-ai
- GitHub: https://github.com/Gaurav890/Elda.git
- Result: winner (Claude: Best Use of Claude)
- Team: 4 GitHub contributor(s) — Gaurav Chaulagain (36 commits), Prelisa (5 commits), Claude (1 commits), Medhavee Upadhyaya (1 commits)
## Devpost submission (written by the team)
### Inspiration
When my grandmother was diagnosed with dementia, we watched her memory fade and her independence slowly disappear. Simple routines like taking medicine or remembering meals became daily struggles. That experience made us realize how deeply technology fails the people who need it most. EldaAI was born from the desire to build an AI that could understand, care, and detect before things get worse.
### What it does
EldaAI is an AI-powered eldercare platform that transforms caregiving from reminders to real-time intelligence. It listens, learns, and detects using Claude to understand speech and emotion, Letta to learn daily behavior patterns, and Chroma to detect changes over time. EldaAI automatically generates daily and monthly health summaries for doctors and caregivers, highlighting medication compliance, mood shifts, and potential cognitive decline.
### How we built it
Backend: FastAPI with PostgreSQL, JWT authentication, and APScheduler for smart reminders. AI Layer: Claude for intent and sentiment analysis, Letta for behavioral memory, Chroma for semantic pattern detection. Mobile App: Built with React Native + Expo for voice-first interaction. Caregiver Dashboard: Built with Next.js + Tailwind for real-time monitoring, insights, and alerts. Communication: Twilio for voice calls, Firebase for push notifications. Deployment: Railway (backend), Vercel (dashboard).
### Challenges we ran into
Making voice-based AI interactions natural for elderly users with limited tech familiarity. Training Claude to detect subtle emotional cues and health-related intent. Integrating multiple AI services (Claude, Letta, Chroma) seamlessly while staying within API limits. Designing a UI that feels simple enough for 80-year-olds but powerful enough for doctors.
### Accomplishments we're proud of
Built a fully functional prototype Mobile App for Elder People and Care Giver web app in 2 days that integrates Claude, Letta, and Chroma. Successfully generated real-time AI health summaries from daily conversations. Designed a caregiver dashboard that visualizes daily mood and medication adherence. Created a system that bridges empathy, AI, and healthcare — something our team truly believes in. Building human-centric AI means designing for emotion, not just accuracy. Simplicity in UX is more powerful than complexity in features — especially for elders. Prompt engineering and data context are key to getting reliable results from LLMs like Claude. Collaboration across AI, design, and healthcare perspectives can create deeply impactful solutions.
### What's next
for EldaAI Integrate with wearable health data (heart rate, sleep, activity) for early disease detection. Enable multi-language and cultural personalization for global accessibility. Expand caregiver tools to include doctor collaboration and long-term pattern analytics. Long-term vision: Let people “train” their AI throughout their lives so when they age, their AI already knows them deeply, acting as a personal caregiver and memory companion.
## README (from the GitHub repository)
# Elder Companion AI - Complete Project Specification
## Project Overview
**Elder Companion AI** is a voice-first mobile application designed to help elderly individuals (especially those with Alzheimer's, dementia, or living alone) maintain their daily routines through intelligent reminders, conversational AI companionship, and caregiver oversight.
### Core Innovation
- **Voice-first interaction**: All patient communication happens in-app through voice
- **AI that learns**: System adapts to each patient's patterns over time
- **Proactive monitoring**: Multiple detection methods ensure safety
- **Family connection**: Caregivers stay informed without being intrusive
### What Makes This Special
- **NOT just a reminder app**: It's a companion that learns, adapts, and cares
- **NOT an alarm system**: It's conversational and empathetic
- **NOT a replacement for caregivers**: It's a tool to enhance care and maintain independence
----------
## Table of Contents
1. [System Architecture](#system-architecture)
2. [Tech Stack](#tech-stack)
3. [Database Schema](#database-schema)
4. [Core Features](#core-features)
5. [AI Integration Strategy](#ai-integration-strategy)
6. [Communication Flow](#communication-flow)
7. [Mobile App Specifications](#mobile-app-specifications)
8. [Web Dashboard Specifications](#web-dashboard-specifications)
9. [API Design](#api-design)
10. [Security & Privacy](#security-privacy)
11. [Implementation Timeline](#implementation-timeline)
12. [Testing Strategy](#testing-strategy)
13. [Deployment Strategy](#deployment-strategy)
14. [Demo Preparation](#demo-preparation)
----------
## System Architecture
### High-Level Architecture
```
┌─────────────────────────────────────────────────────────────┐
│ CAREGIVER WEB DASHBOARD │
│ - Patient management │
│ - Schedule configuration │
│ - Real-time monitoring │
│ - Daily reports and insights │
│ - Alert management │
└────────────────────────┬─────────────────────────────────────┘
│
│ HTTPS REST API
│ (Polling every 5-10 seconds)
│
┌────────────────────────▼─────────────────────────────────────┐
│ BACKEND SERVER │
│ (FastAPI) │
│ │
│ ┌────────────────────────────────────────────────────┐ │
│ │ CORE SERVICES │ │
│ │ • Scheduler (APScheduler - check-ins every 2hrs) │ │
│ │ • Activity Monitor (check every 30 min) │ │
│ │ • Alert Manager │ │
│ │ • Daily Summary Generator (midnight) │ │
│ └────────────────────────────────────────────────────┘ │
│ │
│ ┌────────────────────────────────────────────────────┐ │
│ │ AI LAYER │ │
│ │ │ │
│ │ ┌─────────────┐ ┌─────────────┐ ┌──────────┐ │ │
│ │ │ CLAUDE │ │ LETTA │ │ CHROMA │ │ │
│ │ │ │ │ │ │ │ │ │
│ │ │ Real-time │ │ Long-term │ │ Semantic │ │ │
│ │ │ Understanding│ │ Memory │ │ Search │ │ │
│ │ └─────────────┘ └─────────────┘ └──────────┘ │ │
│ └────────────────────────────────────────────────────┘ │
│ │
│ ┌────────────────────────────────────────────────────┐ │
│ │ COMMUNICATION SERVICES │ │
│ │ • Twilio (SMS/Calls to CAREGIVERS only) │ │
│ │ • Firebase (Push notifications to patient app) │ │
│ │ • Vapi (Optional voice AI enhancement) │ │
│ └────────────────────────────────────────────────────┘ │
│ │
│ ┌────────────────────────────────────────────────────┐ │
│ │ DATABASE (PostgreSQL) │ │
│ │ • Patient profiles │ │
│ │ • Schedules & reminders │ │
│ │ • Conversations │ │
│ │ • Activity logs │ │
│ │ • Alerts & insights │ │
│ └────────────────────────────────────────────────────┘ │
└────────────────────────┬─────────────────────────────────────┘
│
│ HTTPS REST API
│ Push Notifications (Firebase)
│
┌────────────────────────▼─────────────────────────────────────┐
│ PATIENT MOBILE APP (React Native) │
│ │
│ ┌──────────────────────────────────────────────────────┐ │
│ │ VOICE INTERACTION LAYER │ │
│ │ • Voice input (react-native-voice) │ │
│ │ • Voice output (expo-speech TTS) │ │
│ │ • Always-visible "Talk to Me" button │ │
│ │ • Wake word detection: "Hey Companion" (optional) │ │
│ └──────────────────────────────────────────────────────┘ │
│ │
│ ┌──────────────────────────────────────────────────────┐ │
│ │ MONITORING LAYER │ │
│ │ • Activity tracker (sends heartbeat every 15 min) │ │
│ │ • Accelerometer (motion detection) │ │
│ │ • App state tracking (foreground/background) │ │
│ └──────────────────────────────────────────────────────┘ │
│ │
│ ┌──────────────────────────────────────────────────────┐ │
│ │ SAFETY FEATURES │ │
│ │ • Emergency button (giant, red, always visible) │ │
│ │ • Scheduled check-ins (every 2 hours) │ │
│ │ • Manual check-in trigger │ │
│ └──────────────────────────────────────────────────────┘ │
└──────────────────────────────────────────────────────────────┘
NOTE: IoT Integration (Alexa, Google Home, Smart Pill Dispensers)
is NOT part of this hackathon build. Mention as future roadmap.
```
---
### Data Flow Diagrams
#### 1. Scheduled Check-In Flow
```
EVERY 2 HOURS:
Backend Scheduler triggers check-in
↓
Send push notification to patient's app
"Hi Maggie, just checking in. How are you feeling?"
↓
App receives notification
↓
App plays TTS: "Hi Maggie, just checking in. How are you feeling?"
↓
App starts listening for voice input (30 second timeout)
↓
┌─────────────────────┬────────────────────────┐
│ │ │
PATIENT RESPONDS NO RESPONSE
↓ ↓
Voice → Text Wait 30 seconds
↓ ↓
Send to Backend Send second prompt:
↓ "Maggie, please say something
Backend: so I know you're okay"
1. Get Letta ↓
context Listen again (30 sec)
2. Send to ↓
Claude ┌──────┬──────┐
3. Analyze │ │
response RESPONDS STILL NO RESPONSE
4. Update ↓ ↓
Letta (same CREATE ALERT
5. Generate as ↓
reply left) Notify caregiver:
↓ • SMS via Twilio
Send response • Dashboard update
to app • Log in database
↓
App speaks respo
[README truncated for size]
## Detected evidence (automated analysis)
Indexed codebase: 271 recognized source files, 1907 KB.
- Anthropic (technology) — detected in the code
- C (language) — detected in the code
- CSS (language) — detected in the code
- FastAPI (technology) — detected in the code
- HTML (language) — detected in the code
- Java (language) — detected in the code
- JavaScript (language) — detected in the code
- Next.js (technology) — detected in the code
- Python (language) — detected in the code
- React (technology) — detected in the code
- Tailwind CSS (technology) — detected in the code
- TypeScript (language) — detected in the code
- AI coding agent: Claude Code — evidence: config files committed to the repository; commit authorship or trailers
## Codebase structure (from repository index)
### Files (120 of 316)
```
.claude/QUICK_COMMANDS.md
.claude/README.md
.claude/RESUME.md
.claude/SESSION_STATE.md
.DS_Store
.gitignore
backend/.env.example
backend/.gitignore
backend/alembic.ini
backend/alembic/env.py
backend/alembic/script.py.mako
backend/alembic/versions/0fce1b03abdf_add_mobile_setup_fields_to_patient.py
backend/alembic/versions/7ccebe398c0e_add_enhanced_patient_profile_fields.py
backend/alembic/versions/8ab72b20f47b_add_caregiver_preferences_column.py
backend/alembic/versions/9a5c40d1e6f3_add_caregiver_notes_table.py
backend/alembic/versions/a72a74be09a9_initial_migration_create_all_tables_.py
backend/app/__init__.py
backend/app/api/__init__.py
backend/app/api/v1/__init__.py
backend/app/api/v1/activity.py
backend/app/api/v1/auth.py
backend/app/api/v1/conversations.py
backend/app/api/v1/letta.py
backend/app/api/v1/mobile.py
backend/app/api/v1/notes.py
backend/app/api/v1/patients.py
backend/app/api/v1/reports.py
backend/app/api/v1/schedules.py
backend/app/api/v1/voice.py
backend/app/core/__init__.py
backend/app/core/config.py
backend/app/core/dependencies.py
backend/app/core/security.py
backend/app/database/__init__.py
backend/app/database/base.py
backend/app/database/session.py
backend/app/jobs/__init__.py
backend/app/jobs/inactivity_detector.py
backend/app/jobs/reminder_generator.py
backend/app/jobs/scheduler.py
backend/app/jobs/summary_generator.py
backend/app/main.py
backend/app/models/__init__.py
backend/app/models/activity_log.py
backend/app/models/alert.py
backend/app/models/caregiver.py
backend/app/models/conversation.py
backend/app/models/daily_summary.py
backend/app/models/insight.py
backend/app/models/note.py
backend/app/models/patient.py
backend/app/models/relationship.py
backend/app/models/reminder.py
backend/app/models/schedule.py
backend/app/models/system_log.py
backend/app/schemas/__init__.py
backend/app/schemas/activity.py
backend/app/schemas/auth.py
backend/app/schemas/conversation.py
backend/app/schemas/insight.py
backend/app/schemas/mobile.py
backend/app/schemas/note.py
backend/app/schemas/patient.py
backend/app/schemas/report.py
backend/app/schemas/schedule.py
backend/app/scripts/__init__.py
backend/app/scripts/init_letta_agents.py
backend/app/seeds/__init__.py
backend/app/seeds/comprehensive_seed.py
backend/app/seeds/mobile_test_seed.py
backend/app/seeds/README.md
backend/app/services/__init__.py
backend/app/services/ai_orchestrator.py
backend/app/services/ai/__init__.py
backend/app/services/chroma_service.py
backend/app/services/claude_service.py
backend/app/services/communication/__init__.py
backend/app/services/communication/firebase_service.py
backend/app/services/letta_service.py
backend/app/services/reports.py
backend/app/services/scheduler/__init__.py
backend/app/utils/__init__.py
backend/check_device_tokens.py
backend/create_instant_test_reminder.py
backend/create_local_notif_test_reminder.py
backend/create_test_conversations.py
backend/create_test_reminder.py
backend/create_test_user_v2.py
backend/create_test_user.py
backend/create_upcoming_reminders.py
backend/documents/BACKEND_INTEGRATION_PLAN.md
backend/documents/MASTER_BACKEND_DOCUMENTATION.md
backend/generate_qr_page.py
backend/get_patient_credentials.py
backend/Procfile
backend/railway.json
backend/README.md
backend/requirements.txt
backend/test_activity_monitoring.py
backend/test_create_reminder_for_testing.py
backend/test_enhanced_patient_profile.py
backend/test_inactivity_detection.py
backend/test_mobile_endpoints.py
backend/test_preferences.py
backend/test_send_notification.py
backend/tests/__init__.py
caregiver-dashboard/.env.example
caregiver-dashboard/.eslintrc.json
caregiver-dashboard/.gitignore
caregiver-dashboard/clear-storage.html
caregiver-dashboard/components.json
caregiver-dashboard/Documents/CAREGIVER_WEB_APP_API_GUIDE.md
caregiver-dashboard/Documents/CAREGIVER_WEB_APP_SETUP_GUIDE.md
caregiver-dashboard/Documents/CAREGIVER_WEB_APP_SPECIFICATION.md
caregiver-dashboard/Documents/CAREGIVER_WEB_APP_TASKS.md
caregiver-dashboard/Documents/CaregiverDesign.md
caregiver-dashboard/Documents/DASHBOARD_QR_CODE_IMPLEMENTATION.md
caregiver-dashboard/Documents/WEB_DASHBOARD_FRONTEND_STATUS.md
caregiver-dashboard/next.config.js
caregiver-dashboard/package.json
[196 more files omitted for size]
```
### Dependencies
- backend/requirements.txt: alembic@==1.12.1, anthropic@==0.7.7, apscheduler@==3.10.4, chromadb@==0.4.18, fastapi@==0.104.1, firebase-admin@==6.3.0, httpx@==0.25.2, numpy@<2.0, passlib[bcrypt]@==1.7.4, psycopg2-binary@==2.9.9, pydantic-settings@==2.1.0, pydantic[email]@==2.5.0, pytest@==7.4.3, pytest-asyncio@==0.21.1, python-dateutil@==2.8.2, python-dotenv@==1.0.0, python-jose[cryptography]@==3.3.0, python-multipart@==0.0.6, requests@==2.31.0, sqlalchemy@==2.0.23, twilio@==8.11.0, uvicorn[standard]@==0.24.0
- caregiver-dashboard/package.json: @hookform/resolvers@^3.10.0, @radix-ui/react-alert-dialog@^1.1.15, @radix-ui/react-avatar@^1.1.10, @radix-ui/react-checkbox@^1.3.3, @radix-ui/react-dialog@^1.1.15, @radix-ui/react-dropdown-menu@^2.1.16, @radix-ui/react-label@^2.1.7, @radix-ui/react-popover@^1.1.15, @radix-ui/react-progress@^1.1.7, @radix-ui/react-select@^2.2.6, @radix-ui/react-separator@^1.1.7, @radix-ui/react-slot@^1.2.3, @radix-ui/react-switch@^1.2.6, @radix-ui/react-tabs@^1.1.13, @radix-ui/react-toast@^1.2.15, @tanstack/react-query@^5.59.20, @tanstack/react-query-devtools@^5.59.20, @types/node@^22.9.0, @types/react@^18.3.12, @types/react-dom@^18.3.1, autoprefixer@^10.4.20, axios@^1.7.7, class-variance-authority@^0.7.1, clsx@^2.1.1, date-fns@^4.1.0, date-fns-tz@^3.2.0, eslint@^9.14.0, eslint-config-next@15.0.3, lucide-react@^0.460.0, next@15.0.3, postcss@^8.4.47, qrcode.react@^4.2.0, react@^18.3.1, react-day-picker@^9.11.1, react-dom@^18.3.1, react-hook-form@^7.65.0, recharts@^3.3.0, tailwind-merge@^2.6.0, tailwindcss@^3.4.14, tailwindcss-animate@^1.0.7, typescript@^5.6.3, zod@^3.25.76
- elder-companion-mobile/package.json: @babel/core@^7.23.0, @babel/preset-env@^7.23.0, @babel/runtime@^7.23.0, @notifee/react-native@^9.1.8, @react-native-async-storage/async-storage@^1.19.5, @react-native-community/netinfo@^9.5.0, @react-native-firebase/app@^18.6.1, @react-native-firebase/messaging@^18.6.1, @react-native-voice/voice@^3.2.4, @react-native/eslint-config@^0.72.2, @react-native/metro-config@^0.72.11, @react-navigation/native@^6.1.9, @react-navigation/stack@^6.3.20, @types/react@^18.2.0, @types/react-native@^0.72.0, @typescript-eslint/eslint-plugin@^6.0.0, @typescript-eslint/parser@^6.0.0, axios@^1.6.0, babel-jest@^29.6.0, babel-plugin-module-resolver@^5.0.2, date-fns@^2.30.0, eslint@^8.50.0, jest@^29.6.0, metro-react-native-babel-preset@^0.76.8, react@18.2.0, react-native@0.72.6, react-native-background-fetch@^4.2.0, react-native-camera@^4.2.1, react-native-device-info@^14.1.1, react-native-gesture-handler@^2.13.4, react-native-permissions@^5.4.2, react-native-qrcode-scanner@^1.5.5, react-native-safe-area-context@^4.7.4, react-native-screens@^3.27.0, react-native-tts@^4.1.0, typescript@^5.2.0, zustand@^4.4.6
### Recent commits (newest first)
- Update REBUILD_FOR_DEMO.sh
- Streamlined files
- Updated readme file
- Updated Readme.md
- Files cleanup
- Delete LICENSE
- Updated readme.md
- Updated Readme.md
- Updarted Readme.md
- dump
- working on reminder system
- Firebase error fixed in simulator
- Firebase was added to ios and android but app is crashing
- Voice chat is working and TTS is also working
- Live chat and text transcription in progress
- Mobile inital version integrated with basic apis
- Worked on mobile app- Initial project setup done
- added QR module backend api and working on integrating QRs in web app for caregiver
- integrated letta
- Completed initial api integration and testing
## Key source files (fetched from GitHub, selected and truncated for size)
### elder-companion-mobile/UserDesign.md
```markdown
You are an expert mobile UX/UI designer.
Design the complete front end for the “Elder Companion AI” patient mobile app.
Goal:
Deliver an accessible, voice-first interface that elderly users can operate easily.
---
# 1. Brand & Visual System
Same palette as the web app:
primary #3566E5, accent #F47C63, bg #F9FAFB, surface #FFFFFF, text #1A1A1A, success #4CAF50, error #E53935.
Typography:
- Headings : Playfair Display Bold 24 pt
- Body : Nunito Sans Regular 16 pt
- Buttons : Semi-Bold 18 pt
Shape & Spacing:
- 8 dp grid
- Corner radius 16 dp
- Card shadow subtle elevation 2
- Large tap targets (≥52 dp)
Voice & Accessibility:
- Every action has speech feedback and visible captions
- High contrast mode supported
- Caption area for all spoken text
- Haptics on confirmation
---
# 2. Navigation
Stack Navigator:
`Welcome → CodeEntry → QRScan → Permissions → Tabs(Home)`
Bottom Tabs:
- Main (voice-first home)
- Reminders
- Settings
---
# 3. Screen Designs
## Welcome
- Greeting text: “Hello! I’m your companion.”
- Two large buttons: “Enter Code”, “Scan QR”
- Calm background gradient (blue → white)
## Code Entry
- Label: “Enter your 6-digit code”
- 6 input boxes with focus animation
- Primary button: “Continue”
- Error variant: red text “This code looks old. Let’s try a fresh one.”
## QR Scan
- Camera preview frame with rounded corners
- Instruction text: “Align the QR code inside the frame”
- Cancel button (secondary)
## Permissions
- Three cards: Microphone / Notifications / Location
- Each card → icon + short rationale
“We’ll use your microphone to listen when you tap the mic.”
- Button: “Allow All and Continue”
## Home (Main Tab)
- Greeting line: “Good afternoon, Mary 🌞”
- Next Reminder Card:
• Time (e.g., 2:00 PM)
• Label “Medication — Yellow pill on the table”
• Status dot (yellow = upcoming)
- Big circular Microphone button (center) with pulse animation
- Caption line beneath mic (show live transcript)
- Persistent red “Emergency” button bottom center
- Tabs below: Main (active blue), Reminders, Settings
Voice States:
1. Idle → caption “Tap the mic to talk.”
2. Listening → animated waveform + “Listening…”
3. Processing → spinner + “Processing…”
4. Speaking → speech bubble shows AI reply text + TTS.
Transition animations < 300 ms.
## Voice Overlay (Modal)
- Full-screen gradient background
- Center: waveform animation
- State labels: “Listening …”, “Processing …”, “Speaking …”
- Bottom buttons: End Chat (red), Mute (gray)
- Caption area for live transcript text.
## Reminders Tab
- Header: “Today’s Reminders”
- List items: time, label, status chip (completed/pending/escalated)
- Tap → bottom sheet with actions: “Hear Description” (plays TTS), “Mark Done”
- Empty state: “No reminders right now.”
## Settings Tab
- Language selector (dropdown)
- Voice tone radio group (gentle / cheerful / formal)
- Toggle “Listening always on” with description
- About card (app version, copyright)
- Save button (primary)
[truncated — 1178 more characters]
```
### Documents/API_CONNECTION_FIX.md
```markdown
# API Connection Issues - Fixed! 🔧
## Problems Identified
### 1. **Wrong IP Address in Mobile App**
- **Issue**: Mobile app was configured to use `192.168.4.36:8000`
- **Your actual IP**: `10.72.1.235`
- **Fix**: Updated to use `localhost:8000` for simulator
### 2. **Multiple Backend Processes**
- **Issue**: Backend logs show "Address already in use"
- **Cause**: Multiple uvicorn processes trying to run on port 8000
- **Fix**: Kill all processes and start clean
### 3. **Mobile App Cache**
- **Issue**: Even after fixing IP, app still uses old cached config
- **Fix**: Clean build and reinstall pods
---
## ✅ What I Fixed
### 1. Mobile App API Configuration
**File**: `elder-companion-mobile/src/config/api.ts`
**Changed from:**
```typescript
return 'http://192.168.4.36:8000'; // WRONG IP!
```
**Changed to:**
```typescript
return 'http://localhost:8000'; // Correct for simulator
```
**For Physical iPhone:**
If you need to test on real device, it will use: `http://10.72.1.235:8000`
---
## 🚀 How to Fix Everything (One Command!)
Run this automated fix script:
```bash
cd /Users/gaurav/Elda
./FIX_API_CONNECTIONS.sh
```
**This script will:**
1. ✅ Kill all running processes (backend, metro, react-native)
2. ✅ Kill any process using port 8000 or 3000
3. ✅ Start backend cleanly on port 8000
4. ✅ Clean mobile app build cache
5. ✅ Reinstall iOS pods
6. ✅ Rebuild mobile app with correct API config
7. ✅ (Optional) Start dashboard
**Choose option 1** when asked - this builds for iPhone Simulator with localhost:8000
---
## 🧪 Testing After Fix
### Test 1: Backend is Running
```bash
curl http://localhost:8000/docs
```
**Expected**: HTML response (docs page)
### Test 2: Backend API Endpoint
```bash
curl http://localhost:8000/api/v1/health || curl http://localhost:8000/
```
**Expected**: JSON response
### Test 3: Mobile App Setup
1. Wait for build to complete (2-3 minutes)
2. App opens in simulator
3. Try to set up with patient credentials
4. Should connect to `http://localhost:8000`
### Test 4: Dashboard
1. Open http://localhost:3000 in browser
2. Login: sarah.miller@example.com / test123
3. Should see patients list
---
## 🔍 Debugging Commands
### Check Backend Status
```bash
# Test if responding
curl -I http://localhost:8000/docs
# View logs
tail -f /tmp/elda-backend-clean.log
# Check what's running on port 8000
lsof -i:8000
```
### Check Mobile App Configuration
```bash
cd /Users/gaurav/Elda/elder-companion-mobile
grep -A5 "return 'http" src/config/api.ts
```
### Restart Backend Manually
```bash
# Kill everything on port 8000
lsof -ti:8000 | xargs kill -9
# Start fresh
cd /Users/gaurav/Elda/backend
source venv/bin/activate
uvicorn app.main:app --reload --host 0.0.0.0 --port 8000
```
### Rebuild Mobile App Manually
```bash
cd /Users/gaurav/Elda/elder-companion-mobile
# Clean
rm -rf ios/build
rm -rf /tmp/metro-*
watchman watch-del-all
# Reinstall pods
cd ios && pod install && cd ..
# Build
npx react-native run-ios
```
---
## 📱 Mo
[truncated — 2971 more characters]
```
### backend/requirements.txt
```
# Web Framework
fastapi==0.104.1
uvicorn[standard]==0.24.0
python-multipart==0.0.6
# Database
sqlalchemy==2.0.23
alembic==1.12.1
psycopg2-binary==2.9.9
# Authentication & Security
python-jose[cryptography]==3.3.0
passlib[bcrypt]==1.7.4
python-dotenv==1.0.0
pydantic[email]==2.5.0
pydantic-settings==2.1.0
# AI Services
anthropic==0.7.7
chromadb==0.4.18
numpy<2.0 # chromadb 0.4.18 requires numpy 1.x
requests==2.31.0
# Communication Services
twilio==8.11.0
firebase-admin==6.3.0
# Background Jobs
apscheduler==3.10.4
# Utilities
python-dateutil==2.8.2
# Development
pytest==7.4.3
pytest-asyncio==0.21.1
httpx==0.25.2
```
### caregiver-dashboard/package.json
```
{
"name": "caregiver-dashboard",
"version": "0.1.0",
"private": true,
"scripts": {
"dev": "next dev",
"build": "next build",
"start": "next start",
"lint": "next lint"
},
"dependencies": {
"@hookform/resolvers": "^3.10.0",
"@radix-ui/react-alert-dialog": "^1.1.15",
"@radix-ui/react-avatar": "^1.1.10",
"@radix-ui/react-checkbox": "^1.3.3",
"@radix-ui/react-dialog": "^1.1.15",
"@radix-ui/react-dropdown-menu": "^2.1.16",
"@radix-ui/react-label": "^2.1.7",
"@radix-ui/react-popover": "^1.1.15",
"@radix-ui/react-progress": "^1.1.7",
"@radix-ui/react-select": "^2.2.6",
"@radix-ui/react-separator": "^1.1.7",
"@radix-ui/react-slot": "^1.2.3",
"@radix-ui/react-switch": "^1.2.6",
"@radix-ui/react-tabs": "^1.1.13",
"@radix-ui/react-toast": "^1.2.15",
"@tanstack/react-query": "^5.59.20",
"@tanstack/react-query-devtools": "^5.59.20",
"axios": "^1.7.7",
"class-variance-authority": "^0.7.1",
"clsx": "^2.1.1",
"date-fns": "^4.1.0",
"date-fns-tz": "^3.2.0",
"lucide-react": "^0.460.0",
"next": "15.0.3",
"qrcode.react": "^4.2.0",
"react": "^18.3.1",
"react-day-picker": "^9.11.1",
"react-dom": "^18.3.1",
"react-hook-form": "^7.65.0",
"recharts": "^3.3.0",
"tailwind-merge": "^2.6.0",
"zod": "^3.25.76"
},
"devDependencies": {
"@types/node": "^22.9.0",
"@types/react": "^18.3.12",
"@types/react-dom": "^18.3.1",
"autoprefixer": "^10.4.20",
"eslint": "^9.14.0",
"eslint-config-next": "15.0.3",
"postcss": "^8.4.47",
"tailwindcss": "^3.4.14",
"tailwindcss-animate": "^1.0.7",
"typescript": "^5.6.3"
}
}
```
### elder-companion-mobile/package.json
```
{
"name": "elder-companion-mobile",
"version": "1.0.0",
"description": "Elder Companion AI - Mobile App for Patients",
"main": "index.js",
"scripts": {
"android": "react-native run-android",
"ios": "react-native run-ios",
"start": "react-native start",
"test": "jest",
"lint": "eslint . --ext .js,.jsx,.ts,.tsx"
},
"dependencies": {
"@notifee/react-native": "^9.1.8",
"@react-native-async-storage/async-storage": "^1.19.5",
"@react-native-community/netinfo": "^9.5.0",
"@react-native-firebase/app": "^18.6.1",
"@react-native-firebase/messaging": "^18.6.1",
"@react-native-voice/voice": "^3.2.4",
"@react-navigation/native": "^6.1.9",
"@react-navigation/stack": "^6.3.20",
"axios": "^1.6.0",
"date-fns": "^2.30.0",
"react": "18.2.0",
"react-native": "0.72.6",
"react-native-background-fetch": "^4.2.0",
"react-native-camera": "^4.2.1",
"react-native-device-info": "^14.1.1",
"react-native-gesture-handler": "^2.13.4",
"react-native-permissions": "^5.4.2",
"react-native-qrcode-scanner": "^1.5.5",
"react-native-safe-area-context": "^4.7.4",
"react-native-screens": "^3.27.0",
"react-native-tts": "^4.1.0",
"zustand": "^4.4.6"
},
"devDependencies": {
"@babel/core": "^7.23.0",
"@babel/preset-env": "^7.23.0",
"@babel/runtime": "^7.23.0",
"@react-native/eslint-config": "^0.72.2",
"@react-native/metro-config": "^0.72.11",
"@types/react": "^18.2.0",
"@types/react-native": "^0.72.0",
"@typescript-eslint/eslint-plugin": "^6.0.0",
"@typescript-eslint/parser": "^6.0.0",
"babel-jest": "^29.6.0",
"babel-plugin-module-resolver": "^5.0.2",
"eslint": "^8.50.0",
"jest": "^29.6.0",
"metro-react-native-babel-preset": "^0.76.8",
"typescript": "^5.2.0"
},
"engines": {
"node": ">=16"
}
}
```
### elder-companion-mobile/index.js
```javascript
/**
* Elder Companion Mobile App
* Entry Point
*/
import { AppRegistry } from 'react-native';
import App from './App';
import { name as appName } from './app.json';
// Register background handler for Firebase notifications
// Note: This must be outside of any component
try {
const messaging = require('@react-native-firebase/messaging').default;
messaging().setBackgroundMessageHandler(async (remoteMessage) => {
console.log('[Background] Message received:', remoteMessage);
// Background handler logic is in notification.service.ts
return Promise.resolve();
});
} catch (error) {
console.log('[Background] Firebase messaging not available yet:', error.message);
}
AppRegistry.registerComponent(appName, () => App);
```
### elder-companion-mobile/App.tsx
```typescript
/**
* Elder Companion Mobile App
* Main App Component
*/
import React, { useEffect } from 'react';
import { SafeAreaView, StatusBar, StyleSheet } from 'react-native';
import { GestureHandlerRootView } from 'react-native-gesture-handler';
import { AppNavigator } from './src/navigation/AppNavigator';
import { useSettingsStore } from './src/stores/settings.store';
import { notificationService } from './src/services/notification.service';
import { heartbeatService } from './src/services/heartbeat.service';
function App(): JSX.Element {
const { loadSettings } = useSettingsStore();
// Load settings and initialize services on app start
useEffect(() => {
const initializeApp = async () => {
try {
console.log('[App] Initializing...');
// Load settings first
await loadSettings();
// Initialize push notifications (non-blocking)
setTimeout(() => {
notificationService.initialize().catch((error) => {
console.error('[App] Failed to initialize notification service:', error);
});
}, 1000);
// Initialize heartbeat service (background tasks)
setTimeout(() => {
heartbeatService.initialize().catch((error) => {
console.error('[App] Failed to initialize heartbeat service:', error);
});
}, 1500);
console.log('[App] Initialization complete');
} catch (error) {
console.error('[App] Initialization error:', error);
}
};
initializeApp();
}, [loadSettings]);
return (
);
}
const styles = StyleSheet.create({
container: {
flex: 1,
},
});
export default App;
```
### backend/app/main.py
```python
"""
Elder Companion AI - FastAPI Backend
Main application entry point
"""
from fastapi import FastAPI
from fastapi.middleware.cors import CORSMiddleware
from fastapi.responses import JSONResponse
import logging
from contextlib import asynccontextmanager
from app.core.config import settings
# Configure logging
logging.basicConfig(
level=logging.INFO if settings.APP_ENV == "production" else logging.DEBUG,
format="%(asctime)s - %(name)s - %(levelname)s - %(message)s"
)
logger = logging.getLogger(__name__)
@asynccontextmanager
async def lifespan(app: FastAPI):
"""
Lifespan context manager for startup and shutdown events
"""
# Startup
logger.info("Starting Elder Companion AI Backend")
logger.info(f"Environment: {settings.APP_ENV}")
# Initialize AI services
try:
from app.services.chroma_service import chroma_service
logger.info("Chroma service initialized successfully")
except Exception as e:
logger.error(f"Failed to initialize Chroma service: {e}")
# Initialize background job scheduler
try:
from app.jobs.scheduler import start_scheduler
start_scheduler()
logger.info("Background job scheduler started")
except Exception as e:
logger.error(f"Failed to start scheduler: {e}")
yield
# Shutdown
logger.info("Shutting down Elder Companion AI Backend")
# Shutdown background scheduler
try:
from app.jobs.scheduler import shutdown_scheduler
shutdown_scheduler()
logger.info("Background job scheduler stopped")
except Exception as e:
logger.error(f"Error stopping scheduler: {e}")
# Create FastAPI app
app = FastAPI(
title="Elder Companion AI API",
description="Backend API for Elder Companion AI - Voice-enabled elderly care platform",
version="1.0.0",
docs_url="/docs",
redoc_url="/redoc",
lifespan=lifespan
)
# Configure CORS
app.add_middleware(
CORSMiddleware,
allow_origins=settings.cors_origins_list,
allow_credentials=True,
allow_methods=["*"],
allow_headers=["*"],
)
# Health check endpoint
@app.get("/health", tags=["Health"])
async def health_check():
"""
Health check endpoint for monitoring
"""
return JSONResponse(
status_code=200,
content={
"status": "healthy",
"service": "elder-companion-api",
"version": "1.0.0",
"environment": settings.APP_ENV
}
)
# Scheduler status endpoint
@app.get("/admin/scheduler", tags=["Admin"])
async def scheduler_status():
"""
Get background job scheduler status
"""
from app.jobs.scheduler import get_scheduler_status
return get_scheduler_status()
# Root endpoint
@app.get("/", tags=["Root"])
async def root():
"""
Root endpoint
"""
return {
"message": "Elder Companion AI API",
"version": "1.0.0",
"docs": "/docs",
"health": "/health"
}
# Include API routers
from app.api.v1 import auth, patients, schedules, conversations, voice, notes, activity, reports, letta, mobile
app.include_router(auth.router, prefix="/api/v1/auth", tags=["Authentication"])
app.include_router(patients.router, prefix="/api/v1/patients", tags=["Patients"])
app.include_router(schedules.router, prefix="/api/v1/schedules", tags=["Schedules"])
app.include_router(conversations.router, prefix="/api/v1/conversations", tags=["Conversations"])
app.include_router(voice.router, prefix="/api/v1/voice", tags=["Voice Interaction"])
app.include_router(notes.router, prefix="/api/v1", tags=["Caregiver Notes"])
app.include_router(activity.router, prefix="/api/v1", tags=["Activity Logs"])
app.include_router(reports.router, prefix="/api/v1", tags=["Reports"])
app.include_router(letta.router, prefix="/api/v1/letta", tags=["Letta AI Integration"])
app.include_router(mobile.router, prefix="/api/v1/mobile", tags=["Mobile App"])
if __name__ == "__main__":
import uvicorn
uvicorn.run(
"app.main:app",
host="0.0.0.0",
port=8000,
reload=True if settings.APP_ENV == "development" else False
)
```
### elder-companion-mobile/src/styles/index.ts
```typescript
/**
* Design System Index
* Central export point for all design system modules
*/
export { Colors } from './colors';
export { Typography, FontFamily, FontWeight } from './typography';
export { Spacing, BorderRadius, TouchTarget, Elevation, ScreenPadding } from './spacing';
/**
* Usage:
*
* import { Colors, Typography, Spacing } from '../styles';
*
* const styles = StyleSheet.create({
* container: {
* backgroundColor: Colors.primary,
* padding: Spacing.md,
* },
* text: {
* ...Typography.h1,
* color: Colors.text,
* },
* });
*/
```
### caregiver-dashboard/src/app/page.tsx
```typescript
'use client';
// Root page - Redirects to appropriate page based on auth status
import { useEffect } from 'react';
import { useRouter } from 'next/navigation';
import { isAuthenticated } from '@/lib/auth/storage';
export default function HomePage() {
const router = useRouter();
useEffect(() => {
// Redirect based on authentication status
if (isAuthenticated()) {
router.push('/care-circle');
} else {
router.push('/login');
}
}, [router]);
// Show loading state while redirecting
return (
);
}
```
[240 more indexed source files omitted to keep this export small. The full file list is in the Codebase structure section above.]