# Project export: Elda AI This document was generated by HackStack to give an AI agent context about a hackathon project. Sections are labeled with their provenance; content marked as truncated was cut to keep this document small. ## Project metadata - Hackathon: Cal Hacks 12.0 - Tagline: EldaAI listens, learns, and detects, transforming eldercare with AI that monitors behavior, prevents medication mistakes, and empowers caregivers through real-time insights. - Devpost: https://devpost.com/software/elda-ai - GitHub: https://github.com/Gaurav890/Elda.git - Result: winner (Claude: Best Use of Claude) - Team: 4 GitHub contributor(s) — Gaurav Chaulagain (36 commits), Prelisa (5 commits), Claude (1 commits), Medhavee Upadhyaya (1 commits) ## Devpost submission (written by the team) ### Inspiration When my grandmother was diagnosed with dementia, we watched her memory fade and her independence slowly disappear. Simple routines like taking medicine or remembering meals became daily struggles. That experience made us realize how deeply technology fails the people who need it most. EldaAI was born from the desire to build an AI that could understand, care, and detect before things get worse. ### What it does EldaAI is an AI-powered eldercare platform that transforms caregiving from reminders to real-time intelligence. It listens, learns, and detects using Claude to understand speech and emotion, Letta to learn daily behavior patterns, and Chroma to detect changes over time. EldaAI automatically generates daily and monthly health summaries for doctors and caregivers, highlighting medication compliance, mood shifts, and potential cognitive decline. ### How we built it Backend: FastAPI with PostgreSQL, JWT authentication, and APScheduler for smart reminders. AI Layer: Claude for intent and sentiment analysis, Letta for behavioral memory, Chroma for semantic pattern detection. Mobile App: Built with React Native + Expo for voice-first interaction. Caregiver Dashboard: Built with Next.js + Tailwind for real-time monitoring, insights, and alerts. Communication: Twilio for voice calls, Firebase for push notifications. Deployment: Railway (backend), Vercel (dashboard). ### Challenges we ran into Making voice-based AI interactions natural for elderly users with limited tech familiarity. Training Claude to detect subtle emotional cues and health-related intent. Integrating multiple AI services (Claude, Letta, Chroma) seamlessly while staying within API limits. Designing a UI that feels simple enough for 80-year-olds but powerful enough for doctors. ### Accomplishments we're proud of Built a fully functional prototype Mobile App for Elder People and Care Giver web app in 2 days that integrates Claude, Letta, and Chroma. Successfully generated real-time AI health summaries from daily conversations. Designed a caregiver dashboard that visualizes daily mood and medication adherence. Created a system that bridges empathy, AI, and healthcare — something our team truly believes in. Building human-centric AI means designing for emotion, not just accuracy. Simplicity in UX is more powerful than complexity in features — especially for elders. Prompt engineering and data context are key to getting reliable results from LLMs like Claude. Collaboration across AI, design, and healthcare perspectives can create deeply impactful solutions. ### What's next for EldaAI Integrate with wearable health data (heart rate, sleep, activity) for early disease detection. Enable multi-language and cultural personalization for global accessibility. Expand caregiver tools to include doctor collaboration and long-term pattern analytics. Long-term vision: Let people “train” their AI throughout their lives so when they age, their AI already knows them deeply, acting as a personal caregiver and memory companion. ## README (from the GitHub repository) No README available. ## Detected evidence (automated analysis) Indexed codebase: 271 recognized source files, 1907 KB. - Anthropic (technology) — detected in the code - C (language) — detected in the code - CSS (language) — detected in the code - FastAPI (technology) — detected in the code - HTML (language) — detected in the code - Java (language) — detected in the code - JavaScript (language) — detected in the code - Next.js (technology) — detected in the code - Python (language) — detected in the code - React (technology) — detected in the code - Tailwind CSS (technology) — detected in the code - TypeScript (language) — detected in the code - AI coding agent: Claude Code — evidence: config files committed to the repository; commit authorship or trailers ## Codebase structure (from repository index) ### Files (120 of 316) ``` .claude/QUICK_COMMANDS.md .claude/README.md .claude/RESUME.md .claude/SESSION_STATE.md .DS_Store .gitignore backend/.env.example backend/.gitignore backend/alembic.ini backend/alembic/env.py backend/alembic/script.py.mako backend/alembic/versions/0fce1b03abdf_add_mobile_setup_fields_to_patient.py backend/alembic/versions/7ccebe398c0e_add_enhanced_patient_profile_fields.py backend/alembic/versions/8ab72b20f47b_add_caregiver_preferences_column.py backend/alembic/versions/9a5c40d1e6f3_add_caregiver_notes_table.py backend/alembic/versions/a72a74be09a9_initial_migration_create_all_tables_.py backend/app/__init__.py backend/app/api/__init__.py backend/app/api/v1/__init__.py backend/app/api/v1/activity.py backend/app/api/v1/auth.py backend/app/api/v1/conversations.py backend/app/api/v1/letta.py backend/app/api/v1/mobile.py backend/app/api/v1/notes.py backend/app/api/v1/patients.py backend/app/api/v1/reports.py backend/app/api/v1/schedules.py backend/app/api/v1/voice.py backend/app/core/__init__.py backend/app/core/config.py backend/app/core/dependencies.py backend/app/core/security.py backend/app/database/__init__.py backend/app/database/base.py backend/app/database/session.py backend/app/jobs/__init__.py backend/app/jobs/inactivity_detector.py backend/app/jobs/reminder_generator.py backend/app/jobs/scheduler.py backend/app/jobs/summary_generator.py backend/app/main.py backend/app/models/__init__.py backend/app/models/activity_log.py backend/app/models/alert.py backend/app/models/caregiver.py backend/app/models/conversation.py backend/app/models/daily_summary.py backend/app/models/insight.py backend/app/models/note.py backend/app/models/patient.py backend/app/models/relationship.py backend/app/models/reminder.py backend/app/models/schedule.py backend/app/models/system_log.py backend/app/schemas/__init__.py backend/app/schemas/activity.py backend/app/schemas/auth.py backend/app/schemas/conversation.py backend/app/schemas/insight.py backend/app/schemas/mobile.py backend/app/schemas/note.py backend/app/schemas/patient.py backend/app/schemas/report.py backend/app/schemas/schedule.py backend/app/scripts/__init__.py backend/app/scripts/init_letta_agents.py backend/app/seeds/__init__.py backend/app/seeds/comprehensive_seed.py backend/app/seeds/mobile_test_seed.py backend/app/seeds/README.md backend/app/services/__init__.py backend/app/services/ai_orchestrator.py backend/app/services/ai/__init__.py backend/app/services/chroma_service.py backend/app/services/claude_service.py backend/app/services/communication/__init__.py backend/app/services/communication/firebase_service.py backend/app/services/letta_service.py backend/app/services/reports.py backend/app/services/scheduler/__init__.py backend/app/utils/__init__.py backend/check_device_tokens.py backend/create_instant_test_reminder.py backend/create_local_notif_test_reminder.py backend/create_test_conversations.py backend/create_test_reminder.py backend/create_test_user_v2.py backend/create_test_user.py backend/create_upcoming_reminders.py backend/documents/BACKEND_INTEGRATION_PLAN.md backend/documents/MASTER_BACKEND_DOCUMENTATION.md backend/generate_qr_page.py backend/get_patient_credentials.py backend/Procfile backend/railway.json backend/README.md backend/requirements.txt backend/test_activity_monitoring.py backend/test_create_reminder_for_testing.py backend/test_enhanced_patient_profile.py backend/test_inactivity_detection.py backend/test_mobile_endpoints.py backend/test_preferences.py backend/test_send_notification.py backend/tests/__init__.py caregiver-dashboard/.env.example caregiver-dashboard/.eslintrc.json caregiver-dashboard/.gitignore caregiver-dashboard/clear-storage.html caregiver-dashboard/components.json caregiver-dashboard/Documents/CAREGIVER_WEB_APP_API_GUIDE.md caregiver-dashboard/Documents/CAREGIVER_WEB_APP_SETUP_GUIDE.md caregiver-dashboard/Documents/CAREGIVER_WEB_APP_SPECIFICATION.md caregiver-dashboard/Documents/CAREGIVER_WEB_APP_TASKS.md caregiver-dashboard/Documents/CaregiverDesign.md caregiver-dashboard/Documents/DASHBOARD_QR_CODE_IMPLEMENTATION.md caregiver-dashboard/Documents/WEB_DASHBOARD_FRONTEND_STATUS.md caregiver-dashboard/next.config.js caregiver-dashboard/package.json [196 more files omitted for size] ``` ### Dependencies - backend/requirements.txt: alembic@==1.12.1, anthropic@==0.7.7, apscheduler@==3.10.4, chromadb@==0.4.18, fastapi@==0.104.1, firebase-admin@==6.3.0, httpx@==0.25.2, numpy@<2.0, passlib[bcrypt]@==1.7.4, psycopg2-binary@==2.9.9, pydantic-settings@==2.1.0, pydantic[email]@==2.5.0, pytest@==7.4.3, pytest-asyncio@==0.21.1, python-dateutil@==2.8.2, python-dotenv@==1.0.0, python-jose[cryptography]@==3.3.0, python-multipart@==0.0.6, requests@==2.31.0, sqlalchemy@==2.0.23, twilio@==8.11.0, uvicorn[standard]@==0.24.0 - caregiver-dashboard/package.json: @hookform/resolvers@^3.10.0, @radix-ui/react-alert-dialog@^1.1.15, @radix-ui/react-avatar@^1.1.10, @radix-ui/react-checkbox@^1.3.3, @radix-ui/react-dialog@^1.1.15, @radix-ui/react-dropdown-menu@^2.1.16, @radix-ui/react-label@^2.1.7, @radix-ui/react-popover@^1.1.15, @radix-ui/react-progress@^1.1.7, @radix-ui/react-select@^2.2.6, @radix-ui/react-separator@^1.1.7, @radix-ui/react-slot@^1.2.3, @radix-ui/react-switch@^1.2.6, @radix-ui/react-tabs@^1.1.13, @radix-ui/react-toast@^1.2.15, @tanstack/react-query@^5.59.20, @tanstack/react-query-devtools@^5.59.20, @types/node@^22.9.0, @types/react@^18.3.12, @types/react-dom@^18.3.1, autoprefixer@^10.4.20, axios@^1.7.7, class-variance-authority@^0.7.1, clsx@^2.1.1, date-fns@^4.1.0, date-fns-tz@^3.2.0, eslint@^9.14.0, eslint-config-next@15.0.3, lucide-react@^0.460.0, next@15.0.3, postcss@^8.4.47, qrcode.react@^4.2.0, react@^18.3.1, react-day-picker@^9.11.1, react-dom@^18.3.1, react-hook-form@^7.65.0, recharts@^3.3.0, tailwind-merge@^2.6.0, tailwindcss@^3.4.14, tailwindcss-animate@^1.0.7, typescript@^5.6.3, zod@^3.25.76 - elder-companion-mobile/package.json: @babel/core@^7.23.0, @babel/preset-env@^7.23.0, @babel/runtime@^7.23.0, @notifee/react-native@^9.1.8, @react-native-async-storage/async-storage@^1.19.5, @react-native-community/netinfo@^9.5.0, @react-native-firebase/app@^18.6.1, @react-native-firebase/messaging@^18.6.1, @react-native-voice/voice@^3.2.4, @react-native/eslint-config@^0.72.2, @react-native/metro-config@^0.72.11, @react-navigation/native@^6.1.9, @react-navigation/stack@^6.3.20, @types/react@^18.2.0, @types/react-native@^0.72.0, @typescript-eslint/eslint-plugin@^6.0.0, @typescript-eslint/parser@^6.0.0, axios@^1.6.0, babel-jest@^29.6.0, babel-plugin-module-resolver@^5.0.2, date-fns@^2.30.0, eslint@^8.50.0, jest@^29.6.0, metro-react-native-babel-preset@^0.76.8, react@18.2.0, react-native@0.72.6, react-native-background-fetch@^4.2.0, react-native-camera@^4.2.1, react-native-device-info@^14.1.1, react-native-gesture-handler@^2.13.4, react-native-permissions@^5.4.2, react-native-qrcode-scanner@^1.5.5, react-native-safe-area-context@^4.7.4, react-native-screens@^3.27.0, react-native-tts@^4.1.0, typescript@^5.2.0, zustand@^4.4.6 ### Recent commits (newest first) - Update REBUILD_FOR_DEMO.sh - Streamlined files - Updated readme file - Updated Readme.md - Files cleanup - Delete LICENSE - Updated readme.md - Updated Readme.md - Updarted Readme.md - dump - working on reminder system - Firebase error fixed in simulator - Firebase was added to ios and android but app is crashing - Voice chat is working and TTS is also working - Live chat and text transcription in progress - Mobile inital version integrated with basic apis - Worked on mobile app- Initial project setup done - added QR module backend api and working on integrating QRs in web app for caregiver - integrated letta - Completed initial api integration and testing ## Key source files (fetched from GitHub, selected and truncated for size) Source contents could not be fetched from GitHub right now. [250 more indexed source files omitted to keep this export small. The full file list is in the Codebase structure section above.]