# Project export: SageWell
This document was generated by HackStack to give an AI agent context about a hackathon project. Sections are labeled with their provenance; content marked as truncated was cut to keep this document small.
## Project metadata
- Hackathon: TreeHacks 2024
- Tagline: An AI-powered Medical Assistant for the Elderly
- Devpost: https://devpost.com/software/sagewell
- GitHub: https://github.com/PrabhleenKaurLamba/SageWell
- Video: https://www.youtube.com/embed/y6nkSYeK0pA?enablejsapi=1&hl=en_US&rel=0&start=&version=3&wmode=transparent
- Result: winner (Best Use of Monster Generative AI APIs (4x XBox Series S [1st] & 1 million Monster API credits [2nd] & $400 Cash [3rd]))
- Team: 1 GitHub contributor(s) — Prabhleen Kaur Lamba (2 commits)
## Devpost submission (written by the team)
### Inspiration
Our inspiration for creating this AI project stemmed from the desire to leverage current technology to enhance the lives of our community members, particularly the elderly. Recognizing the difficulties faced by aging individuals, including our own grandparents, to embrace technological advancements, and their concerns about health conditions, we sought a way to integrate technology and healthcare services seamlessly into their lives. Thus, SageWell was conceived—an AI companion designed to provide personalized support to seniors by navigating medical information alongside their healthcare providers. At SageWell, we believe in accessibility of AI for all age groups.
### What it does
SageWell enables users to seek medical information through natural language interactions, allowing elderly individuals to pose questions verbally and receive spoken responses, mimicking human conversation.
### How we built it
SageWell leverages the capabilities of two Monster APIs: OpenAI-Whisper Large-v2 for speech-to-text conversion and Meta's llama-2-7b-chat-hf for refining our reinforcement learning model. Our model was trained on MedQuAD, a comprehensive dataset containing over 47,000 medical question-answer pairs, Drugs, Side Effects and Medical Condition dataset, and Drugs Related to Medical Conditions dataset. The frontend of the web app was built using React, a JavaScript library, and the service we integrated into our app to store all the audio files was Firebase.
### Challenges we ran into
In the process of developing SageWell, we encountered several challenges. Since there were many integrations in our application, from speech-to-text transcription and MonsterAPIs for fine-tuned LLMs, to storage service providers, we faced difficulties trying to link all the individual pieces together. We learned several new tools and technologies and also spent time fine-tuning models to provide medical information. Additionally, we encountered setbacks when we were finishing up our project as we were facing CORS errors when making API calls from the browser - we were able to work around this by adding a proxy, which served as a bridge between our client and server.
### Accomplishments we're proud of
We empowered our primary user demographic, the elderly, to engage with SageWell through voice interactions instead of having to type text. We addressed the challenges that many seniors encounter when typing on digital devices, thereby increasing the accessibility of the process of seeking medical information and ensuring inclusivity in AI for all age groups, especially the elderly. Our reinforcement learning model has demonstrated effectiveness, evidenced by the decrease in training loss after each iteration and to 0.756 at the end. This indicates that the model fits well on the training data. We merged three datasets: the Medical Question Answering data set, the Drugs, Side Effects and Medical Condition data set, and the Drugs Related to Medical Conditions data set. By training our model for SageWell on these datasets obtained from NIH websites and drugs.com, we allowed SageWell to provide medical information to users based on reliable, comprehensive databases.
### What we learned
Through this project, we gained valuable insights into the startup ecosystem and developer space. We expanded our skill set by refining our model, working with new APIs and storage providers, and creating a solution that addresses the specific challenges faced by our target audience.
### What's next
The journey of SageWell is just beginning. Moving forward, we aim to expand its capabilities to assist in additional areas crucial for the well-being of the elderly, such as medication reminders and guidance on accessing support for domestic chores. Furthermore, we envision integrating features that facilitate connections between seniors and younger generations, including their grandchildren and other youth in their communities. By fostering these intergenerational connections, SageWell will expand its targeting market size by not only keeping the elderly engaged with their loved ones but also ensuring they remain connected to the evolving world around them. Through SageWell, we look forward to continuing to push for accessibility of AI for all age groups.
## README (from the GitHub repository)
# SageWell, an AI-powered Medical Assistant for the Elderly | Stanford TreeHacks 2024 Prize Winner
https://devpost.com/software/sagewell
https://youtu.be/y6nkSYeK0pA
## Detected evidence (automated analysis)
Indexed codebase: 11 recognized source files, 22 KB.
- CSS (language) — detected in the code
- Firebase (technology) — detected in the code
- HTML (language) — detected in the code
- JavaScript (language) — detected in the code
- React (technology) — detected in the code
## Codebase structure (from repository index)
### Files (17 of 17)
```
.firebaserc
.gitignore
firebase.json
package.json
public/index.html
public/manifest.json
public/robots.txt
README.md
src/css/Assistant.css
src/css/Home.css
src/firebase.js
src/index.css
src/index.js
src/Pages/Assistant.js
src/Pages/Home.js
src/reportWebVitals.js
src/setupTests.js
```
### Dependencies
- package.json: @fortawesome/fontawesome-free@^6.5.1, @testing-library/jest-dom@^5.17.0, @testing-library/react@^13.4.0, @testing-library/user-event@^13.5.0, firebase@^10.8.0, mic-recorder-to-mp3@^2.2.2, monsterapi@^0.0.3, react@^18.2.0, react-dom@^18.2.0, react-icons@^5.0.1, react-router-dom@^6.22.1, react-scripts@5.0.1, web-vitals@^2.1.4
### Recent commits (newest first)
- Update README.md
- Update README.md
- Update README.md
- Update README.md
- Update README.md
- add UI and new api for model
- format string
- merged APIs
- test
- added monster api call
- implemented text to speech
- initial commit
- Initialize project using Create React App
## Key source files (fetched from GitHub, selected and truncated for size)
### package.json
```
{
"name": "treehacks",
"version": "0.1.0",
"private": true,
"proxy": "https://23c0047b-044d-4b61-8822-91d103c68f85.monsterapi.ai",
"dependencies": {
"@fortawesome/fontawesome-free": "^6.5.1",
"@testing-library/jest-dom": "^5.17.0",
"@testing-library/react": "^13.4.0",
"@testing-library/user-event": "^13.5.0",
"firebase": "^10.8.0",
"mic-recorder-to-mp3": "^2.2.2",
"monsterapi": "^0.0.3",
"react": "^18.2.0",
"react-dom": "^18.2.0",
"react-icons": "^5.0.1",
"react-router-dom": "^6.22.1",
"react-scripts": "5.0.1",
"web-vitals": "^2.1.4"
},
"scripts": {
"start": "react-scripts start",
"build": "react-scripts build",
"test": "react-scripts test",
"eject": "react-scripts eject"
},
"eslintConfig": {
"extends": [
"react-app",
"react-app/jest"
]
},
"browserslist": {
"production": [
">0.2%",
"not dead",
"not op_mini all"
],
"development": [
"last 1 chrome version",
"last 1 firefox version",
"last 1 safari version"
]
}
}
```
### src/index.js
```javascript
import React from 'react';
import ReactDOM from 'react-dom';
import { BrowserRouter, Route, Routes, Navigate } from 'react-router-dom';
import './index.css';
import HomePage from './Pages/Home';
import Assistant from './Pages/Assistant';
import reportWebVitals from './reportWebVitals';
function App() {
return (
} />
} />
} />
);
}
const root = ReactDOM.createRoot(document.getElementById('root'));
root.render(
);
reportWebVitals();
```
### src/setupTests.js
```javascript
// jest-dom adds custom jest matchers for asserting on DOM nodes.
// allows you to do things like:
// expect(element).toHaveTextContent(/react/i)
// learn more: https://github.com/testing-library/jest-dom
import '@testing-library/jest-dom';
```
### src/reportWebVitals.js
```javascript
const reportWebVitals = onPerfEntry => {
if (onPerfEntry && onPerfEntry instanceof Function) {
import('web-vitals').then(({ getCLS, getFID, getFCP, getLCP, getTTFB }) => {
getCLS(onPerfEntry);
getFID(onPerfEntry);
getFCP(onPerfEntry);
getLCP(onPerfEntry);
getTTFB(onPerfEntry);
});
}
};
export default reportWebVitals;
```
### src/index.css
```css
body {
margin: 0;
font-family: -apple-system, BlinkMacSystemFont, 'Segoe UI', 'Roboto', 'Oxygen',
'Ubuntu', 'Cantarell', 'Fira Sans', 'Droid Sans', 'Helvetica Neue',
sans-serif;
-webkit-font-smoothing: antialiased;
-moz-osx-font-smoothing: grayscale;
}
code {
font-family: source-code-pro, Menlo, Monaco, Consolas, 'Courier New',
monospace;
}
```
### src/firebase.js
```javascript
// // Import the functions you need from the SDKs you need
// import { initializeApp } from "firebase/app";
// import { getStorage } from "./firebase/storage"
// // TODO: Add SDKs for Firebase products that you want to use
// // https://firebase.google.com/docs/web/setup#available-libraries
import { initializeApp } from "firebase/app";
// Your web app's Firebase configuration
const firebaseConfig = {
apiKey: "AIzaSyCK1JhypC57k0-ZaZCh0AF_m3Gr7-8C7W4",
authDomain: "treehacks-8cd81.firebaseapp.com",
projectId: "treehacks-8cd81",
storageBucket: "treehacks-8cd81.appspot.com",
messagingSenderId: "684110143182",
appId: "1:684110143182:web:a617b98bc5ca0ac259ba9f"
};
// Initialize Firebase
const app = initializeApp(firebaseConfig);
export { app }; // Export the initialized Firebase app
```
### public/index.html
```html
SageWell
```
### src/Pages/Home.js
```javascript
import React from 'react';
import logo from './../img/logo.png';
import './../css/Home.css';
const HomePage = () => {
const goToHome = () => {
window.location.href = "/";
};
const goToAssistant = () => {
window.location.href = "/assistant";
};
return (
Welcome to SageWell, an AI-powered Medical Assistant for the Elderly
We believe in accessibility of AI for all age groups!