Project Info
This project did not submit a demo video on Devpost.
Inspiration
When our group was brainstorming the ideas, we found out how hard it is for us to understand the medicine based on the package. That leads into thinking about the struggle that people with impaired visions and elder people may have. Envision a world where visually impaired and elderly individuals no longer struggle to read medicine labels or depend on others. With MedVision Web, this vision becomes a reality. It offers a straightforward and efficient software solution that scans medication labels and instantly vocalizes the medication name, purpose, and dosage. Together, we're revolutionizing the healthcare experience, ensuring that people of all ages and visual abilities can independently and confidently manage their well-being.
What it does
Users can capture or upload an image of a medicine package label, and our software employs Google Vision AI and Together.AI to scan and extract text from the image. It then provides users with necessary information, including a text-to-speech feature, providing an efficient and user-friendly solution.
How we built it
We built a full-stack application that uses ReactJS for the front end and Python with Flask for the back end. It integrates with various AI services, including Together.AI and Google Cloud and Firebase for database functionality. Additionally, we have attempted to develop a mobile app using Flutter.
Challenges we ran into
As this is our first time implementing a full-stack app using various AI technologies and tools, we had difficulties when integrating their APIs into our app. Thanks to the workshops and mentors, we were able to quickly overcome these challenges and proceed with our work. Even though we developed the front-end and back-end separately, we struggled to integrate them due to time constraints. Also, testing a complex full-stack application with multiple AI services is definitely a challenging process.
Accomplishments we're proud of
This project involves various parts being developed separately, and the most significant accomplishment we are proud of is successfully integrating all of them and offering impactful features to users.
What we learned
We learned a lot about how to integrate APIs, different creative ideas & tools, collaboration with teams, and finally we had fun!
What's next
We believe that MedVision is more than just a project, it's a transformative tool for enhancing public health. Our vision for the future is to create a chatbot which can make health and medication information accessible at users' fingertips. We're dedicated to enhancing the user experience with a responsive design and user authentication, providing a secure environment for users to access a wealth of health resources. We aspire to elevate the health community by pushing the boundaries of innovation and making a positive impact in healthcare technology.
Getting Started with Create React App
This project was bootstrapped with Create React App.
Available Scripts
In the project directory, you can run:
npm start
Runs the app in the development mode.
Open http://localhost:3000 to view it in your browser.
The page will reload when you make changes.
You may also see any lint errors in the console.
npm test
Launches the test runner in the interactive watch mode.
See the section about running tests for more information.
npm run build
Builds the app for production to the build folder.
It correctly bundles React in production mode and optimizes the build for the best performance.
The build is minified and the filenames include the hashes.
Your app is ready to be deployed!
See the section about deployment for more information.
npm run eject
Note: this is a one-way operation. Once you eject, you can't go back!
If you aren't satisfied with the build tool and configuration choices, you can eject at any time. This command will remove the single build dependency from your project.
Instead, it will copy all the configuration files and the transitive dependencies (webpack, Babel, ESLint, etc) right into your project so you have full control over them. All of the commands except eject will still work, but they will point to the copied scripts so you can tweak them. At this point you're on your own.
You don't have to ever use eject. The curated feature set is suitable for small and middle deployments, and you shouldn't feel obligated to use this feature. However we understand that this tool wouldn't be useful if you couldn't customize it when you are ready for it.
Learn More
You can learn more in the Create React App documentation.
To learn React, check out the React documentation.
Code Splitting
This section has moved here: https://facebook.github.io/create-react-app/docs/code-splitting
Analyzing the Bundle Size
This section has moved here: https://facebook.github.io/create-react-app/docs/analyzing-the-bundle-size
Making a Progressive Web App
This section has moved here: https://facebook.github.io/create-react-app/docs/making-a-progressive-web-app
Advanced Configuration
This section has moved here: https://facebook.github.io/create-react-app/docs/advanced-configuration
Deployment
This section has moved here: https://facebook.github.io/create-react-app/docs/deployment
npm run build fails to minify
This section has moved here: https://facebook.github.io/create-react-app/docs/troubleshooting#npm-run-build-fails-to-minify
Analysis
View
Metric
No commits on this project resolved to a GitHub account.
Technology
- CSSIn code
- ExpressIn code
- FirebaseIn code
- HTMLIn code
- JavaScriptIn code
- PythonIn code
- ReactIn code
- Tailwind CSSIn code
- FlaskClaimed
8 of 9 appear in the indexed code. 1 claimed on Devpost could not be matched to code, which may simply mean the tool leaves no trace in the repository.
AI coding agents
No AI coding agent signals were found in this repository.
Detected from committed agent config files and commit authorship. Absence of a signal is not proof an agent was unused.
Codebase size
Source size
25 KB
Source files
21
Counts recognized source files only; vendored directories, binaries and lockfiles are excluded, so this is smaller than the repository on disk.
Repository
erik-ksth/medVision1.0
36 files · 5.8 MB · @ ab26de5
Structure
Interface
2 files · 6%Screens, components and styles rendered to the user.
Application logic
16 files · 44%Domain rules, services and shared utilities.
Supporting
Layers are inferred from where files sit in the tree, not from reading the code. A project that names its directories unconventionally will read oddly here — open the file browser to check anything the diagram implies.
Languages
- JavaScript47%
- Python29%
- Markdown13%
- HTML7%
- CSS4%
Share of indexed source by file size. Binary and vendored files are excluded.
Dependencies
package.json
npm · 20- @emotion/react
- @emotion/styled
- @mui/icons-material
- @mui/material
- @mui/styled-engine-sc
- @testing-library/jest-dom
- @testing-library/react
- @testing-library/user-event
- axios
- express
- firebase
- firebase-admin
- react
- react-dom
- react-router-dom
- react-scripts
- styled-components
- use-sound
- +2 more
backend/requirements.txt
pypi · 6- firebase-admin
- google-cloud-texttospeech
- google-cloud-vision
- Playsound
- requests
- together
Declared in the repository’s manifests at the indexed commit. A declared package is not proof it is used, and runtime dependencies are listed first.
This project’s features have not been analysed yet.
Export this project's context (description, README, evidence, key source files) to chat with an AI agent elsewhere.