Project Info

MedInfoBot

Devpost

This project did not submit a demo video on Devpost.

Are you tired of the confusion and uncertainty that often accompanies medication prescriptions? Introducing MedInfoBot, your trusted companion on your healthcare journey. We understand that understanding medication details can be challenging, and that's why we've designed MedInfoBot to simplify medication understanding and make healthcare more accessible than ever before.

What it does

With MedInfoBot, you can effortlessly extract important information from your prescriptions, including medication names, dosages, and what it does. Say goodbye to the complexity of medical terms. Our user-friendly interface provides clear and concise explanations of common uses of your medicine and potential side effects, along with audio descriptions, for those visually impaired, empowering anyone to make informed decisions about your own health. Key Features: Prescription Information Processing MedInfoBot employs Optical Character Recognition (OCR) to extract prescription details from images, ensuring accurate and reliable data retrieval. User-Friendly Interface The application boasts an intuitive and user-friendly interface, making it accessible to users of all backgrounds and ages. AI-Powered Explanations MedInfoBot utilizes the OpenAI API to generate clear and concise explanations of medication details, enhancing your understanding of what you're taking. Hardware Integration Powered by the Milk-V Duo board and the CAM-GC2083 camera module, MedInfoBot leverages efficient hardware capabilities for accurate image capture and processing. Expandable Features The Milk-V Duo board's versatility allows for the seamless integration of future additional features, such as human emotion detection and prediction with the camera module. Technologies Hardware Components MedInfoBot operates on a low cost, low power consumption, high performance $5 RISC-V computer, ensuring that our solution is not only accessible but also incredibly efficient. Milk-V Duo Board This ultra-compact embedded development platform is powered by the CV1800B chip, capable of running Linux and RTOS. It provides a reliable, low-cost, and high-performance foundation for MedInfoBot. The board features dual processors, versatile GPIO pins, USB support, and more, making it a perfect match for this healthcare application. CAM-GC2083 Camera Module The GLAXYCORE's GC2083 CMOS Image Sensor, is a camera module thatoffers up to 2MP resolution, ensuring high-quality imaging. It seamlessly integrates with the 16P MIPI CSI interface on the Milk-V Duo board, enabling advanced imaging capabilities. With features like optical excellence, high sensitivity, and impressive dynamic range, this camera module enhances the MedInfoBot's image capture capabilities significantly. Software Components This bot makes liberal use of various machine learning/AI models to perform its desired functions. PyTesseract PyTesseract is a Python wrapper for Google's Tesseract Optical Character Recognition application. This allows the bot to take an image as an input, and output the recognizable text that appears in the image. OpenAI/ChatGPT OpenAI's ChatGPT LLM was used to process the text output from PyTesseract and extract the medication name from the text. It was also then used to return useful information about the specified medication. GTTS GTTS (Google Text To Speech) is a python wrapper for Google's Text to Speech functions. It was used to generate an audio file of the medication name and description outputted by the previous software component. Together, these hardware components and software technologies power MedInfoBot to simplify medication understanding and promote healthcare accessibility.

What's next

As we move forward, MedInfoBot aims to expand its capabilities and impact in the healthcare space. Here's a glimpse of what's on the horizon: Multi-Language Support Accessibility to healthcare information for a global audience with support for multiple languages. Integration with Hume AI Exploring emotion detection capabilities to provide personalized support alongside medication information. Voice Assistance Making MedInfoBot even more accessible with voice command features for medication inquiries. User Profiles Personalized profiles to track medication history, receive reminders, and get tailored recommendations. Medical Database Integration Currently, ChatGPT is used to search for information about the given medication. In the future, this can be upgraded to searching in a pre-compiled/pre-assembled medical database in order to speed up bot functions and improve medication accuracy. MedInfoBot's journey doesn't end here! We are your gateway to simplified medication understanding and informed healthcare decisions. Join us in making healthcare more accessible and understandable for everyone.

Analysis

Compare with all teams

View

Metric

Figures cover GitHub contributors during the hackathon window. A co-authored commit counts in full for each author, so per-member totals add up to more than the whole-team figures.

Technology

Found in codeClaimed only
  • PythonIn code
  • OpenAIClaimed

1 of 2 appear in the indexed code. 1 claimed on Devpost could not be matched to code, which may simply mean the tool leaves no trace in the repository.

AI coding agents

No AI coding agent signals were found in this repository.

Detected from committed agent config files and commit authorship. Absence of a signal is not proof an agent was unused.

Codebase size

Source size

3.9 KB

Source files

4

Counts recognized source files only; vendored directories, binaries and lockfiles are excluded, so this is smaller than the repository on disk.

0 stars