Project Info
This project did not submit a demo video on Devpost.
Inspiration
We were inspired by how we could utilize AI tools in the medical scene. Specifically, when you have questions about anything related to yourself, we often search these questions up on Reddit. But what is on Reddit can't be taken granted since its anonymous. What we aim to achieve is to give reliable medical advice to our users.
What it does
Our product offers users three convenient ways to access reliable medical information: voice, image, and text. Whether users prefer to ask questions through spoken words, upload pictures for analysis, or type in their inquiries, our model delivers high-quality, evidence-based responses using sources from the Harrison medical textbook and sites from our custom Google search API. It integrates reasoning/chain of thought by allowing the model to break down the context and query to give the user the best response possible. Furthermore, it will help draft an email to send to your doctor.
How we built it
For the frontend we utilized React to build it. For the backend we utilized Groq.
Challenges we ran into
We ran into many challenges. One of them includes formatting the AIs response in a way that was readable. We chose to showcase the output in Markdown since regular text was very unreadable at large chunks. By using the ReactMarkdown library, we formatted our markdown properly. Another problem we had was CORS issues between Flask and React, but those just took time debugging. Also internet issues :C
Accomplishments we're proud of
We're proud of building something that can be put into quick use. Instead of people having to scavenge through the internet for valid information, we condense this process for them. We were really proud of our complex LLM architecture.
What we learned
We learned more about using different technologies like Groq, Chroma, Deepgram, GCP, and Hyperbolic. Specifically, culminating these technologies to make a clean product.
What's next
for MedTalk For next steps, we'd like to use like fetch.ai where we have different agents which can process different sorts of tasks. One thing that would be cool to implement is to automate next steps in the conversation like booking a doctor's appointment
This project did not link a GitHub repository.
Analysis
No indexed repository for this project, so there are no commit stats to show.
Technology
- FlaskUnchecked
- JavaScriptUnchecked
- PythonUnchecked
- ReactUnchecked
No repository was indexed for this project, so these Devpost claims have not been checked against code.
AI coding agents
No repository was indexed, so agent usage could not be checked.
Detected from committed agent config files and commit authorship. Absence of a signal is not proof an agent was unused.
Codebase size
No repository was indexed, so there is no codebase to measure.
This project did not link a GitHub repository, so there is nothing to diagram.
This project did not link a GitHub repository, so its feature claims have not been checked against code.
Export this project's context (description, README, evidence, key source files) to chat with an AI agent elsewhere.