Project Info
This project did not submit a demo video on Devpost.
Inspiration
and Beginning The journey of developing our food transparency app began with a simple yet powerful idea: to empower consumers with the knowledge they need to make informed decisions about the food they buy and consume. Inspired by the vision of Open Food Facts, we were driven by the belief that everyone should have access to transparent information about the products they consume daily. This vision resonated deeply with our team, igniting a passion to contribute to a more transparent and sustainable food system.
What it does
Health Receipt is a revolutionary app designed to provide consumers with comprehensive information about the food products they purchase. Its core functionalities include: OCR-Based Receipt Scanning: Using optical character recognition (OCR) technology, Health Receipt scans grocery store receipts to extract detailed information about the food items listed. Nutrition Information: The app retrieves nutrition facts for each scanned product, including calorie count, macronutrient breakdown, and ingredient list. Eco-Scores and Packaging Information: Health Receipt evaluates the environmental impact of each product by analyzing packaging materials and carbon footprint, providing users with eco-scores to guide sustainable purchasing decisions. Allergen Warnings: The app identifies potential allergens present in scanned products, helping users with dietary restrictions make safe choices. Recipe Creation: Health Receipt offers a unique feature that allows users to generate recipes based on the ingredients scanned from their receipts, promoting creative and healthy meal planning.
How we built it
Typescript: We chose TypeScript for its strong typing system and scalability, enabling us to write cleaner and more maintainable code. Bun: The backend of Health Receipt is powered by Bun, providing a fast and efficient server environment for processing user requests and handling data. npm: We utilized npm, the package manager for JavaScript, to integrate various libraries and dependencies into our project, streamlining development and ensuring compatibility. Convex: Leveraging the Convex framework, we implemented features such as text search, server functions, and real-time updates, enhancing the performance and functionality of our app's backend. Google Vision API: For OCR functionality, we integrated the Google Vision API, which enabled us to extract text data from grocery store receipts with high accuracy and reliability. Together AI: Collaborating with Together AI, we incorporated innovative features like recipe creation into Health Receipt, enriching the user experience and adding value to the app.
Challenges we ran into
Throughout the hackathon, we encountered numerous challenges that tested our perseverance and problem-solving skills. From overcoming technical hurdles to refining user interfaces for optimal usability, each obstacle presented an opportunity for growth and innovation. One of our significant challenges was ensuring the accuracy and reliability of OCR data extraction, requiring meticulous fine-tuning and validation processes. With each hurdle overcame, we emerged stronger and more resilient, fueled by our passion for catalyzing positive change in the food industry.
Accomplishments we're proud of
Our integration with the Open Food Facts database has enabled us to contribute to the broader movement for food transparency. By leveraging this vast repository of product data, we're facilitating greater transparency and accountability within the food industry.
What we learned
Through the development of Health Receipt, we gained invaluable insights into the importance of teamwork and collaboration. Our team dynamics played a crucial role in driving the project forward, with each member contributing their unique strengths and expertise. We learned to leverage individual strengths to overcome challenges and capitalize on opportunities, fostering a supportive and cohesive working environment. Additionally, we became more attuned to recognizing and addressing our team's weaknesses, embracing a culture of continuous improvement and open communication. Ultimately, our journey with Health Receipt reinforced the significance of teamwork in achieving shared goals and delivering impactful solutions to real-world problems.
Health-Receipt
Understanding how healthy your shopping list is is now as easy as simply scanning your receipt! Simply open the app, scan your Walmart receipt, and start understanding what's going into your body. From essential nutrients to harmful chemicals, our application details them all in an easily-understandable way. Get started today!
Team
This application was built with ❤️ by
- Eliot H.
- Atishay J.
- Sravan K.
- Rohit
Data Flow
For developers, here's how everything works. When you scan your receipt, our OCR model extracts what products you bought and securely sends that data to our Convex backend, which then looks up the products from Walmart, retrieves the information about the foods from our database, and then sends that data back to our frontend, which displays it.
Getting Started Developing!
- First, make sure to run
bun install(ornpm install) in order to install all necessary packages - Next, run the backend by running
npx convex dev - Then, install Expo Go on the mobile device that you will be viewing the frontend
- Finally, run
bun start(ornpm start) in order to start the frontend. Open Expo Go on your device and scan the QR code, and then you'll see the application there!
Analysis
View
Metric
- 26
- 1
- 1
Figures cover GitHub contributors during the hackathon window. A co-authored commit counts in full for each author, so per-member totals add up to more than the whole-team figures.
Technology
- JavaScriptIn code
- ReactIn code
- TypeScriptIn code
3 of 3 appear in the indexed code.
AI coding agents
No AI coding agent signals were found in this repository.
Detected from committed agent config files and commit authorship. Absence of a signal is not proof an agent was unused.
Codebase size
Source size
76 KB
Source files
39
Counts recognized source files only; vendored directories, binaries and lockfiles are excluded, so this is smaller than the repository on disk.
Repository
chrehall68/health-receipt
62 files · 1.0 MB · @ 053581b
Structure
Interface
24 files · 39%Screens, components and styles rendered to the user.
Application logic
13 files · 21%Domain rules, services and shared utilities.
Supporting
Layers are inferred from where files sit in the tree, not from reading the code. A project that names its directories unconventionally will read oddly here — open the file browser to check anything the diagram implies.
Languages
- TypeScript90%
- JavaScript6%
- Markdown5%
Share of indexed source by file size. Binary and vendored files are excluded.
Dependencies
package.json
npm · 39- @expo/vector-icons
- @google-cloud/vision
- @react-navigation/native
- @reduxjs/toolkit
- convex
- expo
- expo-camera
- expo-file-system
- expo-font
- expo-image-picker
- expo-linking
- expo-router
- expo-splash-screen
- expo-status-bar
- expo-system-ui
- expo-web-browser
- react
- react-dom
- +21 more
Declared in the repository’s manifests at the indexed commit. A declared package is not proof it is used, and runtime dependencies are listed first.
This project’s features have not been analysed yet.
Export this project's context (description, README, evidence, key source files) to chat with an AI agent elsewhere.