Project Info
Inspiration
π‘ Our inspiration stemmed from a desire to empower πͺ elderly individuals who may struggle with memory loss to live more independently and confidently in their own homes. We recognized the importance of creating a solution that not only addresses the practical challenge of finding objects but also provides companionship and reassurance. π
What it does
π€ Spot my good boy is a revolutionary dog-like πΎ robot designed to assist the elderly in locating misplaced items within their living space. Using advanced technology and cutting-edge AI, it responds to natural language commands, navigates the environment to find requested objects, and provides verbal feedback to confirm its successππ. Additionally, it serves as a vigilant companion, capable of alerting users to potential hazards in their surroundings. π€ππ
How we built it
π οΈ We leveraged cutting-edge technology to retrofit a Boston Dynamics robot with custom software and hardware components. Through intensive programming and integration efforts, we enabled the robot to understand and execute complex commands, navigate autonomously, and communicate effectively with users. π»π This involved extensive collaboration between a huge diversity of technical experts ππ₯ from our team: software engineers, hardware specialists, and user experience designers. π»π οΈπ©βπ»
Challenges we ran into
π΅ Developing Spot my good boy presented several significant challenges, including: π¨ Integrating natural language processing capabilities to ensure seamless communication. π€π£οΈ Designing an intuitive user interface for elderly users with varying levels of technological familiarity. π΅π΄π₯οΈ Implementing robust object recognition and navigation algorithms to locate items accurately. πΈπ Managing multiple AI agents and API calls to services such as Google Text-to-Speech (gTTS), OpenAI's Whispr, GPT-4, and OpenCV cascade models for object detection. π€π€π€ Hardware integration for sound, microphone, camera, and movement controls, ensuring seamless interaction and functionality across different components. π€π·πΉοΈ
Accomplishments we're proud of
π We are immensely proud of several accomplishments, including: Successfully creating a functional prototype of Spot my good boy within the constraints of the hackathon timeframe. β±οΈπ€ Demonstrating the robot's ability to understand and respond to verbal commands in real-time. ποΈπ€ Implementing reliable object detection and navigation algorithms, ensuring accurate retrieval of items. πΈπ§π Establishing a foundation for future development and refinement of the technology. ππ
What we learned
π‘ Our journey with Spot my good boy taught us invaluable lessons about teamwork, innovation, and the power of technology to positively impact lives. ππ Key takeaways include: The importance of user-centered design in creating inclusive and accessible solutions. π₯π The challenges and complexities of integrating hardware and software components in robotics projects. π€π¨ The significance of empathy and understanding when designing for vulnerable populations. π΅π΄π The potential for technology to enhance the quality of life for elderly individuals and caregivers alike. ππ
What's next
π Moving forward, we envision several exciting opportunities to further enhance and refine Spot my good boy: Conducting additional user testing and feedback sessions to iteratively improve the robot's functionality and user experience π₯π Exploring potential partnerships with assisted living facilities and healthcare providers to deploy Spot in real-world environments π₯π΅ Continuously updating and expanding Spot's capabilities through software updates π²π Investigating advanced features such as fall detection, medication reminders, and remote monitoring capabilities ππβ° Collaborating with researchers and industry experts to explore the broader implications of robotics in eldercare and aging-in-place initiatives π΄π΅π€ With dedication and innovation, Spot my good boy has the potential to revolutionize the way we support and care for elderly individuals, empowering them to live independently and confidently in their own homes. π‘π΅π
Spot My Good Boy
This project is the result of the collaboration between Yoni, Ava, Josselin, and Joachim for Stanford TreeHacks 2024 (February 16 - 18, 2024).
Short description
Introducing Spot My Good Boy: your memory's best friend! Never forget a thing with Spot. Life-changing companionship for seniors!
Inspiration
Our inspiration stemmed from a desire to empower πͺ elderly individuals who may struggle with memory loss to live more independently and confidently in their own homes. We recognized the importance of creating a solution that not only addresses the practical challenge of finding objects but also provides companionship and reassurance. π
What it does
Spot my good boy is a revolutionary dog-like πΎ robot designed to assist the elderly in locating misplaced items within their living space. Using advanced technology and cutting-edge AI, it responds to natural language commands, navigates the environment to find requested objects, and provides verbal feedback to confirm its successππ. Additionally, it serves as a vigilant companion, capable of alerting users to potential hazards in their surroundings. π€ππ
How we built it
We leveraged cutting-edge technology to retrofit a Boston Dynamics robot with custom software and hardware components. Through intensive programming and integration efforts, we enabled the robot to understand and execute complex commands, navigate autonomously, and communicate effectively with users. π»π This involved extensive collaboration between a huge diversity of technical experts ππ₯ from our team: software engineers, hardware specialists, and user experience designers. π»π οΈπ©βπ»
Challenges we ran into
Developing Spot my good boy presented several significant challenges, including: π¨
- Integrating natural language processing capabilities to ensure seamless communication. π€π£οΈ
- Designing an intuitive user interface for elderly users with varying levels of technological familiarity. π΅π΄π₯οΈ
- Implementing robust object recognition and navigation algorithms to locate items accurately. πΈπ
- Managing multiple AI agents and API calls to services such as Google Text-to-Speech (gTTS), OpenAI's Whispr, GPT-4, and OpenCV cascade models for object detection. π€π€π€
- Hardware integration for sound, microphone, camera, and movement controls, ensuring seamless interaction and functionality across different components. π€π·πΉοΈ
Accomplishments that we're proud of π
We are immensely proud of several accomplishments, including:
- Successfully creating a functional prototype of Spot my good boy within the constraints of the hackathon timeframe. β±οΈπ€
- Demonstrating the robot's ability to understand and respond to verbal commands in real-time. ποΈπ€
- Implementing reliable object detection and navigation algorithms, ensuring accurate retrieval of items. πΈπ§π
- Establishing a foundation for future development and refinement of the technology. ππ
What we learned π‘
Our journey with Spot my good boy taught us invaluable lessons about teamwork, innovation, and the power of technology to positively impact lives. ππ Key takeaways include:
- The importance of user-centered design in creating inclusive and accessible solutions. π₯π
- The challenges and complexities of integrating hardware and software components in robotics projects. π€π¨
- The significance of empathy and understanding when designing for vulnerable populations. π΅π΄π
- The potential for technology to enhance the quality of life for elderly individuals and caregivers alike. ππ
What's next for Spot my good boy π
Moving forward, we envision several exciting opportunities to further enhance and refine Spot my good boy:
- Conducting additional user testing and feedback sessions to iteratively improve the robot's functionality and user experience π₯π
- Exploring potential partnerships with assisted living facilities and healthcare providers to deploy Spot in real-world environments π₯π΅
- Continuously updating and expanding Spot's capabilities through software updates π²π
- Investigating advanced features such as fall detection, medication reminders, and remote monitoring capabilities ππβ°
- Collaborating with researchers and industry experts to explore the broader implications of robotics in eldercare and aging-in-place initiatives π΄π΅π€
With dedication and innovation, Spot my good boy has the potential to revolutionize the way we support and care for elderly individuals, empowering them to live independently and confidently in their own homes. π‘π΅π
Links
Analysis
View
Metric
- 36
- 5
- 1
- 1
Figures cover GitHub contributors during the hackathon window. A co-authored commit counts in full for each author, so per-member totals add up to more than the whole-team figures.
Technology
- OpenAIIn code
- PythonIn code
- DockerClaimed
2 of 3 appear in the indexed code. 1 claimed on Devpost could not be matched to code, which may simply mean the tool leaves no trace in the repository.
AI coding agents
No AI coding agent signals were found in this repository.
Detected from committed agent config files and commit authorship. Absence of a signal is not proof an agent was unused.
Codebase size
Source size
32 KB
Source files
9
Counts recognized source files only; vendored directories, binaries and lockfiles are excluded, so this is smaller than the repository on disk.
Repository
JosselinSomervilleRoberts/hackathon-spot
13 files Β· 37 KB Β· @ f90ba22
Structure
Application logic
8 files Β· 62%Domain rules, services and shared utilities.
Supporting
Layers are inferred from where files sit in the tree, not from reading the code. A project that names its directories unconventionally will read oddly here β open the file browser to check anything the diagram implies.
Languages
- Python85%
- Markdown15%
Share of indexed source by file size. Binary and vendored files are excluded.
Dependencies
requirements.txt
pypi Β· 2- gTTS
- openai
Declared in the repositoryβs manifests at the indexed commit. A declared package is not proof it is used, and runtime dependencies are listed first.
This projectβs features have not been analysed yet.
Export this project's context (description, README, evidence, key source files) to chat with an AI agent elsewhere.