Project Info
Inspiration
🌟 Our inspiration for "GrabThisSpot" came from a desire to bridge the gap between humans and robots. We envisioned a world where controlling robots wasn't just a technical feat, but a magical experience. Imagine feeling like a wizard, commanding a robot with a simple wave or a flick of the wrist. Our love for innovation and a bit of sci-fi imagination fueled our passion to create this project.
What it does
🤖 "GrabThisSpot" is your portal to the future of robotics. It allows you to control a Boston Dynamics SPOT robot through intuitive gestures. Raise your hand to make it move forward, lower it to go backward, swing it left or right to steer – it's like controlling the robot with a Jedi's finesse. With AI and computer vision, it recognizes your face and your unique gestures, ensuring it responds to you, and only you. Plus, it calculates the distance between you and the robot for safety.
How we built it
🔨 We combined cutting-edge hardware, software, and a dash of creativity. We integrated the SPOT robot, programmed the gesture recognition system, and fine-tuned the AI to understand the user's intent. Our team worked tirelessly to ensure a seamless user experience, where technology feels like magic.
Challenges we ran into
🌦️ We faced challenges like a dog chasing its tail. Fine-tuning the gesture recognition system to ensure accuracy and real-time responsiveness was a tough bone to chew. Dealing with different lighting conditions and user variability added to the complexity. But our determination and teamwork helped us overcome these hurdles.
Accomplishments we're proud of
🏆 We're ecstatic to have turned our vision into reality. Creating a project that allows anyone to effortlessly control a robot with gestures is a big win for us. We're proud of the seamless integration of hardware and software, as well as our dedication to user safety by implementing distance detection.
What we learned
🧠 This journey taught us the power of innovation, teamwork, and the joy of creating something that wows people. We deepened our understanding of computer vision, AI, and the immense potential of human-robot interaction.
What's next
🚀 The journey doesn't end here. We're eager to refine our project further and explore new applications for gesture-controlled robotics. Our vision is to make technology even more accessible, interactive, and fun. Watch out for more magic with "GrabThisSpot" in the future!
GrabThisSpot
GrabThisSpot is a Gesture-Based Robot Control which gives you the ability to communicate with robots through natural, intuitive means has the potential to redefine the way we engage with these mechanical counterparts. It embarks on a transformative journey into the realm of human-robot interaction, where hand gestures and movements become the conduit for commanding and controlling the movement of a robot.
Description
GrabThisSpot is about effortlessly guiding a robot's every move, from navigating complex terrains to performing intricate tasks, simply by using your own body's language. No cumbersome controllers or intricate programming required—just the innate expressiveness of your hands and body. This project is dedicated to realizing this vision, pushing the boundaries of technological innovation, and ultimately enhancing the adaptability and accessibility of robotic systems.
Built with
The project is built on the foundation of the SPOT robot from Boston Dynamics, harnessing Python and the Flask web framework for development. Key components include computer vision techniques such as pose estimation (MediaPipe by Google) and facial recognition, facilitated by deep learning models. These technologies allow users to control the SPOT robot through natural hand gestures and movements. The integration of various sensors and robust communication protocols ensures real-time responsiveness and reliability, promising to revolutionize human-robot interaction by making it more intuitive and accessible across diverse applications and industries.
Dependencies
- SPOT ROBOT[By Boston Dynamics]: This spot robot was used for the project, can be replaced by any robot
- Mediapipe: A Python Library for detecting body posture
- DeepFace: A python library to detect and recognize faces
- OpenCV: A Python Library for image analysis
- Axios: Used to make HTTP requests to the Flask back-end and external APIs.
- Material-UI: A UI framework for creating responsive and visually appealing designs.
To install these dependencies, navigate to the base directory and run the following command:
pip install requirements.txt
Authors
Contributors names and contact info
Yash Khandelwal Julen Ferro
Analysis
View
Metric
No commits on this project resolved to a GitHub account.
Technology
- CSSIn code
- HTMLIn code
- JavaScriptIn code
- PythonIn code
- FlaskClaimed
4 of 5 appear in the indexed code. 1 claimed on Devpost could not be matched to code, which may simply mean the tool leaves no trace in the repository.
AI coding agents
No AI coding agent signals were found in this repository.
Detected from committed agent config files and commit authorship. Absence of a signal is not proof an agent was unused.
Codebase size
Source size
1019 KB
Source files
16
Counts recognized source files only; vendored directories, binaries and lockfiles are excluded, so this is smaller than the repository on disk.
Repository
ferriitoo/CalHack-Spot
34 files · 94.4 MB · @ 4a0d155
Structure
Interface
1 file · 3%Screens, components and styles rendered to the user.
Application logic
14 files · 41%Domain rules, services and shared utilities.
Supporting
Layers are inferred from where files sit in the tree, not from reading the code. A project that names its directories unconventionally will read oddly here — open the file browser to check anything the diagram implies.
Languages
- XML89%
- Python10%
- JavaScript1%
- Markdown0%
- HTML0%
- CSS0%
Share of indexed source by file size. Binary and vendored files are excluded.
Dependencies
requirements.txt
pypi · 1- pip
Declared in the repository’s manifests at the indexed commit. A declared package is not proof it is used, and runtime dependencies are listed first.
This project’s features have not been analysed yet.
Export this project's context (description, README, evidence, key source files) to chat with an AI agent elsewhere.