Project Info
This project did not submit a demo video on Devpost.
Inspiration
The inspiration behind Urban Quest came from the desire to blend everyday exploration with the power of AI. We wanted to create an interactive platform where users could snap photos of their surroundings and instantly learn more about what they captured. Whether it’s an interesting landmark, an object, or a question about the environment, Urban Quest makes discovery and learning fun and accessible. We aimed to bring adventure and curiosity into the palms of our users.
What it does
Urban Quest allows users to take photos and ask questions about the content in the images. Using AI, the app processes the photos, analyzes the visual elements, and provides insightful responses. Whether it's identifying objects, explaining a scene, or answering specific questions related to the captured image, Urban Quest brings context and understanding to the world around the user. It’s a blend of exploration and knowledge sharing, designed for curious minds.
How we built it
We built Urban Quest using Swift and integrated advanced AI technologies like Google Vision and Gemini API for image recognition and content generation. The app's core functionality revolves around the seamless interaction between the camera, the AI model, and the user interface. We used cloud-based AI models to handle the heavy lifting of image analysis and natural language processing, ensuring fast and accurate responses. The app’s design focuses on simplicity, allowing users to easily capture images, ask questions, and receive answers in real-time.
Challenges we ran into
One of the biggest challenges we faced was integrating AI models to effectively understand and process the images, especially in real-time. Ensuring smooth performance while handling large images and making API calls was difficult. Another challenge was creating a user-friendly experience that balanced the power of AI with simplicity. We also had to carefully manage user privacy, particularly when accessing the camera and photo library, while adhering to strict data security protocols.
Accomplishments we're proud of
We’re proud of successfully combining image capture, AI-based analysis, and interactive storytelling in a single, cohesive app. The smooth integration of the camera functionality with real-time AI processing was a significant achievement. We also take pride in making a highly interactive and educational tool that can engage users in a fun and meaningful way. Creating an intuitive user interface that can bring such advanced technology to the everyday user is another highlight.
What we learned
Throughout the development process, we learned a lot about AI integration, especially in mobile applications. We deepened our understanding of how to process visual data and convert it into meaningful responses using AI models. Managing real-time API calls, handling image data, and optimizing app performance across different devices provided valuable insights. We also learned how important user experience is, especially when dealing with complex technology—keeping things simple and easy to use was key.
What's next
for Urban Quest Moving forward, we plan to expand Urban Quest’s capabilities by adding more advanced image recognition features, such as real-time object tracking and expanded visual analysis. We also aim to incorporate social features where users can share their discoveries and learn from others. Additionally, we want to explore gamification elements to make the learning process even more engaging. Lastly, we’re looking to enhance the AI model's ability to understand even more complex queries and provide richer, more detailed responses.
Urban Quest
Urban Quest is an interactive mobile app that allows users to capture images and ask questions about the content. With real-time AI-generated insights, Urban Quest makes everyday exploration fun and educational.
Features
- Capture Images: Use your camera to capture moments or objects.
- AI-Powered Responses: Ask questions about the images and get detailed AI-generated responses.
- Seamless Integration: Effortlessly switch between capturing photos and receiving educational insights.
How to Use
- Capture an Image: Open the app and use the camera feature to capture an image.
- Ask a Question: Type your question related to the captured image in the text field.
- Get Responses: The AI model will analyze the image and provide a meaningful response.
Technologies Used
- SwiftUI for the app interface.
- Google Cloud Vision for image recognition.
- Google Generative AI for text-based responses.
Analysis
View
Metric
- 2
Figures cover GitHub contributors during the hackathon window. A co-authored commit counts in full for each author, so per-member totals add up to more than the whole-team figures.
Technology
- SwiftIn code
- Google GeminiClaimed
1 of 2 appear in the indexed code. 1 claimed on Devpost could not be matched to code, which may simply mean the tool leaves no trace in the repository.
AI coding agents
No AI coding agent signals were found in this repository.
Detected from committed agent config files and commit authorship. Absence of a signal is not proof an agent was unused.
Codebase size
Source size
18 KB
Source files
8
Counts recognized source files only; vendored directories, binaries and lockfiles are excluded, so this is smaller than the repository on disk.
Repository
arricsekhon/urban-Quest
19 files · 43 KB · @ f7023d5
Structure
Application logic
18 files · 95%Domain rules, services and shared utilities.
+2 more
Supporting
Layers are inferred from where files sit in the tree, not from reading the code. A project that names its directories unconventionally will read oddly here — open the file browser to check anything the diagram implies.
Languages
- Swift95%
- Markdown5%
Share of indexed source by file size. Binary and vendored files are excluded.
Feature verification
AI-generated responses to questions about images (Gemini)Verified
Ask questions about the images and get detailed AI-generated responses using Google Generative AI
Claimed on readmehigh confidenceurban-Quest/ContentView.swift:47— GenerativeModel(name: "gemini-1.5-flash-002", apiKey: APIKey.default) is instantiated and model.generateContent(finalInput) is called on submiturban-Quest/APIkey.swift:5— APIKey.default reads the Gemini API key from GenerativeAI-Info.plisturban-Quest.xcodeproj/project.xcworkspace/xcshareddata/swiftpm/Package.resolved— generative-ai-swift package is pinned as a real dependency
Capture images via cameraVerified
Use your camera to capture moments or objects
Claimed on readmehigh confidenceurban-Quest/ContentView.swift:36— ImagePicker wraps UIImagePickerController with sourceType .camera, wired to a camera button via openCamera() and checkCameraAccess()
SwiftUI-based mobile app interfaceVerified
SwiftUI for the app interface
Claimed on readmehigh confidenceurban-Quest/ContentView.swift:1— App is built entirely with SwiftUI views (ContentView, ImagePicker, SideMenu)
Ask questions and receive contextual answers about a captured imageCode-supported
Whether it's identifying objects, explaining a scene, or answering specific questions related to the captured image, Urban Quest brings context and understanding to the world around the user
Claimed on Devpostmedium confidenceurban-Quest/ContentView.swift:260— generateResponse() concatenates a hardcoded placeholder 'image analysis' string with the user's text prompt and sends it to Gemini, so questions do get answered but not based on real visual analysis of the photourban-Quest/ContentView.swift:306— analyzeImageUsingVertexAI returns a hardcoded simulated string ('This image contains a sunset over the ocean.') instead of calling any real vision API, per its own comment 'Simulating a response here (replace this with actual API call)'
Seamless integration between capturing photos and receiving insightsCode-supported
Effortlessly switch between capturing photos and receiving educational insights
Claimed on readmemedium confidenceurban-Quest/ContentView.swift:179— Camera button, image thumbnail preview, text field, and submit button are combined in one input bar, and chatHistory stores paired input/response/image, showing a single-screen flow between capture and response
Side menu navigationCode-supported
Seamless Integration: Effortlessly switch between capturing photos and receiving educational insights (implied navigation via menu)
Claimed on readmelow confidenceurban-Quest/MenuView.swift:11— SideMenu view exists and is toggled open/closed from ContentView, but only contains static placeholder text items ('Menu Item 1/2/3') with no real functionality
Google Cloud Vision image analysisClaimed only
Google Cloud Vision for image recognition, integrated with Gemini for content generation
Claimed on readmehigh confidenceInteractive storytelling / exploration experienceClaimed only
Explore the world through interactive storytelling and image-based discovery
Claimed on Devpostmedium confidence
An AI agent derived these features from the project’s Devpost page and readme, then searched the code for each one. Verified features are backed by cited code; claimed-only features had no supporting code, which is not by itself proof a feature is missing.
Export this project's context (description, README, evidence, key source files) to chat with an AI agent elsewhere.