Project Info
Inspiration
As naturally curious people, we often find ourselves researching multiple topics or juggling different tasks at the same time. Over time, it becomes increasingly difficult to keep track of scattered information and to extract what truly matters while filtering out the noise. This process is further slowed by the constant, time-consuming context switching between note-taking apps and web browsers, which fragments attention and disrupts productive research flow. We wanted an easy way to capture an instance that matters, across multiple sources, and bring them into a single, organized space. We realized screenshots are a powerful tool for capturing information instantly. Tools like Notion and Google Docs are excellent for note-taking, and AI can generate insights when given context. Relay it was incepted from the combination of all these ideas into one seamless workflow. Just like pointing at something and saying, “Relay it!” AI takes over the heavy lifting. From that moment on, AI handles the capture and organization of information, allowing you to keep browsing without breaking your flow.
What it does
Relay It is an AI-powered research workspace that turns visual browsing into organized, actionable notes. The Core Workflow: Capture - Take screenshots of anything interesting while researching (This is already the most time comsuming process of the whole workflow!!!!) Intelligent Analysis - Each screenshot is analyzed by AI to understand: What information it contains (OCR text extraction) Why you captured it (user intent detection) How it relates to your other screenshots (context clues) Smart Note Generation - Instead of showing raw data or JSON, Relay It generates context-aware markdown notes tailored to what you're doing: Trip planning? Get hotel comparisons, decision frameworks, and itinerary suggestions Job searching? Get position comparisons, application trackers, and interview prep notes Content creation? Get structured outlines, key talking points, and source citations Learning? Get concept summaries, connections between ideas, and study guides Your notes aren't static, you can: Talk with AI to add more information or ask questions Talk with AI to add more information or ask questions Directly edit the markdown for full control Directly edit the markdown for full control Add new screenshots that automatically integrate into existing notes Add new screenshots that automatically integrate into existing notes The Result: Seemingly disorganized screenshots become a living document that helps you understand, compare, and act on your research— seamlessly.
How we built it
A stroke of luck, ~1050mg of caffeine.
Challenges we ran into
Our biggest problem was not one of technicality but one of collaboration and a lack of communication. Creative differences led to arguments and nearly led us to quitting altogether. Thankfully we were able to use our words to come to a better conclusion than that and were able to produce a final product we were all proud of in the end.
Accomplishments we're proud of
The accomplishment we’re most proud of is turning messy, passive information into something interactive and useful. Instead of just storing screenshots, we built a system that understands context, generates insights, and lets users edit their notes through conversation. Technically, we’re proud of how the frontend, backend, and AI reasoning work together seamlessly under hackathon time pressure. Conceptually, we’re proud that it genuinely saves cognitive load and helps people think, not just collect data.
Relay It Backend
AI-powered backend API for screenshot analysis and intelligent note management. Built for research sessions where users capture screenshots and receive AI-generated insights, summaries, and interactive note editing.
What It Does
This backend provides RESTful API endpoints that power the Relay It application:
- Screenshot Analysis - Analyzes uploaded images using Google's Gemini 2.0 Flash to extract text, identify entities (hotels, restaurants, products, etc.), and generate structured insights
- Session Management - Organizes screenshots into sessions with metadata tracking and retrieval
- AI Summarization - Creates intelligent summaries from multiple screenshots and entities within a session
- Interactive Chat - Enables users to edit markdown notes via natural language commands or ask questions about their research
- Regeneration - Re-analyzes screenshots with refined prompts for improved results
Tech Stack
- Next.js 16 - API routes with Edge Runtime for fast global deployment
- TypeScript - Full type safety across all endpoints
- Gemini 2.0 Flash Exp - Google's latest AI model for vision and text generation
- Supabase - Authentication and PostgreSQL database
- Vercel - Serverless deployment platform
API Endpoints
POST /api/analyze- Analyze screenshot and extract entitiesPOST /api/summarize- Generate session summary from entitiesPOST /api/regenerate- Re-analyze with custom promptsPOST /api/chat- Interactive note editing and Q&AGET /api/sessions- List all sessionsGET /api/sessions/[id]- Get session details
See API.md for detailed endpoint documentation.
Quick Start
npm install
npm run dev
Environment variables required:
GEMINI_API_KEY- Google AI API key
Deployed at: https://relay-that-backend.vercel.app
Analysis
View
Metric
- 18
- 2
Figures cover GitHub contributors during the hackathon window. A co-authored commit counts in full for each author, so per-member totals add up to more than the whole-team figures.
Technology
- Next.jsIn code
- ReactIn code
- SupabaseIn code
- TypeScriptIn code
- FlaskClaimed
- Node.jsClaimed
- PostgreSQLClaimed
- PythonClaimed
- SwiftClaimed
- VercelClaimed
4 of 10 appear in the indexed code. 6 claimed on Devpost could not be matched to code, which may simply mean the tool leaves no trace in the repository.
AI coding agents
No AI coding agent signals were found in this repository.
Detected from committed agent config files and commit authorship. Absence of a signal is not proof an agent was unused.
Codebase size
Source size
95 KB
Source files
16
Counts recognized source files only; vendored directories, binaries and lockfiles are excluded, so this is smaller than the repository on disk.
Repository
AndrewMahran7/Relay-It-Server
34 files · 1.0 MB · @ a8cf67c
Structure
Interface
2 files · 6%Screens, components and styles rendered to the user.
API & routing
7 files · 21%Request entry points: routes, handlers and controllers.
Application logic
11 files · 32%Domain rules, services and shared utilities.
Supporting
Layers are inferred from where files sit in the tree, not from reading the code. A project that names its directories unconventionally will read oddly here — open the file browser to check anything the diagram implies.
Languages
- TypeScript59%
- Markdown41%
Share of indexed source by file size. Binary and vendored files are excluded.
Dependencies
package.json
npm · 10- @supabase/supabase-js
- next
- react
- react-dom
- +6 more
Declared in the repository’s manifests at the indexed commit. A declared package is not proof it is used, and runtime dependencies are listed first.
This project’s features have not been analysed yet.
Export this project's context (description, README, evidence, key source files) to chat with an AI agent elsewhere.