Project Info
This project did not submit a demo video on Devpost.
Inspiration
Devin is really annoying to use, but imagine you could just deploy full-stack apps with just your voice - pretty much J.A.R.V.I.S for software engineering.
What it does
Generates apps based on voice input and even uses computer use agents to mimic UI designs.
How we built it
Scrapybara for computer use to screenshot similar designs, Gemini's VLM to take the screenshot and describe it in natural language, ElevenLabs / Whisper for voice communication, and o1 for all of our software agents.
Challenges we ran into
Figuring out how the APIs worked and stringing everything together. Also a lot of latency issues.
Accomplishments we're proud of
We somehow managed to get something working in this short timeframe.
What we learned
You just gotta have fun with it tbh.
What's next
A lot more integrations and getting a fully working web app. This could be a decent startup idea too, especially if it controls an army of software agents.
D.E.V.I.S
Design Evolution Via Intelligent Systems
DEVIS is a multi-agent system that helps create and deploy UI/UX designs through voice interaction and AI-powered code generation.
Components
- Voice Agent: Captures and processes verbal feedback from engineers
- Frontend Agent: Generates React components and styles based on requirements
- Screenshot Agent: Captures and analyzes reference designs using Anthropic's Claude
- Deployment Agent: Automatically deploys generated code to GitHub and Vercel
Setup
- Install dependencies:
pip install -r requirements.txt
- Create a
.envfile with the following keys:
OPENAI_API_KEY=your_openai_key
ANTHROPIC_API_KEY=your_anthropic_key
GITHUB_TOKEN=your_github_token
VERCEL_TOKEN=your_vercel_token
- Install system dependencies for PyAudio:
brew install portaudio
Usage
- Run the main script:
python main.py
- Speak your UI/UX requirements when prompted
- Optionally provide a reference URL for design inspiration
- The system will:
- Process your voice input
- Generate React components and styles
- Create a GitHub repository
- Deploy to Vercel automatically
Example
from devis import DEVIS
devis = DEVIS()
devis.run_design_cycle(reference_url="https://example.com")
Notes
- Make sure your microphone is properly configured
- Ensure you have sufficient permissions for GitHub and Vercel APIs
- The generated code uses React and Tailwind CSS by default
Analysis
View
Metric
- 3
- 1
Figures cover GitHub contributors during the hackathon window. A co-authored commit counts in full for each author, so per-member totals add up to more than the whole-team figures.
Technology
- AnthropicIn code
- FastAPIIn code
- OpenAIIn code
- PythonIn code
- VercelIn code
- Google GeminiClaimed
5 of 6 appear in the indexed code. 1 claimed on Devpost could not be matched to code, which may simply mean the tool leaves no trace in the repository.
AI coding agents
- CursorConfig
Detected from committed agent config files and commit authorship. Absence of a signal is not proof an agent was unused.
Codebase size
Source size
25 KB
Source files
6
Counts recognized source files only; vendored directories, binaries and lockfiles are excluded, so this is smaller than the repository on disk.
Repository
jessechoe10/DEVIS
9 files · 31 KB · @ 057bf3c
Structure
Application logic
5 files · 56%Domain rules, services and shared utilities.
Supporting
Layers are inferred from where files sit in the tree, not from reading the code. A project that names its directories unconventionally will read oddly here — open the file browser to check anything the diagram implies.
Languages
- Python94%
- Markdown6%
Share of indexed source by file size. Binary and vendored files are excluded.
Dependencies
requirements.txt
pypi · 17- anthropic
- elevenlabs
- fastapi
- google-ai-generative-language
- google-generativeai
- openai
- Pillow
- pyaudio
- PyGithub
- python-dotenv
- python-multipart
- scrapybara
- sounddevice
- soundfile
- speechrecognition
- uvicorn
- vercel
Declared in the repository’s manifests at the indexed commit. A declared package is not proof it is used, and runtime dependencies are listed first.
This project’s features have not been analysed yet.
Export this project's context (description, README, evidence, key source files) to chat with an AI agent elsewhere.