Project Info
This project did not submit a demo video on Devpost.
*S*ystematic *T*eaching *U*sing *D*ynamic *Y*ielding and *A*utonomous *I*ntelligence Overview StudyAI is a groundbreaking, voice-activated study assistant engineered to redefine the self-study experience. Utilizing cutting-edge machine learning, voice recognition, and natural language understanding technologies, this platform offers an array of features designed to facilitate efficient and effective study sessions.
Inspiration
In an era flooded with information, the conventional methods of self-study are fraught with challenges like information overload, disorganized note management, and a lack of personalized learning experiences. Study AI tackles these issues head-on, offering a revolutionary approach to academic learning and comprehension. Goals Our mission is to revolutionize self-study by providing an intelligent, voice-activated assistant that delivers a seamless and intuitive user experience. Study AI aims to become the go-to platform for students, offering features like text and video summarization, explanatory image generation, educational video recommendations, and personalized note management. Built With Frontend: Reflex.dev with custom React components as plugins Backend: FastAPI (via Reflex.dev) Voice Recognition and Text-to-Speech: 11Labs, Whisper Autonomous Agents: OpenAI function calling agents Text Summarization: Using mistralai/Mistral-7B-Instruct-v0.1 from TogetherAI Image Generation: Using stabilityai/stable-diffusion-2-1 from TogetherAI Challenges Implementing real-time voice recognition and natural language understanding with minimal latency (less than 5 seconds response time) Ensuring seamless integration of multiple technologies, including machine learning models and external APIs. Achieving scalability while maintaining high performance and reliability. Ensuring data privacy and security. Accomplishments Successfully developed a voice-activated command parsing module. Implemented autonomous decision-making capabilities using OpenAI function calling. Engineered data fetching and summarization modules with high accuracy and efficiency. Integrated YouTube API for enriched educational content. What We Learned How to integrate machine learning and voice recognition technologies to create a seamless user experience. The importance of a modular architecture for scalability and future expansions. How to manage and manipulate large datasets for quick and accurate retrieval. The nuances of user experience design, particularly for an educational tool. What's Next Implementing a personalized learning path based on user behavior and preferences. Expanding the database to include more academic resources and journals. Launching a mobile application to make StudyAI accessible on the go. Exploring partnerships with educational institutions for broader reach and impact. Features Voice Activation and Command Parsing: Understands user needs through voice commands. Autonomous Decision Making: Adapts to the user's needs, activating the most useful tools or functionalities. Text Summarization: Offers concise, yet comprehensive, academic information. Generate Visualizations: Provides visual aids for complex topics. YouTube Video Suggestions: Recommends relevant educational videos from YouTube.
S.T.U.D.Y.A.I
Systematic Teaching Using Dynamic Yielding and Autonomous Intelligence
Overview
Studyai is a groundbreaking, voice-activated study assistant engineered to redefine the self-study experience. Utilizing cutting-edge machine learning, voice recognition, and natural language understanding technologies, this platform offers an array of features designed to facilitate efficient and effective study sessions.
Inspiration
In an era flooded with information, the conventional methods of self-study are fraught with challenges like information overload, disorganized note management, and a lack of personalized learning experiences. Autostudy Buddy was conceived to tackle these issues head-on, offering a revolutionary approach to academic learning and comprehension.
Goals
Our mission is to revolutionize self-study by providing an intelligent, voice-activated assistant that delivers a seamless and intuitive user experience. Autostudy Buddy aims to become the go-to platform for students, offering features like text and video summarization, explanatory image generation, educational video recommendations, and personalized note management.
Built With
- Frontend: Reflex.dev with React components as plugins
- Backend: FastAPI
- Voice Recognition and Text-to-Speech: 11Labs, LLM
- Autonomous Agents: OpenAI function calling agents
- Text Summarization: TogetherAI
- Image Generation: TogetherAI
- Database: MindsDB
- YouTube Integration: MindsDB with YouTube API
Challenges
- Implementing real-time voice recognition and natural language understanding.
- Ensuring seamless integration of multiple technologies, including machine learning models and external APIs.
- Achieving scalability while maintaining high performance and reliability.
- Ensuring data privacy and security.
Accomplishments
- Successfully developed a voice-activated command parsing module.
- Implemented autonomous decision-making capabilities using OpenAI.
- Engineered data fetching and summarization modules with high accuracy and efficiency.
- Integrated YouTube API for enriched educational content.
- Designed an effective note management system using MindsDB.
What We Learned
- How to integrate machine learning and voice recognition technologies to create a seamless user experience.
- The importance of a modular architecture for scalability and future expansions.
- How to manage and manipulate large datasets for quick and accurate retrieval.
- The nuances of user experience design, particularly for an educational tool.
What's Next
- Implementing a personalized learning path based on user behavior and preferences.
- Expanding the database to include more academic resources and journals.
- Launching a mobile application to make Autostudy Buddy accessible on the go.
- Exploring partnerships with educational institutions for broader reach and impact.
Functions
- Voice Activation and Command Parsing: Understands user needs through voice commands.
- Autonomous Decision Making: Adapts to the user's needs, activating the most useful tools or functionalities.
- Text Summarization: Offers concise, yet comprehensive, academic information.
- Image Generation: Provides visual aids for complex topics.
- YouTube Video Suggestions: Recommends relevant educational videos.
- Note Management: Organizes user-uploaded study notes for easy retrieval.
Analysis
View
Metric
- 18
- 5
Figures cover GitHub contributors during the hackathon window. A co-authored commit counts in full for each author, so per-member totals add up to more than the whole-team figures.
Technology
- CSSIn code
- JavaScriptIn code
- Next.jsIn code
- PythonIn code
- ReactIn code
- Tailwind CSSIn code
- OpenAIClaimed
6 of 7 appear in the indexed code. 1 claimed on Devpost could not be matched to code, which may simply mean the tool leaves no trace in the repository.
AI coding agents
No AI coding agent signals were found in this repository.
Detected from committed agent config files and commit authorship. Absence of a signal is not proof an agent was unused.
Codebase size
Source size
135 KB
Source files
41
Counts recognized source files only; vendored directories, binaries and lockfiles are excluded, so this is smaller than the repository on disk.
Repository
IdkwhatImD0ing/STUDYAI
69 files · 12.6 MB · @ eb08360
Structure
Interface
21 files · 30%Screens, components and styles rendered to the user.
Application logic
17 files · 25%Domain rules, services and shared utilities.
Supporting
Layers are inferred from where files sit in the tree, not from reading the code. A project that names its directories unconventionally will read oddly here — open the file browser to check anything the diagram implies.
Languages
- JavaScript77%
- Python21%
- Markdown3%
- CSS0%
Share of indexed source by file size. Binary and vendored files are excluded.
Dependencies
.web/package.json
npm · 26- @chakra-ui/icons
- @chakra-ui/react
- @chakra-ui/system
- @emotion/react
- @emotion/styled
- axios
- focus-visible
- framer-motion
- json5
- next
- next-sitemap
- next-themes
- react
- react-dom
- react-markdown
- react-syntax-highlighter
- recordrtc
- rehype-katex
- +8 more
requirements.txt
pypi · 1- reflex
Declared in the repository’s manifests at the indexed commit. A declared package is not proof it is used, and runtime dependencies are listed first.
This project’s features have not been analysed yet.
Export this project's context (description, README, evidence, key source files) to chat with an AI agent elsewhere.