Project Info
This project did not submit a demo video on Devpost.
Inspiration
Our project, Polarity, was born in the midst of an educational crisis, where overwhelmed educators are often unable to provide written notes for their lectures. This not only places a significant burden on students to accurately document these lectures but also takes away valuable time that could be spent on understanding and internalizing the material. We saw a unique opportunity to use technology to fill this gap by creating a tool that not only aids students in generating their own precise notes effortlessly but also empowers teachers.
What it does
With Polarity, educators can record their teachings, and the system will automatically transcribe and convert these recordings into detailed, well-formatted LaTeX notes, with every mathematical equation and concept captured accurately from voice to paper. This approach not only ensures students have access to high-quality notes but also streamlines the note-distribution process, making it more efficient for teachers to provide essential study materials to their students.
How we built it
We first created a dataset of LaTeX files manually based on audio clips from a variety different math and physics lectures, in order to maintain a more representative data sample. After that, we fine-tuned our model utilizing data pairs of audio clip transcripts (from speech to text) to LaTeX code. We turned to establish our formal data pipeline at this point, where we utilized MonsterAPI speech->text and then GPT4 text->LaTeX. Since the data was trained, and the pipeline was fully working at this point, the only task left to tackle was building a website using the innovative Reflex.dev framework. We were able to do this and connect it to our API chain (MonsterAPI/GPT4), finalizing our work.
Challenges we ran into
One of the biggest challenges we faced was dealing with model limitations earlier in the hackathon. We initially tried to train a PredictionGuard suggested model, DeepSeek, on our task. However, we faced limitations with the token response being very low for these models. After switching to GPT4, nearly none of these issues were relevant anymore. The next major issue we had was the efficiency of the model - it became too slow to the point of not being able to function properly, causing runtime errors with our environment. We had to make several changes to make the model faster, including changing our prompts and our data pipeline.
Accomplishments we're proud of
Polarity’s capability to intelligently organize lecture content into a structured format stands out remarkably. Not only does it transcribe words but it also discerns the flow of the lecture to create meaningful headers and sections autonomously. Beyond that, the accuracy with which Polarity renders mathematical equations, symbols, and concepts is unparalleled. Through rigorous training, our system has mastered the complex language of mathematics, allowing it to replicate the exact equations and symbols discussed in lectures. This capability ensures that every notation, from simple algebraic expressions to intricate calculus, is flawlessly represented in LaTeX (textbook) format. Polarity is also equipped with advanced speech processing algorithms that filter out filler words commonly found in spoken language. This ensures that the final notes are concise and free of clutter, containing only the critical information that students need to focus on. This feature is especially beneficial in maintaining the high quality and readability of the notes, ensuring they serve as an effective study tool.
What's next
We plan to roll out Polarity as a product for schools and universities across America, hopefully easing a burden off of overworked educators by providing a method to generate class notes for students with ease. While many AI models already exist for general information, there is not a currently feasible model that can specifically help implement work in LaTeX. We are working to create an API that allows educators to specifically tailor a AI model to their class structure and format.
This repository has no readme, or GitHub could not be reached.
Analysis
View
Metric
No commits on this project resolved to a GitHub account.
Technology
- PythonIn code
1 of 1 appear in the indexed code.
AI coding agents
No AI coding agent signals were found in this repository.
Detected from committed agent config files and commit authorship. Absence of a signal is not proof an agent was unused.
Codebase size
Source size
4.8 KB
Source files
3
Counts recognized source files only; vendored directories, binaries and lockfiles are excluded, so this is smaller than the repository on disk.
Repository
rish1p/polarity
6 files · 9 KB · @ 41f4261
Structure
Application logic
3 files · 50%Domain rules, services and shared utilities.
Supporting
Layers are inferred from where files sit in the tree, not from reading the code. A project that names its directories unconventionally will read oddly here — open the file browser to check anything the diagram implies.
Languages
- Python100%
Share of indexed source by file size. Binary and vendored files are excluded.
Dependencies
requirements.txt
pypi · 1- reflex
Declared in the repository’s manifests at the indexed commit. A declared package is not proof it is used, and runtime dependencies are listed first.
This project’s features have not been analysed yet.
Export this project's context (description, README, evidence, key source files) to chat with an AI agent elsewhere.