# Project export: TeslaQA

This document was generated by HackStack to give an AI agent context about a hackathon project. Sections are labeled with their provenance; content marked as truncated was cut to keep this document small.

## Project metadata

- Hackathon: TreeHacks 2025
- Tagline: Our project combines BLIP's ability to convert traffic videos into text descriptions with ChatGPT's question-answering capabilities to automatically analyze and explain complex traffic scenarios.
- Devpost: https://devpost.com/software/teslaqa
- GitHub: https://github.com/HangLiu01/2025treehacks_tesla
- Demo: https://www.kaggle.com/competitions/tesla-real-world-video-q-a/leaderboard
- Team: 1 GitHub contributor(s) — Hang (4 commits)

## Devpost submission (written by the team)

### Inspiration

Current Vision Language Models (VLMs), despite their ability to learn "common sense" from internet data and handle long-tail cases, fall short in autonomous driving applications due to two critical limitations: they can't process high frame-rate video inputs and can't meet real-time latency requirements. This gap presents significant implications for real-world applications: Autonomous vehicle development needs better analysis of edge cases Driving schools require objective assessment tools Insurance companies seek efficient claim verification methods Law enforcement needs automated traffic violation analysis

### What it does

TeslaQA automatically analyzes traffic videos and answers questions about driver behavior, traffic rules, and road safety. By first converting video content into descriptive text using BLIP, and then leveraging ChatGPT for question-answering, our system provides detailed explanations of traffic scenarios.

### How we built it

Used BLIP to convert video frames into detailed text descriptions Employed ChatGPT API to analyze these descriptions and answer specific questions Created a pipeline that processes 5-second traffic videos Developed custom prompt engineering to ensure accurate and relevant responses

### Challenges we ran into

Initially struggled with TimeSformer model and BLIP model for video understanding Faced issues with different video frame rates and lengths Had to optimize the text descriptions to be both concise and informative Needed to carefully design prompts to get consistent, accurate answers

### Accomplishments we're proud of

Successfully combined computer vision and language models Created an interpretable system that can explain its reasoning Achieved accurate answers for complex traffic scenarios Built a scalable solution that can handle various traffic situations

### What we learned

The importance of model selection for specific tasks How to effectively combine multiple AI models The value of converting visual data to text for better interpretability Techniques for prompt engineering with GPT models

### What's next

Fine-tune BLIP model for specialized traffic understanding: Generate more precise descriptions of vehicle movements, signals, and road conditions Better capture critical driving behaviors and safety moments Develop traffic-specific visual attention mechanisms Fine-tune BLIP model for specialized traffic understanding: Generate more precise descriptions of vehicle movements, signals, and road conditions Better capture critical driving behaviors and safety moments Develop traffic-specific visual attention mechanisms Enhance text summary quality through: Adding detailed spatial relationships between vehicles Incorporating multi-frame temporal understanding Building specialized traffic vocabulary and context Enhance text summary quality through: Adding detailed spatial relationships between vehicles Incorporating multi-frame temporal understanding Building specialized traffic vocabulary and context Technical Improvements: Integrate with existing traffic monitoring systems Develop APIs for easy integration Create efficient frame selection algorithms Optimize for real-time processing Technical Improvements: Integrate with existing traffic monitoring systems Develop APIs for easy integration Create efficient frame selection algorithms Optimize for real-time processing Model Enhancement: Train on larger, more diverse traffic datasets Implement more sophisticated prompting strategies Add multi-camera support Develop hierarchical summarization capabilities Model Enhancement: Train on larger, more diverse traffic datasets Implement more sophisticated prompting strategies Add multi-camera support Develop hierarchical summarization capabilities Our goal is to make roads safer by providing better tools for understanding and analyzing traffic scenarios, ultimately contributing to the development of more reliable autonomous driving systems and better driver education. The kaggle link is listed below. And our team name is 'passionfruit.'

## README (from the GitHub repository)

# 2025treehacks_tesla

https://www.kaggle.com/competitions/tesla-real-world-video-q-a/overview


## Detected evidence (automated analysis)

Indexed codebase: 1 recognized source files, 0 KB.
- OpenAI (technology) — claimed on Devpost, not found in the code
- Python (language) — claimed on Devpost, not found in the code

## Codebase structure (from repository index)

### Files (3 of 3)

```
integrated_model.ipynb
model.ipynb
README.md
```

### Dependencies

No dependency index available.

### Recent commits (newest first)

- upload a more integrated version of our code
- upload main model
- Update README.md
- Initial commit

## Key source files (fetched from GitHub, selected and truncated for size)

No suitable source files found.