Project Info
This project did not submit a demo video on Devpost.
Inspiration
This project is deeply personal for me. As a software engineer apprentice at Sony Interactive Entertainment, I often join professional meetings on Zoom and Microsoft Teams. However, I frequently leave my camera off—not out of preference, but because Zoom’s virtual backgrounds fail to represent me properly. My curly, textured hair is often distorted, cut off, or blends unnaturally, making me feel misrepresented and self-conscious on screen. This isn't just my experience; many Black professionals and individuals with curly or afro-textured hair face the same issue. Existing segmentation models are primarily trained on straight and wavy hair, leaving our textures as an afterthought. AfroVision aims to fix this by improving hair segmentation for virtual backgrounds, ensuring people with all hair types are represented accurately and equitably.
What it does
AfroVision enhances virtual background rendering by improving the segmentation of curly, coily, and afro-textured hair. We implemented DeepLabV3 with ResNet101 to segment hair while testing how different models handle diverse textures. Our system processes images, generates segmentation masks, and seamlessly blends the subject with a virtual background.
How we built it
Data Collection: We sourced datasets focusing on curly, wavy, and afro-textured hair, scraping additional images to ensure diversity. Segmentation Model: Used DeepLabV3-ResNet101 for semantic segmentation. Image Processing: Preprocessed images, normalized data, and resized masks for improved accuracy. Testing & Evaluation: Applied segmentation to real-world images to assess effectiveness on different hair textures.
Challenges we ran into
Dataset Limitations: Many publicly available datasets lack representation of diverse hair textures. We had to scrape and manually verify images to supplement the dataset. Google Drive Issues: Encountered technical difficulties accessing and managing data stored in Google Drive, slowing down our workflow. Processing Errors: Debugging file path errors and refining image preprocessing took significant time. Time Constraints: With a limited window, fine-tuning on afro-textured hair remains a next step beyond this hackathon.
Accomplishments we're proud of
Successfully segmented multiple curly hair textures and demonstrated virtual background blending. Created a working pipeline for future fine-tuning and improvement. Identified key areas where segmentation models fall short for Black and curly-haired users, setting a foundation for addressing this bias.
What we learned
Importance of Representation in AI: Bias in training data leads to biased models. We saw firsthand how standard segmentation models struggle with diverse hair types. Fine-Tuning is Essential: Pre-trained models work to an extent but must be customized to better capture curls and coils. Efficient Debugging Matters: Managing large datasets and troubleshooting Google Drive path issues is a skill in itself.
What's next
Integrate with Zoom SDK: Implement AfroVision into Zoom's virtual background system to enable real-time segmentation improvements. Fine-Tune on Afro Hair Data: We need to train DeepLabV3 further with more labeled images of afro-textured hair. Expand Dataset & Annotation: Manually annotate and generate higher-quality segmentation masks for kinky, coily, and tightly curled hair. Improve Real-Time Performance: Optimize processing speed for live applications like Zoom and Google Meet. Open Source Contribution: Publish the dataset and model improvements to benefit other developers tackling bias in computer vision. Fine-Tune on Afro Hair Data: We need to train DeepLabV3 further with more labeled images of afro-textured hair. Expand Dataset & Annotation: Manually annotate and generate higher-quality segmentation masks for kinky, coily, and tightly curled hair. Improve Real-Time Performance: Optimize processing speed for live applications like Zoom and Google Meet. Open Source Contribution: Publish the dataset and model improvements to benefit other developers tackling bias in computer vision.
AfroVision
Improving Hair Segmentation for Curly and Afro-Textured Hair
Inspiration
Virtual backgrounds often distort or cut off curly, textured, and afro hair due to biased segmentation models trained mostly on straight and wavy hair. AfroVision enhances segmentation accuracy to ensure better representation across all hair types.
What It Does
AfroVision improves virtual background rendering by enhancing segmentation for curly, coily, and afro-textured hair. We implemented DeepLabV3 with ResNet101 to refine hair detection and blending in virtual settings.
How It Was Built
Data Collection: Curated datasets featuring diverse hair textures, supplemented by scraping additional images. Segmentation Model: Used DeepLabV3-ResNet101 for precise hair segmentation. Preprocessing & Augmentation: Normalized images and resized masks for consistency. Testing & Evaluation: Applied segmentation to real-world images, analyzing effectiveness across different hair textures.
Challenges
Dataset Gaps: Most datasets lack adequate representation of Black and curly hair. File Management Issues: Google Drive access problems slowed workflow. Processing Errors: Debugging segmentation outputs and image masks took time. Time Constraints: While functional, further fine-tuning is necessary for real-time applications.
Accomplishments
Built a working segmentation model tailored for diverse hair textures. Demonstrated real-world improvements in virtual background blending. Identified biases in existing models and laid the foundation for future fine-tuning. What We Learned AI Bias Affects Real-World Applications: Standard models struggle with afro-textured hair due to limited training data. Fine-Tuning is Key: Pre-trained models help, but domain-specific data is essential. Efficient Debugging Saves Time: Managing datasets, handling file paths, and optimizing preprocessing are crucial.
Next Steps
🚀 Integrate with Zoom SDK for real-time segmentation 📊 Fine-tune on afro-textured hair datasets 📂 Expand dataset & annotation for better model generalization ⚡ Optimize performance for real-time applications 🛠 Open-source AfroVision to help address bias in AI
Analysis
View
Metric
- 2
Figures cover GitHub contributors during the hackathon window. A co-authored commit counts in full for each author, so per-member totals add up to more than the whole-team figures.
Technology
- PythonIn code
- PyTorchClaimed
1 of 2 appear in the indexed code. 1 claimed on Devpost could not be matched to code, which may simply mean the tool leaves no trace in the repository.
AI coding agents
No AI coding agent signals were found in this repository.
Detected from committed agent config files and commit authorship. Absence of a signal is not proof an agent was unused.
Codebase size
Source size
4.7 KB
Source files
2
Counts recognized source files only; vendored directories, binaries and lockfiles are excluded, so this is smaller than the repository on disk.
Repository
Pamelachristina/AfroVision
9 files · 17.6 MB · @ 123439d
Structure
Application logic
5 files · 56%Domain rules, services and shared utilities.
Supporting
Layers are inferred from where files sit in the tree, not from reading the code. A project that names its directories unconventionally will read oddly here — open the file browser to check anything the diagram implies.
Languages
- Python54%
- Markdown46%
Share of indexed source by file size. Binary and vendored files are excluded.
This project’s features have not been analysed yet.
Export this project's context (description, README, evidence, key source files) to chat with an AI agent elsewhere.