Inspiration

I was at the Columbia hackathon last week when I had the opportunity to see social Stockfish (an AI that predicts conversation flow, like a chess engine for chats) get built next to me. It blew my mind. Shoutout to @eddybuild and @cadenbuild for their work on the chess glasses (the reason I bought the meta ray bands lmao) and social Stockfish---it was a huge spark for me. I wanted to create something similarly badass, a glimpse into the future of AI-powered wearable social intelligence. So, I jumped into a solo project to challenge myself at one of the biggest stages. The result? TalkTuah---a real-time conversation coach that listens, analyzes, and guides you through any interaction. What It Does Real-Time Listening: Captures conversation and transcribes it on the fly. Engagement & Body Language Tracking: Keeps an eye on how people are reacting. Smart Suggestions: Provides AI-generated tips and responses right when you need them. Wearable Output: Whispers prompts through Meta Ray-Bans (yes the glasses---but no official SDK!). It's perfect for dates, interviews, or just hanging out. TalkTuah subtly nudges you toward your goal without taking over the conversation. How I Built It Speechmatics for live transcription. OpenAI + Grok to generate and refine conversation strategies. BlackHole 2ch for seamless audio routing (in and out). ElevenLabs for text-to-speech, whispering cues through the Ray-Bans. Meta Ray-Bans have no official SDK, so I had to piece together custom workarounds to make it all function in real time. Challenges No SDK for Meta Ray-Bans: The biggest headache by far. Low Latency: Had to make sure everything responded fast enough for real conversation. Natural Feel: Too many AI interruptions get weird, so timing was everything. Next Steps Speed & Smoothness: Optimize real-time performance even more. Advanced Body Language Detection: Refine how TalkTuah interprets nonverbal cues. Mobile App Companion: Bring these features to people without the glasses.