Overview
Networking events move fast. You can meet dozens of people in a day, swap contacts, and still forget the most important part: what made the conversation meaningful. In typical interactions, you keep contact info, but not real context: what you talked about, what you promised, where you met, or even what the person looked like.
Converge builds the passive CRM that redefines professional networking. The app processes real-time video and audio feeds (ideally from Meta glasses, but we didn’t have any so we used a phone). Important details are extracted from these feeds, shown in a live AR display, and saved to a CRM dashboard for later viewing.
Technical Details
There was a LOT of components to this project that were very difficult to integrate, but luckily my hackathon teammates were absolutely cracked so we pulled it off.
- Real-time vision: Using Overshoot, we processed the video feed into live visual details for storage (e.g. what the person was wearing, what their nametag said)
- Real-time audio: LiveKit gave us live conversation transcription, with voice diarization allowing us to distinguish between speakers in the audio
- Headshot generation: we used Gemini to generate clean-looking headshots for the dashboard, for each person you talk to
- Face recognition: a face embedding vector is generated when a person is detected, and a vector search is performed to determine if you’ve talked to that person before
- Conversation context storage: synthesized with Gemini and stored in MongoDB Atlas
- Interactive visualization of connections: D3.js
- there’s definitely more I’m forgetting, this project was kind of insane
NexHacks
My team built this at NexHacks, which was hosted at CMU in Pittsburgh! It was the furthest I’d ever travelled to a hackathon, and the biggest hackathon I’d ever been to. Fortunately I found a really great team of guys from all over the country, and we locked in for the whole 24 hours and built my most ambitious hackathon project yet.
Here’s the devpost!
Repository
rribeiropedro/converge
Updated 20 days ago
Last updated on January 28, 2026.