FirstSight
Description
Meta Ray-Ban first-aid guidance: contactless heart rate (rPPG), facial droop detection, and Gemini voice agent with JRCALC 2022 clinical GraphRAG. 🏆 3rd place UnicornMafia To The Americas 2026.
Installation
This entry records only its repository, not the path inside it, so there is no
exact command to give. Open the source below and copy the folder into
~/.claude/skills/, or the file into ~/.claude/agents/.
README
A Meta Ray-Ban first-aid guidance system. Point the glasses (or your phone/laptop camera) at a patient - the backend runs two real-time CV models and an AI voice agent that talks you through what it sees:
- Facial droop: detects stroke-related asymmetry using MediaPipe landmarks + EfficientNet-B0
- Heart rate: contactless remote photoplethysmography (rPPG) from skin colour (YOLOR head detection + CHROM/POS ensemble, no contact needed)
- Voice guidance: Gemini agent backed by JRCALC 2022 clinical guidelines GraphRAG
**Supported platforms:** browser webcam, iOS (iPhone), Android, Meta Ray-Ban glasses.
🏆 3rd Place - UnicornMafia "To The Americas" Hackathon 2026
Sponsored by Pydantic AI · Render · MUBIT · Lovable · Cognition · Expedite · The Residency
What It Can Do
Detect a stroke before it's obvious
Point the glasses at someone's face. FirstSight runs a MediaPipe landmark extractor and an EfficientNet-B0 model on every frame, scoring mouth, eye, and brow asymmetry in real time. Asymmetric faces (a key FAST indicator) are flagged immediately, with severity graded `none / mild / severe`. AUROC 0.98
Related Skills
Auto Update
Pull the latest ECC repo changes and reinstall the current managed targets.
Ecc Guide
Navigate ECC's current agents, skills, commands, hooks, install profiles, and docs from the live repository su
Epic Claim
Claim an epic issue, stamp coordination state, and sync local ownership.
Epic Publish
Publish a validated epic update back to the issue and local cache.
Epic Review
Mark epic review requested, approved, or changes requested.
Epic Unblock
Sweep blocked epic issues and reopen anything whose dependencies are closed.