The Unheard Classroom

The Unheard Classroom is a radical reimagining of the school environment for a world where screens are no longer the center of attention. Instead, learning is mediated through ambient audio and subtle haptic cues. Students wear lightweight over-ear headphones that deliver spatial audio and a wristband that provides tactile feedback corresponding to emotions, emphasis, and narrative beats. The classroom itself is equipped with an array of microphones and speakers that create a responsive soundscape, allowing teachers to guide lessons through voice and sound design rather than slides or whiteboards.

Curriculum modules are built around 'unheard biographies'—deeply researched audio narratives from marginalized communities, historical figures, and contemporary voices rarely represented in mainstream education. Students listen, then respond by speaking, moving, or using simple gestures that alter the narrative's path. The haptic wristband conveys emotion (e.g., a warm pulse for empathy, a sharp buzz for tension), enabling a visceral connection to the material. Teachers receive ambient analytics via a discreet earpiece, tracking engagement and comprehension without visual distractions.

The project was born out of a frustration with attention economy–driven edtech and a belief that the post-smartphone era will demand more embodied, empathetic learning experiences. It never got built because the team disbanded when two key members moved overseas, and hardware costs remained prohibitive without outside funding. But the vision lives on.

Traditional education relies heavily on screens, reading, and visual stimuli, which fragment attention and often fail to foster deep empathy. In a post-smartphone world, we have an opportunity to rediscover oral traditions and embodied learning. Yet current tools ignore the power of audio and touch. Many students—especially those from unheard backgrounds—struggle to see themselves in a curriculum that prioritizes written text and visual media. The Unheard Classroom addresses this by centering voices and feelings, making diversity intrinsic to the medium itself.

• Develop a curriculum of 10 'unheard biographies' covering topics from indigenous environmental knowledge to the history of sign language, each lasting 3–5 sessions.
• Create a haptic vocabulary of at least 12 distinct patterns (e.g., 'curiosity', 'conflict', 'resolution') that can be reliably recognized by students.
• Build a classroom deployment kit costing under $500 per student (including headphones and wristband).
• Pilot in three diverse schools (urban, rural, and a school for the deaf with adapted feedback) with 60 students total.
• Achieve 80% of students reporting increased empathy toward the biographical subjects, measured via pre- and post-surveys and qualitative interviews.

• Not a replacement for all subjects—focuses on humanities, social studies, and ethics.
• Not a fully automated system—teacher remains central as facilitator and storyteller.
• Not a competitive or gamified platform—no scores, levels, or achievements.
• Not a solo experience—the classroom is inherently collective, with shared soundscapes and group reflections.
• Not a screen-based analytics dashboard—teacher feedback is auditory and haptic.

• Custom haptic wristband: microcontroller (ESP32), coin vibration motors (4–6), accelerometer for gesture input, LiPo battery.
• Over-ear headphones with bone conduction transducers and integrated microphone (for student voice responses).
• Classroom base station: Raspberry Pi 4 with audio interface (Focusrite Scarlett 18i8), directional microphone array, and software-defined radio for low-latency streaming to wearables.
• Audio engine: JUCE framework for content creation, with spatial audio via 3GPP (MPEG-H) and haptic track editing in Reaper.
• Analytics: Real-time audio stream processing with OpenSMILE for vocal sentiment analysis, feeding a sonified dashboard for the teacher (e.g., rising pitch = low engagement).

The system is divided into three layers:

1. Content Creation Studio: Teachers or audio producers use a desktop app (built in JUCE) to record narratives, layer soundscapes, and draw haptic patterns on a timeline. Haptic patterns are encoded as MIDI-like note events (pitch = intensity, velocity = sharpness) and synced to the audio file. The output is an .unheard file: a container with multichannel audio and haptic metadata.

2. Classroom Server: A Raspberry Pi running custom Python software scans a QR code at the start of each session to load the day's .unheard file. It streams audio over a local Wi-Fi network (using ESP-NOW for low latency) to each student's headset. Simultaneously, it broadcasts haptic data via BLE to the wristbands. The server also listens to room microphones to detect student response phrases (trigger words like 'agree' or 'question') and adjusts the narrative branching accordingly.

3. Wearable Firmware: The headset receives audio and mixes it with spatial cues based on the student's position (via accelerometer). The wristband renders haptic patterns using a dedicated vibration motor driver chip (DRV2605). Students can input simple gestures (tap, swipe, shake) to signal emotional reactions, which are sent back to the server as biometric metadata.

1. Haptic ambiguity: Students may not consistently interpret haptic patterns as intended, leading to confusion.
2. Audio fatigue: Extended listening may cause cognitive overload, especially for neurodivergent students.
3. Hardware cost: $500/student is still high for underfunded schools; material sourcing during supply chain disruptions.
4. Teacher training: Requires a mindset shift from visual to audio pedagogy; may face resistance.
5. Privacy: Biometric data (heart rate from wristband, voice recordings) raise consent and data security issues.

• How do we assess learning outcomes without written tests? (Potential: oral portfolios, peer-to-peer teaching)
• Can haptics convey nuanced emotions like 'ambivalence' or 'irony' reliably?
• Should the system support multiple languages from the start, or start with English only?
• How to handle students with hearing impairments? (The wristband could be primary, with visual or vibrotactile alternatives)
• What is the optimal class size for an ambient audio classroom? (Pilot will try 15–25 students)

The project lost momentum when two co-founders accepted faculty positions abroad, and hardware prototyping costs exceeded the small grant we received. We never found a school district willing to pilot untested haptic technology at scale. So it remained a plan—a very detailed one—on a shared drive. No tragedy, just timing.

The Unheard Classroom was originally conceived during a workshop on post-digital futures. Its name comes from the idea that so many voices are literally unheard in traditional schooling. The haptic patterns were inspired by research at the MIT Media Lab on emotional vibrotactile communication. One early prototype used vibrating motors from old smartphones.