Haptic Echo: A Non-Visual Ambient Messaging Protocol for Post-Screen Sociality

Haptic Echo reimagines interpersonal messaging in a world where screens have faded from daily life. As ambient computing environments—smart speakers, wearables, smart home sensors—become the primary interface, we lack a lightweight, non-intrusive way to send and receive social signals. Inspired by the tactile and auditory richness of pre-digital communication (whistles, hand gestures, vibrations), this project explores a protocol built on haptic patterns and short audio tones. The research moves through three phases: (1) co-design workshops with diverse groups including blind, deafblind, and sighted users to ideate communication scenarios; (2) iterative prototyping of wearable haptic bands and ambient audio beacons; (3) a 4-week field deployment with 20 participants in a mock 'post-smartphone' household. The goal is to understand the social dynamics, privacy implications, and emotional resonance of non-visual messaging, and to produce design guidelines for ambient social systems that are inclusive by default.

Current messaging paradigms rely on visual interfaces—screens, text, emojis. In a future where screens are replaced by environmental sensors, voice assistants, and wearables, how will we maintain the intimacy and spontaneity of quick messages? Voice-only solutions (like walkie-talkies) lack subtlety and privacy. Haptic-only feedback is limited in expressivity. Moreover, many existing solutions exclude people with visual or hearing disabilities. Haptic Echo addresses the gap by designing a multimodal (touch + sound) messaging protocol that is inherently accessible, because it isn't built on a visual foundation. It asks: Can a combination of patterned vibrations and tonal cues convey emotional nuance, urgency, and identity—without a screen? And how does such a medium reshape social norms around attention, availability, and connection?

• Develop a vocabulary of haptic-audio primitives (e.g., vibration patterns for 'thinking of you', 'call me', 'arrived home') through participatory design with at least 15 users of varying abilities.
• Build a functional prototype consisting of a wrist-worn haptic actuator and a small ambient speaker that can send/receive messages via a local mesh network.
• Conduct a 4-week field study with 20 participants living in a simulated ambient environment (shared apartment with smart sensors but no screens) to measure message frequency, emotional response, and privacy preferences.
• Produce a design framework for non-visual social protocols that can be adapted by other researchers and practitioners.
• Publish findings at a top-tier HCI conference (e.g., CHI, UbiComp) with inclusive design principles.

• Creating a fully polished consumer product.
• Replacing all forms of digital communication; Haptic Echo is for specific lightweight social signals.
• Designing for long-form conversation; no text-to-speech or speech-to-text.
• Solving all accessibility issues; focus on blind/low-vision and general population, not Deaf community (though audio tones may be used).
• Integrating with existing smartphone apps; we assume a post-smartphone environment.
• Commercialization; this is purely research.

Wearable haptic actuators (e.g., Lofelt L5 or TECOTEC vibration motors), Arduino-compatible microcontrollers (Adafruit Feather nRF52840 with BLE), ambient speakers (e.g., JBL Clip or custom PZT speakers), mesh networking protocol (OpenThread or ESP-NOW), 3D-printed enclosures, conductive thread for fabric-based wearables, audio editing software (Audacity), signal processing libraries (Python, librosa), and co-design materials (low-fi prototyping kits, paper forms, video recording). Also: a simulated smart home testbed with motion sensors, smart lights, and air quality monitors to create an ambient environment.

The system is built around a central 'ambient hub' (a Raspberry Pi in each room) that relays messages between nodes. Each user wears a haptic band (wrist) and carries a small 'tone cube' (optional) that emits short audio cues. Messages are composed by combining two dimensions: a vibration pattern (rhythm, intensity, duration) and an audio tone (pitch, timbre, duration). Users can assign contacts to specific patterns (e.g., friend A's pattern is a triple pulse + a rising tone; friend B is a slow wave + a low hum). Messages are sent by selecting a recipient from a simple tactile menu on the band (tap patterns to cycle through contacts) or via voice command to the ambient hub. The hub handles encoding and transmission. On reception, the band vibrates the pattern and the tone cube plays the associated sound. The architecture emphasizes low latency, privacy (no cloud, local mesh only), and low cognitive load. The research methods include ethnographic observation, experience sampling via micro-surveys prompted by deliberate interruptions, and post-study interviews.

• Participants may find haptic patterns difficult to learn or remember, leading to low adoption.
• Audio tones may be perceived as intrusive or noisy in shared spaces.
• The simulated environment may not capture real-world usage dynamics.
• Privacy concerns: since messages are sent via ambient speakers, others in the room can hear them.
• Technical challenges with mesh network reliability in a multi-room setting.
• Recruitment of participants with diverse sensory abilities may be difficult.

• How many vibration patterns can a user reliably distinguish without training? (Hypothesis: 5-7 with a few days of use.)
• Do audio tones enhance or detract from the privacy of communication? (Maybe tones can be made inaudible to others using high-frequency or bone conduction.)
• What social norms emerge around message acknowledgment? Is a vibration enough to signal response?
• How does the system affect the feeling of 'being together' in the ambient environment?
• Can the protocol be extended to include presence detection (automatically sending a 'home' vibration when entering a room)?

This project remained in the planning stage because the team lost access to the university's prototyping lab after a funding shift, and the principal investigator moved to a different institution. The idea was shelved but the problem persists – and the recent rise of ambient AI assistants makes it more relevant than ever.

The project intentionally avoids the term 'assistive technology' to avoid ghettoization; instead, it frames non-visual communication as a universal need in a screenless future. The co-design process heavily involved members of the local blindness advocacy group to ensure the protocol felt natural and empowering, not limiting. The plan included budget for a 3D printer and multiple haptic actuators.