Apple is venturing into brain-computer interface (BCI) technology through a collaboration with Synchron, an innovative neurotechnology company. This partnership aims to enable users to control Apple devices—such as iPhones, iPads, and the Vision Pro headset—using only their thoughts, marking a significant advancement in accessibility and human-computer interaction.
Synchron’s Stentrode: A Minimally Invasive Brain Implant
Synchron has developed the Stentrode, a stent-like device implanted via the jugular vein to reside near the brain’s motor cortex. Unlike traditional brain implants that require open-brain surgery, the Stentrode’s endovascular approach reduces surgical risks and enhances scalability. Once implanted, it captures neural signals and translates them into digital commands, allowing users to interact with devices without physical movement or voice commands.
Integration with Apple Devices
Apple has introduced a new Brain-Computer Interface Human Interface Device (BCI HID) protocol, officially recognizing brain signals as a native input method alongside touch, voice, and typing. This protocol integrates seamlessly with Apple’s existing accessibility features, such as Switch Control, enabling users to navigate and control their devices through thought alone.
In clinical trials, individuals with conditions like ALS have successfully used the Stentrode to operate Apple devices. For instance, a participant named Mark utilized the implant to control an Apple Vision Pro headset, engaging in activities like playing games and sending messages, thereby regaining a sense of autonomy and connection.
Advancements in Cognitive AI with NVIDIA
Synchron is also collaborating with NVIDIA to enhance the capabilities of its BCI technology. By leveraging NVIDIA’s Holoscan and Omniverse platforms, Synchron has developed Chiral, a cognitive AI model trained on neural data. This integration aims to improve the accuracy and responsiveness of brain-signal decoding, facilitating more intuitive interactions between users and their devices.
Potential Reconciliation Between Apple and NVIDIA?
Historically, Apple and NVIDIA have had a tumultuous relationship, marked by disputes over driver support and hardware integration. However, their mutual collaboration with Synchron may pave the way for renewed cooperation. By jointly advancing BCI technology (through their individual relationships with Synchron), Apple and NVIDIA might have a new opportunity to reconcile past differences and work together on groundbreaking innovations that blend hardware, software, and human cognition.
Implications for Accessibility and Beyond
The partnership between Apple and Synchron signifies a transformative step in making technology more accessible to individuals with severe motor impairments. By enabling thought-controlled interaction with devices, this innovation offers new avenues for communication, creativity, and independence.
Looking ahead, Apple plans to release a developer standard later this year to support broader adoption of BCI-compatible applications. As the technology matures, it holds the potential to redefine user interfaces and expand the possibilities of human-device interaction beyond accessibility, potentially benefiting a wider audience.
Sources
- Apple to Support Brain-Implant Control of Its Devices
- Synchron’s brain implant lets users navigate iPhones and iPads using only their minds
- Synchron To Achieve First Native Brain-Computer Interface Integration with iPhone, iPad and Apple Vision Pro
- The Synchron story: Aussie brain tech finds love and money in the US
- Synchron’s Brain-Computer Interface Now Has Nvidia’s AI
