Skip to content

Inclusive Design

The making of Microsoft Adaptive Accessories

How we’re designing assisted devices to give everyone access to the future.

By
Tracy Jones

  –   The estimated reading time is 9 min.

A pile of brightly colored plastic rock climbing holds, mainly in purple, orange, and white, scattered on a gray surface. The holds vary in shape and size, designed for different types of climbing grips.

In 1980, when Bill Gates set out to put a computer on every desktop and in every home, the Americans with Disabilities Act wouldn’t be passed for another 10 years. Making computers and software for people with disabilities was a marginalized practice. As the digital world rapidly developed, the disabled community had limited access to what would ultimately change our reality.

Their hyper imaginative contributions to innovation have still yet to be given a proper chance, but soon, like buildings without wheelchair access, that will be history. Last month we released Microsoft Adaptive Accessories, made up of the Adaptive Mouse, Adaptive Button, and the Adaptive Hub. They are like adding customizable ramps and handrails to stores and public spaces. The devices assist people of all unique abilities in ways that other people take for granted, things like moving the cursor across the screen, double clicking on an icon, or copying and pasting text.

A variety of black ergonomic computer input devices including a contoured mouse, a rectangular control pad with various buttons and ports, and four modular input switches with different shapes: a disc, a joystick, a square pad, and a d-pad.
The Adaptive Accessories ecosystem

The power of a parent’s love

The revolutionary development of Microsoft Adaptive Accessories wouldn’t take 1,000 people marching to the White House, demanding that the Americans with Disabilities Act be passed. The Adaptive Mouse was conceived by a father’s love for his child and a team of designers that were passionate about assistive devices. “I called Microsoft Adaptive Accessories the spiritual successor to the Xbox Adaptive Controller,” said Johnson.

In the Netherlands, Microsoft Senior Designer John Helmes’ seven-year-old daughter Jara is among the one billion people around the globe living with disabilities. She has cerebral palsy. The condition is a series of disorders that affect her ability to move, balance, posture, and talk. When Jara was born, doctors thought that she may not make it, but Jara’s will to live wasn’t trying to hear that. Through therapy, and with the aid of talented doctors, Jara was becoming just another girl adding magic to the world. The only problem was that she needed help operating her computer.

Using a tablet was child’s play. Through plastic holes fixed onto the screen, she could accurately touch where she intended. Using a trackball to interact with her computer was ok, but not great, barely going beyond the default. “I saw the trackball wasn’t very efficient. I thought there must be a better way,” Helmes said. From his experience, other assisted devices were difficult to find and expensive, too, defeating the purpose of accessibility. They were as subpar as Jara’s ankle braces — cold, metallic, heavy, uncomfortable, pricey.

Two colorful prosthetic leg components are displayed. The front view shows a purple knee joint with a Velcro strap and a pink lower leg and foot. The rear view highlights a smiley face design, fun details, customizable color schemes, and a lightweight, 3D-printed build.
Jara’s 3D-printed ankle braces

From 3D-printed orthotics to mouse extensions

Inspired by the innovation that 3D-printed orthotics was unlocking, Helmes had Jara’s lower legs scanned. Using a digital model of her legs, he used a 3D-printer to make Jara’s new customized ankle braces out of a nylon material that was light, soft, and a lot less difficult to integrate. They were low cost, more customizable, and easily repairable. Complete with smiley faces, the orthotics were hot pink and purple with inner openings that alleviated painful pressure points along the soles of her feet. She successfully wore the braces for a year and a half. “I thought, ‘hey, if you can make an orthotic for your leg, why can’t you make an orthotic for your mouse?’” Helmes said.

Top image: An adult and a child's hands interact with a small black device with a white lid.
Bottom left image: An adult hand holds the black device with the white lid open, revealing an interior compartment.
Bottom right image: The device's white side with attached black straps.
Out of an old arc mouse, Helmes made the original Adaptive Mouse with 3D-printed extensions.

He started sketching augmented mouse iterations. He had an intimate understanding of his daughter’s needs: Jara’s condition disrupted her motor skills and caused light spasms, forcing her fingers to slide off the surface of the mouse. Her hand needed something that could keep her fingers in place while navigating the cursor. Helmes, having little private resources or a budget, said, “You get a lot of ideas when you’re limited.” He looked at different kinds of pre-existing mice to figure out the most ideal shape to augment.

An old arc mouse had “a really nice small compact core,” he said. He took the tail off, short-wired the mouse’s switch, and added a 3D-printed adapter in the back of the core, behind its replaceable battery. The adapter enabled him to slip in a customized 3D-printed extension. It was his first original Adaptive Mouse prototype. The extension was intended to keep Jara’s fingers in place as she maneuvered the device. Helmes had his daughter test the prototype. It would be the first time that he saw Jara independently use her PC. She was five. To help take their Adaptive Mouse further, Helmes submitted his project to Microsoft’s Hackathon. Soon, the two-person team of Helmes and Jara would virtually multiply overnight.

Various modular pink and white computer mouse parts are arranged on a white background. The components include different body types, scroll wheels, and extensions designed to offer customization options for the mouse.
The first official Adaptive Mouse prototype.

A true cross-company collaboration

Each year, this week-long event brings together thousands of Microsoft hackers, tinkerers, and thinkers from around the world to participate in creating our newest and greatest inventions, like the Xbox Adaptive Controller. Through the event, Helmes, who works on Azure, met Paul Kos, Director of Electrical Engineering for Devices on the MACH (Microsoft Asia Center for Hardware) team in Shenzhen, China. His team builds most of Microsoft’s keyboards, mice, and other accessories. From the beginning, they were Helmes’ biggest supporters and closest collaborators. Johnson, Accessibility Program Manager Solomon Romney, the wider Xbox Adaptive Controller team, and many from the Windows and Devices team would also join Helmes’ project.

A collection of various plastic components organized neatly on a flat surface. The items are sorted into rows and columns by shape, size, and color. The components include parts in black, white, gray, orange, yellow, purple, and blue, resembling pieces for electronic devices.
Just a few of the many mouse extensions that were produced and tested.

Together, they set core design elements. The Adaptive Mouse had to be affordable, scalable, easy to use, adaptable, and the Adaptive Mouse had to look and feel like it belonged adjacent to a Microsoft Surface tablet or any of our other hardware. Jara, who is seven now, used the original augmented mouse prototype as her go-to for operating her PC. She used it so much that it eventually had to be taped together. The team understood that the Adaptive mouse had to be as small and as thin as possible, taking up the least amount of surface area on a desktop.

With Microsoft Director of Ergonomics Edie Adams helping to test and refine the comfortability of the team’s many designs, their mouse extension explorations were like the stars. Legos, forks, foam, cardboard, corkscrews, clay, and 3D-printed shapes turned into trial extensions. People will eventually be able to create and use their own personal 3D-printed extensions. Nobody tells you how to mouse was the Hackathon team’s battle cry. They produced an official mouse core prototype with a scroll wheel, left-right clicks, and an adapter extension in the back similar to Jara’s homemade Adaptive Mouse.

The image shows an assortment of variously shaped gray plastic casings placed on a flat surface. The casings come in different sizes and designs, including rectangular, rectangular with curved tops, and small square forms. They appear to be electronic device enclosures.
.
Just a few of the many mouse extensions that were produced and tested.
A close-up of multicolored climbing holds laid out on a grey surface. The holds are arranged in rows and include a variety of shapes and sizes, featuring colors such as purple, white, blue, and orange. The background is blurred, focusing on the foreground items.

Co-designing to create universal access

Kos knew that solely focusing on the Adaptive Mouse was like selecting who would have access to the future. “If you go too far down a path, you don’t recognize who you’re excluding. You have to always remember to judge your decisions based on who you’re excluding,” Bryce said. He brought in people from the disabled community to talk to the team about broadening the project. “Co-creating with these communities because of their lived experience makes them the prime experts on how to design for innovation,” said Inclusive Design Director Christina Mallon. Since both of her arms are paralyzed, she uses the Adaptive Mouse with a foot extension.

The team ultimately decided to create an ecosystem, designing a switchbox hub, a multi-sensory button in addition to the Adaptive Mouse. “Some people may struggle even with that Adaptive Mouse, or some people can move the mouse but they won’t be able to press the buttons,” Kos said. After the Hackathon, developing the Adaptive Mouse was no longer play-play. The game had changed. Now, their project was becoming a reality.

“We really wanted to make sure that we’re designing a system for the unexpected, or designing for solutions that we haven’t thought of,” said Design Director Simon Dearsley. His department was tasked with refining the Adaptive Mouse and getting the project onto the accessories roadmap. The Adaptive Hub and the Adaptive Button’s features and functionalities were mostly realized, though figuring out Adaptive Mouse solutions was like spiraling through a worm hole.

A collage of various adaptive gaming devices being used, including specialized controllers, switches, and buttons. Hands are shown operating different equipment in diverse setups, indicating a focus on accessible gaming for individuals with different physical needs.
The two-crew design team of Helmes and his daughter Jara extensively testing with Adaptive Accessories.

Where’s the juice?

Debate over maintaining the Adaptive Mouse’s replaceable battery or implementing a rechargeable one led the team to consider developing their own battery, but it would need certification, taking up a lot of time and resources. They integrated an inner rechargeable battery with a USB-C port so the Adaptive Mouse, Adaptive Hub, and Adaptive Button could share the same battery. The design saved a lot of money, but how were people going to recharge the mouse while using it?

Putting the USB-C charging port at the core’s tip was a start, but what if the Adaptive Mouse tilts towards the desk? What if a person’s extension slants the Adaptive Mouse at an angle, preventing it from laying flat on the desk? And was the original adapter extension still an attractive solution? Without an extension attached to the adapter, there was a large empty slot cut into the back of the Adaptive Mouse, making it looked unfinished.

A collection of various computer mouse parts and gaming accessories in black, blue, and white arranged neatly on a light grey surface. To the right, there is a grey laptop, and the hands of two individuals are interacting with the items.
The two-crew design team of Helmes and his daughter Jara extensively testing with Adaptive Accessories.

Everyone is a world builder

The image of paralyzed protesters climbing the steps of the United States Capital would forever put dips in curves and crosswalk sounds on street corners. Those protesters showed how they were disabled by a world designed against them, but like Jara, they would not settle. As a Microsoft designer, Helmes used his expertise to help his daughter, which catalyzed a company-wide effort to help many. As the digital world continues to be built, Microsoft Adaptive Accessories will empower everyone on the planet to take part in constructing a technological universe that will be designed by you and for you.

To learn more about how Adaptive Accessories is unlocking the potential of people with disabilities, please visit John and Jara’s Youtube channel.

Read more

To stay in the know with Microsoft Design, follow us on Twitter and Instagram, or join our Windows or Office Insider program. And if you are interested in working with us at Microsoft, head over to aka.ms/DesignCareers.