via University of Michigan
Microphones are perhaps the most common electronic sensor in the world, with an estimated 320 million listening for our commands in the world’s smart speakers. The trouble is that they’re capable of hearing everything else, too.
But now, a team of University of Michigan researchers has developed a system that can inform a smart home—or listen for the signal that would turn on a smart speaker—without eavesdropping on audible sound.
The key to the device, called PrivacyMic, is ultrasonic sound at frequencies above the range of human hearing. Running dishwashers, computer monitors, even finger snaps, all generate ultrasonic sounds, which have a frequency of 20 kilohertz or higher. We can’t hear them—but dogs, cats and PrivacyMic can.
The system pieces together the ultrasonic information that’s all around us to identify when its services are needed, and sense what’s going on around it. Researchers have demonstrated that it can identify household and office activities with greater than 95% accuracy.
“There are a lot of situations where we want our home automation system or our smart speaker to understand what’s going on in our home, but we don’t necessarily want it listening to our conversations,” said Alanson Sample, U-M associate professor of electrical engineering and computer science. “And what we’ve found is that you can have a system that understands what’s going on and a hard guarantee that it will never record any audible information.”
Ubiquitous computing + privacy
PrivacyMic can filter out audible information right on the device. That makes it more secure than encryption or other security measures that take steps to secure audio data after it’s recorded or limit who has access to it. Those measures could all leave sensitive information vulnerable to hackers, but with PrivacyMic, the information simply doesn’t exist.
While smart speakers are an obvious application, the research team envisions many others that, while less common, may be more important. In-home ultrasonic devices, for example, could monitor the homes of the elderly for signs that they need help, monitor lung function in respiratory patients or listen to clinical trial participants for sonic signatures that could reveal medication side effects or other problems.
“A conventional microphone placed in somebody’s home for months at a time could give doctors richer information than they’ve ever had before, but patients just aren’t willing to do that with today’s technology,” Sample said. “But an ultrasonic device could give doctors and medical schools unprecedented insight into what their patients’ lives are really like in a way that the patients are much more likely to accept.”
The idea behind PrivacyMic began when the team was classifying previously recorded audio. Looking at a visual graph of the data, they realized that audible sound was only a small piece of what was available.
“We realized that we were sitting on a lot of interesting information that was being ignored. We could actually get a picture of what was going on in a home or office without using any audio at all,” said Yasha Iravantchi, a graduate student in electrical engineering and computer science and first author on a new paper on the research.
Listening for ultrasonic sound
Armed with this insight, a laptop and an ultrasonic microphone, the team then went to work capturing audio from tooth brushing, toilet flushing, vacuuming, running dishwashers, using computer monitors and hundreds of other common activities. They then compressed the ultrasonic signatures into smaller files that included key bits of information while stripping out noise within the range of human hearing—a bit like an ultrasonic MP3—and built a Raspberry Pi-based device to listen for them.
The device, which can be set to filter out speech or to strip out all audible content, accurately identified common activities more than 95% of the time. The team also conducted a trial where study participants listened to the audio collected by the device and found that not a single participant could make out human speech.
While the device is a proof of concept at this stage, Sample says that implementing similar technology in a device like a smart speaker would require only minor modifications—software that listens for ultrasonic sound and a microphone capable of picking it up, which are inexpensive and readily available. While such a device is likely several years off, the team has applied for patent protection through the U-M Office of Technology Transfer.
“Smart technology today is an all-or-nothing proposition. You can either have nothing or you can have a device that’s capable of constant audio recording,” Sample said. “PrivacyMic offers another layer of privacy—you can interact with your device using audio if you choose or you can have another setting where the device can glean information without picking up audio.”
Original Article: ‘PrivacyMic’: For a smart speaker that doesn’t eavesdrop
The Latest Updates from Bing News & Google News
Go deeper with Bing News on:
- Worried your smart home device is listening to you? University of Michigan researcher has a solutionon June 17, 2021 at 9:28 am
Some people may worry their smart home devices are randomly listening to their private conversations, but what if there was a way to prevent that from happening? A team of University of Michigan ...
- University of Michigan researchers develop microphone for smart speakers that doesn’t eavesdropon June 11, 2021 at 12:55 pm
An estimate 320 million smart speakers are in homes and offices around the world with the capability of hearing everything we say. But a team at the University of Michigan is hoping to change that.
- The human ear detects a half-millisecond delay in soundon June 10, 2021 at 8:18 am
Hearing is one of the most sensitive of our senses, and even small issues in sound quality can interfere with listening experiences. Acoustics researchers at Aalto University, in collaboration ...
- Watch: Device can operate smart homes without listening to user conversationson June 9, 2021 at 11:42 am
University of Michigan researchers have created a system that can inform a smart home without eavesdropping on audible sound, called PrivacyMic. The team was inspired to create the new device while ...
- PrivacyMic can capture information inside the home without recording conversationson June 9, 2021 at 5:51 am
Engineers at the University of Michigan have created a new device called PrivacyMic that could usher in an era of smart speakers that can capture information inside ...
Go deeper with Google Headlines on:
Go deeper with Bing News on:
- Global Automotive Ultrasonic Radar Market 2021 Research by Top Manufacturers, Segmentation, Business Review and Regional Analysis by 2026on June 19, 2021 at 4:37 am
Global Automotive Ultrasonic Radar Market Growth 2021-2026 recently launched by MRInsightsbiz analyzes the value and volume of the m ...
- Ultrasonic probe promises stiffness-based disease diagnosticson June 18, 2021 at 2:00 am
A novel phonon probe can simultaneously measure 3D spatial and mechanical information from microscopic objects in hard-to-reach parts of the body ...
- Ultrasonic Spray Nozzles Market 2021 Definitions, Classifications, Applications, Industry Analysis and Forecast by 2031on June 16, 2021 at 3:53 am
The latest research report provides a complete assessment of the Global Ultrasonic Spray Nozzles market for the forecast year 2022-2031, which is beneficial for companies regardless of their size and ...
- Ultrasonic Scaler Market Size Segments and Growth 2021: Research Strategies with Share Analysis, Top Key Players with Opportunities Forecast to 2027on June 16, 2021 at 1:45 am
Jun 16, 2021 (The Expresswire) -- "Final Report will add the analysis of the impact of COVID-19 on this industry." Our Latest Report on “Ultrasonic ...
- Ultrasonic Sensor Market Research Report by Type, by End Use, by Application, by Region - Global Forecast to 2026 - Cumulative Impact of COVID-19on June 15, 2021 at 11:20 pm
Ultrasonic Sensor Market Research Report by Type (Ultrasonic 2 Point Proximity Switches, Ultrasonic Proximity Sensors, and Ultrasonic Retro Reflective Sensor), by End Use (Agricul ...