Headphones designed to save your life from reckless drivers
Dr. Xiaofan (Fred) Jiang’s lab, at the Data Science Institute of Columbia University, has a scenic view of the Hudson River and easy access to busy streets where he can test his latest invention — smart headphones that warn pedestrians of road dangers.
Small circuit boards sit on a gray table covered with mathematical equations written in pencil. They're specifically engineered for different versions of the prototype — the latest of which is a modified pair of $10 overhead headphones Jiang ordered from Amazon. The idea, he said, is to build parts that can one day be integrated into mass-market headphones.
Jiang's lab re-engineers commercial headphone using custom circuit boards that help an app signal road dangers.Credit: zlata ivleva / mashableThe headphones were re-engineered with the custom circuit boards, as well as four extra microphones, meant to detect street sounds. That information is sent to the circuit board to extract useful information, and then it's transmitted to a custom smartphone app for AI analysis.
The app is trained to differentiate car sounds from background noise; calculate the distance and position cars relative to the headphone wearer; and alert them of surrounding dangers.
Jiang explains how the custom circuit board is wired to four microphones the lab planted on the headphones.Credit: zlata ivleva / mashableJiang offered to start our day with a lab demo. Once I was finally able to attach one of the microphones to my uncooperative mock-neck collar, Steven Xia, the lab’s PhD research assistant, handed me his phone and instructed me to hit “start” on the app.
“Let’s hope it works,” Jiang joked. “What is it called — Murphy’s Law?”
Xia positioned himself at a 45-degree angle to my right and played sounds of a moving car from a speaker he was holding. No alerts from the headphones.
“I’m supposed to hear notifications, right?” I asked Xia, who proceeded to adjust the volume on his phone. Xia repositioned himself and continued playing car sounds. The headphones beeped, and the phone buzzed. A moving red dot on the app accurately showed me the simulated car’s position relative to where I stood.
The red dot in the app signals a car's position relative to the headphone users.Credit: zlata ivleva / mashableXia explained that the red dot had moved because the app interprets distance based on the volume of the car. The louder the car gets, the closer the car is.
“Right now, it’s about how the loudness is changing, right? But it’s not actually changing,” Jiang added. “This is really just better at showing the direction. We should go to the streets and do something more realistic.”
As we headed toward a street nearby, Jiang told me how he tested the headphones at four different locations, both urban and suburban, to experiment its efficacy in different settings.
“It’s funny because I drive an electric hybrid car,” Jiang added, noting that quiet electric cars and hybrids can sometimes be challenging for the system to detect. But he also mentioned how legislation in the EU requires hybrid and electric cars to generate artificial noise, and how others are advocating for cars to emit digital signals which his system can be modified to detect.
Noticing a loud generator near our destination, Jiang recommended that we pick a location that would minimize any unforeseeable disruptions. Xia suggested a place just across the street and around the corner, where he had tested the headphones before.
“Are we comfortable with jaywalking? With our system, you can be more comfortable doing that,” Jiang said sarcastically. “No, no, no. There’s one thing we try to reassure: We’re not trying to desensitize pedestrians’ attention. We do notencourage jaywalking.”
Steven Xia, the lab's PhD research assistant, conducts a roadside test.Credit: Zlata Ivleva / MashableWe settled at a location where a generator rumbled in the background. This time, I suggested that Xia put on the headphones so that I could observe. The red dot hovered around the screen, where the generator was located. “I think this is from that noise back there,” Xia said.
“Also the airplane,” Xia added as an airplane approached us overhead. The red dot bounced along the movement of the plane. Jiang noted to himself that the lab would need to sample and record more airplane sounds and label them as “not car” so the AI can learn to differentiate cars from airplanes.
Jiang observes the headphone's performance for adjustments in the future.Credit: Zlata Ivleva / Mashable“This is why I say we’re still about a year away from when we can transfer it to the university’s [venture capital partner]. When the scenario is ideal, it’s what we expect. But there are a lot of these random things — it has false positives,” Jiang said, noting that these roadside tests often worked better in suburban environments. “But this is something we need to solve. Urban is where the problem is.”
Jiang told me he had experimented with other options that would detect vehicles better, such as cameras and LiDAR technologies used by self-driving cars. “But they’re power hungry; we want to be able to power this with a cell phone battery,” he said. “And we discussed privacy as another problem.”
But he also mentioned the idea of a smart city: If in the future, cities are equipped with sensors that track every moving object, then the headphones will be much better at warning everybody of potential dangers.
A few cars drove by again, and the app worked perfectly those times.
“Every time we come out we have to think about how to improve this. Sorry this didn’t work out as well as I thought it would,” Jiang said as we walked back toward campus. “But maybe next year we’re going to meet up again.”
TopicsArtificial Intelligence
(责任编辑:产品中心)
- Campbell highlights Washington Declaration amid security concerns over Putin
- 长江中游或为家鸡起源地
- Hillary Clinton has to like where she stands in Florida.
- Liverpool face Chelsea test as Manchester clubs enter fray
- How much will PCB's Champions Cup mentors be paid?
- CrowdStrike outage is still causing hundreds of flight cancellations daily
- Gov't at odds over suspending inter
- Liverpool face Chelsea test as Manchester clubs enter fray
- 守护“广州绿心”!广州海珠国家湿地公园党组书记梁锋为绿美广东代言
- Cheap heat
- Moon holds out hope for overcoming COVID
- 以数据要素乘数效应助力现代农业!“数据要素×”三年行动计划发布
- Samsung allegedly plans to unveil new Galaxy S smartphones at CES
-
Update your BIOS: Utilities from Top Motherboard Makers
PSA:Enthusiasts building their own PCs are accustomed to keeping up with latest drivers, especially ...[详细] -
Smart toys that talk to kids are often full of security flaws
Today, kids have the chance to interact with their stuffed animals, robots, or dolls in ways their p ...[详细] -
Netflix has the most, best movies out of all the streaming services
If you can only afford one streaming service, maybe this study will help you decide.Based on the Rot ...[详细] -
雅安日报/北纬网讯6月20日上午,受市人大常委会党组书记、主任李伊林委托,市人大常委会党组成员、副主任李荣主持召开市人大常委会党组“两学一做”学习教育第一次学习讨论会。会议指出,全市各级人大及其常委会 ...[详细]
-
50 Years Later: The Revolutionary 8008 Microprocessor
Guest author Ken Shirriff is a Silicon Valley-based computer enthusiast who enjoys reverse-engineeri ...[详细] -
Randi Zuckerberg's podcast satirizes Silicon Valley with fairytales
In Randi Zuckerberg's world of satirical fairytales, "happily ever after" is not a guarantee.On Frid ...[详细] -
科技赋能文旅新体验 青岛市北区文化圈交互地图首轮线下打卡活动启动
中国山东网-感知山东5月26日讯(记者 杨广科)想参与街道、社区文化活动苦于找不到活动位置?想了解非遗文化找不到工坊位置?想规划博物馆之旅不知道博物馆有哪些?“市北文化圈交互地图&rdqu ...[详细] -
雅安日报/北纬网讯14日,有市民打电话反映,市区雅州廊桥的桥头两端停满了车辆,不仅出入不便,也存在安全隐患。记者随即来到雅州廊桥了解情况。中午11点,在雅州廊桥靠近大北街的桥头,已经停了两排车。车辆将 ...[详细]
-
Europe now has a huge AI gap, for better or for worse
When it comes to tech, Europe has been on a slightly separate track from the U.S. for a while, but t ...[详细] -
中国山东网-感知山东9月23日讯 9月20日-29日,青岛国际小提琴比赛半决赛·决赛将陆续进行,期间将同步开展无极四重奏专场音乐会等系列丰富的艺术欣赏活动,让观众在欣赏比赛的同时,聆听到 ...[详细]
11 Telescopes Exploring The Magic of Space
The polar vortex will return, and bring the coldest temps of the year
- Carbon neutrality law violates basic rights: Constitutional Court
- Tamagotchis are making a comeback to your smartphone in 2018
- 灞变笢绉诲姩闈掑矝鍒嗗叕鍙稿畬鎴?023涓浗鏃犵嚎鐢靛ぇ浼氶€氫俊淇濋殰宸ヤ綔
- Russian delegation arrives in Pyongyang for trade, science talks: KCNA
- 厚植精神文明沃土 培树司法文明新风
- 'Anthem' gets off to a rocky start as EA's 'VIP' weekend falls apart
- Spurs in talks with Real Madrid to re