Dataconomy
  • News
  • AI
  • Big Data
  • Machine Learning
  • Trends
    • Blockchain
    • Cybersecurity
    • FinTech
    • Gaming
    • Internet of Things
    • Startups
    • Whitepapers
  • Industry
    • Energy & Environment
    • Finance
    • Healthcare
    • Industrial Goods & Services
    • Marketing & Sales
    • Retail & Consumer
    • Technology & IT
    • Transportation & Logistics
  • Events
  • About
    • About Us
    • Contact
    • Imprint
    • Legal & Privacy
    • Newsletter
    • Partner With Us
    • Writers wanted
Subscribe
No Result
View All Result
Dataconomy
  • News
  • AI
  • Big Data
  • Machine Learning
  • Trends
    • Blockchain
    • Cybersecurity
    • FinTech
    • Gaming
    • Internet of Things
    • Startups
    • Whitepapers
  • Industry
    • Energy & Environment
    • Finance
    • Healthcare
    • Industrial Goods & Services
    • Marketing & Sales
    • Retail & Consumer
    • Technology & IT
    • Transportation & Logistics
  • Events
  • About
    • About Us
    • Contact
    • Imprint
    • Legal & Privacy
    • Newsletter
    • Partner With Us
    • Writers wanted
Subscribe
No Result
View All Result
Dataconomy
No Result
View All Result

The Visual Microphone: Recovering Sound from Vibration in Objects

by Eileen McNulty
August 5, 2014
in Machine Learning, News
Home Topics Data Science Machine Learning
Share on FacebookShare on TwitterShare on LinkedInShare on WhatsAppShare on e-mail


Researchers from MIT, Microsoft Research, and Adobe Research have been collaborating on an intriguing project. They are experimenting with recovering sound from high-speed video of the minute vibrations from objects. The project is known as The Visual Microphone, and according the project website, this is how it works:

When sound hits an object, it causes small vibrations of the object’s surface. We show how, using only high-speed video of the object, we can extract those minute vibrations and partially recover the sound that produced them, allowing us to turn everyday objects—a glass of water, a potted plant, a box of tissues, or a bag of chips—into visual microphones. We recover sounds from highspeed footage of a variety of objects with different properties, and use both real and simulated data to examine some of the factors that affect our ability to visually recover sound. We evaluate the quality of recovered sounds using intelligibility and SNR metrics and provide input and recovered audio samples for direct comparison. We also explore how to leverage the rolling shutter in regular consumer cameras to recover audio from standard frame-rate videos, and use the spatial resolution of our method to visualize how sound-related vibrations vary over an object’s surface, which we can use to recover the vibration modes of an object.

 

You can see the (surprisingly accurate) results in the video above for yourself- the experiment using a normal DSLR is particularly extraordinary.

You can find more example experiments here, or read the research paper for yourself here.

(Video and featured image credit: The Visual Microphone)

Follow @DataconomyMedia

Interested in more content like this? Sign up to our newsletter, and you wont miss a thing!

[mc4wp_form]

Related Posts

Amazon employees walk out against to board to make a change

Amazon employees walk out against to board to make a change

June 1, 2023
RarBG shutdown: Check out the best alternatives to try now

RarBG shutdown: Check out the best alternatives to try now

June 1, 2023
FTC rang Amazon’s bell this time, and it wasn’t as kind as Alexa

FTC rang Amazon’s bell this time, and it wasn’t as kind as Alexa

June 1, 2023
Zoom Settlement: Is Epiqpay legit?

Zoom Settlement: Is Epiqpay legit?

June 1, 2023
QR codes in AI and ML: Enhancing predictive analytics for business

QR codes in AI and ML: Enhancing predictive analytics for business

May 29, 2023
Elevating ML to new heights with distributed learning

Elevating ML to new heights with distributed learning

May 22, 2023

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

LATEST ARTICLES

Sneak peek at Microsoft Fabric price and its promising features

Amazon employees walk out against to board to make a change

RarBG shutdown: Check out the best alternatives to try now

FTC rang Amazon’s bell this time, and it wasn’t as kind as Alexa

Skybox AI brings AI to VR

Achieving seamless compliance with automation

Dataconomy

COPYRIGHT © DATACONOMY MEDIA GMBH, ALL RIGHTS RESERVED.

  • About
  • Imprint
  • Contact
  • Legal & Privacy
  • Partnership
  • Writers wanted

Follow Us

  • News
  • AI
  • Big Data
  • Machine Learning
  • Trends
    • Blockchain
    • Cybersecurity
    • FinTech
    • Gaming
    • Internet of Things
    • Startups
    • Whitepapers
  • Industry
    • Energy & Environment
    • Finance
    • Healthcare
    • Industrial Goods & Services
    • Marketing & Sales
    • Retail & Consumer
    • Technology & IT
    • Transportation & Logistics
  • Events
  • About
    • About Us
    • Contact
    • Imprint
    • Legal & Privacy
    • Newsletter
    • Partner With Us
    • Writers wanted
No Result
View All Result
Subscribe

This website uses cookies. By continuing to use this website you are giving consent to cookies being used. Visit our Privacy Policy.