Dataconomy
  • News
  • AI
  • Big Data
  • Machine Learning
  • Trends
    • Blockchain
    • Cybersecurity
    • FinTech
    • Gaming
    • Internet of Things
    • Startups
    • Whitepapers
  • Industry
    • Energy & Environment
    • Finance
    • Healthcare
    • Industrial Goods & Services
    • Marketing & Sales
    • Retail & Consumer
    • Technology & IT
    • Transportation & Logistics
  • Events
  • About
    • About Us
    • Contact
    • Imprint
    • Legal & Privacy
    • Newsletter
    • Partner With Us
    • Writers wanted
Subscribe
No Result
View All Result
Dataconomy
  • News
  • AI
  • Big Data
  • Machine Learning
  • Trends
    • Blockchain
    • Cybersecurity
    • FinTech
    • Gaming
    • Internet of Things
    • Startups
    • Whitepapers
  • Industry
    • Energy & Environment
    • Finance
    • Healthcare
    • Industrial Goods & Services
    • Marketing & Sales
    • Retail & Consumer
    • Technology & IT
    • Transportation & Logistics
  • Events
  • About
    • About Us
    • Contact
    • Imprint
    • Legal & Privacy
    • Newsletter
    • Partner With Us
    • Writers wanted
Subscribe
No Result
View All Result
Dataconomy
No Result
View All Result

Silicon image sensors enable faster image processing

by Kerem Gülen
September 1, 2022
in News, Technology & IT
Home News
Share on FacebookShare on TwitterShare on LinkedInShare on WhatsAppShare on e-mail
  • The camera system in autonomous vehicles depends on image processing speed.
  • Complementary metal-oxide-semiconductor (CMOS) image sensors, also known as silicon imaging sensor chips, have recently benefited from researchers’ development of the first in-sensor processor.
  • Although commercial image sensor chips also use silicon photodiode arrays, the team’s photodiodes are electrostatically doped, allowing voltages to regulate the sensitivity of individual photodiodes, or pixels, to incoming light.
  • The silicon photodiode array can be constructed with different image filters to reduce unnecessary information or noise for various purposes.
  • The team’s next objective is to make photodiodes denser and incorporate them into silicon-integrated circuits.

As every driver is aware, accidents may occur instantaneously. Therefore, image processing speed is essential for the camera system in autonomous vehicles. The time it takes for the system to capture a picture and send the data to the CPU for image processing may determine whether a person avoids a barrier or has a serious accident.

Faster image processing is made possible thanks to silicon photodiodes

The visual processing can be sped up via in-sensor image processing, in which the image sensor itself retrieves significant characteristics from raw data rather than a separate computer. Until recently, in-sensor processing demonstrations have only been possible using newly developed research materials that are currently challenging to integrate into commercial systems.


MIT researchers have built a new LEGO-like AI chip


Recently, researchers at the Harvard John A. Paulson School of Engineering and Applied Sciences (SEAS) have created the first in-sensor processor that could be incorporated into commercial silicon imaging sensor chips, also referred to as complementary metal-oxide-semiconductor (CMOS) image sensors, which are used in nearly all commercial devices that need to capture visual data, including smartphones.

Silicon image sensors enable faster image processing
This technology can also be used in smartphones

Donhee Ham, the Gordon McKay Professor of Electrical Engineering and Applied Physics at SEAS and the paper’s senior author, stated, “Our work can harness the mainstream semiconductor electronics industry to rapidly bring in-sensor computing to a wide variety of real-world applications.”


Join the Partisia Blockchain Hackathon, design the future, gain new skills, and win!


Ham and his team developed an array of silicon photodiodes. A silicon photodiode array is also used in commercially available image sensor chips. Still, the team’s photodiodes are electrostatically doped, allowing individual photodiodes’ sensitivity, or pixels, to incoming light to be controlled by voltages.

Analog versions of the multiplication and addition processes essential to many image processing pipelines can be carried out by an array of voltage-tunable photodiodes, collecting the necessary visual information as soon as the image is collected.

Silicon image sensors enable faster image processing
For example, a high-pass filter may be required by an imaging system in an autonomous car to monitor lane markers

According to Houk Jang, a postdoctoral scholar at SEAS and the paper’s first author, these dynamic photodiodes “can concurrently filter images as they are captured, allowing for the first stage of vision processing to be moved from the microprocessor to the sensor itself.”

The silicon photodiode array can be designed with various image filters to sift out extraneous information or noise for various purposes. For example, an autonomous car’s imaging system may require a high-pass filter to monitor lane markers. At the same time, other applications may necessitate a filter that blurs to reduce noise.


Ultralow power AI chips are possible thanks to SNNs


According to Henry Hinton, a graduate student at SEAS and the paper’s co-first author, “the use of this silicon-based in-sensor processor not only in machine vision applications but also in bio-inspired applications, wherein early information processing allows for the co-location of sensor and compute units, like in the brain,” said Henry Hinton, a graduate student at SEAS and co-first author of the paper.

Silicon image sensors enable faster image processing
“By replacing the standard non-programmable pixels in commercial silicon image sensors with the programmable ones developed here, imaging devices can intelligently trim out unneeded data”

The team’s next goal is to make photodiodes denser and incorporate them into silicon-integrated circuits.

“By replacing the standard non-programmable pixels in commercial silicon image sensors with the programmable ones developed here, imaging devices can intelligently trim out unneeded data, thus making energy and bandwidth more efficient to address the demands of the next generation of sensory applications,” explained Jang.

For those who want to read further, the research is published in Nature Electronics.

Tags: chipimage processingprocessorSilicon image sensorssilicon photodiodes

Related Posts

How did ChatGPT passed an MBA exam

How did ChatGPT passed an MBA exam?

January 27, 2023
Google code red: ChatGPT and You.com like AI-powered tools threatening the search engine. Moreover, latest Apple Search rumors increased the danger.

Google code red: ChatGPT, You.com and rumors of Apple Search challenge the dominance of search giant

January 26, 2023
5 best office automation tools: Examples

The significance of office automation in today’s rapidly changing business world

January 24, 2023
T-Mobile data breach 2023 explained: Learn how did the leak happen and explore T-Mobile data breach history. It is not the first time of the company

T-Mobile data breach 2023: The telecom giant got hacked eight times in the last six years

January 20, 2023
What is smart robotics: Benefits and challenges

Unlocking the full potential of automation with smart robotics

January 19, 2023
Microsoft layoffs 2023: Amazon job cuts that affect 11,000 employees explained. Big tech layoffs continue... Learn why and what will happen next.

Microsoft layoffs will affect more than 11,000 employees

January 18, 2023

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

LATEST ARTICLES

How did ChatGPT passed an MBA exam?

AI prompt engineering is the key to limitless worlds

Transform your data into a competitive advantage with AaaS

Google code red: ChatGPT, You.com and rumors of Apple Search challenge the dominance of search giant

Tome AI offers a new way to create presentations easily

Transforming data into insightful information with BI reporting

Dataconomy

COPYRIGHT © DATACONOMY MEDIA GMBH, ALL RIGHTS RESERVED.

  • About
  • Imprint
  • Contact
  • Legal & Privacy
  • Partnership
  • Writers wanted

Follow Us

  • News
  • AI
  • Big Data
  • Machine Learning
  • Trends
    • Blockchain
    • Cybersecurity
    • FinTech
    • Gaming
    • Internet of Things
    • Startups
    • Whitepapers
  • Industry
    • Energy & Environment
    • Finance
    • Healthcare
    • Industrial Goods & Services
    • Marketing & Sales
    • Retail & Consumer
    • Technology & IT
    • Transportation & Logistics
  • Events
  • About
    • About Us
    • Contact
    • Imprint
    • Legal & Privacy
    • Newsletter
    • Partner With Us
    • Writers wanted
No Result
View All Result
Subscribe

This website uses cookies. By continuing to use this website you are giving consent to cookies being used. Visit our Privacy Policy.