| Jun 13, 2024 |
|
|
|
(Nanowerk Information) Researchers have demonstrated a brand new clever photonic sensing-computing chip that may course of, transmit and reconstruct photos of a scene inside nanoseconds. This advance opens the door to extraordinarily high-speed picture processing that would profit edge intelligence for machine imaginative and prescient purposes resembling autonomous driving, industrial inspection and robotic imaginative and prescient.
|
|
Edge computing, which performs intensive computing duties like picture processing and evaluation on native units, is evolving into edge intelligence by including synthetic intelligence (AI) pushed evaluation and decision-making.
|
|
“Capturing, processing and analyzing images for edge-based tasks such as autonomous driving is currently limited to millisecond-level speeds due to the necessity of optical-to-electronic conversions,” stated analysis crew chief Lu Fang from Tsinghua College in China. “Our new chip can perform all these processes in just nanoseconds by keeping them all in the optical domain. This could be used to significantly enhance, or even replace, the traditional architecture of sensor acquisition followed by AI post-processing.”
|
|
In Optica (“Parallel photonic chip for nano-second end-to-end image processing, transmission, and reconstruction”), Optica Publishing Group’s journal for high-impact analysis, the researchers describe the brand new chip, which they name an optical parallel computational array (OPCA) chip. They present that the OPCA has a processing bandwidth of as much as 100 billion pixels and a response time of simply 6 nanoseconds, which is about six orders of magnitude quicker than present strategies. In addition they used the chip to create an optical neural community that integrates picture notion, computation and reconstruction.
|
|
“The chip and optical neural network could boost the efficiency of processing complex scenes in industrial inspection and help advance intelligent robot technology to a higher level of cognitive intelligence,” stated Wei Wu, co-first writer of the paper. “We think it could also revolutionize edge intelligence.”
|
 |
| Researchers have developed a brand new clever photonic sensing-computing chip that may course of, transmit and reconstruct photos of a scene inside nanoseconds. (Picture: Wei Wu, Tsinghua College)
|
Eliminating optical to electrical conversions
Machine imaginative and prescient — which makes use of cameras, picture sensors, lighting and laptop algorithms to seize, course of and analyze photos for particular duties — historically includes changing optical data into digital electrical indicators utilizing sensors. These indicators are then transmitted over optical fibers for long-distance knowledge transmission and downstream duties. Nevertheless, the frequent conversion between optical and electrical indicators together with restricted developments in digital processors has develop into a serious restriction on bettering the velocity and processing capability of machine imaginative and prescient.
|
|
“The world is entering an AI era, but AI is very time- and energy-exhaustive,” stated Fang. “Meanwhile, the growth of edge devices, such as smartphones, intelligent cars and laptops has resulted in explosive growth of image data to be processed, transmitted and displayed. We are working to advance machine vision by integrating sensing and computing in the optical domain, which is particularly important for edge computing and for enabling more sustainable AI applications.”
|
|
The problem in performing each picture acquisition and evaluation on the identical chip within the optical area is discovering a approach to convert the free-space spatial gentle used for imaging into an on-chip guided gentle wave. The researchers achieved this by designing a chip that consists of a sensing-computing array of devoted designed ring resonators that convert a free-space optical depth picture — a 2D illustration of a scene’s gentle depth — right into a coherent gentle sign that may then be guided on the chip. A micro-lens array enhances the method by focusing the scene onto the OPCA chip.
|
|
|
|
The chip’s structure allowed the researchers to create an end-to-end multi-wavelength optical neural community to couple the on-chip modulated gentle right into a large-bandwidth optical waveguide, the place the modulated gentle is added collectively spectrally. The multispectral optical outputs can then be used for classification duties or to create an all-optical reconstruction of the picture.
|
|
“Because each sensing-computing element of this chip is reconfigurable, they can each operate as a programmable neuron that generates light modulation output based on the input and weight,” stated Fang. “The neural network connects all the sensing-computing neurons with a single waveguide, facilitating an all-optical full connection between the input information and the output.”
|
|
To show the capabilities of the OPCA chip, the researchers confirmed that it might be used to categorise a handwritten picture and to carry out picture convolution, a course of that applies a filter to a picture to extract options. The findings confirmed that the chip structure can successfully full data compression and scene reconstruction, indicating its potential for widespread purposes.
|
|
The researchers at the moment are working to enhance the sensing-computing OPCA chip to additional improve computational efficiency whereas additionally being aligned extra intently with real-world situations and optimized for edge computing purposes. The researchers say that for sensible use, the optical neural community’s processing capability would have to be elevated to successfully deal with more and more complicated and lifelike clever duties. The shape issue of the OPCA chip and total kind issue additionally have to be minimized.
|
|
“We hope that machine vision will be gradually improved to be faster and more energy-efficient by using light to perform both sensing and computing,” stated Fang. “Even though today’s approach will not likely be completely replaced, we expect the sensing-computing method to find its niche in edge computing where it can drive a wide range of promising applications.”
|
