Fujitsu, MIT's CBMM Develop AI Technology to Recognize Unseen Data with High Accuracy
December 9, 2021 | ACN NewswireEstimated reading time: 3 minutes
Fujitsu Limited and the Center for Brains, Minds and Machines (CBMM) headquartered at the Massachusetts Institute of Technology (MIT) have achieved an important milestone in a joint initiative to deliver improvements in the accuracy of artificial intelligence (AI) models. The results of the research collaboration between Fujitsu and CBMM are published in a paper discussing computational principles that draw inspiration from neuroscience to enable AI models to recognize unseen (out-of-distribution, OOD) data (1) that deviates from the original training data. Highlights of the paper will be presented at the NeurIPS 2021 (Conference on Neural Information Processing Systems) (2), showing improvements in the accuracy of AI models.
The advent of deep neural networks (DNNs) in recent years has contributed to an increasing variety of real-world applications for AI and machine learning technologies, including for tasks like defect detection for the manufacturing industry and diagnostic imaging in the medical field. While these AI models can at times demonstrate performance equal to or better than that of humans, challenges remain as recognition accuracy tends to deteriorate when environmental conditions like lighting and perspective significantly differ from those in datasets used during the training process.
To resolve this, researchers at Fujitsu and CBMM have made collaborative progress in understanding AI principles enabling recognition of OOD data with high accuracy by dividing the DNN into modules - for example shape and color, amongst other attributes - taking a unique approach inspired by the cognitive characteristics of humans and the structure of the brain. An AI model using this process was rated as the most accurate in an evaluation measuring image recognition accuracy against the "CLEVR-CoGenT" benchmark (3), as shown in the paper presented by the group at NeurIPS.
Dr. Seishi Okamoto, Fellow at Fujitsu Limited commented, "Since 2019, Fujitsu has engaged in joint research with MIT?s CBMM to deepen our understanding of how the human brain synthesizes information to generate intelligent behavior, pursuing how to realize such intelligence as AI and leveraging this knowledge that contributes to solving problems facing a variety of industries and society at large. This achievement marks a major milestone for the future development of AI technology that could deliver a new tool for training models that can respond flexibly to different situations and recognize even unknown data that differs considerably from the original training data with high accuracy, and we look forward to the exciting real-world possibilities this opens up."
Dr. Tomaso Poggio, the Eugene McDermott Professor at the Department of Brain and Cognitive Sciences at MIT and Director of the Center for Brains, Minds and Machines, remarked, "There is a significant gap between DNNs and humans when evaluated in out-of-distribution conditions, which severely compromises AI applications, especially in terms of their safety and fairness. Research inspired by neuroscience may lead to novel technologies capable of overcoming dataset bias. The results obtained so far in this research program are a good step in this direction."
Future possible applications may include AI for monitoring traffic that can respond to changes in various observation conditions and a diagnostic medical imaging AI that can correctly recognize different types of lesions.
About the New Method
Research findings focus on the fact that the human brain can precisely capture and classify visual information, even if there are differences in shapes and colors of the objects we perceive. The new method calculates a unique index based on the way an object is perceived by neurons and how the DNN classifies the input images. The model encourages the increase of the index in order to improve recognizing OOD example objects more effectively.
Up to now it was assumed that the best method to create an AI model with high recognition accuracy was to train the DNN as a single module without splitting it up. However, by splitting the DNN into separate modules depending on shapes, colors, and other attributes of the objects based on the newly developed index, researchers at Fujitsu and CBMM have successfully achieved higher recognition accuracy.
Future Plans
Fujitsu and CBMM hope to further refine the findings to develop an AI able to make human-like flexible judgments with the aim to apply it in various areas like manufacturing and medical care.
(1) OOD data:
Data substantially different from the data seen during the AI training.
(2 Presented at NeurIPS:
"How Modular Should Neural Module Networks Be for Systematic Generalization?"; Planned presentation date and time: December 8, 4:30 PM PST/ December 9, 2021 9:30 AM JST
Presenters: Vanessa D'Amario (Massachusetts Institute of Technology), Tomotake Sasaki (Fujitsu) and Xavier Boix (Massachusetts Institute of Technology)
(3) CLEVR-CoGenT dataset:
A benchmark developed by Stanford University to measure an AI's ability to recognize new combinations of objects and attributes.
Suggested Items
Koh Young Showcases Award-winning Inspection Solutions at SMTconnect with SmartRep in Hall 4A.225
04/25/2024 | Koh Young TechnologyKoh Young Technology, the industry leader in True 3D measurement-based inspection solutions, will showcase an array of award-winning inspection and measurement solutions at SMTconnect alongside its sales partner, SmartRep, in booth 4A.225 at NürnbergMesse from June 11-13, 2023. The following offers a glimpse into what Koh Young will present at the tradeshow:
Book Excerpt: The Printed Circuit Assembler’s Guide to... Factory Analytics
04/24/2024 | I-Connect007 Editorial TeamIn our fast-changing, deeply competitive, and margin-tight industry, factory analytics can be the key to unlocking untapped improvements to guarantee a thriving business. On top of that, electronics manufacturers are facing a tremendous burden to do more with less. If you don't already have a copy of this book, what follows is an excerpt from the introduction chapter of 'The Printed Circuit Assembler’s Guide to... Factory Analytics: Unlocking Efficiency Through Data Insights' to whet your appetite.
Real Time with... IPC APEX EXPO 2024: Industrial Quality Solutions from Zeiss
04/23/2024 | Real Time with...IPC APEX EXPOEditor Nolan Johnson and Herminso Gomez of Zeiss Group discuss the company's industrial quality solutions, with a focus on X-ray technology. Zeiss provides a range of microscopy options and Herminso highlights the advantages of X-ray technology for aerospace, medical, and consumer electronics sectors.
Altair Acquires Cambridge Semantics, Powering Next-Generation Enterprise Data Fabrics and Generative AI
04/22/2024 | AltairAltair a global leader in computational intelligence, acquired Cambridge Semantics, a modern data fabric provider and creator of one of the industry’s leading analytical graph databases.
I-Connect007 Editor’s Choice: Five Must-Reads for the Week
04/19/2024 | Marcy LaRont, PCB007 MagazineFor my must-read picks of the week, I’m highlighting Parker Capers, a young professional seeking employment, solid counsel from Dan Beaulieu on what your post-show plan should look like, more information and insight on “chiplets” and the need for secure data transfer standards from columnist Preeya Kuray, as well as Matt Stevenson’s design for reality wisdom. It’s a reminder to download one of our newest books (there are several) you don't want to miss if you are an assembler.