Cracking Open the Black Box of Automated Machine Learning
June 3, 2019 | MITEstimated reading time: 5 minutes
ATMSeer’s interface consists of three parts. A control panel allows users to upload datasets and an AutoML system, and start or pause the search process. Below that is an overview panel that shows basic statistics — such as the number of algorithms and hyperparameters searched — and a “leaderboard” of top-performing models in descending order. “This might be the view you’re most interested in if you’re not an expert diving into the nitty gritty details,” Veeramachaneni says.
ATMSeer includes an “AutoML Profiler,” with panels containing in-depth information about the algorithms and hyperparameters, which can all be adjusted. One panel represents all algorithm classes as histograms — a bar chart that shows the distribution of the algorithm’s performance scores, on a scale of 0 to 10, depending on their hyperparameters. A separate panel displays scatter plots that visualize the tradeoffs in performance for different hyperparameters and algorithm classes.
Case studies with machine-learning experts, who had no AutoML experience, revealed that user control does help improve the performance and efficiency of AutoML selection. User studies with 13 graduate students in diverse scientific fields — such as biology and finance — were also revealing. Results indicate three major factors — number of algorithms searched, system runtime, and finding the top-performing model — determined how users customized their AutoML searches. That information can be used to tailor the systems to users, the researchers say.
“We are just starting to see the beginning of the different ways people use these systems and make selections,” Veeramachaneni says. “That’s because now that this information is all in one place, and people can see what’s going on behind the scenes and have the power to control it.”
Suggested Items
Altus Equips SSTL with Advanced Cleaning Technology for Electronics
05/07/2024 | Altus GroupAltus Group, a leading supplier of capital equipment for the electronics manufacturing industry, has announced the successful installation of an advanced PCBA cleaning system at Surrey Satellite Technology Limited (SSTL).
I-Connect007 Editor’s Choice: Five Must-Reads for the Week
05/03/2024 | Nolan Johnson, I-Connect007This week’s most important news is strategic—and telling. When one puts together the IPC industry reports, we simply have to include the recent conversation with Shawn DuBravac and Tom Kastner. On the design side, check out the latest “On The Line With…” podcast featuring Brad Griffin from Cadence Design Systems, discussing SI and PI in the realm of intelligent system design.
Industrial PC Market Size to Record $1.75 Billion Growth from 2023-2027
05/03/2024 | PRNewswireThe global industrial pc market size is estimated to grow by USD 1.75 billion from 2023 to 2027, according to Technavio. This growth is expected to occur at a Compound Annual Growth Rate (CAGR) of almost 6.29% during the forecast period.
Real Time with… IPC APEX EXPO 2024: Sigma Engineering's Recycling and Regeneration Systems for PCB Etching
05/02/2024 | Real Time with...IPC APEX EXPOEvan Howard of Schmoll America interviews Kristoffer Bjorklund, Sigma Engineering's supply chain manager. We learn about Sigma's recycling and regeneration systems for PCB industry etching and the benefits and challenges of implementing these systems in existing factories.
Boeing T-7A Red Hawk Triples Progress
05/01/2024 | BoeingThe Boeing T-7A Red Hawk achieved three recent milestones, propelling the advanced pilot trainer for the U.S. Air Force forward.