ARTIFICIAL INTELLIGENCE


Sparse modelling with small datasets


Takashi Someda, CTO at Hacarus, on the advantages of sparse modelling AI tools


W


ith the recent rise in interest in artificial intelligence for


computer vision applications, a lot of attention has been given to the potential benefits that AI can bring – promises of more accurate quality control inspection with fewer false alarms and lower cost. However, when deployed,


these goals often aren’t met – in fact, 85 per cent of AI projects fail. Some of the reasons behind this statistic are that most of the efforts to deploy AI to date assume the availability of large amounts of data to train the model, ignore the importance of being able to explain how the algorithm arrived at its conclusion, and lack consideration for compute resource requirements. Often, in today’s complex


manufacturing processes, there aren’t enough examples of defects to create an accurate


model. Furthermore, and perhaps more importantly, commonly used methods such as deep learning are a black box, only able to provide results but not show the method used to reach a conclusion. Without contextualising classification or decisions, little guidance is given for how to improve production processes in order to reduce defects and errors. Does this mean that we


should abandon AI for visual inspection? No! Luckily there are other approaches that can be used to reap the benefits of AI. One of these is sparse modelling, a technique that remedies some of the issues inherent to deep learning. Essentially, sparse modelling


is a data modelling approach that focuses on identifying unique characteristics. A reasonably recent example of sparse modelling is its use to create the first ever image


20 IMAGING AND MACHINE VISION EUROPE DECEMBER 2019/JANUARY 2020


of a black hole, published by researchers belonging to the Event Horizon Telescope project. Sparse modelling, however, is not new; over the past 20 years research in academia has been ongoing, and it’s been growing as a tool in the statistical analysis and machine learning community. Unlike deep learning, there is no concrete algorithm and therefore the exact origins are difficult to pinpoint. However,


‘Sparse modelling can provide accurate models with as little as 50 images’


Robert Tibshirani’s 1996 ‘Regression shrinkage and selection via Lasso’ can be considered an early paper that makes use of the technology. Sparse modelling can be seen as a data analysis toolbox aiming to understand and isolate the factors that have a meaningful impact on a certain occurrence.


Sparse modelling-based inspection When applying sparse modelling to visual inspection there are three main steps that


need to be taken. Te first is pre-processing the data, where harmonisation through the use of techniques such as patching, cropping and sampling are performed. Tis is followed by feature extraction, which depends on the dataset. Feature classification is the final step; even standard classification methods like tree-based models can work well for well-designed features. Sparse modelling works with small datasets, and can provide accurate models with as little as 50 images. Te benefits of this approach


are inherent in its design: by abstracting a series of key features from the input, the user knows how the technique arrived at its conclusion. What’s more, since there aren’t many features, the compute power needed is far less when compared to deep learning. As such, sparse modelling can be deployed even on edge devices, removing the need for external cloud connectivity for processing. O


Hacarus was founded in Kyoto as an AI start-up in 2014; it applies sparse modelling technology. Takashi Someda spoke at the Embedded Vision Europe event in Stuttgart, Germany in October.


@imveurope | www.imveurope.com


carlos castilla/Shutterstock.com


Page 1  |  Page 2  |  Page 3  |  Page 4  |  Page 5  |  Page 6  |  Page 7  |  Page 8  |  Page 9  |  Page 10  |  Page 11  |  Page 12  |  Page 13  |  Page 14  |  Page 15  |  Page 16  |  Page 17  |  Page 18  |  Page 19  |  Page 20  |  Page 21  |  Page 22  |  Page 23  |  Page 24  |  Page 25  |  Page 26  |  Page 27  |  Page 28  |  Page 29  |  Page 30  |  Page 31  |  Page 32  |  Page 33  |  Page 34  |  Page 35  |  Page 36  |  Page 37  |  Page 38  |  Page 39  |  Page 40