EVENT MVC 2022
Pick-and-place robotic vision system uses software recipes to speed up application development
T
asked with developing a conveyor tracking system with on-the-fl y robot picking of bags of bread for an industrial bakery, the team at KINE Robotics Oy knew that machine vision was the only possible solution. KINE is a Finnish provider of custom turn-key robotics solutions, whose “key suppliers consider Matrox® Imaging the preferred option for machine vision solutions,” notes Kimmo Salonen, chief technology offi cer at KINE. KINE was helped by OEM Finland Oy, a member of the one of the largest vendors of industrial components in northern Europe. Prior to upgrading to a high-performance vision system, the picking process involved manual removal and depositing of bread packages. The challenge in designing a new system was that product sizes are irregular, and shapes diff er from one type of bread to another, making it tough to determine their location and orientation on the conveyor. The transparent plastic packaging is also diffi cult to detect with optical sensors, due to low contrast and partial refl ections. A robotic solution would ensure a faster, reliable and cost-eff ective manner of product detection and processing (Image 1). “We were already familiar with the capabilities of Matrox Design Assistant® X vision software, which has proven to be a versatile tool for this project, off ering exactly the kind of integration and control we wanted,” says Salonen. As a result, KINE developed the vision system around this fl owchart-based software and a Basler Blaze 101 3D Time-of-Flight (ToF) camera as the sensor, selected as it eliminated the need for separate lighting, and reduced concerns about contrast and refl ections.
Designed to function completely autonomously, the vision system sits directly atop the incoming product conveyor (Image 2). It centers on Matrox Design Assistant X software and the Basler 3D ToF camera, which aff ords real-time measurement of up to 30 fps and provides precise 3D data to the vision software. The camera is triggered from a photodetector by way of a PLC communicating with the vision program via a UDP; the PLC also synchronises the robot by similar means. The Matrox Design Assistant
20 March 2022 | Automation
X runtime environment and the associated vision program run on an industrial panel PC. A Stäubli TS2-60 SCARA robot does the pick-and-place, communicating via TCP with Stäubli VALtrack software library. Camera data analysis is implemented using Matrox Design Assistant X, which also produces the central interface to the vision system. The ToF camera records the surfaces as a 3D point cloud with over 300,000 XYZ coordinates; the software then converts it into a depth map, which is analysed using 2D vision tools to determine the grip points for the robot. The 2D tools provided by Matrox Design Assistant X work particularly well on depth-map data and allowed the team at KINE to eff ectively solve their application. Sami Sinisalo, robot specialist at KINE, notes that, “there was a plan to use 3D information from the Basler ToF camera to determine the pick height for the robot, but we ultimately decided to create a recipe for each product with Matrox Design Assistant X.” Transparent plastic bags are not visible to the ToF camera (Image 3), and as the bread products within are arranged in random positions, the lack of a single, consistently fl at surface makes it very diffi cult to determine the correct pick-height based on 3D depth- map information (Image 4). Recipes are used to confi gure select fl owchart steps so that a fl owchart can inspect diff erent product variants. This allowed a single project to inspect the diff erent types of breads. Recipes can be created and confi gured in Matrox Design Assistant X vision software at both design-time and runtime. KINE and their customer are very pleased with the results, which provides a lower error rate than the prior manual handling and with a higher throughput of goods. KINE also saw a reduction in the overall costs related to machine vision by 75%, compared to traditional camera and lighting options. With the new vision system, the robot grip can handle between 25 and 30 packages per minute. The team at KINE sees many opportunities for future integration of Matrox Imaging products into their customed robot solutions, thanks in no small part to the success achieved with this 3D pick-and-place robot system.
Image 1: The 3D conveyor tracking vision system offers on-the-fly robot picking
Image 2: The ToF camera views the packaged bread and sends 3D data to vision software for processing and analysis
Image 3: The transparent plastic bag is not seen by the ToF camera
Image 4: Random product arrangement makes it difficult to determine the correct pick-height information
CONTACT:
Matrox Imaging
www.matrox.com/en/imaging
automationmagazine.co.uk
Page 1 |
Page 2 |
Page 3 |
Page 4 |
Page 5 |
Page 6 |
Page 7 |
Page 8 |
Page 9 |
Page 10 |
Page 11 |
Page 12 |
Page 13 |
Page 14 |
Page 15 |
Page 16 |
Page 17 |
Page 18 |
Page 19 |
Page 20 |
Page 21 |
Page 22 |
Page 23 |
Page 24 |
Page 25 |
Page 26 |
Page 27 |
Page 28 |
Page 29 |
Page 30 |
Page 31 |
Page 32 |
Page 33 |
Page 34 |
Page 35 |
Page 36 |
Page 37 |
Page 38 |
Page 39 |
Page 40 |
Page 41 |
Page 42 |
Page 43 |
Page 44 |
Page 45 |
Page 46 |
Page 47 |
Page 48 |
Page 49 |
Page 50 |
Page 51 |
Page 52 |
Page 53 |
Page 54 |
Page 55 |
Page 56 |
Page 57 |
Page 58 |
Page 59 |
Page 60 |
Page 61 |
Page 62 |
Page 63 |
Page 64 |
Page 65 |
Page 66
