Full metadata record
DC Field | Value | Language |
---|---|---|
dc.contributor.author | Jordan, Florian | - |
dc.contributor.author | Baum, Winfried | - |
dc.contributor.author | Frese, Christian | - |
dc.date.accessioned | 2024-07-16T09:14:15Z | - |
dc.date.available | 2024-07-16T09:14:15Z | - |
dc.date.issued | 2024 | - |
dc.identifier.uri | https://fordatis.fraunhofer.de/handle/fordatis/410 | - |
dc.identifier.uri | http://dx.doi.org/10.24406/fordatis/357 | - |
dc.description.abstract | During accidents involving hazardous chemicals, people in the area may be put at risk of harm. (Semi-)autonomous robots can mitigate this threat by removing leaking containers. However, teleoperation requires extensive training and is difficult in practice. To overcome these limitations, we implemented a perception system on an autonomous excavator that locates individual barrels in chaotic scenes for extraction. Following the human-in-the-loop principle, operators can remotely select which barrel to remove. An efficient U-Net-style, DCAN-flavored neural network is trained using synthetic and collected real-world RGB data (5,000 synthetic and 593 real images) and compared to an inference-heavy Mask R-CNN model. In experiments on a leave-out test set, created from the excavator, our model yielded an ODS mIoU of 85.14% and mAP of 72.19%, while Mask R-CNN achieved an ODS mIoU of 86.6% and mAP of 84.31%. With roughly 0.00584s inference time on 800×576 32-bit tensors, our model is faster than Mask R-CNN with an inference time of roughly 0.0491s. Using the robot calibration data, the point clouds of multiple LiDAR sensors are fused with the RGB segmentation to find local cylinder models for each barrel, delivering the exact poses for extraction using the motion planner to find a collision-free motion plan. Force measurements were included in the gripper to avoid deforming the barrel. Field trials showed that the barrels can be reliably extracted without any damage. | en |
dc.description.sponsorship | Funded by the German Federal Ministry of Education and Research (BMBF) within the project AKIT-PRO (13N15673). | en |
dc.language.iso | en | en |
dc.rights.uri | https://creativecommons.org/licenses/by-nc/4.0/ | en |
dc.subject | Instance Segmentation | en |
dc.subject.ddc | DDC::000 Informatik, Informationswissenschaft, allgemeine Werke::000 Informatik, Wissen, Systeme::005 Computerprogrammierung, Programme, Daten | en |
dc.title | Barrel Pile Instance Segmentation | en |
dc.type | Image | en |
dc.contributor.funder | Bundesministerium für Bildung und Forschung BMBF (Deutschland) | en |
dc.description.technicalinformation | This dataset provides roughly 5.000 synthetically generated images, 593 real images collected with a DSLR camera and 47 real images collected online from an autonomous excavator of chaotic barrel piles together with instance mappings according to these images. The structure separates the synthetic, real and online data, for each subset there is a 'RGB' folder containing the images and a 'Instance' folder containing the instance mappings (different colors for each barrel instance) in PNG format. | en |
fordatis.institute | IOSB Fraunhofer-Institut für Optronik, Systemtechnik und Bildauswertung | en |
fordatis.institute | IPA Fraunhofer-Institut für Produktionstechnik und Automatisierung | en |
fordatis.rawdata | true | en |
fordatis.sponsorship.FundingProgramme | Innovationen im Einsatz – Praxisleuchttürme der zivilen Sicherheit | en |
fordatis.sponsorship.projectid | 13N15673 | en |
fordatis.sponsorship.projectname | AutonomieKIT für die Umrüstung von Arbeitsmaschinen in kooperierende Nutzfahrzeuge zur Unterstützung von Rettungskräften | en |
fordatis.sponsorship.projectacronym | AKIT-PRO | en |
fordatis.sponsorship.ResearchFrameworkProgramm | Forschung für die zivile Sicherheit | en |
fordatis.date.start | 2022 | - |
fordatis.date.end | 2022 | - |
Appears in Collections: | Fraunhofer-Institut für Produktionstechnik und Automatisierung IPA |
Files in This Item:
File | Description | Size | Format | |
---|---|---|---|---|
Barrel-Instance-Segmentation.tar.xz | Tarball Archive of all RGB and instances masks images | 17,28 GB | Tarball | Download/Open |
Version History
Version | Item | Date | Summary |
---|---|---|---|
1 | fordatis/410 | 2024-07-16 11:14:15.0 |
This item is licensed under a Creative Commons License