3D Printed Synthetic Data
- Enriching synthetic data with 3D printed cluster munition replicas for use in image training datasets
- Posted: Jan 23, 2021 . Modified: Mar 12, 2023
High-quality training data is essential for developing accurate object detection algorithms. But most publicly available datasets are too generic for application to human rights investigation and recording videos of real munitions in conflict zones can put lives at risk. To offset the challenge of sourcing training data from conflict zones, VFRAME creates 3D-printed replicas to enrich training datasets and create benchmark images.
3D-printed replicas are safe, inert, proxy objects that can be photographed and annotated in various environments for use in computer vision image training datasets. The examples on this page show the 9N235 submunition fabricated fused deposition modeling (FDM), an accessible and low-cost printing method. Minimal artifacts can be seen in the raw prints (left) while the finished parts (right) are seamless. The replica shown above was fabricated in 2021 and is based on a 3D scan of a real free-from-explosive (FFE) 9N235 submunition. Each part is accurate to within a millimeter.
Previous attempts during 2019-2020 explored using stereolithography (SLA) resin printing. The main advantage of using SLA printers is cleaner prints with less layer lines, which means less post-processing. But SLA printers require more maintenance for the resin material, including additional UV curing and disposal of hazardous fluids.
VFRAME has been prototype this technique since 2019 in collaboration with Mnemonic, an organization dedicated to preserving evidence of atrocities and war-crimes in Syria, Yemen, and Sudan. Since 2022 it has been used to help train the final detection models used to locate evidence of illegal cluster munition strikes in videos from Syria and Yemen, and now also in Ukraine.
Key Findings from Research 2019 - 2023 #
Printing
- Use FDM printing with PLA filament for making replicas
- Print with closest color filament match as base material
- Print at 0.2mm layer height for prototype and 0.1mm for final print
- Post-process with wet sandpaper using 100-200-400-800 for smooth surfaces
- Avoid using electric sanding with dry sandpapers as it can melt plastic
- Use primer to fill gaps in layer lines between wet sanding
- Use brush or spray painting to finalize
- Combine materials (metal screws, connectors) to add more real material texture where possible
Safety
- 3D printed replicas are safe and effective alternative to using real munitions in training datasets
- 3D printed replicas are lightweight and easily transported
- 3D printed replicas can be disassembled and safely transported to unique locations and then reassembled whereas traveling with “real” replicas can be more challenging
Acknowledgments #
First version 3D replica prints made with FormLabs Form 2 and Form 3 SLA resin printer in Berlin by Formlabs. Thanks to Marcelo Coelho, Jory, Luke, and Ramaine.
Exhibitions #
Thanks to Ars Electronica for including this research at its early stage in their 2019 exhbition in Linz, Austria
Funding #
This research received partial support from SIDA / Meedan grant