Research: Cluster Munition Detector Prototype

Detecting Cluster Munitions with Computer Vision

Active research area. Follow github.com/vframeio for updates.
Detecting AO2.5RT cluster munitions is challenging due to the variety of appearances and fractured assemblies. Without a large enough training dataset, the detector fails to find all munitions.
Detecting AO2.5RT cluster munitions is challenging due to the variety of appearances and fractured assemblies. Without a large enough training dataset, the detector fails to find all munitions.

Since VFRAME started in 2017, building a cluster munition detector has always been priority, but attaining high accuracy has been more difficult than expected. Munitions can appear in many different ways. For example, the AO-2.5RT cluster munition can appear fully intact, split in half with and without arming fins, or the arming fins may appear alone. Each of these variations can appear upside down, covered in dirt, damanged, or partially occluded. Detecting a AO-2.5RT cluster munition actually means detecting all of these visual appearances.

The hierarchy below shows how each munition is sub-classed into different visual states, each of which are annotated separately for training and then combined during inference using a hierarchical object detection model.

Hierarchy of the cluster munition annotations
Hierarchy of the cluster munition annotations

Using this approach for labeling, several hundred annotations are manually created for each object in each class. Then, the Darknet/YoloV3 training network is used to create object detection models.

Prototype #1 (below) initially worked well for cluster munitions that appeared close the camera, but it missed objects that were smaller or covered in dirt. Prototype #3 was trained using more examples and small imagery and has higher detection accuracy on smaller objects. However, the overall accuracy is still quite low likely due to insufficient training data.

Cluster Munition Detector Prototypes

Cluster munition detector prototype #3. October 2018.
Cluster munition detector prototype #1. This prototype worked well on large objects, but failed to generalize well to other sizes in other scenes. January 2018.
Acknowledgements

This research has been supported by funding from PrototypeFund (DE).