Computer Vision for OSINT Research

VFRAME researches and develops state-of-the-art computer vision technologies for application to human rights research and conflict zone monitoring.

Dec 9, 2021: Financial Times writes about VFRAME: Researchers train AI on ‘synthetic data’ to uncover Syrian war crimes

Dec 1, 2021: ModelZoo launches. First object detection model preview available for RBK-250 detector, trained using 3D-rendered synthetic data.

Nov, 2021: dface.app face redaction web app launches (code)

RBk-250 detections using synthetic data trained model
Research: These detections show the accuracy of a RBK-250 object detection algorithm trained using 100% 3D-rendered synthetic data.
Image © Mnemonic.org. Detections: VFRAME.

Current Research and Prototypes

3D Printed Training Data
  • 3D Printed Training Data
  • Enriching synthetic data with 3D printed cluster munition replicas for use in image training datasets
3D Rendered Training Data
  • 3D Rendered Training Data
  • Using 3D modeled scenes to build synthetic training datasets for objects in conflict zones
Cluster Munition Detector
  • Cluster Munition Detector
  • Training object detection algorithms to locate illegal munitions
Scene Summarization
  • Scene Summarization
  • Content-based scene summarization to find the most representative frames in videos

About VFRAME

Human rights researchers often rely on videos shared online to document war crimes, atrocities, and human rights violations. Manually reviewing these videos is expensive, does not scale, and can cause vicarious trauma. As an increasing number of videos are posted, a new approach is needed to understand these large datasets.

VFRAME has been working with Mnemonig.org, a Berlin-based organization dedicated to documenting war crimes and human rights violations, to develop computer vision tools to address these challenges.

Specifically, VFRAME has been developing a scalable computer vision system for large-scale analysis of video archives to detect illegal munitions, and redaction tools to blur faces. VFRAME can detect objects, such as the RBK-250 munition found in videos from the Syrian conflict, with up to 99% accuracy at over 400 FPS on a single desktop.

Read more about who we are and what we do.

Recent Press

Collaborations

Form Labs
Syrian Archive

Funding

German Federal Ministry of Education and Research - BMBF
Meedan / Check Global
NLNet and NGI0
Prototype Fund

Awards

Ars Electronica
Beazley Design of the Year Awards 2019
STARTS

Publications

In development