VFRAME is a collection of open-source computer vision software tools designed specifically for human rights investigations that rely on large datasets of visual media.

Current Research and Prototypes

  • Synthetic Data
  • Using 3D modeled scenes to build synthetic training datasets for objects in conflict zones
  • Scene Summarization
  • Content-based scene summarization to find the most representative frames in videos
  • Munition Detector
  • Training object detection algorithms to locate illegal munitions

About VFRAME

Human rights researchers often rely on videos shared online to document war crimes, atrocities, and human rights violations. Manually reviewing these videos is expensive, does not scale, and can cause vicarious trauma. As an increasing number of videos are posted, a new approach is needed to understand these large datasets.

VFRAME is developing computer vision tools to process million-scale video collections, scene summarization algorithms to reduce processing times, object detection models to detect illegal munitions, synthetic datasets to train object detection models, a visual search engine to locate similar images of interest, and an custom annotation system to create training data. Read more