Demos for "Fighting FIRe with FIRE: Assessing the Validity of Text-to-Video Retrieval Benchmarks"

Demos for our submission to the NeurIPS 2022 Datasets and Benchmarks Track. Click the hyperlinks below to view each demo

Go to Source Code at github.com/facebookresearch/mm-retrieval-evaluation

Dataset Viewer

View the MSR-VTT and MSVD datasets. Captions and videos are searchable. Go To Viewer Demo

Prediction Comparison

Compare the predictions of CLIP4CLIP, TeachText, and SSB Models. Go To Compare Demo

Query Dataset with SQL

Query the FIRE dataset with SQL. Go to SQL Demo