Showcase: geolocating a dashcam video without GPS, only from the footage [P]

Pipeline Overview

Sharing a project I have been working on called Third Eye. It does visual geolocation. Given a video, it figures out where it was filmed using only the image content, and draws the route on a map.

Pipeline in short:

• Per frame place recognition against a street imagery index
• A trajectory search that stitches the frames into one coherent path
• A geometric verification step to catch false matches
• Per frame confidence so weak frames are flagged, not faked

Results

I ran it on real dashcam footage and it traced the route quite well. Cross domain matching like this is genuinely hard, so a fair amount of the work went into making it honest about uncertainty.

Keen to hear feedback on the matching and trajectory side.

Video Demo:

The Index was covering a 12KM² Area around NYC.