AccessMath tracks whiteboard contents in lecture videos through time and generates keyframes. 'Ink' in keyframes can be used to jump to where that 'ink' is drawn in the video, or searched using image queries through the Tangent-V search engine. (NSF-funded project - Video Demo)
The first multi-modal equation editing prototype, with support for handwriting, typing, and image input for formulas, along with support for math + keyword search. (NSF-funded project; Video Demo)
Audio Search in Lectures
A prototype that supports searching lecture videos for spoken keyterms (within-speaker), using a modified Dynamic Time Warping algorithm (NSF-funded project; Example Results).
Formula Search Engines
We created Tangent and refined Approach0, two state-of-the-art formula search engines. (Funded by NSF and the Alfred P. Sloan Foundation)
Back in 2008, Kurt Kluever created the first video captcha, where users enter three words describing a video. (Funded by Xerox Corporation)
The dprl has participated in every CROHME competition since its inception in 2011, and co-organized the competition since 2013. CROHME has become a standard benchmark for handwritten formula recognition. A new CROHME competition is being held for ICDAR 2019, which also includes typeset formula detection.