Demos, publications, data, and software from the lab.
Publications - papers, theses, and abstracts/posters produced by the dprl are available here.
Software and Data - source code and data are available for a number of projects. They can be found here.
Below are example dprl projects, with demos/videos where available.
AccessMath and Tangent-V
AccessMath tracks whiteboard contents in lecture videos through time and generates keyframes. 'Ink' in keyframes can be used to jump to where that 'ink' is drawn in the video, or searched using image queries through the Tangent-V search engine. (NSF-funded project - Video Demo)
The min math-aware search interface
The first multi-modal equation editing prototype, with support for handwriting, typing, and image input for formulas, along with support for math + keyword search. (NSF-funded project; Video Demo)
AccessMath: Keyword Spotting
A prototype that supports searching lecture videos for spoken keyterms (within-speaker), using a modified Dynamic Time Warping algorithm (NSF-funded project; Example Results).
Formula Search Engines
We created Tangent and refined Approach0, two state-of-the-art formula search engines. (Funded by NSF and the Alfred P. Sloan Foundation)
Back in 2008, Kurt Kluever created the first video captcha, where users enter three words describing a video. (Funded by Xerox Corporation)
The CROHME Competitions
The dprl has participated in every CROHME competition since its inception in 2011, and co-organized the competition since 2013. CROHME has become a standard benchmark for handwritten formula recognition. A new CROHME competition is being held for ICDAR 2019, which also includes typeset formula detection.