ProfessorPhD (Comp. Sc.), MSc, BMusic, BA (Queen's University, Canada) Director, Document and Pattern Recognition Lab (dprl)Department of Computer Science Rochester Institute of Technology (NY, USA) |

## Journal Papers

M. Kanadje, Z. Miller, A. Agarwal, R. Gaborski, R. Zanibbi and S. Ludi. (2016) Assisted keyword indexing for lecture videos using unsupervised keyword spotting.

Pattern Recognition Letters, 71(1):8--15. (Online demonstration).Final version available online from Elsevier.C. Riedl, R. Zanibbi, M.A. Hearst, S. Zhu, M. Menietti, J. Crusan, I. Metelsky, K.R. Lakhani (2016) Detecting figures and part labels in patents: competition-based development of graphics recognition algorithms.

Int'l J. Document Analysis and Recognition, 19(2): 155-172. (original publication available from www.springerlink.com).H. Mouchere, R. Zanibbi, U. Garain and C. Viard-Gaudin. (2016) Advancing the State-of-the-Art for Handwritten Math Recognition: The CROHME Competitions, 2011-2014.

Int'l Journal on Document Analysis and Recognition, 19(2): 173-189. (original publication available from www.springerlink.com).R. Zanibbi and D. Blostein (2012) Recognition and Retrieval of Mathematical Expressions,

Int'l. Journal on Document Analysis and Recognition15(4): 331-357. (original publication available from www.springerlink.com).J. Heliotis and R. Zanibbi (2011) Moving Away from Programming and Towards Computer Science in the CS First Year, Journal of Computing Sciences in Colleges, 26(3): 115-125.

R. Zanibbi, D. Blostein, and J.R. Cordy. (2004) A Survey of Table Recognition: Models, Observations, Transformations, and Inferences,

Int'l Journal of Document Analysis and Recognition,Vol. 7, No. 1, pp. 1-16.(The original publication is available at www.springerlink.com)R. Zanibbi, D. Blostein, and J.R. Cordy. (2002) Recognizing Mathematical Expressions Using Tree Transformation,

IEEE Trans. Pattern Analysis and Machine Intelligence, Vol. 24, No. 11, pp. 1455-1467.(The original publication is available at ieeexplore.ieee.org)

## Invited Papers

Zanibbi, R. and Orakwue, A. (2015) Math Search for the Masses: Multimodal Search Interfaces and Appearance-Based Retrieval. Proc. Conference on Intelligent Computer Mathematics (CICM), LNAI 9150, Springer, pp. 18-36, Washington, DC.

## Book Chapters

Mouchère, H., Viard-Gaudin, C., Zanibbi, R. and Garain, U. (2017) Systems for the Analysis of Handwritten Mathematical Expressions, in

Document Analysis and Text Recognition: Benchmarking State-of-the-Art Systems, Series in Machine Perception and Artificial Intelligence (SMPAI), Vol. 82, Eds. V. Märgner, U. Pal and A. Antonacopoulos, World Scientific Publishing Co.D. Blostein and R. Zanibbi. (2014)

Processing Mathematical Notation, inHandbook of Document Image Processing and Recognition, pp. 679-702, Springer-Verlag.R. Zanibbi, D. Blostein, and J.R. Cordy. (2008) Decision-Based Specification and Comparison of Table Recognition Algorithms, in

Machine Learning in Document Analysis and Recognition, Springer Studies in Computational Intelligence, Vol. 90, pp. 71-103 (original version is available from www.springerlink.com).

## Conference Proceedings

R. Zanibbi and B. Coüasnon (Editors). (2013) Proceedings of Document Recognition and Retrieval XX, Vol. 8658 of

Proceedings of the SPIE.C. Viard-Gaudin and R. Zanibbi (Editors). (2012) Proceedings of Document Recognition and Retrieval XIX, Vol. 8297 of

Proceedings of the SPIE.

## Patents

J. Handley, A. Rahgozar, D. Venable, P. Spiteri, A. Namboodiri, and Zanibbi, R. (2011). System and Method for Identifying and Labeling Fields of Text Associated with Scanned Business Documents. (Xerox Corporation) U.S. Patent No. 7,965,891.

J. Handley, A. Rahgozar, D. Venable, P. Spiteri, A. Namboodiri, and Zanibbi, R. (2010). System and Method for Identifying and Labeling Fields of Text Associated with Scanned Business Documents. (Xerox Corporation) U.S. Patent No. 7,860,312.

J. Handley, A. Rahgozar, D. Venable, P. Spiteri, A. Namboodiri, and Zanibbi, R. (2010). System and Method for Identifying and Labeling Fields of Text Associated with Scanned Business Documents. (Xerox Corporation) U.S. Patent No. 7,689,037.

## Refereed Conference Papers

## 2020 - present

Zhong, W., Rohatgi, S., Wu, J., Giles, C.L., and Zanibbi, R. (2020)

Accelerating Substructure Similarity Search for Formula Retrieval.Proc. European Conference on Information Retrieval, to appear.Nishizawa, G., Liu, J., Diaz, Y., Dmello, A., Zhong, W. and Zanibbi, R. (2020)

MathSeer: A Math-Aware Search Interface with Intuitive Formula Editing, Reuse, and Lookup.Proc. European Conference on Information Retrieval, to appear.Mansouri, B., Agarwal, A., Oard, D., and Zanibbi, R. (2020)

Finding Old Answers to New Math Questions: The ARQMath Lab at CLEF 2020.Proc. European Conference on Information Retrieval, to appear.## 2015 - 2019

Mansouri, B., Rohtagi, S., Oard, D., Wu, J., Giles, C.L., and Zanibbi, R. (2019) Tangent-CFT: An Embedding model for Mathematical Formulas. Proc. International Conference on the Theory of Information Retrieval (ICTIR). Santa Clara, California, USA (to appear).

Mahdavi, M., Condon, M., Davila, K., and Zanibbi, R. (2019) LPGA: Line-of-Sight Parsing with Graph-Based Attention for Math Formula Recognition

Proc. Int'l Conf. Document Analysis and Recognition, Sydney, Australia (to appear).M. Mahdavi, R. Zanibbi, H. Mouchere, and Utpal Garain (2019). ICDAR 2019 CROHME + TFD: Competition on Recognition of Handwritten Mathematical Expressions and Typeset Formula Detection. Proc. International Conference on Document Analysis and Recognition, Sydney, Australia (to appear).

Mahdavi, M. and Zanibbi, R. (2019) Tree-Based Structure Recognition Evaluation for Math Expressions: Techniques and Case Study. IAPR Graphics Recognition Workshop (GREC, held at ICDAR 2019), Sydney, Australia (abstract, 2pp., to appear).

Choi, K.-Y., Couasnon, B., Ricquebourg, Y., and Zanibbi, R. (2019) CNN-Based Accidental Detection in Dense Printed Piano Scores.

Proc. Int'l Conf. Document Analysis and Recognition, Sydney, Australia (to appear).Mansouri, B., Oard, D., and Zanibbi, R. (2019) Characterizing Searches for Mathematical Concepts.

Proc. ACM Joint Conference on Digital Libraries (JCDL), Urbana-Champaign, Illinois. (Nominated for a Best Paper Award, invited for Journal Submission)Zhong, W., and Zanibbi, R. (2019) Structural Similarity Search for Formulas using Leaf-Root Paths in Operator Subtrees.

Proc. European Conference on Information Retrieval (ECIR), Cologne, Germany (to appear) (Best Applications Paper Award)Davila, K., and Zanibbi, R., (2019) Tangent-V: Math Formula Image Search Using Line-of-Sight Graphs,

Proc. European Conference on Information Retrieval (ECIR), Cologne, Germany (to appear).Choi, K.-Y., Couasnon, B., Ricquebourg, Y., and Zanibbi, R. (2018) Music symbol detection with Faster R-CNN using synthetic annotations.

Proc. Int'l Work. Reading Music Systems, pp. 9-10, Paris, France. (abstract)Davila, K. and Zanibbi, R. (2018) Visual Search Engine for Handwritten and Typeset Math in Lecture Videos and LaTeX Notes.

Proc. Int'l Conf. Frontiers in Handwriting Recognition,Niagara Falls, NY (Best Paper Award).Pacha, A., Choi, K-Y., Couasnon, B., Ricquebourg, Y., Zanibbi, R. and Eidenberger, H. (2018) Handwritten Music Object Detection: Open Issues and Baseline Results.

Proc. IAPR W. on Document Analysis Systems (DAS), Vienna, Austria (to appear).Choi, K.Y., Couasnon, B., Ricquebourg, Y. and Zanibbi, R. (2017) Bootstrapping Samples of Accidentals in Dense Piano Scores for CNN-Based Detection.

Proc. IAPR Int'l. W. on Graphics Recognition (GREC),Kyoto, Japan (abstract, 2pp.)Davila, K. and Zanibbi, R. (2017) Whiteboard Video Summarization via Spatio-Temporal Conflict Minimization. Proc. Int'l Conf. Document Analysis and Recognition (ICDAR), pp. 356-363, Kyoto, Japan.

Davila, K. and Zanibbi, R. (2017) Layout and Semantics: Combining Representations for Math Formula Search.

Proc. ACM Special Interest Group on Information Retrieval (SIGIR),pp. 1165-1168, Tokyo, Japan.L. Hu and R. Zanibbi. (2016) MST-Based Visual Parsing of Online Handwritten Mathematical Expressions.

Proc. Int'l Conf. Frontiers in Handwriting Recognition, pp. 607-612, Shenzhen, China (Best Poster Award).L. Hu and R. Zanibbi. (2016) Line-of-Sight Stroke Graphs and Parzen Shape Context Features for Handwritten Math Formula Representation and Symbol Segmentation.

Proc. Int'l Conf. Frontiers in Handwriting Recognition, Shenzhen, China (to appear).H Mouchere, C. Viard-Gaudin, R. Zanibbi and U. Garain. (2016) ICFHR 2016 CROHME: Competition on Recognition of Online Handwritten Mathematical Expressions..

Proc. Int'l Conf. Frontiers in Handwriting Recognition, Shenzhen, China (to appear).R. Zanibbi, K. Davlia, A. Kane and F. Tompa (2016) Multi-Stage Math Formula Search: Using Appearance-Based Similarity Metrics at Scale.

Proc. ACM Special Interest Group on Information Retrieval (SIGIR), pp. 145-154, Pisa, Italy.S. Zhu and R. Zanibbi (2016). A Text Detection System for Natural Scenes with Convolutional Feature Learning and Cascaded Classification.

Proc. Computer Vision and Pattern Recognition (CVPR), pp. 625-632, Las Vegas.Final version available from IEEE Xplore.H. Chatbri, K. Davila, K. Kameyama and R. Zanibbi (2015) Shape matching using keypoints extracted from both the foreground and the background of binary images. Proc. Int'l Conf. Image Processing Theory, Tools and Applications, pp. 205-210, Orleans, France.

Stalnaker, D. and Zanibbi, R. (2015) Math expression retrieval using an inverted index over symbol pairs. Proc. SPIE Document Recognition and Retrieval, Vol. 9402, pp. 07(1)-07(12), San Francisco.

## 2010 - 2014

Pattaniyil, N. and Zanibbi, R. (2014) Combining TF-IDF Text Retrieval with an Inverted Index over Symbol Pairs in Math Expressions: The Tangent Math Search Engine at NTCIR 2014. Proc. 11th NII Testbeds and Community for Information access Research (NTCIR), Tokyo, Japan (online, 8pp.).

Davila, K.M., Ludi, S. and Zanibbi, R. (2014) Using off-line features and synthetic data for on-line handwritten math symbol recognition. Proc. Int'l Conf. Frontiers in Handwriting Recognition, pp. 323-328, Crete, Greece.

Mouchere, H., Viard-Gaudin, C., Zanibbi, R. and Garain, U. (2014) ICFHR 2014 Competition on Recognition of On-line Handwritten Mathematical Expressions (CROHME 2014). Proc. Int'l Conf. Frontiers in Handwriting Recognition, pp. 791-796, Crete, Greece.

Reichenbach, M.S., Agarwal, A. and Zanibbi, R. (2014) Rendering expressions to improve accuracy of relevance assessment for math search. Proc. ACM SIGIR, Gold Coast, Australia, pp. 851-854.

Del Valle Wangari, K., Zanibbi, R. and Agarwal, A. (2014) Discovering real-world use cases for a multimodal math search interface. Proc. ACM SIGIR, Gold Coast, Australia, pp. 947-950.

Davila, K.M., Agarwal, A., Gaborski, R., Zanibbi, R., and Ludi, S. (2013) AccessMath: Indexing and retrieving video segments containing math expressions based on visual similarity. Proc. IEEE Western New York Image Processing Conference, Rochester, NY (online, 4pp.)

F. Alvaro and R. Zanibbi (2013) A Shape-Based Layout Descriptor for Classifying Spatial Relationships in Handwritten Math. ACM Symp. Document Engineering, pp. 123-126, Florence, Italy.

H. Mouchere, C. Viard-Gaudin, R. Zanibbi, U. Garain, D.H. Kim and J.H. Kim (2013) ICDAR 2013 CROHME: Third International Competition on Recognition of Online Handwritten Mathematical Expressions.

Proc. Int'l Conf. Document Analysis and Recognition,pp.1428-1432, Washington, DC.S. Zhu and R. Zanibbi (2013) Label Detection and Recognition for USPTO Images using Convolutional K-means Feature Quantization and AdaBoost.

Proc. Int'l Conf. Document Analysis and Recognition,pp. 633-637, Washington, DC.L. Hu and R. Zanibbi (2013) Segmenting Handwritten Math Symbols Using AdaBoost and Multi-Scale Shape Context Features.

Proc. Int'l Conf. Document Analysis and Recognition, pp. 1180-1184, Washington, DC.R. Zanibbi, H. Mouchere, and C. Viard-Gaudin (2013) Evaluating Structural Pattern Recognition for Handwritten Math via Primitive Label Graphs

Proc. Document Recognition and Retrieval, Proc. SPIE vol. 8658, pp. 17-1 - 17-11, San Francisco, CA.S. Zhu, L. Hu and R. Zanibbi (2013) Rotation-Robust Math Symbol Recognition and Retrieval Using Outer Contours and Image Subsampling

Proc. Document Recognition and Retrieval, Proc. SPIE vol. 8658, pp. 05-1 - 05-12, San Francisco, CA.C. Sasarak, K. Hart, R. Pospesel, D. Stalnaker, L. Hu, R. LiVolsi, S. Zhu, and R. Zanibbi. (2012) min: A Multimodal Web Interface for Math Search.

Symp. Human-Computer Interaction and Information Retrieval, Cambridge, MA (online, 4pp).L. Hu, K. Hart, R. Pospesel, and R. Zanibbi. (2012) Baseline extraction-driven parsing of handwritten mathematical expressions

Proc. Int'l Conf. Pattern Recognition, Tsukuba Science City, Japan.R. LiVolsi, R. Zanibbi, and C. Bigelow. (2012) Collecting historical font metrics from Google Books.

Proc. Int'l Conf. Pattern Recognition, Tsukuba Science City, Japan.T. Schellenberg, B. Yuan, and R. Zanibbi. (2012). Layout-based substitution tree indexing and retrieval for mathematical expressions,

Proc. Document Recognition and Retrieval XIX, pp. OI1-OI8, San Francisco.L. Hu and R. Zanibbi. (2011) HMM-Based Recognition of Online Handwritten Mathematical Symbols Using Segmental K-means Initialization and a Modified Pen-up/down Feature.

Proc. Int'l. Conf. Document Analysis and Recognition, pp. 457-462, Beijing.R. Zanibbi and L. Yu. (2011) Math Spotting: Retrieving Math in Technical Documents Using Handwritten Query Images.

Proc. Int'l Conf. Document Analysis and Recognition, pp. 446-451, Beijing.R. Zanibbi, A. Pillay, H. Mouchere, C. Viard-Gaudin, and D. Blostein. (2011) Stroke-Based Performance Metrics for Handwritten Mathematical Expressions.

Proc. Int'l Conf. Document Analysis and Recognition, pp. 334-338, Beijing.R. Zanibbi and B. Yuan. (2011) Keyword and image-based retrieval for mathematical expressions.

Proc. Document Recognition and Retrieval XVIII, vol. 7874 of Proc. SPIE, pp. OI1-OI9, San Francisco, CA.## 2000-2009

R. Zanibbi, D. Blostein, and J.R. Cordy. (2009) White-Box Evaluation of Computer Vision Algorithms through Explicit Decision-Making,

Proc. Int'l. Conf. Computer Vision Systems, Lecture Notes in Computer Science, Vol. 5815, pp. 295-304.K.A. Kluever and R. Zanibbi (2009). Balancing Usability and Security in a Video CAPTCHA, in

Proc. Symposium on Usable Privacy and Security(archived online in the ACM International Conference Proceeding Series).R. Zanibbi, D. Blostein, and J.R. Cordy. (2005) Recognition Tasks are Imitation Games, in

Pattern Recognition and Data Mining, Eds. S. Singh et al., Lecture Notes in Computer Science, Vol. 3686, pp. 209-218.R. Zanibbi, D. Blostein, and J.R. Cordy. (2005) Historical Recall and Precision: Summarizing Generated Hypotheses, in

Proc. Int'l Conf. Document Analysis and Recognition, pp. 202-206, Seoul, Korea.R. Zanibbi, D. Blostein, and J.R. Cordy. (2005) The Recognition Strategy Language, in

Proc. Int'l Conf. Document Analysis and Recognition, pp. 565-569, Seoul, Korea.J.C. Handley, A.M. Namboodiri, and R. Zanibbi. (2005) Document Understanding System Using Stochastic Context-Free Grammars, in

Proc. Int'l Conf. Document Analysis and Recognition, pp. 511-515, Seoul, Korea.L. Zhang, D. Blostein, and R. Zanibbi. (2005) Using Fuzzy Logic to Analyze Superscript and Subscript Relations in Handwritten Mathematical Expressions, in

Proc. Int'l Conf. Document Analysis and Recognition, pp. 972-976, Seoul, Korea.D. Blostein, J.R. Cordy and R. Zanibbi. (2002) Applying Compiler Techniques to Diagram Recognition, in

Proc. Sixteenth Int'l Conference on Pattern Recognition, Vol. 3, pp. 123-126, Quebec City, Canada.D. Blostein, E. Lank, A. Rose, and R. Zanibbi. (2002) User Interfaces for On-Line Diagram Recognition, in

Graphics Recognition: Algorithms and Applications, Lecture Notes in Computer Science, Vol. 2390, pp. 92-103.R. Zanibbi, D. Blostein and J.R. Cordy. (2001) Baseline Structure Analysis of Handwritten Mathematics Notation, In

Proc. Sixth Int'l Conference on Document Analysis and Recognition, Seattle, Washington, pp. 768-773.R. Zanibbi, K. Novins, J. Arvo and K. Zanibbi. (2001) Aiding Manipulation of Handwritten Mathematical Expressions through Style-Preserving Morphs, In

Proc. Graphics Interface 2001, Ottawa, Canada, pp. 127-134.D. Blostein, E. Lank, and R. Zanibbi. (2000) Treatment of Diagrams in Document Image Analysis, in

Theory and Application of Diagrams, Lecture Notes in Computer Science, Vol. 1889, Springer-Verlag, pp. 330-344.

## Workshop Abstracts and Non-Refereed Papers

M. Mahdavi, M. Condon, and R. Zanibbi (2018) Applying Hierarchical Contextual Parsing to Isolated Typeset Math Formulas.

Western New York Image Processing Workshop (WNYIP), Rochester, NY, USA. (poster)B. Coüasnon, A. Popat and R. Zanibbi. Discussion Group Summary: Graphics Syntax in the Deep Learning Age. Proc. Work. Graphics Recognition 2017, 4 pp., to appear, 2018.

K.-Y. Choi, B. Coüasnon, Yann Ricquebourg and R. Zanibbi. Music Symbol Detection with Faster R-CNN Using Synthetic Annotations. Proc. Int'l Work. Reading Music Systems (WoRMS), 2 pp., to appear (abstract), 2018.

R. Zanibbi, A. Aizawa, M. Kohlhase, I. Ounis, G. Topic and K. Davila. (2016) NTCIR-12 MathIR Task Overview. Proc. NTCIR-12, Tokyo (online proceedings).

K. Davila, R. Zanibbi, A. Kane and F.W. Tompa (2016) Tangent-3 at the NTCIR-12 MathIR Task. Proc. NTCIR-12, Tokyo (online proceedings).

C. Bigelow and R. Zanibbi (2015) Analysis Of Typographical Trends In European Printing 1470-1660. Proc. Conf. of the American Printing History Association.

L. Ouyang and R. Zanibbi. (2009) Identifying Layout Classes for Mathematical Symbols using Layout Context,

Proc. IEEE Western New York Image Processing Workshop(extended abstract).L. Ouyang and R. Zanibbi. (2009) Handwritten Mathematical Symbol Classification Using Layout Context,

Int'l Workshop on Pen-Based Mathematical Computation(extended abstract).A. Pillay and R. Zanibbi. (2009) Intelligent Combination of Structural Analysis Algorithms: Application to Mathematical Expression Recognition,

Int'l Workshop on Pen-Based Mathematical Computation(extended abstract).L. Yu and R. Zanibbi. (2009) Math Spotting in Technical Documents Using Handwritten Queries,

Int'l Workshop on Pen-Based Mathematical Computation(extended abstract).K. Kluever and R. Zanibbi. (2008) Video CAPTCHAs: Usability vs. Security.

Proc. IEEE Western New York Image Processing Workshop, Rochester, NY (USA) (abstract).R. Zanibbi, D. Blostein, and J.R. Cordy. (2006) Decision-Based Specification and Comparison of Table Recognition Strategies.

Proc. IEEE Western New York Image Processing Workshop, Rochester, NY (USA) (abstract).D. Blostein, R. Zanibbi, G. Nagy, R. Harrap. (2003) Document Representations.

Proc. Fifth IAPR Int'l Workshop on Graphics Recognition (GREC 2003), Barcelona, Spain, pp. 3-12.R. Zanibbi, B. Ma, Y. Chen, D.R. Pichora and R.E. Ellis. (2003) Planning Correction of Distal Radial Fractures Using ICP,

Proc. Third Int'l Meeting Int'l Society for Computer Assisted Orthopaedic Surgery, Marbella, Spain. (abstract; link is to poster presented at the conference)R. Zanibbi, D. Blostein and J.R. Cordy. (2001) Directions in Recognizing Tabular Structures of Handwritten Mathematics Notation, In

Proc. Fourth Int'l IAPR Workshop on Graphics Recognition, Kingston, Canada, pp. 493-499.

## Technical Reports

R. Zanibbi, K. Davila, A. Kane, F. Tompa. (July 2015) The Tangent Search Engine: Improved Similarity Metrics and Scalability for Math Formula Search. (arXiv preprint)

C. Riedel, R. Zanibbi, M.A. Hearst, S. Zhu, M. Menietti, J. Crusan, I. Metelsky, and K.R. Lakhani. (Oct. 2014) Detecting Figures and Part Labels in Patents: Competition-Based Development of Image Processing Algorithms. Harvard-NASA Tournament Lab Technical Report 01 (Harvard University, Cambridge, MA).

R. Zanibbi. (Mar. 2011) Programmer's Guide to the Recognition Strategy Language (Version 2.0). Technical Report, Department of Computer Science, Rochester Institute of Technology (Rochester, NY).

## Theses

R. Zanibbi. (Dec. 2004) A Language for Specifying and Comparing Table Recognition Strategies. Ph.D. Dissertation, School of Computing, Queen's University, Canada. (Co-supervisors: D. Blostein and J.R. Cordy).

R. Zanibbi. (Jan. 2000) Recognition of Mathematics Notation via Computer Using Baseline Structure, Queen's University School of Computing Technical Report ISSN-0836-0227-2000-439, 2000, 87 pages (M.Sc. Thesis. Supervisor: D. Blostein).