Research Projects
Prototypical Part Networks
Summer 2022 - Fall 2024Learning prototypes of object parts for model explainability by design
Keywords: machine learning, neural networks, object recognition, object parts, XAI
A Virtue Ethics-Based Framework for Technology Design
Fall 2021 - PresentSoftware Engineering Principles that Incorporate the Wisdom of Virtue Ethics
Keywords: virtue ethics, Catholic social teaching, common good, design patterns, HCI, the Internet, AI
Human and Machine Perception of Filtered and Synthetic Faces
Spring 2020 - PresentIs the process of recognition changing over time in response to augmented and virtual reality?
Keywords: augmented reality, virtual reality, facial recognition, facial analysis, visual perception
When Technology Falls Short
Fall 2019 - PresentConstructive criticism of emerging technologies, scientific trends, and policies
Keywords: machine learning, facial analysis, election integrity, scientific integrity, peace studies
Human-Drone Partnerships for Emergency Response
Fall 2019 - PresentSemi-autonomous UAVs to support emergency response scenarios, such as fire surveillance and search and rescue
Keywords: drones, software engineering, participatory design, object detection, first responders
Unconventional Approaches to Hacking Neural Networks
Spring 2018 - Fall 2020Uncovering new vulnerabilities in neural network-based applications where security is a consideration
Keywords: machine learning, neural networks, face recognition, security, backdoors, exploits
Hyperparameter Optimization: Distributed Hardware-Aware and Homotopy-Based Strategies
Spring 2017 - PresentIntelligent mapping of hardware resources to model search tasks making use of homotopy optimization
Keywords: machine learning, hyperparameters, optimization, distributed computing, homotopy
Computational Models of Zebrafish Sensory Integration
Fall 2016 - Fall 2020Modeling neural circuits to explain fish behavior and apply to generalized recognition problems in AI
Keywords: computational neuroscience, zebrafish, sensory integration, data fusion, extreme value theory
Image Restoration and Enhancement for Visual Recognition
Fall 2016 - Fall 2021Work to bridge the gap between computational photography and visual recognition
Keywords: deblurring, denoising, super-resolution, deep learning, object recognition, video
Face Synthesis
Fall 2015 - Winter 2023Fast and accurate photo-quality face synthesis for use in face recognition work
Keywords: face synthesis, face recognition, face analysis, computer graphics, data augmentation
Learning-free Image Segmentation
Fall 2015 - Spring 2019Image segmentation for settings where machine learning-based approaches are slow and do not generalize
Keywords: image filtering, volumetric segmentation, connectomics, medical imaging, iris recognition
Tools for Neuroscience
Fall 2015 - Spring 2024Techniques to help neuroscientists understand neuroanatomy and function
Keywords: connectomics, electron microscopy, two-photon imaging, x-ray tomography, behavior
Brain-informed Machine Learning
Fall 2014 - Spring 2019Applying measurements of neural activity to regularize machine learning models
Keywords: fMRI, psychophysics, classification, deep learning, neural-weights, object recognition
Visual Place Recognition
Spring 2013 - Fall 2019Condition invariant visual place recognition for robot navigation inspired by vision science
Keywords: robotics, navigation, place recognition, whole image matching, patch matching, calibration
Good Recognition is Non-metric
Fall 2012 - Spring 2014A new look at a fundamental question in computer vision: is recognition metric?
Keywords: machine learning, metric learning, recognition, face recognition, object recognition
Psychophysics for Computer Vision
Fall 2012 - PresentMeasuring exemplar-by-exemplar difficulty and the pattern of errors of humans for supervised learning
Keywords: psychology, citizen science, psychophysics, object recognition, face detection, attributes
Open World Recognition
Spring 2011 - PresentTheory and algorithms that address the difficult problem of training without complete class knowledge
Keywords: novelty, classifiers, architectures, object recognition, activity recognition, handwriting recognition
Extreme Value Theory for Visual Recognition
Spring 2008 - PresentThe theory and practice of recognition score analysis for prediction and fusion
Keywords: calibration, meta-recognition, score analysis, object recognition, face recognition, attributes
Language & Literature
Spring 2009 - PresentMachine learning and related statistical methods to open up new modes of inquiry in the humanities
Keywords: computational linguistics, intertextuality, sound, stylistics, classics, historical document analysis
Unconstrained Face Recognition
Spring 2008 - PresentFeature localization and recognition considering difficult circumstances such as low light, long distance, blur and noise
Keywords: optics, sensors, eye detection, face recognition, feature descriptors, data fusion, evaluation
Digital Image and Video Forensics
Spring 2008 - PresentApproaches to edited content detection, synthetic content detection, and image provenance analysis
Keywords: forensics, image manipulation, image synthesis, provenance analysis, semantic content analysis
Revocable Biotokens
Fall 2007 - Fall 2013Combining cryptography and biometrics to support identity specific protocols in potentially insecure environments
Keywords: template protection, fingerprint verification, face verification, voice verification, cryptography