Research Projects


Prototypical Part Networks

Prototypical Part Networks

Summer 2022 - Fall 2024

Learning prototypes of object parts for model explainability by design

Keywords: machine learning, neural networks, object recognition, object parts, XAI
When Technology Falls Short

When Technology Falls Short

Fall 2019 - Present

Constructive criticism of emerging technologies, scientific trends, and policies

Keywords: machine learning, facial analysis, election integrity, scientific integrity, peace studies
Human-Drone Partnerships for Emergency Response

Human-Drone Partnerships for Emergency Response

Fall 2019 - Present

Semi-autonomous UAVs to support emergency response scenarios, such as fire surveillance and search and rescue

Keywords: drones, software engineering, participatory design, object detection, first responders
Unconventional Approaches to Hacking Neural Networks

Unconventional Approaches to Hacking Neural Networks

Spring 2018 - Fall 2020

Uncovering new vulnerabilities in neural network-based applications where security is a consideration

Keywords: machine learning, neural networks, face recognition, security, backdoors, exploits
Hyperparameter Optimization: Distributed Hardware-Aware and Homotopy-Based Strategies

Hyperparameter Optimization: Distributed Hardware-Aware and Homotopy-Based Strategies

Spring 2017 - Present

Intelligent mapping of hardware resources to model search tasks making use of homotopy optimization

Keywords: machine learning, hyperparameters, optimization, distributed computing, homotopy
Computational Models of Zebrafish Sensory Integration

Computational Models of Zebrafish Sensory Integration

Fall 2016 - Fall 2020

Modeling neural circuits to explain fish behavior and apply to generalized recognition problems in AI

Keywords: computational neuroscience, zebrafish, sensory integration, data fusion, extreme value theory
Image Restoration and Enhancement for Visual Recognition

Image Restoration and Enhancement for Visual Recognition

Fall 2016 - Fall 2021

Work to bridge the gap between computational photography and visual recognition

Keywords: deblurring, denoising, super-resolution, deep learning, object recognition, video
Face Synthesis

Face Synthesis

Fall 2015 - Winter 2023

Fast and accurate photo-quality face synthesis for use in face recognition work

Keywords: face synthesis, face recognition, face analysis, computer graphics, data augmentation
Learning-free Segmentation

Learning-free Image Segmentation

Fall 2015 - Spring 2019

Image segmentation for settings where machine learning-based approaches are slow and do not generalize

Keywords: image filtering, volumetric segmentation, connectomics, medical imaging, iris recognition
Tools for Neuroscience

Tools for Neuroscience

Fall 2015 - Spring 2024

Techniques to help neuroscientists understand neuroanatomy and function

Keywords: connectomics, electron microscopy, two-photon imaging, x-ray tomography, behavior
Brain-informed Machine Learning

Brain-informed Machine Learning

Fall 2014 - Spring 2019

Applying measurements of neural activity to regularize machine learning models

Keywords: fMRI, psychophysics, classification, deep learning, neural-weights, object recognition
Visual Place Recognition

Visual Place Recognition

Spring 2013 - Fall 2019

Condition invariant visual place recognition for robot navigation inspired by vision science

Keywords: robotics, navigation, place recognition, whole image matching, patch matching, calibration
Is good recognition metric?

Good Recognition is Non-metric

Fall 2012 - Spring 2014

A new look at a fundamental question in computer vision: is recognition metric?

Keywords: machine learning, metric learning, recognition, face recognition, object recognition
Psychophysics

Psychophysics for Computer Vision

Fall 2012 - Present

Measuring exemplar-by-exemplar difficulty and the pattern of errors of humans for supervised learning

Keywords: psychology, citizen science, psychophysics, object recognition, face detection, attributes
Open World Recognition

Open World Recognition

Spring 2011 - Present

Theory and algorithms that address the difficult problem of training without complete class knowledge

Keywords: novelty, classifiers, architectures, object recognition, activity recognition, handwriting recognition
Extreme Value Theory for Visual Recognition

Extreme Value Theory for Visual Recognition

Spring 2008 - Present

The theory and practice of recognition score analysis for prediction and fusion

Keywords: calibration, meta-recognition, score analysis, object recognition, face recognition, attributes
Language and Literature

Language & Literature

Spring 2009 - Present

Machine learning and related statistical methods to open up new modes of inquiry in the humanities

Keywords: computational linguistics, intertextuality, sound, stylistics, classics, historical document analysis
Unconstrained Face Recognition

Unconstrained Face Recognition

Spring 2008 - Present

Feature localization and recognition considering difficult circumstances such as low light, long distance, blur and noise

Keywords: optics, sensors, eye detection, face recognition, feature descriptors, data fusion, evaluation
Digital Image and Video Forensics

Digital Image and Video Forensics

Spring 2008 - Present

Approaches to edited content detection, synthetic content detection, and image provenance analysis

Keywords: forensics, image manipulation, image synthesis, provenance analysis, semantic content analysis
Revocable Biotokens

Revocable Biotokens

Fall 2007 - Fall 2013

Combining cryptography and biometrics to support identity specific protocols in potentially insecure environments

Keywords: template protection, fingerprint verification, face verification, voice verification, cryptography