Skip to footer
Home Research Artificial Intelligence / Machine Learning Dimensionality Reduction for Representing the Knowledge of Probabilistic Models

Dimensionality Reduction for Representing the Knowledge of Probabilistic Models

0

Abstract

Most deep learning models rely on expressive high-dimensional representations to achieve good performance on tasks such as classification. However, the high dimensionality of these representations makes them difficult to interpret and prone to over-fitting. We propose a simple, intuitive and scalable dimension reduction framework that takes into account the soft probabilistic interpretation of standard deep models for classification. When applying our framework to visualization, our representations more accurately reflect inter-class distances than standard visualization techniques such as t-SNE. We show experimentally that our framework improves generalization performance to unseen categories in zero-shot learning. We also provide a finite sample error upper bound guarantee for the method.

Authors

Marc T Law, Jake Snell, Amir-massoud Farahmand, Raquel Urtasun, Richard S. Zemel

Conference

ICLR 2019

Full Paper

‘Dimensionality Reduction for Representing the Knowledge of Probabilistic Models’ (PDF)

Uber ATG

Comments
Previous article DARNet: Deep Active Ray Network for Building Segmentation
Next article Deep Rigid Instance Scene Flow
Raquel Urtasun
Raquel Urtasun is the Chief Scientist for Uber ATG and the Head of Uber ATG Toronto. She is also a Professor at the University of Toronto, a Canada Research Chair in Machine Learning and Computer Vision and a co-founder of the Vector Institute for AI. She is a recipient of an NSERC EWR Steacie Award, an NVIDIA Pioneers of AI Award, a Ministry of Education and Innovation Early Researcher Award, three Google Faculty Research Awards, an Amazon Faculty Research Award, a Connaught New Researcher Award, a Fallona Family Research Award and two Best Paper Runner up Prize awarded CVPR in 2013 and 2017. She was also named Chatelaine 2018 Woman of the year, and 2018 Toronto’s top influencers by Adweek magazine