Zero-shot Learning for Visual Recognition Problems

Loading...
Thumbnail Image
Date
2015, 2016
Authors
Naha, Shujon
Journal Title
Journal ISSN
Volume Title
Publisher
IEEE
Elsevier
Abstract

In this thesis we discuss different aspects of zero-shot learning and propose solutions for three challenging visual recognition problems: 1) unknown object recognition from images 2) novel action recognition from videos and 3) unseen object segmentation. In all of these three problems, we have two different sets of classes, the “known classes”, which are used in the training phase and the “unknown classes” for which there is no training instance. Our proposed approach exploits the available semantic relationships between known and unknown object classes and use them to transfer the appearance models from known object classes to unknown object classes to recognize unknown objects. We also propose an approach to recognize novel actions from videos by learning a joint model that links videos and text. Finally, we present a ranking based approach for zero-shot object segmentation. We represent each unknown object class as a semantic ranking of all the known classes and use this semantic relationship to extend the segmentation model of known classes to segment unknown class objects.

Description
Keywords
Zero-shot Learning, Computer Vision, Object Recognition, Action Recognition, Object Segmentation
Citation
Shujon Naha and Yang Wang. Zero-Shot Object Recognition Using Semantic Label Vectors. The 12th Conference on Computer and Robot Vision (CRV), 2015.
Shujon Naha and Yang Wang. Beyond Verbs: Understanding Actions in Videos with Text. International Conference on Pattern Recognition (ICPR), 2016.
Shujon Naha and Yang Wang. Object Figure-Ground Segmentation Using Zero-Shot Learning. International Conference on Pattern Recognition (ICPR), 2016.