Dense semantic image segmentation with objects and attributes

TitleDense semantic image segmentation with objects and attributes
Publication TypeConference Paper
Year of Publication2014
AuthorsZheng, S, Cheng, MMing, Warrell, J, Sturgess, P, Vineet, V, Rother, C, Torr, PHS
Conference NameProceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition
ISBN Number9781479951178
KeywordsAttributes, Image segmentation, Object recognition, Scene Understanding

The concepts of objects and attributes are both important for describing images precisely, since verbal descriptions often contain both adjectives and nouns (e.g. 'I see a shiny red chair'). In this paper, we formulate the problem of joint visual attribute and object class image segmentation as a dense multi-labelling problem, where each pixel in an image can be associated with both an object-class and a set of visual attributes labels. In order to learn the label correlations, we adopt a boosting-based piecewise training approach with respect to the visual appearance and co-occurrence cues. We use a filtering-based mean-field approximation approach for efficient joint inference. Further, we develop a hierarchical model to incorporate region-level object and attribute information. Experiments on the aPASCAL, CORE and attribute augmented NYU indoor scenes datasets show that the proposed approach is able to achieve state-of-the-art results.

Citation KeyZheng2014