We propose AffordanceNet, a new deep learning approach to simultaneously detect multiple objects and their affordances from RGB images. Our AffordanceNet has two branches: an object detection branch to localize and classify the object, and an affordance detection branch to assign each pixel in the object to its most probable affordance label. The proposed framework employs three key components ...

The concept of affordances has been suggested as a way to understand the effects of information technology (IT) on human behavior and the factors that affect individual IT use. However research has discussed affordances mostly on a conceptual or theoretical level. We empirically investigate different characteristics of affordances to understand the factors that influence users’ understanding of...

Introduction One of the many goals of design research is to better understand the ways in which end users interact with the products of designing. This focus is not surprising—the ultimate measure of success for any design is the adoption by the user. The concept of affordance recently has been the focus of increased interest in the design research community because it captures well the relatio...

The field of functional recognition or affordance estimation from images has seen a revival in recent years. As originally proposed by Gibson, the affordances of a scene were directly perceived from the ambient light: in other words, functional properties like sittable were estimated directly from incoming pixels. Recent work, however, has taken a mediated approach in which affordances are deri...

The concept of affordance has been brought to HCI by Don Norman, who has recently protested against its misuse by designers. They say they will put affordances in the interface, or afford this or that to the users, but Norman points out that affordances only exist inasmuch as they are perceived by users. Therefore, it doesn’t make sense to use the term as designers do. This paper takes the desi...

The concept of affordance has been brought to HCI by Don Norman, who has recently protested against its misuse by designers. They say they will put affordances in the interface, or afford this or that to the users, but Norman points out that affordances only exist inasmuch as they are perceived by users. Therefore, it doesn’t make sense to use the term as designers do. This paper takes the desi...

Localizing functional regions of objects or affordances is an important aspect of scene understanding. In this work, we cast the problem of affordance segmentation as that of semantic image segmentation. In order to explore various levels of supervision, we introduce a pixelannotated affordance dataset of 3090 images containing 9916 object instances with rich contextual information in terms of ...

We propose a new approach to localizing handle-like grasp affordances in 3-D point clouds. The main idea is to identify a set of sufficient geometric conditions for the existence of a grasp affordance and to search the point cloud for neighborhoods that satisfy these conditions. Our goal is not to find all possible grasp affordances, but instead to develop a method of localizing important types...

Smart objects are a representation strategy for games and virtual worlds, in which information about object interactions is distributed into the objects themselves: an object knows how it can be used, what kinds of effects it has, etc. In this work, we describe a prototype that aims to explore social simulation using smart objects. We extend the concept of smart objects to include a model of hu...