The physical and textural attributes of objects have been widely studied for recognition, detection and segmentation tasks in computer vision.~A number of datasets, such as large scale ImageNet, have been proposed for feature learning using data hungry deep neural networks and for hand-crafted feature extraction. To intelligently interact with objects, robots and intelligent machines need the ability to infer beyond the traditional physical/textural attributes, and understand/learn visual cues, called visual affordances, for affordance recognition, detection and segmentation. To date there is no publicly available large dataset for visual affordance understanding and learning. In this paper, we introduce a large scale multi-view RGBD visual affordance learning dataset, a benchmark of 47210 RGBD images from 37 object categories, annotated with 15 visual affordance categories. To the best of our knowledge, this is the first ever and the largest multi-view RGBD visual affordance learning dataset. We benchmark the proposed dataset for affordance segmentation and recognition tasks using popular Vision Transformer and Convolutional Neural Networks. Several state-of-the-art deep learning networks are evaluated each for affordance recognition and segmentation tasks. Our experimental results showcase the challenging nature of the dataset and present definite prospects for new and robust affordance learning algorithms. The dataset is publicly available at https://sites.google.com/view/afaqshah/dataset.

翻译：物体的物理属性和纹理属性已在计算机视觉的识别、检测和分割任务中得到广泛研究。为满足数据饥渴型深度神经网络的特征学习以及手工特征提取的需求，研究者已提出如大规模ImageNet等多个数据集。然而，要实现与物体的智能交互，机器人和智能设备需要具备超越传统物理/纹理属性的推理能力，理解并学习被称为"视觉可供性"的视觉线索，用于可供性识别、检测和分割。迄今为止，尚无公开的大规模视觉可供性理解与学习数据集。本文提出一个大规模多视角RGBD视觉可供性学习数据集——包含来自37个物体类别的47210张RGBD图像的基准数据集，标注了15种视觉可供性类别。据我们所知，这是首个也是规模最大的多视角RGBD视觉可供性学习数据集。我们采用流行的Vision Transformer和卷积神经网络对提出的数据集进行可供性分割与识别任务的基准测试，评估了多种最先进的深度学习网络在可供性识别与分割任务上的表现。实验结果展示了该数据集的挑战性，并为开发全新且鲁棒的可供性学习算法提供了明确前景。该数据集已公开于https://sites.google.com/view/afaqshah/dataset。