Abstract In this paper, we extend Open-set Semantic Segmentation (OSS) into a new image segmentation task called Generalized (GOSS). Previously, with well-known OSS, the intelligent agents only detect unknown regions without further processing, limiting their perception capacity of environment. It stands to reason that analysis detected pixels would be beneficial for agents’ decision-making. Th...