It is an open question what semantic representations transformer-based language models can encode and whether they have access to more abstract aspects of meaning. Here, we propose a diagnostic dataset investigate how well understand the degree semantics adjectives. In dataset, referred as Adjective Scale Probe (ASP), semi-automatically generate 8 tests Natural Language Inference (NLI) question...