Developing means to conduct shared evaluation in the user modelling, adaptation and personalization (UMAP) space is inherently difficult. Not least because of privacy concerns and individual differences in behaviours between users of systems. In this paper we propose a research-centre centred living labs approach as one potential way to overcome these difficulties and to allow for shared task g...