Advances in language modeling have led to the development of deep attention-based models that are performant across a wide variety natural processing (NLP) problems. These typified by pre-training process on large unlabeled text corpora and subsequently fine-tuned for specific tasks. Although considerable work has been devoted understanding attention mechanisms pre-trained models, it is less un...

Recently, a considerable number of studies in computer vision involve deep neural architectures called transformers. Visual processing these models incorporates computational that are claimed to implement attention mechanisms. Despite an increasing body work attempts understand the role mechanisms transformers, their effect is largely unknown. Here, we asked if transformers exhibit similar effe...

objective: the purpose of this study is to compare the executive functions children and adolescents who suffer from attention deficit hyperactivity disorder (adhd) with normal children. method: twenty children with adhd were compared to 19 healthy children terms of some executive functions using the computerized version of tower london, continuous performance test (cpt), and stroop color test. ...