Recently, several studies have proposed methods to utilize some classes of optimization problems in designing deep neural networks encode constraints that conventional layers cannot capture. However, these are still their infancy and require special treatments, such as the analysis Karush–Kuhn–Tucker (KKT) condition, derive backpropagation formula. In this paper, we propose a new formulation ca...