Online learning has witnessed an increasing interest over the recent past due to its low computational requirements and relevance a broad range of streaming applications. In this brief, we focus on online regularized regression. We propose novel efficient regression algorithm, called normalized least-squares (ONLS). perform theoretical analysis by comparing total loss ONLS against gradient desc...