An extended Newton-type algorithm for <mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML" display="inline" id="d1e2442" altimg="si3.svg"><mml:msub><mml:mrow><mml:mi>?</mml:mi></mml:mrow><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msub></mml:math>-regularized sparse logistic regression and its efficiency for classifying large-scale datasets
نویسندگان
چکیده
Sparse logistic regression, as an effective tool of classification, has been developed tremendously in recent two decades, from its origination the $\ell_1$-regularized version to sparsity constrained models. This paper is carried out on regression by Newton method. We begin with establishing first-order optimality condition associated a $\tau$-stationary point. point can be equivalently interpreted system equations which then efficiently solved The method considerably low computational complexity and enjoys global quadratic convergence properties. Numerical experiments random real data demonstrate superior performance when against seven state-of-the-art solvers.
منابع مشابه
Distributed Newton Method for Regularized Logistic Regression
Regularized logistic regression is a very successful classification method, but for large-scale data, its distributed training has not been investigated much. In this work, we propose a distributed Newton method for training logistic regression. Many interesting techniques are discussed for reducing the communication cost. Experiments show that the proposed method is faster than state of the ar...
متن کاملDistributed Newton Methods for Regularized Logistic Regression
Regularized logistic regression is a very useful classification method, but for large-scale data, its distributed training has not been investigated much. In this work, we propose a distributed Newton method for training logistic regression. Many interesting techniques are discussed for reducing the communication cost and speeding up the computation. Experiments show that the proposed method is...
متن کاملA Method for Large-Scale l1-Regularized Logistic Regression
Logistic regression with l1 regularization has been proposed as a promising method for feature selection in classification problems. Several specialized solution methods have been proposed for l1-regularized logistic regression problems (LRPs). However, existing methods do not scale well to large problems that arise in many practical settings. In this paper we describe an efficient interior-poi...
متن کاملA Method for Large-Scale 1-Regularized Logistic Regression
Logistic regression with 1 regularization has been proposed as a promising method for feature selection in classification problems. Several specialized solution methods have been proposed for 1-regularized logistic regression problems (LRPs). However, existing methods do not scale well to large problems that arise in many practical settings. In this paper we describe an efficient interior-point...
متن کاملTrust Region Newton Method for Large-Scale Logistic Regression
Large-scale logistic regression arises in many applications such as document classification and natural language processing. In this paper, we apply a trust region Newton method to maximize the log-likelihood of the logistic regression model. The proposed method uses only approximate Newton steps in the beginning, but achieves fast convergence in the end. Experiments show that it is faster than...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Journal of Computational and Applied Mathematics
سال: 2021
ISSN: ['0377-0427', '1879-1778', '0771-050X']
DOI: https://doi.org/10.1016/j.cam.2021.113656