On orthogonal tensors and best rank-one approximation ratio
نویسندگان
چکیده
As is well known, the smallest possible ratio between the spectral norm and the Frobenius norm of an m× n matrix with m ≤ n is 1/ √ m and is (up to scalar scaling) attained only by matrices having pairwise orthonormal rows. In the present paper, the smallest possible ratio between spectral and Frobenius norms of n1×· · ·×nd tensors of order d, also called the best rank-one approximation ratio in the literature, is investigated. The exact value is not known for most configurations of n1 ≤ · · · ≤ nd. Using a natural definition of orthogonal tensors over the real field (resp., unitary tensors over the complex field), it is shown that the obvious lower bound 1/ √ n1 · · ·nd−1 is attained if and only if a tensor is orthogonal (resp., unitary) up to scaling. Whether or not orthogonal or unitary tensors exist depends on the dimensions n1, . . . , nd and the field. A connection between the (non)existence of real orthogonal tensors of order three and the classical Hurwitz problem on composition algebras can be established: existence of orthogonal tensors of size `×m×n is equivalent to the admissibility of the triple [`,m, n] to the Hurwitz problem. Some implications for higher-order tensors are then given. For instance, real orthogonal n×· · ·×n tensors of order d ≥ 3 do exist, but only when n = 1, 2, 4, 8. In the complex case, the situation is more drastic: unitary tensors of size ` × m × n with ` ≤ m ≤ n exist only when `m ≤ n. Finally, some numerical illustrations for spectral norm computation are presented.
منابع مشابه
Orthogonal Rank-two Tensor Approximation: a Modified High-order Power Method and Its Convergence Analysis
With the notable exceptions that tensors of order 2, that is, matrices always have best approximations of arbitrary low ranks and that tensors of any order always have the best rank-one approximation, it is known that high-order tensors can fail to have best low rank approximations. When the condition of orthogonality is imposed, even at the most general case that only one pair of components in...
متن کاملOrthogonal Low Rank Tensor Approximation: Alternating Least Squares Method and Its Global Convergence
With the notable exceptions of two cases — that tensors of order 2, namely, matrices, always have best approximations of arbitrary low ranks and that tensors of any order always have the best rank-one approximation, it is known that high-order tensors may fail to have best low rank approximations. When the condition of orthogonality is imposed, even under the modest assumption that only one set...
متن کاملOn the Tensor Svd and Optimal Low Rank Orthogonal Approximations of Tensors
Abstract. It is known that a high order tensor does not necessarily have an optimal low rank approximation, and that a tensor might not be orthogonally decomposable (i.e., admit a tensor SVD). We provide several sufficient conditions which lead to the failure of the tensor SVD, and characterize the existence of the tensor SVD with respect to the Higher Order SVD (HOSVD) of a tensor. In face of ...
متن کاملBest Rank-One Tensor Approximation and Parallel Update Algorithm for CPD
A novel algorithm is proposed for CANDECOMP/PARAFAC tensor decomposition to exploit best rank-1 tensor approximation. Different from the existing algorithms, our algorithm updates rank-1 tensors simultaneously in-parallel. In order to achieve this, we develop new all-at-once algorithms for best rank-1 tensor approximation based on the Levenberg-Marquardt method and the rotational update. We sho...
متن کاملOn the Best Rank-1 and Rank-(R1 , R2, ... , RN) Approximation of Higher-Order Tensors
In this paper we discuss a multilinear generalization of the best rank-R approximation problem for matrices, namely, the approximation of a given higher-order tensor, in an optimal leastsquares sense, by a tensor that has prespecified column rank value, row rank value, etc. For matrices, the solution is conceptually obtained by truncation of the singular value decomposition (SVD); however, this...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- CoRR
دوره abs/1707.02569 شماره
صفحات -
تاریخ انتشار 2017