Newton-type Method for the Orthonormal INDSCAL Problem in Metric Multidimensional Scaling

Read the full article See related articles

Discuss this preprint

Start a discussion What are Sciety discussions?

Listed in

This article is not in any list yet, why not save it to one of your lists.
Log in to save this article

Abstract

The orthonormal individual differences scaling (O-INDSCAL) model is a fundamental tool for metric multidimensional scaling of multiple doubly centered dissimilarity matrices, but efficient algorithms remain scarce when orthonormality and nonnegativity constraints are imposed in medium- to large-scale settings. In this work, we revisit O-INDSCAL from a Riemannian optimization perspective and make two main contributions. First, starting from explicit closed-form expressions of the Riemannian gradient and Hessian, we represent the Hessian as a Kronecker-product-based linear operator on the tangent space and reformulate the Riemannian Newton equation as a symmetric linear system whose dimension coincides with that of the underlying product manifold. This dimension-reduced formulation enables the use of Krylov subspace methods and substantially lowers the per-iteration cost of Newton steps while preserving second-order accuracy. Second, we design a hybrid algorithm that couples a globally convergent Riemannian curvilinear search with Barzilai--Borwein step sizes and a locally quadratically convergent Riemannian Newton refinement, thereby combining robust globalization with fast local convergence. Extensive numerical experiments on synthetic and real O-INDSCAL benchmarks show that the proposed method attains high-accuracy solutions and compares favorably with projected gradient flows, ALS/MPE-type schemes, and generic Manopt-based Riemannian solvers in terms of both efficiency and reliability. MATLAB implementations of all methods used in the numerical experiments are available at Hybrid Newton for OINDSCAL MATLAB Codes.

Article activity feed