Use this resource - and many more! - in *your* textbook!

AcademicPub holds over eight million pieces of educational content for you to mix-and-match *your* way.

**Not an educator**but still interested in using this content? No problem! Visit our provider's page to contact the publisher and get permission directly.

# Multivariate Multilinear Regression

## By: Dacheng Tao; Xuelong Li; Xinbo Gao; Ya Su;

2012 / IEEE

### Description

This item was taken from the IEEE Periodical ' Multivariate Multilinear Regression ' Conventional regression methods, such as multivariate linear regression (MLR) and its extension principal component regression (PCR), deal well with the situations that the data are of the form of low-dimensional vector. When the dimension grows higher, it leads to the under sample problem (USP): the dimensionality of the feature space is much higher than the number of training samples. However, little attention has been paid to such a problem. This paper first adopts an in-depth investigation to the USP in PCR, which answers three questions: 1) Why is USP produced? 2) What is the condition for USP, and 3) How is the influence of USP on regression. With the help of the above analysis, the principal components selection problem of PCR is presented. Subsequently, to address the problem of PCR, a multivariate multilinear regression (MMR) model is proposed which gives a substitutive solution to MLR, under the condition of multilinear objects. The basic idea of MMR is to transfer the multilinear structure of objects into the regression coefficients as a constraint. As a result, the regression problem is reduced to find two low-dimensional coefficients so that the principal components selection problem is avoided. Moreover, the sample size needed for solving MMR is greatly reduced so that USP is alleviated. As there is no closed-form solution for MMR, an alternative projection procedure is designed to obtain the regression matrices. For the sake of completeness, the analysis of computational cost and the proof of convergence are studied subsequently. Furthermore, MMR is applied to model the fitting procedure in the active appearance model (AAM). Experiments are conducted on both the carefully designed synthesizing data set and AAM fitting databases verified the theoretical analysis.

**Related Topics**

General Topics For Engineers

Robotics And Control Systems

Power, Energy And Industry Applications

Visual Databases

Curve Fitting

Image Sampling

Principal Component Analysis

Regression Analysis

Aam Fitting Databases

Multivariate Multilinear Regression

Mlr

Principal Component Regression

Pcr

Under Sample Problem

Usp

Feature Space Dimensionality

Principal Component Selection Problem

Multivariate Linear Regression

Multilinear Objects

Regression Coefficients

Low-dimensional Coefficients

Alternative Projection Procedure

Regression Matrices

Convergence Proof

Fitting Procedure Model

Active Appearance Model

Training

Noise

Active Appearance Model

Computational Modeling

Linear Regression

Under Sample Problem (usp)

Active Appearance Model (aam)

Multivariate Linear Regression (mlr)

Principal Component Regression (pcr)

Computing And Processing

Components, Circuits, Devices And Systems

Communication, Networking And Broadcast Technologies

Signal Processing And Analysis

Engineering

Low-dimensional Vector