By: Neil E. Cotter

Regression

 

 

Multiple regression

 

 

Example 1

 

 

 

 
 
 

 

Ex:            Find a multiple regression (i.e., hyperplane fit) to the following data:

            (3, 4, 27)      (5, 5, 15)      (2, 6, 23)      (1, 3, 9)        (4, 2, 1)

Sol'n:       The hyperplane is defined as follows:

We write matrix terms for the data and hyperplane fit:

                

The matrix equation for the data and hyperplane fit are as follows:

A pseudoinverse of X yields the least-squares solution:

where

Not'n:      XTX transpose

 

Plugging the (x1x2) coordinates into the hyperplane equation yields the following estimated y values:

or

The errors are found by subtracting y values from estimated y values:

Note:       The errors sum to zero, but this is not always the case.

In the plot, below, the estimates are shown as circles: