In Exercises 1-4, find the equation \(y = {\beta _0} + {\beta _1}x\) of the least-square line that best fits the given data points.

  1. \(\left( {0,1} \right),\left( {1,1} \right),\left( {2,2} \right),\left( {3,2} \right)\)

Short Answer

Expert verified

The equation of the least-square line that best fits is \(y = 0.9 + 0.4x\).

Step by step solution

01

The design matrix X and observation vector y

Use the x and y coordinates to find the \(X\) and \(y\) matrices.

\(X = \left[ {\begin{aligned}1&0\\1&1\\1&2\\1&3\end{aligned}} \right]\) and \(y = \left[ {\begin{aligned}1\\1\\2\\2\end{aligned}} \right]\)

02

Obtain the normal equations 

The normal equation of \(X\beta = y\) can be obtained using \({X^T}X\beta = {X^T}y\) which is equivalent to \(\beta = {\left( {{X^T}X} \right)^{ - 1}}{X^T}y\).

Find \({X^T}X\) as follows:

\(\begin{aligned}{X^T}X &= \left[ {\begin{aligned}1&1&1&1\\0&1&2&3\end{aligned}} \right]\left[ {\begin{aligned}1&0\\1&1\\1&2\\1&3\end{aligned}} \right]\\ &= \left[ {\begin{aligned}{1 + 1 + 1 + 1}&{0 + 1 + 2 + 3}\\{0 + 1 + 2 + 3}&{0 + 1 + 4 + 9}\end{aligned}} \right]\\ &= \left[ {\begin{aligned}4&6\\6&{14}\end{aligned}} \right]\end{aligned}\)

Find the inverse of \({X^T}X\) as follows:

\(\begin{aligned}{\left( {{X^T}X} \right)^{ - 1}} &= {\left[ {\begin{aligned}4&6\\6&{14}\end{aligned}} \right]^{ - 1}}\\ &= \frac{1}{{56 - 36}}\left[ {\begin{aligned}{*{20}{c}}{14}&{ - 6}\\{ - 6}&4\end{aligned}} \right]\\ &= \frac{1}{{20}}\left[ {\begin{aligned}{14}&{ - 6}\\{ - 6}&4\end{aligned}} \right]\end{aligned}\)

Find \({X^T}y\) as follows:

\(\begin{aligned}{X^T}y &= \left[ {\begin{aligned}1&1&1&1\\0&1&2&3\end{aligned}} \right]\left[ {\begin{aligned}1\\1\\2\\2\end{aligned}} \right]\\ &= \left[ {\begin{aligned}{1 + 1 + 2 + 2}\\{0 + 1 + 4 + 6}\end{aligned}} \right]\\ &= \left[ {\begin{aligned}6\\{11}\end{aligned}} \right]\end{aligned}\)

03

Solve the normal equation

Substitute the calculated values in \(\beta = {\left( {{X^T}X} \right)^{ - 1}}{X^T}y\) and solve it as follows:

\(\begin{aligned}\beta &= {\left( {{X^T}X} \right)^{ - 1}}{X^T}y\\\beta &= \frac{1}{{20}}\left[ {\begin{aligned}{14}&{ - 6}\\{ - 6}&4\end{aligned}} \right]\left[ {\begin{aligned}6\\{11}\end{aligned}} \right]\\\beta &= \frac{1}{{20}}\left[ {\begin{aligned}{84 - 66}\\{ - 36 + 44}\end{aligned}} \right]\\\beta &= \frac{1}{{20}}\left[ {\begin{aligned}{18}\\8\end{aligned}} \right]\\\left[ {\begin{aligned}{{\beta _0}}\\{{\beta _1}}\end{aligned}} \right] &= \left[ {\begin{aligned}{0.9}\\{0.4}\end{aligned}} \right]\end{aligned}\)

Hence, the equation of the least-square line that best fits is \(y = 0.9 + 0.4x\).

Unlock Step-by-Step Solutions & Ace Your Exams!

  • Full Textbook Solutions

    Get detailed explanations and key concepts

  • Unlimited Al creation

    Al flashcards, explanations, exams and more...

  • Ads-free access

    To over 500 millions flashcards

  • Money-back guarantee

    We refund you if you fail your exam.

Over 30 million students worldwide already upgrade their learning with Vaia!

One App. One Place for Learning.

All the tools & learning materials you need for study success - in one app.

Get started for free

Most popular questions from this chapter

Let \(\left\{ {{{\bf{v}}_1}, \ldots ,{{\bf{v}}_p}} \right\}\) be an orthonormal set in \({\mathbb{R}^n}\). Verify the following inequality, called Bessel’s inequality, which is true for each x in \({\mathbb{R}^n}\):

\({\left\| {\bf{x}} \right\|^2} \ge {\left| {{\bf{x}} \cdot {{\bf{v}}_1}} \right|^2} + {\left| {{\bf{x}} \cdot {{\bf{v}}_2}} \right|^2} + \ldots + {\left| {{\bf{x}} \cdot {{\bf{v}}_p}} \right|^2}\)

In Exercises 7–10, let\[W\]be the subspace spanned by the\[{\bf{u}}\]’s, and write y as the sum of a vector in\[W\]and a vector orthogonal to\[W\].

8.\[y = \left[ {\begin{aligned}{ - 1}\\4\\3\end{aligned}} \right]\],\[{{\bf{u}}_1} = \left[ {\begin{aligned}1\\1\\{\bf{1}}\end{aligned}} \right]\],\[{{\bf{u}}_2} = \left[ {\begin{aligned}{ - 1}\\3\\{ - 2}\end{aligned}} \right]\]

In Exercises 1-4, find the equation \(y = {\beta _0} + {\beta _1}x\) of the least-square line that best fits the given data points.

4. \(\left( {2,3} \right),\left( {3,2} \right),\left( {5,1} \right),\left( {6,0} \right)\)

In Exercises 17 and 18, all vectors and subspaces are in \({\mathbb{R}^n}\). Mark each statement True or False. Justify each answer.

a. If \(W = {\rm{span}}\left\{ {{x_1},{x_2},{x_3}} \right\}\) with \({x_1},{x_2},{x_3}\) linearly independent,

and if \(\left\{ {{v_1},{v_2},{v_3}} \right\}\) is an orthogonal set in \(W\) , then \(\left\{ {{v_1},{v_2},{v_3}} \right\}\) is a basis for \(W\) .

b. If \(x\) is not in a subspace \(W\) , then \(x - {\rm{pro}}{{\rm{j}}_W}x\) is not zero.

c. In a \(QR\) factorization, say \(A = QR\) (when \(A\) has linearly

independent columns), the columns of \(Q\) form an

orthonormal basis for the column space of \(A\).

Suppose \(A = QR\), where \(Q\) is \(m \times n\) and R is \(n \times n\). Showthat if the columns of \(A\) are linearly independent, then \(R\) mustbe invertible.

See all solutions

Recommended explanations on Math Textbooks

View all explanations

What do you think about this solution?

We value your feedback to improve our textbook solutions.

Study anywhere. Anytime. Across all devices.

Sign-up for free