We concluded Section MatArithmetic by showing how we can rewrite a system of linear equations as the matrix equation \(AX=B\) where \(A\) and \(B\) are known matrices and the solution matrix \(X\) of the equation corresponds to the solution of the system. In this section, we develop the method for solving such an equation. To that end, consider the system

\[ \left \{ \begin{array}{rcr} 2x-3y & = & 16 \\ 3x+4y & = & 7 \\ \end{array} \right .\]

To write this as a matrix equation, we follow the procedure outlined on page ??. We find the coefficient matrix \(A\), the unknowns matrix \(X\) and constant matrix \(B\) to be

\[ \begin{array}{ccc} A = \left [ \begin{array}{rr} 2 & -3 \\ 3 & 4 \\ \end{array} \right ] & X = \left [ \begin{array}{r} x \\ y \\ \end{array} \right ] & B = \left [ \begin{array}{r} 16 \\ 7 \\ \end{array} \right ] \end{array}\]

In order to motivate how we solve a matrix equation like \(AX = B\), we revisit solving a similar equation involving real numbers. For instance, to solve \(3x = 5\), we divide both sides by \(3\) and obtain \(x = \frac {5}{3}\). How can we go about defining an analogous process for matrices? To answer this question, we solve \(3x=5\) again, but this time, we pay attention to the properties of real numbers being used at each step. Recall that dividing by \(3\) is the same as multiplying by \(\frac {1}{3} = 3^{-1}\), the so-called multiplicative inverse of \(3\).

\[ \begin{array}{rclr} 3x & = & 5 \\ 3^{-1}(3x) & = & 3^{-1}(5) & \text {Multiply by the (multiplicative) inverse of $3$} \\ \left (3^{-1}\cdot 3\right ) x & = & 3^{-1}(5) & \text {Associative property of multiplication} \\ 1 \cdot x & = & 3^{-1}(5) & \text {Inverse property} \\ x & = & 3^{-1}(5) & \text {Multiplicative Identity} \\ \end{array} \]

If we wish to check our answer, we substitute \(x = 3^{-1}(5)\) into the original equation

\[ \begin{array}{rclr} 3x & \stackrel {?}{=} & 5 \\ 3\left ( 3^{-1}(5)\right ) & \stackrel {?}{=} & 5 \\ \left (3 \cdot 3^{-1}\right )(5) & \stackrel {?}{=} & 5 & \text {Associative property of multiplication} \\ 1 \cdot 5 & \stackrel {?}{=} & 5 & \text {Inverse property} \\ 5 & \stackrel {\checkmark }{=} & 5 & \text {Multiplicative Identity} \\ \end{array} \]

Thinking back to Theorem matrixmultprops, we know that matrix multiplication enjoys both an associative property and a multiplicative identity. What’s missing from the mix is a multiplicative inverse for the coefficient matrix \(A\). Assuming we can find such a beast, we can mimic our solution (and check) to \(3x=5\) as follows

\[ \begin{array}{cc} \text {Solving $AX = B$} & \text {Checking our answer} \\ \begin{array}{rcl} AX & = & B \\ A^{-1}(AX) & = & A^{-1}B \\ \left (A^{-1}A\right ) X & = & A^{-1}B \\ I_2X & = & A^{-1}B \\ X & = & A^{-1}B \\ \end{array} & \begin{array}{rcl} AX & \stackrel {?}{=} & B \\ A \left (A^{-1}B\right ) & \stackrel {?}{=} & B \\ \left (AA^{-1}\right ) B & \stackrel {?}{=}& B \\ I_2B & \stackrel {?}{=} & B \\ B & \stackrel {\checkmark }{=}& B \\ \end{array} \\ \end{array}\]

The matrix \(A^{-1}\) is read ‘\(A\)-inverse’ and we will define it formally later in the section. At this stage, we have no idea if such a matrix \(A^{-1}\) exists, but that won’t deter us from trying to find it.

We want \(A^{-1}\) to satisfy two equations, \(A^{-1}A = I_2\) and \(AA^{-1} = I_2\), making \(A^{-1}\) necessarily a \(2 \times 2\) matrix. Hence, \(A^{-1}\) has the form

\[ A^{-1} = \left [ \begin{array}{rr} x_1 & x_2 \\ x_3 & x_4 \\ \end{array} \right ]\]

for real numbers \(x_1\), \(x_2\), \(x_3\) and \(x_4\). For reasons which will become clear later, we focus our attention on the equation \(AA^{-1} = I_2\). We have

\[\begin{array}{rcl} AA^{-1} & = & I_{2} \\ \left [ \begin{array}{rr} 2 & -3 \\ 3 & 4 \\ \end{array} \right ] \left [ \begin{array}{rr} x_1 & x_2 \\ x_3 & x_4 \\ \end{array} \right ] & = & \left [ \begin{array}{rr} 1 & 0 \\ 0 & 1 \\ \end{array} \right ] \\ \left [ \begin{array}{rr} 2x_1 - 3x_3 & 2x_2 - 3x_4 \\ 3x_1 +4x_3 & 3x_2 +4x_4 \\ \end{array} \right ] & = & \left [ \begin{array}{rr} 1 & 0 \\ 0 & 1 \\ \end{array} \right ] \\ \end{array} \]

This gives rise to two more systems of equations

\[\begin{array}{cc} \left \{ \begin{array}{rcr} 2x_1-3x_3 & = & 1 \\ 3x_1+4x_3 & = & 0 \\ \end{array} \right . & \left \{ \begin{array}{rcr} 2x_2-3x_4 & = & 0 \\ 3x_2+4x_4 & = & 1 \\ \end{array} \right . \end{array}\]

At this point, it may seem absurd to continue with this venture. After all, the intent was to solve one system of equations, and in doing so, we have produced two more to solve. Remember, the objective of this discussion is to develop a general method which, when used in the correct scenarios, allows us to do far more than just solve a system of equations.

If we set about solving these systems using augmented matrices using the techniques in Section AugMatrices, we see that not only do both systems have the same coefficient matrix, this coefficient matrix is none other than the matrix \(A\) itself! (We will come back to this observation in a moment.)

\[ \begin{array}{ccc} \left \{ \begin{array}{rcr} 2x_1-3x_3 & = & 1 \\ 3x_1+4x_3 & = & 0 \\ \end{array} \right . & \xrightarrow {\text {Encode into a matrix}} & \left [ \begin{array}{rr|r} 2 & -3 & 1 \\ 3 & 4 & 0 \\ \end{array} \right ] \\ \left \{ \begin{array}{rcr} 2x_2-3x_4 & = & 0 \\ 3x_2+4x_4 & = & 1 \\ \end{array} \right . & \xrightarrow {\text {Encode into a matrix}} & \left [ \begin{array}{rr|r} 2 & -3 & 0 \\ 3 & 4 & 1 \\ \end{array} \right ] \\ \end{array} \]

To solve these two systems, we use Gauss-Jordan Elimination to put the augmented matrices into reduced row echelon form. (We leave the details to the reader.) For the first system, we get

\[ \begin{array}{ccc} \left [ \begin{array}{rr|r} 2 & -3 & 1 \\ 3 & 4 & 0 \\ \end{array} \right ] & \xrightarrow {\text {Gauss Jordan Elimination}} & \left [ \begin{array}{rr|r} 1 & 0 & \frac {4}{17} \\ 0 & 1 & -\frac {3}{17} \\ \end{array} \right ] \\ \end{array}\]

which gives \(x_1 = \frac {4}{17}\) and \(x_3 = -\frac {3}{17}\). To solve the second system, we use the exact same row operations, in the same order, and we obtain

\[ \begin{array}{ccc} \left [ \begin{array}{rr|r} 2 & -3 & 0 \\ 3 & 4 & 1 \\ \end{array} \right ] & \xrightarrow {\text {Gauss Jordan Elimination}} & \left [ \begin{array}{rr|r} 1 & 0 & \frac {3}{17} \\ 0 & 1 & \frac {2}{17} \\ \end{array} \right ] \\ \end{array}\]

which means \(x_2 = \frac {3}{17}\) and \(x_4 = \frac {2}{17}\). Hence,

\[ A^{-1} = \left [ \begin{array}{rr} x_1 & x_2 \\ x_3 & x_4 \\ \end{array} \right ] = \left [ \begin{array}{rr} \frac {4}{17} & \frac {3}{17} \\ -\frac {3}{17} & \frac {2}{17} \\ \end{array} \right ] \]

We can check to see that \(A^{-1}\) behaves as it should by computing \(AA^{-1}\)

\[ AA^{-1} = \left [ \begin{array}{rr} 2 & -3 \\ 3 & 4 \\ \end{array} \right ] \left [ \begin{array}{rr} \frac {4}{17} & \frac {3}{17} \\ -\frac {3}{17} & \frac {2}{17} \\ \end{array} \right ] = \left [ \begin{array}{rr} 1 & 0 \\ 0 & 1 \\ \end{array} \right ] = I_2 \, \, \checkmark \]

As an added bonus,

\[ A^{-1}A = \left [ \begin{array}{rr} \frac {4}{17} & \frac {3}{17} \\ -\frac {3}{17} & \frac {2}{17} \\ \end{array} \right ]\left [ \begin{array}{rr} 2 & -3 \\ 3 & 4 \\ \end{array} \right ] = \left [ \begin{array}{rr} 1 & 0 \\ 0 & 1 \\ \end{array} \right ] = I_2 \, \, \checkmark \]

We can now return to the problem at hand. From our discussion on page 1, we know

\[ X = A^{-1}B = \left [ \begin{array}{rr} \frac {4}{17} & \frac {3}{17} \\ -\frac {3}{17} & \frac {2}{17} \\ \end{array} \right ]\left [ \begin{array}{r} 16 \\ 7 \\ \end{array} \right ] = \left [ \begin{array}{r} 5 \\ -2 \\ \end{array} \right ] \]

so that our final solution to the system is \((x,y) = (5,-2)\).

As mentioned, the point of this exercise was not just to solve the system of linear equations, but to develop a general method for finding \(A^{-1}\). To that end, we analyze the foregoing discussion in a more general context. To find \(A^{-1}\), we used two augmented matrices, both containing the entries as \(A\):

\[ \begin{array}{rcl} \left [ \begin{array}{rr|r} 2 & -3 & 1 \\ 3 & 4 & 0 \end{array} \right ] = \left [ \begin{array}{c|c} {\large \textit {A}} & \begin{array}{r} 1\\ 0 \end{array} \end{array} \right ] \\ \left [ \begin{array}{rr|r} 2 & -3 & 0 \\ 3 & 4 & 1 \end{array} \right ] = \left [ \begin{array}{c|c} {\large \textit {A}} & \begin{array}{r} 0\\ 1 \end{array} \end{array} \right ] \end{array} \]

We also note that the reduced row echelon forms of these augmented matrices can be written as

\[ \begin{array}{rcl} \left [ \begin{array}{rr|r} 1 & 0 & \frac {4}{17} \\ 0 & 1 & -\frac {3}{17} \end{array} \right ] = \left [ \begin{array}{c|c} {\large \textit {A}} & \begin{array}{r} 1\\ 0 \end{array} \end{array} \right ] \\ \left [ \begin{array}{rr|r} 1 & 0 & \frac {3}{17} \\ 0 & 1 & \frac {2}{17} \end{array} \right ] = \left [ \begin{array}{c|c} {\large \textit {A}} & \begin{array}{r} 0\\ 1 \end{array} \end{array} \right ] \end{array} \]

where we have identified the entries to the left of the vertical bar as the identity \(I_2\) and the entries to the right of the vertical bar as the solutions to our systems. The long and short of the solution process can be summarized as

\[ \begin{array}{ccc} \left [ \begin{array}{c|c} {\large \textit {A}} & \begin{array}{r} 1\\ 0 \end{array} \end{array} \right ] & \xrightarrow {\text {Gauss Jordan Elimination}} & \left [ \begin{array}{c|c} \textit {I}_2 & \begin{array}{r} x_1\\ x_3 \end{array} \end{array} \right ] \\ \left [ \begin{array}{c|c} \textit {I}_2 & \begin{array}{r} 0\\ 1 \end{array} \end{array} \right ] & \xrightarrow {\text {Gauss Jordan Elimination}} & \left [ \begin{array}{c|c} \textit {I}_2 & \begin{array}{r} x_2\\ x_4 \end{array} \end{array} \right ] \end{array}\]

Since the row operations for both processes are the same, all of the arithmetic on the left hand side of the vertical bar is identical in both problems. The only difference between the two processes is what happens to the constants to the right of the vertical bar. As long as we keep these separated into columns, we can combine our efforts into one ‘super-sized’ augmented matrix and describe the above process as

\[ \begin{array}{ccc} \left [ \begin{array}{c|c} {\large \textit {A}} & \begin{array}{rr} 1 & 0\\ 0 & 1 \end{array} \end{array} \right ] & \xrightarrow {\text {Gauss Jordan Elimination}} & \left [ \begin{array}{c|c} \textit {I}_2 & \begin{array}{rr} x_1 & x_2\\ x_3 & x_4 \end{array} \end{array} \right ] \end{array}\]

We have the identity matrix \(I_2\) appearing as the right hand side of the first super-sized augmented matrix and the left hand side of the second super-sized augmented matrix. To our surprise and delight, the elements on the right hand side of the second super-sized augmented matrix are none other than those which comprise \(A^{-1}\). Hence, we have

\[ \begin{array}{ccc} \left [ \begin{array}{c|c} A & I_2 \end{array} \right ] & \xrightarrow {\text {Gauss Jordan Elimination}} & \left [ \begin{array}{c|c} I_2 & A^{-1} \end{array} \right ] \end{array}\]

In other words, the process of finding \(A^{-1}\) for a matrix \(A\) can be viewed as performing a series of row operations which transform \(A\) into the identity matrix of the same dimension. We can view this process as follows. In trying to find \(A^{-1}\), we are trying to ‘undo’ multiplication by the matrix \(A\). The identity matrix in the super-sized augmented matrix \([A | I]\) keeps a running memory of all of the moves required to ‘undo’ \(A\). This results in exactly what we want, \(A^{-1}\). We are now ready to formalize and generalize the foregoing discussion. We begin with the formal definition of an invertible matrix.

Note that, as a consequence of our definition, invertible matrices are square, and as such, the conditions in Definition matrixinverse force the matrix \(A^{-1}\) to be same dimensions as \(A\), that is, \(n \times n\). Since not all matrices are square, not all matrices are invertible. However, just because a matrix is square doesn’t guarantee it is invertible. (See the exercises.)

Our first result summarizes some of the important characteristics of invertible matrices and their inverses.

The proofs of the properties in Theorem inversematrixprops rely on a healthy mix of definition and matrix arithmetic.

To establish the first property, we assume that \(A\) is invertible and suppose the matrices \(B\) and \(C\) act as inverses for \(A\). That is, \(BA = AB = I_{n}\) and \(CA = AC = I_{n}\). We need to show that \(B\) and \(C\) are, in fact, the same matrix. To see this, we note that \(B = I_{n}B = (CA)B = C(AB) = CI_{n} = C\). Hence, any two matrices that act like \(A^{-1}\) are, in fact, the same matrix.

To prove the second property of Theorem inversematrixprops, we note that if \(A\) is invertible then the discussion on page 1 shows the solution to \(AX=B\) to be \(X = A^{-1}B\), and since \(A^{-1}\) is unique, so is \(A^{-1}B\).

Conversely, if \(AX = B\) has a unique solution for every \(n \times r\) matrix \(B\), then, in particular, there is a unique solution \(X_{0}\) to the equation \(AX = I_{n}\). The solution matrix \(X_{0}\) is our candidate for \(A^{-1}\). We have \(AX_{0} = I_{n}\) by definition, but we need to also show \(X_{0}A = I_{n}\). To that end, we note that \(A\left (X_{0}A\right ) = \left (AX_{0}\right )A = I_{n}A = A\). In other words, the matrix \(X_{0}A\) is a solution to the equation \(AX = A\). Clearly, \(X=I_{n}\) is also a solution to the equation \(AX = A\), and since we are assuming every such equation as a unique solution, we must have \(X_{0}A = I_{n}\). Hence, we have \(X_{0}A = AX_{0} = I_{n}\), so that \(X_{0} = A^{-1}\) and \(A\) is invertible.

The foregoing discussion justifies our quest to find \(A^{-1}\) using our super-sized augmented matrix approach

\[ \begin{array}{ccc} \left [ \begin{array}{c|c} A & I_{n} \\ \end{array} \right ] & \xrightarrow {\text {Gauss Jordan Elimination}} & \left [ \begin{array}{c|c} I_{n} & A^{-1} \\ \end{array} \right ] \end{array}\]

We are, in essence, trying to find the unique solution to the equation \(AX = I_{n}\) using row operations.

What does all of this mean for a system of linear equations? Theorem inversematrixprops tells us that if we write the system in the form \(AX=B\), then if the coefficient matrix \(A\) is invertible, there is only one solution to the system \(-\) that is, if \(A\) is invertible, the system is consistent and independent.

We also know that the process by which we find \(A^{-1}\) is determined completely by \(A\), and not by the constants in \(B\). This answers the question as to why we would bother doing row operations on a super-sized augmented matrix to find \(A^{-1}\) instead of an ordinary augmented matrix to solve a system; by finding \(A^{-1}\) we have done all of the row operations we ever need to do, once and for all, since we can quickly solve any equation \(AX = B\) using one multiplication, \(A^{-1}B\).

In Example matrixinverseex, we see that finding one inverse matrix can enable us to solve an entire family of systems of linear equations. There are many examples of where this comes in handy ‘in the wild’, and we chose our example for this section from the field of electronics. We also take this opportunity to introduce the student to how we can compute inverse matrices using the calculator.