From
A First Course in Linear Algebra
Version 2.30
© 2004.
Licensed under the
GNU Free Documentation License.
http://linear.ups.edu/
In this section we specialize to systems of linear equations where every equation has a zero as its constant term. Along the way, we will begin to express more and more ideas in the language of matrices and begin a move away from writing out whole systems of equations. The ideas initiated in this section will carry through the remainder of the course.
As usual, we begin with a definition.
Definition
HS
Homogeneous System
A system of linear equations,
is
homogeneous if the vector of constants is the zero vector, in other words,
.
Example
AHSAC
Archetype C as a homogeneous system
For each archetype that is a system of equations, we have formulated a similar, yet different, homogeneous system of equations by replacing each equation’s constant term with a zero. To wit, for
Archetype C, we can convert the original system of equations into the homogeneous system,
Can you quickly find a solution to this system without row-reducing the augmented matrix?
As you might have discovered by studying Example AHSAC, setting each variable to zero will always be a solution of a homogeneous system. This is the substance of the following theorem.
Theorem
HSC
Homogeneous Systems are Consistent
Suppose that a system of linear equations is homogeneous. Then the system is consistent.
Proof Set each variable of the system to zero. When substituting these values into each equation, the left-hand side evaluates to zero, no matter what the coefficients are. Since a homogeneous system has zero on the right-hand side of each equation as the constant term, each equation is true. With one demonstrated solution, we can call the system consistent.
Since this solution is so obvious, we now define it as the trivial solution.
Definition
TSHSE
Trivial Solution to Homogeneous Systems of Equations
Suppose a homogeneous system of linear equations has
variables. The solution
,
,…,
(i.e.
) is called the
trivial solution.
Here are three typical examples, which we will reference throughout this section. Work through the row operations as we bring each to reduced row-echelon form. Also notice what is similar in each example, and what differs.
Example
HUSAB
Homogeneous, unique solution, Archetype B
Archetype B can be converted to the homogeneous system,
whose augmented matrix row-reduces to
|
|
By Theorem HSC, the system is consistent, and so the computation means the solution set contains just a single solution. Then, this lone solution must be the trivial solution.
Example
HISAA
Homogeneous, infinite solutions, Archetype A
Archetype A can be converted to the homogeneous system,
whose augmented matrix row-reduces to
|
|
By Theorem HSC, the system is consistent, and so the computation means the solution set contains one free variable by Theorem FVCS, and hence has infinitely many solutions. We can describe this solution set using the free variable ,
|
|
Geometrically, these are points in three dimensions that lie on a line through the origin.
Example
HISAD
Homogeneous, infinite solutions, Archetype D
Archetype D (and identically,
Archetype E) can be converted to the homogeneous system,
whose augmented matrix row-reduces to
|
|
By Theorem HSC, the system is consistent, and so the computation means the solution set contains two free variables by Theorem FVCS, and hence has infinitely many solutions. We can describe this solution set using the free variables and ,
After working through these examples, you might perform the same computations for the slightly larger example, Archetype J.
Notice that when we do row operations on the augmented matrix of a homogeneous system of linear equations the last column of the matrix is all zeros. Any one of the three allowable row operations will convert zeros to zeros and thus, the final column of the matrix in reduced row-echelon form will also be all zeros. So in this case, we may be as likely to reference only the coefficient matrix and presume that we remember that the final column begins with zeros, and after any number of row operations is still zero.
Example HISAD suggests the following theorem.
Theorem
HMVEI
Homogeneous, More Variables than Equations, Infinite solutions
Suppose that a homogeneous system of linear equations has
equations and
variables with
. Then the system has infinitely many solutions.
Proof We are assuming the system is homogeneous, so Theorem HSC says it is consistent. Then the hypothesis that , together with Theorem CMVEI, gives infinitely many solutions.
Example HUSAB and Example HISAA are concerned with homogeneous systems where and expose a fundamental distinction between the two examples. One has a unique solution, while the other has infinitely many. These are exactly the only two possibilities for a homogeneous system and illustrate that each is possible (unlike the case when where Theorem HMVEI tells us that there is only one possibility for a homogeneous system).
The set of solutions to a homogeneous system (which by Theorem HSC is never empty) is of enough interest to warrant its own name. However, we define it as a property of the coefficient matrix, not as a property of some system of equations.
Definition
NSM
Null Space of a Matrix
The
null space of a matrix
, denoted
, is the set of all the vectors that are solutions to the homogeneous system
.
(This definition contains Notation NSM.)
In the Archetypes ( Appendix A) each example that is a system of equations also has a corresponding homogeneous system of equations listed, and several sample solutions are given. These solutions will be elements of the null space of the coefficient matrix. We’ll look at one example.
Example
NSEAI
Null space elements of Archetype I
The write-up for
Archetype I lists several solutions of the corresponding homogeneous system. Here are two, written as solution vectors. We can say that they are in the null space of the coefficient matrix for the system of equations in
Archetype I.
However, the vector
|
|
is not in the null space, since it is not a solution to the homogeneous system. For example, it fails to even make the first equation true.
Here are two (prototypical) examples of the computation of the null space of a matrix.
Example
CNS1
Computing a null space, #1
Let’s compute the null space of
|
|
which we write as . Translating Definition NSM, we simply desire to solve the homogeneous system . So we row-reduce the augmented matrix to obtain
|
|
The variables (of the homogeneous system) and are free (since columns 1, 2 and 4 are pivot columns), so we arrange the equations represented by the matrix in reduced row-echelon form to
So we can write the infinite solution set as sets using column vectors,
|
|
Example
CNS2
Computing a null space, #2
Let’s compute the null space of
|
|
which we write as . Translating Definition NSM, we simply desire to solve the homogeneous system . So we row-reduce the augmented matrix to obtain
|
|
There are no free variables in the homogeneous system represented by the row-reduced matrix, so there is only the trivial solution, the zero vector, . So we can write the (trivial) solution set as
|
|
C10 Each Archetype (
Appendix A) that is a system of equations has a corresponding homogeneous system with the same coefficient matrix. Compute the set of solutions for each. Notice that these solution sets are the null spaces of the coefficient matrices.
Archetype A
Archetype B
Archetype C
Archetype D/
Archetype E
Archetype F
Archetype G/
Archetype H
Archetype I
and
Archetype J
Contributed by
Robert Beezer
C20
Archetype K and
Archetype L are simply
matrices (i.e. they are not systems of equations). Compute the null space of each matrix.
Contributed by
Robert Beezer
For Exercises C21-C23, solve the given homogeneous linear system. Compare your results to the results of the corresponding exercise in Section TSS.
C21
Contributed by
Chris Black
Solution [
208]
C22
Contributed by
Chris Black
Solution [
209]
C23
Contributed by
Chris Black
Solution [
210]
For Exercises C25-C27, solve the given homogeneous linear system. Compare your results to the results of the corresponding exercise in Section TSS.
C25
Contributed by
Chris Black
Solution [
211]
C26
Contributed by
Chris Black
Solution [
211]
C27
Contributed by
Chris Black
Solution [
212]
C30 Compute the null space of the matrix , .
|
|
Contributed by
Robert Beezer
Solution [
213]
C31 Find the null space of the matrix , .
Contributed by
Robert Beezer
Solution [
215]
M45 Without doing any computations, and without examining any solutions, say as much as possible about the form of the solution set for corresponding homogeneous system of equations of each archetype that is a system of equations.
Archetype A
Archetype B
Archetype C
Archetype D/
Archetype E
Archetype F
Archetype G/
Archetype H
Archetype I
Archetype J
Contributed by
Robert Beezer
For Exercises M50–M52 say
as much as possible about each system’s solution set. Be sure to make it clear which theorems you are using to reach your conclusions.
M50 A homogeneous system of 8 equations in 8 variables.
Contributed by
Robert Beezer
Solution [
216]
M51 A homogeneous system of 8 equations in 9 variables.
Contributed by
Robert Beezer
Solution [
216]
M52 A homogeneous system of 8 equations in 7 variables.
Contributed by
Robert Beezer
Solution [
216]
T10 Prove or disprove: A system of linear equations is homogeneous if and only if the system has the zero vector as a solution.
Contributed by
Martin Jackson
Solution [
216]
T12 Give an alternate proof of Theorem HSC that uses Theorem RCLS.
Contributed by
Ivan Kessler
T20 Consider the homogeneous system of linear equations
, and suppose that
is one solution to the system of equations. Prove that
is also a solution to
.
Contributed by
Robert Beezer
Solution [
217]
C21 Contributed by
Chris Black
Statement [
201]
The augmented matrix for the given linear system and its row-reduced form are:
Thus, we see that the system is consistent (as predicted by Theorem HSC) and has an infinite number of solutions (as predicted by Theorem HMVEI). With suitable choices of and , each solution can be written as
C22 Contributed by
Chris Black
Statement [
202]
The augmented matrix for the given linear system and its row-reduced form are:
Thus, we see that the system is consistent (as predicted by Theorem HSC) and has an infinite number of solutions (as predicted by Theorem HMVEI). With a suitable choice of , each solution can be written as
C23 Contributed by
Chris Black
Statement [
202]
The augmented matrix for the given linear system and its row-reduced form are:
Thus, we see that the system is consistent (as predicted by Theorem HSC) and has an infinite number of solutions (as predicted by Theorem HMVEI). With suitable choices of and , each solution can be written as
C25 Contributed by
Chris Black
Statement [
203]
The augmented matrix for the given linear system and its row-reduced form are:
An homogeneous system is always consistent ( Theorem HSC) and with an application of Theorem FVCS yields zero free variables. Thus the only solution to the given system is the trivial solution, .
C26 Contributed by
Chris Black
Statement [
203]
The augmented matrix for the given linear system and its row-reduced form are:
An homogeneous system is always consistent ( Theorem HSC) and with an application of Theorem FVCS yields zero free variables. Thus the only solution to the given system is the trivial solution, .
C27 Contributed by
Chris Black
Statement [
204]
The augmented matrix for the given linear system and its row-reduced form are:
An homogeneous system is always consistent ( Theorem HSC) and with , an application of Theorem FVCS yields one free variable. With a suitable choice of each solution can be written in the form
C30 Contributed by
Robert Beezer
Statement [
205]
Definition NSM tells us that the null space of
is the solution set to the homogeneous system
. The augmented matrix of this system is
|
|
To solve the system, we row-reduce the augmented matrix and obtain,
|
|
This matrix represents a system with equations having three dependent variables ( , , and ) and two independent variables ( and ). These equations rearrange to
So we can write the solution set (which is the requested null space) as
|
|
C31 Contributed by
Robert Beezer
Statement [
205]
We form the augmented matrix of the homogeneous system
and row-reduce the matrix,
We knew ahead of time that this system would be consistent ( Theorem HSC), but we can now see there are free variables, namely and (Theorem FVCS). Based on this analysis, we can rearrange the equations associated with each nonzero row of the reduced row-echelon form into an expression for the lone dependent variable as a function of the free variables. We arrive at the solution set to the homogeneous system, which is the null space of the matrix by Definition NSM,
M50 Contributed by
Robert Beezer
Statement [
206]
Since the system is homogeneous, we know it has the trivial solution (
Theorem HSC). We cannot say anymore based on the information provided, except to say that there is either a unique solution or infinitely many solutions (Theorem PSSLS). See
Archetype A and
Archetype B to understand the possibilities.
M51 Contributed by
Robert Beezer
Statement [
206]
Since there are more variables than equations,
Theorem HMVEI applies and tells us that the solution set is infinite. From the proof of
Theorem HSC we know that the zero vector is one solution.
M52 Contributed by
Robert Beezer
Statement [
206]
By
Theorem HSC, we know the system is consistent because the zero vector is always a solution of a homogeneous system. There is no more that we can say, since both a unique solution and infinitely many solutions are possibilities.
T10 Contributed by
Robert Beezer
Statement [
206]
This is a true statement. A proof is:
( ) Suppose we have a homogeneous system . Then by substituting the scalar zero for each variable, we arrive at true statements for each equation. So the zero vector is a solution. This is the content of Theorem HSC.
( ) Suppose now that we have a generic (i.e. not necessarily homogeneous) system of equations, that has the zero vector as a solution. Upon substituting this solution into the system, we discover that each component of must also be zero. So .
T20 Contributed by
Robert Beezer
Statement [
206]
Suppose that a single equation from this system (the
-th one) has the form,
|
|
Evaluate the left-hand side of this equation with the components of the proposed solution vector ,
So makes each equation true, and so is a solution to the system.
Notice that this result is not true if we change from a homogeneous system to a non-homogeneous system. Can you create an example of a (non-homogeneous) system with a solution such that is not a solution?