(24 intermediate revisions by 3 users not shown)
Line 1: Line 1:
&nbsp;<u>'''Linear Dependence'''</u>  
+
[[Category:MA265Fall2011Walther]]
 +
[[Category:bonus point project]]
 +
[[Category:MA265]]
 +
[[Category:linear algebra]]
 +
[[Category:math]]
 +
 
 +
<center><font size= 4>
 +
'''Linear Dependence'''
 +
</font size>
 +
 
 +
Student project for [[MA265]]
 +
</center>
 +
----
 +
----
 +
 
 +
== '''''Definition'''''  ==
 +
 
 +
----
  
 
<br>  
 
<br>  
  
'''Definition'''  
+
== <br> The vectors <span class="texhtml">''v''<sub>1</sub>,''v''<sub>2</sub>,...,''v''<sub>''k''</sub>''&nbsp;''</span>in a vector space <span class="texhtml">''V''</span>&nbsp;are said to be linearly dependent if there exist constans&nbsp;<span class="texhtml">''a''<sub>1</sub>,''a''<sub>2</sub><sub></sub>,...,''a''<sub>''k''</sub></span> not all zero, such that<br>  ==
  
The vectors <span class="texhtml">''v''<sub>1</sub>,''v''<sub>2</sub>,...,''v''<sub>''k''</sub>''&nbsp;''</span>in a vector space <span class="texhtml">''V''</span>&nbsp;are said to be linearly dependent if there exist constans&nbsp;<span class="texhtml">''a''<sub>1</sub>,''a''<sub>2</sub><sub></sub>,...,''a''<sub>''k''</sub></span> not all zero, such that<br>  
+
&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;<math>\sum_{j=1}^k a_1v_1+a_2v_2+...+a_kv_k=0</math>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;'''(1)''' &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;<br>  
  
(1)
+
== Otherwise, <span class="texhtml">''v''<sub>1</sub>,''v''<sub>2</sub>,...,''v''<sub>''k''</sub></span>&nbsp;are called linearly independent. That is&nbsp;<span class="texhtml">''v''<sub>1</sub>,''v''<sub>2</sub>,...,''v''<sub>''k''</sub></span>&nbsp;are linearly independent if, whenever <span class="texhtml">''a''<sub>1</sub>''v''<sub>1</sub>+ ''a''<sub>2</sub>''v''<sub>2</sub>+...+''a''<sub>''k''</sub>''v''<sub>''k''</sub>=0</span>  ==
  
 
<br>  
 
<br>  
  
Otherwise, <span class="texhtml">''v''<sub>1</sub>,''v''<sub>2</sub>,...,''v''<sub>''k''</sub></span>&nbsp;are called linearly independent. That is&nbsp;<span class="texhtml">''v''<sub>1</sub>,''v''<sub>2</sub>,...,''v''<sub>''k''</sub></span>&nbsp;are linearly independent if, whenever <span class="texhtml">''a''<sub>1</sub>''v''<sub>1</sub>+ ''a''<sub>2</sub>''v''<sub>2</sub>+...+''a''<sub>''k''</sub>''v''<sub>''k''</sub>=0</span>  
+
== &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;<span class="texhtml">''a''<sub>1</sub>= ''a''<sub>2</sub>=...=''a''<sub>''k''</sub>=0</span> ==
  
 
<br>  
 
<br>  
  
&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;<span class="texhtml">''a''<sub>1</sub>= ''a''<sub>2</sub>=...=''a''<sub>''k''</sub>=0</span>  
+
<br>
 +
 
 +
== If <span class="texhtml">''S'' = {''v''<sub>1</sub>,''v''<sub>2</sub>,...,''v''<sub>''k''</sub>''}''</span>&nbsp;,then we also say that the set <span class="texhtml">''S''</span>&nbsp;is linearly dependent or linearly independent if the vectors have the corresponding property.  ==
  
 
<br>  
 
<br>  
 +
 +
== &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;It should be emphasized that for any vectors <span class="texhtml">''v''<sub>1</sub>,''v''<sub>2</sub>,...,''v''<sub>''k''</sub></span>, Equation (1) always holds if we choose all the scalars <span class="texhtml">''a''<sub>1</sub>,''a''<sub>2</sub>,...,''a''<sub>''k''</sub></span>, equal to zero. The important point in this definition is whether it is possible to satisfy (1) with at least one of the scalars different from zero.  ==
  
 
<br>  
 
<br>  
  
If <span class="texhtml">''S'' = {''v''<sub>1</sub>,''v''<sub>2</sub>,...,''v''<sub>''k''</sub>''}''</span>&nbsp;,then we also say that the set <span class="texhtml">''S''</span>&nbsp;is linearly dependent or linearly independent if the vectors have the corresponding property.  
+
== Remark: <u>'''Definition'''</u> is started for a finite set of vectors, but it also applies to an infinite set <span class="texhtml">''S''</span>&nbsp;of a vector space, using corresponding notation for infinite sums. ==
  
 
<br>  
 
<br>  
  
&nbsp; &nbsp; &nbsp; &nbsp; &nbsp;It should be emphasized that for any vectors <span class="texhtml">''v''<sub>1</sub>,''v''<sub>2</sub>,...,''v''<sub>''k''</sub></span>, Equation (1) always holds if we choose all the scalars <span class="texhtml">''a''<sub>1</sub>,''a''<sub>2</sub>,...,''a''<sub>''k''</sub></span>, equal to zero. The important point in this definition is whether it is possible to satisfy (1) with at least one of the scalars different from zero.  
+
== &nbsp; &nbsp; &nbsp; &nbsp; To determine whether a set of vectors is linearly independent or linearly dependent, we use Equation (1). Regardless of the form of the vectors, Equation (1) yields a homogeneous linear system of equations. it is always consistent, since <span class="texhtml">''a''<sub>1</sub>=''a''<sub>2</sub>=...=''a''<sub>''k''</sub>=0</span>&nbsp;is a solution. However, the main idea from the <u>'''Definition'''</u>is whether there is a nontrivial solution. ==
 +
 
 +
----
  
 
<br>  
 
<br>  
  
Remark: '''Definition''' is started for a finite set of vectors, but it also applies to an infinite set <span class="texhtml">''S''</span>&nbsp;of a vector space, using corresponding notation for infinite sums.  
+
<br>
 +
 
 +
----
 +
 
 +
== '''''Example 1''''' ==
 +
 
 +
----
 +
 
 +
== <br> Determine whether the vectors  ==
 +
 
 +
<math>v1=\left[\begin{array}{cccc}3\\2\\1\end{array}\right]</math>  
 +
 
 +
<math>v2=\left[\begin{array}{cccc}1\\2\\0\end{array}\right]</math>
 +
 
 +
<math>v3=\left[\begin{array}{cccc}-1\\-2\\-1\end{array}\right]</math>
 +
 
 +
== are linearly independent. ==
  
 
<br>  
 
<br>  
  
&nbsp; &nbsp; &nbsp; &nbsp; To determine whether a set of vectors is linearly independent or linearly dependent, we use Equation (1). Regardless of the form of the vectors, Equation (1) yields a homogeneous linear system of equations. it is always consistent, since <span class="texhtml">''a''<sub>1</sub>=''a''<sub>2</sub>=...=''a''<sub>''k''</sub>=0</span>&nbsp;is a solution. However, the main idea from the '''Definition '''is whether there is a nontrivial solution.
+
=== <u>'''Solution'''</u>  ===
 +
 
 +
== Forming Equation (1) ==
 +
 
 +
<math>a1\left[\begin{array}{cccc}3\\2\\1\end{array}\right]</math><math>+a2\left[\begin{array}{cccc}1\\2\\0\end{array}\right]</math><math>+a3\left[\begin{array}{cccc}-1\\2\\-1\end{array}\right]</math><math>=\left[\begin{array}{cccc}0\\0\\0\end{array}\right]</math>
 +
 
 +
== we obtain the homogeneous system ==
 +
 
 +
== <span class="texhtml">3''a''<sub>1</sub> + ''a''<sub>2</sub> − ''a''<sub>3</sub> = 0</span>  ==
 +
 
 +
== <span class="texhtml">2''a''<sub>1</sub> + 2''a''<sub>2</sub> + 2''a''<sub>3</sub> = 0</span> ==
 +
 
 +
== <span class="texhtml">''a''<sub>1</sub>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;− ''a''<sub>3</sub> = 0</span>  ==
  
 
<br>  
 
<br>  
  
Example 1
+
== The corresponding augmented matrix is  ==
  
Determine whether the vectors
+
<math>\left[\begin{array}{cccc}3&1&-1&|0\\2&2&2&|0\\1&0&-1&|0\end{array}\right]</math>
  
<math>v1=\left(\begin{array}{cccc}3\\2\\1\end{array}\right)</math>  
+
<br>  
  
<math>v2=\left(\begin{array}{cccc}1\\2\\0\end{array}\right)</math>
+
== Whose reduced row echelon form is  ==
  
<math>v3=\left(\begin{array}{cccc}-1\\-2\\-1\end{array}\right)</math>  
+
<math>\left[\begin{array}{cccc}1&0&-1&|0\\0&1&2&|0\\0&0&0&|0\end{array}\right]</math>  
  
are linearly independent.  
+
<br>
 +
 
 +
== This there is a nontrivial solution  ==
 +
 
 +
=== <math>\left[\begin{array}{cccc}k\\-2k\\k\end{array}\right]</math>&nbsp; &nbsp; &nbsp; &nbsp;k is not equal to 0  ===
 +
 
 +
== so the vectors are linearly dependent. ==
 +
 
 +
----
  
 
<br>  
 
<br>  
  
'''Solution'''  
+
<br>
 +
 
 +
<br>
 +
 
 +
----
 +
 
 +
== '''''Example 2'''''  ==
  
Forming Equation (1)
+
----
  
<math>a1\left(\begin{array}{cccc}3\\2\\1\end{array}\right)</math><math>+a2\left(\begin{array}{cccc}1\\2\\0\end{array}\right)</math><math>+a3\left(\begin{array}{cccc}-1\\2\\-1\end{array}\right)</math><math>=\left(\begin{array}{cccc}0\\0\\0\end{array}\right)</math>
+
== <br> Are the vectors  ==
  
we obtain the homogeneous system
+
<math>v1=\left[\begin{array}{cccc}1&0&1&2\end{array}\right]</math>
  
<span class="texhtml">3''a''<sub>1</sub> + ''a''<sub>2</sub> − ''a''<sub>3</sub> = 0</span>  
+
<math>v2=\left[\begin{array}{cccc}0&1&1&2\end{array}\right]</math><br>  
  
<span class="texhtml">2''a''<sub>1</sub> + 2''a''<sub>2</sub> + 2''a''<sub>3</sub> = 0</span>
+
== <math>v3=\left[\begin{array}{cccc}1&1&1&3\end{array}\right]</math>&nbsp; &nbsp; &nbsp;in&nbsp;<span class="texhtml">''R''</span><sub><span class="texhtml">4</span></sub> ==
  
<span class="texhtml">''a''<sub>1</sub> − ''a''<sub>3</sub> = 0</span>
+
== linearly dependent or linearly independent?  ==
  
 
<br>  
 
<br>  
  
The corresponding augmented matrix is
+
=== <u>'''Solution'''</u>  ===
  
<math>\left(\begin{array}{cccc}3&1&-1&|0\\2&2&2&|0\\1&0&-1&|0\end{array}\right)</math>  
+
== We form Equation (1),  ==
 +
 
 +
== <span class="texhtml">''a''<sub>1</sub>''v''<sub>1</sub>+''a''<sub>2</sub>''v''<sub>2</sub>+''a''<sub>3</sub>''v''<sub>3</sub>=0</span>  ==
 +
 
 +
== and solve for <span class="texhtml">''a''<sub>1</sub>,''a''<sub>2</sub>,''a''</span><sub><span class="texhtml">3</span></sub><span class="texhtml">.</span><br>  ==
 +
 
 +
== The resulting homogeneous system is  ==
 +
 
 +
== <span class="texhtml">''a''<sub>1</sub> + ''a''<sub>3</sub> = 0</span>  ==
 +
 
 +
== <span class="texhtml">''a''<sub>2</sub> + ''a''<sub>3</sub> = 0</span>  ==
 +
 
 +
== <span class="texhtml">''a''<sub>1</sub> + ''a''<sub>2 </sub>+ ''a''<sub>3</sub> = 0</span>  ==
 +
 
 +
== <span class="texhtml">2''a''<sub>1</sub> + 2''a''<sub>2 </sub>+ 3''a''<sub>3</sub> = 0</span>  ==
 +
 
 +
== <br>  ==
 +
 
 +
== The corresponding augmented matrix is  ==
 +
 
 +
<math>\left[\begin{array}{cccc}1&0&1&|0\\0&1&1&|0\\1&1&1&|0\\2&2&3&|0\end{array}\right]</math>  
  
 
<br>  
 
<br>  
  
Whose reduced row echelon form is  
+
== and its reduced row echelon form is ==
  
<math>\left(\begin{array}{cccc}1&0&-1&|0\\0&1&2&|0\\0&0&0&|0\end{array}\right)</math>  
+
<math>\left[\begin{array}{cccc}1&0&0&|0\\0&1&0&|0\\0&0&1&|0\\0&0&0&|0\end{array}\right]</math>  
  
 
<br>  
 
<br>  
  
This there is a nontrivial solution  
+
== Thus the only solution is the trivial solution ==
  
<math>\left(\begin{array}{cccc}k\\-2k\\k\end{array}\right)</math>&nbsp; &nbsp; &nbsp; &nbsp;k is not equal to 0  
+
== <span class="texhtml">''a''<sub>1</sub> = ''a''<sub>2</sub> = ''a''<sub>3</sub> = 0</span>  ==
  
so the vectors are linearly dependent.  
+
== so the vectors are linearly independent. ==
 +
 
 +
----
  
 
<br>  
 
<br>  
 +
 +
== <u>'''''Theorem'''''</u>  ==
 +
 +
<u></u>
 +
 +
<u></u>
 +
 +
<u></u>
 +
 +
<u></u>
 +
 +
== Let {<span class="texhtml">''S'' = ''v''<sub>1</sub>,''v''<sub>2</sub>,...,''v''<sub>''n''</sub>''}''</span>  ==
 +
 +
== be a set of&nbsp;<span class="texhtml">''n''</span>&nbsp;vectors in&nbsp;<span class="texhtml">''R<sup>'''n'''</sup>''</span>. Let&nbsp;<span class="texhtml">''A''</span>&nbsp;be the matrix whose columns (rows) are the elements of&nbsp;<span class="texhtml">''S''</span>. Then&nbsp;<span class="texhtml">''S''</span>&nbsp;is linearly independent if and only if det(<span class="texhtml">''A''</span>) is not equal to 0.  ==
 +
 +
<u></u>
 +
 +
<u></u>
 +
 +
<u></u>
 +
 +
<u></u>
 +
 +
<u><br></u>
 +
 +
----
 +
 +
== ''Example 3''  ==
 +
 +
----
 +
 +
== Is &nbsp; &nbsp;&nbsp;<math>S=\left[\begin{array}{cccc}1&2&3\end{array}\right]</math>&nbsp;<math>,\left[\begin{array}{cccc}0&1&2\end{array}\right]</math>&nbsp;<math>,\left[\begin{array}{cccc}3&0&-1\end{array}\right]</math>  ==
 +
 +
== a linearly independent set of vectors in&nbsp;<span class="texhtml">''R''</span><sup><span class="texhtml">3</span></sup><span class="texhtml">?</span>  ==
  
 
<br>  
 
<br>  
  
Example 2
+
== <u>Solution</u>  ==
  
Are the vectors  
+
== We form the matrix&nbsp;<span class="texhtml">''A''</span>&nbsp;whose rows are the vectors in&nbsp;<span class="texhtml">''S''</span>:  ==
  
<math>v1=\left(\begin{array}{cccc}1&0&1&2\end{array}\right)</math>  
+
<br>  
  
<math>v2=\left(\begin{array}{cccc}0&1&1&2\end{array}\right)</math>  
+
<math>A=\left[\begin{array}{cccc}1&2&3\\0&1&2\\3&0&-1\end{array}\right]</math>
 +
 
 +
<br>  
  
and
+
== Since det(<span class="texhtml">''A''</span>) = 2, we conclude that&nbsp;<span class="texhtml">''S''</span>&nbsp;is linearly independent.  ==
  
<math>v3=\left(\begin{array}{cccc}1&1&1&3\end{array}\right)</math>&nbsp; &nbsp; &nbsp;in&nbsp;<span class="texhtml">''R''</span><sub><span class="texhtml">4</span></sub>
+
----
  
 
<br>  
 
<br>  
  
linearly dependent or linearly independent?
+
== <u>'''''Theorem'''''</u>  ==
 +
 
 +
<u></u>
 +
 
 +
== Let&nbsp;<span class="texhtml">''S''<sub><span style="font-size: 17px;">1</span></sub></span>&nbsp;and&nbsp;<span class="texhtml">''S''<sub>2</sub></span>&nbsp;be finite susbsets of a vector space and let&nbsp;<span class="texhtml">''S''<sub><span style="font-size: 17px;">1</span></sub></span>&nbsp;be a subset of&nbsp;<span class="texhtml">''S''<sub>2</sub></span>. Then the following statements are true:  ==
 +
 
 +
== (a) If&nbsp;<span class="texhtml">''S''<sub><span style="font-size: 17px;">1</span></sub></span>&nbsp;is linearly dependent, so is&nbsp;<span class="texhtml">''S''<sub>2</sub></span>.  ==
 +
 
 +
== (b) If&nbsp;<span class="texhtml">''S''<sub>2</sub></span>&nbsp;is linearly independent, so is&nbsp;<span class="texhtml">''S''<sub><span style="font-size: 17px;">1</span></sub></span>.  ==
 +
 
 +
----
  
 
<br>  
 
<br>  
  
'''Solution'''  
+
== <u>'''''Theorem'''''</u>  ==
  
We form Equation (1),
+
<u></u>
  
<span class="texhtml">''a''<sub>1</sub>''v''<sub>1</sub>+''a''<sub>2</sub>''v''<sub>2</sub>+''a''<sub>3</sub>''v''<sub>3</sub>=0</span>  
+
== The nonzero vectors v<sub>1</sub>,v<sub><span style="font-size: 17px;">2</span></sub>,...,v<sub></sub><sub>n</sub>&nbsp;in a vector space V&nbsp;are linearly dependent if and only if one of the vectors v<sub></sub><sub>j</sub>&nbsp;''<math>(2 \le j)</math>&nbsp;''is a linear combination of the preceding vectors v<sub>1</sub>,v<sub>2</sub>,...,<span class="texhtml">''v''<sub>''j''</sub> </span><sub><span class="texhtml">− 1.</span></sub>  ==
  
and solve for <span class="texhtml">''a''<sub>1</sub>,''a''<sub>2</sub>,''a''</span><sub><span class="texhtml">3</span></sub><span class="texhtml">.</span><br>
+
----
  
The resulting homogeneous system is
+
== ''Example 4''  ==
  
<span class="texhtml">''a''<sub>1</sub> + ''a''<sub>3</sub> = 0</span>
+
----
  
<span class="texhtml">''a''<sub>2</sub> + ''a''<sub>3</sub> = 0</span>  
+
== Let&nbsp;<span class="texhtml">''V''</span>=<span class="texhtml">''R''<sub>3</sub></span>&nbsp;and also&nbsp;  ==
  
<span class="texhtml">''a''<sub>1</sub> + ''a''<sub>2 </sub>+ ''a''<sub>3</sub> = 0</span>
+
== <math>v1=\left[\begin{array}{cccc}1&2&-1\end{array}\right]</math> ==
  
<span class="texhtml">2''a''<sub>1</sub> + 2''a''<sub>2 </sub>+ 3''a''<sub>3</sub> = 0</span>  
+
<math>v2=\left[\begin{array}{cccc}1&-2&1\end{array}\right]</math>  
 +
 
 +
<math>v3=\left[\begin{array}{cccc}-3&2&-1\end{array}\right]</math>  
 +
 
 +
<math>v4=\left[\begin{array}{cccc}2&0&0\end{array}\right]</math>  
  
 
<br>  
 
<br>  
  
The corresponding augmented matrix is
+
== We find that  ==
  
<math>\left(\begin{array}{cccc}1&0&1&|0\\0&1&1&|0\\1&1&1&|0\\2&2&3&|0\end{array}\right)</math>  
+
== &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;<span class="texhtml">''v''<sub>1</sub> + ''v''<sub>2</sub> + 0''v''<sub>3</sub> − ''v''<sub>4</sub> = 0,</span>  ==
 +
 
 +
== so&nbsp;<span class="texhtml">''v''<sub>!</sub>,''v''<sub>2</sub>,''v''<sub>3</sub></span>, and&nbsp;<span class="texhtml">''v''<sub>4&nbsp;</sub></span>  ==
 +
 
 +
== are linearly dependent. We then have  ==
 +
 
 +
== &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;<span class="texhtml">''v''<sub>4</sub> = ''v''<sub>1</sub> + ''v''<sub>2</sub> + 0''v''<sub>3</sub></span>  ==
 +
 
 +
<u></u>  
  
 
<br>  
 
<br>  
  
and its reduced row echelon form is
+
== <u>'''Remarks'''</u>  ==
  
<math>\left(\begin{array}{cccc}1&0&0&|0\\0&1&0&|0\\0&0&1&|0\\0&0&0&|0\end{array}\right)</math>  
+
== 1. We observe that the previous <u>'''''Theorem'''''</u>'''''&nbsp;'''''does not say that <u>every</u>&nbsp;vector&nbsp;<span class="texhtml">''v''</span>&nbsp;is a linear combination of the preceding vectors. Thus, in the previous example, we also have&nbsp;<span class="texhtml">''v''<sub><span style="font-size: 17px;">1</span></sub>&nbsp;+ 2''v''<sub>2</sub> + ''v''<sub>3</sub> + 0''v''<sub>4</sub> = 0</span>.  ==
 +
 
 +
== We cannot solve, in this equation, for&nbsp;<span class="texhtml">''v''<sub>4</sub></span>&nbsp;as a linear combination of  ==
 +
 
 +
== <span class="texhtml">''v''<sub>1</sub>,''v''<sub>2</sub>,</span>&nbsp;and&nbsp;<span class="texhtml">''v''<sub>3</sub></span>, since its coefficient is zero.  ==
 +
 
 +
== 2. We can also prove that if&nbsp;<span class="texhtml">''S'' = {''v''<sub>1</sub>,''v''<sub>2</sub>,...,''v''<sub>''k''</sub></span>} is a set of vectors in a vector space&nbsp;<span class="texhtml">''V''</span>, then&nbsp;<span class="texhtml">''S''</span>&nbsp;is linearly dependent if and only if one of the vectors in&nbsp;<span class="texhtml">''S''</span>&nbsp;is a linear combination of all the other vectors in&nbsp;<span class="texhtml">''S''</span>. For instance in the previous example,  ==
 +
 
 +
== &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;<span class="texhtml">''v''<sub>1</sub> =  − ''v''<sub>2</sub> − 0''v''<sub>3</sub> + ''v''<sub>4</sub>; &nbsp; &nbsp; &nbsp;<math>v_2= \frac{-1}{2} v1 - \frac{1}{2} v_3 -0v_4</math></span>  ==
 +
 
 +
== 3. Observe that if&nbsp;<span class="texhtml">''v''<sub>1</sub>,''v''<sub>2</sub>,...,''v''<sub>''k''</sub></span>  ==
 +
 
 +
== are linearly independent vectors in a vector space, then they must be distinct and nonzero.  ==
 +
 
 +
----
 +
 
 +
----
  
 
<br>  
 
<br>  
  
Thus the only solution is the trivial solution
+
== Useful link to calculate linear dependence/independence  ==
 +
 
 +
== http://www.math.odu.edu/~bogacki/cgi-bin/lat.cgi?c=li  ==
 +
 
 +
== http://www.math.odu.edu/~bogacki/cgi-bin/lat.cgi ==
  
<span class="texhtml">''a''<sub>1</sub> = ''a''<sub>2</sub> = ''a''<sub>3</sub> = 0</span>
+
----
  
so the vectors are linrearly independent.
+
[[Category:MA265Fall2011Walther]]

Latest revision as of 09:05, 11 April 2013


Linear Dependence

Student project for MA265



Contents

Definition




The vectors v1,v2,...,vk in a vector space V are said to be linearly dependent if there exist constans a1,a2,...,ak not all zero, such that

                                                                           $ \sum_{j=1}^k a_1v_1+a_2v_2+...+a_kv_k=0 $                       (1)                                 

Otherwise, v1,v2,...,vk are called linearly independent. That is v1,v2,...,vk are linearly independent if, whenever a1v1+ a2v2+...+akvk=0


                                                                       a1= a2=...=ak=0



If S = {v1,v2,...,vk} ,then we also say that the set S is linearly dependent or linearly independent if the vectors have the corresponding property.


         It should be emphasized that for any vectors v1,v2,...,vk, Equation (1) always holds if we choose all the scalars a1,a2,...,ak, equal to zero. The important point in this definition is whether it is possible to satisfy (1) with at least one of the scalars different from zero.


Remark: Definition is started for a finite set of vectors, but it also applies to an infinite set S of a vector space, using corresponding notation for infinite sums.


        To determine whether a set of vectors is linearly independent or linearly dependent, we use Equation (1). Regardless of the form of the vectors, Equation (1) yields a homogeneous linear system of equations. it is always consistent, since a1=a2=...=ak=0 is a solution. However, the main idea from the Definitionis whether there is a nontrivial solution.





Example 1



Determine whether the vectors

$ v1=\left[\begin{array}{cccc}3\\2\\1\end{array}\right] $

$ v2=\left[\begin{array}{cccc}1\\2\\0\end{array}\right] $

$ v3=\left[\begin{array}{cccc}-1\\-2\\-1\end{array}\right] $

are linearly independent.


Solution

Forming Equation (1)

$ a1\left[\begin{array}{cccc}3\\2\\1\end{array}\right] $$ +a2\left[\begin{array}{cccc}1\\2\\0\end{array}\right] $$ +a3\left[\begin{array}{cccc}-1\\2\\-1\end{array}\right] $$ =\left[\begin{array}{cccc}0\\0\\0\end{array}\right] $

we obtain the homogeneous system

3a1 + a2a3 = 0

2a1 + 2a2 + 2a3 = 0

a1               − a3 = 0


The corresponding augmented matrix is

$ \left[\begin{array}{cccc}3&1&-1&|0\\2&2&2&|0\\1&0&-1&|0\end{array}\right] $


Whose reduced row echelon form is

$ \left[\begin{array}{cccc}1&0&-1&|0\\0&1&2&|0\\0&0&0&|0\end{array}\right] $


This there is a nontrivial solution

$ \left[\begin{array}{cccc}k\\-2k\\k\end{array}\right] $       k is not equal to 0

so the vectors are linearly dependent.






Example 2



Are the vectors

$ v1=\left[\begin{array}{cccc}1&0&1&2\end{array}\right] $

$ v2=\left[\begin{array}{cccc}0&1&1&2\end{array}\right] $

$ v3=\left[\begin{array}{cccc}1&1&1&3\end{array}\right] $     in R4

linearly dependent or linearly independent?


Solution

We form Equation (1),

a1v1+a2v2+a3v3=0

and solve for a1,a2,a3.

The resulting homogeneous system is

a1 + a3 = 0

a2 + a3 = 0

a1 + a2 + a3 = 0

2a1 + 2a2 + 3a3 = 0


The corresponding augmented matrix is

$ \left[\begin{array}{cccc}1&0&1&|0\\0&1&1&|0\\1&1&1&|0\\2&2&3&|0\end{array}\right] $


and its reduced row echelon form is

$ \left[\begin{array}{cccc}1&0&0&|0\\0&1&0&|0\\0&0&1&|0\\0&0&0&|0\end{array}\right] $


Thus the only solution is the trivial solution

a1 = a2 = a3 = 0

so the vectors are linearly independent.



Theorem

Let {S = v1,v2,...,vn}

be a set of n vectors in Rn. Let A be the matrix whose columns (rows) are the elements of S. Then S is linearly independent if and only if det(A) is not equal to 0.



Example 3


Is     $ S=\left[\begin{array}{cccc}1&2&3\end{array}\right] $ $ ,\left[\begin{array}{cccc}0&1&2\end{array}\right] $ $ ,\left[\begin{array}{cccc}3&0&-1\end{array}\right] $

a linearly independent set of vectors in R3?


Solution

We form the matrix A whose rows are the vectors in S:


$ A=\left[\begin{array}{cccc}1&2&3\\0&1&2\\3&0&-1\end{array}\right] $


Since det(A) = 2, we conclude that S is linearly independent.



Theorem

Let S1 and S2 be finite susbsets of a vector space and let S1 be a subset of S2. Then the following statements are true:

(a) If S1 is linearly dependent, so is S2.

(b) If S2 is linearly independent, so is S1.



Theorem

The nonzero vectors v1,v2,...,vn in a vector space V are linearly dependent if and only if one of the vectors vj $ (2 \le j) $ is a linear combination of the preceding vectors v1,v2,...,vj − 1.


Example 4


Let V=R3 and also 

$ v1=\left[\begin{array}{cccc}1&2&-1\end{array}\right] $

$ v2=\left[\begin{array}{cccc}1&-2&1\end{array}\right] $

$ v3=\left[\begin{array}{cccc}-3&2&-1\end{array}\right] $

$ v4=\left[\begin{array}{cccc}2&0&0\end{array}\right] $


We find that

                                            v1 + v2 + 0v3v4 = 0,

so v!,v2,v3, and v

are linearly dependent. We then have

                                             v4 = v1 + v2 + 0v3


Remarks

1. We observe that the previous Theorem does not say that every vector v is a linear combination of the preceding vectors. Thus, in the previous example, we also have v1 + 2v2 + v3 + 0v4 = 0.

We cannot solve, in this equation, for v4 as a linear combination of

v1,v2, and v3, since its coefficient is zero.

2. We can also prove that if S = {v1,v2,...,vk} is a set of vectors in a vector space V, then S is linearly dependent if and only if one of the vectors in S is a linear combination of all the other vectors in S. For instance in the previous example,

                                                   v1 = − v2 − 0v3 + v4;      $ v_2= \frac{-1}{2} v1 - \frac{1}{2} v_3 -0v_4 $

3. Observe that if v1,v2,...,vk

are linearly independent vectors in a vector space, then they must be distinct and nonzero.




Useful link to calculate linear dependence/independence

http://www.math.odu.edu/~bogacki/cgi-bin/lat.cgi?c=li

http://www.math.odu.edu/~bogacki/cgi-bin/lat.cgi


Alumni Liaison

Ph.D. on Applied Mathematics in Aug 2007. Involved on applications of image super-resolution to electron microscopy

Francisco Blanco-Silva