(New page: Category:ECE Category:QE Category:CNSIP Category:problem solving Category:random variables Category:probability <center> <font size= 4> [[ECE_PhD_Qualifying_Exams...)
 
Line 29: Line 29:
 
The number of changeovers <math>Y</math> can be expressed as the sum of n-1 Bernoulli random variables:
 
The number of changeovers <math>Y</math> can be expressed as the sum of n-1 Bernoulli random variables:
  
<math>Y=\sum_{i=1}^{n-1}X_i</math>
+
<math>Y=\sum_{i=1}^{n-1}X_i</math>.
 +
 
 +
Therefore,
 +
 
 +
<math>E(Y)=E(\sum_{i=1}^{n-1}X_i)=\sum_{i=1}^{n-1}E(X_i)</math>.
 +
 
 +
For Bernoulli random variables,
 +
 
 +
<math>E(X_i)=p(E_i=1)=p(1-p)+(1-p)p=2p(1-p)</math>.
 +
 
 +
Thus
 +
 
 +
<math>E(Y)=2(n-1)p(1-p)</math>.
  
 
<math class="inline">\Phi_{\mathbf{X}}\left(\omega\right)=E\left[e^{i\omega\mathbf{X}}\right]=\int_{-\infty}^{\infty}\frac{A}{2}e^{-A\left|x\right|}\cdot e^{i\omega x}dx=\frac{A}{2}\left[\int_{-\infty}^{0}e^{x\left(A+i\omega\right)}dx+\int_{0}^{\infty}e^{x\left(-A+i\omega\right)}dx\right]</math><math class="inline">=\frac{A}{2}\left[\frac{e^{x\left(A+i\omega\right)}}{A+i\omega}\biggl|_{-\infty}^{0}+\frac{e^{x\left(-A+i\omega\right)}}{-A+i\omega}\biggl|_{0}^{\infty}\right]=\frac{A}{2}\left[\frac{1}{A+i\omega}-\frac{1}{-A+i\omega}\right]</math><math class="inline">=\frac{A}{2}\cdot\frac{A-i\omega+A+i\omega}{A^{2}+\omega^{2}}=\frac{A^{2}}{A^{2}+\omega^{2}}.</math>  
 
<math class="inline">\Phi_{\mathbf{X}}\left(\omega\right)=E\left[e^{i\omega\mathbf{X}}\right]=\int_{-\infty}^{\infty}\frac{A}{2}e^{-A\left|x\right|}\cdot e^{i\omega x}dx=\frac{A}{2}\left[\int_{-\infty}^{0}e^{x\left(A+i\omega\right)}dx+\int_{0}^{\infty}e^{x\left(-A+i\omega\right)}dx\right]</math><math class="inline">=\frac{A}{2}\left[\frac{e^{x\left(A+i\omega\right)}}{A+i\omega}\biggl|_{-\infty}^{0}+\frac{e^{x\left(-A+i\omega\right)}}{-A+i\omega}\biggl|_{0}^{\infty}\right]=\frac{A}{2}\left[\frac{1}{A+i\omega}-\frac{1}{-A+i\omega}\right]</math><math class="inline">=\frac{A}{2}\cdot\frac{A-i\omega+A+i\omega}{A^{2}+\omega^{2}}=\frac{A^{2}}{A^{2}+\omega^{2}}.</math>  

Revision as of 17:30, 3 November 2014


ECE Ph.D. Qualifying Exam

Communication, Networking, Signal and Image Processing (CS)

Question 1: Probability and Random Processes

August 2013



Part 1

Consider $ n $ independent flips of a coin having probability $ p $ of landing on heads. Say that a changeover occurs whenever an outcome differs from the one preceding it. For instance, if $ n=5 $ and the sequence $ HHTHT $ is observed, then there are 3 changeovers. Find the expected number of changeovers for $ n $ flips. Hint: Express the number of changeovers as a sum of Bernoulli random variables.


Solution 1

The number of changeovers $ Y $ can be expressed as the sum of n-1 Bernoulli random variables:

$ Y=\sum_{i=1}^{n-1}X_i $.

Therefore,

$ E(Y)=E(\sum_{i=1}^{n-1}X_i)=\sum_{i=1}^{n-1}E(X_i) $.

For Bernoulli random variables,

$ E(X_i)=p(E_i=1)=p(1-p)+(1-p)p=2p(1-p) $.

Thus

$ E(Y)=2(n-1)p(1-p) $.

$ \Phi_{\mathbf{X}}\left(\omega\right)=E\left[e^{i\omega\mathbf{X}}\right]=\int_{-\infty}^{\infty}\frac{A}{2}e^{-A\left|x\right|}\cdot e^{i\omega x}dx=\frac{A}{2}\left[\int_{-\infty}^{0}e^{x\left(A+i\omega\right)}dx+\int_{0}^{\infty}e^{x\left(-A+i\omega\right)}dx\right] $$ =\frac{A}{2}\left[\frac{e^{x\left(A+i\omega\right)}}{A+i\omega}\biggl|_{-\infty}^{0}+\frac{e^{x\left(-A+i\omega\right)}}{-A+i\omega}\biggl|_{0}^{\infty}\right]=\frac{A}{2}\left[\frac{1}{A+i\omega}-\frac{1}{-A+i\omega}\right] $$ =\frac{A}{2}\cdot\frac{A-i\omega+A+i\omega}{A^{2}+\omega^{2}}=\frac{A^{2}}{A^{2}+\omega^{2}}. $

(b)

$ P\left(\left\{ \left|\mathbf{X}-\overline{\mathbf{X}}\right|\leq2\sigma\right\} \right)=1-P\left(\left\{ \left|\mathbf{X}-\overline{\mathbf{X}}\right|>2\sigma\right\} \right). $ By Chebyshev Inequality, $ P\left(\left\{ \left|\mathbf{X}-\overline{\mathbf{X}}\right|>2\sigma\right\} \right)\leq\frac{\sigma^{2}}{\left(2\sigma\right)^{2}}=\frac{1}{4} $ .

$ P\left(\left\{ \left|\mathbf{X}-\overline{\mathbf{X}}\right|\leq2\sigma\right\} \right)\geq\frac{3}{4}. $


Solution 2

Write it here.


Back to QE CS question 1, August 2000

Back to ECE Qualifying Exams (QE) page

Alumni Liaison

Basic linear algebra uncovers and clarifies very important geometry and algebra.

Dr. Paul Garrett