Revision as of 16:00, 30 March 2015 by Wu112 (Talk | contribs)

(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)


ECE Ph.D. Qualifying Exam

Communication, Networking, Signal and Image Processing (CS)

Question 1: Probability and Random Processes

August 2011



Part 4

Jump to Part 1,2,3


Assume that $ \mathbf{X}(t) $ is a zero-mean continuous-time Gaussian white noise process with autocorrelation function

                $ R_{\mathbf{XX}}(t_1,t_2)=\delta(t_1-t_2). $

Let $ \mathbf{Y}(t) $ be a new random process ontained by passing $ \mathbf{X}(t) $ through a linear time-invariant system with impulse response $ h(t) $ whose Fourier transform $ H(\omega) $ has the ideal low-pass characteristic

               $ H(\omega) = \begin{cases} 1, & \mbox{if } |\omega|<\Omega,\\ 0, & \mbox{elsewhere,} \end{cases} $

where $ \Omega>0 $.

a) Find the mean of $ \mathbf{Y}(t) $.

b) Find the autocorrelation function of $ \mathbf{Y}(t) $.

c) Find the joint pdf of $ \mathbf{Y}(t_1) $ and $ \mathbf{Y}(t_2) $ for any two arbitrary sample time $ t_1 $ and $ t_2 $.

d) What is the minimum time difference $ t_1-t_2 $ such that $ \mathbf{Y}(t_1) $ and $ \mathbf{Y}(t_2) $ are statistically independent?


Solution 1:

a)

$ \begin{align} E[Y(t)] &= E[X(t)\ast h(t)] &\\ &= E\left[\int_{-\infty}^\infty x(\alpha)h(t-\alpha)d\alpha\right] &\\ &= \int_{-\infty}^\infty E[X(\alpha)]h(t-\alpha)d\alpha &\\ &= \int_{-\infty}^\infty 0\cdot h(t-\alpha)d\alpha &\\ &= 0 & \end{align} $

b)

$ R_{XX}(t_1,t_2)=\delta(t_1-t_2)\Rightarrow X(t) $ is wide-sense stationary

$ \Rightarrow R_{XX}(\tau)= R_{XX}(t,t+\tau)=\delta(\tau) $

$ \Rightarrow S_{XX}(\omega)= \int_{-\infty}^\infty R_{XX}(\tau)e^{-i\omega\tau}d\tau = \int_{-\infty}^\infty \delta(\tau)e^{-i\omega\tau}d\tau = 1 $

$ \Rightarrow S_{YY}(\omega)= S_{XX}\cdot\vert H(\omega)\vert^2 = 1\cdot H(\omega)\cdot H^\ast(\omega) = H(\omega) $

$ \begin{align} \Rightarrow R_{YY}(\tau)&=\frac{1}{2\pi}\int_{-\infty}^\infty S_{YY}(\omega)e^{i\omega\tau}d\omega &\\ &= \frac{1}{2\pi}\int_{-\Omega}^\Omega e^{i\omega\tau}d\omega &\\ &= \frac{1}{2\pi}\cdot\frac{1}{i\tau}e^{i\omega\tau}\vert_{\omega=-\Omega}^\Omega &\\ &= \frac{1}{\pi\tau}\left(\frac{1}{2i}\left(e^{i\Omega\tau}-e^{-i\Omega\tau}\right)\right) &\\ &= \frac{\text{sin}\Omega\tau}{\pi\tau} & \end{align} $

c)

Since $ \mathbf{X}(t) $ is Gaussian random process, and $ h(t) $ is the impulse response of a linear time-invariant system.

$ \Rightarrow \mathbf{Y}(t) $ is also a Gaussian random process.

$ \Rightarrow \mathbf{Y}(t_1) $ and $ \mathbf{Y}(t_2) $ are jointly Gaussian distributed for any $ t_1 $, $ t_2 $, $ t_1\neq t_2 $.

$ \Rightarrow $ The joint pdf

$ f_{Y(t_1)Y(t_2)}(y_1,y_2)=\frac{1}{2\pi\sigma_{Y_1}\sigma_{Y_2}\sqrt{1-r^2}}\text{exp}\left\{\frac{-1}{2(1-r^2)}\left(\frac{(y_1-\eta_{Y_1})^2}{\sigma_{Y_1}^2}-2r\frac{(y_1-\eta_{Y_1})(y_2-\eta_{Y_2})}{\sigma_{Y_1}\sigma_{Y_2}}+\frac{(y_2-\eta_{Y_2})^2}{\sigma_{Y_2}^2}\right)\right\} $,

where

$ \sigma_{Y_1}=\sigma_{Y_2}=\sqrt{R_{YY}(0)}=\sqrt{\lim_{\tau \to 0}\frac{\text{sin}\Omega\tau}{\pi\tau}}=\sqrt{\frac{\Omega}{\pi}} $,

$ \eta_{Y_1}=\eta_{Y_2}=E[Y(t)]=0 $,

$ r=\frac{\text{cov}(Y(t_1),Y(t_2))}{\sigma_{Y_1}\sigma_{Y_2}}=\frac{R_{YY}(t_1-t_2)}{\sigma_{Y_1}\sigma_{Y_2}}=\frac{\frac{\text{sin}\Omega(t_1-t_2)}{\pi(t_1-t_2)}}{\frac{\Omega}{\pi}}=\frac{\text{sin}\Omega(t_1-t_2)}{\Omega(t_1-t_2)} $.

d)

$ \mathbf{Y}(t_1) $ and $ \mathbf{Y}(t_2) $ are jointly Gaussian random variables.

$ \Rightarrow \mathbf{Y}(t_1) $ and $ \mathbf{Y}(t_2) $ are statistically independent if and only if $ \text{cov}(Y(t_1),Y(t_2))=0 $.

$ \Rightarrow R_{YY}(t_1-t_2)=0 $

$ \Rightarrow \frac{\text{sin}\Omega(t_1-t_2)}{\pi(t_1-t_2)}=0 \Rightarrow \text{sin}\Omega(t_1-t_2)=0 \text{ and } t_1\neq t_2 $

$ \Rightarrow \Omega(t_1-t_2)=n\pi \text{, } n\in\mathbb{Z} \text{ and } t_1\neq t_2 $

$ \Rightarrow t_1-t_2=n\frac{\pi}{\Omega} \text{, } n\in\mathbb{Z}/\{0\} $

$ \Rightarrow $ The minimum time difference is $ \frac{\pi}{\Omega} $ as $ n=1 $.


"Communication, Networks, Signal, and Image Processing" (CS)- Question 4, August 2011

Go to


Back to ECE Qualifying Exams (QE) page

Alumni Liaison

Correspondence Chess Grandmaster and Purdue Alumni

Prof. Dan Fleetwood