Exercises
This section contains a series of exercises. The answers to all these can be found in the Answers_to_Exercises_Chap13.ipynb
Jupyter notebook in this book’s GitHub repository.
We have a composite random variable, , that consists of three binary random variables,
. We denote this as
. We’ll use
for the outcome for
,
for the outcome of
, and
for the outcome of
. This means
.
We can write the outcome, , for the overall random variable,
, as a three-digit bit-string For example,
–to represent the outcome,
. There are
possible values for
; these are 000,001,010,011,100,101,110,111. We can also denote the true probability distribution, P X(x), as
; it corresponds to eight numbers (between 0 and 1) that all add up to 1.
Now, let’s introduce our approximation, . We will use a product approximation, so we’ll write the following:
Eq. 44
We’ve put the superscript “approx” on the distributions on the...