Error Control Coding

21ECE744
 INTRODUCTION
• Random experiment: Experiment of which the
outcome cannot be predicted. Example:
tossing a coin
• Sample space: Set of all possible outcomes of
an experiment. Example: if coin is tossed
twice, then sample space
SS= {HH, HT, TH, TT}
• Event: Every subset of sample space is an event.
• Mutually exclusive/disjoint event: Those events that cannot
happen together are called mutually exclusive event.
Example: day and night, head and tail.
• Probability: Probability of an event is the measure of chance
that event occurs or the ratio of number of favorable cases to
the number of all possible cases.

Number of favorable cases

P(A) = ____________________________
Total outcomes of an experiment
 Rules of probability
• Probability of every event is at least zero
• There is no such thing as –ve probability
• Probability of sure event is one
• If two events A and B are said to be mutually
exclusive then,
P(AUB)= P(A)+P(B)
• When the events are not mutually exclusive then,
P(AUB)= P(A)+P(B)-P(AnB)
 PROBLEMS
1. A man is informed that when a pair of dice is
rolled, the result is 9. Determine the
probability
2. Three coins are tossed. What is the
probability of getting
i) all heads, ii) atleast one head, iii) two heads,
iv) atleast two heads
3. A ball is thrown at random from a box containing
6 red balls, 4 white balls and 5 blue balls.
Determine the probability that i) getting only red
ii) not getting red iii) only white iv) not getting
red/white v) only blue
4. Two dice are thrown simultaneously. Find the
probability of i) same number on the both dice,
ii) even number as the sum, iii) a prime as a
sum, iv) multiple of 3 as sum, v) total of at least
10, vi) doublet of same even numbers, vii)
multiple of 2 on one dice and multiple of 3 on
other side.
• Joint probability: The probability of two events in conjunction
i.e., it is the probability of both events together. It is
represented as P(AB) or P(AnB) or P(A,B).
• Conditional probability: Let A and B be any two events
associated with random experiment . The probability of
occurrence of event A when event B has already occurred is
called conditional probability of A when B is given, i.e., P(A/B).
• By definition P(A/B) is probability of occurrence of event A
when event B has already occurred is given by
no. of cases favorable to B which P(A/B)=(P(AUB)/P(B))
are also favorable to A or
P(A/B)= _______________________________ P(B/A)=(P(BnA)/P(A)) = (P(AnB)/P(B))
no. of cases favorable to B
Note:
If two events are independent their joint
probability is the product of the prior
probabilities of each event occurring by itself.
Two random events A and B are statistically
independent if and only if P(AnB) =P(A).P(B)
i.e., P(A/B) = (P(AnB)/P(B)) = (P(A).P(B)/P(B)) = P(A)
Baye’s Theorem (Baye’s Rule):
• P(m0/r0) = (P(r0/m0).P(m0))/(P(r0))
or
• P(m1/r1) = (P(r1/m1).P(m1))/(P(r1))
Product rule or chain rule or total probability theorem:
CHAIN RULE:
• P(r0) = (P(r0/m0).P(m0))+(P(r0/m1).P(m1))
i.e., P(A) = P(A/B1).P(B1)+P(A/B2).P(B2)+……..P(A/
Bn).P(Bn)
BAYES RULE:
P(Bj/A) = (P(A/Bj).P(Bj))/(P(A))
Problems:
1. A pair of dice is thrown. If it is known that
one dice shows a, (i) what is te probability
that the other dice shows a 5, (ii) the total of
both is greater than 7
2. The probability that a student passes an
examination is 0.9, given that he has studied.
The probability that he passes the
examination without studying is 0.2. Assume
that the probability of the student studying is
0.6, what is the probability that he studied.
3. In a certain group of engineers, 60% have insufficient
background of information theory, 50% have
inadequate knowledge of probability theory and 80%
are either one or both of the categories. What is the
percentage of people who know probability among
those who have a sufficient background of
information theory.
4. The runs scored by a cricketerin 6 innings are given
below. What is the probability that he would score an
half century in an innings.
Innings I II III IV V VI
No of 75 50 23 32 80 52
runs
5. 750 families with 2 children were selected randomly and the
following data were recorded. Compute the probability of
family choosen at random having (i) no boy (ii) one boy (iii) two
boys. Also check whether the sum of these probabilities is 1.

No of boys in family 0 1 2
No of families 350 250 150

6. Consider the following event for a family with children where

A={children of both sexes}
B={atmost one boy}
(i)Show that A and B are independent events with a family has 3
children
(ii) Show that A and B are dependent events if a family has only 2
children
 7. In the exit poll results given by a TV channelin the past 10
years it was observed that 65 out of 80 times, the predictions
proved correct. What is the probability that the next exit poll
result given by the Tv channel will be correct? What is the
probability that the result will be incorrect?
8. A survey was conducted about the distance travelled each day
by the employees of a company to their place of work and the
resultLess
Distance is given
than below
5-10km 10-15km 15-20km 20-25km 25-30km
travelled 5km

No of 30 172 180 58 35 25
employees

If an employee is choosen at random, what is the probability (i)

that he travels less than 10km (ii) that he travels 20km or
more (iii) that he travels less than 20km but not less than
10km? Is the sum of these probabilities equal to 1?
9. A binary communcation channel carries data as one
of two types of signals denoted by 0 and 1, due to
noise a transmitted 0 is sometimes received as 1 and
transmitted 1 is sometimes received as 0. For a given
channel assume a probability of 0.94 that a
transmitted 0 correctly received as 0 and the
probability of 0.91 that a transmitted 1 is received as
1. Further assume a propbability of 0.45 of
transmitting is 0 if the signal is sent. Determine the
(i) probability that 1 is received (ii) probability that 0
is received (iii) probability that 1 must be
transmitted given that 1 was received (iv) 0 was
transmitted and 0 was received (v) probability of an
error
10. A binary communication system 0 or 1is transmitted
because of noise on channel. O can be received as 1 and
vice-versa. Let m0 and m1 represent events of transmitting 0
and 1 respectively and let r0 and r1 denotes events of reeiving
0 and 1 respectively, given P(m0)=0.5, P(r1/m0)=0.1,
P(r0/m1)=0.2, Find (i)P() and P(), (ii) if 0 was received, what is
the probability that 0 was sent, (iii) if 1 was received, what is
the probability that 1 was sent.
11. A jar contain black and white marbles. 2 marbles are cosen
without replacement. The probability of selecting a black
marble and then a white marble is 0.34 and the probability
of selecting a black marble on the first draw is 0.47. What is
the probability of selecting a white marble on the second
draw given that the first marble drawn was black.
12. The probability that it is Friday and that a student is absent is
0.03. Since there are 5 school days in a week, the probability
that it is Friday is 0.2. What is the probability that a student is
absent given that today is Friday.
13. A maths teacher gave her class 2 tests. 25% of the class
passed both tests and 42% of the class passed the first test.
What percent of those who passed the first test also passed
the second test.
14. A dice is thrown 500 times and the frequency of the
outcomes are given as follows
Outcome 1 2 3 4 5 6
frequency 85 48 82 65 96 124

When the dice is thrown again, what is the probability of a

prime number showing.