PPT-DM-UNIT4-Group Theory and Group Codes
PPT-DM-UNIT4-Group Theory and Group Codes
PPT-DM-UNIT4-Group Theory and Group Codes
• BASIC ALGEBRA
• ALGEBRAIC SYSTEM
There are common notations for the number system which are
R – the set of all Real numbers, R+ - the set of Positive real numbers.
• A non empty set A with one or more binary operations on it is called an algebraic
system.
Examples.
• Set : 𝑁 = {1,2,3 … } – the set of natural numbers, Operation : the usual addition ‘+’
which is a binary operation on N, then (𝑁, +) is an algebraic system.
• Similarly, (𝑄, +), (𝑍, . ), (𝑅, +), (𝐶, +) … are algebraic systems
General properties of algebraic system
Let (S, ∗ ) be an algebraic system, ∗ is the binary operation on S .
• Closure property – For all a,b ∈ S, a∗b∈S
• Associativity - For all a, b, c ∈ S , (a ∗ b) ∗ c = a ∗ (b ∗ c) ,
• Commutativity - For all a,b ∈ S, a∗b=b∗a
• Identity element – There exists an element e ∈ S, such that
for any a ∈ S, a ∗ e = e ∗ a =a
• Inverse element – For every a ∈ S , there exists some b ∈ S such that
a ∗ b = b ∗ a= e, then b is called the inverse element of a.
MODULE 2
• GROUP
• ABELIAN GROUP
• EXAMPLES
• ORDER OF GROUP
• ORDER OF ELEMENT
GROUPS
Definition : Group
If G is a non empty set and * is a binary operation on G, then the algebraic system {G, *}
is called a group if the following axioms are satisfied:
1) For all a,b ∈ S, a ∗ b ∈ S [Closure property]
2) For all a, b, c ∈ G, a ∗ b ∗ c = a ∗ (b ∗ c) (Associativity)
3) There exists an element e ∈ G such that, for any a ∈G, 𝑎∗e= e∗a= a
(Existence of identity)
4) For every a ∈G, there exists an element 𝑎−1 ∈ G such that
a ∗ 𝑎−1 = 𝑎−1 ∗ a = e (Existence of inverse)
Abelian group
The group (G, ∗ ) which has commutative property ,
for all a,b ∈ S, a ∗ b = b ∗ a , is called an abelian group.
• Finite/Infinite group
The group (G, ∗ ) is said to be finite or infinite according as the underlying set is finite or infinite.
• Order of a group
If (G, ∗ ) is a finite group , then the number of elements of G is the order of the group written as O(G) or |G|
• Order of an element
Let (G, ∗) be a group and a ∈ G, the least positive integer m, such that 𝑎𝑚 = 𝑒, the identity element of G, is
called order of a and is written as O(a)=m
Examples for Groups
1) The set (𝑍, +), of all integers under addition forms a group.
2) The set of all 2 x 2 non singular matrices over R is an abelian group under matrix
addition , but not abelian with respect to matrix multiplication as 𝐴𝐵 ≠ 𝐵𝐴
1 2 … 𝑛
𝑝=
𝑝(1) 𝑝(2) … 𝑝(𝑛)
1 2 3 4
For example 𝑝 =
3 4 2 1
If A has n elements 𝑆𝐴 has 𝑛! Permutations.
Permutation group
1 2 3 4 1 2 3 4
Let 𝑝1 = 𝑎𝑛𝑑 𝑝2 = , the composition of these two
1 4 2 3 3 2 4 1
permutations is defined as
1 2 3 4 1 2 3 4
𝑝1 ◦ 𝑝2 = ◦
1 4 2 3 3 2 4 1
1 2 3 4
=
3 1 2 4
MODULE 3
• PROPERTIES OF GROUPS
• PROBLEMS ON GROUPS
° p1 p2 p3 p4 p5 p6
p1 p1 p2 p3 p4 p5 p6
p2 p2 p1 p4 p3 P6 p5
p3 p3 p4 p1 p2 P4 p1
p4 p4 p3 p2 p1 p3 p2
p5 p5 p6 p4 p3 p1 p4
p6 p6 p5 p1 p2 p4 p1
• From the above table, for any two or three elements we can prove closure and
associative property.
• The identity element is 𝑝1 and the inverse of any element is the element itself.
Problems on Groups
4. Let a ≠ 0 be a fixed real number and G = {𝒂𝒏 : 𝒏 ∈ 𝒁}, 𝐏𝐫𝐨𝐯𝐞 𝐭𝐡𝐚𝐭 𝐆 is an abelian group under
multiplication .
Proof :
• Closed : if 𝑎𝑛1 , 𝑎𝑛2 ∈ G then 𝑎 ∗ 𝑏 = 𝑎𝑛1+𝑛2 ∈ G as n1+n2 ∈ Z
• Associativity : For 𝑎𝑛1 , 𝑎𝑛2 , 𝑎𝑛3 ∈ G
𝑎𝑛1 ∗ 𝑎𝑛2 ∗ 𝑎𝑛3 = 𝑎𝑛1 ∗ 𝑎𝑛2+𝑛3 = 𝑎𝑛1+𝑛2+𝑛3
(𝑎𝑛1 ∗ 𝑎𝑛2 ) ∗ 𝑎𝑛3 = 𝑎𝑛1+𝑛2 ∗ 𝑎𝑛3 = 𝑎𝑛1+𝑛2+𝑛3
• Identity element - 𝑎𝑛 ∗ 𝑎𝑒 = 𝑎𝑛
𝑎𝑛+𝑒 = 𝑎𝑛 implies 𝑒=0 and 𝑎𝑒 = 𝑎0 = 1 is the identity element
• Inverse element – for 𝑎 ∈ 𝑅, 𝑎𝑛 ∗ 𝑎𝑛1 = 𝑎0 => 𝑛 + 𝑛1 = 0 => 𝑛1 = −𝑛
𝑎𝑛1 = 𝑎−𝑛 is the inverse of 𝑎𝑛
5. For any group (G, *) if 𝒂𝟐 = 𝐞 with a ≠ e, then prove that G is abelian
[Or, if every element of a group (G, *) is its own inverse, then G is abelian]
Proof:
Let a2 = e .
Tℎ𝑒𝑛 a2 ∗ 𝑎−1 = 𝑎 ∗ 𝑎 ∗ 𝑎−1 = 𝑒 ∗ 𝑎−1 = 𝑎−1
a2 ∗ 𝑎−1 = 𝑎 ∗ (𝑎 ∗ 𝑎−1 ) = 𝑎 ∗ 𝑒 = 𝑎
implies 𝑎 = 𝑎−1
−1
Then for any 𝑎, 𝑏 ∈ 𝐺, 𝑎 ∗ 𝑏 =𝑎∗𝑏
𝑏 −1 ∗ 𝑎−1 = 𝑎 ∗ 𝑏
𝑏 ∗ 𝑎 = 𝑎 ∗ 𝑏 , G is abelian.
6. Let (𝑮,∗) be a group. Prove that G is abelian if and only if 𝒂 ∗ 𝒃 𝟐 = 𝒂𝟐 ∗ 𝒃𝟐
Proof:
Let G be abelian,
Consider 𝑎 ∗ 𝑏 2 = 𝑎 ∗ 𝑏 ∗ 𝑎 ∗ 𝑏
= 𝑎 ∗ (𝑏 ∗ 𝑎 ∗ 𝑏 ) [Associativity]
= 𝑎 ∗ ((𝑏 ∗ 𝑎) ∗ 𝑏)
= 𝑎 ∗ (𝑎 ∗ 𝑏) ∗ 𝑏 [ commutativity]
= (𝑎 ∗ 𝑎) ∗ 𝑏 ∗ 𝑏 = 𝑎2 ∗ 𝑏 2
Now , suppose 𝑎 ∗ 𝑏 2 = 𝑎2 ∗ 𝑏 2
𝑎 ∗ 𝑏 ∗ 𝑎 ∗ 𝑏 = (𝑎 ∗ 𝑎) ∗ 𝑏 ∗ 𝑏
𝑎 ∗ (𝑏 ∗ 𝑎 ∗ 𝑏 ) = 𝑎 ∗ (𝑎 ∗ 𝑏 ∗ 𝑏 )
𝑏∗ 𝑎∗𝑏 =𝑎∗ 𝑏∗𝑏
(𝑏 ∗ 𝑎) ∗ 𝑏 = (𝑎 ∗ 𝑏) ∗ 𝑏 [ Associativity]
𝑏 ∗ 𝑎 = 𝑎 ∗ 𝑏 ----commutative.
Thus G is abelian.
• Exercises :
1 0 −1 0 1 0 −1 0
1. The set , , , is an abelian group under matrix
0 1 0 1 0 −1 0 −1
multiplication.
2. The set {0,1,2,3,4} is a finite abelian group of order 5 under addition modulo 5.
• SUBGROUPS
• PROBLEMS ON SUBGROUPS
Problems on subgroups
1.The intersection of two subgroups of a group G is also a subgroup of G .
Proof:
Let 𝐻1 𝑎𝑛𝑑 𝐻2 be any two subgroups of G. 𝐻1 ∩ 𝐻2 is a non-empty set, since, at least the
identity element e is common to both 𝐻1 𝑎𝑛𝑑 𝐻2
Let 𝑎 ∈ 𝐻1 ∩ 𝐻2 , 𝑡ℎ𝑒𝑛 𝑎 ∈ 𝐻1 𝑎𝑛𝑑 𝑎 ∈ 𝐻2
Let 𝑏 ∈ 𝐻1 ∩ 𝐻2 , 𝑡ℎ𝑒𝑛 𝑏 ∈ 𝐻1 𝑎𝑛𝑑 𝑏 ∈ 𝐻2
𝐻1 is a subgroup of G, 𝑎 ∗ 𝑏 −1 ∈ 𝐻1 𝑎 𝑎𝑛𝑑 𝑏 ∈ 𝐻
𝐻2 is a subgroup of G, 𝑎 ∗ 𝑏 −1 ∈ 𝐻2 𝑎 𝑎𝑛𝑑 𝑏 ∈ 𝐻
∴ 𝑎 ∗ 𝑏 −1 ∈ 𝐻1 ∩ 𝐻2 implies 𝐻1 ∩ 𝐻2 is a subgroup of G.
SUBGROUPS
If {G, ∗} is a group and H ⊆ G is a non-empty subset of G, called subgroup of G , if H
itself forms a group .
Theorem:
The necessary and sufficient condition for a non empty subset H of a group {G, ∗} to be a
∴ 𝑥𝑦 2 = 𝑒. i.e 𝑥𝑦 ∈ 𝐻
Thus, if 𝑥, 𝑦 ∈ 𝐻, 𝑤𝑒 ℎ𝑎𝑣𝑒 𝑥𝑦 ∈ 𝐻 [closed]
Thus H is a subgroup.
• Cyclic groups
• Examples
• Properties
• Problems
Cyclic group
A group (G, ∗) is said to be a cyclic group if there exists an element a∈ 𝐺 such that every element of G can
be expressed as some integral power of a, a is called generator of G.
We write G=(a)
Examples :
1. Let G={1,-1, i, -i} and G is a group under multiplication. It is cyclic with the generator i
(i.e.) G=(i) or G=(-i)
2. Let G={1, 𝜔, 𝜔2 } is a cyclic group under multiplication generated by 𝜔 . 𝜔2 is also a generator.
• DEFINITION OF HOMOMORPHISM
• EXAMPLES OF HOMOMORPHISM
• PROPERTIES OF HOMOMORPHISM
DEFINITION OF HOMOMORPHISM
• Given two groups, (G, ∗) and (H, ·), a group homomorphism (morphism) from (G, ∗) to
(H, ·) is a function h : G → H such that for all u and v in G it holds that
ℎ(𝑢 ∗ 𝑣) = ℎ(𝑢) ⋅ ℎ(𝑣) for all u, v ϵ G
• Isomorphism: A group homomorphism that is bijective; i.e., injective and surjective.
Its inverse is also a group homomorphism.
• In this case, the groups G and H are called isomorphic; they differ only in the notation of
their elements and are identical for all practical purposes
• (G, ∗) and (H, ·) are isomorphic – there is an isomorphism between (G, ∗) and (H, ·)and
it is denoted by (G, ∗) ≅ (H, ·)
EXAMPLES OF HOMOMORPHISM
1. Every isomorphism is a homomorphism with Ker = {e}.
is a homomorphism.
PROPERTIES OF HOMOMORPHISM
(i) f(e) =e’ where e and e’are the identity elements of G and G’ respectively
𝑢 −𝑣
Let H = { | 𝑢, 𝑣 ∈ ℂ} with usual addition (+) and multiplication (∙) on matrices.
𝑣 𝑢
Then (H,+, ∙) is a non-commutative division ring.
1 0
Proof. It is clear that (H,+, ∙) is a subring of the ring (M2(ℂ),+, ∙) and is the
0 1
identity element of the ring (H,+, ∙) . The ring (H,+, ∙) is non-commutative, since if A =
0 1 𝑖 0 0 1 𝑖 0 0 −𝑖 0 𝑖
and B = , then A.B = . = ≠ B.A = .
−1 0 0 −𝑖 −1 0 0 −𝑖 −𝑖 0 𝑖 0
The non-zero elements of H are invertible.
𝑢 𝑣
𝑢 −𝑣 0 0 𝑢𝑢+𝑣𝑣 𝑢𝑢+𝑣𝑣
Let A = ∈ H with A ≠ . Let B = −𝑣 𝑢 . Since B ∈ H
𝑣 𝑢 0 0
𝑢𝑢+𝑣𝑣 𝑢𝑢+𝑣𝑣
𝑢 𝑣
1 0 𝑢𝑢+𝑣𝑣 𝑢𝑢+𝑣𝑣
and A.B = B.A = , we have A is invertible and A −1 = −𝑣 𝑢 .
0 1
𝑢𝑢+𝑣𝑣 𝑢𝑢+𝑣𝑣
Example:
𝑢 −𝑣
1. Let H = { | 𝑢, 𝑣 ∈ ℂ} with usual addition (+) and multiplication (∙)
𝑣 𝑢
on matrices. Then (H,+,∙) is a non-commutative division ring (Hamilton’s
quaternions ring) and hence it is not a field.
(⇐) Suppose that n is a prime number. By Theorem (The ring (ℤ p,+p,∙𝑝 ) has no zero
divisor if and only if p is a prime integer number), the ring (ℤ n,+n,∙𝑛 ) has no zero
divisor. Since (ℤ n,+n,∙𝑛 ) is a commutative ring with identity, we have (ℤ n,+n,∙𝑛 ) is an
integral domain. Since the ring (ℤ n,+n,∙𝑛 ) is finite, we have from Theorem (Every
finite integral domain is a field ) that (ℤ n,+n,∙𝑛 ) is a field.
Coding Theory – Encoders and
decoders- Hamming codes
Encoder: It is a device or process which converts(transforms) data(messages) in such a
way that the presence of noise in the transformed messages is detectable.
Decoder: It is a device or process which converts(transforms) the encoded
data(message
s) into their original form that can be understood by the receiver.
block code that is capable of detecting up to two simultaneous bit errors and
correcting single-bit errors.
Error detection using single parity check involves the following steps:-
At sender side,
The newly formed code word (Original data + parity bit) is transmitted to the
receiver
Error detection using single parity check involves the following steps:-
At receiver side,
Receiver receives the transmitted code word.
The total number of 1’s in the received code word is counted.
If total number of 1’s is even and even parity is used, then receiver assumes that
no error occurred.
If total number of 1’s is even and odd parity is used, then receiver assumes that
error occurred.
If total number of 1’s is odd and odd parity is used, then receiver assumes that
no error occurred.
If total number of 1’s is odd and even parity is used, then receiver assumes that
error occurred
Parity Check Example:-
ASCII(AMERICAN STANDARD CODE INFORMATION
INTERCHANGE
Hamming Codes:
If the original message is a binary string of length m, the Hamming encoded
message is string of length n (n>m).
m digits represent the information part of the message and the remaining (n-
m) digits are for the detection and correction of errors in the message
received.
In Hamming’s single error detecting code of length n, the first (n-1) digits
contain the information part of the message and the last digit is made either 0
or 1.
Even Parity Check:-
The extra digit introduced in the last position of the encoded word of length
n, gives an even number of 1’s
Odd Parity Check:-
The extra digit introduced in the last position of the encoded word of length
n, gives an odd number of 1’s
Weight of the Binary string:-
The number of 1’s in the binary string 𝑥 ∈ 𝐵2 . It is denoted by |x|.
Hamming Distance:-
If x1,x2,…. xn = (x1,x2,…. xn ) and y1,y2,…. yn = (y1,y2,…. yn ) ϵ Bn , the
number of positions in the strings for which xi≠ yi is called the Hamming
Distance between x and y. It is denoted by H(x,y)
H(x,y) = weight of x y = 𝑛𝑖=1(𝑥𝑖 +2 y𝑖 )
Example of Hamming Distance:-
If x= 11010 and y = 10101,then H(x,y) = 𝑥 𝑦 = 01111 = 4
The minimum distance of a code (a set of encoded words) is the minimum of
the Hamming distances between all pairs of encoded words in the code.
For example: If x = 10110, y = 11110 and z = 10011, then H(x,y) = 1, H(y,z)
= 3, H(z,x) = 2 and so the minimum distance between these code words is 1.
Theorem:1. A code(an(m,n)encoding function)can detect at the most k
errors if and only if the minimum distance between any two code words is at
least (k+1)
Example:
Let x= 000 and y = 111 be the encoded words (two values of encoding
function)
H(x,y) =| 3𝑖=1(𝑥𝑖 +2 y𝑖 )| = 3
In x = 000,one error occurs, the received word could be 100 or 001 or 010.
In y = 111, one error occurs, the received word could be 011 or 101 or 110
The two sets of received words {100 , 001 , 010}and {011 , 101 , 110} are
distinct
Hence, if any of the above six words is received due to one error, it is easily
found out which encoded word has get altered and in which digit position the
error has occurred and hence, the error is corrected.
If two error occur during transmission,
the word 000 would have been received as 110 or 011 or 101
the word 111 would have been received as 100 or 001 or 100
If an error in single digit is corrected in any of received word 110 or 011 or
101, the corrected word would be 111, which is not the transmitted word.
Similarly, If an error in single digit is corrected in any of received word 100
or 001 or 100, the corrected word would be 000, which is not the transmitted
word.
Theorem:2. A code can correct a set of at most k errors iff the
minimum distance between any two code words is at least (2k+1)
Example:
Let x= 000 and y = 111 be the encoded words (two values of encoding
function)
H(x,y) =| 3𝑖=1(𝑥𝑖 +2 y𝑖 )| = 3
In x = 000, during transmission zero or one error occurs, the received word
could be 000 or 100 or 001 or 010.
In y = 111, during transmission zero one error occurs, the received word
could be 111 or 011 or 101 or 110
The two sets of received words {000,100 , 001 , 010}and {111,011 , 101 ,
110} are distinct
So whatever words received, the single or no error can be easily detected and
corrected.
Basic Notions of Error Correction using Matrices:-
Generator Matrix:
Let 𝑒: 𝐵𝑚 → 𝐵𝑛 be the encoding function with m<n, m,n ∈ 𝑧 + and B = {0,1}.
Consider the m x n matrix G over B. This matrix G is called the generator
matrix for the code
It is of the form [Im|A], Im is the m x m unit matrix and A is an m x (n-m)
matrix to be chosen suitably.
If w is a message in Bm, then e(w) = wG and the code (the set of code words)
C = e( Bm )⊆ Bn, where w is a (1 x m) vector
If w is a message in B2,
1 0 11 0
Assume G =
0 1 01 1
• B2 = {00,01,10,11}
• Code words corresponding to above message are
1 0 1 1 0
• e(00) = 0 0 = 0 0 00 0
0 1 0 1 1
1 0 1 1 0
• e(10) = 1 0 = 1 0 11 0
0 1 0 1 1
1 0 1 1 0
• e(01) = 0 1 = 0 1 01 1
0 1 0 1 1
1 0 1 1 0
• e(11) = 1 1 = 1 1 10 1
0 1 0 1 1
• Clearly C = e( B2 )⊆ B5
Problems:
1 0 0 1 1 0
1. Given the generator matrix 𝐺 = 0 1 0 0 1 1 corresponding to the
0 0 1 1 0 1
3 6
encoding function 𝑒: 𝐵 → 𝐵 ,find the corresponding parity check matrix
and use it to decode the following received words and hence, to find the
original message. Are all the words decoded uniquely?
(i) 110101 (ii) 001111 (iii) 110001 (iv) 111111
Solution: If we assume the G = [I3|A], I3 is the 3 x 3 unit matrix, then
1 0 0 1 0 0
H= [AT| I3] = 1 1 0 0 1 0
0 1 1 0 0 1
Compute the syndrome of each of the received word by using H∙ [𝑟] 𝑇
1
1
1 0 0 1 0 0 0
𝑇 𝑇 0
(i) H∙ [𝑟] = H∙ [𝑒(𝑤)] = 1 1 0 0 1 0 = 0 , Received word is the
1
0 1 1 0 0 1 0
0
transmitted word itself and the original message1is 110
0
0
1 0 0 1 0 0 0
𝑇 𝑇 1
(ii) H∙ [𝑟] = H∙ [𝑒(𝑤)] = 1 1 0 0 1 0 = 1 , Received word is the fifth
1
0 1 1 0 0 1 0
1
1
column of H, the element in the fifth position of r is changed, Therefore, the
decoded word is 001101 and the original message is 001.
1
1
1 0 0 1 0 0 1
𝑇 𝑇 0
(iii) H∙ [𝑟] = H∙ [𝑒(𝑤)] = 1 1 0 0 1 0 = 0 , Received word is the
0
0 1 1 0 0 1 0
0
1 position of r is changed,
fourth column of H, the element in the fourth
Therefore, the decoded word is 110101 and the original message is 110
1
1
1 0 0 1 0 0 1
𝑇 𝑇 1
(iv) H∙ [𝑟] = H∙ [𝑒(𝑤)] = 1 1 0 0 1 0 = 1 , Received word is not
1
0 1 1 0 0 1 1
1
identical with any column of H, the received1word cannot be decoded
uniquely.