Linear Algebra by Nayak
Linear Algebra by Nayak
PREFACE
Linear Algebra plays an important role in the spheres of Mathematics, Physics, and
Engineering due to their inherent viabilities. The aim of this text book is to give rigorous
and thorough analysis and applications of various aspects of Linear algebra and analysis with
applications. Also, the present book has been designed in a lucid and coherent manner so
that the Honours and Postgraduate students of various Universities may reap considerable
benefit out of it. I have chosen the topics with great care and have tried to present them
systematically with various examples.
The author expresses his sincere gratitude to his teacher Prof. S. Das, Department
of Mathematics, R. K. Mission Residential College, Narendrapur, India, who taught him
this course at the UG level. Author is thankful to his friends and colleagues, especially,
Dr. S. Bandyopadhyay, Mr. Utpal Samanta and Mr. Arup Mukhopadhyay of Bankura
Christian College, Dr. Jayanta Majumdar, Durgapur Govt. College, Pratikhan Mandal,
Durgapur Govt. College, for their great help and valuable suggestions in the preparation
of the book. Author also extends his thanks to Prof. (Dr.) Madhumangal Pal, Dept. of
Applied Mathematics, Vidyasagar University, for his encouragement and handy suggestions.
This book could not have been completed without the loving support and encouragement
of my parents, wife (Mousumi) and son (Bubai). I extend my thanks to other well wishers
relatives and students for embalming me to sustain enthusiasm for this book. Finally, I
express my gratitude to Books and Allied (P) Ltd., specially Amit Ganguly, for bringing
out this book.
I would like to thank to Dr. Sk. Md. Abu Nayeem of Aliah University, West Bengal and
my student Mr. Buddhadeb Roy for support in writing/typing in LaTex verision.
This book could not have been completed without the loving support and encouragement
of my parents, wife (Mousumi) and son (Bubai). I extend my thanks to other well wishers
relatives and students for embalming me to sustain enthusiasm for this book. Finally, I
express my gratitude to Asian Books Private Limited, Delhi, for bringing out this book.
Critical evaluation, suggestions and comments for further improvement of the book will
be appreciated and gratefully acknowledged.
Prasun Kumar Nayak ,
(nayak [email protected])
Bankura Christian College,
Bankura, India, 722 101.
Dedicated to my parents
Sankar Nath Nayak and Mrs. Indrani Nayak
for their continuous encouragement and support..
Contents
1 Theory of Sets
1.1 Sets . . . . . . . . . . . . . . . . . . . .
1.1.1 Description of Sets . . . . . . . .
1.1.2 Types of Sets . . . . . . . . . . .
1.2 Algebraic Operation on Sets . . . . . . .
1.2.1 Union of Sets . . . . . . . . . . .
1.2.2 Intersection of Sets . . . . . . .
1.2.3 Disjoint Sets . . . . . . . . . . .
1.2.4 Complement of a Set . . . . . . .
1.2.5 Difference . . . . . . . . . . . . .
1.2.6 Symmetric Difference . . . . . .
1.3 Duality and Algebra Sets . . . . . . . .
1.4 Cartesian Product of Sets . . . . . . . .
1.5 Cardinal Numbers . . . . . . . . . . . .
1.6 Relation . . . . . . . . . . . . . . . . . .
1.6.1 Equivalence Relation . . . . . . .
1.7 Equivalence Class . . . . . . . . . . . . .
1.7.1 Partitions . . . . . . . . . . . . .
1.8 Poset . . . . . . . . . . . . . . . . . . . .
1.8.1 Dual Order . . . . . . . . . . . .
1.8.2 Chain . . . . . . . . . . . . . . .
1.8.3 Universal Bounds . . . . . . . . .
1.8.4 Covering Relation . . . . . . . .
1.8.5 Maximal and Minimal Elements
1.8.6 Supremum and Infimum . . . . .
1.9 Lattices . . . . . . . . . . . . . . . . . .
1.9.1 Lattice Algebra . . . . . . . . . .
1.9.2 Sublattices . . . . . . . . . . . .
1.9.3 Bounded Lattices . . . . . . . . .
1.9.4 Distributive Lattices . . . . . . .
1.9.5 Trivially Complement . . . . . .
1.10 Mapping . . . . . . . . . . . . . . . . . .
1.10.1 Types of Functions . . . . . . . .
1.10.2 Composite mapping . . . . . . .
1.11 Permutation . . . . . . . . . . . . . . . .
1.11.1 Equal permutations . . . . . . .
1.11.2 Identity permutation . . . . . . .
1.11.3 Product of permutations . . . . .
1.11.4 Inverse of permutations . . . . .
iii
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
1
1
2
3
6
6
7
8
9
10
11
11
15
18
20
22
30
31
34
35
36
36
37
38
40
42
44
45
45
45
46
47
48
57
63
63
63
63
64
iv
CONTENTS
1.11.5 Cyclic permutation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 65
1.12 Enumerable Set . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 67
2 Theory of Numbers
2.1 Number System . . . . . . . . . . . . . . .
2.1.1 Non-positional Number System . . .
2.1.2 Positional Number System . . . . .
2.2 Natural Number . . . . . . . . . . . . . . .
2.2.1 Basic Properties . . . . . . . . . . .
2.2.2 Well Ordering Principle . . . . . . .
2.2.3 Mathematical Induction . . . . . . .
2.3 Integers . . . . . . . . . . . . . . . . . . . .
2.3.1 Divisibility . . . . . . . . . . . . . .
2.3.2 Division Algorithm . . . . . . . . . .
2.4 Common Divisor . . . . . . . . . . . . . . .
2.4.1 Greatest Common Divisor . . . . . .
2.5 Common Multiple . . . . . . . . . . . . . .
2.5.1 Lowest Common Multiple . . . . . .
2.6 Diophantine Equations . . . . . . . . . . . .
2.6.1 Linear Diophantine Equations . . . .
2.7 Prime Numbers . . . . . . . . . . . . . . . .
2.7.1 Relatively Prime Numbers . . . . . .
2.7.2 Fundamental Theorem of Arithmetic
2.8 Modular/Congruence System . . . . . . . .
2.8.1 Elementary Properties . . . . . . . .
2.8.2 Complete Set of Residues . . . . . .
2.8.3 Reduced Residue System . . . . . .
2.8.4 Linear Congruences . . . . . . . . .
2.8.5 Simultaneous Linear Congruences .
2.8.6 Inverse of a Modulo m . . . . . . . .
2.9 Fermats Theorem . . . . . . . . . . . . . .
2.9.1 Wilsons Theorem . . . . . . . . . .
2.10 Arithmetic Functions . . . . . . . . . . . . .
2.10.1 Eulers Phi Function . . . . . . . . .
2.10.2 The Mobius Function: . . . . . . . .
2.10.3 Divisor Function . . . . . . . . . . .
2.10.4 Floor and Ceiling Functions . . . . .
2.10.5 Mod Function . . . . . . . . . . . . .
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
83
83
83
84
85
85
85
86
89
90
92
94
95
97
97
99
99
102
103
108
111
111
117
121
122
125
130
131
133
136
136
141
143
144
144
3 Theory of Matrices
3.1 Matrix . . . . . . . . . . . .
3.1.1 Special Matrices . . .
3.1.2 Square Matrix . . . .
3.2 Matrix Operations . . . . . .
3.2.1 Equality of matrices .
3.2.2 Matrix Addition . . .
3.2.3 Matrix Multiplication
3.2.4 Transpose of a Matrix
3.3 Few Matrices . . . . . . . . .
3.3.1 Nilpotent Matrix . . .
3.3.2 Idempotent Matrix . .
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
149
149
149
150
153
153
153
154
160
161
161
162
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
CONTENTS
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
163
163
163
164
165
166
171
181
183
184
186
186
189
190
190
191
192
192
192
195
195
201
202
205
206
206
207
208
208
209
211
212
213
216
218
220
220
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
235
235
240
246
247
247
249
251
252
257
262
277
278
vi
CONTENTS
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
278
279
279
281
283
5 Linear Transformations
5.1 Linear Transformations . . . . . . . . . . . . . .
5.1.1 Kernal of Linear Mapping . . . . . . . . .
5.1.2 Image of Linear Mapping . . . . . . . . .
5.2 Isomorphism . . . . . . . . . . . . . . . . . . . .
5.3 Vector Space of Linear Transformation . . . . . .
5.3.1 Product of Linear Mappings . . . . . . . .
5.3.2 Invertible Mapping . . . . . . . . . . . . .
5.4 Singular and Non-singular Transformation . . . .
5.5 Linear Operator . . . . . . . . . . . . . . . . . .
5.6 Matrix Representation of Linear Transformation
5.7 Orthogonal Linear Transformation . . . . . . . .
5.8 Linear Functional . . . . . . . . . . . . . . . . . .
5.8.1 Dual Space . . . . . . . . . . . . . . . . .
5.8.2 Second Dual Space . . . . . . . . . . . . .
5.8.3 Annihilators . . . . . . . . . . . . . . . . .
5.9 Transpose of a Linear Mapping . . . . . . . . . .
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
293
293
297
300
311
316
318
321
324
326
327
341
344
345
349
350
354
4.7
4.8
4.6.2 Co-ordinates . . . . . . .
Rank of a Matrix . . . . . . . . .
4.7.1 Row Space of a Matrix . .
4.7.2 Column Space of a Matrix
Isomorphic . . . . . . . . . . . .
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
365
365
365
366
369
374
375
376
377
380
7 Matrix Eigenfunctions
7.1 Matrix Polynomial . . . . . . . . . .
7.1.1 Polynomials of Matrices . . .
7.1.2 Matrices and Linear Operator
7.2 Characteristic Polynomial . . . . . .
7.2.1 Eigen Value . . . . . . . . . .
7.2.2 Eigen Vector . . . . . . . . .
7.2.3 Eigen Space . . . . . . . . . .
7.3 Diagonalization . . . . . . . . . . . .
7.3.1 Orthogonal Diagonalisation .
7.4 Minimal Polynomial . . . . . . . . .
7.5 Bilinear Forms . . . . . . . . . . . .
7.5.1 Real Quadratic Forms . . . .
7.6 Canonical Form . . . . . . . . . . . .
7.6.1 Jordan Canonical Form . . .
7.7 Functions of Matrix . . . . . . . . .
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
395
395
395
396
396
398
398
410
413
417
420
425
425
427
435
439
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
CONTENTS
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
440
441
443
443
445
446
8 Boolean Algebra
8.1 Operation . . . . . . . . . . . . . . . . . . . . .
8.1.1 Unary Operation . . . . . . . . . . . . .
8.1.2 Binary Operation . . . . . . . . . . . . .
8.2 Boolean Algebra . . . . . . . . . . . . . . . . .
8.2.1 Boolean Algebra as a Lattice . . . . . .
8.2.2 Boolean Algebra as an Algebraic System
8.2.3 Boolean Algebra Rules . . . . . . . . . .
8.2.4 Duality . . . . . . . . . . . . . . . . . .
8.2.5 Partial Order Relation . . . . . . . . . .
8.3 Boolean Function . . . . . . . . . . . . . . . . .
8.3.1 Constant . . . . . . . . . . . . . . . . .
8.3.2 Literal . . . . . . . . . . . . . . . . . . .
8.3.3 Variable . . . . . . . . . . . . . . . . . .
8.3.4 Monomial . . . . . . . . . . . . . . . . .
8.3.5 Polynomial . . . . . . . . . . . . . . . .
8.3.6 Factor . . . . . . . . . . . . . . . . . . .
8.3.7 Boolean Function . . . . . . . . . . . . .
8.4 Truth Table . . . . . . . . . . . . . . . . . . .
8.5 Disjunctive Normal Form . . . . . . . . . . . .
8.5.1 Complete DNF . . . . . . . . . . . . . .
8.6 Conjunctive Normal Form . . . . . . . . . . . .
8.6.1 Complete CNF . . . . . . . . . . . . . .
8.7 Switching Circuit . . . . . . . . . . . . . . . . .
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
455
455
455
455
455
455
456
460
461
466
467
467
467
468
468
468
468
468
469
470
470
472
472
475
7.8
7.9
vii
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
Chapter 1
Theory of Sets
George Cantor gave an intuitive definition of sets in 1895. Sets are building blocks of various
discrete structures. The theory of sets is one of the most important tools of mathematics.
The main aim of this chapter is to discuss some properties of sets.
1.1
Sets
A well defined collection of distinct object is defined as set. Each object is known as an
element or member of a set. The following are some examples of the set.
(i) All integers.
(ii) The positive rational numbers less than or equal to 5.
(iii) The planet in solar system.
(iv) Indian rivers.
(v) 4th semester B.Sc. students of Burdwan University.
(vi) The peoples in particular locality.
(vii) Cricketers in the world.
By the term well defined, we mean that we are given a collection of objects with certain
definite property or properties, given in such a way that we are clearly able to distinguish
whether a given object is our collection or not. The following collections are not examples
of set.
(i) Good students of a class, because good is not well-defined word, a student may be
good for particular people, but he/she may not be good for other people.
(ii) Tall students, tall is not well-defined measurement.
(iii) Girls and boys of a particular locality, because there is no sharp boundary of age for
which a female can surely identify.
These type of collections are designated as fuzzy sets. The elements of a set must be
distinct and distinguishable. By distinct, it means that no element is repeated, and by
distinguishable, means there is no doubt whether an element is either in the set or not in
the set.
(i) The standard mathematical symbols used to represent sets are upper-case letters like
A, B, X, etc. and the elements of the set can be written in lower-case letters like a,
b, p, q, x, y, etc.
(ii) If an element x is a member of a set A, we write x A, read as x belongs to A or
a is an element of S or a is in S. The symbol is a Greek alphabet epsilon. On
1
Theory of Sets
the other hand, if x is not the element of A, then we write x 6 A , which is read as x
does not belong to A or x is not an element of the set A.
1.1.1
Description of Sets
As a set is determined by its elements, we have specify the elements of set A in order to
define A. Five common methods are used to describe the sets, they are (i) roster or list or
enumeration or tabular method, and (ii) selector or rule or set-builder property method (iii)
The characteristics method and (iv) Diagrammatic method.
(i) Roster method
In this method, all elements are listed explicitly separated by commas and are enclosed
within braces { }. Sometimes parenthesis ( ) or square [ ] may also be used.
A set is defined by naming all its members and can be used only for finite sets. Let X,
whose elements are x1 , x2 , , xn is usually written as X = {x1 , x2 , , xn }. For examples,
the set of all natural numbers less than 5 can be represented as A = {1, 2, 3, 4}.
Sometimes, it is not humanly possible to enumerate all elements, but after knowing some
initial elements one can guess the other elements. In this case dots are used at the end within
the braces. For an example, set of positive integers can be written as A = {1, 2, 3, 4, },
set of all integers B = {. . . , 2, 1, 0, 1, 2, . . .}, etc.
It may be noted that the elements of a set can be written in any order, but the name
of an element is listed only once. For example, {2,3,4}, {4,3,2}, {2,4,3} all represent the
same set. Thus, while we describe a set in this manner, the order of the elements is not
important.
(ii) Set-builder method
In this method, a set can be specified by stating one or more properties, which uniquely
satisfy by the elements. A set in this method is written as
A = {x : P1 (x) or P2 (x), etc},
(1.1)
i.e., x A if x satisfy the properties P1 (x), P2 (x), etc. The symbol : is read as such
that, it is also denoted by or /. For example,
A = {x : x is a positive even integers }
B = {x : x is a vowel in English alphabet }
C = {x : x is integer and 1 x 10} etc .
It is required that the property P be such that for any given x U , the universal set, the
proposition P (x) is either true of false.
(iii) The characteristics method
A set is defined by a function, usually called a characteristic function, that declares which
elements of U are members of the set and which are not. Let U = {u1 , u2 , . . . , un } be the
universal set and A U . Then the characteristic
function of A is defined as
1, if ui A
A (ui ) =
(1.2)
0, if ui 6 A.
Sets
i.e., the characteristic function maps elements of U to elements of the set {0, 1}, which
is formally expressed by A : U {0, 1}. For example, let U = {1, 2, 3, . . . , 10} and A =
{2, 4, 6, 8, 10}, then A (2) = 1, A (4) = 1, A (6) = 1, A (8) = 1, A (10) = 1 and A (a) = 0
for all other elements of U . It may be observed that A is onto function but not one-one.
(iv) Diagrammatic method
A set can be represented diagrammatically by closed figures like circles, triangles, rectangles,
etc. The point in the interior of the figure represents the elements of the set. Such a representation is called a Venn diagram or Venn-Euler diagram, after the British mathematician
Venn. In this diagram the universal set U is represented by the interior of a rectangle and
each subset of U is represented by the circle inside the rectangle.
If two sets are equal then they represent by same circle. If the sets A and B are disjoint
then the circles for A and B are drawn in such a way that they have no common area, If
the sets A and B have a small common area. If A B then the circle for A is drawn fully
inside the circle for B. This visual representation helps us to prove the set identities very
easily.
(v) Recursion method
A set can be described by giving one or more elements of the set and a rule for generating
the remaining elements. The underlying process is called recursion. For example, (a) the
set A = {1, 4, 7, } can be described as A = {a0 = 1, an+1 = an + 3}; (b) F = {Fn : F0 =
0, F1 = 1, Fn = Fn1 + Fn2 } is a set described by recursion. This set is called the set of
Fibonacci numbers.
Some standard sets and their notations
Some sets are frequently used in mathematical analysis or in algebraic structure, which are
stated below.
N The set of all natural numbers.
Z The set of all integers.
Z + The set of all positive integer.
Q The set of all rational numbers.
Q+ The set of all positive rational numbers.
R The set of all real numbers.
R+ The set of all positive real numbers.
C The set of all complex numbers.
1.1.2
Types of Sets
Null set
A set which contains no element is called null set or empty set or void set and is denoted by
the Greek alphabet (read as phi). In Roaster method, it is denoted by {}. For example,
A = {x : x2 + 4 = 0 and x R}
is a null set. To describe the null set, we can use any property, which is not true for any
element. It may be noted that the set {} or {0} is not a null set.
A set which is not a null set, is called non-empty set.
Singleton set
A set consisting only a single element is called a singleton or unit set. For example, A = {0},
B ={x: 1 < x < 3, x is integer}, the solution set C = {x : x 2 = 0} = {2} etc., are
examples of singleton set. Note that {0} is not a null set, since it contains 0 as its member,
it is singleton set.
Theory of Sets
(1.3)
Sets
Proper subset
The set A is called proper subset of B if every element of A is a member of B and there is
at least one element in B such that it is not in the set A. It is written as A B. Therefore,
B is the proper subset of A if
(i) x B = x A
(ii) y A such that y
/ B.
In this case, B A and A 6= B and B is said to the proper subset of A and is denoted by
B A. If B is the subset of A(i.e. B A) A is called the super set of B. For example,
(i) {1, 2} is the proper subset of {1, 2, 3, 4}.
(ii) The set of vowels is a proper subset of the set of English alphabet
(iii) N (set of natural numbers) is a proper subset of Z (set of integers).
Note the following:
(i) If even a single element in A which is not in B, then A is not a subset of B and we
write A 6 B. For example {1, 2} 6 {2, 4, 6, 8, 9}.
(ii) If A B or B A, then the sets A and B are said to be comparable. For example,
if A = {1, 2}, B = {5, 6, 7} then A 6 B and these are not comparable.
(iii) Every set is a subset of itself and every set is a subset of the universal set.
(iv) has no proper subset. Also, A A = .
(v) For any set A, A A. This is known as the reflexive law of inclusion.
(vi) If A B and B C, then A C. This is known as transitive law of inclusion.
In Venn diagram, the universal set is usually represented by a rectangular region and its
subset by closed bounded regions inside the rectangular region.
Equality of sets
If A B and B A, then A and B contain the same members. Two sets A and B are
said to be equal if every element of A is an element of B and also every element of B is an
element of A. That is, A B and B A. The equality, of two sets is denoted by A = B.
Conversely, if A = B then A B and B A must be satisfied. For example, A = {1, 4, 9}
and B = {4, 9, 1} are equal sets. To indicate that A and B are not equal, we write A 6= B.
Theorem 1.1.1 The null set is a subset of every set.
Proof: Let A be an arbitrary set. Then, in order to show that A, we must show that
there is no element of which is not contained in A. Since contains no element at all, no
such element can therefore be found. Hence, A.
Theorem 1.1.2 The number of subsets of a given set containing n elements is 2n .
Proof: Let A be an arbitrary set containing n elements. Then, one of its subsets is the
empty set. Apart from this,
(i) The number of subsets of A, each containing 1 element = n1 .
(ii) The number of subsets of A, each containing 2 elements = n2 .
Theory of Sets
n
3
n
n
1.2
Like addition, multiplication and other operations on numbers in arithmetic, there are certain operations on sets, namely union, intersection, complementation, etc. In this section,
we shall discuss several ways of combining different sets and develop some properties among
them.
1.2.1
Union of Sets
Let A and B be two given subsets of an universal set U . Union (or join) of two subsets A
and B, denoted by A B, is defined by
A B = {x : x A or x B or both},
(1.4)
here the or is means and/or, i.e. the set contains the elements which either belong to A
or B or both. The Venn diagram of Fig. 1.1 illustrate pictorially the meaning of , where
U is the rectangular area, and A and B are disks. Union is also known as join or logical sum
of A and B. Note that, the common elements are to be taken only once. For example,
1.2.2
Intersection of Sets
Let A and B be two given subsets of an universal set U . The intersection of A and B is
denoted by A B and is defined by
A B = {x : x A and x B}.
(1.5)
The intersection of the sets A and B is the set of all elements which are in both the sets A
and B. The AB is shown in Fig. 1.2. The intersection is also known as meet. AB is read
as A intersection B or A meet B. For example, (i) let A ={2, 5, 6, 8} and B ={2, 6, 8, 9, 10}
then A B ={2, 6, 8} (ii) if A = [2, 5] and B = [1, 3], then A B = [2, 3] = {x : 2 x 3}.
From the Venn diagram we get the following properties of intersection:
Theory of Sets
A U = A: identity law.
,
.
2
2 6
1.2.3
3
2
Disjoint Sets
It is sometimes observed that the intersection between two non-empty sets produced a null
set. In this case, no element is common in A and B and these two sets are called disjoint
or mutually exclusive sets. Thus two sets A and B are said to be disjoint if and only if
A B = , i.e. they have no element in common. Then Venn diagram of disjoint sets A and
B is shown in Fig. 1.3. For example, (i) A = {1, 2, 3} and B = {6, 7, 9} and (ii) if A ={x:
x is even integer} and B ={x: x is odd integer} then A B = , i.e., A and B are disjoint.
When A B 6= , the sets A and B are said to be intersecting.
Note 1.2.1 The three relations B A, A B = A and A B = B are mutually equivalent,
i.e., one implies the other two.
1.2.4
Complement of a Set
(1.6)
i.e., the set contains the elements which belong to the universal set U but not elements of
A. The venn diagram of Ac is shown in Fig. 1.4. Clearly, if A0 is the complement of A, then
#
A
"!
Ac
Figure 1.4: Complement of A
A is a complement of A0 . For example, let A = {1, 3, 5, 7, 9}, if U = {1, 2, 3, 4, 5, 6, 7, 8, 9}
then A0 = {2, 4, 6, 8}. From Venn diagram we have
(i) (A0 )0 = A : involution property.
(ii) U 0 = ; 0 = U .
(iii) If A B then B c Ac and conversely, if Ac B c then B A.
(iv) A A0 = U : law of excluded middle.
A A0 = : law of contradiction.
i=1
i=1
i=1
10
1.2.5
Theory of Sets
Difference
Let A, B be any two subsets of an universal set U . The difference of two subsets A and B
of an universal set U is a subset of A, denoted by A B or A/B and is defined by
A B = {x : x A and x
/ B},
(1.7)
i.e., the set containing of those elements of A which are not elements of B. Also
B A = {x : x B and x 6 A}.
(1.8)
This is also called the relative component of the set B with respect to the set A. A B is
called the complement of B relative to A. The differences A B and B A are shown in
B
6
AB
6
BA
x A and x 6 (B C)}
x A and (x 6 B or x 6 C)}
(x A and x 6 B) or (x A and x C)}
x (A B) or x (A C)} = (A B) (A C).
1.2.6
11
Symmetric Difference
}
A4B
Figure 1.6: Symmetric difference of A and B (shaded ares)
then, AB = {1, 3, 4, 8}. Note that,
(A B) (B A) = (A B 0 ) (B A0 )
= A (B B 0 ) A0
= (A ) A0 = A A0 = .
Therefore, A 4 B can be considered as the union of disjoint subsets A B and B A,
provided A B and B A are both non empty. From the definition, we have the following,
(i) Symmetric difference is commutative, i.e., AB = BA,
(ii) Symmetric difference is associative, i.e., (AB)C = A(BC),
(iii) A = A, for all subsets of A.
(iv) AA = , for all subsets of A.
(v) AB = iff A = B,
(vi) A (B 4 C) = (A B) 4 (A C) : Distributive property.
1.3
Principle of duality
Let E is an equation(or law) of set algebra (involving , , U , ). If we replace by ,
by , U by and by U in E then we obtain E another law, which is also a valid law.
This is known as principle of duality. For example,
12
Theory of Sets
13
14
Theory of Sets
15
1.4
Let A and B are two nonempty sets. An order pair consists of two elements, say a A
and b B, and it is denoted by (a, b). The element a is called the first element or first
coordinate and the element b is called the second element or second coordinate. The ordered
pairs (a, b) and (b, a) are distinct unless a = b. Thus (a, a) is a well-defined ordered pair.
If a, c A and b, d B, two ordered pairs (a, b) and (c, d) are said to be equal, i.e.,
(a, b) = (c, d) if and only if a = c and b = d.
An order triple is ordered triple of objects (a, b, c) where a is first, b is second and c is
third element of triple. An order triple can also be written in terms of ordered pairs as
{(a, b), c}. Similarly, ordered quadruple is an ordered pair {((a, b), c), d} with first element
as ordered pair.
Definition 1.4.1 Let A and B be any two finite sets. The cartesian product (or cross
product or direct product) of A and B, denoted by A B, (read as A cross B), is the set
defined by,
n
o
A B = (x, y)|x A and y B
16
Theory of Sets
i.e., A B is the set of all distinct order pairs (x, y), the first element of the pair is an
element of A and the second is an element of B. For example, let A ={a, b} and B ={1, 2,
3}. Then
A B ={(a, 1), (a, 2), (a, 3), (b, 1), (b, 2), (b, 3)} and
B A ={(1, a), (2, a), (3, a), (1, b), (2, b), (3, b)}.
The geometric representation of A B is depicted in the Fig. 1.7.
3 6 (a, 3)
(b, 3)
(a, 2)
(b, 2)
(a, 1)
(b, 1)
Ai = A1 A2 An = {(x1 , x2 , , xn ) : xi Ai }.
i=1
17
[ CH 96, 01]
18
1.5
Theory of Sets
Cardinal Numbers
The number of distinct elements in a set A is called the cardinal number of the set and it
is denoted by n(A) or |A| or card(A). For example, n() = 0, n({a}) = 1, n({a, b}) = 2,
n(Z) = , etc. Following are the important properties of cardinal number
(i) If A and B are disjoint, then
(a) n(A B) = n() = 0 and (b) n(A B) = n(A) + n(B),
(ii) Let A and B be two finite sets, with A B 6= , then
n(A B) = n(A) + n(B) n(A B),
(iii) If A, B, C be three arbitrary finite sets then
n(A B C) = n(A) + n(B) + n(C) n(A B)
n(B C) n(C A) + n(A B C),
(iv) Suppose we have any finite number of finite sets, say, A1 , A2 , , Am . Let sk be the
sum of the cardinalities, then
n(A1 A2 Am ) = s1 s2 + s3 + (1)m1 sm .
(v) n(A A) = n(A) and n(A A) = n(A).
The inclusion and exclusion principle
The number of elements in finite sets such as A B, A B, AB, etc. are obtained by
adding and as well as deleting certain elements. This method of finding the number of
elements in a finite set is known as inclusion and exclusion principle.
Ex 1.5.1 If n(A) and n(B) denote the number of elements in the finite sets A and B
respectively, then prove that n(A) + n(B) = n(A B) + n(A B).
Solution: If A and B are disjoint then n(A B) is equal to the sum of the elements of
A and the elements of B. That is n(A B) = n(A) + n(B). If A and B are disjoint then
A
6
K
7
B (A B) A (A B)
AB
Figure 1.8:
A B is express as union of three disjoint sets A B, A (A B) and B (A B). Let
us draw the Venn diagram showing A B 0 , A B, A0 B and A0 B 0 , where A and B are
two subsets of the universal set U . From the diagram, we have,
A = (A B 0 ) (A B) and B = (A B) (A0 B)
and the sets A B 0 , A B and A0 B are disjoint. Therefore,
n(A) = n(A B 0 ) + n(A B) and n(B) = n(A B) + n(A0 B)
n(A) + n(B) = n(A B 0 ) + 2n(A B) + n(A0 B).
Cardinal Numbers
19