11 - Vector Space
11 - Vector Space
in Economics I
Vector Space
Larson 4.1-4.3
Graphical Representation of a Vector
𝑢𝑢1
𝑢𝑢 = 𝑢𝑢 𝑢𝑢2
2
e.g.
2 3
𝑢𝑢 =
3
𝑢𝑢1
2
Length of a Vector
Length of a vector is called norm
𝑢𝑢2
and is denoted by ⋅ . For real
vectors, it is defined as:
3
𝑢𝑢⃑ = 𝑢𝑢12 + ⋯+ 𝑢𝑢𝑛𝑛2
2 𝑢𝑢1
𝑢𝑢 = 2
3
𝑢𝑢⃑ = 22 + 32 = 13
Graphical Representation of
Vector Addition
𝑢𝑢2
2
𝑢𝑢 =
3 4
𝑣𝑣
3
𝑣𝑣⃑ = 𝑢𝑢
1 𝑢𝑢 𝑢𝑢 + 𝑣𝑣
5
𝑢𝑢 + 𝑣𝑣⃑ = 𝑣𝑣
4 5
𝑢𝑢1
Graphical Representation of
Vector Addition
2 𝑢𝑢2
𝑢𝑢 =
3
𝑢𝑢
−2
−𝑢𝑢 =
−3 𝑢𝑢1
0 0
𝑢𝑢 + −𝑢𝑢 = −𝑢𝑢 0
0
Graphical Representation of
Scalar Multiplication
𝑢𝑢2
3
𝑢𝑢 = , 𝑐𝑐 = 2
1
6
𝑐𝑐𝑢𝑢 =
2 2
𝑐𝑐𝑐𝑐
𝑢𝑢
𝑢𝑢1
6
Dot Product of Perpendicular Vectors
An interesting fact: if two vectors
are perpendicular to each other, 𝑢𝑢2
their dot product is zero:
2 0
𝑢𝑢 = , 𝑣𝑣⃑ =
0 3
𝑢𝑢 ⋅ 𝑣𝑣⃑ = 2 × 0 + 0 × 3 = 0 𝑦𝑦 𝑣𝑣 𝑥𝑥
1 −1
𝑥𝑥⃑ = , 𝑦𝑦⃑ = 𝑢𝑢1
1 1 𝑢𝑢
𝑥𝑥⃑ ⋅ 𝑦𝑦⃑ = 1 × −1 + 1 × 1 = 0
We say the vectors are
orthogonal to each other
Properties of Vector Addition
2
and Scalar Multiplication in ℝ
• 𝑢𝑢 + 𝑣𝑣⃑ is a vector in ℝ2 • 𝑐𝑐𝑢𝑢 is a vector in ℝ2
• 𝑢𝑢 + 𝑣𝑣⃑ = 𝑣𝑣⃑ + 𝑢𝑢 • 𝑐𝑐 𝑢𝑢 + 𝑣𝑣⃑ = 𝑐𝑐𝑢𝑢 + 𝑐𝑐 𝑣𝑣⃑
• 𝑢𝑢 + 𝑣𝑣⃑ + 𝑤𝑤 • 𝑐𝑐 + 𝑑𝑑 𝑢𝑢 = 𝑐𝑐𝑢𝑢 + 𝑑𝑑𝑢𝑢
= 𝑢𝑢 + 𝑣𝑣⃑ + 𝑤𝑤 • 𝑐𝑐 𝑑𝑑𝑢𝑢 = 𝑐𝑐𝑐𝑐 𝑢𝑢
• 𝑢𝑢 + 0 = 𝑢𝑢 • 1 𝑢𝑢 = 𝑢𝑢
0 is called a zero vector
R: real number space
• 𝑢𝑢 + −𝑢𝑢 = 0 2: 2-d
Vector Space
Let 𝑉𝑉 be a set of vectors. 𝑉𝑉 is a vector space if the
following properties are satisfied for every vector 𝑢𝑢, 𝑣𝑣⃑
and 𝑤𝑤 and every real number 𝑐𝑐 and 𝑑𝑑:
• 𝑢𝑢 + 𝑣𝑣⃑ is a vector in 𝑉𝑉 • 𝑐𝑐𝑢𝑢 is a vector in 𝑉𝑉
• 𝑢𝑢 + 𝑣𝑣⃑ = 𝑣𝑣⃑ + 𝑢𝑢 • 𝑐𝑐 𝑢𝑢 + 𝑣𝑣⃑ = 𝑐𝑐𝑢𝑢 + 𝑐𝑐 𝑣𝑣⃑
• 𝑢𝑢 + 𝑣𝑣⃑ + 𝑤𝑤 • 𝑐𝑐 + 𝑑𝑑 𝑢𝑢 = 𝑐𝑐𝑢𝑢 + 𝑑𝑑𝑢𝑢
= 𝑢𝑢 + 𝑣𝑣⃑ + 𝑤𝑤
• 𝑐𝑐 𝑑𝑑𝑢𝑢 = 𝑐𝑐𝑐𝑐 𝑢𝑢
• 𝑢𝑢 + 0 = 𝑢𝑢
0 is called a zero vector • 1 𝑢𝑢 = 𝑢𝑢
• 𝑢𝑢 + −𝑢𝑢 = 0
Examples of Vector Spaces
• Real number spaces: ℝ, ℝ2 , ℝ3 …
same length
𝑎𝑎1 𝑏𝑏1 𝑎𝑎1 𝑏𝑏1 𝑎𝑎1 + 𝑏𝑏1
⋮ , ⋮ ∈ 𝑅𝑅𝑛𝑛 ⋮ + ⋮ = ⋮ ∈ 𝑅𝑅𝑛𝑛
𝑎𝑎𝑛𝑛 𝑏𝑏𝑛𝑛 𝑎𝑎𝑛𝑛 𝑏𝑏𝑛𝑛 𝑎𝑎𝑛𝑛 + 𝑏𝑏𝑛𝑛
• Polynomial spaces: any set containing all polynomials of the
same order or smaller
3𝑥𝑥 2 + 4𝑥𝑥, 5𝑥𝑥 2 + 𝑥𝑥 ∈ 𝑃𝑃2
3𝑥𝑥 2 + 4𝑥𝑥 + 5𝑥𝑥 2 + 𝑥𝑥 = 8𝑥𝑥 2 + 5𝑥𝑥 ∈ 𝑃𝑃2
• Matrix spaces: any set containing all matrices of the same size
1 2 3 7 0 9
, ∈ 𝑀𝑀2,3
4 5 6 2 8 1
1 2 3 7 0 9 8 2 12
+ = ∈ 𝑀𝑀2,3
4 5 6 2 8 1 6 13 7
Example: Is ℝ a Vector Space?
To verify a set is a vector space, we need to check all
10 properties, which are called axioms:
• 𝑢𝑢 + 𝑣𝑣⃑ is a vector in 𝑉𝑉
• 𝑢𝑢 + 𝑣𝑣⃑ = 𝑣𝑣⃑ + 𝑢𝑢
• 𝑢𝑢 + 𝑣𝑣⃑ + 𝑤𝑤
= 𝑢𝑢 + 𝑣𝑣⃑ + 𝑤𝑤
• 𝑢𝑢 + 0 = 𝑢𝑢
0 is called a zero vector
• 𝑢𝑢 + −𝑢𝑢 = 0
Example: Is ℝ a Vector Space?
To verify a set is a vector space, we need to check all
10 properties, which are called axioms:
• 𝑐𝑐𝑢𝑢 is a vector in 𝑉𝑉
• 𝑐𝑐 𝑢𝑢 + 𝑣𝑣⃑ = 𝑐𝑐𝑢𝑢 + 𝑐𝑐𝑣𝑣⃑
• 𝑐𝑐 + 𝑑𝑑 𝑢𝑢 = 𝑐𝑐𝑢𝑢 + 𝑑𝑑𝑢𝑢
• 𝑐𝑐 𝑑𝑑𝑢𝑢 = 𝑐𝑐𝑐𝑐 𝑢𝑢
• 1 𝑢𝑢 = 𝑢𝑢
Spanning Set
𝑢𝑢2
• You can represent any
𝑣𝑣
point on ℝ2 as the sum
of the scalar multiples
of two “distinct” vectors 𝑢𝑢
7
• E.g. 𝑢𝑢 = 2 , 𝑣𝑣⃑ = 3 , −𝑣𝑣
7
3 1
7 𝑢𝑢
= 2𝑢𝑢 + 𝑣𝑣⃑ −1
7 2 𝑣𝑣
𝑢𝑢1
−1
= 𝑢𝑢 − 𝑣𝑣⃑
2
Spanning Set
• All vectors in ℝ2 can be represented as a linear
combination of 𝑢𝑢 and 𝑣𝑣: ⃑
For any 𝑤𝑤 ∈ ℝ2 , there exist scalars 𝑐𝑐 and 𝑑𝑑 such that
𝑤𝑤 = 𝑐𝑐𝑢𝑢 + 𝑑𝑑 𝑣𝑣⃑