Chapters 1 - 6: - Chapter 6
Chapters 1 - 6: - Chapter 6
Chapters 1 - 6: - Chapter 6
• Chapter 1:
– Photogrammetry: Definition, introduction, and applications.
• Chapters 2 – 4:
– Electro-magnetic radiation.
– Optics.
– Film development and digital cameras.
• Chapter 5:
– Vertical imagery: Definitions, image scale, and relief
displacement.
• Chapter 6:
– Measurement and refinement of image coordinates.
Analytical Photogrammetry Ayman F. Habib
1
Mathematical Model
1
Overview
• Mathematical model: Objectives.
• Mathematical model: Alternatives.
• Rotation matrices (2-D and 3-D).
– Derivation and characteristics.
• Collinearity equations.
– Concept and derivation.
• Bundle block adjustment.
– Concept and objectives.
• Least squares adjustment in photogrammetry.
Mathematical Model
2
Image Coordinate System: Diapositive
Flight Direction
Perspective Center y
xa a
ya
x
Fiducial Marks
Analytical Photogrammetry Ayman F. Habib
5
A
XA ZA
YA
X
3
Mathematical Model
z Z
Perspective Center y Y
xa a A
ya
x XA ZA
YA
X
xa = f x ( X A , YA , Z A , .........)
ya = f y ( X A , YA , Z A , .........)
Analytical Photogrammetry Ayman F. Habib
7
Mathematical Model
4
Rotation Matrices
• Rotation in a plane:
– Given a point p(x, y) w.r.t. an xy-coordinate system.
– The system is rotated with an angle α yielding a new
coordinate system x`y`.
– We would like to express the coordinates of the point
(p) w.r.t. the new system (x`, y`) as a function of:
• The old coordinates (x, y), and
• The rotation angle α.
Rotation in a Plane
Y
Y´
a
b
x P
x´ y´
c
X´
y
d
α
α
X
5
Rotation in a Plane
x′ cos α sin α x
y′ = − sin α cos α y
where :
cos α sin α
Rotation matrix ( R) =
− sin α cos α
R T R= R R T = I 2
Analytical Photogrammetry Ayman F. Habib
12
6
Properties of the Rotation Matrix
Rotation in Space
Z & Z´
Y´ Y P
z & z´
α x
x´ y y´
X´
α X
7
Rotation in Space
x `= x cos α + y sin α
y `= − x sin α + y cos α
z `= z
Orthogonality Conditions
r11 r12 r13
R = r21 r22 r23
r31 r32 r33
8
Rotation in Space
Zω Z Yω
Y
ω
X & Xω
9
Primary Rotation (ω)
xω 1 0 0 x
y = 0 cos ω sin ω y
ω
zω 0 − sin ω cos ω z
xω x
y = M y
ω ω x 1 0 0 xω
zω z y = 0 cos ω − sin ω yω
z 0 sin ω cos ω zω
x xω
y = R y
ω ω
z zω
Analytical Photogrammetry Ayman F. Habib
19
zω
zωφ
yω & yωφ
xω
xωφ
10
Secondary Rotation (φ)
Yωφκ
κ Yωφ
κ
Xωφκ
κ Xωφ
11
Tertiary Rotation (κ)
xωφκ cos κ sin κ 0 xωφ
yωφκ =− sin κ cos κ 0 yωφ
zωφκ 0 0 1 zωφ
xωφκ xωφ xωφ cos κ − sin κ 0 xωφκ
yωφκ =M κ yωφ yωφ = sin κ cos κ 0 yωφκ
zωφκ zωφ zωφ 0 0 1 zωφκ
xωφ xωφκ
yωφ =Rκ yωφκ
zωφ zωφκ
Analytical Photogrammetry Ayman F. Habib
23
Rotation in Space
xωφκ x
yωφκ =M κ M φ M ω y
zωφκ z
// to the image coordinate system // to the ground coordinate system
x xωφκ
y =R R R y
ω φ κ ωφκ
z zωφκ
// to the ground coordinate system // to the image coordinate system
Analytical Photogrammetry Ayman F. Habib
24
12
Rotation in Space
m 11 m 12 m 13
M κ M φ M ω = M = m 21 m 22 m 23
m 31 m 32 m 33
where :
m 11 = cos φ cos κ
m 12 = cos ω sin κ + sin ω sin φ cos κ
m 13 = sin ω sin κ − cos ω sin φ cos κ
m 21 = − cos φ sin κ
m 22 = cos ω cos κ − sin ω sin φ sin κ
m 23 = sin ω cos κ + cos ω sin φ sin κ
m 31 = sin φ
m 32 = − sin ω cos φ
m 33 = cos ω cos φ
Rotation in Space
r 11 r 12 r 13
R ω R φ R κ = R = r 21 r 22 r 23
r 31 r 32 r 33
where :
r 11 = cos φ cos κ
r 12 = − cos φ sin κ
r 13 = sin φ
r 21 = cos ω sin κ + sin ω sin φ cos κ
r 22 = cos ω cos κ − sin ω sin φ sin κ
r 23 = − sin ω cos φ
r 31 = sin ω sin κ − cos ω sin φ cos κ
r 32 = sin ω cos κ + cos ω sin φ sin κ
r 33 = cos ω cos φ
13
Alternative Derivation of the Rotation Matrix
z Z
y
Y
k Kj
J x
i
X
I
14
Alternative Derivation of the Rotation Matrix
cos( xX ) cos( yX ) cos( zX )
r r r
i = cos( xY ) j = cos( yY ) k = cos( zY )
cos( xZ ) cos( yZ ) cos( zZ )
15
Alternative Derivation of the Rotation Matrix
16
Alternative Derivation of the Rotation Matrix
r r r
r1 = 1 r2 = 1 r3 = 1
r r
r1 • r2 = 0.0
r r
r1 • r3 = 0.0
r r
r2 • r3 = 0.0
• Which are the orthogonality conditions for rotations matrices.
R −1 = R T
R T R= R R T = I 3
Rotation in Space
• Remarks:
– The elements of the rotation matrix depends on the
sequence of rotations.
• i.e., Rκ Rφ Rω ≠ Rκ Rω Rφ.
– Positive rotation angle is defined as the one that is
counter clock wise when looking at the system with the
positive direction of the axis of rotation is pointing
towards us.
– The angles (ω, φ, κ) are the rotation angles that need to
be applied to the ground coordinate system until it
becomes parallel to the image coordinate system.
Analytical Photogrammetry Ayman F. Habib
34
17
Positive Rotation Angles
(Right Handed System)
z
+ve κ
y
+ve ω +ve φ
x
Analytical Photogrammetry Ayman F. Habib
35
z
z z
x x x
Z Y Y
Y
φ
ω
X X
Z κ
X
ω ≈ 90° Z φ ≈ -20° κ ≈ 0°
Analytical Photogrammetry Ayman F. Habib
36
18
Rotation Angles (ω, φ, κ)
z
y
x
Z
ω ≈ ?, φ ≈ ?, and κ ≈ ?
Analytical Photogrammetry Ayman F. Habib
37
Azimuth ≡ Yaw
Analytical Photogrammetry Ayman F. Habib
38
19
Collinearity Equations
• Objective:
– Mathematically represent the general relationship
between corresponding image and ground coordinates.
• Concept:
– Image Point, Object Point, and the Perspective Center
are collinear.
Collinearity Equations
Perspective Center
Straight Line
20
Collinearity Equations
o
oa = λ oA
Collinearity Equations
(Perspective Center)
zi yi
ZG
a (xa, ya)
c pp
+ xi
+
R(ω , φ ,κ ) Oi
A
ZO
YG ZA
XA
XO YA
YO XG
OG
21
The vector connecting the perspective
center to the image point
o
xa x p xa − x p
vi = ya − y = y −y
r
p a p a
0 c − c
X X X − XO
r A O A
Vo = YA − YO = YA − YO
Z A ZO Z A − ZO
A
w.r.t. the ground coordinate system
22
Collinearity Equations
r r
vi =λ M (ω , φ , κ ) VO
xa − x p m11 m12 m13 X A − X O
y − y =λ m m22 m23 YA −YO
a p 21
− c m31 m32 m33 Z A −Z O
Collinearity Equations
23
Collinearity Equations
r11 ( X A −XO )+r21 (YA −YO )+r31 (Z A −ZO )
xa =xp −c
r13 ( X A −XO )+r23 (YA −YO )+r33 (Z A −ZO )
r12 ( X A −XO )+r22 (YA −YO )+r32 (Z A −ZO )
ya = y p −c
r13 ( X A −XO )+r23 (YA −YO )+r33 (Z A −ZO )
• Involved parameters:
– Image coordinates (xa, ya).
– Ground coordinates (AA, YA, ZA).
– Exterior Orientation Parameters – EOP, (XO, YO, ZO, ω, φ, κ).
– Interior Orientation Parameters – IOP, (xp, yp, c).
Analytical Photogrammetry Ayman F. Habib
47
Interior Orientation
• Interior Orientation Parameters (IOP) describe the
internal characteristics of the implemented camera.
– IOP include the principal distance, principal point
coordinates, and distortion parameters.
– IOP are determined using a calibration procedure.
24
Interior Orientation
• IOP together with the image coordinates of selected
features define a bundle of light rays (image bundle).
pc (xp, yp, c)
z
Exterior Orientation
• Exterior Orientation Parameters (EOP) define the
position and the attitude of the image bundle
relative to the ground coordinate system.
– The position of the bundle is defined by (XO, YO, ZO).
– The attitude of the bundle (image coordinate system)
relative to the ground coordinate system is defined by
the rotation angles (ω, φ, κ).
• EOP can be either:
– Indirectly estimated using Ground Control Points
(GCP), or
– Directly measured using GPS/INS units onboard the
imaging platform.
25
Exterior Orientation
z y
pc x
ZG
R (ω ,φ ,κ )
YG
Zo
Xo
Yo
XG
• EOP:
– Indirectly estimated (indirect geo-referencing), or
– Directly measured (direct geo-referencing).
Analytical Photogrammetry Ayman F. Habib
51
exterior orientation
interior orientation
26
Indirect Geo-Referencing: Image Block
Direct Geo-Referencing
INS b-frame
GPS antenna
b
b R
c
m a
R (t)
b
c-frame
m
m r
r (t) pc
INS
m m b
R (t) = R (t) R
c b c
27
Direct Geo-Referencing
GPS Antenna
INS PC
GPS Receiver
28
Bundle Block Adjustment
29
Bundle Block Adjustment
30
Tie Points
31
Analog Camera (WILD RC10)
32
Digital Camera: SONY DSC 717
33
Digital Camera: EOS-1D
34
Least Squares Adjustment in
Photogrammetry
35
Unknown Parameters
Observable Quantities
36
Tie Points
37
Ground Control Points: Collection
38
Ground Control Points: Terrestrial Dataset
39
IOP: Camera Calibration Certificate
• Fiducial Marks:
• ID x-Coordinate mm y-Coordinate mm
• 01 -105.999 -105.978
• 02 105.996 106.022
• 03 -106.018 106.021
• 04 105.988 -105.978
40
IOP: Camera Calibration Certificate
Digital camera
GPS antenna
INS
41
EOP: GPS-INS (Airborne System)
GPS Antenna
INS PC
GPS Receiver
Mathematical Model
y
42
Mathematical Model
Distortion Parameters
∆xRadial Lens Distortion = x (k1 r 2 +k2 r 4 + k3 r 6 +....)
∆yRadial Lens Distortion = y (k1 r 2 +k2 r 4 + k3 r 6 +....)
∆xDecentric Lens Distortion = (1+ p32 r 2 ){ p1 (r 2 + 2 x 2 ) +2 p2 x y }
∆yDecentric Lens Distortion = (1+ p32 r 2 ){2 p1 x y + p2 (r 2 + 2 y 2 )}
x = x − xp
y = y − yp
Analytical Photogrammetry Ayman F. Habib
86
43
Least Squares Adjustment
y= Ax+e e ~ (0, σ o2 P −1 )
y n × 1 observatio n vector
A n × m design matrix
x m × 1 vector of unknowns
e n × 1 noise contaminat ing the observatio n vector
σ P 2
o
−1
n × n variance covariance matrix of the noise vector
xˆ = ( AT PA) −1 AT Py
D{xˆ}= σ o2 ( AT PA) −1
e~ = y − Axˆ
σˆ o2 = (e~ T Pe~ ) / (n − m)
44
Y = a( X ) + e
Non Linear System
a ( X ) is the non − linear function
We use Taylor Series Expansion
∂a
Y ≈ a( X o ) + (X − Xo)+ e ( We ignore higher order terms )
∂X Xo
Where :
Xo
is approximate values for the unknown parameters
∂a
Y − a( X o ) = (X − Xo)+ e
∂X X o
y= Ax+e
Where :
y = Y − a( X o )
∂a
A=
∂X Xo
Examples
• Linear System:
– 2-D Similarity Transformation.
• Given:
– The coordinates of a set of points in two different
coordinate systems, which can be related to each other
through 2-D similarity transformation.
• Unknown parameters:
– The 2-D similarity transformation parameters (xt, yt, a, b).
• Non-Linear System:
– Computing the radius of a circle.
• By observing the area of a circle, we would like to estimate its
radius.
Analytical Photogrammetry Ayman F. Habib
90
45
2-D Similarity Transformation
ex
e ~ (0, σ o P )
2 −1
y
x1 1 0 x1′ − y1′ e x1
y 0 e
1 1 y1′ x1′ xt y1
x2 1 0 x 2′ − y 2′ y e
= t + x2
y 2 0 1 y 2′ x 2′ a e y2
x3 1 ex
0 x 3′ − y 3′ b
3
y 3 0 1 y 3′ x 3′ e y 3
Analytical Photogrammetry Ayman F. Habib
92
46
Estimating the Radius of a Circle
Areaobs. = π R 2 + e Areaobs .
e Areaobs . ~ (0, σ o2 P −1 )
y1 2 π Ro e Area1
y = 2 π R [∆R ] +
2 o e
Area2
y3 2 π Ro e Area
3
47
Example (4 Images in Two Strips)
1 2 1 2
3 4 3 4
Control Point
5 6 5 6 Tie Point
I II
3 4 3 4
5 6 5 6
7 8 7 8
III IV
Analytical Photogrammetry Ayman F. Habib
95
• Number of equations:
– 4 x 6 x 2 = 48 equations (collinearity equations).
• Number of unknowns:
– 4 x 6 + 3 x 4 = 36 unknowns
• Redundancy:
– 12.
• Assumptions:
– IOP are known.
48
Structure of the Design Matrix (BA)
A= y=
49
Structure of the Normal Matrix
I II III IV
[N ] =
3 4 5 6
Sample Data:
• 2 cameras.
• 4 images.
• 16 points.
50
Structure of the Normal Matrix: Example
51