Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                

Extensive Form Games: Perfect Information: ECON2112

Download as pdf or txt
Download as pdf or txt
You are on page 1of 69

Extensive Form Games: Perfect Information

ECON2112

Extensive Form Games: Perfect Information


Introduction

In a normal form game, players take decisions simultaneously.

In an extensive form game, players may observe other players


past decisions.

Extensive Form Games: Perfect Information


Introduction

A game of perfect information is an extensive form game where


players can always observe other players past actions

Extensive Form Games: Perfect Information


Perfect Information

Example (Perfect Information)


1
L

2
a
2, 1

1, 3

0, 0

The open circle is the initial node or root of the game tree.

The black circles and the open circle are called decision nodes.

L, R, a and b are called choices.

1 and 2 are the names of the players.

We specify a payoff vector in each final node.

Extensive Form Games: Perfect Information


Perfect Information

Example (Perfect Information)


1
L

2
a
2, 1

1, 3

0, 0

The open circle is the initial node or root of the game tree.

The black circles and the open circle are called decision nodes.

L, R, a and b are called choices.

1 and 2 are the names of the players.

We specify a payoff vector in each final node.

Extensive Form Games: Perfect Information


Perfect Information

Example (Perfect Information)


1
L

2
a
2, 1

1, 3

0, 0

The open circle is the initial node or root of the game tree.

The black circles and the open circle are called decision nodes.

L, R, a and b are called choices.

1 and 2 are the names of the players.

We specify a payoff vector in each final node.

Extensive Form Games: Perfect Information


Perfect Information

Example (Perfect Information)


1
L

2
a
2, 1

1, 3

0, 0

The open circle is the initial node or root of the game tree.

The black circles and the open circle are called decision nodes.

L, R, a and b are called choices.

1 and 2 are the names of the players.

We specify a payoff vector in each final node.

Extensive Form Games: Perfect Information


Perfect Information

Example (Perfect Information)


1
L

2
a
2, 1

1, 3

0, 0

The open circle is the initial node or root of the game tree.

The black circles and the open circle are called decision nodes.

L, R, a and b are called choices.

1 and 2 are the names of the players.

We specify a payoff vector in each final node.

Extensive Form Games: Perfect Information


Perfect Information

Example (Perfect Information)


1
L

2
a
2, 1

2
b
0, 0

c
4, 0

d
1, 3

L, R, a, b, c, d are called choices (or actions).

What is player 1s set of pure strategies? S1 = {L, R }

What is player 2s set of pure strategies? S2 = {ac , ad , bc , bd }

Extensive Form Games: Perfect Information


Perfect Information

Example (Perfect Information)


1
L

2
a
2, 1

2
b
0, 0

c
4, 0

d
1, 3

L, R, a, b, c, d are called choices (or actions).

What is player 1s set of pure strategies? S1 = {L, R }

What is player 2s set of pure strategies? S2 = {ac , ad , bc , bd }

Extensive Form Games: Perfect Information


Perfect Information

Example (Perfect Information)


1
L

2
a
2, 1

2
b
0, 0

c
4, 0

d
1, 3

L, R, a, b, c, d are called choices (or actions).

What is player 1s set of pure strategies? S1 = {L, R }

What is player 2s set of pure strategies? S2 = {ac , ad , bc , bd }

Extensive Form Games: Perfect Information


Perfect Information

Example (Perfect Information)


1
L

2
a
2, 1

2
b
0, 0

c
4, 0

d
1, 3

L, R, a, b, c, d are called choices (or actions).

What is player 1s set of pure strategies? S1 = {L, R }

What is player 2s set of pure strategies? S2 = {ac , ad , bc , bd }

Extensive Form Games: Perfect Information


Perfect Information

Example (Perfect Information)


1
L

2
a

2
b

1
2, 1

0, 0

4, 0

1, 4

1, 3

Player 1 set of pure strategies: S1 = {LA, LB , RA, RB }

Player 2 set of pure strategies: S2 = {ac , ad , bc , bd }.

Extensive Form Games: Perfect Information


Perfect Information

Example (Perfect Information)


1
L

2
a

2
b

1
2, 1

0, 0

4, 0

1, 4

1, 3

Player 1 set of pure strategies: S1 = {LA, LB , RA, RB }

Player 2 set of pure strategies: S2 = {ac , ad , bc , bd }.

Extensive Form Games: Perfect Information


Perfect Information

Example (Perfect Information)


1
L

2
a

1
2

1
2

2
2, 1

0, 0

4, 0

2, 3

0, 3

We can introduce moves of Nature.

Player 1 set of pure strategies: S1 = {L, R }.

Player 2 set of pure strategies: S2 = {ac , ad , bc , bd }.

Extensive Form Games: Perfect Information


Perfect Information

Example (Perfect Information)


1
L

2
a

1
2

1
2

2
2, 1

0, 0

4, 0

2, 3

0, 3

We can introduce moves of Nature.

Player 1 set of pure strategies: S1 = {L, R }.

Player 2 set of pure strategies: S2 = {ac , ad , bc , bd }.

Extensive Form Games: Perfect Information


Pure and Mixed Strategies

What is a pure strategy in an Extensive Form Game?


In a game of perfect information, a pure strategy is a plan of action for
the entire game, that tells the player what particular choice to take at
every possible juncture of the game where it is his turn to move.

What is the set of Pure Strategies?


The set of all possible plans of action.

What is a Mixed Strategy?


A probability distribution on the set of pure strategies.

Extensive Form Games: Perfect Information


Pure and Mixed Strategies

What is a pure strategy in an Extensive Form Game?


In a game of perfect information, a pure strategy is a plan of action for
the entire game, that tells the player what particular choice to take at
every possible juncture of the game where it is his turn to move.

What is the set of Pure Strategies?


The set of all possible plans of action.

What is a Mixed Strategy?


A probability distribution on the set of pure strategies.

Extensive Form Games: Perfect Information


Pure and Mixed Strategies

What is a pure strategy in an Extensive Form Game?


In a game of perfect information, a pure strategy is a plan of action for
the entire game, that tells the player what particular choice to take at
every possible juncture of the game where it is his turn to move.

What is the set of Pure Strategies?


The set of all possible plans of action.

What is a Mixed Strategy?


A probability distribution on the set of pure strategies.

Extensive Form Games: Perfect Information


Normal Form Representation

Once we know what is the set of pure strategies for each player,
we can obtain the normal form representation of a an extensive
form game

Example
1
L

2
a
2, 1

b
0, 0

1, 3
L
R

a
2, 1
1, 3

b
0, 0
1, 3

Extensive Form Games: Perfect Information


Normal Form Representation

Once we know what is the set of pure strategies for each player,
we can obtain the normal form representation of a an extensive
form game

Example
1
L

2
a
2, 1

b
0, 0

1, 3
L
R

a
2, 1
1, 3

b
0, 0
1, 3

Extensive Form Games: Perfect Information


Normal Form Representation

Once we know what is the set of pure strategies for each player,
we can obtain the normal form representation of a an extensive
form game

Example
1
L

2
a
2, 1

b
0, 0

1, 3
L
R

a
2, 1
1, 3

b
0, 0
1, 3

Extensive Form Games: Perfect Information


Normal Form Representation

Once we know what is the set of pure strategies for each player,
we can obtain the normal form representation of a an extensive
form game

Example
1
L

2
a
2, 1

b
0, 0

1, 3
L
R

a
2, 1
1, 3

b
0, 0
1, 3

Extensive Form Games: Perfect Information


Normal Form Representation

Once we know what is the set of pure strategies for each player,
we can obtain the normal form representation of a an extensive
form game

Example
1
L

2
a
2, 1

b
0, 0

1, 3
L
R

a
2, 1
1, 3

b
0, 0
1, 3

Extensive Form Games: Perfect Information


Normal Form Representation

Example
1
L

2
a
2, 1

2
b
0, 0

c
4, 0

d
1, 3
L
R

ac
2, 1
4, 0

ad
2, 1
1, 3

bc
0, 0
4, 0

bd
0, 0
1, 3

Extensive Form Games: Perfect Information


Normal Form Representation

Example
1
L

2
a
2, 1

2
b
0, 0

c
4, 0

d
1, 3
L
R

ac
2, 1
4, 0

ad
2, 1
1, 3

bc
0, 0
4, 0

bd
0, 0
1, 3

Extensive Form Games: Perfect Information


Normal Form Representation

Example
1
L

2
a
2, 1

2
b
0, 0

c
4, 0

d
1, 3
L
R

ac
2, 1
4, 0

ad
2, 1
1, 3

bc
0, 0
4, 0

bd
0, 0
1, 3

Extensive Form Games: Perfect Information


Normal Form Representation

Example
1
L

2
a
2, 1

2
b
0, 0

c
4, 0

d
1, 3
L
R

ac
2, 1
4, 0

ad
2, 1
1, 3

bc
0, 0
4, 0

bd
0, 0
1, 3

Extensive Form Games: Perfect Information


Normal Form Representation

Example
1
L

2
a
2, 1

2
b
0, 0

c
4, 0

d
1, 3
L
R

ac
2, 1
4, 0

ad
2, 1
1, 3

bc
0, 0
4, 0

bd
0, 0
1, 3

Extensive Form Games: Perfect Information


Normal Form Representation

Example
1
L

2
a
2, 1

2
b
0, 0

c
4, 0

d
1, 3
L
R

ac
2, 1
4, 0

ad
2, 1
1, 3

bc
0, 0
4, 0

bd
0, 0
1, 3

Extensive Form Games: Perfect Information


Normal From Representation

Example
1
L

2
a

2
b

1
2, 1

0, 0

4, 0

1, 4

1, 3

LA
LB
RA
RB

ac
2, 1
2, 1
4, 0
1, 4

ad
2, 1
2, 1
1, 3
1, 3

bc
0, 0
0, 0
4, 0
1, 4

bd
0, 0
0, 0
1, 3
1, 3

Extensive Form Games: Perfect Information


Normal From Representation

Example
1
L

2
a

2
b

1
2, 1

0, 0

4, 0

1, 4

1, 3

LA
LB
RA
RB

ac
2, 1
2, 1
4, 0
1, 4

ad
2, 1
2, 1
1, 3
1, 3

bc
0, 0
0, 0
4, 0
1, 4

bd
0, 0
0, 0
1, 3
1, 3

Extensive Form Games: Perfect Information


Normal From Representation

Example
1
L

2
a

2
b

1
2, 1

0, 0

4, 0

1, 4

1, 3

LA
LB
RA
RB

ac
2, 1
2, 1
4, 0
1, 4

ad
2, 1
2, 1
1, 3
1, 3

bc
0, 0
0, 0
4, 0
1, 4

bd
0, 0
0, 0
1, 3
1, 3

Extensive Form Games: Perfect Information


Normal From Representation

Example
1
L

2
a

2
b

1
2, 1

0, 0

4, 0

1, 4

1, 3

LA
LB
RA
RB

ac
2, 1
2, 1
4, 0
1, 4

ad
2, 1
2, 1
1, 3
1, 3

bc
0, 0
0, 0
4, 0
1, 4

bd
0, 0
0, 0
1, 3
1, 3

Extensive Form Games: Perfect Information


Normal From Representation

Example
1
L

2
a

2
b

1
2, 1

0, 0

4, 0

1, 4

1, 3

LA
LB
RA
RB

ac
2, 1
2, 1
4, 0
1, 4

ad
2, 1
2, 1
1, 3
1, 3

bc
0, 0
0, 0
4, 0
1, 4

bd
0, 0
0, 0
1, 3
1, 3

Extensive Form Games: Perfect Information


Normal From Representation

Example
1
L

2
a

2
b

1
2, 1

0, 0

4, 0

1, 4

1, 3

LA
LB
RA
RB

ac
2, 1
2, 1
4, 0
1, 4

ad
2, 1
2, 1
1, 3
1, 3

bc
0, 0
0, 0
4, 0
1, 4

bd
0, 0
0, 0
1, 3
1, 3

Extensive Form Games: Perfect Information


Normal From Representation

Example
1
L

2
a

2
b

1
2, 1

0, 0

4, 0

1, 4

1, 3

LA
LB
RA
RB

ac
2, 1
2, 1
4, 0
1, 4

ad
2, 1
2, 1
1, 3
1, 3

bc
0, 0
0, 0
4, 0
1, 4

bd
0, 0
0, 0
1, 3
1, 3

Extensive Form Games: Perfect Information


Perfect Information

Example
1
L

2
a

1
2

1
2

2
2, 1

0, 0

4, 0

2, 3

0, 3

L
R

ac
2, 1
2, 23

ad
2, 1
1, 3

bc
0, 0
2, 32

bd
0, 0
1, 3

Extensive Form Games: Perfect Information


Perfect Information

Example
1
L

2
a

1
2

1
2

2
2, 1

0, 0

4, 0

2, 3

0, 3

L
R

ac
2, 1
2, 23

ad
2, 1
1, 3

bc
0, 0
2, 32

bd
0, 0
1, 3

Extensive Form Games: Perfect Information


Perfect Information

Example
1
L

2
a

1
2

1
2

2
2, 1

0, 0

4, 0

2, 3

0, 3

L
R

ac
2, 1
2, 23

ad
2, 1
1, 3

bc
0, 0
2, 32

bd
0, 0
1, 3

Extensive Form Games: Perfect Information


Perfect Information

Example
1
L

2
a

1
2

1
2

2
2, 1

0, 0

4, 0

2, 3

0, 3

L
R

ac
2, 1
2, 23

ad
2, 1
1, 3

bc
0, 0
2, 32

bd
0, 0
1, 3

Extensive Form Games: Perfect Information


Perfect Information

Example
1
L

2
a

1
2

1
2

2
2, 1

0, 0

4, 0

2, 3

0, 3

L
R

ac
2, 1
2, 23

ad
2, 1
1, 3

bc
0, 0
2, 32

bd
0, 0
1, 3

Extensive Form Games: Perfect Information


Perfect Information

Example
1
L

2
a

1
2

1
2

2
2, 1

0, 0

4, 0

2, 3

0, 3

L
R

ac
2, 1
2, 23

ad
2, 1
1, 3

bc
0, 0
2, 32

bd
0, 0
1, 3

Extensive Form Games: Perfect Information


Normal Form Representation

The normal form representation of an extensive form game is


useful to

Compute Nash equilibria

Find Dominated Strategies.

Extensive Form Games: Perfect Information


Nas Equilibrium

Definition (Nash Equilibrium)


The Nash equilibrium of a perfect information game (or, more
generally, of an extensive form game) is the Nash equilibrium of its
Normal form representation.

Extensive Form Games: Perfect Information


Nash Equilibrium

Typically, not every Nash equilibrium of a perfect information game is


reasonable.

Example
1
L

2
a
2, 1

1, 3

L
R

a
2, 1
1, 3

b
0, 0
1, 3

0, 0

The game has two Nash equilibria (L, a) and (R , b).

Under (R , b), player 2 is threating player 1 with playing b if he


plays L.

But, is this a credible threat?

Extensive Form Games: Perfect Information


Nash Equilibrium

Typically, not every Nash equilibrium of a perfect information game is


reasonable.

Example
1
L

2
a
2, 1

1, 3

L
R

a
2, 1
1, 3

b
0, 0
1, 3

0, 0

The game has two Nash equilibria (L, a) and (R , b).

Under (R , b), player 2 is threating player 1 with playing b if he


plays L.

But, is this a credible threat?

Extensive Form Games: Perfect Information


Nash Equilibrium

Typically, not every Nash equilibrium of a perfect information game is


reasonable.

Example
1
L

2
a
2, 1

1, 3

L
R

a
2, 1
1, 3

b
0, 0
1, 3

0, 0

The game has two Nash equilibria (L, a) and (R , b).

Under (R , b), player 2 is threating player 1 with playing b if he


plays L.

But, is this a credible threat?

Extensive Form Games: Perfect Information


Nash Equilibrium

Example
1
L

2
a
2, 1

1, 3

L
R

a
2, 1
1, 3

b
0, 0
1, 3

0, 0

If player 2 finds himself in a situation where he has to choose


between a and b, he will always choose a.

Player 1 should foresee this, and play L instead of R.

(In any case, note that b is a dominated strategy.)

Extensive Form Games: Perfect Information


Backwards Induction

This idea can be generalized as the Principle of Backwards


Induction.

Definition (Backwards Induction/Informal Idea)


Players should make their choices in a way consistent with deductions
about other players rational behavior in the future.

The implementation of the Backwards Induction principle to


games of perfect information involves a computational method.

Extensive Form Games: Perfect Information


Backwards Induction. Computation

Backwards Induction. Computation

First we resolve the last moves in the game.

Then we substitute decision nodes by the expected payoff that


arises from a rational move at such decision node.

And we keep resolving last moves in the same way until we get to
the root of the game tree.

Extensive Form Games: Perfect Information


Rollback equilibrium

Example
1
L

2
a

2
b

1
2, 1

0, 0

1, 3

4, 0 1, 4
The optimal moves of the Rollback equilibrium are A, a, d and L.

This corresponds to the pure strategy profile (LA, ad ).

However, we can also give the result as the behavioral strategy


profile (A, a, d , L).

Extensive Form Games: Perfect Information


Rollback equilibrium

Example
1
L

2
a
2, 1

2
b
0, 0

c
4, 0

d
1, 3

The optimal moves of the Rollback equilibrium are A, a, d and L.

This corresponds to the pure strategy profile (LA, ad ).

However, we can also give the result as the behavioral strategy


profile (A, a, d , L).

Extensive Form Games: Perfect Information


Rollback equilibrium

Example
1
L

R
2

2, 1

c
4, 0

d
1, 3

The optimal moves of the Rollback equilibrium are A, a, d and L.

This corresponds to the pure strategy profile (LA, ad ).

However, we can also give the result as the behavioral strategy


profile (A, a, d , L).

Extensive Form Games: Perfect Information


Rollback equilibrium

Example
1
L
2, 1

R
1, 3

The optimal moves of the Rollback equilibrium are A, a, d and L.

This corresponds to the pure strategy profile (LA, ad ).

However, we can also give the result as the behavioral strategy


profile (A, a, d , L).

Extensive Form Games: Perfect Information


Rollback equilibrium

Example
1
L
2, 1

R
1, 3

The optimal moves of the Rollback equilibrium are A, a, d and L.

This corresponds to the pure strategy profile (LA, ad ).

However, we can also give the result as the behavioral strategy


profile (A, a, d , L).

Extensive Form Games: Perfect Information


Rollback equilibrium

Example
1
L
2, 1

R
1, 3

The optimal moves of the Rollback equilibrium are A, a, d and L.

This corresponds to the pure strategy profile (LA, ad ).

However, we can also give the result as the behavioral strategy


profile (A, a, d , L).

Extensive Form Games: Perfect Information


Rollback equilibrium

Example
1
L
2, 1

R
1, 3

The optimal moves of the Rollback equilibrium are A, a, d and L.

This corresponds to the pure strategy profile (LA, ad ).

However, we can also give the result as the behavioral strategy


profile (A, a, d , L).

Extensive Form Games: Perfect Information


Rollback equilibrium

Example
1
L

2
a

1
2

1
2

2
2, 1

0, 0

0, 3

4, 0 2, 3
Moves that conform with Backwards Induction: d , a, L.

Expressed as a pure strategy profile: (L, ad ).

Expressed as a behavioral strategy profile: (L, a, d ) .

Extensive Form Games: Perfect Information


Rollback equilibrium

Example
1
L
2
a
2, 1

b
0, 0

R
1
2

2, 3

1
2

0, 3

Moves that conform with Backwards Induction: d , a, L.

Expressed as a pure strategy profile: (L, ad ).

Expressed as a behavioral strategy profile: (L, a, d ) .

Extensive Form Games: Perfect Information


Rollback equilibrium

Example
1
L
2, 1

R
1
2

2, 3

1
2

0, 3

Moves that conform with Backwards Induction: d , a, L.

Expressed as a pure strategy profile: (L, ad ).

Expressed as a behavioral strategy profile: (L, a, d ) .

Extensive Form Games: Perfect Information


Rollback equilibrium

Example
1
L
2, 1

R
1, 3

Moves that conform with Backwards Induction: d , a, L.

Expressed as a pure strategy profile: (L, ad ).

Expressed as a behavioral strategy profile: (L, a, d ) .

Extensive Form Games: Perfect Information


Rollback equilibrium

Example
1
L
2, 1

R
1, 3

Moves that conform with Backwards Induction: d , a, L.

Expressed as a pure strategy profile: (L, ad ).

Expressed as a behavioral strategy profile: (L, a, d ) .

Extensive Form Games: Perfect Information


Rollback equilibrium

Example
1
L
2, 1

R
1, 3

Moves that conform with Backwards Induction: d , a, L.

Expressed as a pure strategy profile: (L, ad ).

Expressed as a behavioral strategy profile: (L, a, d ) .

Extensive Form Games: Perfect Information


Rollback equilibrium

Example
1
L
2, 1

R
1, 3

Moves that conform with Backwards Induction: d , a, L.

Expressed as a pure strategy profile: (L, ad ).

Expressed as a behavioral strategy profile: (L, a, d ) .

Extensive Form Games: Perfect Information


Behavioral Strategies

Definition (Behavioral Strategies)


In a game of perfect information, a players behavioral strategy
specifies at every decision node where it is his turn to move a
probability distribution over the choices that follow.

Definition (Behavioral Strategy Profile)


In a game of perfect information, a behavioral strategy profile specifies
one behavioral strategy for each player.

Extensive Form Games: Perfect Information


Behavioral Strategies

Compare:

Definition (Pure strategy)


In a game of perfect information, a pure strategy is a plan of action for
the entire game, that tells the player what particular choice to take at
every possible juncture of the game where it is his turn to move.

Definition (Mixed Strategy)


A mixed strategy is a probability distribution over the set of pure
strategies.

Definition (Behavioral Strategies)


In a game of perfect information, a players behavioral strategy
specifies at every decision node where it is his turn to move a
probability distribution over the choices that follow.

Extensive Form Games: Perfect Information


Behavioral Strategies

Example
1
L

2
a

2
b

1
2, 1

0, 0

4, 0

1, 4

1, 3

LA
LB
RA
RB

ac
2, 1
2, 1
4, 0
1, 4

ad
2, 1
2, 1
1, 3
1, 3

bc
0, 0
0, 0
4, 0
1, 4

(LA, ac ) corresponds to (L, a, A, c ).

( 12 LA + 21 LB , 13 ac + 32 ad ) c.t. (L, 21 A + 12 B , a, 31 c + 23 d ).

bd
0, 0
0, 0
1, 3
1, 3

Extensive Form Games: Perfect Information


Behavioral Strategies

Theorem (Kuhn)
(In any extensive form game with perfect recall,) every probability
distributions on ending nodes induced by a mixed strategy profile can
also be induced by some behavioral strategy profile.

The consequence is that, although mixed strategies may look


more general, there is no loss of generality in working only with
behavioral strategies.

You might also like