The presentation overview discusses key metrics for measuring game performance including lifetime value (LTV), virality, retention, and monetization. It explains that LTV should be considered from the beginning of development. Three case studies are provided of exits from game companies. Performance is measured based on monetization, virality, and retention. The relationships between these metrics and LTV are interdependent. It is important for LTV to be greater than customer acquisition costs for success. The presentation provides definitions and importance of virality, retention, and monetization as well as techniques for improving each metric. It also discusses sources of uncertainty and the importance of not overfitting models to past data.
1 of 41
More Related Content
Groundworks presentation on ltv
2. PRESENTATION OVERVIEW
Relevant background
Why Lifetime Value
Importance beyond social media
Virality
Retention
Monetization
The Cost Side
LTV varies among customers
Uncertainty of LTV
4. THREE EXITS IN THREE YEARS
Co-founded Merscom CCO, led all marketing/sales/distribution
• Grew to top-5 casual game company
• Initiated and negotiated sale to Playdom, which was then rolled into $570 million Disney acquisition
GM of Playdom’s International Publishing team
• Responsible for Europe, Latin America, Russia and India
• Grew it from scratch to 25 percent of Playdom’s revenue
CEO of FiveOneNine Games
• Joint venture of EW Scripps and Capitol Broadcasting
• Launched Facebook and mobile games
Chief Growth Officer at Spooky Cool
• Helped lead sale of company to Zynga
• Lead UA, analytics, monetization and community
Senior Director, Zynga
• Social casino team
• Product, analytics, user acquisition
6. BASED ON THREE PERFORMANCE METRICS
Monetization
Virality
Retention
9. THINK OF LTV STARTING DAY 1
Green-light
Design and
develop
focused on
LTV
Beta and
other testing
to optimize
LTV
Post launch
to focus on
improving
LTV
16. DEFINITION OF VIRALITY
K-score
K=i*conv% (conversion percentage), where “i” is the number of invites sent
out by each new customer and “conv%” is the percentage of invites that
convert into costumers
25. DEFINITION OF MONETIZATION
ARPU (Average
revenue per
user)
ARPDAU
(Average
revenuer per
daily active user)
Average
transaction
Percentage of
customers who
monetize
Average number
of monetization
events per
customer
35. UNCERTAINTY PRINCIPLE
Quantum Mechanics
• The universe is random
• Perfect predictions are impossible if the universe is random
Not a function that creates a value
You are predicting a future event
Create a range, not a number
• Albert Pujols is likely to hit 30-40 home runs is more accurate than Pujols is likey to hit 36
home runs
Models are simplifications of the world
36. RISK VS UNCERTAINTY
Risk
Something you can put a price
on
Uncertainty
Risk that is hard to measure
Do not
confuse
uncertainty
for risk
Correlation of past data does
not create certainty
37. THE MAJOR DIFFERENCE BETWEEN A THING THAT MIGHT GO WRONG AND A THING THAT
CANNOT POSSIBLY GO WRONG IS THAT WHEN A THING THAT CANNOT POSSIBLY GO WRONG
GOES WRONG IT USUALLY TURNS OUT TO BE IMPOSSIBLE TO GET AT OR REPAIR,” WROTE
DOUGLAS ADAMS IN THE HITCHHIKER’S GUIDE TO THE GALAXY SERIES.
Wrong assumptions can have profound effects
• Independence of variables
• Mortgage industry
Chaos Theory
• Not a synonym for the game industry
• A small change in initial conditions can produce a large
and unexpected divergence in outcomes
• Major risk when modeling against past performance
38. DO NOT DISCOUNT QUALITATIVE INFORMATION
More data is better than less
This includes non-quantitive measures
Billy Beane has dramatically increased scouting
The Smell Test
39. AVOID OVERFITTING
Mistaking noise for signal
Fitting a statistical model to
match past observations
Test how much of the
variability of the data is
accounted for by your model
40. SOLUTIONS
Create LTV range
•Think probabilistically
•Distribution shows honest uncertainty
A/B Test
•Can validate assumptions
Surveillance
•Regularly (weekly or monthly) compare data with predictions
•“When the facts change, I change my mind”, John Maynard Keynes
Avoid Overfitting
Include qualitative data