Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3447548.3467113acmconferencesArticle/Chapter ViewAbstractPublication PageskddConference Proceedingsconference-collections
research-article

MEOW: A Space-Efficient Nonparametric Bid Shading Algorithm

Published: 14 August 2021 Publication History

Abstract

Bid Shading has become increasingly important in Online Advertising, with a large amount of commercial [4,12,13,29] and research work [11,20,28] recently published. Most approaches for solving the bid shading problem involve estimating the probability of win distribution, and then maximizing surplus [28]. These generally use parametric assumptions for the distribution, and there has been some discussion as to whether Log-Normal, Gamma, Beta, or other distributions are most effective [8,38,41,44]. In this paper, we show evidence that online auctions generally diverge in interesting ways from classic distributions. In particular, real auctions generally exhibit significant structure, due to the way that humans set up campaigns and inventory floor prices [16,26]. Using these insights, we present a nonparametric method for Bid Shading which enables the exploitation of this deep structure. The algorithm has low time and space complexity, and is designed to operate within the challenging millisecond Service Level Agreements of Real-Time Bid Servers. We deploy it in one of the largest Demand Side Platforms in the United States, and show that it reliably out-performs best in class Parametric benchmarks. We conclude by suggesting some ways that the best aspects of parametric and nonparametric approaches could be combined.

Supplementary Material

MP4 File (kdd2021-Paper2151-Meow_KDD2021_talk2.mp4)
Bid shading is the practice of submitting a price lower than the bidder's private value of a good, so as to reduce cost. Much of the Online Advertising industry uses First Price Auctions, and so automated bid shading has become a necessity. Most approaches for solving the problem involve estimating the probability of win distribution and maximizing surplus. These approaches often use parametric assumptions about the distribution. We show that real online auctions can diverge in interesting ways from classic distributions. In particular we observe a phenomenon reminiscent of Left Digit Anchoring that may be due to how human inventory managers set floor prices. Using these insights, we present a nonparametric method for bid shading which enables the exploitation of this structure.

References

[1]
2021. Nonparametric statistics.Wikipedia website(2021). https://en.wikipedia.org/wiki/Nonparametric_statistics
[2]
Eric J. Allen, Patricia M. Dechow, Devin G. Pope, and George Wu. 2014. Reference-Dependent Preferences: Evidence from Marathon Runner, Management Science. Institute for Operations Research and the Management Sciences (INFORMS) (2014). http://faculty.chicagobooth.edu/devin.pope/research/pdf/website_marathons.pdf
[3]
Yonghong An, Yingyao Hu, and Matthew Shum. 2010. Estimating first-price auctions with an unknown number of bidders: A misclassification approach. Journal of Econometrics, Vol. 157, 2 (2010), 328--341.
[4]
AppNexus. 2018. Demystifying Auction Dynamics for Digital Buyers and Sellers. In AppNexus Website. https://www.appnexus.com/sites/default/files/whitepapers/49344-CM-Auction-Type-Whitepaper-V9.pdf
[5]
Pierpaolo Battigalli and Marciano Siniscalchi. 2003. Rationalizable bidding in first-price auctions. Games and Economic Behavior, Vol. 45, 1 (2003), 38--72.
[6]
A. Blum and J. D. Hartline. 2005. Near-optimal online auctions. Proceedings of the sixteenth annual ACM-SIAM symposium on Discrete algorithms (January 2005), 1156--1163.
[7]
John M. Crespi and Richard J Sexton. 2005. A Multinomial logit framework to estimate bid shading in procurement auctions: Application to cattle sales in the Texas Panhandle. Review of industrial organization, Vol. 27, 3 (2005), 253--278.
[8]
Ying Cui, Ruofei Zhang, Wei Li, and Jianchang Mao. 2011. Bid landscape forecasting in online ad exchange marketplace. In Proceedings of the 17th ACM SIGKDD international conference on Knowledge discovery and data mining. 265--273.
[9]
emarketer. 2020. Top 6 DSPs in the past 12 months.
[10]
Getintent. 2018. Digital Ad Impression Share Among US Supply-Side Platforms (SSPs), by Auction Type, Dec 2017 and March 2018: % of total impressions analyzed by GetIntent, April 30, 2018. https://www.emarketer.com/content/five-charts-the-state-of-programmatic-bidding
[11]
Djordje Gligorijevic, Tian Zhou, Bharatbhushan Shetty, Brendan Kitts, Shengjun Pan, Junwei Pan, and Aaron Flores. 2020. Bid Shading in The Brave New World of First-Price Auctions. In The 29th ACM International Conference on Information and Knowledge Management. CIKM'20.
[12]
Google. 2019 a. Real Time Bidding Protocol Protocol Buffer v.167. https://developers.google.com/authorized-buyers/rtb/downloads/realtime-bidding-proto
[13]
Google. 2019 b. Real Time Bidding Protocol, Release Notes. https://developers.google.com/authorized-buyers/rtb/relnotes#updates-2019-03--13
[14]
Emmanuel Guerre, Isabelle Perrigne, and Quang Vuong. 2000. Optimal nonparametric estimation of first-price auctions. Econometrica, Vol. 68, 3 (2000), 525--574.
[15]
Yanjun Han, Zhengyuan Zhou, Aaron Flores, Erik Ordentlich, and Tsachy Weissman. 2020. Learning to Bid Optimally and Efficiently in Adversarial First-price Auctions. arXiv preprint arXiv:2007.04568 (2020).
[16]
J. Holdershaw, P. Gendall, and R. Garland. 1997. The Widespread Use Of Odd Pricing In The Retail Sector. Marketing Bulletin, Vol. 8. http://marketing-bulletin.massey.ac.nz/V8/MB_V8_N1_Holdershaw.pdf
[17]
Ali Hortacc su, Jakub Kastl, and Allen Zhang. 2018. Bid shading and bidder surplus in the us treasury auction system. American Economic Review, Vol. 108, 1 (2018), 147--69.
[18]
B. Hovaness. 2018. Sold for more than you should have paid. In Hearts and Science Website. https://www.hearts-science.com/sold-for-more-than-you-should-have-paid/
[19]
Thomas Henry Huxley and Leonard Huxley. 1900. The Life and Letters of Thomas Henry Huxley. Vol. 1. Macmillan.
[20]
Niklas Karlsson and Qian Sang. 2021. Adaptive Bid Shading Optimization of First-Price Ad Inventory. In Proceedings of the 2021 American Control Conference (New Orleans). 4971--4978.
[21]
N. B. Keskin and A. Zeevi. 2014. Dynamic pricing with an unknown demand model: Asymptotically optimal semi-myopic policies. Operations Research, Vol. 62, 5 (2014), 1142--1167.
[22]
Brendan Kitts. 2019. Bidder Behavior after Shifting from Second to First Price Auctions in Online Advertising. http://www.appliedaisystems.com/papers/FPA_Effects33.pdf
[23]
B. Kitts and K. Hetherington-Young. 2005. Price Optimization in Grocery Stores with Cannibalistic Product Interactions. Proceedings of the First Workshop on Data Mining Case Studies, Fifth IEEE International Conference on Data Mining (ICDM 2005) (November 2005), 74--91. http://dataminingcasestudies.com/DMCS_WorkshopProceedings25.pdf
[24]
R. Kleinberg and T. Leighton. 2003. The value of knowing a demand curve: Bounds on regret for online posted-price auctions. 44th Annual IEEE Symposium on Foundations of Computer Science (2003), 594--605.
[25]
Paul Kvam and Brani Vidakovic. 2007. Nonparametric Statistics with Applications in Science and Engineering .John Wiley & Sons, Inc. http://zoe.bme.gatech.edu/ bv20/isye6404/Bank/npmarginal.pdf
[26]
Daniel Levy, Dongwon Lee, Haipeng (Allan) Chen, Robert J. Kauffman, and Mark Bergen. 2011. Price Points and Price Rigidity. Review of Economics and Statistics, Vol. 93. Issue 4. https://www.biu.ac.il/soc/ec/d_levy/wp/pricepointsaug2008.pdf
[27]
Christina MacDonald. 2020. Verizon Media brings native marketplace, premium inventory into expanded DSP. In Verizon Media Website. https://www.verizonmedia.com/press/2020/05/01/verizon-media-expanded-dsp
[28]
Shengjun Pan, Brendan Kitts, Tian Zhou, Hao He, Bharatbhushan Shetty, Aaron Flores, Djordje Gligorijevic, Junwei Pan, Tingyu Mao, San Gultekin, and Jianlong Zhang. 2020. Bid Shading by Win-Rate Estimation and Surplus Maximization. In The 26th ACM SIGKDD Conference on Knowledge Discovery and Data Mining. AdKDD'20, San Diego, California, USA.
[29]
Rubicon. 2018. Bridging the Gap to First-Price Auctions: A Buyer's Guide. In Rubicon Website. http://go.rubiconproject.com/rs/958-XBX-033/images/Buyers_Guide_to_First_Price_Rubicon_Project.pdf
[30]
Ilya Segal. 2003. Optimal Pricing Mechanisms with Unknown Demand. American Economic Review, Vol. 93, 3 (June 2003), 509--529. https://papers.ssrn.com/sol3/papers.cfm?abstract_id=297674
[31]
Hermann Simon. 1989. Price Management. North-Holland.
[32]
Pablo Ballesteros-Pérez & Martin Skitmore. 2017. On the distribution of bids for construction contract auctions. Construction Management and Economics, Vol. 35, 3 (2017), 106--121.
[33]
U. Song. 2004. Nonparametric estimation of an eBay auction model with an unknown number of bidders. Department of Economics, University of British Columbia.
[34]
L. Wasserman. 2006. All Things Nonparametric. Springer Verlag.
[35]
Chen-Yu Wei, Haipeng Luo, and Alekh Agarwal. 2020. Taking a hint: How to leverage loss predictors in contextual bandits?. In Conference on Learning Theory. PMLR, 3583--3634.
[36]
J. Wolfers. 2014. What Good Marathons and Bad Investments Have in Common. New York Times (22 April 2014). https://www.nytimes.com/2014/04/23/upshot/what-good-marathons-and-bad-investments-have-in-common.html
[37]
J. Wolfowitz. 1942. Additive Partition Functions and a Class of Statistical Hypotheses. Annals of Statistics (1942), 247--279.
[38]
W.C.H. Wu, M.Y. Yeh, and M.S. Chen. 2015a. Predicting winning price in real time bidding with censored data. KDD (2015).
[39]
Wush Wu, Mi-Yen Yeh, and Ming-Syan Chen. 2018. Deep censored learning of the winning price in the real time bidding. In Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. KDD '18, London, United Kingdom, 2526--2535.
[40]
Wush Chi-Hsuan Wu, Mi-Yen Yeh, and Ming-Syan Chen. 2015b. Predicting winning price in real time bidding with censored data. In Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. KDD '15, Sydney, 1305--1314.
[41]
Z. Xie, K. Lee, and L. Wang. 2017. Optimal Reserve Price for Online Ads Trading Based on Inventory Identification. In Proceedings of AdKDD Workshop .
[42]
Qixing Zheng, Niklas Karlsson, and Qian Sang. 2018. Plant Estimation and Feedback Control for Online Advertising Campaigns. In The 12th China-Japan International Workshop on Information Technology and Control Applications (ITCA2018) .
[43]
T. Zhou, J. Guo, and N. Karlsson. 2018. A KPIs Forecasting Scheme for Online Advertising Systems. Techpulse (2018).
[44]
Tian Zhou, Hao He, Shengjun Pan, Niklas Karlsson, Bharatbhushan Shetty, Brendan Kitts, Djordje Gligorijevic, Junwei Pan, San Gultekin, Tingyu Mao, Jianlong Zhang, and Aaron Flores. 2021. Efficient Deep Distribution Network for Bid Shading in First Price Auctions. KDD '21: Proceedings of the 27th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining (2021).
[45]
Christine Zulehner. 2009. Bidding behavior in sequential cattle auctions. International Journal of Industrial Organization, Vol. 27, 1 (2009), 33--42.

Cited By

View all
  • (2024)Robust Auto-Bidding Strategies for Online AdvertisingProceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining10.1145/3637528.3671729(1804-1815)Online publication date: 25-Aug-2024
  • (2024)Follow the LIBRA: Guiding Fair Policy for Unified Impression Allocation via Adversarial RewardingProceedings of the 17th ACM International Conference on Web Search and Data Mining10.1145/3616855.3635756(750-759)Online publication date: 4-Mar-2024
  • (2023)A Survey on Bid Optimization in Real-Time Bidding Display AdvertisingACM Transactions on Knowledge Discovery from Data10.1145/362860318:3(1-31)Online publication date: 9-Dec-2023
  • Show More Cited By

Index Terms

  1. MEOW: A Space-Efficient Nonparametric Bid Shading Algorithm

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      KDD '21: Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining
      August 2021
      4259 pages
      ISBN:9781450383325
      DOI:10.1145/3447548
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Sponsors

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 14 August 2021

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. advertising
      2. auction
      3. bid
      4. online bidding
      5. optimization
      6. shading

      Qualifiers

      • Research-article

      Conference

      KDD '21
      Sponsor:

      Acceptance Rates

      Overall Acceptance Rate 1,133 of 8,635 submissions, 13%

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)53
      • Downloads (Last 6 weeks)6
      Reflects downloads up to 15 Oct 2024

      Other Metrics

      Citations

      Cited By

      View all
      • (2024)Robust Auto-Bidding Strategies for Online AdvertisingProceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining10.1145/3637528.3671729(1804-1815)Online publication date: 25-Aug-2024
      • (2024)Follow the LIBRA: Guiding Fair Policy for Unified Impression Allocation via Adversarial RewardingProceedings of the 17th ACM International Conference on Web Search and Data Mining10.1145/3616855.3635756(750-759)Online publication date: 4-Mar-2024
      • (2023)A Survey on Bid Optimization in Real-Time Bidding Display AdvertisingACM Transactions on Knowledge Discovery from Data10.1145/362860318:3(1-31)Online publication date: 9-Dec-2023
      • (2023)Deep Landscape Forecasting in Multi-Slot Real-Time BiddingProceedings of the 29th ACM SIGKDD Conference on Knowledge Discovery and Data Mining10.1145/3580305.3599799(4685-4695)Online publication date: 6-Aug-2023
      • (2023)HiBid: A Cross-Channel Constrained Bidding System With Budget Allocation by Hierarchical Offline Deep Reinforcement LearningIEEE Transactions on Computers10.1109/TC.2023.334311173:3(815-828)Online publication date: 14-Dec-2023
      • (2022)Leveraging the hintsProceedings of the 36th International Conference on Neural Information Processing Systems10.5555/3600270.3601820(21329-21341)Online publication date: 28-Nov-2022

      View Options

      Get Access

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Media

      Figures

      Other

      Tables

      Share

      Share

      Share this Publication link

      Share on social media