Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3097983.3098011acmconferencesArticle/Chapter ViewAbstractPublication PageskddConference Proceedingsconference-collections
research-article

Cascade Ranking for Operational E-commerce Search

Published: 13 August 2017 Publication History

Abstract

In the 'Big Data' era, many real-world applications like search involve the ranking problem for a large number of items. It is important to obtain effective ranking results and at the same time obtain the results efficiently in a timely manner for providing good user experience and saving computational costs. Valuable prior research has been conducted for learning to efficiently rank like the cascade ranking (learning) model, which uses a sequence of ranking functions to progressively filter some items and rank the remaining items. However, most existing research of learning to efficiently rank in search is studied in a relatively small computing environments with simulated user queries.
This paper presents novel research and thorough study of designing and deploying a Cascade model in a Large-scale Operational E-commerce Search application (CLOES), which deals with hundreds of millions of user queries per day with hundreds of servers. The challenge of the real-world application provides new insights for research: 1). Real-world search applications often involve multiple factors of preferences or constraints with respect to user experience and computational costs such as search accuracy, search latency, size of search results and total CPU cost, while most existing search solutions only address one or two factors; 2). Effectiveness of e-commerce search involves multiple types of user behaviors such as click and purchase, while most existing cascade ranking in search only models the click behavior. Based on these observations, a novel cascade ranking model is designed and deployed in an operational e-commerce search application. An extensive set of experiments demonstrate the advantage of the proposed work to address multiple factors of effectiveness, efficiency and user experience in the real-world application.

Supplementary Material

MP4 File (liu_cascade_ranking.mp4)

References

[1]
D. Agarwal, B.-C. Chen, R. Gupta, J. Hartman, Q. He, A. Iyer, S. Kolar, Y. Ma, P. Shivaswamy, A. Singh, et al. Activity ranking in linkedin feed. In SIGKDD, 2014.
[2]
R. Baeza-Yates, A. Gionis, F. Junqueira, V. Murdock, V. Plachouras, and F. Silvestri. The impact of caching on search engines. In SIGIR, 2007.
[3]
R. J. Bayardo, Y. Ma, and R. Srikant. Scaling up all pairs similarity search. In WWW, 2007.
[4]
L. Bourdev and J. Brandt. Robust object detection via soft cascade. In CVPR, 2005.
[5]
D. Carmel, D. Cohen, R. Fagin, E. Farchi, M. Herscovici, Y. Maarek, and A. Soffer. Static indexing pruning for information retrieval systems. In SIGIR, 2001.
[6]
O. Chapelle and Y. Chang. Yahoo! learning to rank challenge overview. Journal of Machine Learning Research-Proceedings Track, pages 1--24, 2011.
[7]
M. Chen, Z. E. Xu, and K. Q. W. et al. Classifier cascade for minimizing feature evaluation cost. In AISTATS, 2012.
[8]
H.-T. Cheng, L. Koc, J. Harmsen, T. Shaked, T. Chandra, H. Aradhye, G. Anderson, G. Corrado, W. Chai, M. Ispir, et al. Wide & deep learning for recommender systems. In DLRS, 2016.
[9]
P. Covington, J. Adams, and E. Sargin. Deep neural networks for youtube recommendations. In RecSys, 2016.
[10]
C. Elkan and K. Noto. Learning classifiers from only positive and unlabeled data. In SIGKDD, 2008.
[11]
J. H. Friedman. Greedy function approximation: a gradient boosting machine. Annals of statistics, pages 1189--1232, 2001.
[12]
X. Geng, T. Liu, T. Qin, and H. Li. Feature selection for rankng. In SIGIR, 2007.
[13]
S. Ji and L. Carin. Cost-sensitive feature acquisition and classification. Pattern Recognition, 40(5):1474--1485, 2007.
[14]
L. Lefakis and F. Fleuret. Joint cascade optimization using a product of boosted classifiers. In Advances in neural information processing systems, pages 1315--1323, 2010.
[15]
G. Linden, B. Smith, and J. York. Amazon. com recommendations: Item-to-item collaborative filtering. IEEE Internet computing, 7(1):76--80, 2003.
[16]
T. Liu. Learning to rank for information rerieval. Foundations and Trends in Information Retrieval, 2009.
[17]
V. C. Raykar, B. Krishnapuram, and S. Yu. Designing efficient cascaded classifiers: tradeoff between accuracy and cost. In SIGKDD, 2010.
[18]
H. Schneiderman. Feature-centric evaluation for efficient cascaded object detection. In CVPR, 2004.
[19]
V. S. Sheng and C. X. Ling. Partial example acquisition in cost-sensitive learning. In SIGKDD, 2007.
[20]
P. Viola and M. Jones. Rapid object detection using a boosted cascade of simple features. In CVPR, 2001.
[21]
L. Wang, J. Lin, and D. Metzler. Learning to efficientciently rank. In SIGIR, 2010.
[22]
L. Wang, J. Lin, and D. Metzler. A cascade ranking model for efficientcient ranked retrieval. In SIGIR, 2011.
[23]
L. Wang, J. Lin, D. Metzler, and J. Han. Learning to efficiently rank on big data. In WWW, 2014.
[24]
L. Wang, D. Metzler, and J. Lin. Ranking under temporal constraints. In CIKM, 2010.

Cited By

View all
  • (2024)Mitigating Sample Selection Bias with Robust Domain Adaption in Multimedia RecommendationProceedings of the 32nd ACM International Conference on Multimedia10.1145/3664647.3680615(7581-7590)Online publication date: 28-Oct-2024
  • (2024)RPAF: A Reinforcement Prediction-Allocation Framework for Cache Allocation in Large-Scale Recommender SystemsProceedings of the 18th ACM Conference on Recommender Systems10.1145/3640457.3688128(670-679)Online publication date: 8-Oct-2024
  • (2024)Enhancing Pre-Ranking Performance: Tackling Intermediary Challenges in Multi-Stage Cascading Recommendation SystemsProceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining10.1145/3637528.3671580(5950-5958)Online publication date: 25-Aug-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
KDD '17: Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining
August 2017
2240 pages
ISBN:9781450348874
DOI:10.1145/3097983
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 August 2017

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. cascade ranking
  2. effectiveness and efficiency
  3. operational e-commerce search system
  4. user experience

Qualifiers

  • Research-article

Conference

KDD '17
Sponsor:

Acceptance Rates

KDD '17 Paper Acceptance Rate 64 of 748 submissions, 9%;
Overall Acceptance Rate 1,133 of 8,635 submissions, 13%

Upcoming Conference

KDD '25

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)25
  • Downloads (Last 6 weeks)5
Reflects downloads up to 31 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Mitigating Sample Selection Bias with Robust Domain Adaption in Multimedia RecommendationProceedings of the 32nd ACM International Conference on Multimedia10.1145/3664647.3680615(7581-7590)Online publication date: 28-Oct-2024
  • (2024)RPAF: A Reinforcement Prediction-Allocation Framework for Cache Allocation in Large-Scale Recommender SystemsProceedings of the 18th ACM Conference on Recommender Systems10.1145/3640457.3688128(670-679)Online publication date: 8-Oct-2024
  • (2024)Enhancing Pre-Ranking Performance: Tackling Intermediary Challenges in Multi-Stage Cascading Recommendation SystemsProceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining10.1145/3637528.3671580(5950-5958)Online publication date: 25-Aug-2024
  • (2024)ReNeuIR at SIGIR 2024: The Third Workshop on Reaching Efficiency in Neural Information RetrievalProceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3626772.3657994(3051-3054)Online publication date: 10-Jul-2024
  • (2024)Cache-Aware Reinforcement Learning in Large-Scale Recommender SystemsCompanion Proceedings of the ACM Web Conference 202410.1145/3589335.3648326(284-291)Online publication date: 13-May-2024
  • (2024)Full Stage Learning to Rank: A Unified Framework for Multi-Stage SystemsProceedings of the ACM Web Conference 202410.1145/3589334.3645523(3621-3631)Online publication date: 13-May-2024
  • (2024)A Deep Reinforcement Learning Based Computation Resource Allocation Strategy for Multi-Scenario Advertising Systems2024 IEEE 6th Advanced Information Management, Communicates, Electronic and Automation Control Conference (IMCEC)10.1109/IMCEC59810.2024.10575305(926-930)Online publication date: 24-May-2024
  • (2024)A Multi-agent Reinforcement Learning Based CR Allocation Approach For Multi-Scenario Advertising Systems2024 IEEE 6th Advanced Information Management, Communicates, Electronic and Automation Control Conference (IMCEC)10.1109/IMCEC59810.2024.10575234(1971-1976)Online publication date: 24-May-2024
  • (2024)Token Pruning by Dimensionality Reduction Methods on TCT-ColBERT for RerankingFoundations of Intelligent Systems10.1007/978-3-031-62700-2_7(65-74)Online publication date: 17-Jun-2024
  • (2024)Recent Advances in Generative Information RetrievalAdvances in Information Retrieval10.1007/978-3-031-56069-9_48(363-368)Online publication date: 23-Mar-2024
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media