2nd International Workshop on Industrial Recommendation Systems

August 15 11:00pm (SG) - August 16 8:00am (SG), 2021 / August 15 8:00am (PT) - August 15 5:00pm (PT), 2021


Recommendation systems are used widely in ecommerce industries, multimedia content platforms and social networks to provide suggestions that a user will most likely consume or connect; thus, improving the user experience. This motivates people in both industry and research organizations to focus on personalization or recommendation algorithms, which has resulted in a plethora of research papers. While academic research mostly focuses on the performance of recommendation algorithms in terms of ranking quality or accuracy, it often neglects key factors that impact how a recommendation system will perform in a real-world environment. These key factors include but are not limited to: business metric definition and evaluation, recommendation quality control, data and model scalability, model interpretability, model robustness and fairness, and resource limitations, such as budget on computing and memory resources, engineering workforce cost, etc..

The gap in constraints and requirements between academic research and industry limits the broad applicability of many of academia’s contributions for industrial recommendation systems. This workshop aspires to bridge this gap by bringing together researchers from both academia and industry. Its goal is to serve as a platform via which academic researchers become aware of the additional factors that may affect the chances of algorithm adoption into real production systems, and the performance of the algorithms if deployed. Industrial researchers will also benefit from sharing the practical frameworks at an industrial level.


Xiangnan He

Xiangnan He Professor USTC

Vijay Bhardwaj

Vijay Bhardwaj VP of Product Innovation Netflix

Rishabh Mehrotra

Rishabh Mehrotra Senior Research Scientist Spotify

Yunjiang Jiang Principal Research Scientist JD.com

Da Xu

Da Xu Senior Machine Learning Engineer WalmartLabs

Anoop Deoras

Anoop Deoras Group Manager Amazon AWS

Even Oldridge

Even Oldridge Senior Manager - Recsys Platform Nvidia

Important Dates

May 20, 2021 May 30, 2021 : Workshop paper submission (deadline extended)

June 20, 2021 June 25, 2021 : Workshop paper notifications

July 18, 2021: Camera-ready deadline for workshop papers

August 15 11:00pm (SG) - August 16 8:00am (SG), 2021 / August 15 8:00am (PT) - August 15 5:00pm (PT), 2021: Workshop Date

Call For Papers

This workshop welcomes submissions from researchers and industrial practitioners broadly related to recommendation systems, such as novel recommendation models, efficient recommendation algorithms, novel industrial frameworks, etc. In order to emphasize the gap between the two communities, we extremely welcome submissions on industrial recommendation system infrastructures based on given resources, models and algorithms supported by the specific infrastructures, and frameworks or end-to-end systems that have been deployed in real world production. All accepted papers will be posted on the workshop website and will not appear in the KDD proceedings. Selected papers will be presented as contributed talks.

Specific topics of interest are including but not limited to:

  1. Frameworks or end-to-end systems from industry are extremely welcomed.
  2. Novel data mining and machine learning algorithms for scalable Recommender systems.
  3. Personalization, including personalized product recommendation, streaming content recommendation, ads recommendation, news and article recommendation, etc.
  4. New applications related to recommendation systems.
  5. Existing or novel infrastructures for recommendation systems.
  6. Interactive recommendation system.
  7. Explainability of recommendations.
  8. Fairness, privacy and security in recommender systems.
  9. Recommendations under multi-objective and constraints.
  10. Reproducibility of models and evaluation metrics.
  11. Unbiased recommendation.
  12. User research studies on real-world recommender systems.
  13. Business impact of recommendation systems.

Submission Directions:

The workshop accepts long papers (limited to 9 pages), short papers (6 pages), posters (4 pages), abstracts and demos (2 pages). Paper submission and reviewing will be following the directions of the KDD main conference. Reviews are not double-blind, and author names and affiliations should be listed. Submissions should include all content and references within the limited pages, and must be in PDF format and formatted according to the new Standard ACM Conference Proceedings Template. For LaTeX users: unzip acmart.zip, make, and use sample-sigconf.tex as a template. Additional information about formatting and style files is available online at: https://www.acm.org/publications/proceedings-template. Papers that do not meet the formatting requirements will be rejected without review. In addition, authors can provide an optional two (2) page supplement at the end of their submitted paper (it needs to be in the same PDF file) focused on reproducibility.

Please submit your paper through this Easychair link. Please reach out to irs-kdd@googlegroups.com or irs2021-0@easychair.org for any questions.


Time Speaker Title
10:55PM - 11:00PM, 2021/08/15 (SG)
07:55AM - 08:00AM, 2021/08/15 (PT)
Host Chair Welcome and Open Remards
11:00PM - 11:40PM, 2021/08/15 (SG)
08:00AM - 08:40AM, 2021/08/15 (PT)
Xiangnan He [USTC] Keynote 1 [YouTube]
11:40PM - 00:20AM, 2021/08/15-16 (SG)
08:40AM - 09:20AM, 2021/08/15 (PT)
Vijay Bharadwaj [Netflix] Keynote 2 [YouTube]
00:20AM - 01:00AM, 2021/08/16 (SG)
09:20AM - 10:00AM, 2021/08/15 (PT)
Rishabh Mehrotra [Spotify] Keynote 3 [YouTube]
01:00AM - 01:10AM, 2021/08/16 (SG)
10:00AM - 10:10AM, 2021/08/15 (PT)
N/A Break
01:10AM - 01:25AM, 2021/08/16 (SG)
10:10AM - 10:25AM, 2021/08/15 (PT)
TBD Oral 1 [YouTube]
01:25AM - 01:40AM, 2021/08/16 (SG)
10:25AM - 10:40AM, 2021/08/15 (PT)
TBD Oral 2 [YouTube]
01:40AM - 02:20AM, 2021/08/16 (SG)
10:40AM - 11:20AM, 2021/08/15 (PT)
Panel TBD Panel Discussion (Tentative) [YouTube]
02:20AM - 03:00AM, 2021/08/16 (SG)
11:20AM - 12:00PM, 2021/08/15 (PT)
Yunjiang Jiang [JD.com] Keynote 4 [YouTube]
03:00AM - 04:00AM, 2021/08/16 (SG)
12:00PM - 01:00PM, 2021/08/15 (PT)
N/A Lunch Break[YouTube]
04:00AM - 04:40AM, 2021/08/16 (SG)
01:00PM - 01:40PM, 2021/08/15 (PT)
Da Xu [Walmart] Keynote 5 [YouTube]
04:40AM - 05:20AM, 2021/08/16 (SG)
01:40PM - 02:20PM, 2021/08/15 (PT)
Anoop Deoras [Amazon AWS] Keynote 6 [YouTube]
05:20AM - 06:00AM, 2021/08/16 (SG)
02:20PM - 03:00PM, 2021/08/15 (PT)
Even Oldridge [Nvidia] Keynote 7 [YouTube]
06:00AM - 06:10AM, 2021/08/16 (SG)
03:00PM - 03:10PM, 2021/08/15 (PT)
N/A Break
06:10AM - 06:25AM, 2021/08/16 (SG)
03:10AM - 03:25AM, 2021/08/15 (PT)
TBD Oral 3 [YouTube]
06:25AM - 06:40AM, 2021/08/16 (SG)
03:25PM - 03:40PM, 2021/08/15 (PT)
TBD Oral 4 [YouTube]
06:40AM - 06:55AM, 2021/08/16 (SG)
03:40PM - 03:55PM, 2021/08/15 (PT)
TBD Oral 5 [YouTube]
06:55AM - 07:55AM, 2021/08/16 (SG)
03:55PM - 04:55PM, 2021/08/15 (PT)
Authors of Accepted Papers Poster Session [YouTube]
07:55AM - 08:00AM, 2021/08/16 (SG)
04:55PM - 05:00PM, 2021/08/15 (PT)
Host Chair Announcement, Closing Remarks [YouTube]

Accepted Publications (TBD)

Program Committee

We want to thank our program committee members for their hard work to select the valuable publications for our workshop.

Workshop Co-Chairs

Jianpeng Xu

Jianpeng Xu WalmartLabs

Lingfei Wu

Lingfei Wu JD.com

Linsey Pang

Linsey Pang WalmartLabs

Mohit Sharma

Mohit Sharma Google

Organizing Committees

Dawei Yin

Dawei Yin Baidu

George Karypis

George Karypis University of Minnesota Twin Cities

Justin Basilico

Justin Basilico NetFlix

Philip S. Yu

Philip S. Yu University of Illinois at Chicago