Offline and online evaluation of news recommender systems at swissinfo

2022/01/18


  • Context-tree recommender systems which profile the users in real-time
  • the CTR overestimates the actual impact for popular items and thus gives a skewed impression of the actual performance. Therefore, only comparing the actual article views can accurately picture actual performance.
  • Placing the recommendations at the top of the page more than doubled the CTR than at the bottom

Result

Increase in CTR about 35% for longer user sessions (context tree vs. random)


Reference

Florent Garcin, Boi Faltings, Olivier Donatsch, Ayar Alazzawi, Christophe Bruttin, and Amr Huber, “Offline and online evaluation of news recommender systems at swissinfo.ch,” in Proceedings of the 8th ACM Conference on Recommender systems - RecSys ’14, Foster City, Silicon Valley, California, USA, 2014, pp. 169–176. doi: 10.1145/2645710.2645745.

#recommender-system/news #recommender-system