StreamMyRelevance! Prediction of Result Relevance from Real-Time Interactions and its Application to Hotel Search

Authors: Maximilian Speicher, Sebastian Nuck (HTWK Leipzig), Andreas Both (R&D, Unister GmbH), Martin Gaedke

Introduction

The prime aspect of quality for search-driven web applications is to provide users with the best possible results for a given query. Thus, it is necessary to predict the relevance of results a priori. Current solutions mostly engage clicks on results for respective predictions, but research has shown that it is highly beneficial to also consider additional features of user interaction. Nowadays, such interactions are produced in steadily growing amounts by internet users. Processing these requires streaming-based approaches and incrementally updateable relevance models. We present StreamMyRelevance! - a novel streaming-based system for ensuring quality of ranking in search engines. Our approach provides a complete pipeline from collecting interactions in real-time to processing them incrementally on the server side. We conducted a large-scale evaluation with real-world data from the hotel search domain. Results show that our system yields predictions as good as those of competing state-of-the-art systems, but by design of the underlying framework at higher efficiency, robustness and scalability.

Resources (to be used with WEKA)

• Dataset 0
  • SMR training data
  • SMR model
  • TMR training data
  • TMR model
• Dataset 1
  • SMR training data
  • SMR model
  • TMR training data
  • TMR model
• Dataset 2
  • SMR training data
  • SMR model
  • TMR training data
  • TMR model
• Dataset 3
  • SMR training data
  • SMR model
  • TMR training data
  • TMR model
• Dataset 4
  • SMR training data
  • SMR model
  • TMR training data
  • TMR model
• Dataset 5
  • SMR training data
  • SMR model
  • TMR training data
  • TMR model
• Dataset 6
  • SMR training data
  • SMR model
  • TMR training data
  • TMR model
• Dataset 7
  • SMR training data
  • SMR model
  • TMR training data
  • TMR model
• Dataset 8
  • SMR training data
  • SMR model
  • TMR training data
  • TMR model
• Dataset 9
  • SMR training data
  • SMR model
  • TMR training data
  • TMR model

Acknowledgments

This work has been carried out in cooperation with Unister GmbH, Leipzig and was supported by the ESF and the Free State of Saxony.