LensKit Simulator

This package provides support for generating synthetic data and simulating experiments and user response with LensKit.

Note

This package is currently a work-in-progress.

Development

Dependencies are managed with uv. Once uv is installed (see install in the documentation), in this project, run:

$ uv sync

Source material

This is starting as replication, rewrite, and upgrade of the following:

• Estimating Error and Bias in Offline Evaluation Results [code]
• Candidate Set Sampling for Evaluating Top-N Recommendation

We then plan to incorporate simulation logic from:

• Inference at Scale: Significance Testing for Large Search and Recommendation Experiments
• Multiple Testing for IR and Recommendation System Experiments
• It's Not You, It's Me after further internal development.