TrainTestExperiment (LensKit 3.0-M2)

java.lang.Object
- org.lenskit.eval.traintest.TrainTestExperiment

```
public class TrainTestExperiment
extends Object
```
Sets up and runs train-test evaluations. This class can be used directly, but it will usually be controlled from the train-test command line tool in turn driven by a Gradle script. For a simpler way to programatically run an evaluation, see SimpleEvaluator, which provides a simplified interface to train-test evaluations with cross-validation.
A train-test experiment experiment consists of three things:
- A collection of algorithms.
- A collection of train-test data sets.
- A collection of tasks, each of which performs an action on the recommender (e.g. predict users’ test ratings, or produce recommendations) and measures the recommender’s performance on that task using one or more metrics.
Global output is aggregated into a CSV file; individual tasks or metrics may produce additional files.

Constructor Summary

Constructors
Constructor and Description

TrainTestExperiment()

Constructors
Constructor and Description
`TrainTestExperiment()`

Method Summary

All Methods Static Methods Instance Methods Concrete Methods
Modifier and Type	Method and Description
`void`	`addAlgorithm(AlgorithmInstance algo)` Add an algorithm to the experiment.
`void`	`addAlgorithm(String name, groovy.lang.Closure<?> block)` Add an algorithm configured by a Groovy closure.
`void`	`addAlgorithm(String name, Path file)` Add one or more algorithms by loading a config file.
`void`	`addAlgorithms(List<AlgorithmInstance> algos)` Add multiple algorithm instances.
`void`	`addAlgorithms(Path file)` Add one or more algorithms from a configuration file.
`void`	`addDataSet(DataSet ds)` Add a data set.
`void`	`addDataSets(List<DataSet> dss)` Add several data sets.
`void`	`addTask(EvalTask task)` Add an evaluation task.
`Table`	`execute()` Run the experiment.
`List<AlgorithmInstance>`	`getAlgorithms()` Get the algorithm instances.
`Path`	`getCacheDirectory()` Get the cache directory for model components.
`ClassLoader`	`getClassLoader()` Get the class loader for this experiment.
`List<DataSet>`	`getDataSets()` Get the list of data sets to use.
`Path`	`getOutputFile()` Get the primary output file.
`ExperimentOutputLayout`	`getOutputLayout()`
`boolean`	`getShareModelComponents()` Query whether this experiment will cache and share components.
`List<EvalTask>`	`getTasks()` Get the eval tasks to be used in this experiment.
`int`	`getThreadCount()` Get the number of threads that the experiment may use.
`Path`	`getUserOutputFile()` Get the per-user output file.
`static TrainTestExperiment`	`load(Path file)` Load a train-test experiment from a YAML file.
`void`	`setCacheDirectory(Path dir)` Set the cache directory for model components.
`void`	`setClassLoader(ClassLoader loader)` Set the class loader for this experiment.
`void`	`setOutputFile(Path out)` Set the primary output file.
`void`	`setShareModelComponents(boolean shares)` Control whether model components will be shared.
`void`	`setThreadCount(int tc)` Set the number of threads the experiment may use.
`void`	`setUserOutputFile(Path file)` Set the per-user output file.

Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

- Constructor Detail
  - TrainTestExperiment
```
public TrainTestExperiment()
```
- Method Detail
  - setOutputFile
```
public void setOutputFile(Path out)
```
    Set the primary output file.
    
    Parameters:
    
    out - The file where the primary aggregate output should go.
  - getOutputFile
```
public Path getOutputFile()
```
    Get the primary output file.
    
    Returns:
    
    The primary output file.
  - getUserOutputFile
```
public Path getUserOutputFile()
```
    Get the per-user output file.
    
    Returns:
    
    The output file for per-user measurements.
  - setUserOutputFile
```
public void setUserOutputFile(Path file)
```
    Set the per-user output file.
    
    Parameters:
    
    file - The file for per-user measurements.
  - getAlgorithms
```
public List<AlgorithmInstance> getAlgorithms()
```
    Get the algorithm instances.
    
    Returns:
    
    The algorithms to run.
  - addAlgorithm
```
public void addAlgorithm(AlgorithmInstance algo)
```
    Add an algorithm to the experiment.
    
    Parameters:
    
    algo - The algorithm to add.
  - addAlgorithms
```
public void addAlgorithms(List<AlgorithmInstance> algos)
```
    Add multiple algorithm instances.
    
    Parameters:
    
    algos - The algorithm instances to add.
  - addAlgorithm
```
public void addAlgorithm(String name,
                         groovy.lang.Closure<?> block)
```
    Add an algorithm configured by a Groovy closure. Mostly useful for testing.
    
    Parameters:
    
    name - The algorithm name.
    
    block - The algorithm configuration block.
  - addAlgorithm
```
public void addAlgorithm(String name,
                         Path file)
```
    Add one or more algorithms by loading a config file.
    
    Parameters:
    
    name - The algorithm name.
    
    file - The config file to load.
  - addAlgorithms
```
public void addAlgorithms(Path file)
```
    Add one or more algorithms from a configuration file.
    
    Parameters:
    
    file - The configuration file.
  - getDataSets
```
public List<DataSet> getDataSets()
```
    Get the list of data sets to use.
    
    Returns:
    
    The list of data sets to use.
  - addDataSet
```
public void addDataSet(DataSet ds)
```
    Add a data set.
    
    Parameters:
    
    ds - The data set to add.
  - addDataSets
```
public void addDataSets(List<DataSet> dss)
```
    Add several data sets.
    
    Parameters:
    
    dss - The data sets to add.
  - getShareModelComponents
```
public boolean getShareModelComponents()
```
    Query whether this experiment will cache and share components.
    
    Returns:
    
    true if model components will be shared.
    
    See Also:
    
    setShareModelComponents(boolean)
  - setShareModelComponents
```
public void setShareModelComponents(boolean shares)
```
    Control whether model components will be shared. If setCacheDirectory(Path) is also set, components will be cached on disk; otherwise, they will be opportunistically shared in memory.
    Cached output improves throughput and memory use, but makes build times effectively meaningless. It is turned on by default, but turn it off if you want to measure recommender build times.
    
    Parameters:
    
    shares - true to enable caching of shared model components.
  - getCacheDirectory
```
public Path getCacheDirectory()
```
    Get the cache directory for model components.
    
    Returns:
    
    The directory where model components will be cached.
  - setCacheDirectory
```
public void setCacheDirectory(Path dir)
```
    Set the cache directory for model components.
    
    Parameters:
    
    dir - The directory where model components will be cached.
  - getThreadCount
```
public int getThreadCount()
```
    Get the number of threads that the experiment may use.
    
    Returns:
    
    The number of threads that the experiment may use.
  - setThreadCount
```
public void setThreadCount(int tc)
```
    Set the number of threads the experiment may use.
    
    Parameters:
    
    tc - The number of threads that the experiment may use. If 0 (the default), consults the property lenskit.eval.threadCount, and if that is unset, uses as many threads as there are available processors according to Runtime.availableProcessors().
  - getClassLoader
```
public ClassLoader getClassLoader()
```
    Get the class loader for this experiment.
    
    Returns:
    
    The class loader that will be used.
  - setClassLoader
```
public void setClassLoader(ClassLoader loader)
```
    Set the class loader for this experiment.
    
    Parameters:
    
    loader - The class loader to use.
  - getTasks
```
public List<EvalTask> getTasks()
```
    Get the eval tasks to be used in this experiment.
    
    Returns:
    
    The evaluation tasks to run.
  - addTask
```
public void addTask(EvalTask task)
```
    Add an evaluation task.
    
    Parameters:
    
    task - An evaluation task to run.
  - execute
```
public Table execute()
```
    Run the experiment.
    
    Returns:
    
    The global aggregate results from the experiment.
  - getOutputLayout
```
public ExperimentOutputLayout getOutputLayout()
```
  - load
```
public static TrainTestExperiment load(Path file)
                                throws IOException
```
    Load a train-test experiment from a YAML file.
    
    Parameters:
    
    file - The file to load.
    
    Returns:
    
    The train-test experiment.
    
    Throws:
    
    IOException

Class TrainTestExperiment

Constructor Summary

Method Summary

Methods inherited from class java.lang.Object

Constructor Detail

TrainTestExperiment

Method Detail

setOutputFile

getOutputFile

getUserOutputFile

setUserOutputFile

getAlgorithms

addAlgorithm

addAlgorithms

addAlgorithm

addAlgorithm

addAlgorithms

getDataSets

addDataSet

addDataSets

getShareModelComponents

setShareModelComponents

getCacheDirectory

setCacheDirectory

getThreadCount

setThreadCount

getClassLoader

setClassLoader

getTasks

addTask

execute

getOutputLayout

load