|
| static void | Run (string[] args) |
| | Method for the HCOMP15-ActiveCrowdToolkit experiment More...
|
| |
| static void | RunActiveLearning (string dataSet, RunType runType, TaskSelectionMethod taskSelectionMethod, WorkerSelectionMethod workerSelectionMethod, int InitialNumLabelsPerTask, BCC model, int communityCount=4) |
| | Runs the active learning experiment on a single data set. More...
|
| |
| static void | RunActiveLearningExperiment (int startIndex, int endIndex, TaskSelectionMethod TaskSelectionMethod, WorkerSelectionMethod WorkerSelectionMethod, int InitialNumLabelsPerTask) |
| | Runs the active learning experiment presented in Venanzi et.al (WWW14) "Community-Based Data Aggregation Models for Crowdsourcing" for all the models with an array of data sets. More...
|
| |
|
static Results | RunBatchLearning (string dataSetPath, RunType runType, BCC model=null, int numCommunities=3) |
| |
| static void | AggregateResults (string LoadResultsDir) |
| |
|
|
static int | EndClusterRun = 100 |
| |
|
static int | StartClusterRun = 1 |
| |
|
static string[] | DatasetsPath |
| |
| static string | ResultsPath = @"ResultsActiveCrowdToolkit/" |
| | The path to the results directory. More...
|
| |
| static string | ResultsDir = "" |
| | The path to the results directory including the cluster run (e.g., Results/Run1). More...
|
| |
| static void CrowdsourcingModels.ActiveCrowdToolkitExperiment.AggregateResults |
( |
string |
LoadResultsDir | ) |
|
|
inlinestatic |
The results matrix is a dictionary with 1-level key = filename, 2-level key is the accuracy name, 3-level key is the labelling round and the value is the array of accuracies at that round
Compute averages
Print report
| static void CrowdsourcingModels.ActiveCrowdToolkitExperiment.Run |
( |
string[] |
args | ) |
|
|
inlinestatic |
Method for the HCOMP15-ActiveCrowdToolkit experiment
| static void CrowdsourcingModels.ActiveCrowdToolkitExperiment.RunActiveLearning |
( |
string |
dataSet, |
|
|
RunType |
runType, |
|
|
TaskSelectionMethod |
taskSelectionMethod, |
|
|
WorkerSelectionMethod |
workerSelectionMethod, |
|
|
int |
InitialNumLabelsPerTask, |
|
|
BCC |
model, |
|
|
int |
communityCount = 4 |
|
) |
| |
|
inlinestatic |
Runs the active learning experiment on a single data set.
- Parameters
-
| dataSet | The data. |
| runType | The model run type. |
| taskSelectionMethod | The method for selecting tasks (Random / Entropy). |
| model | The model instance. |
| communityCount | The number of communities (only for CBCC). |
| static void CrowdsourcingModels.ActiveCrowdToolkitExperiment.RunActiveLearningExperiment |
( |
int |
startIndex, |
|
|
int |
endIndex, |
|
|
TaskSelectionMethod |
TaskSelectionMethod, |
|
|
WorkerSelectionMethod |
WorkerSelectionMethod, |
|
|
int |
InitialNumLabelsPerTask |
|
) |
| |
|
inlinestatic |
Runs the active learning experiment presented in Venanzi et.al (WWW14) "Community-Based Data Aggregation Models for Crowdsourcing" for all the models with an array of data sets.
- Parameters
-
| startIndex | First instance of the data set array. |
| endIndex | Last instance of the data set array. |
| whichModel | Model to run. |
| string CrowdsourcingModels.ActiveCrowdToolkitExperiment.ResultsDir = "" |
|
static |
The path to the results directory including the cluster run (e.g., Results/Run1).
| string CrowdsourcingModels.ActiveCrowdToolkitExperiment.ResultsPath = @"ResultsActiveCrowdToolkit/" |
|
static |
The path to the results directory.
The documentation for this class was generated from the following file:
- C:/Users/Matteo/Source/Repos/active-crowd/CrowdsourcingModels/Tests/ActiveCrowdToolkitExperiment.cs
1.8.10 
