CLG authorship analytics - user guide (part 2)

Links

This document is part of the “CLG Authorship Experiments” repository:

• Github repository
• User guide:
  • User guide part 1
  • User guide part 2
• Experiments:
  • Experiment 1: size of documents
  • Experiment 2: size of a group of documents by the same author
  • Experiment 3: number of training cases
  • Experiment 4: author diversity in the training set

Overview

This is the second part of the user guide for “CLG authorship analytics”. The first part is here.

Note: this guide is organized by order of complexity, from the most simple to the most complex kind of process. It is meant to help the reader understand what each of the different levels of the process actually does. Thus the simplest way to run the full process is described at the end of this document.

Rmd

This document was generated from an R Markdown source file. The source file is provided in the repository, it can be used to reproduce these experiments. It can be executed through the RStudio interface (“knit” button) or as follows:

rmarkdown::render('user-guide-part2.Rmd')

• Naturally the document can also be read as a regular documentation.
• Important: this Rmd document includes bash chunks. In order for these to work, the environment must have been configured as explained in Requirements below.

Options

The .Rmd source document can be configured by modifying the following lines:

packages.path <- 'packages'
Sys.setenv(CLG_AUTHORSHIP_PACKAGES_PATH = packages.path)
output.dir <- '/tmp/user-guide-part2.output'
Sys.setenv(OUTPUT_DIR = output.dir)
delete.previous.output <- TRUE
snippets.size <- 25
Sys.setenv(SNIPPETS_SIZE = snippets.size)
Sys.setenv(NCORES = 40)
Sys.setenv(TASKS_DIR= '/tmp/clg-authorship.tasks')
Sys.setenv(EXPE_WORK_DIR = 'experiments/1-doc-size')

• Note: ncores should be set to represent the number of cores available on the machine.
• The role of TASKS_DIR is described below in the “Parallel/distributed processing” section.

In order to manually execute some of the commands below, it is recommended to assign the appropriate value to the above environment variables for the whole session, for example:

export CLG_AUTHORSHIP_PACKAGES_PATH=packages
export OUTPUT_DIR=/tmp/user-guide-part1.output

Initialization

rm -rf "$OUTPUT_DIR" "$TASKS_DIR"

mkdir "$OUTPUT_DIR"
mkdir "$TASKS_DIR"

source session-setup.sh
find data/gb/* data/ia/* -maxdepth 0 -type f | grep -v '\.' | ./create-snippets-dataset.sh $SNIPPETS_SIZE $OUTPUT_DIR/data

Requirements

The software and data requirements are the same as described in user guide part 1, except that this part requires a lot more computational power. It is strongly recommended to run these experiments on a machine with many cores and a large amount of RAM available.

Parallel/distributed processing

The following examples require parallel procesing. The scripts do not handle this themselves, instead a system of external parallel processing is used:

• A predetermined directory, for instance ~/tasks, is used as an inbox for the tasks to process.
• A script run with argument -P ~/tasks writes multiple individual tasks as simple one-line scripts into this directory, instead of running them sequentially.
• An external script task-distrib-daemon.sh runs in the background, picks up the tasks written in ~/tasks and runs them in parallel.
  • task-distrib-daemon.sh accepts various options which makes it possible to use for distributed processing on multiple machine (typically on a computing cluster).
  • Tasks are run whenever a slot is available, based on the provided number of cores.
• The calling script waits for the tasks to be achieved by checking regularly if some output file has been written.
• This system allows flexibility at various levels. In particular multiple scripts can use to the same ~/tasks directory, as long as they write uniquely named files. Since the daemon runs globally, there is no need to control the number of cores allocated to each script.
  • This is used to start the genetic process (see below) for several strategies running at the same time, each of them leaving their tasks in the same directory.

Genetic learning

Naturally there is a high number of possible configurations. The system is intended to learn which configuration(s) work best with a training dataset, using a genetic algorithm to explore the space of possible configurations efficiently.

Multi-configurations files

The concept of multi-config file is introduced for the genetic process. Such a config file is meant to enumerate all the possible values for a parameter:

paramName=value1 value2 ... valueN

The multi-conf contains the parameters for which the Genetic process has to select the optimal values. The parameters are grouped into three categories (see the documentation for mor details):

• Common parameters
• Strategy-specific parameters
• Genetic process parameter

Examples of multi-config “parts” files are provided in conf/ These different parts can be combined:

source session-setup.sh
mkdir "$OUTPUT_DIR/gen1"
generate-multi-conf.sh -c common.simplified.multi-conf.part -g genetic.simplified.multi-conf.part 0 "$OUTPUT_DIR/gen1/0"

## generate-multi-conf.sh: Strategy 'basic' (no POS)
## generate-multi-conf.sh: Strategy 'GI' (no POS)
## generate-multi-conf.sh: Strategy 'univ' (no POS)

• By default the configs parts are found in the directory ./conf . The -d option can be used to specify the directory where the configuration “parts” are found.
• -c and -g are used to force the use of a specific config file for the ‘common’ and ‘genetic’ part instead of the default, in this case a simplified variant meant to take less time (see also below about the genetic process configuration).
• The first mandatory argument is 0 for ignoring observation types involving POS tags, 1 otherwise.
• This generates a full multi-config file on $OUTPUT_DIR/gen1/0/multi-conf-files for every strategy.
• The subdir 0 is needed to avoid that genetic-train.sh deletes the dir (confusing design)

Generating individual config files from a multi-config

The script expand-multi-config.pl is used to generate a subset of individual config files based on a multi-config.

• By default it generates the exhaustive set of all the combinations of parameters values. Of course, using this option wouldn’t be wise with a very large number of parameters/values (see below the number with the basic multi-conf file)
• With option -r <N> (used in the example below) it generates a random subset of N configs.
• With option -g (genetic algorithm) it generates a new generation of configs based on the results of a previous generation. This is called internally in the script train-genetic.sh presented later.

source session-setup.sh
targetdir="$OUTPUT_DIR/example-50-configs"
mkdir "$targetdir"
echo "$OUTPUT_DIR/gen1/0/multi-conf-files/basic.multi-conf"  | expand-multi-config.pl -r 50 "$targetdir/"

## expand-multi-config.pl info: 3840 possible configs

Preparing the input data

In part 1 we were manually “preparing” the input data in the format required by the system. The script prepare-input-data.sh can be used to create the working directory with all the required parts in a way which makes it usable directly by the training scripts:

• Copies the input data (to avoid modifying the input directory)
• Stores the multi-config files
• Calculates the “stop words” based on the training set documents (unless -r is supplied) and stores them where needed
  • The “stop words limits” are obtained directly from the required obs types, assuming that the “stop word id” is a simple integer.
• Prepares all obs types for the input data, including POS if required
• The impostors data must be provided:
  • either as a “prepared resource” with -r
  • or as simple files in a directory with -i
    • in this case the impostors data is prepared, i.e. the required obs types are calculated
• In any case the impostors pre-similarity values are computed against every document in the input data
• The resources options file is generated

Input data

Below we prepare some data using a training and test set generated for the main experiments proposed in this repository (see Experiment 1: size of documents).

mkdir "$OUTPUT_DIR"/input-data.gen1 
cat "$EXPE_WORK_DIR/train.tsv" > "$OUTPUT_DIR/input-data.gen1/truth.txt"
cat "$EXPE_WORK_DIR/train.tsv" | cut -f 1 | tr ' :' '\n\n'  | sort -u | while read f; do 
      cp "$OUTPUT_DIR/data/$f" "$OUTPUT_DIR/input-data.gen1/"
done
head -n 50 "$EXPE_WORK_DIR/train.tsv" > "$OUTPUT_DIR/gen1.train-cases.txt"
tail -n 50 "$EXPE_WORK_DIR/train.tsv" > "$OUTPUT_DIR/gen1.test-cases.txt"

• Note: the script expects a file truth.txt in a subdirectory input containing the cases to be used for training.
• In this example the training set is split into two parts in order to use the second part as validation set (see below).
  • The file truth.txt must contain all the cases.

Impostors data

For this toy example we also create a small set of impostors in the same way as presented in the GI method):

source session-setup.sh
mkdir $OUTPUT_DIR/impostors.gen1
mkdir $OUTPUT_DIR/impostors.gen1/GI.1.impostors
n=$(find $OUTPUT_DIR/data/* -maxdepth 0 -type f | wc -l)
find $OUTPUT_DIR/data/* -maxdepth 0 -type f | random-lines.pl 100 1 $n | while read f; do cp $f $OUTPUT_DIR/impostors.gen1/GI.1.impostors/$(basename "$f").txt; done

• Note: the name my.impostors is the one used in the default GI config file conf/GI.multi-conf.part.

Running the preparation script

• Language: By default a file contents.json is expected in the input data dir (PAN input format), and the language is extracted from it. Option -l is used as an alternative to the json file.
• -i specifies where to find the impostors dataset(s)
• In this case we only provide the “basic” multi-conf file to the script on STDIN. We will show later a more general way.

source session-setup.sh
echo "$OUTPUT_DIR/gen1/0/multi-conf-files/basic.multi-conf"  | prepare-input-data.sh -l english -i $OUTPUT_DIR/impostors.gen1/ "$OUTPUT_DIR/input-data.gen1" "$OUTPUT_DIR/gen1"

## prepare-input-data.sh: language is 'english'
## prepare-input-data.sh init: copying input data
## prepare-input-data.sh: stop words: generating count files, tokens only
## count-obs-dataset.sh: no TreeTagger tokenization/POS tagging needed
## count-obs-dataset.sh: generating count files
## prepare-input-data.sh: input data, generating count files for all obs types
## count-obs-dataset.sh: no TreeTagger tokenization/POS tagging needed
## count-obs-dataset.sh: generating count files
## prepare-input-data.sh: input data, preparing impostors data
## prepare-input-data.sh: writing resources options file
## prepare-input-data.sh: done.

Genetic algorithm

Configuration

The genetic process is controlled by the “genetic” part of the multi-configuration:

cat conf/genetic.simplified.multi-conf.part

## # ***************************************************************
## # GENETIC LEARNING PARAMETERS
## # ***************************************************************
## 
## indivGenetic_1_population=40
## indivGenetic_1_stopCriterionNbWindows=3
## indivGenetic_1_stopCriterionNbGenerationsByWindow=2
## indivGenetic_1_geneticParams=0.2:0.02:0.1:0.05
## indivGenetic_1_perfCriterion=AUC
## indivGenetic_1_nbFoldsOrProp=2
## indivGenetic_1_returnNbBest=100
## 
## indivGenetic_final_nbFolds=2
## indivGenetic_final_nbRuns=5
## #indivGenetic_final_selectMethod=mean mixedMeanMedianMinusSD
## indivGenetic_final_selectMethod=mean
## indivGenetic_final_returnNbBest=50

• The population parameter is the number of individual configs in every generation.
• The “stop criterion” defines when to stop the genetic process: the average performance of the configs in a generation is averaged over a window of the N last generations (stopCriterionNbGenerationsByWindow). The process stops if this value does not increase during M generations (stopCriterionNbWindows).
  • Note: this means that the process must run at least N generations.
• The geneticParams are 4 values separated by colons:
  • prop breeders is the proportion of indivuals to select from the prev gen (cannot be higher than 0.5)
  • prob mutation is the probablity of a mutation on one gene. This is actually the probability of a new random value, which can end up being one the parents values.
  • prop elite is the proportion of the new generation taken as is from the top previous generation
  • prop random is the proportion of the new generation selected totally randomly.
• perfCriterion: evalation measure to use: auc, C1 (C@1, variant of accuracy with ‘unsure’ answer) or final (product of the previous two, as used in PAN15).
• nbFoldsOrProp: \(k\) value for \(k\)-fold cross-validation
• returnNbBest: number \(n\) of top \(n\) best performing configs to return as output of the full process.

The full genetic process may involve a sequence of several steps, each identified with a prefix (e.g. indivGenetic_) and followed by an integer or final for the last step. This allows progressively refining the evaluation of the configs, for instance by using a higher \(k\) or larger ‘stop criterion window’ in the later stages of the process. This multi-steps sequence is managed by train-multi-stages.sh (see also below).

Running the genetic process

source session-setup.sh
task-distrib-daemon.sh  -s 30s -p 1 -v -q 4 "$TASKS_DIR" $NCORES >"$OUTPUT_DIR/gen1.task-daemon.log" &
echo "$OUTPUT_DIR/gen1/0/multi-conf-files/basic.multi-conf" | train-genetic.sh -P "$TASKS_DIR/mytasks" -o  '-c -s' "$OUTPUT_DIR/gen1" "$OUTPUT_DIR/gen1.train-cases.txt" indivGenetic_1_

## train-genetic.sh: reading multi-config files from STDIN
## train-genetic.sh: preparing genetic process
## train-genetic.sh, gen 0001: generating 40 random config files
## expand-multi-config.pl info: 3840 possible configs
## train-genetic.sh, gen 0001: evaluating configs; perfCriterion=AUC; nbFolds=2; input data=/tmp/user-guide-part2.output/gen1/input; multi-config list is:
## /tmp/user-guide-part2.output/gen1/multi-conf-files/basic.multi-conf
## train-generation.sh: generating folds
## train-generation.sh: evaluating 40 configs using 2 folds cross-validation (50 cases); resume mode=0
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.0001') 2022-02-25 18:23: 0/40 done
## 
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.0001') 2022-02-25 18:24: 0/40 done
## 
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.0001') 2022-02-25 18:24: 1/40 done
## 
## train-generation.sh: done.
## INFO train-genetic.sh: average perf for the last 3 2-long windows (empty if not enough generations yet): 
## 
## train-genetic.sh, gen 0002: generating 40 config files by genetic crossover
## expand-multi-config.pl info: 3840 possible configs
## train-genetic.sh, gen 0002: evaluating configs; perfCriterion=AUC; nbFolds=2; input data=/tmp/user-guide-part2.output/gen1/input; multi-config list is:
## /tmp/user-guide-part2.output/gen1/multi-conf-files/basic.multi-conf
## train-generation.sh: generating folds
## train-generation.sh: evaluating 40 configs using 2 folds cross-validation (50 cases); resume mode=0
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.0002') 2022-02-25 18:24: 0/40 done
## 
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.0002') 2022-02-25 18:25: 0/40 done
## 
## train-generation.sh: done.
## INFO train-genetic.sh: average perf for the last 3 2-long windows (empty if not enough generations yet): 
## 
## train-genetic.sh, gen 0003: generating 40 config files by genetic crossover
## expand-multi-config.pl info: 3840 possible configs
## train-genetic.sh, gen 0003: evaluating configs; perfCriterion=AUC; nbFolds=2; input data=/tmp/user-guide-part2.output/gen1/input; multi-config list is:
## /tmp/user-guide-part2.output/gen1/multi-conf-files/basic.multi-conf
## train-generation.sh: generating folds
## train-generation.sh: evaluating 40 configs using 2 folds cross-validation (50 cases); resume mode=0
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.0003') 2022-02-25 18:25: 0/40 done
## 
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.0003') 2022-02-25 18:25: 0/40 done
## 
## train-generation.sh: done.
## INFO train-genetic.sh: average perf for the last 3 2-long windows (empty if not enough generations yet): 
## 
## train-genetic.sh, gen 0004: generating 40 config files by genetic crossover
## expand-multi-config.pl info: 3840 possible configs
## train-genetic.sh, gen 0004: evaluating configs; perfCriterion=AUC; nbFolds=2; input data=/tmp/user-guide-part2.output/gen1/input; multi-config list is:
## /tmp/user-guide-part2.output/gen1/multi-conf-files/basic.multi-conf
## train-generation.sh: generating folds
## train-generation.sh: evaluating 40 configs using 2 folds cross-validation (50 cases); resume mode=0
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.0004') 2022-02-25 18:26: 0/40 done
## 
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.0004') 2022-02-25 18:26: 0/40 done
## 
## train-generation.sh: done.
## INFO train-genetic.sh: average perf for the last 3 2-long windows (empty if not enough generations yet): 
## 
## train-genetic.sh, gen 0005: generating 40 config files by genetic crossover
## expand-multi-config.pl info: 3840 possible configs
## train-genetic.sh, gen 0005: evaluating configs; perfCriterion=AUC; nbFolds=2; input data=/tmp/user-guide-part2.output/gen1/input; multi-config list is:
## /tmp/user-guide-part2.output/gen1/multi-conf-files/basic.multi-conf
## train-generation.sh: generating folds
## train-generation.sh: evaluating 40 configs using 2 folds cross-validation (50 cases); resume mode=0
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.0005') 2022-02-25 18:27: 0/40 done
## 
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.0005') 2022-02-25 18:27: 0/40 done
## 
## train-generation.sh: done.
## INFO train-genetic.sh: average perf for the last 3 2-long windows (empty if not enough generations yet): 
## 
## train-genetic.sh, gen 0006: generating 40 config files by genetic crossover
## expand-multi-config.pl info: 3840 possible configs
## train-genetic.sh, gen 0006: evaluating configs; perfCriterion=AUC; nbFolds=2; input data=/tmp/user-guide-part2.output/gen1/input; multi-config list is:
## /tmp/user-guide-part2.output/gen1/multi-conf-files/basic.multi-conf
## train-generation.sh: generating folds
## train-generation.sh: evaluating 40 configs using 2 folds cross-validation (50 cases); resume mode=0
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.0006') 2022-02-25 18:27: 0/40 done
## 
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.0006') 2022-02-25 18:28: 0/40 done
## 
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.0006') 2022-02-25 18:28: 39/40 done
## 
## train-generation.sh: done.
## INFO train-genetic.sh: average perf for the last 3 2-long windows (empty if not enough generations yet): 
## first    window  mean
## /tmp/user-guide-part2.output/gen1/generations/0005/train/configs.results 3   0.5350461125
## /tmp/user-guide-part2.output/gen1/generations/0003/train/configs.results 2   0.4903446375
## /tmp/user-guide-part2.output/gen1/generations/0001/train/configs.results 1   0.4086839125
## train-genetic.sh, gen 0007: generating 40 config files by genetic crossover
## expand-multi-config.pl info: 3840 possible configs
## train-genetic.sh, gen 0007: evaluating configs; perfCriterion=AUC; nbFolds=2; input data=/tmp/user-guide-part2.output/gen1/input; multi-config list is:
## /tmp/user-guide-part2.output/gen1/multi-conf-files/basic.multi-conf
## train-generation.sh: generating folds
## train-generation.sh: evaluating 40 configs using 2 folds cross-validation (50 cases); resume mode=0
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.0007') 2022-02-25 18:28: 0/40 done
## 
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.0007') 2022-02-25 18:29: 0/40 done
## 
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.0007') 2022-02-25 18:29: 0/40 done
## 
## train-generation.sh: done.
## INFO train-genetic.sh: average perf for the last 3 2-long windows (empty if not enough generations yet): 
## first    window  mean
## /tmp/user-guide-part2.output/gen1/generations/0006/train/configs.results 3   0.535897425
## /tmp/user-guide-part2.output/gen1/generations/0004/train/configs.results 2   0.483253325
## /tmp/user-guide-part2.output/gen1/generations/0002/train/configs.results 1   0.444871875
## train-genetic.sh, gen 0008: generating 40 config files by genetic crossover
## expand-multi-config.pl info: 3840 possible configs
## train-genetic.sh, gen 0008: evaluating configs; perfCriterion=AUC; nbFolds=2; input data=/tmp/user-guide-part2.output/gen1/input; multi-config list is:
## /tmp/user-guide-part2.output/gen1/multi-conf-files/basic.multi-conf
## train-generation.sh: generating folds
## train-generation.sh: evaluating 40 configs using 2 folds cross-validation (50 cases); resume mode=0
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.0008') 2022-02-25 18:29: 0/40 done
## 
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.0008') 2022-02-25 18:30: 0/40 done
## 
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.0008') 2022-02-25 18:30: 0/40 done
## 
## train-generation.sh: done.
## INFO train-genetic.sh: average perf for the last 3 2-long windows (empty if not enough generations yet): 
## first    window  mean
## /tmp/user-guide-part2.output/gen1/generations/0007/train/configs.results 3   0.44996015
## /tmp/user-guide-part2.output/gen1/generations/0005/train/configs.results 2   0.5350461125
## /tmp/user-guide-part2.output/gen1/generations/0003/train/configs.results 1   0.4903446375
## train-genetic.sh, gen 0009: generating 40 config files by genetic crossover
## expand-multi-config.pl info: 3840 possible configs
## train-genetic.sh, gen 0009: evaluating configs; perfCriterion=AUC; nbFolds=2; input data=/tmp/user-guide-part2.output/gen1/input; multi-config list is:
## /tmp/user-guide-part2.output/gen1/multi-conf-files/basic.multi-conf
## train-generation.sh: generating folds
## train-generation.sh: evaluating 40 configs using 2 folds cross-validation (50 cases); resume mode=0
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.0009') 2022-02-25 18:30: 0/40 done
## 
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.0009') 2022-02-25 18:31: 0/40 done
## 
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.0009') 2022-02-25 18:31: 0/40 done
## 
## train-generation.sh: done.
## INFO train-genetic.sh: average perf for the last 3 2-long windows (empty if not enough generations yet): 
## first    window  mean
## /tmp/user-guide-part2.output/gen1/generations/0008/train/configs.results 3   0.468890475
## /tmp/user-guide-part2.output/gen1/generations/0006/train/configs.results 2   0.535897425
## /tmp/user-guide-part2.output/gen1/generations/0004/train/configs.results 1   0.483253325
## train-genetic.sh, gen 0010: generating 40 config files by genetic crossover
## expand-multi-config.pl info: 3840 possible configs
## train-genetic.sh, gen 0010: evaluating configs; perfCriterion=AUC; nbFolds=2; input data=/tmp/user-guide-part2.output/gen1/input; multi-config list is:
## /tmp/user-guide-part2.output/gen1/multi-conf-files/basic.multi-conf
## train-generation.sh: generating folds
## train-generation.sh: evaluating 40 configs using 2 folds cross-validation (50 cases); resume mode=0
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.0010') 2022-02-25 18:31: 0/40 done
## 
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.0010') 2022-02-25 18:32: 0/40 done
## 
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.0010') 2022-02-25 18:32: 0/40 done
## 
## train-generation.sh: done.
## INFO train-genetic.sh: average perf for the last 3 2-long windows (empty if not enough generations yet): 
## first    window  mean
## /tmp/user-guide-part2.output/gen1/generations/0009/train/configs.results 3   0.54665475
## /tmp/user-guide-part2.output/gen1/generations/0007/train/configs.results 2   0.44996015
## /tmp/user-guide-part2.output/gen1/generations/0005/train/configs.results 1   0.5350461125
## train-genetic.sh, gen 0011: generating 40 config files by genetic crossover
## expand-multi-config.pl info: 3840 possible configs
## train-genetic.sh, gen 0011: evaluating configs; perfCriterion=AUC; nbFolds=2; input data=/tmp/user-guide-part2.output/gen1/input; multi-config list is:
## /tmp/user-guide-part2.output/gen1/multi-conf-files/basic.multi-conf
## train-generation.sh: generating folds
## train-generation.sh: evaluating 40 configs using 2 folds cross-validation (50 cases); resume mode=0
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.0011') 2022-02-25 18:32: 0/40 done
## 
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.0011') 2022-02-25 18:33: 0/40 done
## 
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.0011') 2022-02-25 18:33: 0/40 done
## 
## train-generation.sh: done.
## INFO train-genetic.sh: average perf for the last 3 2-long windows (empty if not enough generations yet): 
## first    window  mean
## /tmp/user-guide-part2.output/gen1/generations/0010/train/configs.results 3   0.5664763625
## /tmp/user-guide-part2.output/gen1/generations/0008/train/configs.results 2   0.468890475
## /tmp/user-guide-part2.output/gen1/generations/0006/train/configs.results 1   0.535897425
## train-genetic.sh, gen 0012: generating 40 config files by genetic crossover
## expand-multi-config.pl info: 3840 possible configs
## train-genetic.sh, gen 0012: evaluating configs; perfCriterion=AUC; nbFolds=2; input data=/tmp/user-guide-part2.output/gen1/input; multi-config list is:
## /tmp/user-guide-part2.output/gen1/multi-conf-files/basic.multi-conf
## train-generation.sh: generating folds
## train-generation.sh: evaluating 40 configs using 2 folds cross-validation (50 cases); resume mode=0
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.0012') 2022-02-25 18:33: 0/40 done
## 
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.0012') 2022-02-25 18:34: 0/40 done
## 
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.0012') 2022-02-25 18:34: 0/40 done
## 
## train-generation.sh: done.
## INFO train-genetic.sh: average perf for the last 3 2-long windows (empty if not enough generations yet): 
## first    window  mean
## /tmp/user-guide-part2.output/gen1/generations/0011/train/configs.results 3   0.5740384875
## /tmp/user-guide-part2.output/gen1/generations/0009/train/configs.results 2   0.54665475
## /tmp/user-guide-part2.output/gen1/generations/0007/train/configs.results 1   0.44996015
## train-genetic.sh, gen 0013: generating 40 config files by genetic crossover
## expand-multi-config.pl info: 3840 possible configs
## train-genetic.sh, gen 0013: evaluating configs; perfCriterion=AUC; nbFolds=2; input data=/tmp/user-guide-part2.output/gen1/input; multi-config list is:
## /tmp/user-guide-part2.output/gen1/multi-conf-files/basic.multi-conf
## train-generation.sh: generating folds
## train-generation.sh: evaluating 40 configs using 2 folds cross-validation (50 cases); resume mode=0
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.0013') 2022-02-25 18:34: 0/40 done
## 
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.0013') 2022-02-25 18:35: 0/40 done
## 
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.0013') 2022-02-25 18:35: 0/40 done
## 
## train-generation.sh: done.
## INFO train-genetic.sh: average perf for the last 3 2-long windows (empty if not enough generations yet): 
## first    window  mean
## /tmp/user-guide-part2.output/gen1/generations/0012/train/configs.results 3   0.6066205625
## /tmp/user-guide-part2.output/gen1/generations/0010/train/configs.results 2   0.5664763625
## /tmp/user-guide-part2.output/gen1/generations/0008/train/configs.results 1   0.468890475
## train-genetic.sh, gen 0014: generating 40 config files by genetic crossover
## expand-multi-config.pl info: 3840 possible configs
## train-genetic.sh, gen 0014: evaluating configs; perfCriterion=AUC; nbFolds=2; input data=/tmp/user-guide-part2.output/gen1/input; multi-config list is:
## /tmp/user-guide-part2.output/gen1/multi-conf-files/basic.multi-conf
## train-generation.sh: generating folds
## train-generation.sh: evaluating 40 configs using 2 folds cross-validation (50 cases); resume mode=0
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.0014') 2022-02-25 18:35: 0/40 done
## 
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.0014') 2022-02-25 18:36: 0/40 done
## 
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.0014') 2022-02-25 18:36: 0/40 done
## 
## train-generation.sh: done.
## INFO train-genetic.sh: average perf for the last 3 2-long windows (empty if not enough generations yet): 
## first    window  mean
## /tmp/user-guide-part2.output/gen1/generations/0013/train/configs.results 3   0.592828525
## /tmp/user-guide-part2.output/gen1/generations/0011/train/configs.results 2   0.5740384875
## /tmp/user-guide-part2.output/gen1/generations/0009/train/configs.results 1   0.54665475
## train-genetic.sh, gen 0015: generating 40 config files by genetic crossover
## expand-multi-config.pl info: 3840 possible configs
## train-genetic.sh, gen 0015: evaluating configs; perfCriterion=AUC; nbFolds=2; input data=/tmp/user-guide-part2.output/gen1/input; multi-config list is:
## /tmp/user-guide-part2.output/gen1/multi-conf-files/basic.multi-conf
## train-generation.sh: generating folds
## train-generation.sh: evaluating 40 configs using 2 folds cross-validation (50 cases); resume mode=0
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.0015') 2022-02-25 18:36: 0/40 done
## 
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.0015') 2022-02-25 18:37: 0/40 done
## 
## train-generation.sh: done.
## INFO train-genetic.sh: average perf for the last 3 2-long windows (empty if not enough generations yet): 
## first    window  mean
## /tmp/user-guide-part2.output/gen1/generations/0014/train/configs.results 3   0.5911157875
## /tmp/user-guide-part2.output/gen1/generations/0012/train/configs.results 2   0.6066205625
## /tmp/user-guide-part2.output/gen1/generations/0010/train/configs.results 1   0.5664763625
## train-genetic.sh, gen 0016: generating 40 config files by genetic crossover
## expand-multi-config.pl info: 3840 possible configs
## train-genetic.sh, gen 0016: evaluating configs; perfCriterion=AUC; nbFolds=2; input data=/tmp/user-guide-part2.output/gen1/input; multi-config list is:
## /tmp/user-guide-part2.output/gen1/multi-conf-files/basic.multi-conf
## train-generation.sh: generating folds
## train-generation.sh: evaluating 40 configs using 2 folds cross-validation (50 cases); resume mode=0
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.0016') 2022-02-25 18:37: 0/40 done
## 
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.0016') 2022-02-25 18:37: 0/40 done
## 
## train-generation.sh: done.
## INFO train-genetic.sh: average perf for the last 3 2-long windows (empty if not enough generations yet): 
## first    window  mean
## /tmp/user-guide-part2.output/gen1/generations/0015/train/configs.results 3   0.5497096875
## /tmp/user-guide-part2.output/gen1/generations/0013/train/configs.results 2   0.592828525
## /tmp/user-guide-part2.output/gen1/generations/0011/train/configs.results 1   0.5740384875
## train-genetic.sh, gen 0017: generating 40 config files by genetic crossover
## expand-multi-config.pl info: 3840 possible configs
## train-genetic.sh, gen 0017: evaluating configs; perfCriterion=AUC; nbFolds=2; input data=/tmp/user-guide-part2.output/gen1/input; multi-config list is:
## /tmp/user-guide-part2.output/gen1/multi-conf-files/basic.multi-conf
## train-generation.sh: generating folds
## train-generation.sh: evaluating 40 configs using 2 folds cross-validation (50 cases); resume mode=0
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.0017') 2022-02-25 18:38: 0/40 done
## 
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.0017') 2022-02-25 18:38: 1/40 done
## 
## train-generation.sh: done.
## INFO train-genetic.sh: average perf for the last 3 2-long windows (empty if not enough generations yet): 
## first    window  mean
## /tmp/user-guide-part2.output/gen1/generations/0016/train/configs.results 3   0.5560598125
## /tmp/user-guide-part2.output/gen1/generations/0014/train/configs.results 2   0.5911157875
## /tmp/user-guide-part2.output/gen1/generations/0012/train/configs.results 1   0.6066205625
## train-genetic.sh: genetic loop done, extracting 100 best configs (removing duplicates)
## train-genetic.sh: returning 100 best configs (removed 422 duplicates)
## train-genetic.sh: renaming best configs
## train-genetic.sh: done.

• The above process takes around 10 to 20 mn with 40 cores.
• To see whether the daemon is starting tasks as expected, check its output in $OUTPUT_DIR/gen1.task-daemon.log.
  • Note: the deamon outputs a summary every 30 minutes by default. The duration, level of detail and various options can be configured in the parameters (see task-distrib-daemon.sh -h):
    • -s <duration> cycle duration, i.e. how often to check for new tasks.
    • -p <N> print summary every N cycles.
    • -v verbose mode, more details printed (-V for highest verbosity level).
    • -q <N> stop the daemon after N cycles idle (no task running, no new task). By default the daemon runs until interrupted.
• The option -o '-c -s' is used to call train-cv.sh with the following two options:
  • -c cleans up intermediate files created by the process
  • -s (for safe) prevents errors from causing the full process to abort. This is useful as the randomness of the process may sometimes lead to inconsistent input, causing errors. But it should be used with caution, since this implies that errors are ignored.
• Errors happening in the individual processes are written to files named $OUTPUT_DIR//gen1/generations/*/train/*.log.err, where the first * corresponds to the geneation id and the second * to the configuration id in this generation.

Multi-stages genetic process

As mentioned above, there can be several steps of genetic training with different parameters. A multi-stages sequence must always end with a special stage identified as final in the genetic configuration file. This step finalizes the process:

• It performs 5x2 repeated cross-validation with train-multi-runs.sh on the best configurations returned by the last stage of genetic training. The final set of configs is selected based on the results of this evaluation.
• It re-trains the selected configs on the full training data and also performs once cross-validation once again to obtain the final evaluation scores.

In the following code we use the -r option to resume the previous training and apply the final stage. Note that the id provided as last parameter contains only the prefix indivGenetic since it’s not about a specific stage anymore.

#source session-setup.sh
task-distrib-daemon.sh  -s 30s -p 1 -v -q 4 "$TASKS_DIR" $NCORES >"$OUTPUT_DIR/gen1.task-daemon.log" &
train-multi-stages.sh -r -P "$TASKS_DIR/mytasks" -o  '-c -s' "$OUTPUT_DIR/gen1" "$OUTPUT_DIR/gen1.train-cases.txt" "$OUTPUT_DIR/gen1/0/multi-conf-files/basic.multi-conf" indivGenetic

## train-multi-stages.sh: stagesIds = indivGenetic_1 ; config file=/tmp/user-guide-part2.output/gen1/0/multi-conf-files/basic.multi-conf
## train-multi-stages.sh: *** starting genetic stage indivGenetic_1 ***
## train-genetic.sh: reading multi-config files from STDIN
## train-genetic.sh: preparing genetic process
## train-genetic.sh: resuming genetic process at generation 0001 in '/tmp/user-guide-part2.output/gen1/indivGenetic_1/generations/0001'
## train-genetic.sh, gen 0001: generating 40 random config files
## expand-multi-config.pl info: 3840 possible configs
## train-genetic.sh, gen 0001: evaluating configs; perfCriterion=AUC; nbFolds=2; input data=/tmp/user-guide-part2.output/gen1/indivGenetic_1/input; multi-config list is:
## /tmp/user-guide-part2.output/gen1/indivGenetic_1/multi-conf-files/basic.multi-conf
## train-generation.sh: generating folds
## train-generation.sh: evaluating 40 configs using 2 folds cross-validation (50 cases); resume mode=1
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.indivGenetic_1.0001') 2022-02-25 18:40: 0/40 done
## 
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.indivGenetic_1.0001') 2022-02-25 18:41: 0/40 done
## 
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.indivGenetic_1.0001') 2022-02-25 18:41: 2/40 done
## 
## train-generation.sh: done.
## INFO train-genetic.sh: average perf for the last 3 2-long windows (empty if not enough generations yet): 
## 
## train-genetic.sh, gen 0002: generating 40 config files by genetic crossover
## expand-multi-config.pl info: 3840 possible configs
## train-genetic.sh, gen 0002: evaluating configs; perfCriterion=AUC; nbFolds=2; input data=/tmp/user-guide-part2.output/gen1/indivGenetic_1/input; multi-config list is:
## /tmp/user-guide-part2.output/gen1/indivGenetic_1/multi-conf-files/basic.multi-conf
## train-generation.sh: generating folds
## train-generation.sh: evaluating 40 configs using 2 folds cross-validation (50 cases); resume mode=1
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.indivGenetic_1.0002') 2022-02-25 18:41: 0/40 done
## 
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.indivGenetic_1.0002') 2022-02-25 18:42: 2/40 done
## 
## train-generation.sh: done.
## INFO train-genetic.sh: average perf for the last 3 2-long windows (empty if not enough generations yet): 
## 
## train-genetic.sh, gen 0003: generating 40 config files by genetic crossover
## expand-multi-config.pl info: 3840 possible configs
## train-genetic.sh, gen 0003: evaluating configs; perfCriterion=AUC; nbFolds=2; input data=/tmp/user-guide-part2.output/gen1/indivGenetic_1/input; multi-config list is:
## /tmp/user-guide-part2.output/gen1/indivGenetic_1/multi-conf-files/basic.multi-conf
## train-generation.sh: generating folds
## train-generation.sh: evaluating 40 configs using 2 folds cross-validation (50 cases); resume mode=1
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.indivGenetic_1.0003') 2022-02-25 18:42: 0/40 done
## 
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.indivGenetic_1.0003') 2022-02-25 18:42: 2/40 done
## 
## train-generation.sh: done.
## INFO train-genetic.sh: average perf for the last 3 2-long windows (empty if not enough generations yet): 
## 
## train-genetic.sh, gen 0004: generating 40 config files by genetic crossover
## expand-multi-config.pl info: 3840 possible configs
## train-genetic.sh, gen 0004: evaluating configs; perfCriterion=AUC; nbFolds=2; input data=/tmp/user-guide-part2.output/gen1/indivGenetic_1/input; multi-config list is:
## /tmp/user-guide-part2.output/gen1/indivGenetic_1/multi-conf-files/basic.multi-conf
## train-generation.sh: generating folds
## train-generation.sh: evaluating 40 configs using 2 folds cross-validation (50 cases); resume mode=1
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.indivGenetic_1.0004') 2022-02-25 18:43: 0/40 done
## 
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.indivGenetic_1.0004') 2022-02-25 18:43: 3/40 done
## 
## train-generation.sh: done.
## INFO train-genetic.sh: average perf for the last 3 2-long windows (empty if not enough generations yet): 
## 
## train-genetic.sh, gen 0005: generating 40 config files by genetic crossover
## expand-multi-config.pl info: 3840 possible configs
## train-genetic.sh, gen 0005: evaluating configs; perfCriterion=AUC; nbFolds=2; input data=/tmp/user-guide-part2.output/gen1/indivGenetic_1/input; multi-config list is:
## /tmp/user-guide-part2.output/gen1/indivGenetic_1/multi-conf-files/basic.multi-conf
## train-generation.sh: generating folds
## train-generation.sh: evaluating 40 configs using 2 folds cross-validation (50 cases); resume mode=1
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.indivGenetic_1.0005') 2022-02-25 18:43: 0/40 done
## 
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.indivGenetic_1.0005') 2022-02-25 18:44: 0/40 done
## 
## train-generation.sh: done.
## INFO train-genetic.sh: average perf for the last 3 2-long windows (empty if not enough generations yet): 
## 
## train-genetic.sh, gen 0006: generating 40 config files by genetic crossover
## expand-multi-config.pl info: 3840 possible configs
## train-genetic.sh, gen 0006: evaluating configs; perfCriterion=AUC; nbFolds=2; input data=/tmp/user-guide-part2.output/gen1/indivGenetic_1/input; multi-config list is:
## /tmp/user-guide-part2.output/gen1/indivGenetic_1/multi-conf-files/basic.multi-conf
## train-generation.sh: generating folds
## train-generation.sh: evaluating 40 configs using 2 folds cross-validation (50 cases); resume mode=1
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.indivGenetic_1.0006') 2022-02-25 18:44: 0/40 done
## 
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.indivGenetic_1.0006') 2022-02-25 18:44: 1/40 done
## 
## train-generation.sh: done.
## INFO train-genetic.sh: average perf for the last 3 2-long windows (empty if not enough generations yet): 
## first    window  mean
## /tmp/user-guide-part2.output/gen1/indivGenetic_1/generations/0005/train/configs.results  3   0.4961838375
## /tmp/user-guide-part2.output/gen1/indivGenetic_1/generations/0003/train/configs.results  2   0.4779948625
## /tmp/user-guide-part2.output/gen1/indivGenetic_1/generations/0001/train/configs.results  1   0.4720252125
## train-genetic.sh, gen 0007: generating 40 config files by genetic crossover
## expand-multi-config.pl info: 3840 possible configs
## train-genetic.sh, gen 0007: evaluating configs; perfCriterion=AUC; nbFolds=2; input data=/tmp/user-guide-part2.output/gen1/indivGenetic_1/input; multi-config list is:
## /tmp/user-guide-part2.output/gen1/indivGenetic_1/multi-conf-files/basic.multi-conf
## train-generation.sh: generating folds
## train-generation.sh: evaluating 40 configs using 2 folds cross-validation (50 cases); resume mode=1
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.indivGenetic_1.0007') 2022-02-25 18:45: 0/40 done
## 
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.indivGenetic_1.0007') 2022-02-25 18:45: 0/40 done
## 
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.indivGenetic_1.0007') 2022-02-25 18:45: 28/40 done
## 
## train-generation.sh: done.
## INFO train-genetic.sh: average perf for the last 3 2-long windows (empty if not enough generations yet): 
## first    window  mean
## /tmp/user-guide-part2.output/gen1/indivGenetic_1/generations/0006/train/configs.results  3   0.4341846125
## /tmp/user-guide-part2.output/gen1/indivGenetic_1/generations/0004/train/configs.results  2   0.5096554375
## /tmp/user-guide-part2.output/gen1/indivGenetic_1/generations/0002/train/configs.results  1   0.4889023
## train-genetic.sh, gen 0008: generating 40 config files by genetic crossover
## expand-multi-config.pl info: 3840 possible configs
## train-genetic.sh, gen 0008: evaluating configs; perfCriterion=AUC; nbFolds=2; input data=/tmp/user-guide-part2.output/gen1/indivGenetic_1/input; multi-config list is:
## /tmp/user-guide-part2.output/gen1/indivGenetic_1/multi-conf-files/basic.multi-conf
## train-generation.sh: generating folds
## train-generation.sh: evaluating 40 configs using 2 folds cross-validation (50 cases); resume mode=1
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.indivGenetic_1.0008') 2022-02-25 18:46: 0/40 done
## 
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.indivGenetic_1.0008') 2022-02-25 18:46: 1/40 done
## 
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.indivGenetic_1.0008') 2022-02-25 18:46: 1/40 done
## 
## train-generation.sh: done.
## INFO train-genetic.sh: average perf for the last 3 2-long windows (empty if not enough generations yet): 
## first    window  mean
## /tmp/user-guide-part2.output/gen1/indivGenetic_1/generations/0007/train/configs.results  3   0.4413862
## /tmp/user-guide-part2.output/gen1/indivGenetic_1/generations/0005/train/configs.results  2   0.4961838375
## /tmp/user-guide-part2.output/gen1/indivGenetic_1/generations/0003/train/configs.results  1   0.4779948625
## train-genetic.sh, gen 0009: generating 40 config files by genetic crossover
## expand-multi-config.pl info: 3840 possible configs
## train-genetic.sh, gen 0009: evaluating configs; perfCriterion=AUC; nbFolds=2; input data=/tmp/user-guide-part2.output/gen1/indivGenetic_1/input; multi-config list is:
## /tmp/user-guide-part2.output/gen1/indivGenetic_1/multi-conf-files/basic.multi-conf
## train-generation.sh: generating folds
## train-generation.sh: evaluating 40 configs using 2 folds cross-validation (50 cases); resume mode=1
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.indivGenetic_1.0009') 2022-02-25 18:47: 0/40 done
## 
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.indivGenetic_1.0009') 2022-02-25 18:47: 0/40 done
## 
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.indivGenetic_1.0009') 2022-02-25 18:48: 0/40 done
## 
## train-generation.sh: done.
## INFO train-genetic.sh: average perf for the last 3 2-long windows (empty if not enough generations yet): 
## first    window  mean
## /tmp/user-guide-part2.output/gen1/indivGenetic_1/generations/0008/train/configs.results  3   0.4966646625
## /tmp/user-guide-part2.output/gen1/indivGenetic_1/generations/0006/train/configs.results  2   0.4341846125
## /tmp/user-guide-part2.output/gen1/indivGenetic_1/generations/0004/train/configs.results  1   0.5096554375
## train-genetic.sh: genetic loop done, extracting 100 best configs (removing duplicates)
## train-genetic.sh: returning 100 best configs (removed 56 duplicates)
## train-genetic.sh: renaming best configs
## train-genetic.sh: done.
## train-multi-stages.sh: calling 'train-multi-runs.sh  -r -o "-c -s" -x 5 -f 2 -P "/tmp/clg-authorship.tasks/mytasks.runs" "/tmp/user-guide-part2.output/gen1" "/tmp/user-guide-part2.output/gen1.train-cases.txt" "/tmp/user-guide-part2.output/gen1/indivGenetic_1/best-configs.res"'
## train-multi-runs.sh: nbFolds=2; nbRuns=5; resume mode=1
## train-multi-runs.sh, run 0001: evaluating configs; nbFolds=2; 
## train-generation.sh: generating folds
## train-generation.sh: evaluating 100 configs using 2 folds cross-validation (50 cases); resume mode=1
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.runs.0001') 2022-02-25 18:48: 0/100 done
## 
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.runs.0001') 2022-02-25 18:48: 0/100 done
## 
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.runs.0001') 2022-02-25 18:48: 0/100 done
## 
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.runs.0001') 2022-02-25 18:49: 0/100 done
## 
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.runs.0001') 2022-02-25 18:49: 40/100 done
## 
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.runs.0001') 2022-02-25 18:49: 40/100 done
## 
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.runs.0001') 2022-02-25 18:49: 40/100 done
## 
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.runs.0001') 2022-02-25 18:49: 80/100 done
## 
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.runs.0001') 2022-02-25 18:49: 80/100 done
## 
## train-generation.sh: done.
## train-multi-runs.sh, run 0002: evaluating configs; nbFolds=2; 
## train-generation.sh: generating folds
## train-generation.sh: evaluating 100 configs using 2 folds cross-validation (50 cases); resume mode=1
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.runs.0002') 2022-02-25 18:50: 0/100 done
## 
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.runs.0002') 2022-02-25 18:50: 0/100 done
## 
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.runs.0002') 2022-02-25 18:50: 0/100 done
## 
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.runs.0002') 2022-02-25 18:50: 0/100 done
## 
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.runs.0002') 2022-02-25 18:50: 40/100 done
## 
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.runs.0002') 2022-02-25 18:50: 40/100 done
## 
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.runs.0002') 2022-02-25 18:51: 40/100 done
## 
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.runs.0002') 2022-02-25 18:51: 63/100 done
## 
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.runs.0002') 2022-02-25 18:51: 80/100 done
## 
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.runs.0002') 2022-02-25 18:51: 80/100 done
## 
## train-generation.sh: done.
## train-multi-runs.sh, run 0003: evaluating configs; nbFolds=2; 
## train-generation.sh: generating folds
## train-generation.sh: evaluating 100 configs using 2 folds cross-validation (50 cases); resume mode=1
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.runs.0003') 2022-02-25 18:51: 0/100 done
## 
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.runs.0003') 2022-02-25 18:51: 0/100 done
## 
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.runs.0003') 2022-02-25 18:52: 3/100 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.runs.0003.0009.P36iqmugW.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.runs.0003.0008.TB3xENx1d.running' does not exist
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.runs.0003') 2022-02-25 18:52: 17/100 done
## 
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.runs.0003') 2022-02-25 18:52: 40/100 done
## 
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.runs.0003') 2022-02-25 18:52: 40/100 done
## 
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.runs.0003') 2022-02-25 18:52: 40/100 done
## 
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.runs.0003') 2022-02-25 18:52: 40/100 done
## 
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.runs.0003') 2022-02-25 18:53: 80/100 done
## 
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.runs.0003') 2022-02-25 18:53: 80/100 done
## 
## train-generation.sh: done.
## train-multi-runs.sh, run 0004: evaluating configs; nbFolds=2; 
## train-generation.sh: generating folds
## train-generation.sh: evaluating 100 configs using 2 folds cross-validation (50 cases); resume mode=1
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.runs.0004') 2022-02-25 18:53: 0/100 done
## 
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.runs.0004') 2022-02-25 18:53: 0/100 done
## 
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.runs.0004') 2022-02-25 18:53: 0/100 done
## 
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.runs.0004') 2022-02-25 18:53: 0/100 done
## 
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.runs.0004') 2022-02-25 18:54: 40/100 done
## 
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.runs.0004') 2022-02-25 18:54: 40/100 done
## 
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.runs.0004') 2022-02-25 18:54: 40/100 done
## 
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.runs.0004') 2022-02-25 18:54: 80/100 done
## 
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.runs.0004') 2022-02-25 18:54: 80/100 done
## 
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.runs.0004') 2022-02-25 18:54: 80/100 done
## 
## train-generation.sh: done.
## train-multi-runs.sh, run 0005: evaluating configs; nbFolds=2; 
## train-generation.sh: generating folds
## train-generation.sh: evaluating 100 configs using 2 folds cross-validation (50 cases); resume mode=1
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.runs.0005') 2022-02-25 18:55: 0/100 done
## 
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.runs.0005') 2022-02-25 18:55: 0/100 done
## 
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.runs.0005') 2022-02-25 18:55: 0/100 done
## 
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.runs.0005') 2022-02-25 18:55: 0/100 done
## 
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.runs.0005') 2022-02-25 18:55: 18/100 done
## 
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.runs.0005') 2022-02-25 18:55: 40/100 done
## 
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.runs.0005') 2022-02-25 18:56: 40/100 done
## 
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.runs.0005') 2022-02-25 18:56: 40/100 done
## 
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.runs.0005') 2022-02-25 18:56: 80/100 done
## 
## train-generation.sh: processing configs. (parallelPrefix='/tmp/clg-authorship.tasks/mytasks.runs.0005') 2022-02-25 18:56: 80/100 done
## 
## train-generation.sh: done.
## train-multi-runs.sh: main loop done, extracting stats
## train-multi-stages.sh: re-training selected configs using all cases AND re-cross-validating to obtain unbiased predictions
## train-multi-stages.sh: generating folds for CV (unbiased predictions)
## train-multi-stages.sh: retraining selected configs. 2022-02-25 18:56: 50/100 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.final-train.cv.0004.qkvoEPu81.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.final-train.cv.0003.BoMzoNHFD.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.final-train.cv.0002.zLUyI36Q1.running' does not exist
## train-multi-stages.sh: retraining selected configs. 2022-02-25 18:57: 70/100 done
## 
## train-multi-stages.sh: done.

Meta-classifier (stacked generalization)

We have seen above that the genetic process can return a set of N best performing configurations. Additionally different strategies can be trained, every strategy returning its N best configurations. These individual configs can be considered as individual learners and combined in a meta-classifier which leverages their diversity to predict the final results (hopefully more accurately that any individual learner).

The training of the meta-model is done with the same genetic algorithm as used above, where the parameters to optimize are now the subset of individual configs/models and possibly some additional parameters for the meta-model. Since the set of possible individual models is fixed, the predictions that they return are precomputed in order to avoid repeatedly computing them during the genetic training. Note that this makes this genetic learning stage much faster than the previous one, but it may in some cases cause a bias due to the randomness of some of the methods (since the individual learners are treated as deterministic at this stage).

train-outerCV-1fold.sh

The meta-training is performed by train-outerCV-1fold.sh, which takes as input a training set and a test set. The script uses them in a quite complex way explained below:

• The training set (called “strategy training set” later) is first used to perform the genetic training presented above by calling train-multi-stages.sh for every strategy.
• The N best configs for every strategy are obtained from the stage above. These configs are applied to both the training and test set instances (with apply-multi-configs.sh).
• The test set is then randomly split into two subsets:
  • meta-training set
  • meta validation set (or meta-test set)
• The meta-training set is used to perform the genetic training of the meta-model, calling train-multi-stages.sh again (only once).
• The N best configurations obtained from the meta-training are applied to all the instances: strategy training set, meta-training set and validation set. These top configurations are also “packaged” in a sub directory refactored-strategy-configs in order to be easily usable for application later.
• Bagging (bootstrap aggregating) is applied on the meta validation set (fresh instances) in order to select the final top N meta-configs. This step can be used to analyze the variance of the meta-configs.

For the sake of simplicity and computation speed, in the example below we remove the GI and univ strategies before running the process, resulting in the meta-classifier using only the basic strategy. This is of course not necessary nor recommended in real applications.

cp conf/meta-template.simplified.multi-conf "$OUTPUT_DIR/gen1/meta-template.multi-conf"
# below removing univ and GI strategies to make the process faster
rm -f "$OUTPUT_DIR/gen1/0/multi-conf-files/GI.multi-conf" "$OUTPUT_DIR/gen1/0/multi-conf-files/univ.multi-conf"

source session-setup.sh
task-distrib-daemon.sh  -s 30s -p 1 -v -q 4 "$TASKS_DIR" $NCORES >"$OUTPUT_DIR/gen1.task-daemon.log" &
train-outerCV-1fold.sh -r -P "$TASKS_DIR/mytasks" -o  '-c -s' "$OUTPUT_DIR/gen1" "$OUTPUT_DIR/gen1.train-cases.txt" "$OUTPUT_DIR/gen1.test-cases.txt" "$OUTPUT_DIR/gen1/0/multi-conf-files"

## train-outerCV-1fold.sh: launching training process for strategy 'basic' in '/tmp/user-guide-part2.output/gen1/strategy-training/basic'; multiConfStrategyFile=/tmp/user-guide-part2.output/gen1/0/multi-conf-files/basic.multi-conf
## train-outerCV-1fold.sh: genetic process in progress. 2022-02-25 19:01: 0/1 done
## 
## train-outerCV-1fold.sh: genetic process in progress. 2022-02-25 19:02: 0/1 done
## 
## train-outerCV-1fold.sh: genetic process in progress. 2022-02-25 19:03: 0/1 done
## 
## train-outerCV-1fold.sh: genetic process in progress. 2022-02-25 19:04: 0/1 done
## 
## train-outerCV-1fold.sh: genetic process in progress. 2022-02-25 19:05: 0/1 done
## 
## train-outerCV-1fold.sh: genetic process in progress. 2022-02-25 19:06: 0/1 done
## 
## train-outerCV-1fold.sh: genetic process in progress. 2022-02-25 19:07: 0/1 done
## 
## train-outerCV-1fold.sh: genetic process in progress. 2022-02-25 19:08: 0/1 done
## 
## train-outerCV-1fold.sh: genetic process in progress. 2022-02-25 19:09: 0/1 done
## 
## train-outerCV-1fold.sh: genetic process in progress. 2022-02-25 19:10: 0/1 done
## 
## train-outerCV-1fold.sh: genetic process in progress. 2022-02-25 19:11: 0/1 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.basic.runs.0002.0014.JItJLwIix.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.basic.runs.0002.0010.8cjvssbsr.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.basic.runs.0002.0008.A7haM6vo2.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.basic.runs.0002.0007.eyuCgmQrr.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.basic.runs.0002.0006.HB5aNdAtq.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.basic.runs.0002.0005.Q0zvh6HM8.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.basic.runs.0002.0002.8KReGMmL1.running' does not exist
## train-outerCV-1fold.sh: genetic process in progress. 2022-02-25 19:12: 0/1 done
## 
## train-outerCV-1fold.sh: genetic process in progress. 2022-02-25 19:13: 0/1 done
## 
## train-outerCV-1fold.sh: genetic process in progress. 2022-02-25 19:14: 0/1 done
## 
## train-outerCV-1fold.sh: genetic process in progress. 2022-02-25 19:15: 0/1 done
## 
## train-outerCV-1fold.sh: genetic process in progress. 2022-02-25 19:16: 0/1 done
## 
## train-outerCV-1fold.sh: genetic process in progress. 2022-02-25 19:17: 0/1 done
## 
## train-outerCV-1fold.sh: genetic process in progress. 2022-02-25 19:18: 0/1 done
## 
## train-outerCV-1fold.sh: genetic process in progress. 2022-02-25 19:19: 0/1 done
## 
## train-outerCV-1fold.sh: applying every selected strategy config/model to all cases (train fold: copy; test fold: compute)
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy-training/basic/best.prefix-list' to '/tmp/user-guide-part2.output/gen1/apply-strategy-configs/test.truth'; writing results to '/tmp/user-guide-part2.output/gen1/apply-strategy-configs/fold.test'.
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy-training/basic/best.prefix-list' to '/tmp/user-guide-part2.output/gen1/apply-strategy-configs/test.truth'; writing results to '/tmp/user-guide-part2.output/gen1/apply-strategy-configs/fold.test'. 2022-02-25 19:20: 0/50 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy-training/basic/best.prefix-list' to '/tmp/user-guide-part2.output/gen1/apply-strategy-configs/test.truth'; writing results to '/tmp/user-guide-part2.output/gen1/apply-strategy-configs/fold.test'. 2022-02-25 19:20: 0/50 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy-training/basic/best.prefix-list' to '/tmp/user-guide-part2.output/gen1/apply-strategy-configs/test.truth'; writing results to '/tmp/user-guide-part2.output/gen1/apply-strategy-configs/fold.test'. 2022-02-25 19:20: 0/50 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy-training/basic/best.prefix-list' to '/tmp/user-guide-part2.output/gen1/apply-strategy-configs/test.truth'; writing results to '/tmp/user-guide-part2.output/gen1/apply-strategy-configs/fold.test'. 2022-02-25 19:20: 0/50 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy-training/basic/best.prefix-list' to '/tmp/user-guide-part2.output/gen1/apply-strategy-configs/test.truth'; writing results to '/tmp/user-guide-part2.output/gen1/apply-strategy-configs/fold.test'. 2022-02-25 19:20: 40/50 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy-training/basic/best.prefix-list' to '/tmp/user-guide-part2.output/gen1/apply-strategy-configs/test.truth'; writing results to '/tmp/user-guide-part2.output/gen1/apply-strategy-configs/fold.test'. 2022-02-25 19:20: 40/50 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy-training/basic/best.prefix-list' to '/tmp/user-guide-part2.output/gen1/apply-strategy-configs/test.truth'; writing results to '/tmp/user-guide-part2.output/gen1/apply-strategy-configs/fold.test'. 2022-02-25 19:20: 40/50 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy-training/basic/best.prefix-list' to '/tmp/user-guide-part2.output/gen1/apply-strategy-configs/test.truth'; writing results to '/tmp/user-guide-part2.output/gen1/apply-strategy-configs/fold.test'. 2022-02-25 19:20: 40/50 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy-training/basic/best.prefix-list' to '/tmp/user-guide-part2.output/gen1/apply-strategy-configs/test.truth'; writing results to '/tmp/user-guide-part2.output/gen1/apply-strategy-configs/fold.test'. 2022-02-25 19:20: 40/50 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy-training/basic/best.prefix-list' to '/tmp/user-guide-part2.output/gen1/apply-strategy-configs/test.truth'; writing results to '/tmp/user-guide-part2.output/gen1/apply-strategy-configs/fold.test'. 2022-02-25 19:20: 40/50 done
## 
## apply-multi-configs.sh: done.
## train-outerCV-1fold.sh: generating sub-folds
## train-outerCV-1fold.sh: generating the multi-conf file for meta training stage in '/tmp/user-guide-part2.output/gen1/meta-training/meta.multi-conf'
## train-outerCV-1fold.sh: launching training process for meta stage in '/tmp/user-guide-part2.output/gen1/meta-training'; multiConfStrategyFile=/tmp/user-guide-part2.output/gen1/meta-training/meta.multi-conf
## Error: '/tmp/clg-authorship.tasks/mytasks.meta.runs.0001.0011.Bsm07q6b7.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.meta.runs.0001.0010.Un3KJ5SgL.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.meta.runs.0001.0009.ee1mv25DM.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.meta.runs.0001.0008.0XFncL2fR.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.meta.runs.0001.0007.xPbTG3doD.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.meta.runs.0001.0006.LvA4fZQjB.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.meta.runs.0002.0012.uAq1eqW6A.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.meta.runs.0002.0011.v4VP8fHNt.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.meta.runs.0002.0010.k7NJ3ud3b.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.meta.runs.0002.0009.oVdcvEvLY.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.meta.runs.0002.0008.ciDy4ip0X.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.meta.runs.0002.0007.6Np6ndO4E.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.meta.runs.0003.0004.Divxcqray.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.meta.runs.0003.0011.iU6qVO4k5.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.meta.runs.0003.0010.p5bvcG43D.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.meta.runs.0003.0009.cGjtZumxb.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.meta.runs.0003.0008.ScwhZIHSC.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.meta.runs.0003.0007.AmEQgxWnh.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.meta.runs.0003.0006.tb0s8QKu4.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.meta.runs.0003.0005.gnDJktKcs.running' does not exist
## train-outerCV-1fold.sh: applying every selected meta-config to all cases (meta train fold: copy; strategy train fold + meta test fold: compute)
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/meta-training/best.prefix-list' to '/tmp/user-guide-part2.output/gen1/sub-folds/fold.1.test.cases'; writing results to '/tmp/user-guide-part2.output/gen1/apply-meta-configs/fold.meta-test'.
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/meta-training/best.prefix-list' to '/tmp/user-guide-part2.output/gen1/sub-folds/fold.1.test.cases'; writing results to '/tmp/user-guide-part2.output/gen1/apply-meta-configs/fold.meta-test'. 2022-02-25 19:44: 0/20 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/meta-training/best.prefix-list' to '/tmp/user-guide-part2.output/gen1/sub-folds/fold.1.test.cases'; writing results to '/tmp/user-guide-part2.output/gen1/apply-meta-configs/fold.meta-test'. 2022-02-25 19:44: 0/20 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/meta-training/best.prefix-list' to '/tmp/user-guide-part2.output/gen1/sub-folds/fold.1.test.cases'; writing results to '/tmp/user-guide-part2.output/gen1/apply-meta-configs/fold.meta-test'. 2022-02-25 19:44: 0/20 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/meta-training/best.prefix-list' to '/tmp/user-guide-part2.output/gen1/sub-folds/fold.1.test.cases'; writing results to '/tmp/user-guide-part2.output/gen1/apply-meta-configs/fold.meta-test'. 2022-02-25 19:44: 0/20 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/meta-training/best.prefix-list' to '/tmp/user-guide-part2.output/gen1/sub-folds/fold.1.test.cases'; writing results to '/tmp/user-guide-part2.output/gen1/apply-meta-configs/fold.meta-test'. 2022-02-25 19:44: 0/20 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/meta-training/best.prefix-list' to '/tmp/user-guide-part2.output/gen1/sub-folds/fold.1.test.cases'; writing results to '/tmp/user-guide-part2.output/gen1/apply-meta-configs/fold.meta-test'. 2022-02-25 19:45: 0/20 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.0009.BpOEwKuvv.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.0012.vtL2xdOjv.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.0011.lcOHuANNh.running' does not exist
## apply-multi-configs.sh: done.
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/meta-training/best.prefix-list' to '/tmp/user-guide-part2.output/gen1.train-cases.txt'; writing results to '/tmp/user-guide-part2.output/gen1/apply-meta-configs/fold.strategy-train'.
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/meta-training/best.prefix-list' to '/tmp/user-guide-part2.output/gen1.train-cases.txt'; writing results to '/tmp/user-guide-part2.output/gen1/apply-meta-configs/fold.strategy-train'. 2022-02-25 19:45: 0/20 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/meta-training/best.prefix-list' to '/tmp/user-guide-part2.output/gen1.train-cases.txt'; writing results to '/tmp/user-guide-part2.output/gen1/apply-meta-configs/fold.strategy-train'. 2022-02-25 19:45: 0/20 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/meta-training/best.prefix-list' to '/tmp/user-guide-part2.output/gen1.train-cases.txt'; writing results to '/tmp/user-guide-part2.output/gen1/apply-meta-configs/fold.strategy-train'. 2022-02-25 19:45: 0/20 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/meta-training/best.prefix-list' to '/tmp/user-guide-part2.output/gen1.train-cases.txt'; writing results to '/tmp/user-guide-part2.output/gen1/apply-meta-configs/fold.strategy-train'. 2022-02-25 19:45: 0/20 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/meta-training/best.prefix-list' to '/tmp/user-guide-part2.output/gen1.train-cases.txt'; writing results to '/tmp/user-guide-part2.output/gen1/apply-meta-configs/fold.strategy-train'. 2022-02-25 19:45: 0/20 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/meta-training/best.prefix-list' to '/tmp/user-guide-part2.output/gen1.train-cases.txt'; writing results to '/tmp/user-guide-part2.output/gen1/apply-meta-configs/fold.strategy-train'. 2022-02-25 19:45: 0/20 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.0011.FCr3Iqe9N.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.0010.csfPRdcTb.running' does not exist
## apply-multi-configs.sh: done.
## train-outerCV-1fold.sh: refactoring strategy configs
## apply-bagging.sh: nbRuns=10
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0001/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0001'.
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0001/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0001'. 2022-02-25 19:45: 0/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0001/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0001'. 2022-02-25 19:45: 0/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0001/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0001'. 2022-02-25 19:45: 0/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0001/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0001'. 2022-02-25 19:45: 0/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0001/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0001'. 2022-02-25 19:46: 0/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0001/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0001'. 2022-02-25 19:46: 0/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0001/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0001'. 2022-02-25 19:46: 28/70 done
## 
## date: /tmp/clg-authorship.tasks/mytasks.strategy-as-meta.basic.0031.vzuJveNEj.running: No such file or directory
## /home/moreaue/projects/erw-bash-commons/bin/task-distrib-daemon.sh: line 125: 1645818370 -  : syntax error: operand expected (error token is "-  ")
## Error: '/tmp/clg-authorship.tasks/mytasks.strategy-as-meta.basic.0033.E8gfrqjJL.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.strategy-as-meta.basic.0032.W4wOwynx9.running' does not exist
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0001/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0001'. 2022-02-25 19:46: 40/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0001/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0001'. 2022-02-25 19:46: 40/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0001/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0001'. 2022-02-25 19:46: 40/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0001/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0001'. 2022-02-25 19:46: 40/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0001/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0001'. 2022-02-25 19:46: 40/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0001/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0001'. 2022-02-25 19:46: 40/70 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.0013.2EFyeONhK.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.0012.5YpxEfmfU.running' does not exist
## apply-multi-configs.sh: done.
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0002/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0002'.
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0002/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0002'. 2022-02-25 19:46: 0/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0002/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0002'. 2022-02-25 19:46: 0/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0002/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0002'. 2022-02-25 19:46: 0/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0002/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0002'. 2022-02-25 19:47: 0/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0002/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0002'. 2022-02-25 19:47: 0/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0002/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0002'. 2022-02-25 19:47: 0/70 done
## 
## date: /tmp/clg-authorship.tasks/mytasks.strategy-as-meta.basic.0031.P2uw1fCcO.running: No such file or directory
## /home/moreaue/projects/erw-bash-commons/bin/task-distrib-daemon.sh: line 125: 1645818433 -  : syntax error: operand expected (error token is "-  ")
## Error: '/tmp/clg-authorship.tasks/mytasks.strategy-as-meta.basic.0033.0uhEClsmP.running' does not exist
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0002/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0002'. 2022-02-25 19:47: 40/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0002/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0002'. 2022-02-25 19:47: 40/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0002/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0002'. 2022-02-25 19:47: 40/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0002/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0002'. 2022-02-25 19:47: 40/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0002/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0002'. 2022-02-25 19:47: 40/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0002/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0002'. 2022-02-25 19:47: 40/70 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.0013.fdiTCCYII.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.0012.Pg8omqgwa.running' does not exist
## apply-multi-configs.sh: done.
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0003/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0003'.
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0003/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0003'. 2022-02-25 19:47: 0/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0003/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0003'. 2022-02-25 19:47: 0/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0003/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0003'. 2022-02-25 19:47: 0/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0003/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0003'. 2022-02-25 19:48: 0/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0003/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0003'. 2022-02-25 19:48: 0/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0003/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0003'. 2022-02-25 19:48: 0/70 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.strategy-as-meta.basic.0031.e5Gbu9tku.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.strategy-as-meta.basic.0033.T3uOgauWB.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.strategy-as-meta.basic.0032.D87qSYqvF.running' does not exist
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0003/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0003'. 2022-02-25 19:48: 40/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0003/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0003'. 2022-02-25 19:48: 40/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0003/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0003'. 2022-02-25 19:48: 40/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0003/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0003'. 2022-02-25 19:48: 40/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0003/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0003'. 2022-02-25 19:48: 40/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0003/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0003'. 2022-02-25 19:48: 40/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0003/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0003'. 2022-02-25 19:48: 40/70 done
## 
## date: /tmp/clg-authorship.tasks/mytasks.0011.pGcb9nyyc.running: No such file or directory
## /home/moreaue/projects/erw-bash-commons/bin/task-distrib-daemon.sh: line 125: 1645818528 -  : syntax error: operand expected (error token is "-  ")
## Error: '/tmp/clg-authorship.tasks/mytasks.0013.IMsx67Tee.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.0012.QhCaBjOUB.running' does not exist
## apply-multi-configs.sh: done.
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0004/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0004'.
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0004/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0004'. 2022-02-25 19:48: 0/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0004/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0004'. 2022-02-25 19:48: 0/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0004/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0004'. 2022-02-25 19:49: 0/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0004/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0004'. 2022-02-25 19:49: 0/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0004/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0004'. 2022-02-25 19:49: 0/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0004/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0004'. 2022-02-25 19:49: 0/70 done
## 
## date: /tmp/clg-authorship.tasks/mytasks.strategy-as-meta.basic.0034.MKsnlTGw1.running: No such file or directory
## /home/moreaue/projects/erw-bash-commons/bin/task-distrib-daemon.sh: line 125: 1645818560 -  : syntax error: operand expected (error token is "-  ")
## Error: '/tmp/clg-authorship.tasks/mytasks.strategy-as-meta.basic.0033.KXRmlg9Bu.running' does not exist
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0004/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0004'. 2022-02-25 19:49: 40/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0004/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0004'. 2022-02-25 19:49: 40/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0004/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0004'. 2022-02-25 19:49: 40/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0004/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0004'. 2022-02-25 19:49: 40/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0004/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0004'. 2022-02-25 19:49: 40/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0004/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0004'. 2022-02-25 19:49: 40/70 done
## 
## date: /tmp/clg-authorship.tasks/mytasks.0011.JEJqluwI5.running: No such file or directory
## /home/moreaue/projects/erw-bash-commons/bin/task-distrib-daemon.sh: line 125: 1645818591 -  : syntax error: operand expected (error token is "-  ")
## Error: '/tmp/clg-authorship.tasks/mytasks.0013.b6Bh2kxEz.running' does not exist
## apply-multi-configs.sh: done.
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0005/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0005'.
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0005/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0005'. 2022-02-25 19:49: 0/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0005/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0005'. 2022-02-25 19:49: 0/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0005/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0005'. 2022-02-25 19:50: 0/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0005/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0005'. 2022-02-25 19:50: 0/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0005/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0005'. 2022-02-25 19:50: 0/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0005/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0005'. 2022-02-25 19:50: 0/70 done
## 
## date: /tmp/clg-authorship.tasks/mytasks.strategy-as-meta.basic.0034.uDfaUrSBU.running: No such file or directory
## /home/moreaue/projects/erw-bash-commons/bin/task-distrib-daemon.sh: line 125: 1645818623 -  : syntax error: operand expected (error token is "-  ")
## Error: '/tmp/clg-authorship.tasks/mytasks.strategy-as-meta.basic.0033.xai1gvBiN.running' does not exist
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0005/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0005'. 2022-02-25 19:50: 40/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0005/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0005'. 2022-02-25 19:50: 40/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0005/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0005'. 2022-02-25 19:50: 40/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0005/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0005'. 2022-02-25 19:50: 40/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0005/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0005'. 2022-02-25 19:50: 40/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0005/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0005'. 2022-02-25 19:50: 40/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0005/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0005'. 2022-02-25 19:50: 43/70 done
## 
## date: /tmp/clg-authorship.tasks/mytasks.0011.kQyzgywX0.running: No such file or directory
## /home/moreaue/projects/erw-bash-commons/bin/task-distrib-daemon.sh: line 125: 1645818654 -  : syntax error: operand expected (error token is "-  ")
## Error: '/tmp/clg-authorship.tasks/mytasks.0013.YNTuvT2Zz.running' does not exist
## apply-multi-configs.sh: done.
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0006/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0006'.
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0006/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0006'. 2022-02-25 19:51: 0/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0006/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0006'. 2022-02-25 19:51: 0/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0006/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0006'. 2022-02-25 19:51: 0/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0006/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0006'. 2022-02-25 19:51: 0/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0006/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0006'. 2022-02-25 19:51: 0/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0006/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0006'. 2022-02-25 19:51: 0/70 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.strategy-as-meta.basic.0034.HKxwJbBnU.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.strategy-as-meta.basic.0033.0ZmpfMJeC.running' does not exist
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0006/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0006'. 2022-02-25 19:51: 40/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0006/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0006'. 2022-02-25 19:51: 40/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0006/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0006'. 2022-02-25 19:51: 40/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0006/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0006'. 2022-02-25 19:51: 40/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0006/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0006'. 2022-02-25 19:51: 40/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0006/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0006'. 2022-02-25 19:51: 40/70 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.0011.GZwDZkeno.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.0013.EOuOf9kBH.running' does not exist
## apply-multi-configs.sh: done.
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0007/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0007'.
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0007/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0007'. 2022-02-25 19:52: 0/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0007/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0007'. 2022-02-25 19:52: 0/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0007/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0007'. 2022-02-25 19:52: 0/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0007/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0007'. 2022-02-25 19:52: 0/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0007/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0007'. 2022-02-25 19:52: 0/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0007/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0007'. 2022-02-25 19:52: 0/70 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.strategy-as-meta.basic.0031.rvkMz7nN1.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.strategy-as-meta.basic.0033.xq329RFB7.running' does not exist
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0007/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0007'. 2022-02-25 19:52: 40/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0007/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0007'. 2022-02-25 19:52: 40/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0007/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0007'. 2022-02-25 19:52: 40/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0007/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0007'. 2022-02-25 19:52: 40/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0007/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0007'. 2022-02-25 19:52: 40/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0007/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0007'. 2022-02-25 19:52: 40/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0007/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0007'. 2022-02-25 19:53: 53/70 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.0011.nKxbYMBh2.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.0013.A7RIyenx4.running' does not exist
## apply-multi-configs.sh: done.
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0008/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0008'.
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0008/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0008'. 2022-02-25 19:53: 0/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0008/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0008'. 2022-02-25 19:53: 0/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0008/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0008'. 2022-02-25 19:53: 0/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0008/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0008'. 2022-02-25 19:53: 0/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0008/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0008'. 2022-02-25 19:53: 0/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0008/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0008'. 2022-02-25 19:53: 0/70 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.strategy-as-meta.basic.0034.jlsaI5xQr.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.strategy-as-meta.basic.0033.9NMaM17Vp.running' does not exist
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0008/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0008'. 2022-02-25 19:53: 40/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0008/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0008'. 2022-02-25 19:53: 40/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0008/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0008'. 2022-02-25 19:53: 40/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0008/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0008'. 2022-02-25 19:53: 40/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0008/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0008'. 2022-02-25 19:53: 40/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0008/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0008'. 2022-02-25 19:54: 40/70 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.0011.13zlafTKp.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.0013.nVrBhJ6oB.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.0012.ZT7d77kwu.running' does not exist
## apply-multi-configs.sh: done.
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0009/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0009'.
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0009/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0009'. 2022-02-25 19:54: 0/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0009/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0009'. 2022-02-25 19:54: 0/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0009/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0009'. 2022-02-25 19:54: 0/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0009/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0009'. 2022-02-25 19:54: 0/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0009/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0009'. 2022-02-25 19:54: 0/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0009/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0009'. 2022-02-25 19:54: 0/70 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.strategy-as-meta.basic.0034.lEDoPXDqA.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.strategy-as-meta.basic.0033.9Odr18bGi.running' does not exist
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0009/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0009'. 2022-02-25 19:54: 40/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0009/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0009'. 2022-02-25 19:54: 40/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0009/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0009'. 2022-02-25 19:54: 40/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0009/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0009'. 2022-02-25 19:54: 40/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0009/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0009'. 2022-02-25 19:54: 40/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0009/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0009'. 2022-02-25 19:55: 40/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0009/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0009'. 2022-02-25 19:55: 59/70 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.0014.wA7szqWQE.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.0013.dBL5qpOty.running' does not exist
## apply-multi-configs.sh: done.
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0010/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0010'.
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0010/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0010'. 2022-02-25 19:55: 0/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0010/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0010'. 2022-02-25 19:55: 0/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0010/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0010'. 2022-02-25 19:55: 0/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0010/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0010'. 2022-02-25 19:55: 0/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0010/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0010'. 2022-02-25 19:55: 0/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0010/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0010'. 2022-02-25 19:55: 3/70 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.strategy-as-meta.basic.0034.OQtufYBTq.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.strategy-as-meta.basic.0033.REffRmgQL.running' does not exist
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0010/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0010'. 2022-02-25 19:55: 40/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0010/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0010'. 2022-02-25 19:55: 40/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0010/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0010'. 2022-02-25 19:55: 40/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0010/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0010'. 2022-02-25 19:55: 40/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0010/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0010'. 2022-02-25 19:56: 40/70 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/gen1/strategy+best-meta.prefix-list' to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0010/random.cases'; writing results to '/tmp/user-guide-part2.output/gen1/bagging-meta-test-fold/0010'. 2022-02-25 19:56: 40/70 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.0014.2NloavwJj.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.0013.a8ePh0Jke.running' does not exist
## apply-multi-configs.sh: done.
## apply-bagging.sh: main loop done, extracting stats
## train-outerCV-1fold.sh: done.

Full example

This part shows the full process of training a meta-model with several strategies, albeit with simplified parameters. This experiment is self-contained, i.e. it doesn’t rely on any part executed previously. See above for the detailed explanations.

Preparing the input data

Input data

We use the training set generated for the main experiments (see Experiment 1: size of documents).

mkdir "$OUTPUT_DIR"/input-data.full
cat "$EXPE_WORK_DIR/train.tsv" > "$OUTPUT_DIR/input-data.full/truth.txt"
cat "$EXPE_WORK_DIR/train.tsv"  | cut -f 1 | tr ' :' '\n\n'  | sort -u | while read f; do
      cp "$OUTPUT_DIR/data/$f" "$OUTPUT_DIR/input-data.full/"
done

Impostors data

We build a small impostors dataset (same way as above):

source session-setup.sh
mkdir $OUTPUT_DIR/impostors.full
mkdir $OUTPUT_DIR/impostors.full/my.impostors
n=$(find $OUTPUT_DIR/data/* -maxdepth 0 -type f | wc -l)
find $OUTPUT_DIR/data/* -maxdepth 0 -type f | random-lines.pl 100 1 $n | while read f; do cp $f $OUTPUT_DIR/impostors.full/my.impostors/$(basename "$f").txt; done

• Note: the name my.impostors is the one used in the default GI config file conf/GI.multi-conf.part.

Multi-conf files

For this example we create some simplified multi-conf files which are slightly more advanced than in the previous example:

• The three strategies are included.
• Observation types with stop word and POS tags are used.

Important: The “meta” config file must also be copied in the target directory under the name meta-template.multi-conf, as shown below.

source session-setup.sh
mkdir "$OUTPUT_DIR/full"
generate-multi-conf.sh -c common.simplified2.multi-conf.part -g genetic.simplified.multi-conf.part 1 "$OUTPUT_DIR/full"
cat conf/meta-template.simplified.multi-conf > "$OUTPUT_DIR/full/meta-template.multi-conf"

## generate-multi-conf.sh: Strategy 'basic' (with POS)
## generate-multi-conf.sh: Strategy 'GI' (with POS)
## generate-multi-conf.sh: Strategy 'univ' (with POS)

Running the preparation script

source session-setup.sh
prepare-input-data.sh -l english -i $OUTPUT_DIR/impostors.full/ "$OUTPUT_DIR/input-data.full" "$OUTPUT_DIR/full"

## prepare-input-data.sh: language is 'english'
## prepare-input-data.sh init: copying input data
## prepare-input-data.sh: stop words: generating count files, tokens only
## count-obs-dataset.sh: no TreeTagger tokenization/POS tagging needed
## count-obs-dataset.sh: generating count files
## prepare-input-data.sh: input data, generating count files for all obs types
## count-obs-dataset.sh: tokenization and POS tagging
## count-obs-dataset.sh: generating count files
## prepare-input-data.sh: input data, preparing impostors data
## prepare-input-data.sh, impostors dataset 'my.impostors' copying impostors file
## prepare-input-data.sh, impostors dataset 'my.impostors': generating count files for all obs types
## count-obs-dataset.sh: tokenization and POS tagging
## count-obs-dataset.sh: generating count files
## prepare-input-data.sh, impostors dataset 'my.impostors': computing pre-similarity values against all probe files
## prepare-input-data.sh: writing resources options file
## prepare-input-data.sh: done.

Running the full training process with train-top-level.sh

Compared to train-outerCV-1fold.sh, The script train-top-level.sh can be used to run an additional level of cross-validation… although it does not actually perform a proper cross-validation:

• The training data is split randomly into two subsets and B. train-outerCV-1fold.sh is called twice:
  • With A as strategy training set and as meta-training set + validation set,
  • With B as strategy training set and A as meta-training set + validation set.
• After extracting/copying the best models (config and possibly Weka model) from both folds, the final bagging stage is performed on the whole training data.
• The best models are sorted by their performance (depending on the selection method given as parameter, either on the validation set (meta-test set), full training set, or average of both) and written to a file named best.results, in which lines follow the format: <Perf full training set> <Perf meta test set> <Average both>.

This “top-level” stage can be useful to manually assess the effect of randomness on the results (to some extent). However the double genetic process is unlikely to return the exact same configurations in the two runs, so it is impossible in general to calculate the average performance of a particular configuration across the runs.

The script receives only the previously initialized working directory, which contains the training data and multi-configuration files.

source session-setup.sh
task-distrib-daemon.sh  -s 30s -p 1 -v -q 10 "$TASKS_DIR" $NCORES >"$OUTPUT_DIR/full.task-daemon.log" &
train-top-level.sh -r -P "$TASKS_DIR/mytasks" -o  '-c -s' "$OUTPUT_DIR/full"

## train-top-level.sh: generating outer folds
## train-top-level.sh: calling train-outerCV-1fold.sh for fold fold.1 in /tmp/user-guide-part2.output/full/fold.1
## train-top-level.sh: calling train-outerCV-1fold.sh for fold fold.2 in /tmp/user-guide-part2.output/full/fold.2
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 20:00: 0/2 done
## 
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 20:01: 0/2 done
## 
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 20:02: 0/2 done
## 
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 20:03: 0/2 done
## 
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 20:04: 0/2 done
## 
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 20:05: 0/2 done
## 
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 20:06: 0/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.univ.indivGenetic_1.0002.001.csooj4HBA.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 20:07: 0/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.univ.indivGenetic_1.0002.012.iUuPkG38c.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 20:08: 0/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.univ.indivGenetic_1.0002.026.WdEbZVbrQ.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 20:09: 0/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.GI.indivGenetic_1.0002.039.51N4C8PvQ.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 20:10: 0/2 done
## 
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 20:11: 0/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.univ.indivGenetic_1.0003.005.qiHEiwlvO.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 20:12: 0/2 done
## 
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 20:13: 0/2 done
## 
## date: /tmp/clg-authorship.tasks/mytasks.fold.2.GI.indivGenetic_1.0003.026.sgoo5iwhQ.running: No such file or directory
## /home/moreaue/projects/erw-bash-commons/bin/task-distrib-daemon.sh: line 125: 1645820035 -  : syntax error: operand expected (error token is "-  ")
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 20:14: 0/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.GI.indivGenetic_1.0003.022.Qftdj5E0M.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 20:15: 0/2 done
## 
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 20:16: 0/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.univ.indivGenetic_1.0004.014.TZv2GAWnE.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 20:17: 0/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.GI.indivGenetic_1.0004.035.CmNRb6D2E.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 20:18: 0/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.GI.indivGenetic_1.0004.019.Vuw1qQoCm.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 20:19: 0/2 done
## 
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 20:20: 0/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.univ.indivGenetic_1.0004.039.8K5EAzH4u.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 20:21: 0/2 done
## 
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 20:22: 0/2 done
## 
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 20:23: 0/2 done
## 
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 20:24: 0/2 done
## 
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 20:25: 0/2 done
## 
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 20:26: 0/2 done
## 
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 20:27: 0/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.univ.indivGenetic_1.0006.016.GAyWZS1F3.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.univ.indivGenetic_1.0006.013.fpwU99oxG.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 20:28: 0/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.GI.indivGenetic_1.0006.030.xnnNeTEyb.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 20:29: 0/2 done
## 
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 20:30: 0/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.univ.indivGenetic_1.0006.032.HGcmY4X5J.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 20:31: 0/2 done
## 
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 20:32: 0/2 done
## 
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 20:33: 0/2 done
## 
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 20:34: 0/2 done
## 
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 20:35: 0/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.GI.indivGenetic_1.0007.011.O2lBh4awB.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 20:36: 0/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.GI.indivGenetic_1.0007.004.WzW9gtGmT.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 20:37: 0/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.univ.runs.0001.0008.rQe22OkZz.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 20:38: 0/2 done
## 
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 20:39: 0/2 done
## 
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 20:40: 0/2 done
## 
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 20:41: 0/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.univ.indivGenetic_1.0008.032.AGV7lGXBO.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 20:42: 0/2 done
## 
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 20:43: 0/2 done
## 
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 20:44: 0/2 done
## 
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 20:45: 0/2 done
## 
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 20:46: 0/2 done
## 
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 20:47: 0/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.GI.indivGenetic_1.0009.024.gRHE5VN9d.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 20:48: 0/2 done
## 
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 20:49: 0/2 done
## 
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 20:50: 0/2 done
## 
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 20:51: 0/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.GI.runs.0001.0057.XCaBcF9SY.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.GI.runs.0001.0043.OLzeSolMe.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 20:52: 0/2 done
## 
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 20:53: 0/2 done
## 
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 20:54: 0/2 done
## 
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 20:55: 0/2 done
## 
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 20:56: 0/2 done
## 
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 20:57: 0/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.GI.runs.0002.0002.okdLPfu4f.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 20:58: 0/2 done
## 
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 20:59: 0/2 done
## 
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 21:00: 0/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.univ.runs.0004.0029.zwjJtwaEN.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 21:01: 0/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.univ.runs.0004.0067.nMYqmw73a.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 21:02: 0/2 done
## 
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 21:03: 0/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.GI.runs.0001.0052.ZZSd3unR7.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 21:04: 0/2 done
## 
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 21:05: 0/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.univ.runs.0001.0009.v0qlK091h.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 21:06: 0/2 done
## 
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 21:07: 0/2 done
## 
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 21:08: 0/2 done
## 
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 21:09: 0/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.GI.runs.0003.0018.n7D0paKmh.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 21:10: 0/2 done
## 
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 21:11: 0/2 done
## 
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 21:12: 0/2 done
## 
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 21:13: 0/2 done
## 
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 21:14: 0/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.GI.runs.0002.0030.d0QIoSG2k.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 21:15: 0/2 done
## 
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 21:16: 0/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.univ.runs.0002.0018.iWLfKrkCa.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.univ.runs.0002.0016.5gdJVzpqF.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.univ.runs.0002.0015.nkTaRR2qb.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 21:17: 0/2 done
## 
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 21:18: 0/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.univ.runs.0002.0094.Ivg46eRNr.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 21:19: 0/2 done
## 
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 21:20: 0/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.GI.runs.0004.0010.J3FRseiGZ.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.GI.runs.0004.0017.KLPAoIyrx.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.GI.runs.0004.0014.JApCRST4k.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 21:21: 0/2 done
## 
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 21:22: 0/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.GI.runs.0004.0030.D4UHzRDAs.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 21:23: 0/2 done
## 
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 21:24: 0/2 done
## 
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 21:25: 0/2 done
## 
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 21:26: 0/2 done
## 
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 21:27: 0/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.GI.runs.0003.0012.3OwlsBdpL.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 21:28: 0/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.GI.runs.0003.0035.EPAP844fL.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 21:29: 0/2 done
## 
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 21:30: 0/2 done
## 
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 21:31: 0/2 done
## 
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 21:32: 0/2 done
## 
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 21:33: 0/2 done
## 
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 21:34: 0/2 done
## 
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 21:35: 0/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.GI.runs.0005.0065.db48VsMjC.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 21:36: 0/2 done
## 
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 21:37: 0/2 done
## 
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 21:38: 0/2 done
## 
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 21:39: 0/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.GI.runs.0004.0099.d4maYJ7j1.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 21:40: 0/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.univ.runs.0004.0009.cMaiOnRp3.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.GI.runs.0004.0093.EOXfOpqqt.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 21:41: 0/2 done
## 
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 21:42: 0/2 done
## 
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 21:43: 0/2 done
## 
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 21:44: 0/2 done
## 
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 21:45: 0/2 done
## 
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 21:46: 0/2 done
## 
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 21:47: 0/2 done
## 
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 21:48: 0/2 done
## 
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 21:49: 0/2 done
## 
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 21:50: 0/2 done
## 
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 21:51: 0/2 done
## 
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 21:52: 0/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.GI.runs.0005.0092.KSKTP7u8I.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.GI.runs.0005.0084.DnLfCSq1S.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.GI.runs.0005.0079.FFFFtHlms.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 21:53: 0/2 done
## 
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 21:54: 0/2 done
## 
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 21:55: 0/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.univ.runs.0005.0095.jqB85uKfQ.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 21:56: 0/2 done
## 
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 21:57: 0/2 done
## 
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 21:58: 0/2 done
## 
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 21:59: 0/2 done
## 
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 22:00: 0/2 done
## 
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 22:01: 0/2 done
## 
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 22:02: 0/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.univ.final-train.cv.0022.aHfNk2OSg.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 22:03: 0/2 done
## 
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 22:04: 0/2 done
## 
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 22:05: 0/2 done
## 
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 22:06: 0/2 done
## 
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 22:07: 0/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.basic.final-train.model.0018.JlieJG9Us.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.basic.final-train.model.0038.JVs32wfqs.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.basic.final-train.model.0037.dIPqfCBzZ.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.basic.final-train.model.0036.V0DTWOrhi.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 22:08: 0/2 done
## 
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 22:09: 0/2 done
## 
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 22:10: 0/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.basic.0038.9zAQr54Z4.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.basic.0037.H34Ubs9Sb.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.basic.0034.Gu99oRB9j.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.basic.final-train.model.0013.r4nRTbKo0.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.basic.final-train.model.0012.MjPFPVPNF.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.basic.final-train.model.0011.ZH07jXqjz.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.basic.final-train.model.0010.z8MatxWjC.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 22:11: 0/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.basic.final-train.model.0033.AszqoMRU5.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.basic.final-train.model.0032.dCHrcgcYs.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.basic.final-train.model.0031.K1j7s3Sdj.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.basic.final-train.model.0030.7OfOpiOGZ.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.basic.final-train.model.0050.mtslHK59o.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.basic.final-train.model.0049.GRxgXcCuR.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 22:12: 0/2 done
## 
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 22:13: 0/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.basic.0013.duUtC68UH.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.basic.0011.QS4EFxNfK.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.basic.0010.E8oAj60ah.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.basic.0009.PfBnYeRTa.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.basic.0007.FBSr1nqUh.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.basic.0006.zbo9BmgRP.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 22:14: 0/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.basic.0049.ujLhLKIyA.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.basic.0048.ASdHdGb1S.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.basic.0046.Qme0AplQg.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 22:15: 0/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0001.18.p3dFbn7Fm.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0001.22.ZNTfzeICh.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0001.21.sQc3GESXX.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0001.20.QW2lBSTYh.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 22:16: 0/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0002.003.eRrwA8yap.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0002.002.ChAp6nj1o.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0002.001.l9ZgKEBHH.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0002.000.QTVhf7Ewv.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.univ.0040.5UO23Sh8l.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 22:17: 0/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0002.043.LUwr88zLv.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0002.042.lWauxJ2Gx.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0002.041.EOxxDkc86.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0002.040.1reEhHRGP.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 22:18: 0/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.meta.metaGenetic_1.0001.28.FqLgUAyqI.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.meta.metaGenetic_1.0001.32.xOnUl38fW.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.meta.metaGenetic_1.0001.31.YAoyvrsHQ.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.meta.metaGenetic_1.0001.30.WQST7vf4I.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0003.018.Lf6HZhp8j.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0003.023.GnkmkQehc.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0003.022.srMSJTPgj.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0003.021.XA0fqi11k.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0003.020.Y8yE5BqP0.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 22:19: 0/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.meta.metaGenetic_1.0002.013.fRkzm2zYU.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.meta.metaGenetic_1.0002.012.yrbhzbrL8.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.meta.metaGenetic_1.0002.011.Z3Fw4wiXI.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.meta.metaGenetic_1.0002.010.rYt5qFvYX.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.meta.metaGenetic_1.0002.049.7iDzJ2LcO.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0004.003.mTSKU0Vyo.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0004.002.SAP6ME1WD.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0004.001.yXRLX958L.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 22:20: 0/2 done
## 
## date: /tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0004.039.j25lMCAGG.running: No such file or directory
## /home/moreaue/projects/erw-bash-commons/bin/task-distrib-daemon.sh: line 125: 1645827662 -  : syntax error: operand expected (error token is "-  ")
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0004.043.kboPPmLIP.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0004.042.QcSy13yIP.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0004.041.St5NmOi4x.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.meta.metaGenetic_1.0003.028.xfmlT3YJ9.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.meta.metaGenetic_1.0003.033.9WaKiwDmi.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.meta.metaGenetic_1.0003.032.I3RLSy39Q.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.meta.metaGenetic_1.0003.031.u2Mqzi4Jb.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.meta.metaGenetic_1.0003.030.8KcwDE2eb.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 22:21: 0/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0005.024.fCc0EeKIZ.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0005.023.N8KcXOPQv.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0005.022.Db7S53THb.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0005.021.8zeWLeHq3.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 22:22: 0/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.meta.metaGenetic_1.0004.014.xgmXAJypd.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.meta.metaGenetic_1.0004.013.KGYDqeAaG.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.meta.metaGenetic_1.0004.012.CZJRuYZ4S.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.meta.metaGenetic_1.0004.011.4sokGiIat.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0006.003.q6QsfN40n.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0006.002.qWpJ15Zfm.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0006.001.KfjOsgXqC.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 22:23: 0/2 done
## 
## date: /tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0006.038.3jX5ou2vq.running: No such file or directory
## /home/moreaue/projects/erw-bash-commons/bin/task-distrib-daemon.sh: line 125: 1645827833 -  : syntax error: operand expected (error token is "-  ")
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0006.043.6trVnvCRL.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0006.042.foSE5uv2u.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0006.041.vHOuaVggL.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0006.040.4SCTt1oRz.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.meta.metaGenetic_1.0005.029.BJyh9Qdcc.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.meta.metaGenetic_1.0005.034.V1TAE2PfI.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.meta.metaGenetic_1.0005.033.inl9lmWyU.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.meta.metaGenetic_1.0005.032.ZSdx1jykO.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.meta.metaGenetic_1.0005.031.zkpjBpvKv.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 22:24: 0/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0007.023.DzeNA3V2w.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0007.022.ywiaZ3W3u.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.meta.metaGenetic_1.0006.009.RxsJPi8gN.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.meta.metaGenetic_1.0006.013.3tw2B6XZO.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.meta.metaGenetic_1.0006.012.EkerCOHN5.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.meta.metaGenetic_1.0006.011.NlMF8eokg.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 22:25: 0/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0008.004.nlmA94Or4.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0008.003.xBfaaWtrP.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0008.002.cd2uUDIN6.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0008.001.gRH7MscJL.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 22:26: 0/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0008.039.LVntSsdPJ.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0008.044.7a7WagtVN.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0008.043.z0ahwFayO.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0008.042.1tp6X3qu5.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0008.041.dXfzthC6i.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.meta.metaGenetic_1.0007.033.bTw9ziBJu.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.meta.metaGenetic_1.0007.032.K8CvUooox.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.meta.metaGenetic_1.0007.031.AZydkr8ze.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.meta.metaGenetic_1.0007.030.pCugxNErl.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 22:27: 0/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0009.024.GlIOsC1vB.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0009.023.kxbM43st1.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0009.022.rD4xkVJ3b.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0009.021.Nz3RPKkpu.running' does not exist
## date: /tmp/clg-authorship.tasks/mytasks.fold.1.meta.metaGenetic_1.0008.010.vxQ0QxNHn.running: No such file or directory
## /home/moreaue/projects/erw-bash-commons/bin/task-distrib-daemon.sh: line 125: 1645828106 -  : syntax error: operand expected (error token is "-  ")
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.meta.metaGenetic_1.0008.014.0vNE0zB8n.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.meta.metaGenetic_1.0008.013.PYyn0jcLA.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.meta.metaGenetic_1.0008.012.ySxZSE17i.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 22:28: 0/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0010.000.krlxXH9si.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0010.004.CRkDFWaSg.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0010.003.h7dBrf3yI.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0010.002.YB39ozX8Y.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0010.040.kp5Mf7zrF.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0010.044.N52p1xEXi.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0010.043.95mCL9tFM.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0010.042.ecBe05qLF.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 22:29: 0/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.meta.metaGenetic_1.0009.029.D5L7mlhJF.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.meta.metaGenetic_1.0009.034.3pw7gKrlq.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.meta.metaGenetic_1.0009.033.ptHIsGSao.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.meta.metaGenetic_1.0009.032.T8rthQoO3.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 22:30: 0/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0011.025.Rr6dfRxDS.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0011.024.FEE3IUtpL.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0011.023.MG7ZWluVc.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.meta.metaGenetic_1.0010.014.a0tnxuq86.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.meta.metaGenetic_1.0010.013.k1LCFw3UQ.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.meta.metaGenetic_1.0010.012.F1xnWnw0e.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 22:31: 0/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0012.004.2YcDtc7a9.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0012.003.eNmygssTl.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0012.002.8rOBnbvDj.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0012.001.89Xwbazhi.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0012.040.Gma6X5u0E.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0012.044.RLwyLzITw.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0012.043.eWm6d8K1J.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0012.042.93OPREi8M.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 22:32: 0/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.meta.metaGenetic_1.0011.034.8qGQr32OG.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.meta.metaGenetic_1.0011.033.Ni6CpNTTk.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.meta.metaGenetic_1.0011.032.GiLvJMl9h.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0013.021.5XxKoURxL.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0013.025.ZBR93HqNP.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0013.024.P4mGxoGQW.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0013.023.zv9D7Fuy4.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0013.022.igAwDCyZc.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 22:33: 0/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.meta.metaGenetic_1.0012.010.4KHSFarRU.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.meta.metaGenetic_1.0012.014.jZL5P5XXR.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.meta.metaGenetic_1.0012.013.RN0azs5y8.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.meta.metaGenetic_1.0012.012.tXau2ty01.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 22:34: 0/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0014.005.61mdjyBZG.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0014.004.K5Q2JNDsv.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0014.003.WMJDx8UMh.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.meta.runs.0001.0004.3NN218a5Z.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.meta.runs.0001.0003.Y4SLssnYW.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0014.044.ZUxOHNRrw.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0014.043.Tq5i7ONtP.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 22:35: 0/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.meta.runs.0001.0045.6SxOuhlCH.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.meta.runs.0001.0044.D2pREqW4o.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.meta.runs.0001.0043.iTwmhPXL3.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0015.021.n2Eyei8vs.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0015.024.vhNzOoCtb.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0015.023.fsT7F542y.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 22:36: 0/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.meta.runs.0002.0025.vLAkbk5Xh.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.meta.runs.0002.0024.KU9wrZE4u.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0016.001.oHb9RTaob.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0016.006.uzHwaaBAu.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0016.005.LokDxW7lm.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0016.004.a12Qbq4JM.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0016.003.FI9uNfG0I.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 22:37: 0/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0016.042.xViBoqSlJ.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.meta.runs.0003.0006.dYCS6OWsW.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.meta.runs.0003.0005.YuCBDc8BM.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0016.046.OouGiZJ4y.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0016.045.4I25Y88DF.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0016.044.oL66i7YSQ.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.meta.runs.0003.0043.meki9BM7n.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.meta.runs.0003.0046.KTBcnXpLA.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.meta.runs.0003.0045.yT8ikEIOj.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.meta.runs.0003.0044.YXLe4Idnp.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 22:38: 0/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0017.026.UnMxCOtFC.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0017.025.tbOn0AHJZ.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0017.024.uWGZItKbL.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 22:39: 0/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0018.015.d06XqSTnX.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0018.014.DRpUDp7US.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0018.013.wmAv6zVXA.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 22:40: 0/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.0018.Ro0OGO9z5.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 22:41: 0/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.strategy-as-meta.basic.0008.4mnnx6pzV.running' does not exist
## date: /tmp/clg-authorship.tasks/mytasks.fold.1.strategy-as-meta.basic.0010.eSrlEPa4A.running: No such file or directory
## /home/moreaue/projects/erw-bash-commons/bin/task-distrib-daemon.sh: line 125: 1645828935 -  : syntax error: operand expected (error token is "-  ")
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0019.035.STsUcoRBp.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 22:42: 0/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.strategy-as-meta.GI.0039.GHkphBzJ2.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 22:43: 0/2 done
## 
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 22:44: 0/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0020.012.RI8ySmsl7.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0020.017.srMppyeoD.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0020.016.TUd48DjMi.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0020.015.cWHVhmuxQ.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.metaGenetic_1.0020.014.Jpc21W977.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 22:45: 0/2 done
## 
## date: /tmp/clg-authorship.tasks/mytasks.fold.1.strategy-as-meta.GI.0018.Jq0gzLUSE.running: No such file or directory
## /home/moreaue/projects/erw-bash-commons/bin/task-distrib-daemon.sh: line 125: 1645829170 -  : syntax error: operand expected (error token is "-  ")
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.strategy-as-meta.GI.0019.1kQiIwh82.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 22:46: 0/2 done
## 
## date: /tmp/clg-authorship.tasks/mytasks.fold.1.strategy-as-meta.univ.0048.pYjvuG9g1.running: No such file or directory
## /home/moreaue/projects/erw-bash-commons/bin/task-distrib-daemon.sh: line 125: 1645829236 -  : syntax error: operand expected (error token is "-  ")
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 22:47: 0/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.runs.0001.0004.AzZiOZPgR.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.runs.0001.0007.9m24VigF5.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.runs.0001.0006.nGD53t8Vc.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.runs.0001.0044.LqF1VI3Rc.running' does not exist
## date: /tmp/clg-authorship.tasks/mytasks.fold.2.meta.runs.0001.0046.qIzxWLXKU.running: No such file or directory
## /home/moreaue/projects/erw-bash-commons/bin/task-distrib-daemon.sh: line 125: 1645829304 -  : syntax error: operand expected (error token is "-  ")
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 22:48: 0/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.strategy-as-meta.basic.0048.IxEZYCUF5.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.strategy-as-meta.GI.0038.jM75XUuWj.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 22:49: 0/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.strategy-as-meta.univ.0028.TNP9g3OyZ.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 22:50: 0/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.runs.0002.0027.nTInT06du.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 22:51: 0/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.strategy-as-meta.basic.0028.rFi98sNkS.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.strategy-as-meta.GI.0018.GWYRHkNkc.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 22:52: 0/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.strategy-as-meta.univ.0008.ND3N8WzkJ.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.strategy-as-meta.univ.0048.UGBfkfN3z.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 22:53: 0/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.runs.0003.0007.b2uxYh468.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.runs.0003.0006.kdoVKts8N.running' does not exist
## date: /tmp/clg-authorship.tasks/mytasks.fold.1.strategy-as-meta.basic.0010.cVIYALIIn.running: No such file or directory
## /home/moreaue/projects/erw-bash-commons/bin/task-distrib-daemon.sh: line 125: 1645829674 -  : syntax error: operand expected (error token is "-  ")
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.meta.runs.0003.0047.UQzZoAQ1w.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 22:54: 0/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.strategy-as-meta.basic.0048.8zYFyDXkt.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.strategy-as-meta.GI.0038.mSrhln4kc.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 22:55: 0/2 done
## 
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 22:56: 0/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.0019.YDY945vHn.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 22:57: 0/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.strategy-as-meta.basic.0038.cDYU4mRT2.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 22:58: 0/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.strategy-as-meta.univ.0018.rI3Wk0M99.running' does not exist
## date: /tmp/clg-authorship.tasks/mytasks.fold.1.0008.njlxHFKCR.running: No such file or directory
## /home/moreaue/projects/erw-bash-commons/bin/task-distrib-daemon.sh: line 125: 1645829977 -  : syntax error: operand expected (error token is "-  ")
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 22:59: 0/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.0017.MXju5QdtV.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.0019.nAKGuYnvB.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 23:00: 0/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.strategy-as-meta.basic.0040.ixn7gRC2N.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.strategy-as-meta.GI.0030.doi9XfvC0.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 23:01: 0/2 done
## 
## date: /tmp/clg-authorship.tasks/mytasks.fold.1.strategy-as-meta.univ.0020.tBxnZBqO9.running: No such file or directory
## /home/moreaue/projects/erw-bash-commons/bin/task-distrib-daemon.sh: line 125: 1645830111 -  : syntax error: operand expected (error token is "-  ")
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 23:02: 0/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.0018.Huwzavaun.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.strategy-as-meta.basic.0038.ILFqZu5J9.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.strategy-as-meta.basic.0040.nROF9EKvh.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 23:03: 0/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.strategy-as-meta.GI.0030.ZwmRS2SXF.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.strategy-as-meta.univ.0020.FlBL2Zh5l.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 23:04: 0/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.0008.CcD4SDF3F.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 23:05: 0/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.strategy-as-meta.basic.0028.6NxfqY6dp.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.strategy-as-meta.basic.0030.eBz57WZE5.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.strategy-as-meta.GI.0020.iVgJnZEcz.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 23:06: 0/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.strategy-as-meta.univ.0010.WOFH1Okx0.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.strategy-as-meta.univ.0050.ACVbyVRw1.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 23:07: 0/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.strategy-as-meta.basic.0020.jYILSfe7u.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.strategy-as-meta.GI.0008.Oxe0PHxpZ.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.strategy-as-meta.GI.0010.iBWb5n3Z9.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 23:08: 0/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.strategy-as-meta.GI.0050.DZqINYMD2.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.strategy-as-meta.univ.0038.yGZAGZWPe.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 23:09: 0/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.strategy-as-meta.basic.0010.hX8TQ4aV7.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 23:10: 0/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.strategy-as-meta.basic.0050.gjBF3zliU.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.strategy-as-meta.GI.0040.eUKABRLVV.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 23:11: 0/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.strategy-as-meta.univ.0030.xXnZ5TtEV.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.0020.GQaS6ev8m.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 23:12: 0/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.strategy-as-meta.basic.0040.vFSm5To9L.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.strategy-as-meta.GI.0030.DcNIGQ1BM.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 23:13: 0/2 done
## 
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 23:14: 0/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.0008.GTOSOjIgL.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.0010.oDI6HMtmu.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.strategy-as-meta.basic.0030.xFLhhCH3j.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 23:15: 0/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.1.strategy-as-meta.GI.0020.7pSyBRceR.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 23:16: 0/2 done
## 
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 23:17: 1/2 done
## 
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 23:18: 1/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.strategy-as-meta.GI.0050.B1tkjSOvK.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.strategy-as-meta.univ.0040.EX7k0egYd.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 23:19: 1/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.0020.sVsh5AxB5.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 23:20: 1/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.strategy-as-meta.GI.0030.WfuG5MLI0.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 23:21: 1/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.0010.4dVcLE7fU.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.0020.xhskry1fV.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 23:22: 1/2 done
## 
## date: /tmp/clg-authorship.tasks/mytasks.fold.2.strategy-as-meta.basic.0039.Nv4ATjDZi.running: No such file or directory
## /home/moreaue/projects/erw-bash-commons/bin/task-distrib-daemon.sh: line 125: 1645831392 -  : syntax error: operand expected (error token is "-  ")
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 23:23: 1/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.strategy-as-meta.univ.0020.pI1iFbi6g.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 23:24: 1/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.0020.6yeV1vQth.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 23:25: 1/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.strategy-as-meta.basic.0039.sX1vtXmEu.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.strategy-as-meta.GI.0029.zWiMHxpte.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 23:26: 1/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.strategy-as-meta.univ.0019.0C5IZYtDs.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 23:27: 1/2 done
## 
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 23:28: 1/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.strategy-as-meta.basic.0039.PN71mdWcH.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.strategy-as-meta.GI.0029.M3JxPmPZk.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 23:29: 1/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.strategy-as-meta.univ.0019.XCMFGxFAH.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 23:30: 1/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.strategy-as-meta.basic.0039.jh76zkpKK.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 23:31: 1/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.strategy-as-meta.GI.0029.pQi3nOZMO.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.strategy-as-meta.GI.0030.j1MJF3umH.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.strategy-as-meta.univ.0019.xKknlVmT4.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 23:32: 1/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.0010.N3hmeY6zE.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 23:33: 1/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.0020.4NMUJTxBZ.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.strategy-as-meta.basic.0039.pEM1QQfH7.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 23:34: 1/2 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.strategy-as-meta.GI.0030.u6sRRXiiI.running' does not exist
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.strategy-as-meta.univ.0019.q4pMEdkTa.running' does not exist
## train-top-level.sh: main process in progress for '/tmp/user-guide-part2.output/full'... (parallelPrefix='/tmp/clg-authorship.tasks/mytasks') 2022-02-25 23:35: 1/2 done
## 
## date: /tmp/clg-authorship.tasks/mytasks.fold.2.0009.UwpPw6211.running: No such file or directory
## /home/moreaue/projects/erw-bash-commons/bin/task-distrib-daemon.sh: line 125: 1645832165 -  : syntax error: operand expected (error token is "-  ")
## train-top-level.sh: extracting configs and models from both folds (and renaming)
## train-top-level.sh: last stage: bagging for all data and all best models.
## apply-bagging.sh: nbRuns=10
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/full/selected-meta-prefixes.list' to '/tmp/user-guide-part2.output/full/final-bagging/0001/random.cases'; writing results to '/tmp/user-guide-part2.output/full/final-bagging/0001'.
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/full/selected-meta-prefixes.list' to '/tmp/user-guide-part2.output/full/final-bagging/0001/random.cases'; writing results to '/tmp/user-guide-part2.output/full/final-bagging/0001'. 2022-02-25 23:36: 0/20 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/full/selected-meta-prefixes.list' to '/tmp/user-guide-part2.output/full/final-bagging/0001/random.cases'; writing results to '/tmp/user-guide-part2.output/full/final-bagging/0001'. 2022-02-25 23:36: 0/20 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/full/selected-meta-prefixes.list' to '/tmp/user-guide-part2.output/full/final-bagging/0001/random.cases'; writing results to '/tmp/user-guide-part2.output/full/final-bagging/0001'. 2022-02-25 23:36: 0/20 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/full/selected-meta-prefixes.list' to '/tmp/user-guide-part2.output/full/final-bagging/0001/random.cases'; writing results to '/tmp/user-guide-part2.output/full/final-bagging/0001'. 2022-02-25 23:37: 0/20 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/full/selected-meta-prefixes.list' to '/tmp/user-guide-part2.output/full/final-bagging/0001/random.cases'; writing results to '/tmp/user-guide-part2.output/full/final-bagging/0001'. 2022-02-25 23:37: 0/20 done
## 
## apply-multi-configs.sh: done.
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/full/selected-meta-prefixes.list' to '/tmp/user-guide-part2.output/full/final-bagging/0002/random.cases'; writing results to '/tmp/user-guide-part2.output/full/final-bagging/0002'.
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/full/selected-meta-prefixes.list' to '/tmp/user-guide-part2.output/full/final-bagging/0002/random.cases'; writing results to '/tmp/user-guide-part2.output/full/final-bagging/0002'. 2022-02-25 23:37: 0/20 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/full/selected-meta-prefixes.list' to '/tmp/user-guide-part2.output/full/final-bagging/0002/random.cases'; writing results to '/tmp/user-guide-part2.output/full/final-bagging/0002'. 2022-02-25 23:37: 0/20 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/full/selected-meta-prefixes.list' to '/tmp/user-guide-part2.output/full/final-bagging/0002/random.cases'; writing results to '/tmp/user-guide-part2.output/full/final-bagging/0002'. 2022-02-25 23:37: 0/20 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/full/selected-meta-prefixes.list' to '/tmp/user-guide-part2.output/full/final-bagging/0002/random.cases'; writing results to '/tmp/user-guide-part2.output/full/final-bagging/0002'. 2022-02-25 23:37: 0/20 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/full/selected-meta-prefixes.list' to '/tmp/user-guide-part2.output/full/final-bagging/0002/random.cases'; writing results to '/tmp/user-guide-part2.output/full/final-bagging/0002'. 2022-02-25 23:37: 0/20 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/full/selected-meta-prefixes.list' to '/tmp/user-guide-part2.output/full/final-bagging/0002/random.cases'; writing results to '/tmp/user-guide-part2.output/full/final-bagging/0002'. 2022-02-25 23:37: 0/20 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/full/selected-meta-prefixes.list' to '/tmp/user-guide-part2.output/full/final-bagging/0002/random.cases'; writing results to '/tmp/user-guide-part2.output/full/final-bagging/0002'. 2022-02-25 23:37: 15/20 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.0015.6QxMBc76a.running' does not exist
## apply-multi-configs.sh: done.
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/full/selected-meta-prefixes.list' to '/tmp/user-guide-part2.output/full/final-bagging/0003/random.cases'; writing results to '/tmp/user-guide-part2.output/full/final-bagging/0003'.
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/full/selected-meta-prefixes.list' to '/tmp/user-guide-part2.output/full/final-bagging/0003/random.cases'; writing results to '/tmp/user-guide-part2.output/full/final-bagging/0003'. 2022-02-25 23:37: 0/20 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/full/selected-meta-prefixes.list' to '/tmp/user-guide-part2.output/full/final-bagging/0003/random.cases'; writing results to '/tmp/user-guide-part2.output/full/final-bagging/0003'. 2022-02-25 23:37: 0/20 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/full/selected-meta-prefixes.list' to '/tmp/user-guide-part2.output/full/final-bagging/0003/random.cases'; writing results to '/tmp/user-guide-part2.output/full/final-bagging/0003'. 2022-02-25 23:37: 0/20 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/full/selected-meta-prefixes.list' to '/tmp/user-guide-part2.output/full/final-bagging/0003/random.cases'; writing results to '/tmp/user-guide-part2.output/full/final-bagging/0003'. 2022-02-25 23:38: 0/20 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/full/selected-meta-prefixes.list' to '/tmp/user-guide-part2.output/full/final-bagging/0003/random.cases'; writing results to '/tmp/user-guide-part2.output/full/final-bagging/0003'. 2022-02-25 23:38: 0/20 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/full/selected-meta-prefixes.list' to '/tmp/user-guide-part2.output/full/final-bagging/0003/random.cases'; writing results to '/tmp/user-guide-part2.output/full/final-bagging/0003'. 2022-02-25 23:38: 0/20 done
## 
## apply-multi-configs.sh: done.
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/full/selected-meta-prefixes.list' to '/tmp/user-guide-part2.output/full/final-bagging/0004/random.cases'; writing results to '/tmp/user-guide-part2.output/full/final-bagging/0004'.
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/full/selected-meta-prefixes.list' to '/tmp/user-guide-part2.output/full/final-bagging/0004/random.cases'; writing results to '/tmp/user-guide-part2.output/full/final-bagging/0004'. 2022-02-25 23:38: 0/20 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/full/selected-meta-prefixes.list' to '/tmp/user-guide-part2.output/full/final-bagging/0004/random.cases'; writing results to '/tmp/user-guide-part2.output/full/final-bagging/0004'. 2022-02-25 23:38: 0/20 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/full/selected-meta-prefixes.list' to '/tmp/user-guide-part2.output/full/final-bagging/0004/random.cases'; writing results to '/tmp/user-guide-part2.output/full/final-bagging/0004'. 2022-02-25 23:38: 0/20 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/full/selected-meta-prefixes.list' to '/tmp/user-guide-part2.output/full/final-bagging/0004/random.cases'; writing results to '/tmp/user-guide-part2.output/full/final-bagging/0004'. 2022-02-25 23:38: 0/20 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/full/selected-meta-prefixes.list' to '/tmp/user-guide-part2.output/full/final-bagging/0004/random.cases'; writing results to '/tmp/user-guide-part2.output/full/final-bagging/0004'. 2022-02-25 23:38: 0/20 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/full/selected-meta-prefixes.list' to '/tmp/user-guide-part2.output/full/final-bagging/0004/random.cases'; writing results to '/tmp/user-guide-part2.output/full/final-bagging/0004'. 2022-02-25 23:38: 0/20 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.0015.yxwAW0aIw.running' does not exist
## apply-multi-configs.sh: done.
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/full/selected-meta-prefixes.list' to '/tmp/user-guide-part2.output/full/final-bagging/0005/random.cases'; writing results to '/tmp/user-guide-part2.output/full/final-bagging/0005'.
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/full/selected-meta-prefixes.list' to '/tmp/user-guide-part2.output/full/final-bagging/0005/random.cases'; writing results to '/tmp/user-guide-part2.output/full/final-bagging/0005'. 2022-02-25 23:38: 0/20 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/full/selected-meta-prefixes.list' to '/tmp/user-guide-part2.output/full/final-bagging/0005/random.cases'; writing results to '/tmp/user-guide-part2.output/full/final-bagging/0005'. 2022-02-25 23:38: 0/20 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/full/selected-meta-prefixes.list' to '/tmp/user-guide-part2.output/full/final-bagging/0005/random.cases'; writing results to '/tmp/user-guide-part2.output/full/final-bagging/0005'. 2022-02-25 23:38: 0/20 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/full/selected-meta-prefixes.list' to '/tmp/user-guide-part2.output/full/final-bagging/0005/random.cases'; writing results to '/tmp/user-guide-part2.output/full/final-bagging/0005'. 2022-02-25 23:39: 0/20 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/full/selected-meta-prefixes.list' to '/tmp/user-guide-part2.output/full/final-bagging/0005/random.cases'; writing results to '/tmp/user-guide-part2.output/full/final-bagging/0005'. 2022-02-25 23:39: 0/20 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/full/selected-meta-prefixes.list' to '/tmp/user-guide-part2.output/full/final-bagging/0005/random.cases'; writing results to '/tmp/user-guide-part2.output/full/final-bagging/0005'. 2022-02-25 23:39: 0/20 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/full/selected-meta-prefixes.list' to '/tmp/user-guide-part2.output/full/final-bagging/0005/random.cases'; writing results to '/tmp/user-guide-part2.output/full/final-bagging/0005'. 2022-02-25 23:39: 0/20 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.0015.iY47en7mw.running' does not exist
## apply-multi-configs.sh: done.
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/full/selected-meta-prefixes.list' to '/tmp/user-guide-part2.output/full/final-bagging/0006/random.cases'; writing results to '/tmp/user-guide-part2.output/full/final-bagging/0006'.
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/full/selected-meta-prefixes.list' to '/tmp/user-guide-part2.output/full/final-bagging/0006/random.cases'; writing results to '/tmp/user-guide-part2.output/full/final-bagging/0006'. 2022-02-25 23:39: 0/20 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/full/selected-meta-prefixes.list' to '/tmp/user-guide-part2.output/full/final-bagging/0006/random.cases'; writing results to '/tmp/user-guide-part2.output/full/final-bagging/0006'. 2022-02-25 23:39: 0/20 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/full/selected-meta-prefixes.list' to '/tmp/user-guide-part2.output/full/final-bagging/0006/random.cases'; writing results to '/tmp/user-guide-part2.output/full/final-bagging/0006'. 2022-02-25 23:39: 0/20 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/full/selected-meta-prefixes.list' to '/tmp/user-guide-part2.output/full/final-bagging/0006/random.cases'; writing results to '/tmp/user-guide-part2.output/full/final-bagging/0006'. 2022-02-25 23:39: 0/20 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/full/selected-meta-prefixes.list' to '/tmp/user-guide-part2.output/full/final-bagging/0006/random.cases'; writing results to '/tmp/user-guide-part2.output/full/final-bagging/0006'. 2022-02-25 23:39: 0/20 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/full/selected-meta-prefixes.list' to '/tmp/user-guide-part2.output/full/final-bagging/0006/random.cases'; writing results to '/tmp/user-guide-part2.output/full/final-bagging/0006'. 2022-02-25 23:39: 0/20 done
## 
## apply-multi-configs.sh: done.
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/full/selected-meta-prefixes.list' to '/tmp/user-guide-part2.output/full/final-bagging/0007/random.cases'; writing results to '/tmp/user-guide-part2.output/full/final-bagging/0007'.
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/full/selected-meta-prefixes.list' to '/tmp/user-guide-part2.output/full/final-bagging/0007/random.cases'; writing results to '/tmp/user-guide-part2.output/full/final-bagging/0007'. 2022-02-25 23:39: 0/20 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/full/selected-meta-prefixes.list' to '/tmp/user-guide-part2.output/full/final-bagging/0007/random.cases'; writing results to '/tmp/user-guide-part2.output/full/final-bagging/0007'. 2022-02-25 23:39: 0/20 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/full/selected-meta-prefixes.list' to '/tmp/user-guide-part2.output/full/final-bagging/0007/random.cases'; writing results to '/tmp/user-guide-part2.output/full/final-bagging/0007'. 2022-02-25 23:40: 0/20 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/full/selected-meta-prefixes.list' to '/tmp/user-guide-part2.output/full/final-bagging/0007/random.cases'; writing results to '/tmp/user-guide-part2.output/full/final-bagging/0007'. 2022-02-25 23:40: 0/20 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/full/selected-meta-prefixes.list' to '/tmp/user-guide-part2.output/full/final-bagging/0007/random.cases'; writing results to '/tmp/user-guide-part2.output/full/final-bagging/0007'. 2022-02-25 23:40: 0/20 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/full/selected-meta-prefixes.list' to '/tmp/user-guide-part2.output/full/final-bagging/0007/random.cases'; writing results to '/tmp/user-guide-part2.output/full/final-bagging/0007'. 2022-02-25 23:40: 0/20 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/full/selected-meta-prefixes.list' to '/tmp/user-guide-part2.output/full/final-bagging/0007/random.cases'; writing results to '/tmp/user-guide-part2.output/full/final-bagging/0007'. 2022-02-25 23:40: 6/20 done
## 
## apply-multi-configs.sh: done.
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/full/selected-meta-prefixes.list' to '/tmp/user-guide-part2.output/full/final-bagging/0008/random.cases'; writing results to '/tmp/user-guide-part2.output/full/final-bagging/0008'.
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/full/selected-meta-prefixes.list' to '/tmp/user-guide-part2.output/full/final-bagging/0008/random.cases'; writing results to '/tmp/user-guide-part2.output/full/final-bagging/0008'. 2022-02-25 23:40: 0/20 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/full/selected-meta-prefixes.list' to '/tmp/user-guide-part2.output/full/final-bagging/0008/random.cases'; writing results to '/tmp/user-guide-part2.output/full/final-bagging/0008'. 2022-02-25 23:40: 0/20 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/full/selected-meta-prefixes.list' to '/tmp/user-guide-part2.output/full/final-bagging/0008/random.cases'; writing results to '/tmp/user-guide-part2.output/full/final-bagging/0008'. 2022-02-25 23:40: 0/20 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/full/selected-meta-prefixes.list' to '/tmp/user-guide-part2.output/full/final-bagging/0008/random.cases'; writing results to '/tmp/user-guide-part2.output/full/final-bagging/0008'. 2022-02-25 23:40: 0/20 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/full/selected-meta-prefixes.list' to '/tmp/user-guide-part2.output/full/final-bagging/0008/random.cases'; writing results to '/tmp/user-guide-part2.output/full/final-bagging/0008'. 2022-02-25 23:40: 0/20 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/full/selected-meta-prefixes.list' to '/tmp/user-guide-part2.output/full/final-bagging/0008/random.cases'; writing results to '/tmp/user-guide-part2.output/full/final-bagging/0008'. 2022-02-25 23:40: 0/20 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.0015.O6EJnbq8Y.running' does not exist
## apply-multi-configs.sh: done.
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/full/selected-meta-prefixes.list' to '/tmp/user-guide-part2.output/full/final-bagging/0009/random.cases'; writing results to '/tmp/user-guide-part2.output/full/final-bagging/0009'.
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/full/selected-meta-prefixes.list' to '/tmp/user-guide-part2.output/full/final-bagging/0009/random.cases'; writing results to '/tmp/user-guide-part2.output/full/final-bagging/0009'. 2022-02-25 23:40: 0/20 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/full/selected-meta-prefixes.list' to '/tmp/user-guide-part2.output/full/final-bagging/0009/random.cases'; writing results to '/tmp/user-guide-part2.output/full/final-bagging/0009'. 2022-02-25 23:41: 0/20 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/full/selected-meta-prefixes.list' to '/tmp/user-guide-part2.output/full/final-bagging/0009/random.cases'; writing results to '/tmp/user-guide-part2.output/full/final-bagging/0009'. 2022-02-25 23:41: 0/20 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/full/selected-meta-prefixes.list' to '/tmp/user-guide-part2.output/full/final-bagging/0009/random.cases'; writing results to '/tmp/user-guide-part2.output/full/final-bagging/0009'. 2022-02-25 23:41: 0/20 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/full/selected-meta-prefixes.list' to '/tmp/user-guide-part2.output/full/final-bagging/0009/random.cases'; writing results to '/tmp/user-guide-part2.output/full/final-bagging/0009'. 2022-02-25 23:41: 0/20 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/full/selected-meta-prefixes.list' to '/tmp/user-guide-part2.output/full/final-bagging/0009/random.cases'; writing results to '/tmp/user-guide-part2.output/full/final-bagging/0009'. 2022-02-25 23:41: 0/20 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/full/selected-meta-prefixes.list' to '/tmp/user-guide-part2.output/full/final-bagging/0009/random.cases'; writing results to '/tmp/user-guide-part2.output/full/final-bagging/0009'. 2022-02-25 23:41: 15/20 done
## 
## Error: '/tmp/clg-authorship.tasks/mytasks.fold.2.0015.3XQ1bTM2b.running' does not exist
## apply-multi-configs.sh: done.
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/full/selected-meta-prefixes.list' to '/tmp/user-guide-part2.output/full/final-bagging/0010/random.cases'; writing results to '/tmp/user-guide-part2.output/full/final-bagging/0010'.
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/full/selected-meta-prefixes.list' to '/tmp/user-guide-part2.output/full/final-bagging/0010/random.cases'; writing results to '/tmp/user-guide-part2.output/full/final-bagging/0010'. 2022-02-25 23:41: 0/20 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/full/selected-meta-prefixes.list' to '/tmp/user-guide-part2.output/full/final-bagging/0010/random.cases'; writing results to '/tmp/user-guide-part2.output/full/final-bagging/0010'. 2022-02-25 23:41: 0/20 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/full/selected-meta-prefixes.list' to '/tmp/user-guide-part2.output/full/final-bagging/0010/random.cases'; writing results to '/tmp/user-guide-part2.output/full/final-bagging/0010'. 2022-02-25 23:41: 0/20 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/full/selected-meta-prefixes.list' to '/tmp/user-guide-part2.output/full/final-bagging/0010/random.cases'; writing results to '/tmp/user-guide-part2.output/full/final-bagging/0010'. 2022-02-25 23:41: 0/20 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/full/selected-meta-prefixes.list' to '/tmp/user-guide-part2.output/full/final-bagging/0010/random.cases'; writing results to '/tmp/user-guide-part2.output/full/final-bagging/0010'. 2022-02-25 23:41: 0/20 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/full/selected-meta-prefixes.list' to '/tmp/user-guide-part2.output/full/final-bagging/0010/random.cases'; writing results to '/tmp/user-guide-part2.output/full/final-bagging/0010'. 2022-02-25 23:41: 0/20 done
## 
## apply-multi-configs.sh: done.
## apply-bagging.sh: main loop done, extracting stats
## train-top-level.sh: best meta-config found below, see '/tmp/user-guide-part2.output/full/best.results' for more details
## /tmp/user-guide-part2.output/full/selected-meta-configs/fold.1.strategy-as-meta.univ.0006    0.3687431   0.4035072   0.38612515
## train-top-level.sh: done.

Extracting the best model

At the end of the training process, the identifiers for the top N models/configurations (N=100 with the default parameters) found by the training process are written to the file best.results in the output directory. The models are ordered by decreasing performance on the validation set (meta test set; this depends on the parameters), thus showing the top model on the first line.

• The three performance values available for every model in best.results are:
  • performance on the validation set (meta test set)
  • performance on the full training set
  • average of the two above values
• Additional performance statistics are available for the top models in bagging-meta-test-fold-all.stats, which contains four values for every model:
  • mean
  • median
  • standard deviation
  • mean minus std. dev.

head "$OUTPUT_DIR/full/best.results" 

## /tmp/user-guide-part2.output/full/selected-meta-configs/fold.1.strategy-as-meta.univ.0006    0.3687431   0.4035072   0.38612515
## /tmp/user-guide-part2.output/full/selected-meta-configs/fold.2.strategy-as-meta.GI.0002  0.3442276   0.5392263   0.44172695
## /tmp/user-guide-part2.output/full/selected-meta-configs/fold.1.strategy-as-meta.univ.0005    0.3326474   0.3705721   0.35160975
## /tmp/user-guide-part2.output/full/selected-meta-configs/fold.1.strategy-as-meta.univ.0011    0.3240604   0.4247288   0.3743946
## /tmp/user-guide-part2.output/full/selected-meta-configs/fold.1.strategy-as-meta.univ.0014    0.3219252   0.459089    0.3905071
## /tmp/user-guide-part2.output/full/selected-meta-configs/fold.2.strategy-as-meta.GI.0009  0.3086064   0.6741169   0.49136165
## /tmp/user-guide-part2.output/full/selected-meta-configs/fold.2.0012  0.2972733   0.4756946   0.38648395
## /tmp/user-guide-part2.output/full/selected-meta-configs/fold.2.0014  0.2956459   0.4752845   0.3854652
## /tmp/user-guide-part2.output/full/selected-meta-configs/fold.2.0017  0.2956268   0.4752845   0.38545565
## /tmp/user-guide-part2.output/full/selected-meta-configs/fold.2.0015  0.2953785   0.4752845   0.3853315

The actual models corresponding to these identifiers are stored in the subdirectory selected-meta-configs/. The id contained in best.results actually corresponds to the full pathname prefix, so that:

• <prefix>.conf is the configuration file for the model
• <prefix>.model is the directory containing the model.

If provided with such a patname prefix, the system can apply the corresponding model. Of course the path needs to exist and contain the model.

Testing with fresh instances

Preparing the test instances

When testing with fresh instances, the corresponding documents must have been “prepared” (their observation files computed, etc.) before applying the model per se. Of course this is not necessary if the documents in the test set have been prepared previously, together with the training documents (see above).

We use the test set generated for the main experiments (see Experiment 1: size of documents). Here we just copy the test files:

mkdir "$OUTPUT_DIR"/test-data.full
cat "$EXPE_WORK_DIR/test.tsv" > "$OUTPUT_DIR/test-data.full/truth.txt"
cat "$EXPE_WORK_DIR/test.tsv" | cut -f 1 | tr ' :' '\n\n'  | sort -u | while read f; do
      cp "$OUTPUT_DIR/data/$f" "$OUTPUT_DIR/test-data.full/"
done

Then we call the script prepare-input-data.sh on the directory containing the test documents:

source session-setup.sh
ls $OUTPUT_DIR/full/multi-conf-files/*multi-conf | prepare-input-data.sh -l english -r $OUTPUT_DIR/full/resources "$OUTPUT_DIR/test-data.full" "$OUTPUT_DIR/full.test"

## prepare-input-data.sh: language is 'english'
## prepare-input-data.sh init: copying input data
## prepare-input-data.sh: input data, generating count files for all obs types
## count-obs-dataset.sh: tokenization and POS tagging
## count-obs-dataset.sh: generating count files
## prepare-input-data.sh: input data, preparing impostors data
## prepare-input-data.sh, impostors dataset 'my.impostors': computing pre-similarity values against all probe files
## prepare-input-data.sh: writing resources options file
## prepare-input-data.sh: done.

• It’s important to use the same impostors documents and list of stop words as for the training set. This is why the -r option allows to provide an exsting “resources” directory.
• Note: it’s also possible to add the documents to the directory used for training.

Applying the model to the test instances

Below the best model found by the training stage is extracted, then the id (path prefix) is passed to the script test-meta-model.sh:

source session-setup.sh
bestModel=$(head -n 1 "$OUTPUT_DIR/full/best.results" | cut -f 1)
echo "Model id: $bestModel"
task-distrib-daemon.sh  -s 30s -p 1 -v -q 4 "$TASKS_DIR" $NCORES >"$OUTPUT_DIR/test.task-daemon.log" &
test-meta-model.sh -p  -P "$TASKS_DIR/mytasks" "$bestModel" "$EXPE_WORK_DIR/test.tsv" "$OUTPUT_DIR/full.test" "$OUTPUT_DIR/full.test.results" 

## Model id: /tmp/user-guide-part2.output/full/selected-meta-configs/fold.1.strategy-as-meta.univ.0006
## apply-multi-configs.sh: calling self to apply strategy configs/models '/tmp/user-guide-part2.output/full.test.results/indiv-strategies.prefix-list' first.
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/full.test.results/indiv-strategies.prefix-list' to 'experiments/1-doc-size/test.tsv'; writing results to '/tmp/user-guide-part2.output/full.test.results/apply-strategy-configs'.
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/full.test.results/indiv-strategies.prefix-list' to 'experiments/1-doc-size/test.tsv'; writing results to '/tmp/user-guide-part2.output/full.test.results/apply-strategy-configs'. 2022-02-25 23:48: 0/1 done
## 
## apply-multi-configs.sh: done.
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/full.test.results/meta-config.prefix-list' to 'experiments/1-doc-size/test.tsv'; writing results to '/tmp/user-guide-part2.output/full.test.results'.
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/full.test.results/meta-config.prefix-list' to 'experiments/1-doc-size/test.tsv'; writing results to '/tmp/user-guide-part2.output/full.test.results'. 2022-02-25 23:49: 0/1 done
## 
## apply-multi-configs.sh: applying configs/models '/tmp/user-guide-part2.output/full.test.results/meta-config.prefix-list' to 'experiments/1-doc-size/test.tsv'; writing results to '/tmp/user-guide-part2.output/full.test.results'. 2022-02-25 23:49: 0/1 done
## 
## apply-multi-configs.sh: done.
## test-meta-model.sh: done.

• The -p option requires computing performance. The script can also be used to only predict the answers for unlabelled cases.

• The output directory contains:

  • a file $bestModel.answers with the predicted probability for every case in the test set
  • a file $bestModel.perf with the test set performance if -p was used.

Performance on the test set:

cat "$OUTPUT_DIR/full.test.results"/*.perf

## 0.197460 0.438800    0.450000