Starts (or restarts if previously stopped) processing the remaining files
specified by batch_config()
.
batch_run(
path,
failed = FALSE,
progress = FALSE,
files = NULL,
seeds = NULL,
options = furrr::furrr_options(),
ask = getOption("batchr.ask", TRUE)
)
A string of the path to the directory with the files for processing.
A logical scalar specifying how to treat files that previously failed to process. If FALSE (the default) failed files are excluded, if NA they are included and if TRUE they are only included.
A flag specifying whether to print a progress bar.
A character vector of the remaining files to process.
If NULL
then files
is batch_files_remaining(path, failed)
.
A named list of the L'Ecuyer-CMRG seed to use for each
file. If NULL
then seeds
is batch_seeds(files)
.
The future specific options to use with the workers.
seed must be FALSE
.
A flag specifying whether to ask before starting to process the files.
An invisible named logical vector indicating for each file whether it was successfully processed.
batch_run()
logs all file processing attempts together with the
the type (SUCCESS or FAILURE), the
system time in UTC, the file name and any error messages.
The hidden log file can be read using batch_log_read()
.
batch_files_remaining()
provides a vector of the files that
are remaining to be processed.
When processing is complete the hidden configuration file
and hidden log file can be deleted using batch_cleanup()
.
If a remaining file is removed or modified by a separate process,
batch_run()
throws an error.
path <- tempdir()
write.csv(mtcars, file.path(path, "file1.csv"))
batch_config(function(x) TRUE, path, regexp = "[.]csv$")
batch_run(path, ask = FALSE)
batch_cleanup(path)
unlink(file.path(path, "file1.csv"))