Skip to content

Move keys creation to cube preprocessing #491

@SanderDevisscher

Description

@SanderDevisscher

Currently keys.csv is created by ./src/upload_processing_to_UAT.R

createKeyData(dataDir = processingFilePath, bucket = bucket)

While this creates a window1 in which the cube was updated and but the keys.csv file is not, in which issues can occur caused by mismatches between the cube and the keys - file. This might be related to inbo/alien-species-portal#192.

Both the cube and the timeseries are uploaded directly in the script, see:

alienSpecies::createTabularData(dataDir = cube_path, type = "occurrence", bucket = UAT_bucket)

&
aws.s3::s3save(df_ts,
object = "df_timeseries.Rdata",
bucket = UAT_bucket,
opts = list(show_progress = TRUE,
multipart = TRUE))

&
alienSpecies::createTimeseries(
# read grid.RData from bucket
shapeData = alienSpecies::loadShapeData("grid.RData")$utm1_bel_with_regions,
bucket = UAT_bucket
)

1time to approved the PR + approx. 1h 10m to run upload_files_processing

Metadata

Metadata

Projects

No projects

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions