Passing a List[FlyteFile] to a raw ContainerTask

[djbutler]

Is it possible to pass a list of FlyteFiles to a raw ContainerTask?

For example:

concat_files = ContainerTask(
    name="concat-files",
    input_data_dir="/var/inputs",
    output_data_dir="/var/outputs",
    inputs=kwtypes(infiles=List[FlyteFile])
    outputs=kwtypes(outfile=FlyteFile),
    image="alpine",
    command=[
        "cat",
        "{{.inputs.infiles[0]}}",
        "/var/outputs/outfile",
    ],
)

This doesn't seem to work for me. If this is possible at all, I'm guessing this syntax is incorrect: {{.inputs.infiles[0]}}

Any tips?

[Future-Outlier]

Hi, @djbutler .
I think the answer will be "{{.inputs.infiles.0}}"
and the command should be

command=[
        "cat",
        ">",
        "{{.inputs.infiles.0}}",
        "/var/outputs/outfile",
    ],

[Future-Outlier]

Here are the references, thank you!
https://github.com/flyteorg/flyte/blob/master/flytecopilot/data/download.go#L251-L267

[Future-Outlier]

Wait, I think currently raw container task doesn't support collection, I will create an issue for it.

[Future-Outlier]

The implementation has bug.

[Future-Outlier]

I think the dictionary might has bug too.

[Future-Outlier]

I think its not possible to use template syntax to do it, but flyte directory is almost done, thank you.

[Future-Outlier]

flytedirectory is supported as input and output now!