How to apply fill only when the col is missing

[hantsy]

How to apply the fill to the condition that the fields is missing the csv but defind in the DataSchema.

df.convertTo<MyData>{
     fill{col("NewCol")}.with{"default"}
}

Currently, I faced the situation like this, we updated the Data Schema and add some new columns.

Some users use the new schema fields in the CSV file, and other not update and still used the old schema which lacked the new col here.

The fill is good to apply the default to old format CSV if they do not provide the new col. But the fill will override the value in the new format CSV file.

Is possible to only apply the fill to the old format here, and in the new format, use the vlaue in CSV directly.

[Jolanrensen]

Good question! This is indeed something missing in the API. It looks like we need a fillWhenMissing {} or something like that.

In the meantime, a workaround could be:

df.convertTo<MyData> {
    if (!df.containsColumn("NewCol")) fill { "NewCol"() }.with { "default" }
}