spark_auto_mapper.data_types.if_not_null_or_empty

Module Contents

Classes

AutoMapperIfNotNullOrEmptyDataType

If check returns null then return null else return value

class spark_auto_mapper.data_types.if_not_null_or_empty.AutoMapperIfNotNullOrEmptyDataType(check, value, when_null_or_empty=None)

Bases: spark_auto_mapper.data_types.data_type_base.AutoMapperDataTypeBase, Generic[_TAutoMapperDataType]

If check returns null then return null else return value

Parameters
  • check (spark_auto_mapper.type_definitions.wrapper_types.AutoMapperColumnOrColumnLikeType) –

  • value (_TAutoMapperDataType) –

  • when_null_or_empty (Optional[_TAutoMapperDataType]) –

include_null_properties(self, include_null_properties)
Parameters

include_null_properties (bool) –

Return type

None

get_column_spec(self, source_df, current_column)

Gets the column spec for this automapper data type

Parameters
  • source_df (Optional[pyspark.sql.DataFrame]) – source data frame in case the automapper type needs that data to decide what to do

  • current_column (Optional[pyspark.sql.Column]) – (Optional) this is set when we are inside an array

Return type

pyspark.sql.Column