spark_auto_mapper.data_types.lpad

Module Contents

Classes

AutoMapperLPadDataType

Returns column value, left-padded with pad to a length of length. If column value is longer than length,
class spark_auto_mapper.data_types.lpad.AutoMapperLPadDataType(column, length, pad)

Bases: spark_auto_mapper.data_types.text_like_base.AutoMapperTextLikeBase

Returns column value, left-padded with pad to a length of length. If column value is longer than length, the return value is shortened to length characters.

Parameters

  • column (spark_auto_mapper.type_definitions.wrapper_types.AutoMapperColumnOrColumnLikeType) –

  • length (int) –

  • pad (str) –

get_column_spec(self, source_df, current_column)

Gets the column spec for this automapper data type

Parameters

  • source_df (Optional[pyspark.sql.DataFrame]) – source data frame in case the automapper type needs that data to decide what to do

  • current_column (Optional[pyspark.sql.Column]) – (Optional) this is set when we are inside an array

Return type

pyspark.sql.Column