spark_auto_mapper.data_types.date
¶
Module Contents¶
Classes¶
Base class for all Automapper data types |
- class spark_auto_mapper.data_types.date.AutoMapperDateDataType(value, formats=None)¶
Bases:
spark_auto_mapper.data_types.data_type_base.AutoMapperDataTypeBase
Base class for all Automapper data types
Converts a value to date only For datetime use the datetime mapper type
- Parameters
value (spark_auto_mapper.type_definitions.defined_types.AutoMapperDateInputType) – value
formats (Optional[List[str]]) – (Optional) formats to use for trying to parse the value otherwise uses: y-M-d yyyyMMdd M/d/y
- get_column_spec(self, source_df, current_column)¶
Gets the column spec for this automapper data type
- Parameters
source_df (Optional[pyspark.sql.DataFrame]) – source data frame in case the automapper type needs that data to decide what to do
current_column (Optional[pyspark.sql.Column]) – (Optional) this is set when we are inside an array
- Return type
pyspark.sql.Column