spark_pipeline_framework.utilities.json_to_jsonl_converter¶
Module Contents¶
Functions¶
|
Converts json files to jsonl file |
|
Returns whether the file is in jsonl format |
- spark_pipeline_framework.utilities.json_to_jsonl_converter.convert_json_to_jsonl(src_file: pathlib.Path, dst_file: pathlib.Path) pathlib.Path¶
Converts json files to jsonl file :param src_file: json file :param dst_file: :return: path to jsonl file
- spark_pipeline_framework.utilities.json_to_jsonl_converter.check_if_file_is_jsonl(src_file: pathlib.Path) bool¶
Returns whether the file is in jsonl format :param src_file: :type src_file: :return: :rtype: