Module `preprocessor.azure_utils`

Functions

def get_file_from_azure(record) -> azure.storage.filedatalake._download.StorageStreamDownloader

Retrieves a file from Azure Data Lake Storage and returns a StorageStreamDownloader object.

record: MetaRecordAzureDataLakeStorage object containing the information needed to retrieve the file.

Returns: StorageStreamDownloader object containing the file.

Raises: Exception if the file is not a supported type or if there is an error when trying to download the file.

class UnsupportedFiletype (*args, **kwargs)

Raised when an unsupported filetype is encountered in Azure.