snowmobile.core.cfg.loading

[loading] section from snowmobile.toml, including subsections.

Module Contents

Classes

Put	[loading.put]
Copy	[loading.copy]
Loading	[loading]

class snowmobile.core.cfg.loading.Put

Bases: snowmobile.core.cfg.base.Base

[loading.put]

auto_compress :bool

class snowmobile.core.cfg.loading.Copy

Bases: snowmobile.core.cfg.base.Base

[loading.copy]

on_error :str

class snowmobile.core.cfg.loading.Loading

Bases: snowmobile.core.cfg.base.Base

[loading]

Default settings to use when loading data

default-file-format

Name of file-format to use when loading data into the warehouse; default is snowmobile_default_csv; which will be created and dropped afterwards if an existing file format is not specified;

Type

str

include_index

Include the index of a DataFrame when loading it into a table; default is False.

Type

bool

on_error

Action to take if an error is encountered when loading data into the warehouse; default is continue.

Type

bool

keep_local

Option to keep the local file exported when loading into a staging table; default is False.

Type

bool

include_loaded_tmstmp

Include a loaded_tmstmp column when loading a DataFrame into the warehouse; default is True.

Type

bool

quote_char

Quote character to use for delimited files; default is double quotes (").

Type

str

auto_compress

Auto-compress file when loading data; default is True..

Type

bool

overwrite_pre_existing_stage

Overwrite pre-existing staging table if data is being appended into an existing table/the staging table already exists; default is True.

Type

bool

defaults :Dict

put :Put

copy_into :Copy

export_options :Dict[str, Dict]

property configured_args(self) → Dict

Placeholder for configuration arguments of derived classes.