snowmobile.core.cfg.loading
¶
[loading] section from snowmobile.toml, including subsections.
Module Contents¶
Classes¶
[loading.put] | |
[loading.copy] | |
[loading] |
- class
snowmobile.core.cfg.loading.
Put
¶ Bases:
snowmobile.core.cfg.base.Base
[loading.put]
-
auto_compress
:bool¶
-
- class
snowmobile.core.cfg.loading.
Copy
¶ Bases:
snowmobile.core.cfg.base.Base
[loading.copy]
-
on_error
:str¶
-
- class
snowmobile.core.cfg.loading.
Loading
¶ Bases:
snowmobile.core.cfg.base.Base
[loading]
Default settings to use when loading data
-
default-file-format
Name of file-format to use when loading data into the warehouse; default is
snowmobile_default_csv
; which will be created and dropped afterwards if an existing file format is not specified;- Type
-
include_index
¶ Include the index of a DataFrame when loading it into a table; default is
False
.- Type
-
on_error
¶ Action to take if an error is encountered when loading data into the warehouse; default is
continue
.- Type
-
keep_local
¶ Option to keep the local file exported when loading into a staging table; default is
False
.- Type
-
include_loaded_tmstmp
¶ Include a loaded_tmstmp column when loading a DataFrame into the warehouse; default is
True
.- Type
-
overwrite_pre_existing_stage
¶ Overwrite pre-existing staging table if data is being appended into an existing table/the staging table already exists; default is
True
.- Type
-
defaults
:Dict¶
-
put
:Put¶
-
copy_into
:Copy¶
-
export_options
:Dict[str, Dict]¶
- property
configured_args
(self) → Dict¶ Placeholder for configuration arguments of derived classes.
-