base package

Submodules

base.conditional_path_node module

base.do_nothing_node module

base.model module

base.node module

Top level notion of a node in the graph

Author(s):: Carl Anderson (carl.anderson@weightwatchers.com)

class base.node.AbstractNode(configuration, instance_name)

Bases: ABC

_abc_impl = <_abc_data object>

abstract static necessary_config(node_config)

Return a list of necessary configuration keys within the implementation

Parameters:: node_config (dict) – set of parameters / attributes for the node

After adding this list, validation automatically occurs before instantiation in the configuration

Returns:: set of keys necessary to run implementation

abstract run(data_object)

run the node. For a reader, that means read, for a writer that means write etc.

Parameters:

data_object (DataObject) – DataObject instance

Returns:

tuple containing:

data_object (DataObject): instance of DataObject

terminate (bool): terminate the DAG?

Return type:

(tuple)

base.pipeline module

base.postprocess module

base.reader module

base.search_engine module

base.sql_reader module

base.success module

base.transformer module

Module with abstract transformer class to specify interface needed for transformers

Author(s):

Michael Skarlinski (michael.skarlinski@weightwatchers.com)

Carl Anderson (carl.anderson@weightwatchers.com)

class base.transformer.AbstractTransformer

Bases: ABC

Serializable object that can be string together within a pipeline

_abc_impl = <_abc_data object>

abstract fit(data)

User implements fit operation on a single data element from a data_object

Parameters:: data (object) – some data
Returns:: data

fit_transform(data)

fit then transform data

Parameters:: data (object) – input data
Returns:: data, transformed

abstract transform(data)

User implements internal transform function which operates on a single data element from a data_object

Parameters:: data (object) – input data
Returns:: data, transformed