cerebralcortex.core.util package

Submodules

cerebralcortex.core.util.data_formats module

msgpack_to_pandas(input_data: object) → pandas.core.frame.DataFrame

Convert msgpack binary file into pandas dataframe

Parameters:input_data (msgpack) – msgpack data file Returns:pandas dataframe Return type:dataframe

pandas_to_msgpack(df: pandas.core.frame.DataFrame, file_name) → object

Convert pandas dataframe to msgpack format

Parameters:df (pd.DataFrame) – pandas dataframe

cerebralcortex.core.util.datetime_helper_methods module

get_timezone(tz_offset: float, common_only: bool = False)

Returns a timezone for a given offset in milliseconds

Parameters:

• tz_offset (float) – in milliseconds
• common_only (bool) –

Returns:

timezone of an offset

Return type:

str

cerebralcortex.core.util.spark_helper module

get_or_create_sc(type='sparkContext', name='CerebralCortex-Kernal', enable_spark_ui=False)

get or create spark context

Parameters:

• type (str) – type (sparkContext, SparkSessionBuilder, sparkSession, sqlContext). (default=”sparkContext”)
• name (str) – spark app name (default=”CerebralCortex-Kernal”)

Returns:

Module contents