-
Vincenzo Eduardo Padulano authored
Add new option dataframe_distpyspark. When the option is ON, the distributed dataframe module will also support distributed execution with pyspark. Enabling the option also triggers checks for pyspark dependencies (e.g. Java, py4j) on the system during configuration.
Vincenzo Eduardo Padulano authoredAdd new option dataframe_distpyspark. When the option is ON, the distributed dataframe module will also support distributed execution with pyspark. Enabling the option also triggers checks for pyspark dependencies (e.g. Java, py4j) on the system during configuration.