Skip to content

Instantly share code, notes, and snippets.

@NicolaeNMV
Created January 7, 2017 08:51
Show Gist options
  • Save NicolaeNMV/3e1d77a9a00c8b496cf880e08c951af4 to your computer and use it in GitHub Desktop.
Save NicolaeNMV/3e1d77a9a00c8b496cf880e08c951af4 to your computer and use it in GitHub Desktop.
Start jupyter notebook with spark
#!/bin/sh
export PYSPARK_DRIVER_PYTHON="/usr/local/bin/jupyter"
export PYSPARK_DRIVER_PYTHON_OPTS="notebook --NotebookApp.open_browser=False --NotebookApp.ip='*' --NotebookApp.port=8880"
export PYSPARK_PYTHON="/usr/bin/python"
pyspark
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment