Another question is how to install graphframes permanently when the spark nodes can not connect to the internet.
------------------ Original ------------------
From: Denny Lee <[EMAIL PROTECTED]>
Date: Mon,Feb 19,2018 10:23 AM
To: xiaobo <[EMAIL PROTECTED]>
Cc: [EMAIL PROTECTED] <[EMAIL PROTECTED]>
Subject: Re: Does Pyspark Support Graphx?

Note the --packages option works for both PySpark and Spark (Scala).  For the SparkLauncher class, you should be able to include packages ala:

spark.addSparkArg("--packages", "graphframes:0.5.0-spark2.0-s_2.11")
On Sun, Feb 18, 2018 at 3:30 PM xiaobo <[EMAIL PROTECTED]> wrote:

Hi Denny,
The pyspark script uses the --packages option to load graphframe library, what about the SparkLauncher class?
------------------ Original ------------------
From: Denny Lee <[EMAIL PROTECTED]>
Date: Sun,Feb 18,2018 11:07 AM
To: 94035420 <[EMAIL PROTECTED]>
Cc: [EMAIL PROTECTED] <[EMAIL PROTECTED]>

Subject: Re: Does Pyspark Support Graphx?

That¡¯s correct - you can use GraphFrames though as it does support PySpark.  
On Sat, Feb 17, 2018 at 17:36 94035420 <[EMAIL PROTECTED]> wrote:

I can not find anything for graphx module in the python API document, does it mean it is not supported yet?