clear query| facets| time Search criteria: .   Results from 1 to 10 from 1518 (0.0s).
Loading phrases to help you
refine your search...
[SPARK-9850] Adaptive execution in Spark - Spark - [issue]
...Query planning is one of the main factors in high performance, but the current Spark engine requires the execution DAG for a job to be set in advance. Even with cost­-based optimization, it ...    Author: Matei Zaharia , 2018-09-20, 22:54
[expand - 1 more] - Should python-2 be supported in Spark 3.0? - Spark - [mail # user]
...That’s a good point — I’d say there’s just a risk of creating a perception issue. First, some users might feel that this means they have to migrate now, which is before Python itself drops s...
   Author: Matei Zaharia , 2018-09-17, 23:24
Is there any open source framework that converts Cypher to SparkSQL? - Spark - [mail # user]
...GraphFrames ( offers a Cypher-like syntax that then executes on Spark SQL.> On Sep 14, 2018, at 2:42 AM, kant kodali  wrote:> > Hi All,> > I...
   Author: Matei Zaharia , 2018-09-16, 22:09
Python friendly API for Spark 3.0 - Spark - [mail # dev]
...My 2 cents on this is that the biggest room for improvement in Python is similarity to Pandas. We already made the Python DataFrame API different from Scala/Java in some respects, but if the...
   Author: Matei Zaharia , 2018-09-16, 21:09
[expand - 3 more] - time for Apache Spark 3.0? - Spark - [mail # dev]
...Yes, you can start with Unstable and move to Evolving and Stable when needed. We’ve definitely had experimental features that changed across maintenance releases when they were well-isolated...
   Author: Matei Zaharia , 2018-09-06, 21:21
Nightly Builds in the docs (in spark-nightly/spark-master-bin/latest? Can't seem to find it) - Spark - [mail # dev]
...If we actually build stuff nightly in Jenkins, it wouldn’t hurt to publish them IMO. It helps more people try master and test it.> On Aug 31, 2018, at 1:28 PM, Sean Owen  wrote:> ...
   Author: Matei Zaharia , 2018-08-31, 20:33
[discuss] replacing SPIP template with Heilmeier's Catechism? - Spark - [mail # dev]
...I like this as well. Regarding “cost”, I think the equivalent concept for us is impact on the rest of the project (say maintenance cost down the line or whatever). This could be captured in ...
   Author: Matei Zaharia , 2018-08-31, 20:26
[expand - 1 more] - [MLlib][Test] Smoke and Metamorphic Testing of MLlib - Spark - [mail # dev]
...Yes, that makes sense, but just to be clear, using the same seed does *not* imply that the algorithm should produce “equivalent” results by some definition of equivalent if you change the in...
   Author: Matei Zaharia , 2018-08-24, 01:45
Porting or explicitly linking project style in Apache Spark based on - Spark - [mail # dev]
...There’s already a code style guide listed on Maybe it’s the same? We should decide which one we actually want and update this page if it’s wrong.Ma...
   Author: Matei Zaharia , 2018-08-24, 01:35
[SPARK-650] Add a "setup hook" API for running initialization code on each executor - Spark - [issue]
...Would be useful to configure things like reporting libraries...    Author: Matei Zaharia , 2018-08-13, 20:11