clear query| facets| time Search criteria: *:*.   Results from 1 to 10 from 557 (0.0s).
Loading phrases to help you
refine your search...
Slower than usual on PRs - Spark - [mail # dev]
...Hi Spark dev folks,Just an FYI I'm out dealing with recovering from a motorcycle accident somy lack of (or slow) responses on PRs/docs is health related and pleasedon't block on any of my re...
   Author: Holden Karau , 2019-12-02, 17:28
[BEAM-2784] Fix issues from automated conversion to allow Python 2 functionality - Beam - [issue]
...As part of BEAM-1251 we want to move to support a Python2/3 code base. To do this we can use futurize but futurize will break some Python2 elements. A good intermediate checkpoint is contiui...    Author: Holden Karau , 2019-11-19, 18:46
[SPARK-20628] Keep track of nodes which are going to be shut down & avoid scheduling new tasks - Spark - [issue]
...Keep track of nodes which are going to be shut down. We considered adding this for YARN but took a different approach, for instances where we can't control instance termination though (EC2, ...    Author: Holden Karau , 2019-11-16, 02:21
[SPARK-21040] On executor/worker decommission consider speculatively re-launching current tasks - Spark - [issue]
...If speculative execution is enabled we may wish to consider decommissioning of worker as a weight for speculative execution....    Author: Holden Karau , 2019-11-14, 11:33
[SPARK-29163] Provide a mixin to simplify HadoopConf access patterns in DataSource V2 - Spark - [issue]
...Since many data sources need the hadoop config we should make an easy way for them to get access to it with minimal overhead (e.g. broadcasting + mixin). TODO after SPARK-29158. Also look at...    Author: Holden Karau , 2019-11-14, 00:16
[expand - 1 more] - PySpark Pandas UDF - Spark - [mail # user]
...Thanks for sharing that. I think we should maybe add some checks aroundthis so it’s easier to debug. I’m CCing Bryan who might have some thoughts.On Tue, Nov 12, 2019 at 7:42 AM gal.benshlom...
   Author: Holden Karau , 2019-11-12, 15:53
[MAHOUT-2017] Figure out how keep data as DRM in between stages - Mahout - [issue]    Author: Holden Karau , 2019-11-12, 00:05
[expand - 1 more] - Why Spark generates Java code and not Scala? - Spark - [mail # user]
...If you look inside of the generation we generate java code and compile itwith Janino. For interested folks the conversation moved over to the dev@listOn Sat, Nov 9, 2019 at 10:37 AM Marcin T...
   Author: Holden Karau , 2019-11-10, 12:57
[SPARK-28904] Spark PV tests don't create required mount - Spark - [issue]
...The Spark PVTestsSuite assumes that there exists a mount from the host system into minikube but doesn't set up that mount. It also currently assumes the mount is done with the same UID as th...    Author: Holden Karau , 2019-11-01, 14:42
pyspark - memory leak leading to OOM after submitting 100 jobs? - Spark - [mail # user]
...On Thu, Oct 31, 2019 at 10:04 PM Nicolas Paris wrote:> have you deactivated the spark.ui ?> I have read several thread explaining the ui can lead to OOM because it> stores 1000 dags...
   Author: Holden Karau , 2019-11-01, 13:36