| clear
query|
facets|
time |
Search criteria: *:*.
Results from 1 to 10 from
557 (0.0s).
|
|
|
Loading phrases to help you
refine your search...
|
|
Slower than usual on PRs -
Spark - [mail # dev]
|
| ...Hi Spark dev folks,Just an FYI I'm out dealing with recovering from a motorcycle accident somy lack of (or slow) responses on PRs/docs is health related and pleasedon't block on any of my re... |
|
|
|
|
|
|
|
[BEAM-2784] Fix issues from automated conversion to allow Python 2 functionality -
Beam - [issue]
|
| ...As part of BEAM-1251 we want to move to support a Python2/3 code base. To do this we can use futurize but futurize will break some Python2 elements. A good intermediate checkpoint is contiui... |
|
|
|
|
|
|
|
[SPARK-20628] Keep track of nodes which are going to be shut down & avoid scheduling new tasks -
Spark - [issue]
|
| ...Keep track of nodes which are going to be shut down. We considered adding this for YARN but took a different approach, for instances where we can't control instance termination though (EC2, ... |
|
|
|
|
|
|
|
[SPARK-21040] On executor/worker decommission consider speculatively re-launching current tasks -
Spark - [issue]
|
| ...If speculative execution is enabled we may wish to consider decommissioning of worker as a weight for speculative execution.... |
|
|
|
|
|
|
|
[SPARK-29163] Provide a mixin to simplify HadoopConf access patterns in DataSource V2 -
Spark - [issue]
|
| ...Since many data sources need the hadoop config we should make an easy way for them to get access to it with minimal overhead (e.g. broadcasting + mixin). TODO after SPARK-29158. Also look at... |
|
|
|
|
|
|
|
[expand - 1 more]
[collapse]
-
PySpark Pandas UDF -
Spark - [mail # user]
|
| ...Thanks for sharing that. I think we should maybe add some checks aroundthis so it’s easier to debug. I’m CCing Bryan who might have some thoughts.On Tue, Nov 12, 2019 at 7:42 AM gal.benshlom... |
|
|
|
|
| |
|
PySpark Pandas UDF - Spark - [mail # user]
|
| ...Can you switch the write for a count just so we can isolate if it’s thewrite or the count?Also what’s the output path your using?On Sun, Nov 10, 2019 at 7:31 AM Gal Benshlomo wrote:>>&... |
|
|
|
|
|
|
|
[MAHOUT-2017] Figure out how keep data as DRM in between stages -
Mahout - [issue]
|
|
|
|
|
|
|
|
|
[expand - 1 more]
[collapse]
-
Why Spark generates Java code and not Scala? -
Spark - [mail # user]
|
| ...If you look inside of the generation we generate java code and compile itwith Janino. For interested folks the conversation moved over to the dev@listOn Sat, Nov 9, 2019 at 10:37 AM Marcin T... |
|
|
|
|
| |
|
Why Spark generates Java code and not Scala? - Spark - [mail # dev]
|
| ...Switching this from user to devOn Sat, Nov 9, 2019 at 9:47 AM Bartosz Konieczny wrote:> Hi there,>> Few days ago I got an intriguing but hard to answer question:> "Why Spark gene... |
|
|
|
|
|
|
|
[SPARK-28904] Spark PV tests don't create required mount -
Spark - [issue]
|
| ...The Spark PVTestsSuite assumes that there exists a mount from the host system into minikube but doesn't set up that mount. It also currently assumes the mount is done with the same UID as th... |
|
|
|
|
|
|
|
pyspark - memory leak leading to OOM after submitting 100 jobs? -
Spark - [mail # user]
|
| ...On Thu, Oct 31, 2019 at 10:04 PM Nicolas Paris wrote:> have you deactivated the spark.ui ?> I have read several thread explaining the ui can lead to OOM because it> stores 1000 dags... |
|
|
|
|
|
|
|
|