clear query| facets| time Search criteria: .   Results from 1 to 10 from 57 (0.0s).
Loading phrases to help you
refine your search...
[SPARK-22148] TaskSetManager.abortIfCompletelyBlacklisted should not abort when all current executors are blacklisted but dynamic allocation is enabled - Spark - [issue]
...Currently TaskSetManager.abortIfCompletelyBlacklisted aborts the TaskSet and the whole Spark job with `task X (partition Y) cannot run anywhere due to node and executor blacklist. Blacklisti...
http://issues.apache.org/jira/browse/SPARK-22148    Author: Juan Rodríguez Hortalá , 2018-09-04, 18:26
[SPARK-22339] Push epoch updates to executors on fetch failure to avoid fetch retries for missing executors - Spark - [issue]
...When a task finishes with error due to a fetch error, then DAGScheduler unregisters the shuffle blocks hosted by the serving executor (or even all the executors in the failing host, with ext...
http://issues.apache.org/jira/browse/SPARK-22339    Author: Juan Rodríguez Hortalá , 2017-10-26, 23:15
Push epoch updates to executors on fetch failure to avoid fetch retries for missing executors - Spark - [mail # dev]
...Hi,I opened https://issues.apache.org/jira/browse/SPARK-22339 some days ago,and I would like to get some feedback on that. The idea is pushing epochupdates to the executors after a fetch fai...
   Author: Juan Rodríguez Hortalá , 2017-10-25, 17:06
(SPARK-22148) TaskSetManager.abortIfCompletelyBlacklisted should not abort when all current executors are blacklisted but dynamic allocation is enabled - Spark - [mail # dev]
...Hi,I've been working on this issue, and I would like to get your feedback onthe following approach. The idea is that instead of failing in`TaskSetManager.abortIfCompletelyBlacklisted`, when ...
   Author: Juan Rodríguez Hortalá , 2017-10-24, 17:18
[expand - 1 more] - Graceful node decommission mechanism for Spark - Spark - [mail # dev]
...Hi,Are there any comments or suggestions regarding this proposal?Thanks,JuanOn Mon, Oct 16, 2017 at 10:27 AM, Juan Rodríguez Hortalá <[EMAIL PROTECTED]> wrote:> Hi all,>> I ha...
   Author: Juan Rodríguez Hortalá , 2017-10-20, 17:17
Job keeps aborting because of org.apache.spark.shuffle.FetchFailedException: Failed to connect to server/ip:39232 - Spark - [mail # user]
...Hi Jeff,Can you provide more information about how are you running your job? Inparticular:  - which cluster manager are you using? It is YARN, Mesos, SparkStandalone?  - with confi...
   Author: Juan Rodríguez Hortalá , 2017-07-28, 23:20
unit testing in spark - Spark - [mail # user]
...Hi all,I would also would like to participate on that.Greetings,JuanOn Fri, Dec 9, 2016 at 6:03 AM, Michael Stratton <[EMAIL PROTECTED]> wrote:...
   Author: Juan Rodríguez Hortalá , 2016-12-12, 00:30
[expand - 2 more] - JobScheduler: Error generating jobs for time for custom InputDStream - Spark - [mail # user]
...Hi Shixiong,Thanks for your answer. I will take a lot to your suggestion, maybe my callto SparkContext.parallelize doesn't work well when there are less recordsto parallelize than partitions...
   Author: Juan Rodríguez Hortalá , 2015-09-29, 22:06
[expand - 1 more] - RDD API patterns - Spark - [mail # dev]
...Hi Sim,I understand that what you propose is defining a trait SparkIterable (andalso PairSparkIterable for RDDs of pairs) that encapsulates the methods inRDDs, and then program using that tr...
   Author: Juan Rodríguez Hortalá , 2015-09-19, 20:11
JobScheduler: Error generating jobs for time for custom InputDStream - Spark - [mail # dev]
...Hi,Sorry to insist, anyone has any thoughts on this? Or at least someone canpoint me to a documentation of DStream.compute() so I can understand when Ishould return None for a batch?ThanksJu...
   Author: Juan Rodríguez Hortalá , 2015-09-16, 06:51