clear query| facets| time Search criteria: .   Results from 1 to 10 from 1400 (0.0s).
Loading phrases to help you
refine your search...
2.4.0 Blockers, Critical, etc - Spark - [mail # dev]
...Sean, thanks for checking! The MLlib blockers were resolved today byreverting breaking API changes. We still have some documentation work towrap up. -Xiangrui+Weichen Xu On Fri, Sep 21, 2018...
   Author: Xiangrui Meng , 2018-09-21, 20:22
[SPARK-24374] SPIP: Support Barrier Execution Mode in Apache Spark - Spark - [issue]
...(See details in the linked/attached SPIP doc.)The proposal here is to add a new scheduling model to Apache Spark so users can properly embed distributed DL training as a Spark stage to simpl...
http://issues.apache.org/jira/browse/SPARK-24374    Author: Xiangrui Meng , 2018-09-20, 17:35
[SPARK-24375] Design sketch: support barrier scheduling in Apache Spark - Spark - [issue]
...This task is to outline a design sketch for the barrier scheduling SPIP discussion. It doesn't need to be a complete design before the vote. But it should at least cover both Scala/Java and ...
http://issues.apache.org/jira/browse/SPARK-24375    Author: Xiangrui Meng , 2018-09-20, 17:35
[SPARK-24581] Design: BarrierTaskContext.barrier() - Spark - [issue]
...We need to provide a communication barrier function to users to help coordinate tasks within a barrier stage. This is very similar to MPI_Barrier function in MPI. This story is for its desig...
http://issues.apache.org/jira/browse/SPARK-24581    Author: Xiangrui Meng , 2018-09-20, 17:23
[SPARK-24582] Design: Barrier execution mode - Spark - [issue]
...Xingbo Jiang and Wenchen Fan outlined a design sketch in SPARK-24375, which covers some basic scenarios. This story is for a formal design of the barrier execution mode....
http://issues.apache.org/jira/browse/SPARK-24582    Author: Xiangrui Meng , 2018-09-20, 17:23
[SPARK-24580] List scenarios to be handled by barrier execution mode properly - Spark - [issue]
...List scenarios to be handled by barrier execution mode to help the design. We will start with simple ones to complex.  ...
http://issues.apache.org/jira/browse/SPARK-24580    Author: Xiangrui Meng , 2018-09-20, 17:23
[SPARK-25376] Scenarios we should handle but missed in 2.4 for barrier execution mode - Spark - [issue]
...Imran Rashid You mentioned that there are couple scenarios we should handle in barrier execution mode but we didn't in 2.4. Could you elaborate here?One scenario we are aware of is that spec...
http://issues.apache.org/jira/browse/SPARK-25376    Author: Xiangrui Meng , 2018-09-20, 17:22
[SPARK-24724] Discuss necessary info and access in barrier mode + Kubernetes - Spark - [issue]
...In barrier mode, to run hybrid distributed DL training jobs, we need to provide users sufficient info and access so they can set up a hybrid distributed training job, e.g., using MPI.This ti...
http://issues.apache.org/jira/browse/SPARK-24724    Author: Xiangrui Meng , 2018-09-20, 17:17
[SPARK-24725] Discuss necessary info and access in barrier mode + Mesos - Spark - [issue]
...In barrier mode, to run hybrid distributed DL training jobs, we need to provide users sufficient info and access so they can set up a hybrid distributed training job, e.g., using MPI.This ti...
http://issues.apache.org/jira/browse/SPARK-24725    Author: Xiangrui Meng , 2018-09-20, 17:17
[SPARK-24723] Discuss necessary info and access in barrier mode + YARN - Spark - [issue]
...In barrier mode, to run hybrid distributed DL training jobs, we need to provide users sufficient info and access so they can set up a hybrid distributed training job, e.g., using MPI.This ti...
http://issues.apache.org/jira/browse/SPARK-24723    Author: Xiangrui Meng , 2018-09-20, 17:17