clear query| facets| time Search criteria: *:*.   Results from 1 to 10 from 718 (0.0s).
Loading phrases to help you
refine your search...
[SPARK-30794] Stage Level scheduling: Add ability to set off heap memory - Spark - [issue]
...For stage level scheduling in ExecutorResourceRequests we support setting heap memory, pyspark memory, and memory overhead. We have no split out off heap memory as its own configuration so w...
http://issues.apache.org/jira/browse/SPARK-30794    Author: Thomas Graves , 2020-07-02, 00:43
[SPARK-29762] GPU Scheduling - default task resource amount to 1 - Spark - [issue]
...Default the task level resource configs (for gpu/fpga, etc) to 1.  So if the user specifies the executor resource then to make it more user friendly lets have the task resource config defaul...
http://issues.apache.org/jira/browse/SPARK-29762    Author: Thomas Graves , 2020-06-29, 14:16
[ARROW-9019] [Python] hdfs fails to connect to for HDFS 3.x cluster - Arrow - [issue]
...I'm trying to use the pyarrow hdfs connector with Hadoop 3.1.3 and I get an error that looks like a protobuf or jar mismatch problem with Hadoop. The same code works on a Hadoop 2.9 cluster....
http://issues.apache.org/jira/browse/ARROW-9019    Author: Thomas Graves , 2020-06-18, 14:55
[SPARK-29148] Modify dynamic allocation manager for stage level scheduling - Spark - [issue]
...To Support Stage Level Scheduling, the dynamic allocation manager has to track the usage and need or executor per ResourceProfile.We will have to figure out what to do with the metrics....
http://issues.apache.org/jira/browse/SPARK-29148    Author: Thomas Graves , 2020-06-17, 02:48
[SPARK-29150] Update RDD API for Stage level scheduling - Spark - [issue]
...See the SPIP and design doc attached to SPARK-27495. Note this is meant to be the final task of updating the actual public RDD Api, we want all the other changes in place before enabling thi...
http://issues.apache.org/jira/browse/SPARK-29150    Author: Thomas Graves , 2020-06-02, 03:58
[SPARK-31856] Handle locality wait reset better when executors added - Spark - [issue]
...We found a corner case with the new locality algorithm where we were not affectively resetting the locality when you started without executors.  See https://github.com/apache/spark/pull/2865...
http://issues.apache.org/jira/browse/SPARK-31856    Author: Thomas Graves , 2020-05-28, 14:26
[SPARK-29303] UI updates for stage level scheduling - Spark - [issue]
...Update the UI to show information about stage level scheduling.The stage pages should have what resources were required for instance....
http://issues.apache.org/jira/browse/SPARK-29303    Author: Thomas Graves , 2020-05-21, 18:14
[SPARK-30689] Allow custom resource scheduling to work with YARN versions that don't support custom resource scheduling - Spark - [issue]
...Many people/companies will not be moving to Hadoop 3.1 or greater, where it supports custom resource scheduling for things like GPUs soon and have requested support for it in older hadoop 2....
http://issues.apache.org/jira/browse/SPARK-30689    Author: Thomas Graves , 2020-05-20, 06:27
[SPARK-30623] Spark external shuffle allow disable of separate event loop group - Spark - [issue]
...In SPARK-24355 changes were made to add a separate event loop group for processing ChunkFetchRequests , this  allow fors the other threads to handle regular connection requests when the conf...
http://issues.apache.org/jira/browse/SPARK-30623    Author: Thomas Graves , 2020-05-17, 18:30
[SPARK-15121] Improve logging of external shuffle handler - Spark - [issue]
...I want to get more information about who is connecting to the spark external shuffle handler.   So I want to enhance the OpenBlocks call in ExternalShuffleBlockHandler...
http://issues.apache.org/jira/browse/SPARK-15121    Author: Thomas Graves , 2020-05-17, 18:30