clear query| facets| time Search criteria: *:*.   Results from 1 to 10 from 718 (0.0s).
Loading phrases to help you
refine your search...
[SPARK-30794] Stage Level scheduling: Add ability to set off heap memory - Spark - [issue]
...For stage level scheduling in ExecutorResourceRequests we support setting heap memory, pyspark memory, and memory overhead. We have no split out off heap memory as its own configuration so w...    Author: Thomas Graves , 2020-07-02, 00:43
[SPARK-29762] GPU Scheduling - default task resource amount to 1 - Spark - [issue]
...Default the task level resource configs (for gpu/fpga, etc) to 1.  So if the user specifies the executor resource then to make it more user friendly lets have the task resource config defaul...    Author: Thomas Graves , 2020-06-29, 14:16
[ARROW-9019] [Python] hdfs fails to connect to for HDFS 3.x cluster - Arrow - [issue]
...I'm trying to use the pyarrow hdfs connector with Hadoop 3.1.3 and I get an error that looks like a protobuf or jar mismatch problem with Hadoop. The same code works on a Hadoop 2.9 cluster....    Author: Thomas Graves , 2020-06-18, 14:55
[SPARK-29148] Modify dynamic allocation manager for stage level scheduling - Spark - [issue]
...To Support Stage Level Scheduling, the dynamic allocation manager has to track the usage and need or executor per ResourceProfile.We will have to figure out what to do with the metrics....    Author: Thomas Graves , 2020-06-17, 02:48
[SPARK-29150] Update RDD API for Stage level scheduling - Spark - [issue]
...See the SPIP and design doc attached to SPARK-27495. Note this is meant to be the final task of updating the actual public RDD Api, we want all the other changes in place before enabling thi...    Author: Thomas Graves , 2020-06-02, 03:58
[SPARK-31856] Handle locality wait reset better when executors added - Spark - [issue]
...We found a corner case with the new locality algorithm where we were not affectively resetting the locality when you started without executors.  See    Author: Thomas Graves , 2020-05-28, 14:26
[SPARK-29303] UI updates for stage level scheduling - Spark - [issue]
...Update the UI to show information about stage level scheduling.The stage pages should have what resources were required for instance....    Author: Thomas Graves , 2020-05-21, 18:14
[SPARK-30689] Allow custom resource scheduling to work with YARN versions that don't support custom resource scheduling - Spark - [issue]
...Many people/companies will not be moving to Hadoop 3.1 or greater, where it supports custom resource scheduling for things like GPUs soon and have requested support for it in older hadoop 2....    Author: Thomas Graves , 2020-05-20, 06:27
[SPARK-30623] Spark external shuffle allow disable of separate event loop group - Spark - [issue]
...In SPARK-24355 changes were made to add a separate event loop group for processing ChunkFetchRequests , this  allow fors the other threads to handle regular connection requests when the conf...    Author: Thomas Graves , 2020-05-17, 18:30
[SPARK-15121] Improve logging of external shuffle handler - Spark - [issue]
...I want to get more information about who is connecting to the spark external shuffle handler.   So I want to enhance the OpenBlocks call in ExternalShuffleBlockHandler...    Author: Thomas Graves , 2020-05-17, 18:30