clear query| facets| time Search criteria: .   Results from 1 to 10 from 13 (0.0s).
Loading phrases to help you
refine your search...
[SPARK-25390] data source V2 API refactoring - Spark - [issue]
...Currently it's not very clear how we should abstract data source v2 API. The abstraction should be unified between batch and streaming, or similar but have a well-defined difference between ...    Author: Wenchen Fan , 2019-06-25, 20:20
[SPARK-27815] do not leak SaveMode to file source v2 - Spark - [issue]
...Currently there is a hack in `DataFrameWriter`, which passes `SaveMode` to file source v2. This should be removed and file source v2 should not accept SaveMode....    Author: Wenchen Fan , 2019-06-25, 01:58
[SPARK-27666] Do not release lock while TaskContext already completed - Spark - [issue]
...Exception in thread "Thread-14" java.lang.AssertionError: assertion failed: Block rdd_0_0 is not locked for reading at scala.Predef$.assert(Predef.scala:223) at    Author: Wenchen Fan , 2019-06-18, 02:19
[SPARK-24175] improve the Spark 2.4 migration guide - Spark - [issue]
...The current Spark 2.4 migration guide is not well phrased. We should1. State the before behavior2. State the after behavior3. Add a concrete example with code to illustrate.For example:Since...    Author: Wenchen Fan , 2019-06-18, 02:00
[SPARK-25341] Support rolling back a shuffle map stage and re-generate the shuffle files - Spark - [issue]
...This is a follow up of completely fix that problem, Spark needs to be able to rollback a shuffle map stage and rerun all the map tasks.Acc...    Author: Wenchen Fan , 2019-06-17, 15:52
[SPARK-25342] Support rolling back a result stage - Spark - [issue]
...This is a follow up of completely fix that problem, Spark needs to be able to rollback a result stage and rerun all the result tasks.Howev...    Author: Wenchen Fan , 2019-06-09, 23:57
[SPARK-10316] respect non-deterministic expressions in PhysicalOperation - Spark - [issue]
...We did a lot of special handling for non-deterministic expressions in Optimizer. However, PhysicalOperation just collects all Projects and Filters and messed it up. We should respect the ope...    Author: Wenchen Fan , 2019-06-06, 23:07
[SPARK-27521] move data source v2 API to catalyst module - Spark - [issue]    Author: Wenchen Fan , 2019-06-05, 16:56
[ARROW-1156] [Python] pyarrow.Array.from_pandas should take a type parameter - Arrow - [issue]
...It's convenient to infer the data type so that users can just write pyarrow.Array.from_pandas(arr), however, sometimes users want fine-grained control, e.g., if we have an object type numpy ...    Author: Wenchen Fan , 2019-06-03, 13:00
[SPARK-26215] define reserved keywords after SQL standard - Spark - [issue]
...There are 2 kinds of SQL keywords: reserved and non-reserved. Reserved keywords can't be used as identifiers.In Spark SQL, we are too tolerant about non-reserved keywors. A lot of keywords a...    Author: Wenchen Fan , 2019-05-31, 17:44