clear query| facets| time Search criteria: .   Results from 1 to 10 from 12 (0.0s).
Loading phrases to help you
refine your search...
Welcoming some new Apache Spark committers - Spark - [mail # dev]
...Congratulations and welcome!On Tue, Jul 14, 2020 at 12:36 PM Xingbo Jiang  wrote:> Welcome, Huaxin, Jungtaek, and Dilip!>> Congratulations!>> On Tue, Jul 14, 2020 at 10:3...
   Author: Bryan Cutler , 2020-07-14, 20:07
[SPARK-32312] Upgrade Apache Arrow to 1.0.0 - Spark - [issue]
...Apache Arrow will soon release v1.0.0 which provides backward/forward compatibility guarantees as well as a number of fixes and improvements. This will upgrade the Java artifact and PySpark ...
http://issues.apache.org/jira/browse/SPARK-32312    Author: Bryan Cutler , 2020-07-14, 17:44
[SPARK-29376] Upgrade Apache Arrow to 0.15.1 - Spark - [issue]
...Apache Arrow 0.15.0 was just released see https://arrow.apache.org/blog/2019/10/06/0.15.0-release/There are a number of fixes and improvements including a change to the binary IPC format htt...
http://issues.apache.org/jira/browse/SPARK-29376    Author: Bryan Cutler , 2020-07-14, 17:43
[ARROW-9356] [Java] Remove Netty dependency from arrow-vector - Arrow - [issue]
...Cleanup remaining usage of Netty from arrow-vector and remove as a dependency after ARROW-9300....
http://issues.apache.org/jira/browse/ARROW-9356    Author: Bryan Cutler , 2020-07-12, 22:51
[SPARK-21187] Complete support for remaining Spark data types in Arrow Converters - Spark - [issue]
...This is to track adding the remaining type support in Arrow Converters. Currently, only primitive data types are supported. 'Remaining types: Date Timestamp Complex: Struct, Array, Arrays of...
http://issues.apache.org/jira/browse/SPARK-21187    Author: Bryan Cutler , 2020-07-12, 22:43
[SPARK-32285] Add PySpark support for nested timestamps with arrow - Spark - [issue]
...Currently with arrow optimizations, there is post-processing done in pandas for timestamp columns to localize timezone. This is not done for nested columns with timestamps such as StructType...
http://issues.apache.org/jira/browse/SPARK-32285    Author: Bryan Cutler , 2020-07-12, 22:42
[SPARK-23258] Should not split Arrow record batches based on row count - Spark - [issue]
...Currently when executing scalar pandas_udf or using toPandas() the Arrow record batches are split up once the record count reaches a max value, which is configured with "spark.sql.execution....
http://issues.apache.org/jira/browse/SPARK-23258    Author: Bryan Cutler , 2020-07-11, 00:31
[ARROW-9357] [Java] Document how to set netty/unsafe allocators - Arrow - [issue]
...There are now 2 allocators available, one based on netty and one using unsafe apis. We should provide end-user documentation on which one is default and how to set and use each one....
http://issues.apache.org/jira/browse/ARROW-9357    Author: Bryan Cutler , 2020-07-07, 18:20
[SPARK-32162] Improve Pandas Grouped Map with Window test output - Spark - [issue]
...The output of GroupedMapInPandasTests.test_grouped_over_window_with_key is not helpful, only gives ======================================================================FAIL: test_grouped_ov...
http://issues.apache.org/jira/browse/SPARK-32162    Author: Bryan Cutler , 2020-07-06, 12:41
[SPARK-24554] Add MapType Support for Arrow in PySpark - Spark - [issue]
...Add support for MapType in Arrow related classes in Scala/Java and pyarrow functionality in Python....
http://issues.apache.org/jira/browse/SPARK-24554    Author: Bryan Cutler , 2020-06-26, 16:51