clear query| facets| time Search criteria: .   Results from 21 to 30 from 130828 (0.0s).
Loading phrases to help you
refine your search...
[Discuss] Language Interop for Apache Spark - Spark - [mail # dev]
...There seems to be some desire for third party language extensions for ApacheSpark. Some notable examples include:* C#/F# from project Mobius https://github.com/Microsoft/Mobius* Haskell from...
   Author: tcondie@... , 2018-09-25, 23:55
[SPARK-25533] Inconsistent message for Completed Jobs in the  JobUI, when there are failed jobs, compared to spark2.2 - Spark - [issue]
...Test steps: 1) bin/spark-shellsc.parallelize(1 to 5, 5).collect()sc.parallelize(1 to 5, 2).map{ x => throw new RuntimeException("Fail Job")}.collect()Output in spark - 2.3.1:Output in spa...
http://issues.apache.org/jira/browse/SPARK-25533    Author: shahid , 2018-09-25, 23:35
[SPARK-25102] Write Spark version information to Parquet file footers - Spark - [issue]
...PARQUET-352 added support for the "writer.model.name" property in the Parquet metadata to identify the object model (application) that wrote the file.The easiest way to write this property i...
http://issues.apache.org/jira/browse/SPARK-25102    Author: Zoltan Ivanfi , 2018-09-25, 23:27
[expand - 1 more] - [Spark SQL]: Java Spark Classes With Attributes of Type Set In Datasets - Spark - [mail # user]
...Actually, it appears walking through it in a debug terminal that thedeserializer can properly transform the data on read to an ArrayType, butthe serializer doesn't know what to do when we tr...
   Author: Dillon Dukek , ddukek , ... , 2018-09-25, 22:01
can Spark 2.4 work on JDK 11? - Spark - [mail # user]
...Hi All,can Spark 2.4 work on JDK 11? I feel like there are lot of features thatare added in JDK 9, 10, 11 that can make deployment process a whole lotbetter and of course some more syntax su...
   Author: kant kodali , 2018-09-25, 21:31
Accumulator issues in PySpark - Spark - [mail # dev]
...I was trying to check out accumulators and see if I could use them foranything.I made a demo program and could not figure out how to add them up.I found that I need to do a shuffle between a...
   Author: Abdeali Kothari , 2018-09-25, 20:28
[expand - 8 more] - [Discuss] Datasource v2 support for Kerberos - Spark - [mail # dev]
...I agree with Wenchen that we'd remove the prefix when passing to a source,so you could use the same "spark.yarn.keytab" option in both places. But Ithink the problem is that "spark.yarn.keyt...
   Author: Ryan Blue , tigerquoll , ... , 2018-09-25, 19:48
[SPARK-25495] FetchedData.reset doesn't reset _nextOffsetInFetchedData and _offsetAfterPoll - Spark - [issue]
...FetchedData.reset doesn't reset _nextOffsetInFetchedData and _offsetAfterPoll and causes inconsistent cached data and may make Kafka connector return wrong results....
http://issues.apache.org/jira/browse/SPARK-25495    Author: Shixiong Zhu , 2018-09-25, 18:43
[SPARK-17636] Parquet filter push down doesn't handle struct fields - Spark - [issue]
...There's a PushedFilters for a simple numeric field, but not for a numeric field inside a struct. Not sure if this is a Spark limitation because of Parquet, or only a Spark limitation.scala&g...
http://issues.apache.org/jira/browse/SPARK-17636    Author: Mitesh , 2018-09-25, 18:27
[SPARK-25486] Refactor SortBenchmark to use main method - Spark - [issue]
http://issues.apache.org/jira/browse/SPARK-25486    Author: yucai , 2018-09-25, 18:13