clear query| facets| time Search criteria: .   Results from 1 to 10 from 774 (0.0s).
Loading phrases to help you
refine your search...
What eactly is Function shipping? - Spark - [mail # user]
...Hi All,Everyone talks about how easy function shipping is in Scala. IImmediately go "wait a minute" isn't it just Object serialization anddeserialization that existing in Java since a long t...
   Author: kant kodali , 2018-10-17, 03:06
Does spark.streaming.concurrentJobs still exist? - Spark - [mail # user]
...Does spark.streaming.concurrentJobs still exist?spark.streaming.concurrentJobs (default: 1) is the number of concurrentjobs, i.e. threads in streaming-job-executor thread pool.Also how is th...
   Author: kant kodali , 2018-10-09, 18:52
Spark on YARN not utilizing all the YARN containers available - Spark - [mail # user]
...Hi All,I am using Spark 2.3.1 and using YARN as a cluster manager.I currently got1) 6 YARN containers(executors=6) with 4 executor cores for each container.2) 6 Kafka partitions from one top...
   Author: kant kodali , 2018-10-09, 17:21
How to do a broadcast join using raw Spark SQL 2.3.1 or 2.3.2? - Spark - [mail # user]
...Hi All,How to do a broadcast join using raw Spark SQL 2.3.1 or 2.3.2?Thanks...
   Author: kant kodali , 2018-10-03, 23:40
can Spark 2.4 work on JDK 11? - Spark - [mail # user]
...Hi All,can Spark 2.4 work on JDK 11? I feel like there are lot of features thatare added in JDK 9, 10, 11 that can make deployment process a whole lotbetter and of course some more syntax su...
   Author: kant kodali , 2018-09-25, 21:31
can I model any arbitrary data structure as an RDD? - Spark - [mail # user]
...Hi All,I am wondering if I can model any arbitrary data structure as an RDD? Forexample, can I model, Red-black trees, Suffix Trees, Radix Trees, SplayTrees, Fibonacci heaps, Tries, Linked L...
   Author: kant kodali , 2018-09-25, 10:52
Is there any open source framework that converts Cypher to SparkSQL? - Spark - [mail # user]
...Hi All,Is there any open source framework that converts Cypher to SparkSQL?Thanks!...
   Author: kant kodali , 2018-09-14, 09:43
Can we have Avro-1852 in master or next release? - Avro - [mail # user]
...Hi All,Can we have https://issues.apache.org/jira/browse/AVRO-1852 in master or aspart of any upcoming release? It turns out this is extremely useful andnecessary when used with Spark or Had...
   Author: kant kodali , 2018-09-04, 09:50
How do I generate current UTC timestamp in raw spark sql? - Spark - [mail # user]
...Hi All,How do I generate current UTC timestamp using spark sql?When I do curent_timestamp() it is giving me local time.to_utc_timestamp(current_time(), ????) takes timezone in the secondpara...
   Author: kant kodali , 2018-08-28, 09:04
[expand - 2 more] - GenericRecord.toString produces invalid JSON for logical types - Avro - [mail # user]
...Hi Dan,I modified my function a bit (pasted below). The control never seems toenter my overridden toString method for some reason. The print statementinside my toString method never gets inv...
   Author: kant kodali , 2018-08-24, 07:52