clear query| facets| time Search criteria: author:"Mich Talebzadeh".   Results from 11 to 20 from 55 (0.0s).
Loading phrases to help you
refine your search...
[expand - 3 more] - Converting a date to milliseconds with time zone in Scala - Spark - [mail # user]
...Hi,Thank you all,I am just thinking of passing that date   06/04/2020 12:03:43  and gettingthe correct format from the module. In effectThis date format  yyyy-MM-dd'T'HH:mm:ss...
   Author: Mich Talebzadeh , 2020-04-28, 21:22
[expand - 3 more] - Filtering on multiple columns in spark - Spark - [mail # user]
...Hi,Trying to filter a dataframe with multiple conditions using OR "||" as below  val rejectedDF = newDF.withColumn("target_mobile_no",col("target_mobile_no").cast(StringType)).  &n...
   Author: Mich Talebzadeh , 2020-04-29, 07:45
[expand - 1 more] - Lightbend Scala professional training & certification - Spark - [mail # user]
...Hi,Has anyone had experience of taking training courses  with Lightbendtraining on ScalaI believe they are offering free Scala courses and certifications.Thanks,Dr Mich TalebzadehLinked...
   Author: Mich Talebzadeh , 2020-04-29, 10:29
wot no toggle ? - Spark - [mail # user]
...Look I believe what Sean Owen refereed to as third party is true. We hadone few weeks ago.There are many trolls who are masquerading as different individuals but thelanguage and ferocity is ...
   Author: Mich Talebzadeh , 2020-04-16, 17:17
[expand - 1 more] - Going it alone. - Spark - [mail # user]
...I refer you to the answer I gave in similar thread.Cheers,Dr Mich TalebzadehLinkedIn * https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw*http://talebzadehmich....
   Author: Mich Talebzadeh , 2020-04-16, 17:08
[expand - 2 more] - How to pass a constant value to a partitioned hive table in spark - Spark - [mail # user]
...Thanks Zhang,That is not working. I need to send the value for variable  broadcastValue,it cannot interpret it. scala>   sqltext = """     |   INSERT IN...
   Author: Mich Talebzadeh , 2020-04-16, 11:47
[expand - 1 more] - Save Spark dataframe as dynamic partitioned table in Hive - Spark - [mail # user]
...Thanks Patrick,The partition  broadcastId is static as defined as a value belowval broadcastValue = "123456789"  // I assume this will be sent as aconstant for the batch// Create a...
   Author: Mich Talebzadeh , 2020-04-16, 23:11
Huge difference in speed between pyspark and scalaspark - Spark - [mail # user]
...This comparison comes up time and time again. Spark is written inScala and providesAPIs in Scala, Java, Python, and R.However, its primary focus has been on Scala. In generic terms this mean...
   Author: Mich Talebzadeh , 2020-05-13, 14:30
Modularising Spark/Scala program - Spark - [mail # user]
...Hi,I have a Spark Scala program created and compiled with Maven. It worksfine. It basically does the following:   1. Reads an xml file from HDFS location   2. Creates a D...
   Author: Mich Talebzadeh , 2020-05-02, 13:00
[expand - 7 more] - Exception handling in Spark - Spark - [mail # user]
...Hi,As I understand exception handling in Spark only makes sense if oneattempts an action as opposed to lazy transformations?Let us assume that I am reading an XML file from the HDFS director...
   Author: Mich Talebzadeh , 2020-05-05, 15:25