clear query| facets| time Search criteria: author:"Mich Talebzadeh".   Results from 1 to 10 from 58 (0.0s).
Loading phrases to help you
refine your search...
[expand - 4 more] - Spark reading from Hbase throws java.lang.NoSuchMethodError: org.json4s.jackson.JsonMethods - Spark - [mail # user]
...Hi,Does anyone has any more suggestion for the error I reported below please?Thanks,Mich*Disclaimer:* Use it at your own risk. Any and all responsibility for anyloss, damage or destruction o...
   Author: Mich Talebzadeh , 2020-02-23, 19:13
Spark streaming when a node or nodes go down - Spark - [mail # user]
...Hi,I know this is a basic question but someone enquired about it and I justwanted to fill my knowledge gap so to speak.Within the context of Spark streaming, the RDD is created from the inco...
   Author: Mich Talebzadeh , 2019-12-11, 10:28
org.apache.spark.util.SparkUncaughtExceptionHandler - Spark - [mail # user]
...Hi Nimmi,Can you send us the spark parameters with overhead. assuming you arerunning with yarnExample[4] - 864GB--num-executors 32--executor-memory 21G--executor-cores 4--conf spark.yarn.exe...
   Author: Mich Talebzadeh , 2019-10-10, 21:10
[expand - 1 more] - OrderBy Year and Month is not displaying correctly - Spark - [mail # user]
...*The distinct transformation does not preserve order, you need to distinctfirst, then orderby.*Thanks Enrico. You are correct. Worked fine!joint_accounts.      select(year(col...
   Author: Mich Talebzadeh , 2020-01-06, 12:05
Static and dynamic partition loads in Hive table through Spark - Spark - [mail # user]
...Hi,This is something that I am banging my head to explain someone so hencethis questionThere is an underlying Hive that which is populated reading an XML filethrough Spark.The table in Hive ...
   Author: Mich Talebzadeh , 2020-04-26, 12:14
[expand - 4 more] - can we all help use our expertise to create an IT solution for Covid-19 - Spark - [mail # user]
...Thank you for your remarks. Points taken.Dr Mich TalebzadehLinkedIn * https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw*http://talebzadehmich.wordpress.com*Dis...
   Author: Mich Talebzadeh , 2020-03-26, 18:58
Spark hangs while reading from jdbc - does nothing - Spark - [mail # user]
...Hi,Have you checked your JDBC connections from Spark to Oracle. What is Oraclesaying? Is it doing anything or hanging?set pagesize 9999set linesize 140set heading offselect SUBSTR(name,1,8) ...
   Author: Mich Talebzadeh , 2020-04-11, 17:49
[expand - 3 more] - Converting a date to milliseconds with time zone in Scala - Spark - [mail # user]
...Hi,Thank you all,I am just thinking of passing that date   06/04/2020 12:03:43  and gettingthe correct format from the module. In effectThis date format  yyyy-MM-dd'T'HH:mm:ss...
   Author: Mich Talebzadeh , 2020-04-28, 21:22
[expand - 3 more] - Filtering on multiple columns in spark - Spark - [mail # user]
...Hi,Trying to filter a dataframe with multiple conditions using OR "||" as below  val rejectedDF = newDF.withColumn("target_mobile_no",col("target_mobile_no").cast(StringType)).  &n...
   Author: Mich Talebzadeh , 2020-04-29, 07:45
[expand - 1 more] - Lightbend Scala professional training & certification - Spark - [mail # user]
...Hi,Has anyone had experience of taking training courses  with Lightbendtraining on ScalaI believe they are offering free Scala courses and certifications.Thanks,Dr Mich TalebzadehLinked...
   Author: Mich Talebzadeh , 2020-04-29, 10:29