clear query| facets| time Search criteria: author:"Mich Talebzadeh".   Results from 11 to 20 from 45 (0.0s).
Loading phrases to help you
refine your search...
[expand - 1 more] - Masking username in Spark with regexp_replace and reverse functions - Spark - [mail # user]
...Hi,I am looking at Description column of a bank statement (CSV download) thathas the following formatscala> account_table.printSchemaroot |-- TransactionDate: date (nullable = true)&...
   Author: Mich Talebzadeh , 2019-03-16, 17:39
[expand - 1 more] - Is there any spark API function to handle a group of companies at once in this scenario? - Spark - [mail # user]
...Are these ticker prices for these companies like share value etc?How do you get this company data in Spark? Are you using Spark streaming toget the prices, then work out the stats (AVG, STDD...
   Author: Mich Talebzadeh , 2019-04-07, 08:34
[expand - 1 more] - This MapR-DB Spark Connector with Secondary Indexes - Spark - [mail # user]
...I am at loss why one needs Spark to load one row from the DB as in theexample belowval data = sparkSession  .loadFromMapRDB("/user/mapr/tables/data", schema)  .filter("uid = '101'"...
   Author: Mich Talebzadeh , 2019-05-04, 23:03
[expand - 2 more] - Spark Scala reading from Google Cloud BigQuery table throws error - Spark - [mail # user]
...Thanks Sam. Looks interesting. I will have a look in details and let youknow.Best,Dr Mich TalebzadehLinkedIn * https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8P...
   Author: Mich Talebzadeh , 2018-12-19, 17:09
Spark job on dataproc failing with Exception in thread "main" java.lang.NoSuchMethodError: com.googl - Spark - [mail # user]
...Anyone in Spark user group seen this error in case?ThanksDr Mich TalebzadehLinkedIn * https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw*http://talebzadehmich.w...
   Author: Mich Talebzadeh , 2018-12-20, 10:40
spark hive concurrency - Spark - [mail # user]
...That assertion seems to be true. Spark does not seem to hold locks whendoing DML on a Hive table.I cannot recall whether I checked it in previous versions of Spark.However, in Spark  2....
   Author: Mich Talebzadeh , 2019-04-29, 18:45
[expand - 2 more] - Spark SaveMode - Spark - [mail # user]
...I dug some of my old stuff using Spark as ETL.Regarding the question"Any reason why Spark's SaveMode doesn't have mode that ignore any PrimaryKey/Unique constraint violations?"There is no wa...
   Author: Mich Talebzadeh , 2019-07-21, 13:53
[expand - 2 more] - Spark dataset to explode json string - Spark - [mail # user]
...Hi Richard,You can use the following to read JSON data into DF. The example is readingJSON from Kafka topic          val sc = spark.sparkContext      ...
   Author: Mich Talebzadeh , 2019-07-19, 21:26
[expand - 2 more] - Reading configuration file in Spark Scala throws error - Spark - [mail # user]
...Many thanks Chris.In my Spark streaming I would like to use the config file to read theparameters in. Taking your example, I have       val globalConfig = ConfigFactory.l...
   Author: Mich Talebzadeh , 2019-08-04, 21:33
[expand - 1 more] - Hive external table not working in sparkSQL when subdirectories are present - Spark - [mail # user]
...which versions of Spark and Hive are you using.what will happen if you use parquet tables instead?HTHDr Mich TalebzadehLinkedIn * https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJ...
   Author: Mich Talebzadeh , 2019-08-06, 07:33