clear query| facets| time Search criteria: .   Results from 41 to 50 from 1034 (0.0s).
Loading phrases to help you
refine your search...
Using Spark as an ETL tool for moving data from Hive tables to BigQuery - Spark - [mail # user]
...Hi,To move data from Hive to Google BigQuery, one needs to create a stagingtable in Hive in a storage format that can be read in BigQuery. Both AVROand ORC file format in Hive work but the f...
   Author: Mich Talebzadeh , 2019-01-03, 10:02
Spark job on dataproc failing with Exception in thread "main" java.lang.NoSuchMethodError: com.googl - Spark - [mail # user]
...Anyone in Spark user group seen this error in case?ThanksDr Mich TalebzadehLinkedIn * https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw*http://talebzadehmich.w...
   Author: Mich Talebzadeh , 2018-12-20, 10:40
[expand - 2 more] - Spark Scala reading from Google Cloud BigQuery table throws error - Spark - [mail # user]
...Thanks Sam. Looks interesting. I will have a look in details and let youknow.Best,Dr Mich TalebzadehLinkedIn * https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8P...
   Author: Mich Talebzadeh , 2018-12-19, 17:09
[expand - 3 more] - Drawing Big Data tech diagrams using Pen Tablets - Spark - [mail # user]
...Hi all,I invested in Wacom Intuos  tablet thatallows me to draw freefall diagrams on paper. The diagrams are based on asubset of drawings provided by Inkscape   thatallows free dra...
   Author: Mich Talebzadeh , 2018-11-05, 17:44
Local vs Cluster - Spark - [mail # user]
...Local only one JVM, runs on the host you submitted the job${SPARK_HOME}/bin/spark-submit \                  --master local[N] \ Standalone m...
   Author: Mich Talebzadeh , 2018-09-14, 08:36
[expand - 1 more] - Need info - Kafka - [mail # user]
...Hi James,As a matter of interest this streaming data is fed into some OperationalData Store ODS) like MongoDB?In general using this method will create a near real time snapshot forbusiness u...
   Author: Mich Talebzadeh , 2018-09-12, 17:34
[expand - 1 more] - Using MongoDB as an Operational Data Store (ODS) with Spark Streaming - Spark - [mail # user]
...Hi,Thanks for colleagues who made great suggestions.In my notes below I raised the concern about the speed of writes from Sparkto MongoDB (standalone version).I was doing looping over RDD ro...
   Author: Mich Talebzadeh , 2018-09-09, 18:58
How to retreive data from nested json use dataframe - Spark - [mail # user]
...Hi Tony,Try something like below with two class definitionscase class Address(building: String, coord: Array[Double], street: String,zipcode: String)case class Restaurant(address: Address, b...
   Author: Mich Talebzadeh , 2018-09-08, 15:00
[expand - 8 more] - getting error: value toDF is not a member of Seq[columns] - Spark - [mail # user]
...Ok somehow this worked!             // Save prices to mongoDB collection             val document = sparkContext.paralle...
   Author: Mich Talebzadeh , 2018-09-06, 16:45
[expand - 1 more] - Reading mongoDB collection in Spark with arrays - Spark - [mail # user]
...Hi,This is a way to solve it using function (array_contains(...))scala> *inventory.where (array_contains(inventory("tags"),"blue")).show*+--------+--------------------+-------+-------+---...
   Author: Mich Talebzadeh , 2018-09-02, 16:39