clear query| facets| time Search criteria: .   Results from 31 to 40 from 1036 (0.0s).
Loading phrases to help you
refine your search...
[expand - 1 more] - Writing to Aerospike from Spark with bulk write with user authentication fails - Spark - [mail # user]
...Just as an add on I see this in aerospike logApr 21 2019 17:52:24 GMT: INFO (security): (security.c:5483) permitted |client: 50.140.197.220:33466 | authenticated user: mich | action: login |...
   Author: Mich Talebzadeh , 2019-04-21, 17:59
writing into oracle database is very slow - Spark - [mail # user]
...I don't believe there is inherently anything slow writing to Oracle.This piece of code works fine for me ready a csv file from HDFS and writingit to Oracle tableimport java.sql.DriverManager...
   Author: Mich Talebzadeh , 2019-04-19, 21:36
Hive metastore service - Hive - [mail # user]
...Try thisAssuming that you are talking about Hive Thrift serverbeeline -u jdbc:hive2://rhes75:10099/defaultorg.apache.hive.jdbc.HiveDriver *-n USERNAME -p PASSWORD*  -i/home/hduser/dba/b...
   Author: Mich Talebzadeh , 2019-04-16, 21:26
Load Time from HDFS - Spark - [mail # user]
...Have you tried looking at Spark GUI to see the time it takes to load fromHDFS?Spark GUI by default runs on port 4040. However, you can set in spark-submit${SPARK_HOME}/bin/spark-submit  ...
   Author: Mich Talebzadeh , 2019-04-10, 19:32
Streaming Data - Kafka - [mail # user]
...use Spark streaming to receive topics from Kafka and process through somekind of rule engine based on incoming tickers.Sound like a variation of Lambda architecture. You have the batch layer...
   Author: Mich Talebzadeh , 2019-04-09, 21:13
[expand - 1 more] - Is there any spark API function to handle a group of companies at once in this scenario? - Spark - [mail # user]
...Fine, how do you store these Kafka tropics? Are they loaded into HDFS viaKafka --> Flume --> HDFS?Look at this simple diagram below. Replace MongoDB with Cassandra. Is thiswhat you are...
   Author: Mich Talebzadeh , 2019-04-09, 16:39
[expand - 1 more] - How to retrieve multiple columns values (in one row) to variables in Spark Scala method - Spark - [mail # user]
...Thanks Ayan!Much appreciated your help.Regards,Dr Mich TalebzadehLinkedIn * https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw*http://talebzadehmich.wordpress.c...
   Author: Mich Talebzadeh , 2019-04-06, 15:46
Where does the Driver run? - Spark - [mail # user]
...Hi,I have explained this in my following Linkedlin article "The OperationalAdvantages of Spark as a Distributed Processing Framework"An extract*2) YARN Deployment Modes*The term D*eployment ...
   Author: Mich Talebzadeh , 2019-03-28, 09:28
[expand - 1 more] - Streaming data out of spark to a Kafka topic - Spark - [mail # user]
...Hi Gabor,I will look at the link and see what it provides.Thanks,Dr Mich TalebzadehLinkedIn * https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw*http://talebzad...
   Author: Mich Talebzadeh , 2019-03-28, 09:04
Window function range between - Spark - [mail # user]
...Hi,This works for mescala> val wSpec3 =Window.partitionBy('priceInfo.getItem("ticker")).orderBy('priceInfo.getItem("timeissued").desc).rangeBetween(0,5)wSpec3: org.apache.spark.sql.expres...
   Author: Mich Talebzadeh , 2019-03-25, 21:29