clear query| facets| time Search criteria: *:*.   Results from 1 to 10 from 1421 (0.0s).
Loading phrases to help you
refine your search...
Memory allocation - Spark - [mail # user]
...I have used Spark for several years and realize from recent chatter on this list that I don’t really understand how it uses memory.Specifically is spark.executor.memory and spark.driver.memo...
   Author: Pat Ferrel , 2020-04-17, 20:07
IDE suitable for Spark - Spark - [mail # user]
...IntelliJ Scala works well when debugging master=local. Has anyone used it for remote/cluster debugging? I’ve heard it is possible...From: Luiz Camargo Reply: Luiz Camargo Date: April 7, 2020...
   Author: Pat Ferrel , 2020-04-07, 17:28
[MAHOUT-2023] Drivers broken, scopt classes not found - Mahout - [issue]
...Type `mahout spark-itemsimilarity` after Mahout is installed properly and you get a fatal exception due to missing scopt classes.Probably a build issue related to incorrect versions of scopt...
http://issues.apache.org/jira/browse/MAHOUT-2023    Author: Pat Ferrel , 2020-03-24, 21:16
PredictionIO ASF Board Report for Mar 2020 - OpenOffice - [mail # dev]
...PredictionIO is scalable BY SCALING ITS SUB-SERVICES. Running on a singlemachine sounds like no scaling has been executed or even planned.How do you scale ANY system?1) vertical scaling: mak...
   Author: Pat Ferrel , 2020-03-19, 15:50
[expand - 4 more] - k8s orchestrating Spark service - Spark - [mail # user]
...Thanks for the in depth explanation.These methods would require us to architect our Server around Spark and itis actually designed to be independent of the ML implementation. SparkML isan im...
   Author: Pat Ferrel , 2019-07-03, 23:11
[expand - 3 more] - JAVA_HOME is not set - PredictionIO - [mail # dev]
...Oops, should have said: "I may have missed something but I don’t recall PIObeing released by Apache as an ASF maintained container/image releaseartifact."From: Pat Ferrel  Reply: [EMAIL...
   Author: Pat Ferrel , 2019-07-03, 18:19
[Discuss Kubernetes] Spark with k8s orchestration - Kubernetes - [mail # user]
...We're trying to stand up a cluster with a custom server, Mongo, Elasticsearch, and Spark.We have everything but Spark working with public containers and charts. We are having quite a bit of ...
   Author: Pat Ferrel , 2019-07-01, 19:33
run new spark version on old spark cluster ? - Spark - [mail # user]
...It is always dangerous to run a NEWER version of code on an OLDER cluster.The danger increases with the semver change and this one is not just abuild #. In other word 2.4 is considered to be...
   Author: Pat Ferrel , 2019-05-20, 18:07
Fwd: Spark Architecture, Drivers, & Executors - Spark - [mail # user]
...In order to create an application that executes code on Spark we have along lived process. It periodically runs jobs programmatically on a Sparkcluster, meaning it does not use spark-submit....
   Author: Pat Ferrel , 2019-05-17, 19:27
Spark structured streaming watermarks on nested attributes - Spark - [mail # user]
...Streams have no end until watermarked or closed. Joins need boundeddatasets, et voila. Something tells me you should consider the streamingnature of your data and whether your joins need to ...
   Author: Pat Ferrel , 2019-05-06, 16:23