clear query| facets| time Search criteria: .   Results from 1 to 5 from 5 (0.0s).
Loading phrases to help you
refine your search...
Checkpointing clarifications - Spark - [mail # dev]
...Good morning,I have a large scale job that for certain size of input breaks so I amtrying to play with checkpointing to split the DAG and understand theproblematic point. I have some questio...
   Author: Alessandro Liparoti , 2018-09-20, 14:15
Spark sql syntax checker - Spark - [mail # dev]
...Hi everyone,I am building a framework on top of Spark in which users specify sqlqueries and we analyze them in order to extract some metadata. Moreover,sql queries can be composed, meaning t...
   Author: Alessandro Liparoti , 2018-08-03, 10:39
Spark FAIR Scheduler vs FIFO Scheduler - Spark - [mail # dev]
...Good morning,I have a conceptual question. In an application I am working on, when Iwrite to HDFS some results (*action 1*), I use ~30 executors out of 200. Iwould like to improve resource u...
   Author: Alessandro Liparoti , 2018-06-18, 15:27
Writing to HDFS and cluster utilization - Spark - [mail # dev]
...Hi,I would like to briefly present you my use case and gather possible usefulsuggestions from the community. I am developing a spark job which massivelyread from and write to Hive. Usually, ...
   Author: Alessandro Liparoti , 2018-06-15, 13:02
Spark issue 20236 - overwrite a partitioned data srouce - Spark - [mail # dev]
...Good morning,I am trying to see how this bug affects the write in spark 2.2.0, but Icannot reproduce it. Is it ok then using the codedf.write.mode(SaveMode.Overwrite).insertInto("table_name"...
   Author: Alessandro Liparoti , 2018-06-14, 13:57