clear query| facets| time Search criteria: .   Results from 1 to 10 from 171 (0.0s).
Loading phrases to help you
refine your search...
IncompatibleClassChangeError trying to run spark pipeline - Crunch - [mail # user]
...The next thing to check is if you are mixing versions of Scala (2.11 vs2.12)  Or more specifically if you are compiling against a differentversion than is being packaged in your assembl...
   Author: Micah Whitacre , 2018-04-27, 20:06
[CRUNCH-660] FileTargetImpl uses Distcp vs FileUtils.copy - Crunch - [issue]
...So for handling multiple runtimes I'm not sure there is a way to solve this but documenting as a JIRA regardless.If you are running in a multi-cluster environment where you might want to rea...    Author: Micah Whitacre , 2017-12-11, 15:02
[expand - 1 more] - Regarding Combine File Flag for Sequence Files - Crunch - [mail # user]
...Yes the double negative to enable combining the small files is a bit on theconfusing side.  I think that the SeqFileTableSource combining small filesby default is an oversight versus in...
   Author: Micah Whitacre , 2017-04-18, 02:19
[CRUNCH-611] Simplified Kafka Offset Management in HDFS - Crunch - [issue]
...With the KafkaSource the responsibility of offset management is the burden of the consumer.  With some simple APIs it is actually trivial to support read/storing these offsets in an HDF...    Author: Micah Whitacre , 2017-02-26, 18:33
[CRUNCH-629] Kafka source pulling is aggressive - Crunch - [issue]
...In the KafkaRecordReader certain operations are a bit aggressive due to improper order of operations in the if statements....    Author: Micah Whitacre , 2017-02-26, 18:33
[CRUNCH-621] Kafka no data to consume could get stuck - Crunch - [issue]
...With the KafkaSource and specifically the KafkaRecordReader, if there is no data to consume from a partition because all data fell off Kafka then we can end up in a situation where the Kafka...    Author: Micah Whitacre , 2017-02-26, 18:33
[CRUNCH-617] Better exception when Partition Leader not found - Crunch - [issue]
...We can get a NPE on this line[1] when the BrokerEndpoint response is null.Easiest solution is to defensively detect this and then throw an exception clearly stating the issue.[1&...    Author: Micah Whitacre , 2017-02-26, 18:33
[CRUNCH-628] Upgrade to Kafka - Crunch - [issue]
...Upgrading crunch-kafka from 0.9.x to 0.10.x.  This will require the Kafka cluster is going to be 0.10.x or higher but also that on the classpath are the 0.10.x binaries due to API non-p...    Author: Micah Whitacre , 2017-02-26, 18:33
[CRUNCH-609] KafkaSource could skip data with slow broker response - Crunch - [issue]
...In the case of the consumer.poll timing out, the KafkaRecordReader could return with no values in the records iterator which then causes the KafkaRecordReader to exit prematurely[1]....    Author: Micah Whitacre , 2017-02-26, 18:33
[CRUNCH-606] Create a KafkaSource - Crunch - [issue]
...Pulling data out of Kafka is a common use case and some of the ways to do it Kafka Connect, Camus, Gobblin do not integrate nicely with existing processing pipelines like Crunch.  With ...    Author: Micah Whitacre , 2017-02-26, 18:33