clear query| facets| time Search criteria: .   Results from 1 to 10 from 11 (0.0s).
Loading phrases to help you
refine your search...
[expand - 1 more] - Reading from HCat as Avro - Crunch - [mail # dev]
...The problem I was trying to solve was not wanting to deal with HCatRecords(which are basically GenericRecords) in the M/R code. Particularly with allthe code we (my team/org) have around tod...
   Author: Stephen Durfey , 2018-03-20, 20:35
[CRUNCH-659] Upgrade to Hive 2.x - Crunch - [issue]
...I've been working on CRUNCH-340 to finish implementing the HCatSource and HCatTarget. It seems to be in a better place now that crunch only supports hadoop 2. I was looking to target as high...    Author: Stephen Durfey , 2017-12-08, 16:27
HCatalog and Crunch named outputs - Crunch - [mail # dev]
...I've recently taken up the work efforts on CRUNCH-340 [1] to get afunctioning source and target for going against HCatalog. One of the issuesI've ran into is around named outputs being added...
   Author: Stephen Durfey , 2017-10-25, 20:57
Processing many map only collections in single pipeline with spark - Crunch - [mail # user]
...Instead of using readTextFile on the pipeline, try using the read method and use the TextFileSource, which can accept in a collection of paths.
   Author: Stephen Durfey , 2016-07-16, 02:09
[CRUNCH-588] Modify HFileUtils to flex on affected regions for hfiles, rather than all regions - Crunch - [issue]
...HFileUtils when preparing for writing HFiles sets the number of reducers  equal to the number of regions in the table, and then writes out the start keys for each region to a sequence f...    Author: Stephen Durfey , 2016-05-08, 04:14
[CRUNCH-591] Swap out deprecated usage of HTable and HTableInterface for Table and RegionLocator where applicable - Crunch - [issue]
...HTable and HTableInterface have been deprecated, and should be replaced, but passivity should be maintained. Currently, HTable is only used in HFileUtils and several ITs....    Author: Stephen Durfey , 2016-02-04, 21:34
[expand - 1 more] - Cleaning up after exceptions - Crunch - [mail # user]
...Thanks. I’ll look into that. Also, I just noticed that as of 0.8.2, crunch has a public cleanup() on the Pipeline interface. I should be able to use that, as my code was just updated to that...
   Author: Stephen Durfey , 2014-04-01, 19:02
[expand - 1 more] - crunch 0.8.2+6-cdh4.4.0 - Crunch - [mail # user]
...Attached is a unit test that emits a null avro record that causes this stack trace to occur. The file that is being read in doesn't matter as the contents are ignored. I just needed to read ...
   Author: Stephen Durfey , 2014-02-06, 17:35