Subject: Re: Parallel ALS-WR on very large matrix -- crashing (I think)


Your parameters look good, except if you have binary data, you should
set --implicitFeedback=true. You could also set numFeatures to a very
small value (like 5) just to see if that helps.

The mappers load one of the feature matrices into memory which are dense
(#items x #features entries or #users x #features entries). Are you sure
that the mappers have enough memory for that?

It's really strange that you have problems with such small data, I
tested this with Netflix (> 100M non-zeros) on a few machines and it
worked quite well.

--sebastian

On 02.02.2012 17:25, Nicholas Kolegraff wrote: