HDP 2.2 RMR2 MR2 Error: Java heap space

[venkata81]

Hi I am trying to work on word count example with all new versions HADOOP and R I am getting below error.

Please help thanks in advance

15/01/28 19:56:47 INFO mapreduce.Job: Running job: job_1422488445419_0003
15/01/28 19:56:53 INFO mapreduce.Job: Job job_1422488445419_0003 running in uber mode : false
15/01/28 19:56:53 INFO mapreduce.Job: map 0% reduce 0%
15/01/28 19:56:57 INFO mapreduce.Job: Task Id : attempt_1422488445419_0003_m_000001_0, Status : FAILED
Error: Java heap space
15/01/28 19:56:57 INFO mapreduce.Job: Task Id : attempt_1422488445419_0003_m_000000_0, Status : FAILED
Error: Java heap space
15/01/28 19:57:00 INFO mapreduce.Job: Task Id : attempt_1422488445419_0003_m_000001_1, Status : FAILED
Error: Java heap space
15/01/28 19:57:01 INFO mapreduce.Job: Task Id : attempt_1422488445419_0003_m_000000_1, Status : FAILED
Error: Java heap space
15/01/28 19:57:06 INFO mapreduce.Job: Task Id : attempt_1422488445419_0003_m_000001_2, Status : FAILED
Error: Java heap space
15/01/28 19:57:06 INFO mapreduce.Job: Task Id : attempt_1422488445419_0003_m_000000_2, Status : FAILED
Error: Java heap space
15/01/28 19:57:11 INFO mapreduce.Job: map 100% reduce 100%
15/01/28 19:57:11 INFO mapreduce.Job: Job job_1422488445419_0003 failed with state FAILED due to: Task failed task_1422488445419_0003_m_000001
Job failed as tasks failed. failedMaps:1 failedReduces:0

15/01/28 19:57:12 INFO mapreduce.Job: Counters: 13
Job Counters
Failed map tasks=7
Killed map tasks=1
Launched map tasks=8
Other local map tasks=6
Data-local map tasks=2
Total time spent by all maps in occupied slots (ms)=21018
Total time spent by all reduces in occupied slots (ms)=0
Total time spent by all map tasks (ms)=21018
Total vcore-seconds taken by all map tasks=21018
Total megabyte-seconds taken by all map tasks=43044864
Map-Reduce Framework
CPU time spent (ms)=0
Physical memory (bytes) snapshot=0
Virtual memory (bytes) snapshot=0
15/01/28 19:57:12 ERROR streaming.StreamJob: Job not successful!
Streaming Command Failed!
Error in mr(map = map, reduce = reduce, combine = combine, vectorized.reduce, :
hadoop streaming failed with error code 1

[piccolbo]

Did you read help(hadoop.settings)? If you haven't please try what is
suggested there or let me know how you configured memory-related settings.
Thanks

On Wed, Jan 28, 2015 at 6:17 PM, venkata81 [email protected] wrote:

Hi I am trying to work on word count example with all new versions HADOOP
and R I am getting below error.

Please help thanks in advance

15/01/28 19:56:47 INFO mapreduce.Job: Running job: job_1422488445419_0003
15/01/28 19:56:53 INFO mapreduce.Job: Job job_1422488445419_0003 running
in uber mode : false
15/01/28 19:56:53 INFO mapreduce.Job: map 0% reduce 0%
15/01/28 19:56:57 INFO mapreduce.Job: Task Id :
attempt_1422488445419_0003_m_000001_0, Status : FAILED
Error: Java heap space
15/01/28 19:56:57 INFO mapreduce.Job: Task Id :
attempt_1422488445419_0003_m_000000_0, Status : FAILED
Error: Java heap space
15/01/28 19:57:00 INFO mapreduce.Job: Task Id :
attempt_1422488445419_0003_m_000001_1, Status : FAILED
Error: Java heap space
15/01/28 19:57:01 INFO mapreduce.Job: Task Id :
attempt_1422488445419_0003_m_000000_1, Status : FAILED
Error: Java heap space
15/01/28 19:57:06 INFO mapreduce.Job: Task Id :
attempt_1422488445419_0003_m_000001_2, Status : FAILED
Error: Java heap space
15/01/28 19:57:06 INFO mapreduce.Job: Task Id :
attempt_1422488445419_0003_m_000000_2, Status : FAILED
Error: Java heap space
15/01/28 19:57:11 INFO mapreduce.Job: map 100% reduce 100%
15/01/28 19:57:11 INFO mapreduce.Job: Job job_1422488445419_0003 failed
with state FAILED due to: Task failed task_1422488445419_0003_m_000001
Job failed as tasks failed. failedMaps:1 failedReduces:0

15/01/28 19:57:12 INFO mapreduce.Job: Counters: 13
Job Counters
Failed map tasks=7
Killed map tasks=1
Launched map tasks=8
Other local map tasks=6
Data-local map tasks=2
Total time spent by all maps in occupied slots (ms)=21018
Total time spent by all reduces in occupied slots (ms)=0
Total time spent by all map tasks (ms)=21018
Total vcore-seconds taken by all map tasks=21018
Total megabyte-seconds taken by all map tasks=43044864
Map-Reduce Framework
CPU time spent (ms)=0
Physical memory (bytes) snapshot=0
Virtual memory (bytes) snapshot=0
15/01/28 19:57:12 ERROR streaming.StreamJob: Job not successful!
Streaming Command Failed!
Error in mr(map = map, reduce = reduce, combine = combine,
vectorized.reduce, :
hadoop streaming failed with error code 1

—
Reply to this email directly or view it on GitHub
#158.

[venkata81]

Thanks for your reply. Could I know where can I read help I mean hadoop.settings. Is there any link for it?

Thanks.

[piccolbo]

It's an R expression.

On Wed, Feb 4, 2015 at 7:48 AM, venkata81 [email protected] wrote:

Thanks for your reply. Could I know where can I read help I mean
hadoop.settings. Is there any link for it?

Thanks.

—
Reply to this email directly or view it on GitHub
#158 (comment)
.