Job 3: Failed #5
Description
Job 3 Failed
- Compiled with SBT 1.4 on windows
- No changes to the source code
- Executed on Ubuntu WSL 2
LOG
$ hadoop jar hw2_dblp_mapred.jar 3 input
2021-05-07 19:30:59,751 INFO hw2.RunJobs$: Starting up MapReduce job..
2021-05-07 19:30:59,806 INFO client.DefaultNoHARMFailoverProxyProvider: Connecting to ResourceManager at /0.0.0.0:8032
2021-05-07 19:31:00,034 WARN mapreduce.JobResourceUploader: Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
2021-05-07 19:31:00,135 INFO mapreduce.JobResourceUploader: Disabling Erasure Coding for path: /tmp/hadoop-yarn/staging/hduser/.staging/job_1620420770486_0003
2021-05-07 19:31:02,476 INFO input.FileInputFormat: Total input files to process : 1
2021-05-07 19:31:03,467 INFO mapreduce.JobSubmitter: number of splits:24
2021-05-07 19:31:03,717 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1620420770486_0003
2021-05-07 19:31:03,717 INFO mapreduce.JobSubmitter: Executing with tokens: []
2021-05-07 19:31:03,837 INFO conf.Configuration: resource-types.xml not found
2021-05-07 19:31:03,838 INFO resource.ResourceUtils: Unable to find 'resource-types.xml'.
2021-05-07 19:31:03,880 INFO impl.YarnClientImpl: Submitted application application_1620420770486_0003
2021-05-07 19:31:03,905 INFO mapreduce.Job: The url to track the job: http://DESKTOP-Marcos.localdomain:8088/proxy/application_1620420770486_0003/
2021-05-07 19:31:03,905 INFO mapreduce.Job: Running job: job_1620420770486_0003
2021-05-07 19:31:09,963 INFO mapreduce.Job: Job job_1620420770486_0003 running in uber mode : false
2021-05-07 19:31:09,964 INFO mapreduce.Job: map 0% reduce 0%
2021-05-07 19:31:23,130 INFO mapreduce.Job: Task Id : attempt_1620420770486_0003_m_000000_0, Status : FAILED
Error: java.util.NoSuchElementException: head of empty list
at scala.collection.immutable.Nil$.head(List.scala:629)
at scala.collection.immutable.Nil$.head(List.scala:628)
at com.samujjwaal.hw2.mappers.VenueTopPubMapper.map(VenueTopPubMapper.scala:28)
at com.samujjwaal.hw2.mappers.VenueTopPubMapper.map(VenueTopPubMapper.scala:8)
at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:146)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:799)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:347)
at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:178)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1845)
at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:172)
2021-05-07 19:31:33,230 INFO mapreduce.Job: map 1% reduce 0%
2021-05-07 19:31:36,262 INFO mapreduce.Job: Task Id : attempt_1620420770486_0003_m_000000_1, Status : FAILED
Error: java.util.NoSuchElementException: head of empty list
at scala.collection.immutable.Nil$.head(List.scala:629)
at scala.collection.immutable.Nil$.head(List.scala:628)
at com.samujjwaal.hw2.mappers.VenueTopPubMapper.map(VenueTopPubMapper.scala:28)
at com.samujjwaal.hw2.mappers.VenueTopPubMapper.map(VenueTopPubMapper.scala:8)
at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:146)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:799)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:347)
at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:178)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1845)
at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:172)
2021-05-07 19:31:52,422 INFO mapreduce.Job: map 2% reduce 0%
2021-05-07 19:32:10,556 INFO mapreduce.Job: map 3% reduce 0%
2021-05-07 19:32:22,884 INFO mapreduce.Job: map 4% reduce 0%
2021-05-07 19:32:39,991 INFO mapreduce.Job: map 5% reduce 0%
2021-05-07 19:32:52,045 INFO mapreduce.Job: map 6% reduce 0%
2021-05-07 19:33:07,146 INFO mapreduce.Job: map 7% reduce 0%
2021-05-07 19:33:22,240 INFO mapreduce.Job: map 8% reduce 0%
2021-05-07 19:33:34,302 INFO mapreduce.Job: map 9% reduce 0%
2021-05-07 19:33:52,393 INFO mapreduce.Job: map 10% reduce 0%
2021-05-07 19:34:00,436 INFO mapreduce.Job: Task Id : attempt_1620420770486_0003_m_000006_0, Status : FAILED
Error: java.util.NoSuchElementException: head of empty list
at scala.collection.immutable.Nil$.head(List.scala:629)
at scala.collection.immutable.Nil$.head(List.scala:628)
at com.samujjwaal.hw2.mappers.VenueTopPubMapper.map(VenueTopPubMapper.scala:28)
at com.samujjwaal.hw2.mappers.VenueTopPubMapper.map(VenueTopPubMapper.scala:8)
at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:146)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:799)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:347)
at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:178)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1845)
at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:172)
2021-05-07 19:34:01,445 INFO mapreduce.Job: map 9% reduce 0%
2021-05-07 19:34:10,480 INFO mapreduce.Job: map 10% reduce 0%
2021-05-07 19:34:10,481 INFO mapreduce.Job: Task Id : attempt_1620420770486_0003_m_000000_2, Status : FAILED
Error: java.util.NoSuchElementException: head of empty list
at scala.collection.immutable.Nil$.head(List.scala:629)
at scala.collection.immutable.Nil$.head(List.scala:628)
at com.samujjwaal.hw2.mappers.VenueTopPubMapper.map(VenueTopPubMapper.scala:28)
at com.samujjwaal.hw2.mappers.VenueTopPubMapper.map(VenueTopPubMapper.scala:8)
at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:146)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:799)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:347)
at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:178)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1845)
at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:172)
2021-05-07 19:34:11,492 INFO mapreduce.Job: Task Id : attempt_1620420770486_0003_m_000005_0, Status : FAILED
Error: java.util.NoSuchElementException: head of empty list
at scala.collection.immutable.Nil$.head(List.scala:629)
at scala.collection.immutable.Nil$.head(List.scala:628)
at com.samujjwaal.hw2.mappers.VenueTopPubMapper.map(VenueTopPubMapper.scala:28)
at com.samujjwaal.hw2.mappers.VenueTopPubMapper.map(VenueTopPubMapper.scala:8)
at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:146)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:799)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:347)
at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:178)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1845)
at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:172)
2021-05-07 19:34:12,497 INFO mapreduce.Job: map 8% reduce 0%
2021-05-07 19:34:22,571 INFO mapreduce.Job: map 100% reduce 100%
2021-05-07 19:34:24,579 INFO mapreduce.Job: Job job_1620420770486_0003 failed with state FAILED due to: Task failed task_1620420770486_0003_m_000000
Job failed as tasks failed. failedMaps:1 failedReduces:0 killedMaps:0 killedReduces: 0
2021-05-07 19:34:24,627 INFO mapreduce.Job: Counters: 14
Job Counters
Failed map tasks=6
Killed map tasks=23
Killed reduce tasks=1
Launched map tasks=11
Other local map tasks=4
Data-local map tasks=7
Total time spent by all maps in occupied slots (ms)=1135720
Total time spent by all reduces in occupied slots (ms)=0
Total time spent by all map tasks (ms)=1135720
Total vcore-milliseconds taken by all map tasks=1135720
Total megabyte-milliseconds taken by all map tasks=1162977280
Map-Reduce Framework
CPU time spent (ms)=0
Physical memory (bytes) snapshot=0
Virtual memory (bytes) snapshot=0