ZBLOG

23/06/08 15:30:57 INFO mapreduce.Job: Counters: 35 File System Counters FILE: Number of bytes read=10112 FILE: Number of bytes written=1029545 FILE: Number of read operations=0 FILE: Number of large read operations=0 FILE: Number of wri...

This is the output of a MapReduce job. The job seems to have completed successfully, as there are no error messages in the output.

The output shows various counters that provide information about the job’s performance and resource usage. Here are some of the key counters:

  • Map input records: This counter shows how many records were read by the map function.
  • Map output records: This counter shows how many records were produced by the map function.
  • Reduce input groups: This counter shows how many unique keys were received by the reduce function.
  • Reduce input records: This counter shows how many values were received by the reduce function.
  • Reduce output records: This counter shows how many key-value pairs were produced by the reduce function.
  • Bytes Read (File Input Format Counters): This counter shows how many bytes were read from the input file(s).
  • Bytes Written (File Output Format Counters): This counter shows how many bytes were written to the output file.

In addition to these counters, there are also counters for resource usage such as CPU time and memory usage (Total committed heap usage). These can be useful for identifying performance bottlenecks or tuning your cluster configuration.

本站部分文章来源于网络,版权归原作者所有,如有侵权请联系站长删除。
转载请注明出处:https://golang.0voice.com/?id=5013

分享:
扫描分享到社交APP
上一篇
下一篇
发表列表
游客 游客
此处应有掌声~
评论列表

还没有评论,快来说点什么吧~

联系我们

在线咨询: 点击这里给我发消息

微信号:3007537140

上班时间: 10:30-22:30

关注我们
x

注册

已经有帐号?