Hadoop: checksum

“checksum” command returns the checksum of a file. Checksum is s simple error-detection scheme in which each transmitted message is accompanied by a numerical value based on the number of set bits in the message

Usage
hadoop fs [generic options] -checksum <src> ...

$ hadoop fs -checksum /user/harikrishna_gurram/dir1/append.txt
/user/harikrishna_gurram/dir1/append.txt MD5-of-0MD5-of-512CRC32C 0000020000000000000000005b648c18626e3d21349dd4673afbd370

Note

Create Home directory on HDFS for your current user (if not created already)

         hadoop fs -mkdir -p /user/[current login user]

        

For my system, I used command like following.

         hadoop fs -mkdir -p /user/harikrishna_gurram

Referred Articles

http://hadoop.apache.org/docs/r2.7.0/hadoop-project-dist/hadoop-common/FileSystemShell.html

Previous                                                 Next                                                 Home