Tag: hadoop

Avro defines a sort order for the objects. For most of the types it is natural ordering (for example ascending in case of int) . All the types

Avro Data Files are portable across platforms. You can read the Data Files written by java program from a python program. Data Files carry the schema with them.In

Avro DataFiles are binary files that carry the schema with them. They are splittable and  allows seeking to a random position. You can sync with record boundary . You need

In this blog we will how to read a Sequence file and convert a text file to a sequence file using a java program. Sequence Files : Data

We have already seen how to use Junit to write unit tests for your java classes. There is specialized test suite for testing mapreduce jobs, known as MRUnit.

In the previous we have seen how to read a file from HDFS. In this blog we will see how to write a file from local file system

Hadoop does not use the default java serialization framework for performance reasons. It has it’s own serialization format writables , which is fast and compact but not interoperable. For that hadoop

Any java program can read files from HDFS, given the dependencies. In this blog we will read a file from HDFS and print it’s contents on console. The

In this blog we will see how to create the wordcount example project in eclipse , we will be using maven as build tool. File->New->Project -> Maven Project

With the VMs available from different vendors(Cloudera, Horton Networks, MapR, etc..) it is easy to get started with the Hadoop and its related technologies. System Requirements : To