Category: Java

Most common action type you will find in oozie workflow is <map-reduce> action type. In this blog we will see how to define a map-reduce action type. the

We have already seen how to convert a text file to Avro data file using a simple java program. In this blog we will see how to process

Your reading schema doesn’t has to be same as that of the writing schema. You can add new fields or remove the existing fields(projection). If a new field

Avro defines a sort order for the objects. For most of the types it is natural ordering (for example ascending in case of int) . All the types

In this blog we will see how to create a standalone java application that will run on spark cluster, we will also learn how to use spark-submit tool

Avro Data Files are portable across platforms. You can read the Data Files written by java program from a python program. Data Files carry the schema with them.In

Avro DataFiles are binary files that carry the schema with them. They are splittable and  allows seeking to a random position. You can sync with record boundary . You need

In this blog we will how to read a Sequence file and convert a text file to a sequence file using a java program. Sequence Files : Data

The unit tests has to be fast, so the feedback time will be less and encourage developers to run unit tests for every change they make to the

We have already seen how to use Junit to write unit tests for your java classes. There is specialized test suite for testing mapreduce jobs, known as MRUnit.