How to analyze hadoop cluster?

This article is all about to find capacity of each component in a hadoop cluster. Hit below command to check hdfs report  [cloudera@quickstart bin]$ hdfs dfsadmin -report Below are the parameters for my hadoop cluster Configured Capacity: 58479091712 (54.46 GB) It is the total capacity available to HDFS for storage. Present Capacity: 45443014656 (42.32 GB) Read More

How to setup Hadoop cluster using cloudera vm?

Cloudera released their version of hadoop for UI ,security and monitoring They also provide commercial support for hadoop distributions. Cloudera was first to offer hadoop version as package. Lets see how to install hadoop using cloudera. Visit below site to download cloudera on virtual box https://www.cloudera.com/downloads/quickstart_vms/5-13.html sign up here, after that downloading will be started Read More

What is federation in Hadoop?

Before explaining a federation concept we must know what are NameNodes, DataNodes and their functionality. HDFS follows master- slave architecture. HDFS cluster consists of a single Master called as NameNode. A master server manages the file system namespace and contains metadata information. Metadata information means mapping of data blocks to DataNodes anywhere in Rack. In Read More

The Creator

Many people today believe there is no God Atheists find it really difficult to accept the fact that we have a creator. They will go any length to try and explain how the universe was created and how we all just came into existence without a creator and ironically call themselves rational thinkers. Let me Read More