Got it

Some important features of Apache Hadoop

Latest reply: Dec 18, 2021 18:42:31 1167 27 12 0 0

Some important features of Apache Hadoop :

HI, 

Today I am sharing some useful things about Hadoop, what it actually is, where is it used and its benefits... 


Overview:

 Hadoop is an open source, Java based framework used for storing and processing big data. The data is stored on inexpensive commodity servers that run as clusters. ...

Hadoop uses the MapReduce programming model for faster storage and retrieval of data from its nodes.


Three components of Hadoop :

  1. Hadoop Distributed File System (HDFS)

  2. Hadoop MapReduce

  3. Hadoop YARN


Hadoop



When to Use Hadoop

It is used for Processing very BIG Data. When the data is huge in terabytes or petabytes of data, Hadoop is good choice then. 

  1. For Huge Data 

  2. For Storing a Diverse Set of Data

  3. For Parallel Data Processing

Hadoop parallel processing


When NOT to Use Hadoop

  1. For Real-Time Data Analysis

  2. For a Relational Database System

  3. For Non-Parallel Data Processing


Why is Hadoop important?

Ability to store and process huge amounts of any kind of data, quickly. With data volumes and varieties constantly increasing, especially from social media and the Internet of Things (IoT), that's a key consideration.

Computing power. Hadoop's distributed computing model processes big data fast. The more computing nodes you use, the more processing power you have.

Fault tolerance. Data and application processing are protected against hardware failure. If a node goes down, jobs are automatically redirected to other nodes to make sure the distributed computing does not fail. Multiple copies of all data are stored automatically.

Flexibility. Unlike traditional relational databases, you don’t have to preprocess data before storing it. You can store as much data as you want and decide how to use it later. That includes unstructured data like text, images and videos.

Low cost. The open-source framework is free and uses commodity hardware to store large quantities of data.

Scalability. You can easily grow your system to handle more data simply by adding nodes. Little administration is req uired.


Real Life Applications 

Here are some real-life examples of ways other companies are using Hadoop to their advantage.

  • Analyze life-threatening risks. ... 

  • Identify warning signs of security breaches. ... 

  • Prevent hardware failure. ... 

  • Understand what people think about your company. ... 

  • Understand when to sell certain products. ... 

  • Find your ideal prospects.

 

It provides massive storage for any kind of data, enormous processing power and the ability to handle virtually limitless concurrent tasks or Jobs 


SHARE your experience with it or any additional comment information you may have. 


Sources:


https://www.hostingadvice.com/how-to/what-is-hadoop/ 

https://hadoop.apache.org/


https://www.sas.com/en_us/insights/big-data/hadoop.html




  • x
  • convention:

stephen.xu
Admin Created Apr 30, 2021 09:37:30

Thank you!
View more
  • x
  • convention:

AliBinHussain
AliBinHussain Created Aug 1, 2021 16:35:23 (0) (0)
 
AliBinHussain
AliBinHussain Created Aug 1, 2021 16:35:31 (0) (0)
 
Unicef
MVE Created May 2, 2021 12:55:31

Very good one
View more
  • x
  • convention:

Adriale
Adriale Created May 5, 2021 13:05:09 (0) (0)
 
titusmahwe
Created May 3, 2021 08:35:05

HDFS for distributed storage, MapReduce for parallel processing and YARN for resource management. This is great. Some important features of Apache Hadoop-3917937-1

View more
  • x
  • convention:

MahMush
MahMush Created May 6, 2021 15:09:26 (0) (0)
Wow well summarized thanks for sharing useful things in comments  
MahMush
MahMush Created May 9, 2021 21:39:22 (0) (0)
https://forum.huawei.com/enterprise/en/huawei/m/ViewThread.html?tid=335269&lang=en
Check this wonderful illustration for hdfs u can get clear idea in few minutes  
NTan33
Created May 4, 2021 02:24:19

A good general introduction to Hadoop
View more
  • x
  • convention:

MahMush
MahMush Created May 6, 2021 11:31:06 (0) (0)
Yes a general introduction, we will be discussing in detail in future.. What would you like to see next..?  
ASCN
Created May 5, 2021 11:56:51

Thank you for useful short architecture to easily understand and observe. Great one
View more
  • x
  • convention:

MahMush
MahMush Created May 6, 2021 15:08:23 (0) (0)
Glad to know that you liked it, I prefer making things brief and to the point for general overview of the topic yet sometimes there's a need for details will surely be a writing a detailed one... You can pour suggestions for brief or detailed topics  
MahMush
MahMush Created May 9, 2021 21:40:30 (0) (0)
https://forum.huawei.com/enterprise/en/huawei/m/ViewThread.html?tid=335269&lang=en


Check this out u can find precise information here  
Adriale
Created May 5, 2021 13:05:22

Some important features of Apache Hadoop-3919639-1
View more
  • x
  • convention:

MahMush
Moderator Author Created May 8, 2021 08:46:27

@wissal @Vlada85 @IndianKid @BAZ @zaheernew
share your responce, also what need to be explained in detail i was planning to do the architecture.
View more
  • x
  • convention:

zaheernew
zaheernew Created May 10, 2021 07:03:42 (0) (0)
useful information  
zaheernew
MVE Author Created May 8, 2021 10:11:47

Some important features of Apache Hadoop-3922735-1
View more
  • x
  • convention:

bobi
Created May 8, 2021 11:09:33

Thanks for sharing
View more
  • x
  • convention:

MahMush
MahMush Created Jul 31, 2021 19:00:25 (0) (0)
Thanks for liking the post dear  
12
Back to list

Comment

You need to log in to comment to the post Login | Register
Comment

Notice: To protect the legitimate rights and interests of you, the community, and third parties, do not release content that may bring legal risks to all parties, including but are not limited to the following:
  • Politically sensitive content
  • Content concerning pornography, gambling, and drug abuse
  • Content that may disclose or infringe upon others ' commercial secrets, intellectual properties, including trade marks, copyrights, and patents, and personal privacy
Do not share your account and password with others. All operations performed using your account will be regarded as your own actions and all consequences arising therefrom will be borne by you. For details, see " User Agreement."

My Followers

Login and enjoy all the member benefits

Login

Block
Are you sure to block this user?
Users on your blacklist cannot comment on your post,cannot mention you, cannot send you private messages.
Reminder
Please bind your phone number to obtain invitation bonus.
Information Protection Guide
Thanks for using Huawei Enterprise Support Community! We will help you learn how we collect, use, store and share your personal information and the rights you have in accordance with Privacy Policy and User Agreement.