Got it

What's the difference between Spark SQL and Hive?

Created: Jan 20, 2022 12:21:26Latest reply: Feb 3, 2022 14:10:56 241 4 0 0 0
  HiCoins as reward: 0 (problem unresolved)

Hello, team!

What's the difference between Spark SQL and Hive?


  • x
  • convention:

Featured Answers
olive.zhao
Admin Created Jan 20, 2022 12:24:13

Hello, friend!

Have a nice day!

Differences:

  • The execution engine of Spark SQL is Spark Core, and the default execution engine of Hive is MapReduce.

  • The execution speed of Spark SQL is 10 to 100 times faster than Hive.

  • Spark SQL does not support buckets, but Hive supports.

Relationships:

  • Spark SQL depends on the metadata of Hive.

  • Spark SQL is compatible with most syntax and functions of Hive.

  • Spark SQL can use the custom functions of Hive.

Hope this helps!


View more
  • x
  • convention:

All Answers
olive.zhao
olive.zhao Admin Created Jan 20, 2022 12:24:13

Hello, friend!

Have a nice day!

Differences:

  • The execution engine of Spark SQL is Spark Core, and the default execution engine of Hive is MapReduce.

  • The execution speed of Spark SQL is 10 to 100 times faster than Hive.

  • Spark SQL does not support buckets, but Hive supports.

Relationships:

  • Spark SQL depends on the metadata of Hive.

  • Spark SQL is compatible with most syntax and functions of Hive.

  • Spark SQL can use the custom functions of Hive.

Hope this helps!


View more
  • x
  • convention:

lisali
lisali Created Jan 20, 2022 12:25:35

Hi, 

see Spark SQL vs Hive.


View more
  • x
  • convention:

Saqibaz
Saqibaz Created Jan 21, 2022 18:03:22

Thanks
View more
  • x
  • convention:

Unicef
Unicef MVE Created Feb 3, 2022 14:10:56

NOTE
View more
  • x
  • convention:

Comment

You need to log in to comment to the post Login | Register
Comment

Notice: To protect the legitimate rights and interests of you, the community, and third parties, do not release content that may bring legal risks to all parties, including but are not limited to the following:
  • Politically sensitive content
  • Content concerning pornography, gambling, and drug abuse
  • Content that may disclose or infringe upon others ' commercial secrets, intellectual properties, including trade marks, copyrights, and patents, and personal privacy
Do not share your account and password with others. All operations performed using your account will be regarded as your own actions and all consequences arising therefrom will be borne by you. For details, see " User Agreement."

My Followers

Login and enjoy all the member benefits

Login

Block
Are you sure to block this user?
Users on your blacklist cannot comment on your post,cannot mention you, cannot send you private messages.
Reminder
Please bind your phone number to obtain invitation bonus.
Information Protection Guide
Thanks for using Huawei Enterprise Support Community! We will help you learn how we collect, use, store and share your personal information and the rights you have in accordance with Privacy Policy and User Agreement.