Got it

The admin user cannot view Spark tasks

Latest reply: Aug 15, 2019 00:47:47 547 1 14 0 0

Hello, everyone!

This post refers to the issue that the admin user cannot view Spark tasks. The solution can be found below.

Solution

1.Check whether spark.acl.enable=true and spark.admin.acls=admin are set for the Spark task.

If the two items do not exist in the task configuration, modify them. You can set multiple users for spark.admin,acls. Submit the task again.

2. If the client has a large or small network, you can use either of the following methods:

a) Set the host address and place the host name that is in the same network segment as the big data address in front of the host address. 

2) In the configuration file, set SPARK_LOCAL_IP and spark.driver.host. The former is the IP address bound to the driver during HTTP communication, and the latter is the IP address bound to the driver during rpc communication. Submit the task again.

3. If the yarn has an automatic active/standby switchover and you can view the running tasks before the switchover, you cannot view the running status of the yarn. In this case, restart the yarn active and standby ResourceManagers.

This is my solution, you can share your solution!


admin user cannot view Spark tasks
View more
  • x
  • convention:

Comment

You need to log in to comment to the post Login | Register
Comment

Notice: To protect the legitimate rights and interests of you, the community, and third parties, do not release content that may bring legal risks to all parties, including but are not limited to the following:
  • Politically sensitive content
  • Content concerning pornography, gambling, and drug abuse
  • Content that may disclose or infringe upon others ' commercial secrets, intellectual properties, including trade marks, copyrights, and patents, and personal privacy
Do not share your account and password with others. All operations performed using your account will be regarded as your own actions and all consequences arising therefrom will be borne by you. For details, see " User Agreement."

My Followers

Login and enjoy all the member benefits

Login

Block
Are you sure to block this user?
Users on your blacklist cannot comment on your post,cannot mention you, cannot send you private messages.
Reminder
Please bind your phone number to obtain invitation bonus.