Got it

WorkLoad Getting Started

Latest reply: Dec 2, 2021 05:27:11 330 1 2 0 0

Hello everyone, 

I believe you can learn how to deal with WorkLoad Getting Started from my case.


What can workLoad do?

WorkLoad focuses on platform load collection, analysis, and management. Enhances load visibility, improves application performance, and greatly optimizes system resource allocation.




What is an SLA?

Service level agreements (SLAs) specify acceptable levels of performance and services in an online transaction processing environment. SLAs include average response time and system availability, and SLAs cover only business hours.



Who are users of workLoad?

System administrators, architects, data engineers/SQL engineers, and O&M personnel



What Are the Differences Between WorkLoad and Manager Monitoring?

Manager monitoring is a system-level task that analyzes services based on different roles.

WorkLoad management focuses on batch jobs and SQL queries, and focuses on the application level.



What is the main analysis of workLoad?

- Number of concurrent queries in a time period.

- Which SQL statements occupy more resources?

- How many queries a user submits in a workday and whether the query time meets expectations.



What are the pain points addressed by workLoad?

When a job exception is detected, many services need to be redirected to view logs, which contains a large amount of information. The workload automatically analyzes logs, sets SQL health standards, automatically extracts useful information from logs, and tags jobs.



What is the deployment mode of workLoad?

- Dual-cluster deployment: A cluster is deployed outside the production cluster for load analysis and display.

- Equivalent to a small real-time reporting system that continuously consumes load data from the production cluster in real time.



What components does workLoad use for analysis?

- Data obtained from the production cluster is stored in the HBase.

- Use Phoenix to filter and label data.

- Use impala for aggregation analysis.



Which components are analyzed by workLoad?

Collect five types of data using the telemetry publisher.

Type 1: query profile file of impala queries

Type 2: Hive queries extract the latest query details file of the Hive server.

Type 3: Spark applications use REST APIs to extract event logs from the SHS.

Type 4: MapReduce Jobs Extract Jhist and XML File Records from JHS Through REST APIs

Category 5: Oozie workflows proactively extract Oozie workflow running records through REST APIs.


I hope it is helpful to you!


  • x
  • convention:

MahMush
Moderator Author Created Dec 2, 2021 05:27:11

helpful information...really amazing
View more
  • x
  • convention:

Comment

You need to log in to comment to the post Login | Register
Comment

Notice: To protect the legitimate rights and interests of you, the community, and third parties, do not release content that may bring legal risks to all parties, including but are not limited to the following:
  • Politically sensitive content
  • Content concerning pornography, gambling, and drug abuse
  • Content that may disclose or infringe upon others ' commercial secrets, intellectual properties, including trade marks, copyrights, and patents, and personal privacy
Do not share your account and password with others. All operations performed using your account will be regarded as your own actions and all consequences arising therefrom will be borne by you. For details, see " User Agreement."

My Followers

Login and enjoy all the member benefits

Login

Block
Are you sure to block this user?
Users on your blacklist cannot comment on your post,cannot mention you, cannot send you private messages.
Reminder
Please bind your phone number to obtain invitation bonus.
Information Protection Guide
Thanks for using Huawei Enterprise Support Community! We will help you learn how we collect, use, store and share your personal information and the rights you have in accordance with Privacy Policy and User Agreement.