What to check after servers power off unexpectedly and then power on again? (Q&A)

This post explains what to check after servers power off unexpectedly and then power on again. Please see below.

If servers are powered off unexpectedly and then powered on, you are advised to check the service running status in the following sequence and take measures based on the suggestions.

1. Check the Agile Controller-Campus status.

2. In 20 minutes after the server power-on, log in to the Agile Controller-Campus using the admin account.

   If the login fails, wait for 10 minutes and try again. If the login fails again, contact technical support personnel.

3. Choose System > Maintain > ClusterMonitor > Cluster Management > Cluster Monitor from the main menu.

4. Click before each node in sequence to check the node and service running status.

   Normally, the status of all cluster nodes is Normal, as shown in the following figure. If the status if not Normal, contact technical support personnel.

   

Check the FusionInsight status.  

1. Log in to the FusionInsight Manager using the admin account (https://<FusionInsight management node float ip>:28443/web, default password: Huawei12#$).

2. Check the running status of the FusionInsight.

   If both of the following conditions are met, the FusionInsight cluster status is normal. Otherwise, troubleshoot the fault according to Fault Management in FusionInsight HD V100R002C60U20 Product Documentation. If the fault persists, contact technical support personnel.

      

• Click Services, and ensure that Health Status of each service is Good, as shown in the following figure.

  

• Click Hosts, and ensure that Health Status of each host is Good, as shown in the following figure.

  

Perform a health check for the FusionInsight.

NOTE:    

For description of health check indicators, see FusionInsight HD V100R002C60U20 Health Check Guide.

1. Click Services, and choose More Actions > Start Cluster Health Check to start the health check for cluster.

   

   To export the health check result, click Export in the upper left corner.

2. Click Hosts, select the check box on the left of the target host, and choose More Actions > Start Host Health Check to start the health check for the host.

   

   To export the health check result, click Export in the upper left corner.

Check the FusionInsight tenant list and user list.

If both of the following conditions are met, the FusionInsight cluster is in the normal state.    

NOTE:    

If the tenant and user information cannot be displayed, rectify the fault by performing the following steps:

• Click Tenant. You can view the tenant information.

  

• Click System and choose Configuration > Rights Configuration. On the displayed page, click User Management. You can view the user information.

  

1. Use the PuTTY to log in to the active management node as the omm user.

2. Run the sh ${BIGDATA_HOME}/om-0.0.1/sbin/restart-controller.sh command to restart the Controller component of the FusionInsight Manager.

   If the value of ResHAStatus is Normal in the command output, log in to the FusionInsight Manager again and check whether the fault is rectified. If the fault persists, contact technical support personnel.

Check the number of alarms in the upper right corner of the FusionInsight Manager GUI.

In normal scenarios, the number of various alarms is 0. If the number of a type of alarms is not 0, click the number. In the Operation column, click and perform operations according to Procedure.

If no exception is found in the previous steps, the system is running properly.