Hello everyone!
In this post I would like to share with you a case about how to tackle the issue of the cinder-volume component of the new HCS storage pool being faulty. Please check it out below.
DIAGNOSTIC
Onsite HCS 6.5.1SPH7, a new storage pool is connected to the x86 AZ. After the storage pool is connected, the alarm component on the OM portal is faulty. The cinder-volume service on the host displays a fault, as shown in the below picture:
ANALYSIS PROCESS
1. Logged in to the node where the cinder-volume service is deployed and view the cinder-volume_error.log file. An error message was displayed indicating that the driver failed to be initialized and that the DSWARE query dsware version failed! was displayed, as shown in the below screenshot:
2. Checked the /var/log/fsc_cli/fsc_cli.log log. No new log is displayed. Check the FSC process. No related process is displayed, as shown in the following figure.
3. Ran the fsc_cli startService command as user root to start the FSC process. The following information was displayed:
4. After attempting to switch to the openstack user, the FSC process could not be started. The user and user group with the corresponding directory permission were displayed as root, as shown in the below screenshot:
However, the file in the corresponding directory was openstack:openstack:
As a result, the OpenStack user did not have permission to access the /usr/bin/lib and /usr/bin/conf directories. As a result, the FSC process could not be started.
PROCESS
Perform the below operations on each node where cinder-volume-kvmXXX resides:
1. Modify all users and user groups in the /usr/bin/lib and /usr/bin/conf directories.
2. Run the following command:
chown openstack:openstack /usr/bin/lib/
chown openstack:openstack /usr/bin/conf/
Restart the service on only one node.
3. Restart the cinder-volume service:
cps host-template-instance-operate --service cinder cinder-volume-kvmXXX --action stop
cps host-template-instance-operate --service cinder cinder-volume-kvmXXX --action start
This is my solution, thanks for reading!