Got it

The Rate of Generating Dirty Pages in the VM Memory Is Greater Than the Transmission Bandwidth

Latest reply: May 23, 2022 05:35:07 547 15 7 0 0

Hello everyone!


In this post I would like to share with you a case about the issue that the VM migration fails because the generation rate of dirty pages in the VM memory is higher than the transmission bandwidth. Do find the solution as you read further down.


ISSUE DESCRIPTION


Some engineers perform a live migration on a VM. The VM is not successfully migrated for two hours, while the VM status is Migrating.


ISSUE ANALYSIS


1. Ran the below command to check the VM ID:


nova list | grep vm_name


2. Ran the below command to check the VM request ID:


nova instance-action-list VMID


3. Ran the below command to check the VM migrate status:


nova instance-action VMID VM request ID


nova instance-action VMid req-552dxxx


4. Queried the nova-compute logs of the source and migration host where the VM resided:


cd /var/log/fusionsphere/component/nova-compute/ 

nova-compute_error.log.100


nova log


5. Ran the below command to check the VM instance ID:


nova show VMID | grep instance


6. Logged in to the source host where the VM resided. According to the command output, the dirty page data of the VM was constantly being migrated and could not be migrated:


memory bandwidth


ROOT CAUSE


The generation rate of dirty pages in the VM memory is higher than the transmission bandwidth.


SOLUTION DESCRIPTION


The following workarounds are provided.


Terminate live migration

1. Log in to the controller node and run the below command to query the ID of the VM migration task whose status is running. VMID indicates the VM ID:


nova migration-list|grep VMID


2. Run the below command to manually stop the live migration. In the command, taskID is the migration task ID obtained in step 1:


nova live-migration-abort VMID taskID


3. Run the command queried in step 1 to check whether the live migration is stopped successfully.


Manually pausing dirty pages to complete live migration

1. Log in to the compute node where the VM resides and run the below command to query the instance ID of the VM to be migrated based on the instance name obtained in step 6:


virsh list


virsh list


2. Run the below command to pause the generation of dirty pages for several seconds to complete the live migration. In the command, instanceID is the ID corresponding to instance-name of the VM in step 1 and the second is the number of seconds to pause the generation of dirty pages:


virsh suspend instanceID;sleep second;virsh resume instanceID


virsh suspend 14;sleep 1;virsh resume 14;


3. Run the below command to check whether the migration is complete:


nova migration-list|grep VMID


This is my solution, how about yours? Go ahead and share it with us!

  • x
  • convention:

pupu.F
Created Apr 25, 2022 05:52:32

Good case!
View more
  • x
  • convention:

olive.zhao
olive.zhao Created Apr 26, 2022 00:41:19 (0) (0)
Thanks!  
wissal
MVE Created Apr 25, 2022 06:32:19

Very important solution to know, good job
View more
  • x
  • convention:

olive.zhao
olive.zhao Created Apr 26, 2022 00:41:25 (0) (0)
Thanks!  
Saqibaz
Created Apr 25, 2022 18:12:10

Thank you for sharing.
View more
  • x
  • convention:

olive.zhao
olive.zhao Created Apr 26, 2022 00:41:32 (0) (0)
 
MahMush
Moderator Author Created Apr 29, 2022 15:24:54

Valuable content for users
View more
  • x
  • convention:

MahMush
Moderator Author Created Apr 29, 2022 15:25:12

Thank you for sharing this case
View more
  • x
  • convention:

olive.zhao
olive.zhao Created May 7, 2022 08:31:52 (0) (0)
 
Suhail
Created May 21, 2022 08:57:49

Thanks for sharing
View more
  • x
  • convention:

olive.zhao
olive.zhao Created May 23, 2022 00:50:33 (0) (0)
 
LaikanBegam
Created May 23, 2022 05:24:33

good.
View more
  • x
  • convention:

olive.zhao
olive.zhao Created May 24, 2022 00:40:44 (0) (0)
Thanks for your support!  
hanhcao
Created May 23, 2022 05:35:07

Great share
View more
  • x
  • convention:

olive.zhao
olive.zhao Created May 24, 2022 00:40:30 (0) (0)
Thanks!  

Comment

You need to log in to comment to the post Login | Register
Comment

Notice: To protect the legitimate rights and interests of you, the community, and third parties, do not release content that may bring legal risks to all parties, including but are not limited to the following:
  • Politically sensitive content
  • Content concerning pornography, gambling, and drug abuse
  • Content that may disclose or infringe upon others ' commercial secrets, intellectual properties, including trade marks, copyrights, and patents, and personal privacy
Do not share your account and password with others. All operations performed using your account will be regarded as your own actions and all consequences arising therefrom will be borne by you. For details, see " User Agreement."

My Followers

Login and enjoy all the member benefits

Login

Block
Are you sure to block this user?
Users on your blacklist cannot comment on your post,cannot mention you, cannot send you private messages.
Reminder
Please bind your phone number to obtain invitation bonus.
Information Protection Guide
Thanks for using Huawei Enterprise Support Community! We will help you learn how we collect, use, store and share your personal information and the rights you have in accordance with Privacy Policy and User Agreement.