Got it

CE12808 video service freezes, and packet loss occurs during ping test

Latest reply: Apr 16, 2020 18:16:08 79 2 5 0

Hi, everyone! Today I’m going to introduce you how to deal with the problem that the CE12808 video service freezes, and packet loss occurs during ping test.


Issue Description


The core switch of a hospital is two stacked CE12808s, which are directly stacked by the main control. The main control SIP ports use stack management traffic. The two machine frames have 8 slots and 40G service boards.  The customer reports the service is severely stalled and there is packet loss in the uplink, and the device has a CRC check alarm.


1




Alarm information


<CE12808-CSS>


#25694/active/hwIfMonitorCrcErrorRising/Critical/occurredTime:2018-12-25 02:24/-/-/alarmID:0x081300bc/CID=0x80fc04b1:The CRC error is rising. (hwIfMonitorIndex=17305857, hwIfMonitorCrcErrorStatistics=140, hwIfMonitorCrcErrorThreshold=3, hwIfMonitorAllStatistics=12287, hwIfMonitorCrcErrorInterval=10, EntPhysicalName=40GE1/8/0/0)



<CE12808-CSS>


Dec 25 2018 10:24:46 CE12808-CSS M/1/hwIfMonitorCrcErrorRising_active(l):CID=0x80fc04b1-alarmID=0x081300bc;The CRC error is rising. (hwIfMonitorIndex=17305857, hwIfMonitorCrcErrorStatistics=140, hwIfMonitorCrcErrorThreshold=3, hwIfMonitorAllStatistics=12287, hwIfMonitorCrcErrorInterval=10, EntPhysicalName=40GE1/8/0/0)

  


Sip1/9/0/0                 up       up        0.07%  0.06%          0          0


Sip1/9/0/1                 up       up        0.07%  0.07%          0          0


Sip1/10/0/0                up       up        0.08%  0.08%          0          0


Sip1/10/0/1                up       up        0.10%  0.07%          0          0


Sip2/9/0/0                 up       up        0.07%  0.10%          0          0


Sip2/9/0/1                 up       up        0.07%  0.07%          0          0


Sip2/10/0/0                up       up        0.08%  0.08%          0          0


Sip2/10/0/1                up       up        0.06%  0.07%          0          0


Stack-Port1/1              up       up        0.01%  0.01%       1661          0


40GE1/8/0/0              up       up        0.01%  0.01%       1661          0


40GE1/8/0/1              up       up        0.01%  0.01%          0          0


40GE1/8/0/4              down     down      0.01%  0.01%          0          0


Stack-Port2/1              up       up        0.01%  0.01%          0          0


40GE2/8/0/0              up       up        0.01%  0.01%          0          0


40GE2/8/0/1              up       up        0.01%  0.01%          0          0

 

 


40GE2/8/0/4              down     down      0.01%  0.01%          0          0


Key Process


1. When packet loss occurs, collect traffic statistics on the uplink port of the standby frame and find that the number of sending and receiving packets is equal, and then do the traffic statistics on the main control and find that the number of sending and receiving packets is also the same. So the packet is dropped between two frames.


2. Check the port information and find that the stack port 40G1 / 8/0/0 has a growth error packet and a CRC check error alarm (the other stack port 40G1 / 8/0/1 is normal). So the stack interface is faulty, leading to the services are lost. Shut down the faulty stack port, test the service, transfer the faulty port using modules and stacking cables to 40G1 / 8/0/4 (the other normal interface of this stacking card), and find that the new stacking port has no CRC error, and there is no error packets under the interface.


3. The board interface is faulty and it needs to be replaced.



Root Cause


The 1/8/0/0 interface of the service board is faulty and the network is abnormal.


Solutions


1. The target is to replace frame 1. Prepare to perform the active / standby switchover. Before the operation, check whether the system backup status is "Ready". If so, run the slave switchover enable command to enable active / standby switchover function. And execute slave switchover command to make frame 2 the master. Then run the display stack command to check whether the switchover is successful. The purpose is to operate as smoothly as possible and to ensure normal services.


 

2. Check the slot number of the faulty board through the display device. Power off the faulty board through the power off slot + slot number. Replace it after powering off, and then use the power on slot + slot number to replace the board. Power on and wait for the board to register successfully, and restore the corresponding interface cable.



3. Check the stacking status through the display stack, and restore the 4-port stacking cable to the 0-port to see if the error packet on the interface is eliminated. If normal, perform step (1) to restore the active-standby relationship.


Suggestions and conclusions


1. If packet loss occurs, perform ping tests level by level to locate the device where packet loss occurs.


2. If packet loss occurs, perform traffic statistics to locate which device loses packets.


3. After locating the faulty port, perform a switching test to avoid problems that cannot be solved after the board is replaced.


4. Plug and unplug stacking service boards to ensure that the mainframe is normal and equipped with dual main detection to avoid stack splitting affecting services.


If you have any problems, please post them in our Community. We are happy to solve them for you!

  • x
  • convention:

MVE Created Apr 16, 2020 07:05:11 Helpful(0) Helpful(0)

Thanks for sharing!
View more
  • x
  • convention:

I%20would%20like%20to%20share%20with%20you%20my%20experience%2C%20I'm%20telecommunications%20engineer%2C%20currently%20senior%20project%20manager%20at%20an%20operator%2C%20partner%20of%20Huawei%2C%20in%20the%20radio%20access%20network%20department%2C%20for%2020%20years%20I%20managed%20several%20types%20of%20projects%2C%20for%20the%20different%20nodes%20of%20the%20network.%3Cbr%2F%3EAt%20the%20same%20time%2C%20I%20give%20courses%20in%20universities%20as%20a%20temporary%2C%20to%20bring%20the%20operational%20side%20of%20telecommunication%20technologies%20to%20students%2C%20for%20network%20supervision%20systems%2C%20mobile%20radio%20networks%20and%20access%20networks%20etc.
MVE Created Apr 16, 2020 18:16:08 Helpful(0) Helpful(0)

Very good, thanks
View more
  • x
  • convention:

Hello%20friends%2C%20I%20am%20a%20Telecommunications%20and%20electronics%20engineer%20and%20I%20just%20graduated%20as%20a%20master%20in%20telecommunications%20systems.%20I%20work%20in%20the%20telecommunications%20company%20of%20Cuba%2C%20ETECSA.%20I%20am%2035%20years%20old%20and%20I%20attend%20the%20transport%20network%20in%20my%20province%2C%20which%20is%20mainly%20Huawei.

Comment

Comment
You need to log in to comment to the post Login | Register

Notice Notice: To protect the legitimate rights and interests of you, the community, and third parties, do not release content that may bring legal risks to all parties, including but are not limited to the following:
  • Politically sensitive content
  • Content concerning pornography, gambling, and drug abuse
  • Content that may disclose or infringe upon others ' commercial secrets, intellectual properties, including trade marks, copyrights, and patents, and personal privacy
Do not share your account and password with others. All operations performed using your account will be regarded as your own actions and all consequences arising therefrom will be borne by you. For details, see " Privacy."
If the attachment button is not available, update the Adobe Flash Player to the latest version!

My Followers

Login and enjoy all the member benefits

Login

Huawei Enterprise Support Community
Huawei Enterprise Support Community
Block
Are you sure to block this user?
Users on your blacklist cannot comment on your post,cannot mention you, cannot send you private messages.