Memory Resource Exhaustion Results in a Failure to Log In to the CLI

Hello, everyone!

This post will share with you how to solve the memory resource exhaustion results in a failure to login to the CLI issue.

Problem Description

DeviceManager reports an alarm indicating memory resource exhaustion. When a user attempts to log in to the CLI using an SSH tool, a message is displayed indicating that memory resources are insufficient and the login fails.

Symptom

In DeviceManager, an alarm indicating memory resource exhaustion is reported, as shown in the following figure:

When a user attempts to log in to the CLI, a warning is displayed, as shown in the following figure:

Possible Cause

The operating system running on the storage system does not restrict the FTP log file size. Therefore, when functions involving a dump service are configured such as SystemReporter, memory resources of controllers are constantly used by the log file, ultimately causing memory resource exhaustion.

Identification Method

1. Check those multiple controllers are used.

   The problem occurs only in a scenario where at least three controllers are used.

2. Check that the storage system is configured with performance dump or SystemReporter.

3. Log in to the storage system, enter the storage mode, and check that the large file consuming memory resources is /.lftp/transfer_log.

   

   
   

Solution

• The emergency workaround is to manually delete the trasfer_log file by running rm -f /.lftp/transfer_log.

• Upgrade the storage system to the corresponding version.

  • If the version is V300R002, upgrade it to V300R002C10SPC200+SPH203.

  • If the version is V300R001, upgrade it to V300R001C20SPC200+SPH203.

  • If the version is V300R003, upgrade it to V300R003C10SPC100.

  • If the version is V100R001, upgrade it to V100R001C30SPC200.

  • If the version is V200R002, upgrade it to V200R002C30SPC200+SPH201.

Check After Recovery

Alarms indicating memory resource exhaustion are cleared. Login to the CLI is successful.

Appendix

NA

Application Scope

V200R002C30SPC200 earlier versions of the OceanStor TV2 series

V100R001C30SPC200 earlier versions of the OceanStor 18000 series

V300R001C20SPC200 earlier versions of the OceanStor V3 series

V300R002C10SPC200 earlier versions of the OceanStor V3 series

V300R003C10SPC100 earlier versions of the OceanStor V3 series