Got it

Elasticsearch Basic Concept

Latest reply: Nov 21, 2021 14:58:28 431 2 3 0 0

Hello, everyone!

Today I'm going to introduce you FI Elasticsearch. It helps beginners learn about FI faster.

Component Introduction

Elasticsearch is a distributed open-source system based on JAVA/Lucene. It integrates the search engine and NoSQL database functions and supports RESTful requests.

The Elasticsearch service supports multi-condition retrieval, statistics, and report generation for structured and unstructured text. It has a comprehensive monitoring system with a series of key indicators on systems, clusters, and query performance. Elasticsearch helps users focus on service logic implementation. This service applies to scenarios such as log search and analysis, time and space retrieval, time sequence retrieval and report generation, and intelligent search.

Elasticsearch has the following features:

  • Powerful full-text search and highlight display.

  • Distributed real-time file storage, real-time analysis, and diversified search.

  • Scalability to hundreds of servers to process PB-level structured or unstructured data.

  • Documents are stored in indexes, which can be added, deleted, modified, and queried. Provides diversified document processing capabilities.

  • Rich geographical information search and geographical location aggregation.

Introducing Logs

Log paths:

  • Run logs: ${BigdataLogHome} /elasticsearch/$ {Rolename}

  • Audit logs: ${BigdataLogHome} /audit/elasticsearch/$ {Rolename}

Log archive rule:

  • By default, audit logs are backed up each time when the size of them reaches 128 MB. A maximum of 4 audit log files can be reserved for the archive.

  • By default, run logs are backed up each time when the size of them reaches 128 MB. Run logs are archived every day. The size of compressed run logs cannot exceed 2 GB.

  • The parameters for archiving audit logs and run logs can be configured on FusionInsight Manager.

Log Type

Log File Name

Description

Run logs

elasticsearch_cluster_deprecation.log

Elasticsearch discard logs

elasticsearch_cluster_index_indexing_slowlog.log

Elasticsearch index slow logs

elasticsearch_cluster_index_search_slowlog.log

Elasticsearch query slow logs

elasticsearch_cluster.log

Elasticsearch cluster logs

es-process-check.log

Elasticsearch health check logs

es-sevice-check.log

Elasticsearch service check logs

es-start.log

Elasticsearch startup logs

es-stop.log

Elasticsearch stop logs

es-postinstall.log

Elasticsearch installation logs

Audit logs

elasticsearch_cluster-audit.log

Records index-level operations, such as migrating shards and deleting indexes.


  • x
  • convention:

olive.zhao
Admin Created Nov 16, 2021 09:47:11

There has another post about Elasticseach concepts:

[FI Components] Basic concepts for Elasticsearch

https://forum.huawei.com/enterprise/en/fi-components-basic-concepts-for-elasticsearch/thread/599044-893


View more
  • x
  • convention:

user_4358465
Created Nov 21, 2021 14:58:28

Thanks for sharing!
View more
  • x
  • convention:

Comment

You need to log in to comment to the post Login | Register
Comment

Notice: To protect the legitimate rights and interests of you, the community, and third parties, do not release content that may bring legal risks to all parties, including but are not limited to the following:
  • Politically sensitive content
  • Content concerning pornography, gambling, and drug abuse
  • Content that may disclose or infringe upon others ' commercial secrets, intellectual properties, including trade marks, copyrights, and patents, and personal privacy
Do not share your account and password with others. All operations performed using your account will be regarded as your own actions and all consequences arising therefrom will be borne by you. For details, see " User Agreement."

My Followers

Login and enjoy all the member benefits

Login

Block
Are you sure to block this user?
Users on your blacklist cannot comment on your post,cannot mention you, cannot send you private messages.
Reminder
Please bind your phone number to obtain invitation bonus.
Information Protection Guide
Thanks for using Huawei Enterprise Support Community! We will help you learn how we collect, use, store and share your personal information and the rights you have in accordance with Privacy Policy and User Agreement.