Скачать или смотреть How To Set Up Elasticsearch ILM | Index Lifecycle Management

Elasticsearch support data tiering move data across Hot, Warm, Cold, Delete. So that frequently used index will be in Hot tier and less frequently used/accessed index will move to Warm-- Cold -- Delete tier.

Join WhatsApp: https://www.whatsapp.com/channel/0029...

👉Get CloudWays ➜ https://www.cloudways.com/en/?id=1365224
💥CloudWays COUPON CODE: CLOUDGURU25
☝️☝️ USE THE EXCLUSIVE COUPON CODE ABOVE TO GET 25% OFF FOR 3 MONTHS💥

👉Get Digital Ocean ➜ digitalocean.pxf.io/ZQERvQ
💥Get $200 FREE Credits for signup. So, hurry up!💥

╔═╦╗╔╦╗╔═╦═╦╦╦╦╗╔═╗
║╚╣║║║╚╣╚╣╔╣╔╣║╚╣═╣
╠╗║╚╝║║╠╗║╚╣║║║║║═╣
╚═╩══╩═╩═╩═╩╝╚╩═╩═╝

What is AWS Elasticsearch / AWS ES

AWS Elasticsearch is a service which makes it easy to deploy and use Elasticsearch in the cloud, by using it in AWS it will be easier to cluster and scale, it can be used also for monitoring your nodes and have multiple configuration.

After creating your AWS ES you will have the options to uploaded your data files to be analyzed and indexed by AWS ES.

The AWS ES upload can be done using:

Index or Bulk API using coding options to accomplish this. (index details , bulk details)
Loading bulk using logstash. (For details check here)
Stream CloudWatch logs to AWS Elasticsearch. (Documentation)
Use third party plugins, which some will give you options to bulk copy, streaming or load from AWS S3. (Ex.: Amazon S3 River plugin for ES)
Using CURL
And everyday more solutions are coming...
How to create AWS Elasticsearch

First you need to create a cluster in the AWS Cloud and that will be your Elasticsearch domain, as any of the other AWS similar services you will be able to choose the number of instances in this domain and their hardware type, for creating your Elasticsearch you can use AWS CLI, AWS SDK or the ES console.

What are the steps of creating your first AWS Elasticsearch?

You create the domain from AWS ES console.
Configure and attach the policy you will use.
Configure and/or upload the files/data will be analyzed by AWS Elasticsearch
Now you can use your AWS ES domain for searching and analyzing the uploaded data

Amazon Elasticsearch Service makes it easy to deploy, secure, operate, and scale Elasticsearch for log analytics, full text search, application monitoring, and more. Amazon Elasticsearch Service is a fully managed service that delivers Elasticsearch’s easy-to-use APIs and real-time analytics capabilities alongside the availability, scalability, and security that production workloads require.

The service offers built-in integrations with Kibana, Logstash, and AWS services including Amazon Virtual Private Cloud (VPC), AWS Key Management Service (KMS), Amazon Kinesis Data Firehose, AWS Lambda, Amazon Cognito and Amazon CloudWatch so that you can go from raw data to actionable insights quickly and securely.

It’s easy to get started with Amazon Elasticsearch Service. You can set up and configure petabyte-scale Amazon Elasticsearch Service domains in minutes from the AWS Management Console. Amazon Elasticsearch Service provisions all the resources for your domain and launches it. You can securely access the domain from your VPC or from a public endpoint. The service automatically detects and replaces failed Elasticsearch nodes, reducing the overhead associated with self-managed infrastructure and the Elasticsearch software.

Edit template 'logstash-index-temp'
Index settings (optional)
{
"index": {
"lifecycle": {
"name": "logstash-index-policy",
"rollover_alias": "logstash"
}
}
}
Review details for 'logstash-index-temp'
Summary Preview Request

PUT _index_template/logstash-index-temp
{
"template": {
"settings": {
"index": {
"lifecycle": {
"name": "logstash-index-policy",
"rollover_alias": "logstash"
}
}
},
"mappings": {
"dynamic": true,
"numeric_detection": false,
"date_detection": true,
"dynamic_date_formats": [
"strict_date_optional_time",
"yyyy/MM/dd HH:mm:ss Z||yyyy/MM/dd Z"
],
"_source": {
"enabled": true,
"includes": [],
"excludes": []
},
"_routing": {
"required": false
},
"dynamic_templates": []
}
},
"index_patterns": [
"logstash-*"
]
}

#elasticsearch #elasticsearchtutorial #kibana #logstash