Elasticsearch on Samarthya

Timeseries & Index Management (ILM)

Sat, 01 Aug 2020 08:25:16 +0000

Timeseries is a data stream that is defined for a set of fields over a time period. Some examples may include, daily attendance register for an organization, wherein people punching in every-morning will be different, missing mostly for weekends or on planned and unplanned leaves.

Elastic Alerting

Sun, 05 Jul 2020 00:00:00 +0000

Watcher
#

Watcher is an Elasticsearch feature that facilitates alerting and can be used to create actions based on conditions, which are periodically evaluated using queries on your data. There are two ways of creating a watcher

Aggregations: Elastic

Tue, 09 Jun 2020 00:00:00 +0000

Aggregation works on a group of documents and can be categorized

Metric
Pipeline
Bucket
Matrix

Metric Aggregation
#

Computes a single or multiple values

LDAP Realm in Elasticsearch

Fri, 05 Jun 2020 04:18:06 +0000

It is a short howto guide which shall talk about adding a LDAP realm to an Elasticsearch 7.6.2 cluster.

Realms
#

It is a concept not alien to IDAM professionals. In simple words it is a system that allows you to authenticate and authorize an incoming request. It will define the entity USER, that may include at a bare minimum (not limited to)

Analyze: _analyze api

Sat, 02 May 2020 10:21:09 +0000

Text is a key data in most of the information that is ingested in the elasticsearch, and whether it is type text or keyword it requires careful consideration to choose which analyzer to use.

Pipeline: _ingest API

Thu, 23 Apr 2020 11:08:40 +0000

Pipelines is a smooth way of processing some incoming data. In this blog, I will walk through some of the items I have tried my hands on.

Pipeline
#

A pipeline is a definition of a series of processors that are to be executed in the same order as they are declared.

API _reindex

Mon, 06 Apr 2020 00:00:00 +0000

I will extrapolating based on the original documentation available here and based on some of my experience using this API.

It copies documents from one index to another.

Extracts the document source from the source index and indexes the documents into the destination index. You can copy all documents to the destination index, or reindex a subset of the documents.

ECS: Elastic common schema

Thu, 02 Apr 2020 00:00:00 +0000

Open specification for document fields for data ingested in Elasticsearch. It brings uniformity to certain common fields that are used across data sources.

ECS defines two field levels

Core fields: Represent the fields that are most common across all use cases.
Extended fields: That are not part of the core and specific to cases.

Field sets
#

Field sets are multiple groups of related fields defined by ECS. More information here.

Text - Elastic

Sun, 29 Mar 2020 17:37:33 +0000

If you are not aware of mapping, it might be a little confusing but I would try my best.

Every document that gets indexed in elastic has fields, every field that is accessible has an associated type with it (Inverted Index) which helps elastic organize data for quick retrieval.

Securing Elasticsearch

Wed, 25 Mar 2020 12:00:00 +0000

In this post I will try to enable security for the elasticsearch cluster. It would be simply penned as a sequence of steps you need to follow to enable security as part of the cluster.

Elasticsearch v7.6

Mon, 24 Feb 2020 12:00:00 +0000

In the previous blog we searched for a match_all, and sorted it by age. In this we will improve upon the query we are writing and look for other options.

Elasticsearch v7.6

Fri, 21 Feb 2020 11:24:29 +0000

What I have been doing is evaluating Elasticsearch. The indexing, searching (Phrase, Similarity, Structured, Full Text, Complex), clustering etc. In this blog I will just try and simplify the learning curve.

Elasticsearch on Samarthya

Timeseries & Index Management (ILM)

Elastic Alerting

Watcher #

Aggregations: Elastic

Metric Aggregation #

LDAP Realm in Elasticsearch

Realms #

Analyze: _analyze api

Pipeline: _ingest API

Pipeline #

API _reindex

ECS: Elastic common schema

Field sets #

Text - Elastic

Securing Elasticsearch

Elasticsearch v7.6

Elasticsearch v7.6

Watcher
#

Metric Aggregation
#

Realms
#

Pipeline
#

Field sets
#