Articles

How to Install, Configure Elasticsearch with Apache Hadoop

by Azhar Uddin Technical Architect

here is reason why we compared Elasticsearch with Apache HadoopHere is How To How to Install, Configure Elasticsearch with Apache Hadoop, Flume, Kibana. Also We Provided Links to Official Configuration. Before running the commands, we will suggest to read the text under the next sub header.

 README To Install, Configure Elasticsearch with Apache Hadoop

Previously we have published few important guides. Even you are used for few months with Apache Hadoop, it will not harm to read the above links. They have more textual information more than mere commands to install.

  1. Installing Apache Hadoop
  2. Installing Apache Spark
  3. Installing Fluentd
  4. Installing Elastic Stack / ELK Stack
How to Install, Configure Elasticsearch with Apache Hadoop

 How to Install, Configure Elasticsearch with Apache Hadoop

Minimum needs are HDP 2.0 or HDP Sandbox for HDP 2.0 on CentOS. In other words, follow previous guide to install Hadoop which is on numbered one on previous list of guides. Now we need to work with Java and PATH:

Next we need to install Flume :

Next, we need to install Elasticsearch, which is on numbered four on previous list of guides. We need to open and modify the file elasticsearch.yml :

These are things you need to modify :

cluster.name: “logsearch”
node.name: “node1”
node.master: true
node.data: true
index.number_of_shards: 5
index.number_of_replicas : 1
path.data: /data1,/data2,/data3,/data4
discovery.zen.minimum_master_nodes: 1
discovery.zen.ping.timeout: 3s
discovery.zen.ping.multicast.enabled: false
discovery.zen.ping.unicast.hosts: [“host1”, “host2:port”]


About Azhar Uddin Advanced   Technical Architect

35 connections, 1 recommendations, 149 honor points.
Joined APSense since, May 12th, 2017, From Hyderabad, India.

Created on Sep 6th 2017 08:00. Viewed 289 times.

Comments

No comment, be the first to comment.
Please sign in before you comment.