• Home
  • Archive
  • Tools
  • Contact Us

The Customize Windows

Technology Journal

  • Cloud Computing
  • Computer
  • Digital Photography
  • Windows 7
  • Archive
  • Cloud Computing
  • Virtualization
  • Computer and Internet
  • Digital Photography
  • Android
  • Sysadmin
  • Electronics
  • Big Data
  • Virtualization
  • Downloads
  • Web Development
  • Apple
  • Android
Advertisement
The Customize Windows > Computer and Internet > Cloud Computing > How to Install Apache Druid (Single Server)

By Abhishek Ghosh November 15, 2019 8:48 am Updated on November 15, 2019

How to Install Apache Druid (Single Server)

Advertisement

Apache Druid is a column oriented, analytics database which can be used to build a data warehouse. Druid has APIs (via HTTP and JDBC) for loading, managing, and querying data and the user can also interact with Druid via the console. A mere 4GB RAM of an instance or computer is sufficient to test-run nano-quickstart configuration of Druid, and 16GB RAM instance can run it at production. Druid can be used for clickstreams, view streams, and activity streams, for measuring user engagement, tracking A/B test data, understanding usage patterns, compute impressions, clicks, eCPM, and key conversion metrics. Other use cases of Druid includes business intelligence (OLAPOLAP), Internet of Things.

How to Install Apache Druid

Druid is intended to run as a cluster of nodes to support a fault-tolerant architecture. The cluster will include external dependencies for Apache ZooKeeper (coordination), MySQL or PostgreSQL (metadata storage), and HDFS, or Amazon S3 for deep storage. Using Ambari, you configure Apache Druid (incubating) by setting parameters in a graphical user interface. Druid can be downloaded (and details read) from :

Advertisement

---

Vim
1
2
3
4
#
https://druid.apache.org/
https://github.com/apache/incubator-druid
#

This is the link to 0.16.0 :

Vim
1
2
3
#
https://www.apache.org/dyn/closer.cgi?path=/incubator/druid/0.16.0-incubating/apache-druid-0.16.0-incubating-bin.tar.gz
#

We have to extract and navigate to the main directory :

Vim
1
2
3
4
#
tar -xzf apache-druid-0.16.0-incubating-bin.tar.gz
cd apache-druid-0.16.0-incubating
#

The directories contain the below :

bin/* – scripts for the quickstarts
conf/* – example configurations for single-server, clustered setup
extensions/* – core Druid extensions
hadoop-dependencies/* – Druid Hadoop dependencies
lib/* – libraries and dependencies for core Druid
quickstart/* – configuration files, sample data, and files for the quickstart tutorials

Apache Zookeeper is a dependency of Apache Druid :

Vim
1
2
3
curl https://archive.apache.org/dist/zookeeper/zookeeper-3.4.14/zookeeper-3.4.14.tar.gz -o zookeeper-3.4.14.tar.gz
tar -xzf zookeeper-3.4.14.tar.gz
mv zookeeper-3.4.14 zk

The contents of the Zookeeper to be located at zk under the apache-druid-0.16.0-incubating package root. It is too easy to start Apache Druid :

Vim
1
2
3
#
./bin/start-micro-quickstart
#

Druid UI runs on http://localhost:8888/. It is important to read the tutorials on Druid to correctly configure depending on your need :

Vim
1
2
3
#
https://druid.apache.org/docs/latest/tutorials/
#

Druid needs a Relational DB as a Metadata Storage, i.e. MySQL. We have different guides on installing MySQLinstalling MySQL.

Start a CLI session: mysql -u root -p. Inside the session issue the following commands :

Vim
1
2
3
4
5
6
7
8
9
CREATE DATABASE druid DEFAULT CHARACTER SET utf8;
 
CREATE USER 'druid'@'%' IDENTIFIED BY 'druid-pass';
GRANT ALL PRIVILEGES ON *.* TO 'druid'@'%' WITH GRANT OPTION;
 
CREATE USER 'druid'@'localhost' IDENTIFIED BY 'druid-pass';
GRANT ALL PRIVILEGES ON *.* TO 'druid'@'localhost' WITH GRANT OPTION;
 
flush privileges;

This is the minimum common settings for MySQL :

Vim
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
# Extensions (no deep storage model is listed - using local fs for deep storage - not recommended for production)
druid.extensions.coordinates=["io.druid.extensions:druid-examples","io.druid.extensions:druid-kafka-eight","io.druid.extensions:mysql-metadata-storage"]
 
# Zookeeper
druid.zk.service.host=localhost
 
# Metadata Storage (mysql)
druid.metadata.storage.type=mysql
druid.metadata.storage.connector.connectURI=jdbc\:mysql\://localhost\:3306/druid
druid.metadata.storage.connector.user=druid
druid.metadata.storage.connector.password=diurd
 
# Deep storage (local filesystem for examples - don't use this in production)
druid.storage.type=local
druid.storage.storageDirectory=/Users/hbutani/druid/localStorage
 
# Query Cache (we use a simple 10mb heap-based local cache on the broker)
druid.cache.type=local
druid.cache.sizeInBytes=10000000
 
# Indexing service discovery
druid.selectors.indexing.serviceName=overlord
 
# Monitoring (disabled for examples, if you enable SysMonitor, make sure to include sigar jar in your cp)
# druid.monitoring.monitors=["com.metamx.metrics.SysMonitor","com.metamx.metrics.JvmMonitor"]
 
# Metrics logging (disabled for examples - change this to logging or http in production)
druid.emitter=noop

That ends this guide.

Tagged With postgresql-metadata-storage

This Article Has Been Shared 3826 Times!

Facebook Twitter Google+ Pinterest
Abhishek Ghosh

About Abhishek Ghosh

Abhishek Ghosh is a Businessman, Orthopaedic Surgeon, Author and Blogger. You can keep touch with him on Twitter - @AbhishekCTRL.

Here’s what we’ve got for you which might like :

Articles Related to How to Install Apache Druid (Single Server)

  • Install Apache Spark on Ubuntu Single Cloud Server With Hadoop

    Here is How to Install Apache Spark on Ubuntu Single Cloud Server With Hadoop and Also Without Hadoop. Everything is Explained in Plain English.

  • Install Apache Drill on Ubuntu 16.04 LTS Single Cloud Server

    Drill is SQL Query Engine for Hadoop, NoSQL, Cloud Storage. Here is How to Install Apache Drill on Ubuntu 16.04 LTS Single Cloud Server.

  • Create Data Science Environment on Cloud Server With Docker

    Here Are the Steps, Commands to Create Data Science Environment on Cloud Server For Data Analysis Starting With a Blank Server With SSH.

  • Install Jupyter Notebook and TensorFlow On Ubuntu 18.04 Server

    Here is How To Install Jupyter Notebook and TensorFlow On Ubuntu 18.04 Server. It is probably easy to install Anaconda for Python packages.

  • How to Package and Run Apache Twill (on Hadoop YARN)

    Apache Twill is used to develop, manage distributed applications. We can use Twill to build YARN applications.

Additionally, performing a search on this website can help you. Also, we have YouTube Videos.

Take The Conversation Further ...

We'd love to know your thoughts on this article.
Meet the Author over on Twitter to join the conversation right now!

If you want to Advertise on our Article or want a Sponsored Article, you are invited to Contact us.

Contact Us



Subscribe To Our Free Newsletter

You can subscribe to our Free Once a Day, Regular Newsletter by clicking the subscribe button below.

Click To Subscribe

Please Confirm the Subscription When Approval Email Will Arrive in Your Email Inbox as Second Step.

Search this website…

 

Popular Articles

Our Homepage is best place to find popular articles!

Here Are Some Good to Read Articles :

  • Cloud Computing Service Models
  • What is Cloud Computing?
  • Cloud Computing and Social Networks in Mobile Space
  • ARM Processor Architecture
  • What Camera Mode to Choose
  • Indispensable MySQL queries for custom fields in WordPress
  • Windows 7 Speech Recognition Scripting Related Tutorials

Social Networks

  • Pinterest (15K Followers)
  • Twitter (4.4k Followers)
  • Facebook (5.2k Followers)
  • LinkedIn (3.3k Followers)
  • YouTube (1.5k Followers)
  • GitHub (Repository)
  • GitHub (Gists)
Looking to publish sponsored article on our website?

Contact us

Recent Posts

  • 6 Tips for Securing Your Data from Cyber Attacks as a Remote Worker December 11, 2019
  • What is Process Mining? December 10, 2019
  • Explanation of the ESP32 Vulnerability Warnings December 6, 2019
  • OLTP versus OLAP December 4, 2019
  • What is OLTP (Online Transaction Processing)? December 3, 2019

About This Article

Title: How to Install Apache Druid (Single Server)
2019-11-15

Author: Abhishek Ghosh
Subjects: Cloud Computing

Is Part Of:


TheCustomizeWindows,

Friday, November 15th, 2019,
Vol.1(01),
p.1–66043 [IoT Ready Journal]


Source:The Customize Windows
ISSN: 0019-5847 ;
E-ISSN: 0019-5847 ;
Publisher:
jima.in

Cite this article as: Abhishek Ghosh, "How to Install Apache Druid (Single Server)," in The Customize Windows, November 15, 2019, December 14, 2019, https://thecustomizewindows.com/2019/11/how-to-install-apache-druid-single-server/.

This website uses cookies. If you do not want to allow us to use cookies and/or non-personalized Ads, kindly clear browser cookies after closing this webpage.

Read Cookie Policy.


PC users can consult Corrine Chorney for Security.

Want to know more about us? Read Notability and Mentions & Our Setup.

web analysis

Copyright © 2019 - The Customize Windows | dESIGNed by The Customize Windows

Copyright  · Privacy Policy  · Advertising Policy  · Terms of Service  · Refund Policy