• Home
  • Archive
  • Tools
  • Contact Us

The Customize Windows

Technology Journal

  • Cloud Computing
  • Computer
  • Digital Photography
  • Windows 7
  • Archive
  • Cloud Computing
  • Virtualization
  • Computer and Internet
  • Digital Photography
  • Android
  • Sysadmin
  • Electronics
  • Big Data
  • Virtualization
  • Downloads
  • Web Development
  • Apple
  • Android
Advertisement
You are here: Home » Install Apache Gearpump On localhost (Ubuntu, Windows 10 Bash, Mac)

By Abhishek Ghosh June 11, 2018 10:06 am Updated on June 11, 2018

Install Apache Gearpump On localhost (Ubuntu, Windows 10 Bash, Mac)

Advertisement

Apache Gearpump is a real-time big data streaming engine, it is event/message based. We will need a running Gearpump service before we can submit and run first Gearpump application. There are multiple ways to run Gearpump – localhost mode, standalone mode, YARN mode and Docker mode. Obviously, the easiest way is to test run Apache Gearpump in local mode. Any Linux, MacOSX with Homebrew, or Windows 10 Ubuntu bash can be used with zero configuration. Here Are Steps on How to Install Apache Gearpump On localhost (or Cloud Server). Only for Mac OSX Homebrew, we have to use brew formulas – adjust them replacing with apt.

 

How to Install Apache Gearpump On localhost

 

We are taking that the machine has nothing installed. We have to install java, Scala and sbt. First install Java :

Vim
1
2
3
sudo add-apt-repository ppa:webupd8team/java
sudo apt install oracle-java8-installer
sudo apt install oracle-java8-set-default

For Ubuntu or GNU/Linux, run these :

Advertisement

---

Vim
1
2
3
echo "export PATH=/usr/local/anaconda2/bin:$PATH" >> /etc/bash.bashrc
echo "export JAVA_HOME=/usr/lib/jvm/java-8-oracle/" >> /etc/bash.bashrc
echo "export PATH=$PATH:$JAVA_HOME/bin" >> /etc/bash.bashrc

source that source file to reload or reboot (for server).

For Windows 10 bash if installed in our way using ZSH and MacOS X with ZSH, go to $HOME by typing cd ~ command, open .zshrc file and add :

Vim
1
2
3
export PATH=/usr/local/anaconda2/bin:$PATH
export JAVA_HOME=/usr/lib/jvm/java-8-oracle/
export PATH=$PATH:$JAVA_HOME/bin

Reload :

Vim
1
source .zshrc

If you run :

Vim
1
javac -version

There will be meaningful output. Install Scala :

Vim
1
2
3
sudo apt-get remove scala-library scala
wget www.scala-lang.org/files/archive/scala-2.11.8.deb
sudo dpkg -i scala-2.11.8.deb

For Mac, install Scala with Homebrew as brew formula. Next is sbt :

Vim
1
2
3
4
echo "deb https://dl.bintray.com/sbt/debian /" | sudo tee -a /etc/apt/sources.list.d/sbt.list
sudo apt-key adv --keyserver hkp://keyserver.ubuntu.com:80 --recv 2EE0EA64E40A89B84B2DF73499E82A75642AC823
apt update
apt install sbt

We need to clone the Apache GearPump repository :

Vim
1
git clone https://github.com/apache/incubator-gearpump.git

cd to that directory :

Vim
1
2
3
ls -al
cd incubator-gearpump
ls -al

Then run :

Vim
1
sbt clean assembly packArchiveZip

It will take good amount of time, with output like this :

Install Apache Gearpump On localhost

At end of operation, you’ll get a zip archive, with name like gearpump-2.11-0.8.4.zip. Unzip that :

Vim
1
2
apt install unzip
unzip gearpump-2.11-0.8.4.zip

Now, cd to that directory and run la -al :

Vim
1
2
cd gearpump*
ls -al

There will be gear.conf file under conf. Open that file :

Vim
1
nano gear.conf

Settings will be like this :

Vim
1
2
3
gearpump.hostname "127.0.0.1"
gearpump.cluster.masters ["127.0.0.1:3000"]
gearpump.worker.slots 1000

They have examples, which can be run in this way :

Vim
1
bin/gear app -jar examples/wordcount-2.11-0.8.4-assembly.jar org.apache.gearpump.streaming.examples.wordcount.WordCount

Web UI services will be at http://127.0.0.1:8090 and user-name, password both are admin. That is written in details in their official website :

Vim
1
2
3
4
https://gearpump.apache.org/releases/latest/introduction/submit-your-1st-application/index.html
https://gearpump.apache.org/releases/latest/deployment/deployment-standalone/
https://gearpump.apache.org/releases/latest/deployment/hardware-requirement/
https://gearpump.apache.org/releases/latest/introduction/commandline/

The software is good but installation guide to reach up to that is difficult to a newbie.

This Article Has Been Shared 971 Times!

Facebook Twitter Pinterest

Abhishek Ghosh

About Abhishek Ghosh

Abhishek Ghosh is a Businessman, Surgeon, Author and Blogger. You can keep touch with him on Twitter - @AbhishekCTRL.

Here’s what we’ve got for you which might like :

Articles Related to Install Apache Gearpump On localhost (Ubuntu, Windows 10 Bash, Mac)

  • Install Apache Drill on Ubuntu 16.04 LTS Single Cloud Server

    Drill is SQL Query Engine for Hadoop, NoSQL, Cloud Storage. Here is How to Install Apache Drill on Ubuntu 16.04 LTS Single Cloud Server.

  • Create Data Science Environment on Cloud Server With Docker

    Here Are the Steps, Commands to Create Data Science Environment on Cloud Server For Data Analysis Starting With a Blank Server With SSH.

  • How To Install Apache Solr 6.x on Ubuntu 16.04

    Here is How To Install Apache Solr 6.x on Ubuntu 16.04. Apache Solr Search Platform Can Be Integrated With WordPress, CMS & Other Softwares.

  • What Data Warehousing Solutions Available in the Cloud

    Our current topic under discussion is what data warehousing solutions available in the cloud and we will try to remain on-topic and brief.

  • Install, Configure PyFilter to Control Illegitimate SSH Login Attempts

    There are various intrusion prevention software available to prevent brute-force attacks. Here is How to Install, Configure PyFilter to Control Illegitimate SSH Login Attempts.

Additionally, performing a search on this website can help you. Also, we have YouTube Videos.

Take The Conversation Further ...

We'd love to know your thoughts on this article.
Meet the Author over on Twitter to join the conversation right now!

If you want to Advertise on our Article or want a Sponsored Article, you are invited to Contact us.

Contact Us

Subscribe To Our Free Newsletter

Get new posts by email:

Please Confirm the Subscription When Approval Email Will Arrive in Your Email Inbox as Second Step.

Search this website…

 

Popular Articles

Our Homepage is best place to find popular articles!

Here Are Some Good to Read Articles :

  • Cloud Computing Service Models
  • What is Cloud Computing?
  • Cloud Computing and Social Networks in Mobile Space
  • ARM Processor Architecture
  • What Camera Mode to Choose
  • Indispensable MySQL queries for custom fields in WordPress
  • Windows 7 Speech Recognition Scripting Related Tutorials

Social Networks

  • Pinterest (24.3K Followers)
  • Twitter (5.8k Followers)
  • Facebook (5.7k Followers)
  • LinkedIn (3.7k Followers)
  • YouTube (1.3k Followers)
  • GitHub (Repository)
  • GitHub (Gists)
Looking to publish sponsored article on our website?

Contact us

Recent Posts

  • Cyberpunk Aesthetics: What’s in it Special January 27, 2023
  • How to Do Electrical Layout Plan for Adding Smart Switches January 26, 2023
  • What is a Data Mesh? January 25, 2023
  • What is Vehicular Ad-Hoc Network? January 24, 2023
  • Difference Between Panel Light, COB Light, Track Light January 21, 2023

About This Article

Cite this article as: Abhishek Ghosh, "Install Apache Gearpump On localhost (Ubuntu, Windows 10 Bash, Mac)," in The Customize Windows, June 11, 2018, January 29, 2023, https://thecustomizewindows.com/2018/06/install-apache-gearpump-on-localhost-ubuntu-windows-10-bash-mac/.

Source:The Customize Windows, JiMA.in

PC users can consult Corrine Chorney for Security.

Want to know more about us? Read Notability and Mentions & Our Setup.

Copyright © 2023 - The Customize Windows | dESIGNed by The Customize Windows

Copyright  · Privacy Policy  · Advertising Policy  · Terms of Service  · Refund Policy

We use cookies on our website to give you the most relevant experience by remembering your preferences and repeat visits. By clicking “Accept”, you consent to the use of ALL the cookies.
Do not sell my personal information.
Cookie SettingsAccept
Manage consent

Privacy Overview

This website uses cookies to improve your experience while you navigate through the website. Out of these, the cookies that are categorized as necessary are stored on your browser as they are essential for the working of basic functionalities of the website. We also use third-party cookies that help us analyze and understand how you use this website. These cookies will be stored in your browser only with your consent. You also have the option to opt-out of these cookies. But opting out of some of these cookies may affect your browsing experience.
Necessary
Always Enabled
Necessary cookies are absolutely essential for the website to function properly. These cookies ensure basic functionalities and security features of the website, anonymously.
CookieDurationDescription
cookielawinfo-checkbox-analytics11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Analytics".
cookielawinfo-checkbox-functional11 monthsThe cookie is set by GDPR cookie consent to record the user consent for the cookies in the category "Functional".
cookielawinfo-checkbox-necessary11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookies is used to store the user consent for the cookies in the category "Necessary".
cookielawinfo-checkbox-others11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Other.
cookielawinfo-checkbox-performance11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Performance".
viewed_cookie_policy11 monthsThe cookie is set by the GDPR Cookie Consent plugin and is used to store whether or not user has consented to the use of cookies. It does not store any personal data.
Functional
Functional cookies help to perform certain functionalities like sharing the content of the website on social media platforms, collect feedbacks, and other third-party features.
Performance
Performance cookies are used to understand and analyze the key performance indexes of the website which helps in delivering a better user experience for the visitors.
Analytics
Analytical cookies are used to understand how visitors interact with the website. These cookies help provide information on metrics the number of visitors, bounce rate, traffic source, etc.
Advertisement
Advertisement cookies are used to provide visitors with relevant ads and marketing campaigns. These cookies track visitors across websites and collect information to provide customized ads.
Others
Other uncategorized cookies are those that are being analyzed and have not been classified into a category as yet.
SAVE & ACCEPT