Apache SystemML provides a system for machine learning using big data on top of Apache Spark. Previously we described how to install Apache Mahout for building machine learning platform. Here is another solution for machine learning - Apache SystemML. In this guide we will show you how to install Apache SystemML machine learning system on Ubuntu 16.04. SystemML needs a minimum guidance to get … [Read more...]

Conda is a binary package manager used by Anaconda and other systems of Python and R. Anaconda commonly used for data processing, scientific computing, predictive analytics by the data scientists, developers, analysts, and peoples working in DevOps. Anaconda has collection of over 700+ F/OSS packages. Conda is the CLI utility of Anaconda. Here is how to install Anaconda on Ubuntu 16.04. Here is … [Read more...]

Solr is pronounced as Solar. It is an enterprise search platform built on Apache Lucene. Similar type of software is Elastic Search. Elasticsearch is on same Apache Lucene and more commonly used with Kibana, Beats, and Logstash as Elastic Stack for searching, analyzing and visualizing data. Here is how to install Apache Solr 6.x on Ubuntu 16.04. Apache Solr search platform can be integrated with … [Read more...]

We are talking about TinkerPop3. TinkerPop is graph computing framework offering 3 parts. 3 packaged downloads includes Gremlin Console, Gremlin Server and the source distribution. TinkerPop is slightly confusing to understand to get started. Here is how to install Apache TinkerPop (Gremlin Server) with PHP client on server. Implementations of TinkerPop are Sqlg, Blaze Graph, TinkerGraph, Elastic … [Read more...]

Apache Ambari helps in management, monitoring, provisioning of Hadoop cluster. Here is how to install Apache Ambari on Ubuntu 16.04 to manage Hadoop cluster. Ambari Server uses an embedded PostgreSQL database by default. When we install the Ambari Server, PostgreSQL packages and dependencies must be available for install. We are showing example with repo from Hortonworks for many reasons, one of … [Read more...]

Apache Pig is intended for analyzing large data sets. Usually we combine Pig with Hadoop. The language of Pig is Pig Latin. Apache Pig can execute Hadoop jobs in MapReduce, Apache Tez, Apache Spark. Pig Latin has similarities with SQL for relational database management. Pig Latin can be extended with scripts written in Java, Python, JavaScript, Ruby, Groovy. Here is How To Install Apache Pig On … [Read more...]

Most commonly new developers, particularly who are interested in data analysis face some terminologies which have more to do with theoretical and practical part of engineering and analytical sciences. The developers can be from a variety of domains and the phrases often confuses them. The question what is data refining in big data such an obvious question and answer is commonly written for those … [Read more...]

Normally we install Apache Hadoop and other big data tools on our servers. IBM Analytics Demo Cloud is intended to learn Hadoop, Ambari, BigSQL free of cost with SSH access & web console. With various cloud offerings many things these days have a free usage tier like we shown with unrelated things - Heroku and OpenShift PaaS. Here is how to get started with non-root access to this system. In … [Read more...]

The original project behind Apache NiFi was created by NSA! Of course it will be efficient in tracking and can have vulnerabilities, at least older than 1.3 versions had. Version 1.3.0 is latest at the time of publication of this guide. At present NSA has nothing to do with Apache NiFi and it has been another Big Data tool in Apache Software Foundation's collection. It can have vulnerabilities. … [Read more...]

We have noticed that there are some growing number of websites which write about Big Data, cloud computing and spread wrong information to sell some others paid things. They can not write guides like how to install Spark, Elastic Search, Kibana. Here is list of open source big data visualization tools which will convert data in to graphs, charts usable with tools like Spark, Hadoop. Do not use … [Read more...]