Apache Edgent is for edge devices to analyze collected data by the device. Apache Edgent is a programming model and micro-kernel style runtime which can be embedded in gateways which makes it easy to process sensor streams on edge devices like Raspberry Pi and run local analytics, then send only useful information to server. Apache Edgent's old name is Apache Quarks. The tool is excellent for … [Read more...]

Apache Flink is a big data processing engine which can run in both streaming & batch mode. data Artisans is the company who is the original creator of Flink. It started as a project called Stratosphere, which was forked, and became Apache Flink. Flink can be deployed on local machine, on cluster (it can run on YARN), or can be deployed in the cloud. Core of Apache Flink is a distributed … [Read more...]

In our previous tutorials, we written the steps to install Apache Nutch on Ubuntu Server and also how to install Apache Solr on Ubuntu Server. Integrating Apache Nutch With Apache Solr Will Offer a Web UI, Options to Visually Search and Use Extended Functions of Apache Nutch. Our guide on installing Apache Solr uses older version of Solr (at present). We are using Apache Nutch 1.x - in previous … [Read more...]

Aache Nutch is a Production Ready Web Crawler. Nutch Can Be Extended With Apache Tika, Apache Solr, Elastic Search, SolrCloud, etc. Here is How to Install Apache Nutch on Ubuntu Server. Nutch relies on Apache Hadoop data structure. Apache Lucene is similar to Apache Nutch. Apache Lucene plays an important role in helping Nutch to index and search. We use Apache Tika for parsing, Apache Solr, … [Read more...]

Apache Gora provides an in-memory data model and persistence for big data. It supports persisting to column stores, key/value stores, document stores and RDBMSs, and analyzing the data. It supports Apache Hadoop MapReduce support. Here is How to Install Apache Gora on Ubuntu Server. Gora is one software, example works of which will clarify our article how MySQL used in Big Data … [Read more...]

Apache Avro is a Framework Which Supports RPC and Data Serialization - it uses RPC calls to send data. For this guide, at least you need have Apache Hadoop installed and running on the server. We have guides to install Apache Hadoop on single cloud server. Here is How To Install Apache Avro On Ubuntu Running Apache Hadoop. Another point to mention is that, Apache Avro API's several languages - … [Read more...]

In our earlier guide, we described how to install Gradle on Ubuntu 18.04 LTS. Here Are the Steps on How to Run Apache SAMOA with Apache S4. In this guide, we will use that Gradle. Full Form of S4 is Simple Scalable Streaming System. It is a pluggable platform to develop applications. Apache S4 is a distributed, scalable, pluggable platform to allow the programmers to develop applications for … [Read more...]

Big Data field and data analysis are rapidly growing areas within IT. Both areas, combined together, will lead to an increase in IT spending by about 26 percent annually for the next five years. Big Data is particularly a significant trend in the market and all offers of cloud analytics are designed to ensure the management of data which is/are not organized, enabling the organizations to gain … [Read more...]

Platform as a Service (PaaS) is a special type of service model in cloud computing. PaaS can be imagined as s a link between traditional infrastructure services (Infrastructure as a Service, IaaS) and application in the cloud (Software as a Service, SaaS). In this article, we will highlight how Platform as a Service (PaaS) can help the developers in Big Data & Software Development arena. In … [Read more...]

MySQL is efficient around handling highly concurrent accesses to transactional data on a single machine. MySQL has no way for actual work with big data storage and retrieval. At some point, we realize that there are some matured database systems. For example, it is not abnormal to face scaling issues in Python. SQlite comes with Python. If data is large then there are some NoSQL database such as … [Read more...]