• Home
  • Archive
  • Tools
  • Contact Us

The Customize Windows

Technology Journal

  • Cloud Computing
  • Computer
  • Digital Photography
  • Windows 7
  • Archive
  • Cloud Computing
  • Virtualization
  • Computer and Internet
  • Digital Photography
  • Android
  • Sysadmin
  • Electronics
  • Big Data
  • Virtualization
  • Downloads
  • Web Development
  • Apple
  • Android
Advertisement
You are here: Home » What is in-memory computing? Use of in-memory computing

By Abhishek Ghosh October 11, 2017 5:54 am Updated on October 11, 2017

What is in-memory computing? Use of in-memory computing

Advertisement

A growing number of mobile devices, social networks and the digitization of human life creating a huge flood of data. This data flow is also referred to as big data. The mere expansion of the IT parameters – more memory, better servers etc are not enough to process this information. Instead, the entire IT infrastructure must be re-examined and new solutions must be found to the requirement.

Table of Contents

  1. Introduction
  2. What is in-memory computing?
    • Basic principle of in-memory computing
    • In-memory analytics
  3. In-memory databases
  4. Use of in-memory computing
  5. Conclusion

 

What is in-memory computing?

 

In order to meet the need of the above described situation, from storage and network technology to database software, the individual processing processes demands optimization. This is where the in-memory computing is used to speed up data processing significantly by increasing access speeds. It is not exactly easy to answer what is in-memory computing rather it is easy to go in to description and use of in-memory computing. As growing number of users pushes the functionality of the existing database system to its limits more need of RAM based applications comes under question. In-Memory is characterized by the fact that the primary memory (RAM) of a computer is used as a data store. In-memory technology has been around for several years. Niche which needs to rely on real-time include telecom providers, social networks and trading platforms.

 

Basic principle of in-memory computing

 

Advertisement

---

The topic in-memory computing presents specific challenges to the hardware and applications for diverse requirements.The constant development of the hardware manufacturers and the rapid development of the IT infrastructure means that the corresponding storage systems are becoming increasingly cheaper and are becoming of higher capacities. Thus, it is now possible to upgrade a single server with large DRAM modules to several hundred GB of memory. The same applies to the CPU development – in the latest information of the multi-core development one speaks with Intel of 10 cores within a processor. Through the use and cooperation of different storage systems in the server systems, appropriate storage is used for each requirement and retention times. In the current and time-critical processing, the data is stored directly in the RAM memory. This is the fastest way and provides the best basis for analytical real-time applications. For data that exceeds the size of the RAM, the data is cached via a PCIe-Flash/SSD memory card and then saved to the local hard disk based on the SAS/SSD technology. Afterwards, the information in the storage system is stored via SAN technology and stored for long-term archiving.

In-memory analytics

In-memory analytics is about the fast processing of large data in Business Intelligence (BI). It is important to provide these data quickly so that you can adapt your company strategy if necessary. In the case of the in-memory variant, the read accesses to the hard disk are reduced or stopped. This brings a performance gain, because the access to the data in the RAM is by a factor 10,000 times faster than the access to the hard disk. For RDBM’s is the bottleneck, access to the data, the read, write and the response speed of the hard disk. This can also be counteracted with SSD, but these SSD’s have only a limited number of writes. As already shown in the development, the size of the databases is also a problem. The in-memory analytics are usually also used in in-memory databases, which are explained in more detail.

In-memory databases

For most of the companies, maintaining the customer information is the task of the relational database. There, structured data is stored in tables or records in fields on the hard disk or server. When queries are made to the database, the data must usually be read from the hard disk.

The in-memory technologies are expected to provide a much shorter response time. Their approach is to load the whole database into the RAM and to answer the queries directly from the memory. Since the data is also compressed into a memory database, the size of the database can be reduced to one-tenth.

Classical databases, OLAP (On-Line Analytical Process) solutions are often offered for BI. These are mostly necessary, for example, to make evaluations of the company. Because these queries would otherwise manipulate the database so that no other operations would be possible. This is sometimes done when the databases are not well modeled. When feeding these OLAP cubes, many queries are generated and stored, which can take a long time. This is the bottleneck of these applications, of course these operations are not needed if they are well-modeled databases. These operations are not needed with in-memory databases because they return the requested data more quickly.

For IMDB, there are some problems as the RAM is just a volatile memory. If the server fails for power supply, the data in the memory were lost. This is why large database producers are working with cyclic (snapshot) images on the hard disk. In addition, transaction logs are written to the disk. In these transaction logs, changes to the database are written, for example, value x is changed to y. Mostly, two database servers, in the active standby cluster, are used for a database that shares a storage system. After the one server has lost the power supply, the second one leaves the snapshots and action logs on the hard disk and can thus restore the data from the previously active server. The data that was processed at the time of the crash can not be restored, if, for example, an update of the data was carried out during the loss of the power supply. For this reason, functions are also used in the application which recognize this and, if necessary, re-execute the request. There are many common features of the IMDB on the market:

  1. Data storage: On startup, all data are read into the RAM in order to avoid having to reload any data
  2. Snapshot Images: Changed data are periodically synchronized with the hard disk.
  3. Transaction logs: Between the individual checkpoint files, current changes are written to these logs in order to be able to follow a rollforward after a crash.
  4. ACID principle: Like conventional RDBMS, IMDB can also process all data according to the ACID principle (atomism, consistency conservation, isolation, durability).
  5. High availability: Usually, several database servers are used for a database to ensure data replication.
  6. Direct-Connect: The application can directly load the in-memory database into its address range to avoid any overhead.
What-is-in-memory-computing

 

Use of in-memory computing

 

In-memory computing offers several technologies, but the most important is by far the in-memory database (hereinafter referred to as IMDB), for which software and their use is available in the market. Already since 1984, there are in-memory databases, one of the first available products was the IBM TM1 – OLAP database. However, limitations in the operating system and available hardware meant that these systems could not take advantage of their advantages. In recent years, these limitations have been gradually phased out, and several IMDB solutions from major vendors have been available on the market.

IBM introduced SolidDB as an IMDB in 2008, which provides data integrity through two separate but permanently synchronized database copies as well as through permanent logging on the hard disks. In the event of data loss, the entire database can be restored within seconds without loss of data. Oracle introduced TimesTen in 2009 as an IMDB, which can be used as a cache for the traditional RDBMS or as a standalone database. TimesTen uses transaction logging and database checkpoints as data integrity measures. In 2010, SAP presented HANA as a database technology, which is a High Performance Analytic Appliance.

SQLite is a program library that contains a relational database system and is, due to many database interfaces, the most widely used SQL database in the world. To use SQLite databases in the main memory you can use the “: memory” option in the database connection. As soon as you close the database connection, the database is written to the disk. In-memory databases are becoming more and more popular and find their use mainly in the fields of time-critical applications, real-time data output as well as analysis of large amounts of data. For example, Google, Twitter and Facebook use all customized in-memory databases to ensure fast response times with ever-increasing amounts of data.

 

Conclusion

 

With regard to the topic of in-memory computing, IT experts speak of a paradigm shift, a new era of data processing or real realtime business. For almost a year now, the largest German software company, SAP, has not had the opportunity to demonstrate the benefits that users would be able to derive from the new technology. The speech is from completely new analysis and business applications, as well as a clearly simplified and cost-effective IT infrastructure.

The fact that these statements are not so generalized could be proved during the conduct of the research and experiments. The productive use of in-memory computing offers completely new possibilities in the field of big data and real-time analysis, but the conversion and acquisition costs in the field of both hardware and software are still very high large corporations.

In less complex areas, such as unit tests in software development, in-memory databases are already being used in small and medium-sized enterprises. The technologies of the in-memory computing will gain in importance in near future due to steadily increasing data volumes and falling hardware prices.

If you liked what is in-memory computing, possibly you’ll be interested to read our three-part article Theoretical Foundations of Big Data.

Tagged With what is in memory computing , 7 in-memory computing , in memory computing cima , in memory computing explained , in memory computing technologies , in-memory computation uses , paperuri:(128c0113882f8bca3b38fff519c7df7f) , whta is in memory computing

This Article Has Been Shared 538 Times!

Facebook Twitter Pinterest

Abhishek Ghosh

About Abhishek Ghosh

Abhishek Ghosh is a Businessman, Surgeon, Author and Blogger. You can keep touch with him on Twitter - @AbhishekCTRL.

Here’s what we’ve got for you which might like :

Articles Related to What is in-memory computing? Use of in-memory computing

  • What is Dark Data in Big Data?

    What is Dark Data? It is Big Data Collected, Processed & Stored For Need But Organization Fails to Use it For Direct of Indirect Monetizing.

  • Install Apache Spark on Ubuntu Single Cloud Server With Hadoop

    Here is How to Install Apache Spark on Ubuntu Single Cloud Server With Hadoop and Also Without Hadoop. Everything is Explained in Plain English.

  • Big Data as a Service (BDaaS) Basics

    Big Data as a Service or BDaaS, is as if combination of SaaS, PaaS and DaaS. Self Hosting Big Data platform is time consuming and costly.

  • How To Install Apache Mesos With Marathon On Ubuntu 16.04 LTS

    Here Is How To Install Apache MeOS With Marathon On Ubuntu 16.04 LTS In Order To Integrate,Manage Multiple Servers Or Multi Cloud Environment.

  • Apache Solr vs. Elasticsearch For WordPress Search

    Apache Solr vs. Elasticsearch For WordPress Search is a Complicated Topic as the Number of Plugin is a Matter Which We Need to Consider.

Additionally, performing a search on this website can help you. Also, we have YouTube Videos.

Take The Conversation Further ...

We'd love to know your thoughts on this article.
Meet the Author over on Twitter to join the conversation right now!

If you want to Advertise on our Article or want a Sponsored Article, you are invited to Contact us.

Contact Us

Subscribe To Our Free Newsletter

Get new posts by email:

Please Confirm the Subscription When Approval Email Will Arrive in Your Email Inbox as Second Step.

Search this website…

 

Popular Articles

Our Homepage is best place to find popular articles!

Here Are Some Good to Read Articles :

  • Cloud Computing Service Models
  • What is Cloud Computing?
  • Cloud Computing and Social Networks in Mobile Space
  • ARM Processor Architecture
  • What Camera Mode to Choose
  • Indispensable MySQL queries for custom fields in WordPress
  • Windows 7 Speech Recognition Scripting Related Tutorials

Social Networks

  • Pinterest (24.3K Followers)
  • Twitter (5.8k Followers)
  • Facebook (5.7k Followers)
  • LinkedIn (3.7k Followers)
  • YouTube (1.3k Followers)
  • GitHub (Repository)
  • GitHub (Gists)
Looking to publish sponsored article on our website?

Contact us

Recent Posts

  • What is Voice User Interface (VUI) January 31, 2023
  • Proxy Server: Design Pattern in Programming January 30, 2023
  • Cyberpunk Aesthetics: What’s in it Special January 27, 2023
  • How to Do Electrical Layout Plan for Adding Smart Switches January 26, 2023
  • What is a Data Mesh? January 25, 2023

About This Article

Cite this article as: Abhishek Ghosh, "What is in-memory computing? Use of in-memory computing," in The Customize Windows, October 11, 2017, February 1, 2023, https://thecustomizewindows.com/2017/10/what-is-in-memory-computing/.

Source:The Customize Windows, JiMA.in

PC users can consult Corrine Chorney for Security.

Want to know more about us? Read Notability and Mentions & Our Setup.

Copyright © 2023 - The Customize Windows | dESIGNed by The Customize Windows

Copyright  · Privacy Policy  · Advertising Policy  · Terms of Service  · Refund Policy

We use cookies on our website to give you the most relevant experience by remembering your preferences and repeat visits. By clicking “Accept”, you consent to the use of ALL the cookies.
Do not sell my personal information.
Cookie SettingsAccept
Manage consent

Privacy Overview

This website uses cookies to improve your experience while you navigate through the website. Out of these, the cookies that are categorized as necessary are stored on your browser as they are essential for the working of basic functionalities of the website. We also use third-party cookies that help us analyze and understand how you use this website. These cookies will be stored in your browser only with your consent. You also have the option to opt-out of these cookies. But opting out of some of these cookies may affect your browsing experience.
Necessary
Always Enabled
Necessary cookies are absolutely essential for the website to function properly. These cookies ensure basic functionalities and security features of the website, anonymously.
CookieDurationDescription
cookielawinfo-checkbox-analytics11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Analytics".
cookielawinfo-checkbox-functional11 monthsThe cookie is set by GDPR cookie consent to record the user consent for the cookies in the category "Functional".
cookielawinfo-checkbox-necessary11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookies is used to store the user consent for the cookies in the category "Necessary".
cookielawinfo-checkbox-others11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Other.
cookielawinfo-checkbox-performance11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Performance".
viewed_cookie_policy11 monthsThe cookie is set by the GDPR Cookie Consent plugin and is used to store whether or not user has consented to the use of cookies. It does not store any personal data.
Functional
Functional cookies help to perform certain functionalities like sharing the content of the website on social media platforms, collect feedbacks, and other third-party features.
Performance
Performance cookies are used to understand and analyze the key performance indexes of the website which helps in delivering a better user experience for the visitors.
Analytics
Analytical cookies are used to understand how visitors interact with the website. These cookies help provide information on metrics the number of visitors, bounce rate, traffic source, etc.
Advertisement
Advertisement cookies are used to provide visitors with relevant ads and marketing campaigns. These cookies track visitors across websites and collect information to provide customized ads.
Others
Other uncategorized cookies are those that are being analyzed and have not been classified into a category as yet.
SAVE & ACCEPT