A Course in In-Memory Data Management

A Course in In-Memory Data Management PDF Author: Hasso Plattner
Publisher: Springer
ISBN: 3642552706
Category : Business & Economics
Languages : en
Pages : 315

Get Book

Book Description
Recent achievements in hardware and software development, such as multi-core CPUs and DRAM capacities of multiple terabytes per server, enabled the introduction of a revolutionary technology: in-memory data management. This technology supports the flexible and extremely fast analysis of massive amounts of enterprise data. Professor Hasso Plattner and his research group at the Hasso Plattner Institute in Potsdam, Germany, have been investigating and teaching the corresponding concepts and their adoption in the software industry for years. This book is based on an online course that was first launched in autumn 2012 with more than 13,000 enrolled students and marked the successful starting point of the openHPI e-learning platform. The course is mainly designed for students of computer science, software engineering, and IT related subjects, but addresses business experts, software developers, technology experts, and IT analysts alike. Plattner and his group focus on exploring the inner mechanics of a column-oriented dictionary-encoded in-memory database. Covered topics include - amongst others - physical data storage and access, basic database operators, compression mechanisms, and parallel join algorithms. Beyond that, implications for future enterprise applications and their development are discussed. Step by step, readers will understand the radical differences and advantages of the new technology over traditional row-oriented, disk-based databases. In this completely revised 2nd edition, we incorporate the feedback of thousands of course participants on openHPI and take into account latest advancements in hard- and software. Improved figures, explanations, and examples further ease the understanding of the concepts presented. We introduce advanced data management techniques such as transparent aggregate caches and provide new showcases that demonstrate the potential of in-memory databases for two diverse industries: retail and life sciences.

A Course in In-Memory Data Management

A Course in In-Memory Data Management PDF Author: Hasso Plattner
Publisher: Springer
ISBN: 3642552706
Category : Business & Economics
Languages : en
Pages : 315

Get Book

Book Description
Recent achievements in hardware and software development, such as multi-core CPUs and DRAM capacities of multiple terabytes per server, enabled the introduction of a revolutionary technology: in-memory data management. This technology supports the flexible and extremely fast analysis of massive amounts of enterprise data. Professor Hasso Plattner and his research group at the Hasso Plattner Institute in Potsdam, Germany, have been investigating and teaching the corresponding concepts and their adoption in the software industry for years. This book is based on an online course that was first launched in autumn 2012 with more than 13,000 enrolled students and marked the successful starting point of the openHPI e-learning platform. The course is mainly designed for students of computer science, software engineering, and IT related subjects, but addresses business experts, software developers, technology experts, and IT analysts alike. Plattner and his group focus on exploring the inner mechanics of a column-oriented dictionary-encoded in-memory database. Covered topics include - amongst others - physical data storage and access, basic database operators, compression mechanisms, and parallel join algorithms. Beyond that, implications for future enterprise applications and their development are discussed. Step by step, readers will understand the radical differences and advantages of the new technology over traditional row-oriented, disk-based databases. In this completely revised 2nd edition, we incorporate the feedback of thousands of course participants on openHPI and take into account latest advancements in hard- and software. Improved figures, explanations, and examples further ease the understanding of the concepts presented. We introduce advanced data management techniques such as transparent aggregate caches and provide new showcases that demonstrate the potential of in-memory databases for two diverse industries: retail and life sciences.

In-Memory Data Management

In-Memory Data Management PDF Author: Hasso Plattner
Publisher: Springer Science & Business Media
ISBN: 3642295754
Category : Business & Economics
Languages : en
Pages : 286

Get Book

Book Description
In the last fifty years the world has been completely transformed through the use of IT. We have now reached a new inflection point. This book presents, for the first time, how in-memory data management is changing the way businesses are run. Today, enterprise data is split into separate databases for performance reasons. Multi-core CPUs, large main memories, cloud computing and powerful mobile devices are serving as the foundation for the transition of enterprises away from this restrictive model. This book provides the technical foundation for processing combined transactional and analytical operations in the same database. In the year since we published the first edition of this book, the performance gains enabled by the use of in-memory technology in enterprise applications has truly marked an inflection point in the market. The new content in this second edition focuses on the development of these in-memory enterprise applications, showing how they leverage the capabilities of in-memory technology. The book is intended for university students, IT-professionals and IT-managers, but also for senior management who wish to create new business processes.

In-Memory Data Management

In-Memory Data Management PDF Author: Hasso Plattner
Publisher: Springer Science & Business Media
ISBN: 3642295746
Category : Business & Economics
Languages : en
Pages : 286

Get Book

Book Description
This book examines for the first time, the ways that in-memory computing is changing the way businesses are run. The authors describe techniques that allow analytical and transactional processing at the speed of thought and enable new ways of doing business.

Fast and Scalable Cloud Data Management

Fast and Scalable Cloud Data Management PDF Author: Felix Gessert
Publisher: Springer Nature
ISBN: 3030435067
Category : Computers
Languages : en
Pages : 199

Get Book

Book Description
The unprecedented scale at which data is both produced and consumed today has generated a large demand for scalable data management solutions facilitating fast access from all over the world. As one consequence, a plethora of non-relational, distributed NoSQL database systems have risen in recent years and today’s data management system landscape has thus become somewhat hard to overlook. As another consequence, complex polyglot designs and elaborate schemes for data distribution and delivery have become the norm for building applications that connect users and organizations across the globe – but choosing the right combination of systems for a given use case has become increasingly difficult as well. To help practitioners stay on top of that challenge, this book presents a comprehensive overview and classification of the current system landscape in cloud data management as well as a survey of the state-of-the-art approaches for efficient data distribution and delivery to end-user devices. The topics covered thus range from NoSQL storage systems and polyglot architectures (backend) over distributed transactions and Web caching (network) to data access and rendering performance in the client (end-user). By distinguishing popular data management systems by data model, consistency guarantees, and other dimensions of interest, this book provides an abstract framework for reasoning about the overall design space and the individual positions claimed by each of the systems therein. Building on this classification, this book further presents an application-driven decision guidance tool that breaks the process of choosing a set of viable system candidates for a given application scenario down into a straightforward decision tree.

Non-Volatile Memory Database Management Systems

Non-Volatile Memory Database Management Systems PDF Author: Joy Arulraj
Publisher: Morgan & Claypool Publishers
ISBN: 1681734850
Category : Computers
Languages : en
Pages : 193

Get Book

Book Description
This book explores the implications of non-volatile memory (NVM) for database management systems (DBMSs). The advent of NVM will fundamentally change the dichotomy between volatile memory and durable storage in DBMSs. These new NVM devices are almost as fast as volatile memory, but all writes to them are persistent even after power loss. Existing DBMSs are unable to take full advantage of this technology because their internal architectures are predicated on the assumption that memory is volatile. With NVM, many of the components of legacy DBMSs are unnecessary and will degrade the performance of data-intensive applications. We present the design and implementation of DBMS architectures that are explicitly tailored for NVM. The book focuses on three aspects of a DBMS: (1) logging and recovery, (2) storage and buffer management, and (3) indexing. First, we present a logging and recovery protocol that enables the DBMS to support near-instantaneous recovery. Second, we propose a storage engine architecture and buffer management policy that leverages the durability and byte-addressability properties of NVM to reduce data duplication and data migration. Third, the book presents the design of a range index tailored for NVM that is latch-free yet simple to implement. All together, the work described in this book illustrates that rethinking the fundamental algorithms and data structures employed in a DBMS for NVM improves performance and availability, reduces operational cost, and simplifies software development.

High-Performance In-Memory Genome Data Analysis

High-Performance In-Memory Genome Data Analysis PDF Author: Hasso Plattner
Publisher: Springer Science & Business Media
ISBN: 3319030353
Category : Science
Languages : en
Pages : 223

Get Book

Book Description
Recent achievements in hardware and software developments have enabled the introduction of a revolutionary technology: in-memory data management. This technology supports the flexible and extremely fast analysis of massive amounts of data, such as diagnoses, therapies, and human genome data. This book shares the latest research results of applying in-memory data management to personalized medicine, changing it from computational possibility to clinical reality. The authors provide details on innovative approaches to enabling the processing, combination, and analysis of relevant data in real-time. The book bridges the gap between medical experts, such as physicians, clinicians, and biological researchers, and technology experts, such as software developers, database specialists, and statisticians. Topics covered in this book include - amongst others - modeling of genome data processing and analysis pipelines, high-throughput data processing, exchange of sensitive data and protection of intellectual property. Beyond that, it shares insights on research prototypes for the analysis of patient cohorts, topology analysis of biological pathways, and combined search in structured and unstructured medical data, and outlines completely new processes that have now become possible due to interactive data analyses.

The In-Memory Revolution

The In-Memory Revolution PDF Author: Hasso Plattner
Publisher: Springer
ISBN: 3319166735
Category : Business & Economics
Languages : en
Pages : 275

Get Book

Book Description
This book describes the next generation of business applications in the innovative new SAP Business Suite 4 SAP HANA (SAP S/4HANA), exploiting the revolutionary capabilities of the SAP HANA in-memory database. Numerous real-world examples are presented illustrating the disruptive potential of this technology and the quantum leap it has facilitated in terms of simplicity, flexibility, and speed for new applications. The intuitive structure of this book offers a straightforward business perspective grounded in technology in order to enable valuable business insights drawn from the wealth of real-world experience of the book’s two authors, both prominent figures in the field of business application systems: Hasso Plattner and Bernd Leukert. Hasso Plattner is the co-founder of SAP and the founder of the Hasso Plattner Institute, affiliated with the University of Potsdam, Germany. Bernd Leukert is a member of the SAP Executive Board and the Global Managing Board of SAP.

Big Data in Medical Science and Healthcare Management

Big Data in Medical Science and Healthcare Management PDF Author: Peter Langkafel
Publisher: Walter de Gruyter GmbH & Co KG
ISBN: 3110445743
Category : Computers
Languages : en
Pages : 290

Get Book

Book Description
Big Data in medical science – what exactly is that? What are the potentials for healthcare management? Where is Big Data at the moment? Which risk factors need to be kept in mind? What is hype and what is real potential? This book provides an impression of the new possibilities of networked data analysis and "Big Data" – for and within medical science and healthcare management. Big Data is about the collection, storage, search, distribution, statistical analysis and visualization of large amounts of data. This is especially relevant in healthcare management, as the amount of digital information is growing exponentially. An amount of data corresponding to 12 million novels emerges during the time of a single hospital stay. These are dimensions that cannot be dealt with without IT technologies. What can we do with the data that are available today? What will be possible in the next few years? Do we want everything that is possible? Who protects the data from wrong usage? More importantly, who protects the data from NOT being used? Big Data is the "resource of the 21st century" and might change the world of medical science more than we understand, realize and want at the moment. The core competence of Big Data will be the complete and correct collection, evaluation and interpretation of data. This also makes it possible to estimate the frame conditions and possibilities of the automation of daily (medical) routine. Can Big Data in medical science help to better understand fundamental problems of health and illness, and draw consequences accordingly? Big Data also means the overcoming of sector borders in healthcare management. The specialty of Big Data analysis will be the new quality of the outcomes of the combination of data that were not related before. That is why the editor of the book gives a voice to 30 experts, working in a variety of fields, such as in hospitals, in health insurance or as medical practitioners. The authors show potentials, risks, concrete practical examples, future scenarios, and come up with possible answers for the field of information technology and data privacy.

Advanced Methodologies and Technologies in Network Architecture, Mobile Computing, and Data Analytics

Advanced Methodologies and Technologies in Network Architecture, Mobile Computing, and Data Analytics PDF Author: Khosrow-Pour, D.B.A., Mehdi
Publisher: IGI Global
ISBN: 1522575995
Category : Computers
Languages : en
Pages : 1857

Get Book

Book Description
From cloud computing to data analytics, society stores vast supplies of information through wireless networks and mobile computing. As organizations are becoming increasingly more wireless, ensuring the security and seamless function of electronic gadgets while creating a strong network is imperative. Advanced Methodologies and Technologies in Network Architecture, Mobile Computing, and Data Analytics highlights the challenges associated with creating a strong network architecture in a perpetually online society. Readers will learn various methods in building a seamless mobile computing option and the most effective means of analyzing big data. This book is an important resource for information technology professionals, software developers, data analysts, graduate-level students, researchers, computer engineers, and IT specialists seeking modern information on emerging methods in data mining, information technology, and wireless networks.

Building a Columnar Database on RAMCloud

Building a Columnar Database on RAMCloud PDF Author: Christian Tinnefeld
Publisher: Springer
ISBN: 3319207113
Category : Computers
Languages : en
Pages : 130

Get Book

Book Description
This book examines the field of parallel database management systems and illustrates the great variety of solutions based on a shared-storage or a shared-nothing architecture. Constantly dropping memory prices and the desire to operate with low-latency responses on large sets of data paved the way for main memory-based parallel database management systems. However, this area is currently dominated by the shared-nothing approach in order to preserve the in-memory performance advantage by processing data locally on each server. The main argument this book makes is that such an unilateral development will cease due to the combination of the following three trends: a) Today’s network technology features remote direct memory access (RDMA) and narrows the performance gap between accessing main memory on a server and of a remote server to and even below a single order of magnitude. b) Modern storage systems scale gracefully, are elastic and provide high-availability. c) A modern storage system such as Stanford’s RAM Cloud even keeps all data resident in the main memory. Exploiting these characteristics in the context of a main memory-based parallel database management system is desirable. The book demonstrates that the advent of RDMA-enabled network technology makes the creation of a parallel main memory DBMS based on a shared-storage approach feasible.