Storage Systems
Organization, Performance, Coding, Reliability, and Their Data Processing
- 746 pages
- English
- ePUB (mobile friendly)
- Only available on web
Storage Systems
Organization, Performance, Coding, Reliability, and Their Data Processing
About This Book
Storage Systems: Organization, Performance, Coding, Reliability and Their Data Processing was motivated by the 1988 Redundant Array of Inexpensive/Independent Disks proposal to replace large form factor mainframe disks with an array of commodity disks. Disk loads are balanced by striping data into stripsâwith one strip per diskâ and storage reliability is enhanced via replication or erasure coding, which at best dedicates k strips per stripe to tolerate k disk failures. Flash memories have resulted in a paradigm shift with Solid State Drives (SSDs) replacing Hard Disk Drives (HDDs) for high performance applications. RAID and Flash have resulted in the emergence of new storage companies, namely EMC, NetApp, SanDisk, and Purestorage, and a multibillion-dollar storage market. Key new conferences and publications are reviewed in this book.The goal of the book is to expose students, researchers, and IT professionals to the more important developments in storage systems, while covering the evolution of storage technologies, traditional and novel databases, and novel sources of data. We describe several prototypes: FAWN at CMU, RAMCloud at Stanford, and Lightstore at MIT; Oracle's Exadata, AWS' Aurora, Alibaba's PolarDB, Fungible Data Center; and author's paper designs for cloud storage, namely heterogeneous disk arrays and hierarchical RAID.
- Surveys storage technologies and lists sources of data: measurements, text, audio, images, and video
- Familiarizes with paradigms to improve performance: caching, prefetching, log-structured file systems, and merge-trees (LSMs)
- Describes RAID organizations and analyzes their performance and reliability
- Conserves storage via data compression, deduplication, compaction, and secures data via encryption
- Specifies implications of storage technologies on performance and power consumption
- Exemplifies database parallelism for big data, analytics, deep learning via multicore CPUs, GPUs, FPGAs, and ASICs, e.g., Google's Tensor Processing Units
Frequently asked questions
Information
Table of contents
- Cover image
- Title page
- Table of Contents
- Copyright
- Dedication
- About the author
- Preface
- Acknowledgments
- Abbreviations and acronyms
- Chapter 1: Introduction
- Chapter 2: Storage technologies and their data
- Chapter 3: Disk drive data placement and scheduling
- Chapter 4: Mirrored & hybrid arrays
- Chapter 5: Redundant Arrays of Independent Disks - RAID
- Chapter 6: Coding for multiple disk failures
- Chapter 7: Saving power in disks, flash memories, and servers
- Chapter 8: Database parallelism, big data and analytics, deep learning
- Chapter 9: Structured, unstructured, and diverse databases
- Chapter 10: Heterogeneous Disk Arrays - HDAs
- Chapter 11: Hierarchical RAID - HRAID
- Chapter 12: Conclusions
- Appendix
- Bibliography
- Index