HDInsight essentials : learn how to build and deploy a modern big data architecture to empower your business /: learn how to build and deploy a modern big data architecture to empower your business. (2015)
- Record Type:
- Book
- Title:
- HDInsight essentials : learn how to build and deploy a modern big data architecture to empower your business /: learn how to build and deploy a modern big data architecture to empower your business. (2015)
- Main Title:
- HDInsight essentials : learn how to build and deploy a modern big data architecture to empower your business
- Other Titles:
- Learn how to build and deploy a modern big data architecture to empower your business
- Further Information:
- Note: Rajesh Nadipalli.
- Authors:
- Nadipalli, Rajesh
- Contents:
- Cover; Copyright; Credits; About the Author; About the Reviewers; www.PacktPub.com; Table of Contents; Preface; Chapter 1: Hadoop and HDInsight in a Heartbeat; Data is everywhere; Business value of big data; Hadoop concepts; Brief history of Hadoop; Core components; Hadoop cluster layout; HDFS overview; Writing a file to HDFS; Reading a file from HDFS; HDFS basic commands; YARN overview; YARN application life cycle; YARN workloads; Hadoop distributions; HDInsight overview; HDInsight and Hadoop relationship; Hadoop on Windows deployment options; Microsoft Azure HDInsight Service HDInsight EmulatorHortonworks Data Platform (HDP) for Windows; Summary; Chapter 2: Enterprise Data Lake using HDInsight; Enterprise Data Warehouse architecture; Source systems; Data warehouse; Storage; Processing; User access; Provisioning and monitoring; Data governance and security; Pain points of EDW; The next generation Hadoop-based Enterprise data architecture; Source systems; Data Lake; Storage; Processing; User access; Provisioning and monitoring; Data governance, security, and metadata; Journey to your Data Lake dream; Ingestion and organization; Transformation (rules driven) Access, analyze, and reportTools and technology for Hadoop ecosystem; Use case powered by Microsoft HDInsight; Problem statement; Solution; Source systems; Storage; Processing; User access; Benefits; Summary; Chapter 3: HDInsight Service on Azure; Registering for an Azure account; Azure storage; Provisioning an HDInsightCover; Copyright; Credits; About the Author; About the Reviewers; www.PacktPub.com; Table of Contents; Preface; Chapter 1: Hadoop and HDInsight in a Heartbeat; Data is everywhere; Business value of big data; Hadoop concepts; Brief history of Hadoop; Core components; Hadoop cluster layout; HDFS overview; Writing a file to HDFS; Reading a file from HDFS; HDFS basic commands; YARN overview; YARN application life cycle; YARN workloads; Hadoop distributions; HDInsight overview; HDInsight and Hadoop relationship; Hadoop on Windows deployment options; Microsoft Azure HDInsight Service HDInsight EmulatorHortonworks Data Platform (HDP) for Windows; Summary; Chapter 2: Enterprise Data Lake using HDInsight; Enterprise Data Warehouse architecture; Source systems; Data warehouse; Storage; Processing; User access; Provisioning and monitoring; Data governance and security; Pain points of EDW; The next generation Hadoop-based Enterprise data architecture; Source systems; Data Lake; Storage; Processing; User access; Provisioning and monitoring; Data governance, security, and metadata; Journey to your Data Lake dream; Ingestion and organization; Transformation (rules driven) Access, analyze, and reportTools and technology for Hadoop ecosystem; Use case powered by Microsoft HDInsight; Problem statement; Solution; Source systems; Storage; Processing; User access; Benefits; Summary; Chapter 3: HDInsight Service on Azure; Registering for an Azure account; Azure storage; Provisioning an HDInsight cluster; Cluster topology; Provisioning using Azure Powershell; Creating a storage container; Provisioning a new HDInsight cluster; HDInsight management dashboard; Dashboard; Monitor; Configuration; Exploring clusters using the remote desktop; Running a sample MapReduce Deleting the clusterHDInsight Emulator for the development; Installing HDInsight Emulator; Installation verification; Using HDInsight Emulator; Summary; Chapter 4: Administering Your HDInsight Cluster; Monitoring cluster health; Name Node status; The Name Node Overview page; Datanode Status; Utilities and logs; Hadoop Service Availability; YARN Application Status; Azure storage management; Configuring your storage account; Monitoring your storage account; Managing access keys; Deleting your storage account; Azure Powershell; Access Azure Blob storage using Azure Powershell; Summary Chapter 5: Ingest and Organize Data LakeEnd-to-end Data Lake solution; Ingesting to Data Lake using HDFS command; Connecting to a Hadoop client; Getting your files on the local storage; Transferring to HDFS; Loading data to Azure Blob storage using Azure PowerShell; Loading files to Data Lake using GUI tools; Storage access keys; Storage tools; CloudXplorer; Key benefits; Registering your storage account; Uploading files to your Blob storage; Using Sqoop to move data from RDBMS to Data Lake; Key benefits; Two modes of using Sqoop; Using Sqoop to import data (SQL to Hadoop) … (more)
- Publisher Details:
- Birmingham, UK : Patck Publishing
- Publication Date:
- 2015
- Extent:
- 1 online resource (1 volume), illustrations
- Subjects:
- 005.265
COMPUTERS -- Databases -- Data Warehousing
Big data
Big data
COMPUTERS -- System Administration -- Storage & Retrieval
Electronic books
Electronic books - Languages:
- English
- ISBNs:
- 9781784396664
1784396664
1784399426
9781784399429 - Related ISBNs:
- 9781784399429
- Notes:
- Note: Description based on online resource; title from cover (Safari, viewed February 17, 2015).
- Access Rights:
- Legal Deposit; Only available on premises controlled by the deposit library and to one user at any one time; The Legal Deposit Libraries (Non-Print Works) Regulations (UK).
- Access Usage:
- Restricted: Printing from this resource is governed by The Legal Deposit Libraries (Non-Print Works) Regulations (UK) and UK copyright law currently in force.
- View Content:
- Available online (eLD content is only available in our Reading Rooms) ↗
- Physical Locations:
- British Library HMNTS - ELD.DS.88247
- Ingest File:
- 01_055.xml