Oracle Big Data Fundamentals

Big Data Platformu üzerindeki ana teknolojilerin ele alındığı bu eğitim, Big Data yönetim işine gitmek isteyen ve Oracle Big Data Appliance kullanacak olanların alması gereken ilk eğitimlerden birisidir. Büyük Veri toplama, işleme, entegrasyon ve analiz tekniklerini geniş bir yelpazede kullanmayı öğrenerek, Büyük Veri teknolojisi portföyünüzü artırabilirsiniz.

Eğitim Sonrası Kazanımlar

• Büyük Verileri Tanımlama
• Oracle’ın Entegre Büyük Veri Çözümü’nü ve bileşenlerinin açıklanması.
• Apache Hadoop’u (CDH) içeren Hadoop Ekosistemi ve Cloudera’nın Dağılımını tanımlama
• Hadoop Cluster’daki node’lar ile verileri depolamak, dağıtmak ve çoğaltmak için Hadoop Dağıtılmış Dosya Sistemini (HDFS) kullanımı
• HDFS Komut Satırı Arayüzü, Flume ve Oracle NoSQL Veritabanı’nı kullanarak büyük veriler elde etme
• Hadoop Cluster’da depolanan verilerin dağıtılmış olarak işlenmesi için MapReduce ve YARN kullanımı
• MapReduce, YARN, Hive, PIG, Hadoop, Solr ve Spark için Oracle XQuery kullanarak büyük verileri işleme
• Büyük veri ve depo verilerini Scoop, Oracle Büyük Veri Bağlayıcıları, BDA’ya Kopyalama, Oracle Big Data SQL, Oracle Data Integrator ve Oracle GoldenGate’i kullanarak entegre etmek
• Büyük verileri, Oracle Big Data SQL, Oracle Gelişmiş Analitik Teknolojileri ve Oracle Big Data Discovery’yi kullanarak analiz etmek
• Oracle Big Data Appliance’ı kullanma ve yönetmek
• Verilerinizi korumak
• Oracle Big Data Cloud Hizmetini Anlamak: Temel Özellikleri nelerdir? Bize sağladığı  Avantajlar nelerdir?

Hedef Kitle

• İş analistleri
• Veri Bilimcileri
• Data Warehouse Yöneticileri
• Database Yöneticleri

Eğitim İçeriği

Introduction

• Questions About You
• Course Objectives
• Course Road Map
• Oracle Big Data Lite (BDLite) Virtual Machine (VM) Home Page
• Starting the Oracle BDLite VM and accessing the Practice Files
• Reviewing the Available Big Data Documentation, Tutorials, and Other Resources

Introducing Oracle Big Data Strategy

• Characteristics of Big Data
• Importance of Big Data
• Big Data Opportunities: Some Examples
• Big Data Challenges Big Data implementation examples
• Oracle strategy for Big Data: combining Big Data Processing Engines: Hadoop / NoSQL / RDBMS

Using Oracle Big Data Lite Virtual Machine and Movieplex Application

• Oracle Big Data Lite VM Used in this Course
• Oracle Big Data Lite VM Home Page Sections
• Reviewing the Deployment Guide
• Downloading and installing Oracle VM VirtualBox and its Extension Pack
• Downloading and Running 7-zip Files to create Virtual Box Appliance File
• Importing the Appliance File Staring the Big Data Lite VM and Starting and Stopping Services
• Introducing the Oracle Movieplex Case Study

Introduction to the Big Data Ecosystem

• Computer Clusters and Distributed Computing
• Apache Hadoop
• Types of Analysis That Use Hadoop
• Types of Data Generated
• Apache Hadoop Core Components: HDFS, MapReduce (MR1), and YARN (MR2)
• Apache Hadoop Ecosystem
• Clouderas Distribution Including Apache Hadoop (CDH)
• CDH Architecture and Components

Introduction to the Hadoop Distributed File System

• Hadoop Distributed Filesystem (HDFS) Design Principles, Characteristics, and Key Definitions
• Sample Hadoop High Availability (HA) Cluster
• HDFS Files and Blocks
• Active and Standby Daemons (Services) Functions
• DataNodes (DN) Daemons Functions
• Writing a File to HDFS: Example
• Interacting With Data Stored in HDFS: Hue, Hadoop Client, WebHDFS, and HttpFS

 

Acquire Data using CLI, Fuse, Flume, and Kafka

• Reviewing the Command Line Interface (CLI)
• Viewing File System Contents Using the CLI
• FS Shell Commands
• Loading Data Using the CLI
• Overview of FuseDFS
• What is Flume?
• Kafka topics
• Additional Resources

Acquire and Access Data Using Oracle NoSQL Database

• What is a NoSQL Database
• RDBMS Compared to NoSQL
• HDFS Compared to NoSQL Define Oracle NoSQL
• Database Oracle NoSQL models: Key-Value and Table
• Acquiring and Accessing Data in a NoSQL DB Accessing the CLIs (Data, Admin, SQL)
• Accessing the KVStore

Introduction to MapReduce and YARN Processing Frameworks

• MapReduce Framework Features, Benefits, and Jobs
• Parallel Processing with MapReduce
• Word Count Examples
• Data Locality Optimization in Hadoop
• Submitting and Monitoring a MapReduce Job
• YARN Architecture, Features, and Daemons
• YARN Application Workflow Hadoop Basic Cluster: MapReduce 1 Versus YARN (MR 2)

Resource Management Using Yarn

• Scheduling in YARN
• First In, First Out (FIFO) SchedulerCapacity Scheduler, and Fair Scheduler
• Cloudera Manager Resource Management Features
• Static Service Pools
• Working with the Fair Scheduler
• Cloudera Manager Dynamic Resource Management: Example
• Submitting and Monitoring a MapReduce Job Using YARN
• Using the YARN application Command

Overview of Apache Spark

• Benefits of Using Spark
• Spark Architecture
• Spark Application Components: Driver, Master, Cluster Manager, and Executors
• Running a Spark Application on YARN (yarn-cluster Mode)
• Resilient Distributed Dataset (RDD)
• Spark Interactive Shells: spark-shell and pyspark
• Word Count Example by Using Interactive Scala Monitoring Spark Jobs Using YARN’s ResourceManager Web UI

Overview of Apache Hive

• What is Hive?
• Use Case: Storing Clickstream Data
• Hadoop Architecture
• How is Data Stored in HDFS?
• Organizing and Describing Data With Hive Big Data SQL on Top of Hive Data
• Defining Tables Over HDFS
• Hive Queries

Overview of Cloudera Impala

• Overview of Cloudera Impala Hadoop: Some Data Access/Processing Options
• Cloudera Impala Cloudera Impala: Key Features
• Cloudera Impala: Supported Data Formats
• Cloudera Impala: Programming Interfaces
• How Impala Fits Into the Hadoop Ecosystem
• How Impala Works with Hive

Using Oracle XQuery for Hadoop

• XML Review Oracle XQuery for Hadoop (OXH)
• OXH Features
• OXH Data Flow
• Using OXH: Installation, Functions, Adapters, and Configuration Properties
• Running an OXH Query
• XQuery Transformation and Basic Filtering
• Viewing the Completed Query in YARN’s ResourceManager

Overview of Solr

• Overview of Solr Apache Solr (Cloudera Search)
• Cloudera Search: Key Capabilities
• Cloudera Search: Features
• Cloudera Search Tasks Indexing in
• Cloudera Search Types of Indexing The solrctl Command

Integrating Your Big Data

• Unifying Data: A Typical Requirement
• Comparing Big Data Processing Engines
• Introducing Data Unification Options
• When To Use These Options?

Batch Loading Options

• Apache Sqoop
• Oracle Loader for Hadoop Oracle
• Copy to Hadoop

Using Oracle SQL Connector for HDFS

• Batch and Dynamic Loading: Oracle SQL Connector for HDFS
• OSCH Architecture
• Using OSCH
• Features Parallelism and Performance
• Performance Tuning Key Benefits
• Loading: Choosing a Connector

Using Oracle Data Integrator and Oracle GoldenGate for Big Data

• ETL and Synchronization: Oracle Data Integrator
• ODIs Declarative Design
• ODI Knowledge Modules (KMs)Simpler Physical Design / Shorter Implementation Time
• Using ODI with Big Data Heterogeneous Integration with Hadoop Environments
• Using ODI Studio
• ODI Studio Components: Overview
• ODI Studio: Big Data Knowledge Modules Oracle GoldenGate for Big Data

Using Oracle Big Data SQL

• Barriers to Effective Big Data Adoption
• Overcoming Big Data Barriers
• Oracle Big Data SQL: The Hybrid Solution
• Benefits: Virtualizes data access across Oracle Database, Hadoop and NoSQL stores
• Using Oracle Big Data SQL
• Query Performance Overview
• Deployment Options

Using Oracle Big Data Spatial and Graph

• Graph and Spatial Analysis: All About Relationships
• What is Oracle Big Data Spatial and Graph (BDSG)?
• Strategy (supported platforms, etc)
• BDSG: Graph Analysis
• Oracle BDSG: Spatial Analysis
• Multimedia Analytics Framework
• Deployment Options for Oracle BDSG
• Additional Resources

Using Oracle Advanced Analytics

• Oracle Advanced Analytics (OAA)
• OAA: Oracle Data Mining
• OAA: Oracle R Enterprise

Oracle Big Data Deployment Options

• Introduction to the Oracle Big Data Appliance
• Running the Oracle BDA Configuration Generation Utility
• Oracle BDA Mammoth Software Deployment Bundle
• Using the Oracle BDA mammoth Utility
• BDA Hardware and Integrated and Optional Software
• Administering and Securing the Oracle BDA Introduction to the Oracle Big Data Cloud Service
• Introduction to the Oracle Big Data Cloud Service Compute Edition