Listen and read

Step into an infinite world of stories

  • Read and listen as much as you want
  • Over 950 000 titles
  • Exclusive titles + Storytel Originals
  • Easy to cancel anytime
Try now
Cover for Learning Spark SQL

Learning Spark SQL

Language
English
Format
Category

Non-Fiction

Design, implement, and deliver successful streaming applications, machine learning pipelines and graph applications using Spark SQL API

About This Book

• Learn about the design and implementation of streaming applications, machine learning pipelines, deep learning, and large-scale graph processing applications using Spark SQL APIs and Scala.

• Learn data exploration, data munging, and how to process structured and semi-structured data using real-world datasets and gain hands-on exposure to the issues and challenges of working with noisy and "dirty" real-world data.

• Understand design considerations for scalability and performance in web-scale Spark application architectures.

Who This Book Is For

If you are a developer, engineer, or an architect and want to learn how to use Apache Spark in a web-scale project, then this is the book for you. It is assumed that you have prior knowledge of SQL querying. A basic programming knowledge with Scala, Java, R, or Python is all you need to get started with this book.

What You Will Learn

• Familiarize yourself with Spark SQL programming, including working with DataFrame/Dataset API and SQL

• Perform a series of hands-on exercises with different types of data sources, including CSV, JSON, Avro, MySQL, and MongoDB

• Perform data quality checks, data visualization, and basic statistical analysis tasks

• Perform data munging tasks on publically available datasets

• Learn how to use Spark SQL and Apache Kafka to build streaming applications

• Learn key performance-tuning tips and tricks in Spark SQL applications

• Learn key architectural components and patterns in large-scale Spark SQL applications

In Detail

In the past year, Apache Spark has been increasingly adopted for the development of distributed applications. Spark SQL APIs provide an optimized interface that helps developers build such applications quickly and easily. However, designing web-scale production applications using Spark SQL APIs can be a complex task. Hence, understanding the design and implementation best practices before you start your project will help you avoid these problems.

This book gives an insight into the engineering practices used to design and build real-world, Spark-based applications. The book's hands-on examples will give you the required confidence to work on any future projects you encounter in Spark SQL.

It starts by familiarizing you with data exploration and data munging tasks using Spark SQL and Scala. Extensive code examples will help you understand the methods used to implement typical use-cases for various types of applications. You will get a walkthrough of the key concepts and terms that are common to streaming, machine learning, and graph applications. You will also learn key performance-tuning details including Cost Based Optimization (Spark 2.2) in Spark SQL applications. Finally, you will move on to learning how such systems are architected and deployed for a successful delivery of your project.

Style and approach

This book is a hands-on guide to designing, building, and deploying Spark SQL-centric production applications at scale.

© 2017 Packt Publishing (Ebook): 9781785887352

Release date

Ebook: 7 September 2017

Books similar to Learning Spark SQL

  1. The 48 Laws of Power
    The 48 Laws of PowerRobert Greene
    4.2
  2. This Is What Inequality Looks Like
    This Is What Inequality Looks LikeTeo You Yenn
    4.6
  3. Academic Skills for Interdisciplinary Studies
    Academic Skills for Interdisciplinary Studies
  4. The Easy Way to Stop Gambling: Take Control of Your Life
    The Easy Way to Stop Gambling: Take Control of Your LifeAllen Carr
    4.8
  5. The Art of Thinking Clearly
    The Art of Thinking ClearlyRolf Dobelli
    4.4
  6. De machtscode: Hoe de onzichtbare belangenstrijd achter AI onze democratie bedreigt
    De machtscode: Hoe de onzichtbare belangenstrijd achter AI onze democratie bedreigtMarietje Schaake
    4.4
  7. Fundamental Aspects of Palliative Care Nursing 2nd Edition
    Fundamental Aspects of Palliative Care Nursing 2nd EditionRobert Becker
    4.3
  8. Scream With Me: Horror Films and the Rise of American Feminism (1968-1980)
    Scream With Me: Horror Films and the Rise of American Feminism (1968-1980)Eleanor Johnson
    4
  9. HSK 5 上 Standard Course Textbook and Workbook Exercises Solutions and Audio Files (Lesson 1,2,3): HSK5上
    HSK 5 上 Standard Course Textbook and Workbook Exercises Solutions and Audio Files (Lesson 1,2,3): HSK5上Chemon Chen, Nyna Liu
  10. The Rescue Artist: A True Story of Art, Thieves, and the Hunt for a Missing Masterpiece
    The Rescue Artist: A True Story of Art, Thieves, and the Hunt for a Missing MasterpieceEdward Dolnick
    4.2
  11. Perpetual Euphoria: On the Duty to Be Happy
    Perpetual Euphoria: On the Duty to Be HappyPascal Bruckner
  12. All About Love: New Visions
    All About Love: New Visionsbell hooks
    4
  13. How Did the Undercut Become the Douchiest Hairstyle for Singaporean Men?
    How Did the Undercut Become the Douchiest Hairstyle for Singaporean Men?RICE media
    2.8
  14. The Body Keeps the Score - Summarized for Busy People (Brain, Mind, and Body in the Healing of Trauma: Based on the Book by Bessel van der Kolk MD): Brain, Mind, and Body in the Healing of Trauma: Based on the Book by Bessel van der Kolk MD
    The Body Keeps the Score - Summarized for Busy People (Brain, Mind, and Body in the Healing of Trauma: Based on the Book by Bessel van der Kolk MD): Brain, Mind, and Body in the Healing of Trauma: Based on the Book by Bessel van der Kolk MDGoldmine Reads
    3.6
  15. Momma and the Meaning of Life: Tales of Psychotherapy
    Momma and the Meaning of Life: Tales of PsychotherapyIrvin D. Yalom MD
    4.3
  16. Everything Was Forever, Until It Was No More: The Last Soviet Generation
    Everything Was Forever, Until It Was No More: The Last Soviet GenerationAlexei Yurchak
  17. Discovery of India, The
    Discovery of India, TheJawaharlal Nehru
    4.4
  18. معلقة لبيد بن ربيعة
    معلقة لبيد بن ربيعةلبيد بن ربيعة
    4
  19. Царь собственной персоной: Как Владимир Путин обманул всех нас
    Царь собственной персоной: Как Владимир Путин обманул всех насРоман Баданин, Михаил Рубин
    5
  20. The Story of Philosophy: The Lives and Opinions of the Greater Philosophers
    The Story of Philosophy: The Lives and Opinions of the Greater PhilosophersWill Durant
    4
  21. Uravanai En Uyire
    Uravanai En UyireUma Nathan
    4.6
  22. Mentalization Workbook: How to Understand Yourself and Others When Your Thoughts and Emotions Get in Your Way
    Mentalization Workbook: How to Understand Yourself and Others When Your Thoughts and Emotions Get in Your WayAnthony Bateman, FRCPsych, Peter Fonagy, FMedSci, FBA
  23. Philosophy for Beginners: Introduction to philosophy - history and meaning, basic philosophical directions and methods
    Philosophy for Beginners: Introduction to philosophy - history and meaning, basic philosophical directions and methodsTimo Kaschner
    3.6
  24. Focus: The ASML Way. Inside the Power Struggle over the Most Complex Machine on Earth
    Focus: The ASML Way. Inside the Power Struggle over the Most Complex Machine on EarthMarc Hijink
  25. Money, Parties, and Democracy: Political Finance Between Fat Cats and Big Government
    Money, Parties, and Democracy: Political Finance Between Fat Cats and Big Governmentmatteo Bonotti, Zim Nwokora

Features:

  • Over 950 000 titles

  • Kids Mode (child safe environment)

  • Download books for offline access

  • Cancel anytime

Unlimited

For those who want to listen and read without limits.

S$12.98 /month

Limited Offer
  • 1 account

  • Unlimited Access

  • Unlimited listening

  • Cancel anytime

Try now

Family

For those who want to share stories with family and friends.

Starting at S$14.90 /month

  • 2-3 accounts

  • Unlimited Access

  • Unlimited listening

  • Cancel anytime

You + 1 family member

2 accounts

S$14.90 /month

Try now
Most popular

Unlimited Yearly

For those who want to listen and read without limits.

S$119 /year

Save 58%
  • 1 account

  • Unlimited Access

  • Unlimited listening

  • Cancel anytime

Try now