Ouça e leia
Entre em um mundo infinito de histórias
- Ler e ouvir tanto quanto você quiser
- Com mais de 500.000 títulos
- Títulos exclusivos + Storytel Originals
- 7 dias de teste gratuito, depois R$19,90/mês
- Fácil de cancelar a qualquer momento

Learning Spark SQL
- Autor
- Editor
- Idioma
- Inglês
- Formato
- Categoria
Não-ficção
Design, implement, and deliver successful streaming applications, machine learning pipelines and graph applications using Spark SQL API
About This Book
• Learn about the design and implementation of streaming applications, machine learning pipelines, deep learning, and large-scale graph processing applications using Spark SQL APIs and Scala.
• Learn data exploration, data munging, and how to process structured and semi-structured data using real-world datasets and gain hands-on exposure to the issues and challenges of working with noisy and "dirty" real-world data.
• Understand design considerations for scalability and performance in web-scale Spark application architectures.
Who This Book Is For
If you are a developer, engineer, or an architect and want to learn how to use Apache Spark in a web-scale project, then this is the book for you. It is assumed that you have prior knowledge of SQL querying. A basic programming knowledge with Scala, Java, R, or Python is all you need to get started with this book.
What You Will Learn
• Familiarize yourself with Spark SQL programming, including working with DataFrame/Dataset API and SQL
• Perform a series of hands-on exercises with different types of data sources, including CSV, JSON, Avro, MySQL, and MongoDB
• Perform data quality checks, data visualization, and basic statistical analysis tasks
• Perform data munging tasks on publically available datasets
• Learn how to use Spark SQL and Apache Kafka to build streaming applications
• Learn key performance-tuning tips and tricks in Spark SQL applications
• Learn key architectural components and patterns in large-scale Spark SQL applications
In Detail
In the past year, Apache Spark has been increasingly adopted for the development of distributed applications. Spark SQL APIs provide an optimized interface that helps developers build such applications quickly and easily. However, designing web-scale production applications using Spark SQL APIs can be a complex task. Hence, understanding the design and implementation best practices before you start your project will help you avoid these problems.
This book gives an insight into the engineering practices used to design and build real-world, Spark-based applications. The book's hands-on examples will give you the required confidence to work on any future projects you encounter in Spark SQL.
It starts by familiarizing you with data exploration and data munging tasks using Spark SQL and Scala. Extensive code examples will help you understand the methods used to implement typical use-cases for various types of applications. You will get a walkthrough of the key concepts and terms that are common to streaming, machine learning, and graph applications. You will also learn key performance-tuning details including Cost Based Optimization (Spark 2.2) in Spark SQL applications. Finally, you will move on to learning how such systems are architected and deployed for a successful delivery of your project.
Style and approach
This book is a hands-on guide to designing, building, and deploying Spark SQL-centric production applications at scale.
© 2017 Packt Publishing (E-book): 9781785887352
Data de lançamento
E-book: 7 de setembro de 2017
Livros semelhantes a Learning Spark SQL
- A gente mira no amor e acerta na solidãoAna Suy
- Mais esperto que o diabo: O mistério revelado da liberdade e do sucessoNapoleon Hill
- Sociedade do cansaçoByung-Chul Han
- Poder e ManipulaçãoJacob Petry
- Manifesto comunistaKarl Marx, Friedrich Engels
- Cartas de um terapeuta para seus momentos de criseAlexandre Coimbra Amaral
- Quem Pensa Enriquece: O legadoNapoleon Hill
- Fale tudo em inglêsJosé Roberto Igreja
- O sentido da vida: Vencedor do Prêmio Jabuti 2024Contardo Calligaris
- O Príncipe: Texto IntegralNicolau Maquiavel
- O corpo fala - Edição Comemorativa: A linguagem silenciosa da comunicação não-verbalPierre Weil, Roland Tompakow
- Psicanálise de boteco: O inconsciente na vida cotidianaAlexandre Patricio de Almeida
- MeditaçõesMarco Aurélio
- Jovem Nerd indicaJovem Nerd
- O corpo fala (resumo)Pierre Weil, Roland Tompakow
- O manuscrito original: As leis do triunfo e do sucesso de Napoleon HillNapoleon Hill
- Não pise no meu vazio: Ou o livro do vazio - Semifinalista do Prêmio Jabuti 2024Ana Suy
- Eu só existo no olhar do outro?Christian Dunker, Ana Suy
- A RepúblicaPlatão
- Desbloqueie o poder da sua mente: Programe o seu subconsciente para se libertar das dores e inseguranças e transforme a sua vidaMichael Arruda
- O príncipeNicolau Maquiavel
- Sobre a Brevidade da VidaSêneca
- The 48 Laws of PowerRobert Greene
- China: O socialismo do século XXIElias Jabbour, Alberto Gabriele
- O livro da MitologiaThomas Bulfinch