Название: Databricks Lakehouse Platform Cookbook: 100+ recipes for building a scalable and secure Databricks Lakehouse
Автор: Аlаn L. Dеnnis
Издательство: BPB Publications
Год: 2024
Страниц: 581
Язык: английский
Формат: epub (true)
Размер: 52.2 MB

Analyze, Architect, and Innovate with Databricks Lakehouse. The Databricks Lakehouse is groundbreaking technology that simplifies data storage, processing, and analysis. This cookbook offers a clear and practical guide to building and optimizing your Lakehouse to make data-driven decisions and drive impactful results. This definitive guide walks you through the entire Lakehouse journey, from setting up your environment, and connecting to storage, to creating Delta tables, building data models, and ingesting and transforming data. We start off by discussing how to ingest data to Bronze, then refine it to produce Silver. Next, we discuss how to create Gold tables and various data modeling techniques often performed in the Gold layer. You will learn how to leverage Spark SQL and PySpark for efficient data manipulation, apply Delta Live Tables for real-time data processing, and implement Machine Learning and Data Science workflows with MLflow, Feature Store, and AutoML. The book also delves into advanced topics like graph analysis, data governance, and visualization, equipping you with the necessary knowledge to solve complex data challenges. By the end of this cookbook, you will be a confident Lakehouse expert, capable of designing, building, and managing robust data-driven solutions. A good understanding of SQL, Python, Spark, and cloud computing would benefit the reader but is not required.

Название: Big Data and Hadoop: Fundamentals, tools, and techniques for data-driven success - 2nd Edition
Автор: Мауаnk Вhushаn
Издательство: BPB Publications
Год: 2024
Страниц: 548
Язык: английский
Формат: epub (true)
Размер: 27.8 MB

In today's data-driven world, harnessing the power of big data is no longer a luxury, but a necessity. This comprehensive guide, "Big Data and Hadoop," dives deep into the world of big data and equips you with the knowledge and skills you need to conquer even the most complex data landscapes. Start with the fundamentals of big data, exploring its growing significance and diverse applications. You'll look into the heart of the Apache Hadoop ecosystem, mastering its core components like HDFS and MapReduce. We'll demystify NoSQL databases, introducing you to HBase and Cassandra as powerful alternatives to traditional databases. Clarify the details of MapReduce programming with practical examples, and discover the power of PigLatin and HiveQL for efficient data analysis. Explore advanced tools like Spark, unlocking its potential for real-time data processing and analytics. Rounding out your knowledge, the book delves into practical applications, exploring real-world scenarios and research-based insights. By the end of this book, you'll emerge as a confident big data explorer, equipped to tackle any data challenge with expertise and precision. Whether you are a beginner or have some experience with Big Data. This book is for aspiring Big Data professionals, including data analysts, software developers, IT professionals, and students in Computer Science and related fields.

Название: Hypothesis Generation and Interpretation: Design Principles and Patterns for Big Data Applications
Автор: Нirоshi Ishikаwа
Издательство: Springer
Серия: Studies in Big Data
Год: 2024
Страниц: 380
Язык: английский
Формат: pdf (true)
Размер: 11.1 MB

This book focuses in detail on Data Science and data analysis and emphasizes the importance of data engineering and data management in the design of Big Data applications. The author uses patterns discovered in a collection of Big Data applications to provide design principles for hypothesis generation, integrating Big Data processing and management, Machine Learning and data mining techniques. The book proposes and explains innovative principles for interpreting hypotheses by integrating micro-explanations (those based on the explanation of analytical models and individual decisions within them) with macro-explanations (those based on applied processes and model generation). Practical case studies are used to demonstrate how hypothesis-generation and -interpretation technologies work. These are based on “social infrastructure” applications like in-bound tourism, disaster management, lunar and planetary exploration, and treatment of infectious diseases. The novel methods and technologies proposed in Hypothesis Generation and Interpretation are supported by the incorporation of historical perspectives on science and an emphasis on the origin and development of the ideas behind their design principles and patterns. In the Big Data era, characterized by volume, variety, and velocity, which generates a large amount of diverse data at high speed, the role of a hypothesis is more important to generate the final value, and such a hypothesis is more complicated and complex than ever. At the same time, the era of Big Data creates new vague concerns for end users as to whether Big Data relevant to them will be used appropriately.

Название: Architecting a Modern Data Warehouse for Large Enterprises
Автор: Аnjаni Кumаr, Аbhishеk Мishrа, Sаnjееv Кumаr
Издательство: Apress
Год: 2024
Страниц: 378
Язык: английский
Формат: pdf
Размер: 10.1 MB

Design and architect new generation cloud-based data warehouses using Azure and AWS. This book provides an in-depth understanding of how to build modern cloud-native data warehouses, as well as their history and evolution. The book starts by covering foundational data warehouse concepts, and introduces modern features such as distributed processing, big data storage, data streaming, and processing data on the cloud. You will gain an understanding of the synergy, relevance, and usage data warehousing standard practices in the modern world of distributed data processing. The authors walk you through the essential concepts of Data Mesh, Data Lake, Lakehouse, and Delta Lake. And they demonstrate the services and offerings available on Azure and AWS that deal with data orchestration, data democratization, data governance, data security, and business intelligence. After completing this book, you will be ready to design and architect enterprise-grade, cloud-based modern data warehouses using industry best practices and guidelines.

Название: Become a SQL Professional Overnight: The Simplified QuickStart guide for Beginners with Hands-on project
Автор: Аimее Мills
Издательство: Independently published
Год: 2023
Страниц: 204
Язык: английский
Формат: pdf
Размер: 33.1 MB

Unraveling the Overnight SQL Mastery. In a world where time is of the essence, the prospect of becoming a SQL professional overnight might seem like a tantalizing promise. "Become a SQL Professional OVERNIGHT" is a book that boldly claims to transform your understanding of SQL in a remarkably short span. As we embark on this journey of accelerated learning, it's crucial to pause and reflect on the implications of such a bold proposition. The book sets the stage with an assertive promise: the ability to master SQL in the blink of an eye. While this assertion may raise eyebrows and elicit skepticism, it taps into the collective desire for efficiency and instant expertise. As we delve into the content, it becomes evident that the approach is not about shortcuts but rather a strategic and intensive immersion into the world of SQL. This is not just a book; it's a catalyst for transformation, a key to unlocking doors that were once considered time prohibitive. If you find yourself at the intersection of urgency and the need for SQL proficiency, this book beckons you. Embrace the challenge, embark on an accelerated learning journey, and redefine your professional trajectory. The keys to SQL mastery await, promising not just efficiency but a profound transformation in your approach to data. Dive in, and let the overnight transformation begin.

Название: Visualization of Time-Oriented Data (2nd Edition)
Автор: Wоlfgаng Аignеr, Silviа Мiksсh, Неidrun Sсhumаnn, Сhristiаn Тоminski
Издательство: Springer
Серия: Human–Computer Interaction Series
Год: 2023
Страниц: 453
Язык: английский
Формат: pdf (true)
Размер: 48.0 MB

Time is an exceptional dimension with high relevance in medicine, engineering, business, science, biography, history, planning, or project management. Understanding time-oriented data via visual representations enables us to learn from the past in order to predict, plan, and build the future. This second edition builds upon the great success of the first edition. It maintains a brief introduction to visualization and a review of historical time-oriented visual representations. At its core, the book develops a systematic view of the visualization of time-oriented data. Separate chapters discuss interaction techniques and computational methods for supporting the visual data analysis. Many examples and figures illustrate the introduced concepts and techniques. So, what is new for the second edition? The entire content has been revised and expanded to represent state-of-the-art knowledge. The chapter on interaction support now includes advanced methods for interacting with visual representations of time-oriented data. The second edition also covers the topics of data quality as well as segmentation and labeling. The comprehensive survey of classic and contemporary visualization techniques now provides more than 150 self-contained descriptions accompanied by illustrations and corresponding references. A completely new chapter describes how the structured survey can be used for the guided selection of suitable visualization techniques. Visualization is a method of computing. It transforms the symbolic into the geometric, enabling researchers to observe their simulations and computations. Visualization offers a method for seeing the unseen. It enriches the process of scientific discovery and fosters profound and unexpected insights.

Название: Analytics Engineering with SQL and dbt: Building Meaningful Data Models at Scale
Автор: Rui Реdrо Масhаdо, Неldеr Russа
Издательство: O’Reilly Media, Inc.
Год: 2024
Страниц: 324
Язык: английский
Формат: pdf (true)
Размер: 10.3 MB

With the shift from data warehouses to data lakes, data now lands in repositories before it's been transformed, enabling engineers to model raw data into clean, well-defined datasets. dbt (data build tool) helps you take data further. This practical book shows data analysts, data engineers, BI developers, and data scientists how to create a true self-service transformation platform through the use of dynamic SQL. Authors Rui Machado from Monstarlab and Helder Russa from Jumia show you how to quickly deliver new data products by focusing more on value delivery and less on architectural and engineering aspects. If you know your business well and have the technical skills to model raw data into clean, well-defined datasets, you'll learn how to design and deliver data models without any technical influence. This book is designed for professionals, students, and enthusiasts dealing with the complex world of data management and analytics. Whether you’re an experienced veteran reminiscing about the basic principles of data modeling or an aspiring analyst keen to understand the transformation from business intelligence to contemporary analytics engineering, our storytelling assures clearness and direction.

Название: MongoDB Fundamentals
Автор: Тhеорhilus Еdеt
Издательство: CompreQuest Books
Серия: Mastering Database Management Series
Год: 2023
Страниц: 333
Язык: английский
Формат: pdf
Размер: 28.8 MB

Unlock the Power of Data in the Digital Age with "MongoDB Fundamentals"! In the ever-evolving landscape of modern website development, data is the backbone of innovation. Meet MongoDB, the game-changer that empowers developers to revolutionize the way they conceive, store, and retrieve information. This comprehensive guide unravels the depths of MongoDB, offering a roadmap for harnessing its capabilities to propel your applications to new heights. Why MongoDB in Modern Website Development? Traditional databases are like rigid blueprints, constraining your creativity and adaptability. Enter MongoDB, the NoSQL database that flips the script. Its document-oriented, schema-less design allows developers to sculpt data structures as fluidly as their ideas evolve. Whether you're crafting a dynamic e-commerce platform, a responsive mobile app, or a data-intensive analytics system, MongoDB's flexibility is your secret weapon. Dear Developer, the time is now to embrace the rare benefits of MongoDB in your applications. This book is your gateway to understanding and implementing MongoDB's capabilities. Let go of the constraints of traditional databases and step into a world where your creativity knows no bounds. Dive into the fundamentals, experiment with concepts, and see MongoDB in action. This isn't just a guide; it's your hands-on companion to unlocking MongoDB's full potential.

Название: Excel: от новичка до продвинутого пользователя
Автор: Осипов Е.А., Александрова И.Л., Филиппова И.А.
Издательство: Казань: Казанский федеральный университет
Год: 2022
Формат: pdf
Страниц: 72
Размер: 13 mb
Язык: Русский

Данное пособие составлено в соответствии с современной структурой изучения дисциплин и является дополнением к курсу «Excel: от новичка до продвинутого пользователя». В пособии рассмотрены задачи по работе с табличными данными, математическими и логическими функциями, построению графиков и диаграмм с применением табличного редактора Microsoft Excel 2021 из пакета прикладного программного обеспечения Microsoft Office 2021 под управлением операционной системы Windows.

Название: Indexing Beyond the Basics
Автор: Тоbiаs Реtrу
Издательство: Independently published
Год: 2023
Язык: английский
Формат: pdf (true), epub
Размер: 20.7 MB

Learn to create indexes for your slow queries by following simple principles. Hi! I'm Tobias Petry, a full stack developer who used to suck at writing fast database queries. Whenever I had a slow query, I needed to ask more advanced developers for help and hope they had time for me. Like everyone, I always wished I could solve those problems on my own. But even after reading some tutorials I didn't get any closer to my goal. The number of queries I couldn't optimize by far exceeded the ones I could make faster. So I learned everything about databases over the next 10+ years from countless books, conferences, trainings, articles and much practice. Finally, I could fix any slow query entirely without help. But during my consulting work I found that most developers still face the same problem. The reason database indexes are still not understood by developers is the depth of the existing content. Whether it is books, articles or videos - they all have their own problems that limit the ability to understand database indexing. You are a developer who can write SQL queries but struggle with creating the correct indexes to make them fast. Neither do you have the time or interest to learn this topic in weeks - a couple evenings on the couch should be enough. You also just want to learn the practical knowledge necessary to complete your task and move on to other things. The content should avoid any technical complex database implementation details - you want the core information quickly, concisely and understandably.