000 a
999 _c31326
_d31326
008 230220b xxu||||| |||| 00| 0 eng d
020 _a9789355420787
082 _a005.1
_bPAR
100 _aParsian, Mahmoud
245 _aData algorithms with Spark : recipes and design patterns for scaling up using PySpark
260 _bShroff Publishers,
_c2022
_aMumbai :
300 _axx, 412 p.;
_bill.
_c24 cm
365 _b1600.00
_cINR
_d1.00
504 _aIncludes bibliographical references and index.
520 _aApache Spark's speed, ease of use, sophisticated analytics, and multilanguage support makes practical knowledge of this cluster-computing framework a required skill for data engineers and data scientists. With this hands-on guide, anyone looking for an introduction to Spark will learn practical algorithms and examples using PySpark. In each chapter, author Mahmoud Parsian shows you how to solve a data problem with a set of Spark transformations and algorithms. You'll learn how to tackle problems involving ETL, design patterns, machine learning algorithms, data partitioning, and genomics analysis. Each detailed recipe includes PySpark algorithms using the PySpark driver and shell script. With this book, you will: Learn how to select Spark transformations for optimized solutions Explore powerful transformations and reductions including reduceByKey(), combineByKey(), and mapPartitions() Understand data partitioning for optimized queries Build and apply a model using PySpark design patterns Apply motif-finding algorithms to graph data Analyze graph data by using the GraphFrames API Apply PySpark algorithms to clinical and genomics data Learn how to use and apply feature engineering in ML algorithms Understand and use practical and pragmatic data design patterns.
650 _aComputer programming
650 _aData Mining
650 _aProgrammation
650 _aSpark
650 _aOpen source tools
650 _a Associative law
650 _aBinning
650 _aFlatMap
650 _a Input-Filter-Output design pattern
650 _a Join design patterns
650 _aMonoids
650 _aMotif finding feature
650 _aOne-hot encoding
650 _aPageRank algorithm
650 _aPipelines
650 _aTransformation algorithms
942 _2ddc
_cBK