book

Building Machine Learning Pipelines

by Hannes Hapke, Catherine Nelson

July 2020

Intermediate to advanced

364 pages

9h 2m

English

O'Reilly Media, Inc.

Book available

Read now

Unlock full access

What Are Machine Learning Pipelines?Who Is This Book For?Why TensorFlow and TensorFlow Extended?Overview of the ChaptersConventions Used in This BookUsing Code ExamplesO’Reilly Online LearningHow to Contact UsAcknowledgments
Why Machine Learning Pipelines?When to Think About Machine Learning PipelinesOverview of the Steps in a Machine Learning PipelineData Ingestion and Data VersioningData ValidationData PreprocessingModel Training and TuningModel AnalysisModel VersioningModel DeploymentFeedback LoopsData PrivacyPipeline OrchestrationWhy Pipeline Orchestration?Directed Acyclic GraphsOur Example ProjectProject StructureOur Machine Learning ModelGoal of the Example ProjectSummary
What Is TFX?Installing TFXOverview of TFX ComponentsWhat Is ML Metadata?Interactive PipelinesAlternatives to TFXIntroduction to Apache BeamSetupBasic Data PipelineExecuting Your Basic PipelineSummary
Concepts for Data IngestionIngesting Local Data FilesIngesting Remote Data FilesIngesting Data Directly from DatabasesData PreparationSplitting DatasetsSpanning DatasetsVersioning DatasetsIngestion StrategiesStructured DataText Data for Natural Language ProblemsImage Data for Computer Vision ProblemsSummary
Why Data Validation?TFDVInstallationGenerating Statistics from Your DataGenerating Schema from Your DataRecognizing Problems in Your DataComparing DatasetsUpdating the SchemaData Skew and DriftBiased DatasetsSlicing Data in TFDVProcessing Large Datasets with GCPIntegrating TFDV into Your Machine Learning PipelineSummary
Why Data Preprocessing?Preprocessing the Data in the Context of the Entire DatasetScaling the Preprocessing StepsAvoiding a Training-Serving SkewDeploying Preprocessing Steps and the ML Model as One ArtifactChecking Your Preprocessing Results in Your PipelineData Preprocessing with TFTInstallationPreprocessing StrategiesBest PracticesTFT FunctionsStandalone Execution of TFTIntegrate TFT into Your Machine Learning PipelineSummary
Defining the Model for Our Example ProjectThe TFX Trainer Componentrun_fn() FunctionRunning the Trainer ComponentOther Trainer Component ConsiderationsUsing TensorBoard in an Interactive PipelineDistribution StrategiesModel TuningStrategies for Hyperparameter TuningHyperparameter Tuning in TFX PipelinesSummary
How to Analyze Your ModelClassification MetricsRegression MetricsTensorFlow Model AnalysisAnalyzing a Single Model in TFMAAnalyzing Multiple Models in TFMAModel Analysis for FairnessSlicing Model Predictions in TFMAChecking Decision Thresholds with Fairness IndicatorsGoing Deeper with the What-If ToolModel ExplainabilityGenerating Explanations with the WITOther Explainability TechniquesAnalysis and Validation in TFXResolverNodeEvaluator ComponentValidation in the Evaluator ComponentTFX Pusher ComponentSummary
A Simple Model ServerThe Downside of Model Deployments with Python-Based APIsLack of Code SeparationLack of Model Version ControlInefficient Model InferenceTensorFlow ServingTensorFlow Architecture OverviewExporting Models for TensorFlow ServingModel SignaturesInspecting Exported ModelsSetting Up TensorFlow ServingDocker InstallationNative Ubuntu InstallationBuilding TensorFlow Serving from SourceConfiguring a TensorFlow ServerREST Versus gRPCMaking Predictions from the Model ServerGetting Model Predictions via RESTUsing TensorFlow Serving via gRPCModel A/B Testing with TensorFlow ServingRequesting Model Metadata from the Model ServerREST Requests for Model MetadatagRPC Requests for Model MetadataBatching Inference RequestsConfiguring Batch PredictionsOther TensorFlow Serving OptimizationsTensorFlow Serving AlternativesBentoMLSeldonGraphPipeSimple TensorFlow ServingMLflowRay ServeDeploying with Cloud ProvidersUse CasesExample Deployment with GCPModel Deployment with TFX PipelinesSummary

Decoupling Deployment CyclesWorkflow OverviewOptimization of Remote Model LoadingModel Optimizations for DeploymentsQuantizationPruningDistillationUsing TensorRT with TensorFlow ServingTFLiteSteps to Optimize Your Model with TFLiteServing TFLite Models with TensorFlow ServingMonitoring Your TensorFlow Serving InstancesPrometheus SetupTensorFlow Serving ConfigurationSimple Scaling with TensorFlow Serving and KubernetesSummary
Advanced Pipeline ConceptsTraining Multiple Models SimultaneouslyExporting TFLite ModelsWarm Starting Model TrainingHuman in the LoopSlack Component SetupHow to Use the Slack ComponentCustom TFX ComponentsUse Cases of Custom ComponentsWriting a Custom Component from ScratchReusing Existing ComponentsSummary
Which Orchestration Tool to Choose?Apache BeamApache AirflowKubeflow PipelinesKubeflow Pipelines on AI PlatformConverting Your Interactive TFX Pipeline to a Production PipelineSimple Interactive Pipeline Conversion for Beam and AirflowIntroduction to Apache BeamOrchestrating TFX Pipelines with Apache BeamIntroduction to Apache AirflowInstallation and Initial SetupBasic Airflow ExampleOrchestrating TFX Pipelines with Apache AirflowPipeline SetupPipeline ExecutionSummary
Introduction to Kubeflow PipelinesInstallation and Initial SetupAccessing Your Kubeflow Pipelines InstallationOrchestrating TFX Pipelines with Kubeflow PipelinesPipeline SetupExecuting the PipelineUseful Features of Kubeflow PipelinesPipelines Based on Google Cloud AI PlatformPipeline SetupTFX Pipeline SetupPipeline ExecutionSummary
Explicit and Implicit FeedbackThe Data FlywheelFeedback Loops in the Real WorldDesign Patterns for Collecting FeedbackUsers Take Some Action as a Result of the PredictionUsers Rate the Quality of the PredictionUsers Correct the PredictionCrowdsourcing the AnnotationsExpert AnnotationsProducing Feedback AutomaticallyHow to Track Feedback LoopsTracking Explicit FeedbackTracking Implicit FeedbackSummary
Data Privacy IssuesWhy Do We Care About Data Privacy?The Simplest Way to Increase PrivacyWhat Data Needs to Be Kept Private?Differential PrivacyLocal and Global Differential PrivacyEpsilon, Delta, and the Privacy BudgetDifferential Privacy for Machine LearningIntroduction to TensorFlow PrivacyTraining with a Differentially Private OptimizerCalculating EpsilonFederated LearningFederated Learning in TensorFlowEncrypted Machine LearningEncrypted Model TrainingConverting a Trained Model to Serve Encrypted PredictionsOther Methods for Data PrivacySummary
Model Experiment TrackingThoughts on Model Release ManagementFuture Pipeline CapabilitiesTFX with Other Machine Learning FrameworksTesting Machine Learning ModelsCI/CD Systems for Machine LearningMachine Learning Engineering CommunitySummary
What Is a Container?Introduction to DockerIntroduction to Docker ImagesBuilding Your First Docker ImageDiving into the Docker CLIIntroduction to KubernetesSome Kubernetes DefinitionsGetting Started with Minikube and kubectlInteracting with the Kubernetes CLIDefining a Kubernetes ResourceDeploying Applications to Kubernetes
Before You Get StartedKubernetes on Google CloudSelecting a Google Cloud ProjectSetting Up Your Google Cloud ProjectCreating a Kubernetes ClusterAccessing Your Kubernetes Cluster with kubectlUsing Your Kubernetes Cluster with kubectlPersistent Volume Setups for Kubeflow Pipelines
Custom TFX ImagesExchange Data Through Persistent VolumesTFX Command-Line InterfaceTFX and Its DependenciesTFX TemplatesPublishing Your Pipeline with TFX CLI

Overview

Companies are spending billions on machine learning projects, but it’s money wasted if the models can’t be deployed effectively. In this practical guide, Hannes Hapke and Catherine Nelson walk you through the steps of automating a machine learning pipeline using the TensorFlow ecosystem. You’ll learn the techniques and tools that will cut deployment time from days to minutes, so that you can focus on developing new models rather than maintaining legacy systems.

Data scientists, machine learning engineers, and DevOps engineers will discover how to go beyond model development to successfully productize their data science projects, while managers will better understand the role they play in helping to accelerate these projects.

Understand the steps to build a machine learning pipeline
Build your pipeline using components from TensorFlow Extended
Orchestrate your machine learning pipeline with Apache Beam, Apache Airflow, and Kubeflow Pipelines
Work with data using TensorFlow Data Validation and TensorFlow Transform
Analyze a model in detail using TensorFlow Model Analysis
Examine fairness and bias in your model performance
Deploy models with TensorFlow Serving or TensorFlow Lite for mobile devices
Learn privacy-preserving machine learning techniques