Welcome to Microsoft Machine Learning for Apache Spark documentation!

Contents:

• Microsoft Machine Learning for Apache Spark
  • Features
• Installing Your Docker Image Locally
  • Step 1: Install Docker
  • Step 2: Quickstart – Get the MMLSpark Image and Run It
  • Step 3: Open Jupyter notebook
  • Step 4: Start and stop the Docker image
  • Step 5: Sharing Files and Notebooks Between the Local File System and Docker Container
• Refreshing Your Docker Image Locally
  • Step 1: Make sure the container is stopped
  • Step 2: Remove the local docker image
  • Step 3: Pull the newest image and run it
• Running on HDInsight Spark Cluster
• Azure Environment GPU Setup
  • Requirements on the connection between HDI Spark cluster and GPU VM
  • Connect an HDI cluster and GPU VM via ARM template
• MMLSpark
  • Repository Layout
  • Build
  • Adding a Module
• Pyspark Library
  • AssembleFeatures
  • BinaryFileReader
  • CNTKLearner
  • CNTKModel
  • CheckpointData
  • ComputeModelStatistics
  • ComputePerInstanceStatistics
  • DataConversion
  • FastVectorAssembler
  • Featurize
  • FindBestModel
  • ImageFeaturizer
  • ImageReader
  • ImageTransform
  • ModelDownloader
  • MultiColumnAdapter
  • PartitionSample
  • Repartition
  • SelectColumns
  • SummarizeData
  • TextFeaturizer
  • TrainClassifier
  • TrainRegressor
  • TypeConversionUtils
  • UnrollImage
  • Utils
  • _CNTKLearner
  • _CNTKModel
  • _ImageTransformer
• Scala Library

Indices and tables

• Index
• Module Index
• Search Page