Amazon SageMaker Pipelines now supports callback capability

Amazon SageMaker Pipelines, the first purpose-built continuous integration and continuous delivery (CI/CD) service for machine learning (ML), now supports a new callback step that allows customers to integrate any task or job outside Amazon SageMaker as a step in the model building pipeline. When a callback step is invoked, the current execution of a SageMaker model building pipeline will pause and wait for an external task or job to return a task token that was generated by SageMaker at the start of call back step execution. You can use the call back step to include processing jobs external to SageMaker such a Spark job running on an Amazon EMR cluster or an extract-transform-load (ETL) task in AWS Glue as part of the SageMaker model building pipeline.

View the full article