Ensure High Availability for SageMaker Endpoint Production Variants

Rule Description:

Troubleshooting Steps:

2. 1.
   Verify the current configuration of the SageMaker endpoint.
4. 2.
   Check the instance count parameter settings for the production variant.
6. 3.
   Determine the impact of increasing the instance count on cost and performance.
8. 4.
   Modify the instance count to a value greater than 1 if deemed appropriate.

Remediation Steps:

2. 1.
   Access the AWS Management Console.
4. 2.
   Navigate to the Amazon SageMaker service.
6. 3.
   Identify the endpoint with the production variant that requires adjustment.
8. 4.
   Select the production variant configuration.
10. 5.
    Locate the setting for initial instance count.
12. 6.
    Update the instance count to a value greater than 1.
14. 7.
    Save the changes to apply the updated configuration to the endpoint.

Code Example:

import boto3

sagemaker = boto3.client('sagemaker')

response = sagemaker.update_endpoint(EndpointName='your-endpoint-name', 
                                     EndpointConfigName='your-endpoint-config',
                                     ProductionVariants=[
                                         {
                                             'InstanceType': 'ml.m4.xlarge',
                                             'InitialInstanceCount': 2,
                                             'ModelName': 'your-model-name',
                                             'VariantName': 'AllTraffic'
                                         }
                                     ])