Text Classification with Gluon on Amazon SageMaker and AWS Batch

Source: aws-ml-blog

Note: Currently the demo is in region: us-west-2

This is a revised version of Amazon SageMaker blog code.

FAQs

• fail to build wheel for scipy

  Add RUN apt-get update and RUN apt-get install -y python-dev on top of Dockerfile

• MXNetError: [06:11:12] src/operator/tensor/./broadcast_reduce_op.h:141: Check failed: axis < ndim && axis >= -ndim axis 1 exceeds the input dimension of 1

  Add keepdims=True in mx.nd.argmax functions.

  Ref:

  apache/mxnet#6405

  https://mxnet.incubator.apache.org/api/python/model.html?highlight=metric#mxnet.metric.Accuracy

  https://mxnet.incubator.apache.org/api/python/ndarray/ndarray.html?highlight=argmax#mxnet.ndarray.argmax

TODOs

• add support for py3
• fix Batch source command hard coded filename in create.yaml
• change path for AmazonSageMakerExecutionRole in create.yaml
• add batch access and lambda access for SageMaker execution role
• change to aws-cli default region in lambda_function.py