Older version of the python37-sagemaker-pyspark package in newer docker image

[josephsolidayotto]

The current version of the python37-sagemaker-pyspark package in the (906073651304.dkr.ecr.eu-central-1.amazonaws.com/sagemaker-spark-processing:2.4-cpu) 2.4 docker image is 1.4.0. However, when I upgrade to the (906073651304.dkr.ecr.eu-central-1.amazonaws.com/sagemaker-spark-processing:3.0-cpu) 3.0 docker image, the version is 1.3.0.

Why is the version of the python37-sagemaker-pyspark package older in the newer docker image?

[dp89]

HI @josephsolidayotto

Is there any package called python37-sagemaker-pyspark ? just wanted to since our data team has given package python37-sagemaker-pyspark to install ? Is it called sagemaker?