feat(raster)!: update titiler-pgstac from 0.2.3 to 0.8.0 #239

vincentsarago · 2023-10-16T15:31:38Z

This PR aims to update titiler-pgstac from version 0.2.3 to 0.8.0. Doing so, will also update titiler, rio-tiler, morecantile, fastapi and pydantic.

Endpoint changes

~~Use /collections/{collection_id}/items/{item_id} prefix for Item endpoint.~~

I was able to keep this as it was ({endpoint}/stac/info?collection=collection1&item=item1)

post_process= -> algorithm=
change tile url path parameter order from /tiles/{searchid}/{TileMatrixSetId}/{z}/{x}/{y} to /{searchid}/tiles/{TileMatrixSetId}/{z}/{x}/{y}

# Before
{endpoint}/mosaic/tiles/20200307aC0853900w361030/0/0/0

# Now
{endpoint}/mosaic/20200307aC0853900w361030/tiles/0/0/0

replace /{searchid}/{z}/{x}/{y}/assets endpoints by /{searchid}/tiles/{z}/{x}/{y}/assets
replace - by _ in query parameters
- coord-crs -> coord_crs
- dst-crs -> dst_crs
remove max_size default for mosaic's /statistics [POST] endpoint breaking change
add /bbox and /feature [POST] optional endpoints

vincentsarago · 2023-10-16T15:32:27Z

.pre-commit-config.yaml

@@ -12,7 +12,7 @@ repos:
        language_version: python

  - repo: https://github.com/PyCQA/flake8
-    rev: 3.8.3
+    rev: 6.1.0


flake8 didn't like Annotated types so I had to update

vincentsarago · 2023-10-16T15:32:54Z

raster_api/runtime/Dockerfile

@@ -1,9 +1,9 @@
-FROM public.ecr.aws/sam/build-python3.9:latest
+FROM public.ecr.aws/sam/build-python3.11:latest


not mandatory but will be faster

vincentsarago · 2023-10-16T15:33:37Z

raster_api/runtime/src/algorithms.py

+    }
+)
+
+PostProcessParams = algorithms.dependency


this replace the post_process option we used in DatasetParams

vincentsarago · 2023-10-16T15:34:38Z

raster_api/runtime/src/app.py

 stac = MultiBaseTilerFactory(
    reader=PgSTACReader,
    path_dependency=ItemPathParams,
    optional_headers=optional_headers,
    router_prefix=f"{path_prefix}/stac",
    environment_dependency=settings.get_gdal_config,
    router=APIRouter(route_class=LoggerRouteHandler),
+    extensions=[
+        stacViewerExtension(),
+    ],


We now use extensions instead of creating custom Factories

vincentsarago · 2023-10-16T15:35:38Z

raster_api/runtime/src/app.py

+    extensions=[
+        cogValidateExtension(),
+        cogViewerExtension(),
+    ],


Using the official titiler extensions for the /validate and /viewer endpoints

vincentsarago · 2023-10-16T15:36:51Z

raster_api/runtime/src/datasetparams.py

-        super().__post_init__()
-
-        if self.post_process is not None:
-            self.post_process = pp_methods.get(self.post_process)  # type: ignore


replaced by Algorithm

breaking change now we need to pass algorithm=swir instead of post_process=swir

vincentsarago · 2023-10-16T15:38:45Z

raster_api/runtime/src/dependencies.py

+    ],
+) -> pystac.Item:
+    """STAC Item dependency."""
+    return get_stac_item(request.app.state.dbpool, collection, item)


This is to keep the collection={collection_id}&item={item_id} query parameters for the /stac endpoints

vincentsarago · 2023-10-16T15:39:00Z

raster_api/runtime/src/dependencies.py

-            return features[0]
-
-
-def DatasetPathParams(


I don't think this was used

vincentsarago · 2023-10-16T15:39:18Z

raster_api/runtime/src/extensions.py

+                    "item": item.id,
+                },
+                media_type="text/html",
+            )


Extension instead of custom Factory

vincentsarago · 2023-10-16T19:39:26Z

raster_api/runtime/setup.py

-    "titiler.pgstac==0.2.3",
-    "titiler.application>=0.10,<0.11",
-    "importlib_resources>=1.1.0;python_version<='3.9'",  # https://github.com/cogeotiff/rio-tiler/pull/379
+    "boto3",


boto3 is now an optional dependency in rio-tiler

…cloudfront (#244) # What - adds optional configuration to deploy all endpoints with a custom root path (i.e. `/api/stac` and `/api/raster`) #229, #241 - adds support for using a cloudfront as a reverse proxy #229, #241, #245 - titiler-pgstac upgraded from 0.2.3 to 0.8.0 #239 - titiler upgrade for custom colormap configuration #243 # How tested A temporary test stack was deployed to confirm that raster-api works as expected and that the two-subdomain staging-stac and staging-raster pattern is still supported. The [pre-deploy diff action for this pr](https://github.com/NASA-IMPACT/veda-backend/actions/runs/6791564314/job/18463354484#step:11:919) confirms that the raster API lambda will be upgraded and no domain name changes will be caused.

feat(raster)!: update titiler-pgstac from 0.2.3 to 0.8.0

1bf6078

vincentsarago commented Oct 16, 2023

View reviewed changes

raster_api/runtime/src/dependencies.py

return features[0]

def DatasetPathParams(

Copy link

Contributor Author

vincentsarago Oct 16, 2023

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I don't think this was used

vincentsarago commented Oct 16, 2023

View reviewed changes

add dependencies

d177f15

vincentsarago force-pushed the feature/titiler-pgstac-update0.8.0 branch from e789826 to d177f15 Compare October 16, 2023 19:36

vincentsarago commented Oct 16, 2023

View reviewed changes

vincentsarago added 5 commits October 16, 2023 22:03

add tests deps

fbc7cc7

fix tests

0a885a2

🤦

e748c83

update handler

0dea328

pin pydantic to 1.* for cdk deployment

494a8de

vincentsarago marked this pull request as ready for review October 17, 2023 06:51

fix deps

441c543

anayeaye approved these changes Oct 17, 2023

View reviewed changes

anayeaye merged commit 7f0cbbc into develop Oct 17, 2023
4 checks passed

anayeaye deleted the feature/titiler-pgstac-update0.8.0 branch October 17, 2023 20:39

hanbyul-here mentioned this pull request Oct 23, 2023

Upgrade titiler-pgstac #234

Closed

3 tasks

This was referenced Nov 6, 2023

Update source params for HLS SWIR NASA-IMPACT/veda-config#334

Merged

feat!: titiler upgrade, optional custom base path for apis, optional cloudfront #244

Merged

Fetch upstream changes US-GHG-Center/ghgc-backend#51

Merged

This was referenced Nov 14, 2023

Fetch upstream changes US-GHG-Center/ghgc-backend#52

Merged

Fetch upstream changes US-GHG-Center/ghgc-backend#53

Closed

slesaad mentioned this pull request Nov 15, 2023

Fetch upstream changes US-GHG-Center/ghgc-backend#56

Merged

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

feat(raster)!: update titiler-pgstac from 0.2.3 to 0.8.0 #239

feat(raster)!: update titiler-pgstac from 0.2.3 to 0.8.0 #239

vincentsarago commented Oct 16, 2023 •

edited

Loading

vincentsarago Oct 16, 2023

vincentsarago Oct 16, 2023

vincentsarago Oct 16, 2023

vincentsarago Oct 16, 2023

vincentsarago Oct 16, 2023

vincentsarago Oct 16, 2023 •

edited

Loading

vincentsarago Oct 16, 2023

vincentsarago Oct 16, 2023

vincentsarago Oct 16, 2023

vincentsarago Oct 16, 2023

		@@ -1,9 +1,9 @@
		FROM public.ecr.aws/sam/build-python3.9:latest
		FROM public.ecr.aws/sam/build-python3.11:latest

feat(raster)!: update titiler-pgstac from 0.2.3 to 0.8.0 #239

feat(raster)!: update titiler-pgstac from 0.2.3 to 0.8.0 #239

Conversation

vincentsarago commented Oct 16, 2023 • edited Loading

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

vincentsarago Oct 16, 2023 • edited Loading

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

vincentsarago commented Oct 16, 2023 •

edited

Loading

vincentsarago Oct 16, 2023 •

edited

Loading