Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Scene.load error on conflicting 'y' values with MSG example. #1517

Closed
Benblob688 opened this issue Jan 29, 2021 · 9 comments
Closed

Scene.load error on conflicting 'y' values with MSG example. #1517

Benblob688 opened this issue Jan 29, 2021 · 9 comments
Labels

Comments

@Benblob688
Copy link

Benblob688 commented Jan 29, 2021

I am new to SatPy and have an issue using the basic tutorial "example" with MSG data.

The example code is here: https://nbviewer.jupyter.org/github/pytroll/pytroll-examples/blob/master/satpy/hrit_msg_tutorial.ipynb
and I have supplied some data I have from a project archive used by other people, here for your recreation/testing: https://drive.google.com/drive/folders/1fpZBsGy3GnoD-r7RpuA3fbSCKls4Xs34?usp=sharing

I get an error with the Scene.load syntax.

Btw, the example says to use 'natural' for the composite, but that does not exist in my scene, I have used scn.available_composite_ids() to get the list, and have chosen one from there.

The code:

from satpy.scene import Scene
from satpy.resample import get_area_def
from satpy import find_files_and_readers
from datetime import datetime

files = find_files_and_readers(base_dir='/path/to/data/decompressed/2020/20200906/00/', 
                               start_time=datetime(2020, 9, 6, 0, 0),
                               end_time=datetime(2020, 9, 6, 0, 15),
                               reader='seviri_l1b_hrit')
scn = Scene(filenames=files)

composite = 'convection'
scn.load([composite]) # <- this is the problem
scn.show(composite)

The very large error (I feel the start is unrelated, but have included it for completeness)

/home/users/bpickering/anaconda3/envs/ML/lib/python3.8/site-packages/pyproj/crs/crs.py:543: UserWarning: You will likely lose important projection information when converting to a PROJ string from another format. See: https://proj.org/faq.html#what-is-the-best-format-for-describing-coordinate-reference-systems
  proj_string = self.to_proj4()
/home/users/bpickering/anaconda3/envs/ML/lib/python3.8/site-packages/pyproj/crs/crs.py:543: UserWarning: You will likely lose important projection information when converting to a PROJ string from another format. See: https://proj.org/faq.html#what-is-the-best-format-for-describing-coordinate-reference-systems
  proj_string = self.to_proj4()
/home/users/bpickering/anaconda3/envs/ML/lib/python3.8/site-packages/pyproj/crs/crs.py:543: UserWarning: You will likely lose important projection information when converting to a PROJ string from another format. See: https://proj.org/faq.html#what-is-the-best-format-for-describing-coordinate-reference-systems
  proj_string = self.to_proj4()
/home/users/bpickering/anaconda3/envs/ML/lib/python3.8/site-packages/pyproj/crs/crs.py:543: UserWarning: You will likely lose important projection information when converting to a PROJ string from another format. See: https://proj.org/faq.html#what-is-the-best-format-for-describing-coordinate-reference-systems
  proj_string = self.to_proj4()
/home/users/bpickering/anaconda3/envs/ML/lib/python3.8/site-packages/pyproj/crs/crs.py:543: UserWarning: You will likely lose important projection information when converting to a PROJ string from another format. See: https://proj.org/faq.html#what-is-the-best-format-for-describing-coordinate-reference-systems
  proj_string = self.to_proj4()
/home/users/bpickering/anaconda3/envs/ML/lib/python3.8/site-packages/pyproj/crs/crs.py:543: UserWarning: You will likely lose important projection information when converting to a PROJ string from another format. See: https://proj.org/faq.html#what-is-the-best-format-for-describing-coordinate-reference-systems
  proj_string = self.to_proj4()
/home/users/bpickering/anaconda3/envs/ML/lib/python3.8/site-packages/pyproj/crs/crs.py:543: UserWarning: You will likely lose important projection information when converting to a PROJ string from another format. See: https://proj.org/faq.html#what-is-the-best-format-for-describing-coordinate-reference-systems
  proj_string = self.to_proj4()
---------------------------------------------------------------------------
ValueError                                Traceback (most recent call last)
<ipython-input-11-11ef6e6c03e2> in <module>
     11 
     12 composite = 'convection'
---> 13 scn.load([composite]) # <- this is the problem
     14 scn.show(composite)

~/anaconda3/envs/ML/lib/python3.8/site-packages/satpy/scene.py in load(self, wishlist, calibration, resolution, polarization, level, generate, unload, **kwargs)
   1179         self._wishlist |= needed_datasets
   1180 
-> 1181         self._read_datasets_from_storage(**kwargs)
   1182         self.generate_possible_composites(generate, unload)
   1183 

~/anaconda3/envs/ML/lib/python3.8/site-packages/satpy/scene.py in _read_datasets_from_storage(self, **kwargs)
   1199         """
   1200         nodes = self._dependency_tree.leaves(nodes=self.missing_datasets)
-> 1201         return self._read_dataset_nodes_from_storage(nodes, **kwargs)
   1202 
   1203     def _read_dataset_nodes_from_storage(self, reader_nodes, **kwargs):

~/anaconda3/envs/ML/lib/python3.8/site-packages/satpy/scene.py in _read_dataset_nodes_from_storage(self, reader_nodes, **kwargs)
   1205         # Sort requested datasets by reader
   1206         reader_datasets = self._sort_dataset_nodes_by_reader(reader_nodes)
-> 1207         loaded_datasets = self._load_datasets_by_readers(reader_datasets, **kwargs)
   1208         self._datasets.update(loaded_datasets)
   1209         return loaded_datasets

~/anaconda3/envs/ML/lib/python3.8/site-packages/satpy/scene.py in _load_datasets_by_readers(self, reader_datasets, **kwargs)
   1230         for reader_name, ds_ids in reader_datasets.items():
   1231             reader_instance = self._readers[reader_name]
-> 1232             new_datasets = reader_instance.load(ds_ids, **kwargs)
   1233             loaded_datasets.update(new_datasets)
   1234         return loaded_datasets

~/anaconda3/envs/ML/lib/python3.8/site-packages/satpy/readers/yaml_reader.py in load(self, dataset_keys, previous_datasets, **kwargs)
    917             coords = [all_datasets.get(cid, None)
    918                       for cid in coordinates.get(dsid, [])]
--> 919             ds = self._load_dataset_with_area(dsid, coords, **kwargs)
    920             if ds is not None:
    921                 all_datasets[dsid] = ds

~/anaconda3/envs/ML/lib/python3.8/site-packages/satpy/readers/yaml_reader.py in _load_dataset_with_area(self, dsid, coords, upper_right_corner, **kwargs)
   1087 
   1088     def _load_dataset_with_area(self, dsid, coords, upper_right_corner='native', **kwargs):
-> 1089         ds = super(GEOFlippableFileYAMLReader, self)._load_dataset_with_area(dsid, coords, **kwargs)
   1090 
   1091         if ds is not None:

~/anaconda3/envs/ML/lib/python3.8/site-packages/satpy/readers/yaml_reader.py in _load_dataset_with_area(self, dsid, coords, **kwargs)
    834         if area is not None:
    835             ds.attrs['area'] = area
--> 836             ds = add_crs_xy_coords(ds, area)
    837         return ds
    838 

~/anaconda3/envs/ML/lib/python3.8/site-packages/satpy/resample.py in add_crs_xy_coords(data_arr, area)
    305     else:
    306         # Gridded data (AreaDefinition/StackedAreaDefinition)
--> 307         data_arr = add_xy_coords(data_arr, area, crs=crs)
    308     return data_arr
    309 

~/anaconda3/envs/ML/lib/python3.8/site-packages/satpy/resample.py in add_xy_coords(data_arr, area, crs)
    250     y = xr.DataArray(y, dims=('y',), attrs=y_attrs)
    251     x = xr.DataArray(x, dims=('x',), attrs=x_attrs)
--> 252     return data_arr.assign_coords(y=y, x=x)
    253 
    254 

~/anaconda3/envs/ML/lib/python3.8/site-packages/xarray/core/common.py in assign_coords(self, coords, **coords_kwargs)
    470         data = self.copy(deep=False)
    471         results = self._calc_assign_results(coords_kwargs)
--> 472         data.coords.update(results)
    473         return data
    474 

~/anaconda3/envs/ML/lib/python3.8/site-packages/xarray/core/coordinates.py in update(self, other)
    116             [self.variables, other_vars], priority_arg=1, indexes=self.indexes
    117         )
--> 118         self._update_coords(coords, indexes)
    119 
    120     def _merge_raw(self, other):

~/anaconda3/envs/ML/lib/python3.8/site-packages/xarray/core/coordinates.py in _update_coords(self, coords, indexes)
    290         coords_plus_data = coords.copy()
    291         coords_plus_data[_THIS_ARRAY] = self._data.variable
--> 292         dims = calculate_dimensions(coords_plus_data)
    293         if not set(dims) <= set(self.dims):
    294             raise ValueError(

~/anaconda3/envs/ML/lib/python3.8/site-packages/xarray/core/dataset.py in calculate_dimensions(variables)
    204                 last_used[dim] = k
    205             elif dims[dim] != size:
--> 206                 raise ValueError(
    207                     "conflicting sizes for dimension %r: "
    208                     "length %s on %r and length %s on %r"

ValueError: conflicting sizes for dimension 'y': length 3712 on 'y' and length 7424 on 'acq_time'

I setup a new environment today so all packages are the most recent as suggested, doing commands like pip install satpy and so on. Python 3.8 is being used.

@djhoese
Copy link
Member

djhoese commented Jan 29, 2021

Regarding the natural issue, there's an issue on the examples repository for that here: pytroll/pytroll-examples#7. Since you've run into this, what do you think about making a pull request to fix it? The correct name should be natural_color.

As for your error, could you print out the filenames you are providing? The error seems to suggest that Satpy found 3712 of image data but 7424 of "time" data.

@djhoese djhoese added the bug label Jan 29, 2021
@Benblob688
Copy link
Author

Benblob688 commented Jan 29, 2021

Re. natural, I have tried the corrected natural_color and some other options which scn.available_composite_ids() says exist, and the same error occurs.

The file list is pretty huge, good luck:

{'seviri_l1b_hrit': ['/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-_________-PRO______-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-_________-PRO______-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-_________-EPI______-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-_________-EPI______-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-HRV______-000011___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-HRV______-000018___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-HRV______-000010___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-HRV______-000007___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-HRV______-000014___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-HRV______-000012___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-HRV______-000019___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-HRV______-000006___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-HRV______-000004___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-HRV______-000024___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-HRV______-000005___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-HRV______-000020___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-HRV______-000009___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-HRV______-000003___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-HRV______-000001___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-HRV______-000002___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-HRV______-000014___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-HRV______-000013___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-HRV______-000021___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-HRV______-000023___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-HRV______-000005___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-HRV______-000010___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-HRV______-000017___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-HRV______-000006___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-HRV______-000019___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-HRV______-000016___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-HRV______-000011___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-HRV______-000003___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-HRV______-000015___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-HRV______-000013___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-HRV______-000012___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-HRV______-000017___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-HRV______-000021___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-HRV______-000007___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-HRV______-000004___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-HRV______-000008___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-HRV______-000016___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-HRV______-000024___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-HRV______-000022___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-HRV______-000020___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-HRV______-000023___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-HRV______-000015___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-HRV______-000022___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-HRV______-000002___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-HRV______-000009___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-HRV______-000001___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-HRV______-000008___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-HRV______-000018___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_016___-000008___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_016___-000007___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_016___-000008___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_016___-000002___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_016___-000005___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_016___-000004___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_016___-000001___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_016___-000003___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_016___-000004___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_016___-000003___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_016___-000006___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_016___-000007___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_016___-000002___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_016___-000005___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_016___-000006___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_016___-000001___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_039___-000002___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_039___-000007___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_039___-000003___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_039___-000006___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_039___-000005___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_039___-000001___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_039___-000003___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_039___-000008___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_039___-000002___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_039___-000007___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_039___-000006___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_039___-000008___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_039___-000005___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_039___-000004___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_039___-000001___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_087___-000001___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_087___-000002___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_087___-000005___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_087___-000006___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_087___-000008___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_087___-000006___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_087___-000007___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_087___-000001___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_087___-000004___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_087___-000008___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_087___-000003___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_087___-000002___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_087___-000004___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_087___-000007___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_087___-000003___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_087___-000005___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_097___-000001___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_097___-000003___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_097___-000008___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_097___-000001___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_097___-000004___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_097___-000002___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_097___-000007___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_097___-000007___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_097___-000005___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_097___-000003___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_097___-000002___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_097___-000004___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_097___-000006___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_097___-000008___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_097___-000006___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_097___-000005___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_108___-000001___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_108___-000007___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_108___-000007___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_108___-000006___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_108___-000005___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_108___-000004___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_108___-000003___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_108___-000001___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_108___-000002___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_108___-000005___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_108___-000002___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_108___-000008___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_108___-000004___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_108___-000006___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_108___-000003___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_108___-000008___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_120___-000003___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_120___-000005___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_120___-000008___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_120___-000008___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_120___-000004___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_120___-000005___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_120___-000001___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_120___-000007___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_120___-000006___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_120___-000001___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_120___-000002___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_120___-000002___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_120___-000006___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_120___-000003___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_120___-000007___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_120___-000004___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_134___-000004___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_134___-000005___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_134___-000007___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_134___-000001___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_134___-000003___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_134___-000006___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_134___-000003___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_134___-000004___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_134___-000007___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_134___-000008___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_134___-000006___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_134___-000002___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_134___-000008___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_134___-000001___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_134___-000002___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-IR_134___-000005___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-VIS006___-000008___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-VIS006___-000006___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-VIS006___-000008___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-VIS006___-000005___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-VIS006___-000002___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-VIS006___-000007___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-VIS006___-000003___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-VIS006___-000004___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-VIS006___-000004___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-VIS006___-000005___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-VIS006___-000006___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-VIS006___-000003___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-VIS006___-000001___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-VIS006___-000007___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-VIS006___-000001___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-VIS006___-000002___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-VIS008___-000003___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-VIS008___-000002___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-VIS008___-000006___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-VIS008___-000004___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-VIS008___-000007___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-VIS008___-000005___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-VIS008___-000005___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-VIS008___-000002___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-VIS008___-000008___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-VIS008___-000001___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-VIS008___-000004___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-VIS008___-000001___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-VIS008___-000006___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-VIS008___-000007___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-VIS008___-000008___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-VIS008___-000003___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-WV_062___-000002___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-WV_062___-000001___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-WV_062___-000003___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-WV_062___-000005___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-WV_062___-000006___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-WV_062___-000003___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-WV_062___-000005___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-WV_062___-000002___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-WV_062___-000007___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-WV_062___-000008___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-WV_062___-000001___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-WV_062___-000004___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-WV_062___-000008___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-WV_062___-000007___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-WV_073___-000006___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-WV_073___-000002___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-WV_073___-000008___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-WV_073___-000008___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-WV_073___-000003___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-WV_073___-000001___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-WV_073___-000002___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-WV_073___-000004___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-WV_073___-000005___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-WV_073___-000001___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-WV_073___-000007___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-WV_073___-000006___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-WV_073___-000007___-202009060000-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-WV_073___-000003___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-WV_073___-000004___-202009060015-__',
  '/gws/nopw/j04/swift/earajr/HRIT_archive/2020/20200906/00/H-000-MSG4__-MSG4________-WV_073___-000005___-202009060015-__']}

@djhoese
Copy link
Member

djhoese commented Jan 29, 2021

I'm not an MSG expert (far from it), but it looks like you have two separate images in this directory, right? One for 202009060000 and one for 202009060015? If this is the case, Satpy can only really handle one time step at a time. Two images also makes sense with the error message (one number is twice as much as the other). If you pass the files for a single time, does it work?

@pnuu
Copy link
Member

pnuu commented Jan 29, 2021

I was just writing that you might end up with two time slots worth of data with find_files_and_readers() on one Scene. That typically won't work. My usual approach is not to use it at all, but do this:

import glob
fnames = glob.glob("/path/to/data/decompressed/2020/20200906/00/H*202009060000*__")
scn = Scene(reader="seviri_l1b_hrit", filenames=fnames)

@Benblob688
Copy link
Author

djhoese — changing the second datetime to 0 min, 1 min, or 14 min (instead of 15 min) produces a DivZero error, but you are on the right track about the duplicate file finding. The archive I use has hourly directories and so 4 timestamps in one dir.

pnuu — that works! I now have a ginormous view of the Earth and it's beautiful! I think the example script given by satpy at https://nbviewer.jupyter.org/github/pytroll/pytroll-examples/blob/master/satpy/hrit_msg_tutorial.ipynb should be modified for your method. Is there a benefit to specifying a datetime start and end instead as the example currently shows? It seems that a lot of the skunkworks is hidden behind the scenes, pardon the pun. Makes it difficult to identify errors for a new user.

Along with the nice image I do have more errors, which I believe is a different issue relating to dask. Note that the first set of errors as in the OP, relating to crs are still present. Any ideas? Considering I used a standard conda install on Py3.8 and I am using example code from satpy, I hoped it would be smoother to get started

/home/users/bpickering/anaconda3/envs/ML/lib/python3.8/site-packages/pyproj/crs/crs.py:543: UserWarning: You will likely lose important projection information when converting to a PROJ string from another format. See: https://proj.org/faq.html#what-is-the-best-format-for-describing-coordinate-reference-systems
  proj_string = self.to_proj4()
/home/users/bpickering/anaconda3/envs/ML/lib/python3.8/site-packages/pyproj/crs/crs.py:543: UserWarning: You will likely lose important projection information when converting to a PROJ string from another format. See: https://proj.org/faq.html#what-is-the-best-format-for-describing-coordinate-reference-systems
  proj_string = self.to_proj4()
/home/users/bpickering/anaconda3/envs/ML/lib/python3.8/site-packages/pyproj/crs/crs.py:543: UserWarning: You will likely lose important projection information when converting to a PROJ string from another format. See: https://proj.org/faq.html#what-is-the-best-format-for-describing-coordinate-reference-systems
  proj_string = self.to_proj4()
/home/users/bpickering/anaconda3/envs/ML/lib/python3.8/site-packages/pyproj/crs/crs.py:543: UserWarning: You will likely lose important projection information when converting to a PROJ string from another format. See: https://proj.org/faq.html#what-is-the-best-format-for-describing-coordinate-reference-systems
  proj_string = self.to_proj4()
/home/users/bpickering/anaconda3/envs/ML/lib/python3.8/site-packages/pyproj/crs/crs.py:543: UserWarning: You will likely lose important projection information when converting to a PROJ string from another format. See: https://proj.org/faq.html#what-is-the-best-format-for-describing-coordinate-reference-systems
  proj_string = self.to_proj4()
/home/users/bpickering/anaconda3/envs/ML/lib/python3.8/site-packages/pyproj/crs/crs.py:543: UserWarning: You will likely lose important projection information when converting to a PROJ string from another format. See: https://proj.org/faq.html#what-is-the-best-format-for-describing-coordinate-reference-systems
  proj_string = self.to_proj4()
/home/users/bpickering/anaconda3/envs/ML/lib/python3.8/site-packages/pyproj/crs/crs.py:543: UserWarning: You will likely lose important projection information when converting to a PROJ string from another format. See: https://proj.org/faq.html#what-is-the-best-format-for-describing-coordinate-reference-systems
  proj_string = self.to_proj4()
/home/users/bpickering/anaconda3/envs/ML/lib/python3.8/site-packages/pyproj/crs/crs.py:543: UserWarning: You will likely lose important projection information when converting to a PROJ string from another format. See: https://proj.org/faq.html#what-is-the-best-format-for-describing-coordinate-reference-systems
  proj_string = self.to_proj4()
/home/users/bpickering/anaconda3/envs/ML/lib/python3.8/site-packages/pyproj/crs/crs.py:543: UserWarning: You will likely lose important projection information when converting to a PROJ string from another format. See: https://proj.org/faq.html#what-is-the-best-format-for-describing-coordinate-reference-systems
  proj_string = self.to_proj4()
/home/users/bpickering/anaconda3/envs/ML/lib/python3.8/site-packages/pyproj/crs/crs.py:543: UserWarning: You will likely lose important projection information when converting to a PROJ string from another format. See: https://proj.org/faq.html#what-is-the-best-format-for-describing-coordinate-reference-systems
  proj_string = self.to_proj4()
/home/users/bpickering/anaconda3/envs/ML/lib/python3.8/site-packages/pyproj/crs/crs.py:543: UserWarning: You will likely lose important projection information when converting to a PROJ string from another format. See: https://proj.org/faq.html#what-is-the-best-format-for-describing-coordinate-reference-systems
  proj_string = self.to_proj4()
/home/users/bpickering/anaconda3/envs/ML/lib/python3.8/site-packages/pyproj/crs/crs.py:543: UserWarning: You will likely lose important projection information when converting to a PROJ string from another format. See: https://proj.org/faq.html#what-is-the-best-format-for-describing-coordinate-reference-systems
  proj_string = self.to_proj4()
/home/users/bpickering/anaconda3/envs/ML/lib/python3.8/site-packages/pyproj/crs/crs.py:543: UserWarning: You will likely lose important projection information when converting to a PROJ string from another format. See: https://proj.org/faq.html#what-is-the-best-format-for-describing-coordinate-reference-systems
  proj_string = self.to_proj4()
/home/users/bpickering/anaconda3/envs/ML/lib/python3.8/site-packages/pyproj/crs/crs.py:543: UserWarning: You will likely lose important projection information when converting to a PROJ string from another format. See: https://proj.org/faq.html#what-is-the-best-format-for-describing-coordinate-reference-systems
  proj_string = self.to_proj4()
/home/users/bpickering/anaconda3/envs/ML/lib/python3.8/site-packages/pyproj/crs/crs.py:543: UserWarning: You will likely lose important projection information when converting to a PROJ string from another format. See: https://proj.org/faq.html#what-is-the-best-format-for-describing-coordinate-reference-systems
  proj_string = self.to_proj4()
/home/users/bpickering/anaconda3/envs/ML/lib/python3.8/site-packages/pyproj/crs/crs.py:543: UserWarning: You will likely lose important projection information when converting to a PROJ string from another format. See: https://proj.org/faq.html#what-is-the-best-format-for-describing-coordinate-reference-systems
  proj_string = self.to_proj4()
/home/users/bpickering/anaconda3/envs/ML/lib/python3.8/site-packages/pyproj/crs/crs.py:543: UserWarning: You will likely lose important projection information when converting to a PROJ string from another format. See: https://proj.org/faq.html#what-is-the-best-format-for-describing-coordinate-reference-systems
  proj_string = self.to_proj4()
/home/users/bpickering/anaconda3/envs/ML/lib/python3.8/site-packages/pyproj/crs/crs.py:543: UserWarning: You will likely lose important projection information when converting to a PROJ string from another format. See: https://proj.org/faq.html#what-is-the-best-format-for-describing-coordinate-reference-systems
  proj_string = self.to_proj4()
/home/users/bpickering/anaconda3/envs/ML/lib/python3.8/site-packages/pyproj/crs/crs.py:543: UserWarning: You will likely lose important projection information when converting to a PROJ string from another format. See: https://proj.org/faq.html#what-is-the-best-format-for-describing-coordinate-reference-systems
  proj_string = self.to_proj4()
/home/users/bpickering/anaconda3/envs/ML/lib/python3.8/site-packages/pyproj/crs/crs.py:543: UserWarning: You will likely lose important projection information when converting to a PROJ string from another format. See: https://proj.org/faq.html#what-is-the-best-format-for-describing-coordinate-reference-systems
  proj_string = self.to_proj4()
/home/users/bpickering/anaconda3/envs/ML/lib/python3.8/site-packages/pyproj/crs/crs.py:543: UserWarning: You will likely lose important projection information when converting to a PROJ string from another format. See: https://proj.org/faq.html#what-is-the-best-format-for-describing-coordinate-reference-systems
  proj_string = self.to_proj4()
/home/users/bpickering/anaconda3/envs/ML/lib/python3.8/site-packages/pyproj/crs/crs.py:543: UserWarning: You will likely lose important projection information when converting to a PROJ string from another format. See: https://proj.org/faq.html#what-is-the-best-format-for-describing-coordinate-reference-systems
  proj_string = self.to_proj4()
/home/users/bpickering/anaconda3/envs/ML/lib/python3.8/site-packages/pyproj/crs/crs.py:543: UserWarning: You will likely lose important projection information when converting to a PROJ string from another format. See: https://proj.org/faq.html#what-is-the-best-format-for-describing-coordinate-reference-systems
  proj_string = self.to_proj4()
/home/users/bpickering/anaconda3/envs/ML/lib/python3.8/site-packages/pyproj/crs/crs.py:543: UserWarning: You will likely lose important projection information when converting to a PROJ string from another format. See: https://proj.org/faq.html#what-is-the-best-format-for-describing-coordinate-reference-systems
  proj_string = self.to_proj4()
/home/users/bpickering/anaconda3/envs/ML/lib/python3.8/site-packages/dask/core.py:121: RuntimeWarning: invalid value encountered in cos
  return func(*(_execute_task(a, cache) for a in args))
/home/users/bpickering/anaconda3/envs/ML/lib/python3.8/site-packages/dask/core.py:121: RuntimeWarning: invalid value encountered in sin
  return func(*(_execute_task(a, cache) for a in args))
/home/users/bpickering/anaconda3/envs/ML/lib/python3.8/site-packages/dask/core.py:121: RuntimeWarning: invalid value encountered in greater_equal
  return func(*(_execute_task(a, cache) for a in args))
/home/users/bpickering/anaconda3/envs/ML/lib/python3.8/site-packages/dask/core.py:121: RuntimeWarning: invalid value encountered in greater
  return func(*(_execute_task(a, cache) for a in args))
/home/users/bpickering/anaconda3/envs/ML/lib/python3.8/site-packages/dask/core.py:121: RuntimeWarning: invalid value encountered in log
  return func(*(_execute_task(a, cache) for a in args))

@djhoese
Copy link
Member

djhoese commented Jan 29, 2021

I'll let @pnuu answer the start/end time question.

Regarding hidden stuff: It is mostly that Satpy's Scene doesn't have any logic right now for detecting how many scenes/time steps you've given it so the error messages produced are always a little cryptic.

Regarding the warnings: The pyproj ones are mostly an issue from newer versions of pyproj deprecating the use of "PROJ Strings". We are slowly updating parts of pyresample to not use PROJ strings but it is slow as they are used everywhere.

The last warning about invalid values are expected as numpy/dask will report these anytime a NaN is used. Satpy uses NaNs for invalid pixels including space pixels (like you'll see in a full disk image).

@Benblob688
Copy link
Author

Benblob688 commented Jan 29, 2021

Since the warnings are so huge, can they be suppressed to improve readability with code similar to warnings.filterwarnings("ignore") or will that also smush other important warnings that may crop up, and there is a more precise way to do it just for these expected dask and crs warnings?

The information you described above would be great to add to a markdown box in the example MSG .ipynb in the interim just to reassure & inform new users that the example code is behaving as expected.

@djhoese
Copy link
Member

djhoese commented Jan 29, 2021

It is more likely to happen if you make an issue on the pytroll-examples github repository 😉

@Benblob688
Copy link
Author

Ha! I am new to Git but I've found the notebook and will attempt to "commit" my "proposed" changes... 😁

Benblob688 pushed a commit to Benblob688/pytroll-examples that referenced this issue Jan 29, 2021
Based on the thread at pytroll/satpy#1517, this is a better example to avoid importing two timesteps onto a scene, and adds clarification about the warnings which are expected but would throw off a new user.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

3 participants