Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support for bufr edition 2? #30

Open
jfigui opened this issue May 28, 2021 · 6 comments
Open

Support for bufr edition 2? #30

jfigui opened this issue May 28, 2021 · 6 comments

Comments

@jfigui
Copy link

jfigui commented May 28, 2021

Dear pytroll members,

I wanted to test your trollbufr code with some radar QPE composites from MeteoFrance but I encountered the following issue:
(pyrad) [figuerasiventuraj@sotrtm31-sidev ~]$ trollbufr3 -d -vv /utemp/mdso/figuerasiventuraj/QPE_composite/2020/10/02/202010022355
[DEBUG: bufr_main:351] Namespace(array=False, bulletin=None, desc=False, in_file=['/utemp/mdso/figuerasiventuraj/QPE_composite/2020/10/02/202010022355'], json_dump=False, json_encode=False, out_file=None, reader=True, sparse=False, tables_path='/usr/local/sopra/etc/bufrtables/', tables_type='eccodes', verbose=2)
FILE 202010022355
[INFO: load_file:54] FILE /utemp/mdso/figuerasiventuraj/QPE_composite/2020/10/02/202010022355
[DEBUG: load_file:77] SEARCH AHL : 0 - 0 b'BUFR' : 0 matches > 0
[DEBUG: load_file:97] LOADED 7668358 B, 0 - 7668358
BUFR #0 (7668358 B)
HEADER None
[INFO: bufr:309] SECT 0..5 DECODE
[DEBUG: bufr:316] SECT_0 offs:8 len:8 = {'size': 7668358, 'edition': 2}
ERROR BufrDecodeError: BUFR edition 2 not supported
[ERROR: bufr_main:148] BufrDecodeError: BUFR edition 2 not supported
Traceback (most recent call last):
File "/home/mdso/figuerasiventuraj/anaconda3/envs/pyrad/lib/python3.7/site-packages/trollbufr/bufr_main.py", line 69, in read_bufr_data
bufr.decode_meta(blob, load_tables=False)
File "/home/mdso/figuerasiventuraj/anaconda3/envs/pyrad/lib/python3.7/site-packages/trollbufr/bufr.py", line 318, in decode_meta
raise BufrDecodeError("BUFR edition %d not supported" % self.edition)
trollbufr.coder.errors.BufrDecodeError: BufrDecodeError: BUFR edition 2 not supported

Do you have a fix for that? I am just interested in reading the data in those files with Python, I do not strictly need to read the metadata. Any help would be very much welcome.

Kind regards,

Jordi

@alexmaul
Copy link
Collaborator

Hello Jordi,
trollbufr only supports BUFR 3+4 (yet), since they are in circulation on the GTS.
There is no simple fix to support BUFR 2. I'll have to read up the manuals before I can say if/when there's such support.
Alex

@jfigui
Copy link
Author

jfigui commented May 28, 2021

Hi Alex,

Thanks for your fast reply. I hope you can find the time and the will to do it. It would be a very nice addition to trollbufr because many radar files circulating in Europe are still written in BUFR 2. If I can be of some help let me know but I warn you that I have no idea how bufr works :)

@alexmaul
Copy link
Collaborator

Hi Jordi,
some other project took all my time :(
Now, I've got some BUFR2 radar data I can test with. The differences between BUFR2 and BUFR3 should be in the metadata section "1", so decoding the data sections should be ok.

@jfigui
Copy link
Author

jfigui commented Aug 30, 2021

Hi Alex,

Thanks a lot for taking the time to have a look at it. In such case, could it be possible at least for now to modify the code so that it throws a warning instead of an exception and continues to decode the data?
That would be a quick fix and we can see what to do with the metadata later on.

@jfigui
Copy link
Author

jfigui commented Sep 2, 2021

Hi @alexmaul ,

Can you let me know whether you are working on it and how long do you think it will take to find a solution?

No pressure but it would be good to know whether I would be able to use the package in a reasonable time or I have to work on another solution in the meanwhile.

If you need my help just let me know.

@alexmaul
Copy link
Collaborator

I'm back on it ... but havn't found documentation for the change between Ed.2 and Ed.3.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants