Decoder updates, Landing Notifications, Live KML, RS41 Pressure support, Ending of Python 2 support.

This release brings the following changes:

• Starting to deprecate support for Python 2. See notes below!
• Add dynamic KML link to web interface, allowing display of data via Google Earth. (Thanks drid!)
• Addition of pressure decoding for RS41-SGP sondes. (Thanks rs1729!)
• Improvements in RS41 humidity calculations (Accurate to ~+/- 2.5% Thanks rs1729!)
• Switch to using timestamps as unique frame IDs for DFM sondes, instead of the 1-byte frame ID used currently. This resolves some issues observed on the Sondehub map.
• Fix bug where the Habitat uploader would upload very old telemetry data if the station's internet connection temporarily failed.
• Fix issue in Meisei IMS100 callsign checking.
• Improve handling of telemetry arriving via a UDP socket.
• Add e-mail notification of failed RTLSDRs.
• Add e-mail notification of nearby landing sondes.
• Add geo links to lat/lon entries in the telemetry table.
• Added an option to set the APRS-IS server port in the config file. The default has been set to 14590, which for radiosondy.info means that packets will not be forwarded out to the wider APRS-IS network. Licensed amateur radio operators can set this back to 14580 so their packets are forwarded.
• Added ability to emit radiosonde humidity and pressure data in APRS comment fields. The new suggested default aprs_custom_comment value is now: aprs_custom_comment = Clb=<vel_v> t=<temp> h=<humidity> p=<pressure> <freq> Type=<type> Radiosonde
• Add additional config file checks before allowing custom APRS callsigns.
• Add minimum limits to APRS and Habitat upload rates - please be considerate of other users of these services and not upload at high rates!

IMPORTANT UPDATE NOTES:

• It's now time for all stations to upgrade to Python 3. If your station is running on Python 2, please either do a fresh install (ideally with the latest version of Raspbian), or follow the Python 2 -> 3 upgrade guide here: https://github.com/projecthorus/radiosonde_auto_rx/wiki/Performing-Updates#upgrading-a-station-from-python-2-to-python-3
• The KML link adds a new python dependency ('simplekml'). This can be installed by running: sudo pip3 install -r requirements.txt.
• If you really don't want to do the upgrade to Python 3 just yet, you can probably get away with just installing the simplekml dependency by running: sudo pip install simplekml (But remember that Python 2 support will be completely phased out in the near future)
• Due to the changes in the DFM decoder (the frame ID change), we will be blocking uploads of DFM telemetry to Sondehub from any stations running an auto_rx version older than 1.3.3 effective immediately. If you are in an area with DFM sondes, please update promptly, and ensure you re-build the decoders (e.g. run ./build.sh)
• The recommended aprs_custom_comment value is now: Clb=<vel_v> t=<temp> h=<humidity> p=<pressure> <freq> Type=<type> Radiosonde to best make use of humidity and pressure decoding improvements.
• If you want your APRS-IS packets forwarded out to the wider APRS-IS network (outside of radiosondy.info), then you will need to add in the aprs_port config file option, and set it to 14580. Refer here: https://github.com/projecthorus/radiosonde_auto_rx/wiki/Configuration-File-Changelog#version-133

Please report any problems encountered either on the mailing list, or by raising an issue on this repository.

PLEASE DO NOT USE THE GITHUB GENERATED RELEASE ZIP FILES - USE THE INSTALLATION/UPDATE STEPS DESCRIBED IN THE WIKI

Demod Improvements, Distance Filtering

This release brings the following changes:

• Move to soft-decision-based demodulation for most sonde decoders. This gives a few dB additional demodulation performance for DFM, M10, LMS6 and RS92 decoders. RS41 decoding performance is essentially unchanged.
• Fix issues with RS41 battery voltage decoding in some rare situations.
• Change CSV log file to include all possible fields, making it a bit more consistent.
• Update scripts that process log files to handle these changes.
• Drop SDRs which repeatedly fail from the global SDR list. If all SDRs have failed auto_rx will exit (and promptly be restarted by systemd, if your system is set up that way).
• SDRs are now used in alphanumerical order, with the lowest in the list used first.
• Add initial Meteomodem M20 decode capability. This will only upload to Habhub, until a common APRS callsign format has been agreed upon by other radiosonde decoding software developers.

A new feature which may be of interest to some is the addition of distance-based temporary blocking. This allows you to optimise your station to track only sondes within a certain radius range.
This feature adds a few optional parameters to the bottom of the configuration file. Their use is described here:
https://github.com/projecthorus/radiosonde_auto_rx/wiki/Configuration-File-Changelog#version-132

Remember to run ./build.sh within the auto_rx directory to re-compile the decoders after updating or decoding will not work!

Please report any problems encountered either on the mailing list, or by raising an issue on this repository.

PLEASE DO NOT USE THE GITHUB GENERATED RELEASE ZIP FILES - USE THE INSTALLATION/UPDATE STEPS DESCRIBED IN THE WIKI

Disable Habitat Payload Document creation, other updates

This update stops the auto_rx software from creating new payload documents for each newly discovered radiosonde. I have recently made changes to the Habitat database to use a common payload document for all radiosonde telemetry (callsigns beginning with RS_), which has helped significantly reduce the load on the database. Historical radiosonde data is still accessible, at: http://habitat.sondehub.org/history/RS_ (please contact me if you are using this API regularly)

This update also makes the following changes:

• Fix typo in station.cfg.example (station_beacon_comment) - Thanks Tory!
• Add additional fields to the web interface telemetry table.
• Added horizontal/vertical velocity (m/s) and bearing fields to the log file output.
• The following updates courtesy of @vg1320:
  • Addition of battery voltage output to the DFM and M10 decoders.
  • Additional PTU output to the M10 decoder.

Remember to run ./build.sh within the auto_rx directory to re-compile the decoders after updating!

Please report any problems encountered either on the mailing list, or by raising an issue on this repository.

PLEASE DO NOT USE THE GITHUB GENERATED RELEASE ZIP FILES - USE THE INSTALLATION/UPDATE STEPS DESCRIBED IN THE WIKI

DFM Callsign Changes

This update changes the behaviour of Graw DFM radiosonde sub-type handling. Previously, both Habitat and APRS callsigns included an identification of the DFM sub-type (DFM06, DFM09, DFM17, etc...).
Unfortunately, there has been some issues regarding identification of the newer DFM sonde types (in particular the DFM17), with Graw themselves indicating that the current method of type identification is not necessarily reliable. This resulted in duplicates of the same sondes cluttering APRS.

After discussions with other radiosonde decoder developers, we have agreed to move away from using the interpreted DFM sub-types in any generated callsigns. Instead, only the serial number will be used, prefixed with 'D' - e.g. D19123456 for APRS, and RS_DFM-19123456 for Habitat.
The comment fields in both APRS and Habitat packets will still include the identified DFM sub-type.

This update will result in duplicate sondes appearing on Habitat and APRS as users upgrade. While we cannot do much about the APRS situation, we will be blocking DFM telemetry uploads to Habitat for auto_rx versions older than v1.3.0 effective immediately. Other radiosonde model uploads will not be affected.

Please report any problems encountered either on the mailing list, or by raising an issue on this repository.

PLEASE DO NOT USE THE GITHUB GENERATED RELEASE ZIP FILES - USE THE INSTALLATION/UPDATE STEPS DESCRIBED IN THE WIKI

Fix handling of DFMxB sondes, and handling of encrypted RS41s

Patch release to:

• Allow DFM sondes with a 0xB ID code (most likely DFM-17 sondes) to be processed.
• Fix issues with encrypted RS41 sondes not being blocked correctly due to the new automatic frequency correction features.

Important Note
In the next release (v1.3.0), the way Graw DFM sondes are handled will change. Graw have stated that the method that the radiosonde-decoding community currently uses to determine radiosonde types is not valid, particularly for the new DFM-17 radiosondes.
As such, I will be moving away from including the identified DFM sonde type in the generated callsign (for both Habhub and APRS), and only include it in the comment field.

On Habhub, DFM callsigns will change from DFM09- to DFM-. The format of DFM callsigns used on APRS is still to be agreed upon with developers of other radiosonde decoding software, to ensure we are consistent.

As this change is going to result in many duplicate sondes appearing on various maps as users upgrade, we will be immediately blocking all DFM sonde uploads to Habhub from versions older than v1.3.0 as soon as this version is released. Unfortunately it is not possible to do the same for APRS, so there is likely to be a large amount of duplicate sondes on radiosondy.info and similar sites for a while.

Please report any problems encountered either on the mailing list, or by raising an issue on this repository.

PLEASE DO NOT USE THE GITHUB GENERATED RELEASE ZIP FILES - USE THE INSTALLATION/UPDATE STEPS DESCRIBED IN THE WIKI

Fixes for unencrypted RS41-SGMs, iMet ID generation.

Patch release to fix:

• An issue with handling of unencrypted RS41-SGM telemetry, where no telemetry would be uploaded to APRS or Habitat
• Generation of iMet callsigns should now be consistent across multiple stations.
• The frequency field in APRS packets will now be the 'actual' frequency of the sonde, not the receiver tuned frequency

Meisei iMS-100 Support, Updated Decoders, SNR display

• Add support for Meisei iMS-100 Radiosondes.
• Add support for the yet-unnamed new Lockheed Martin radiosonde (LMS-X for now).
• Rebased all decoders to latest from @rs1729 's repo.
• Detection stage now uses IQ input, and provides an estimate of frequency offset which is used to adjust the starting frequency of the decoder step.
• Fix APRS high-precision coordinate calculation. (Resolves #207 )
• Fix scroll wheel unintentionally zooming the map on the web interface (Resolves #209 )
• Fix a few Python 3 compatibility issues (Thanks @snh!)
• Use fsk_demod decoder chains by default where possible (this is just a change to the defaults in the example configuration file, so you will need to change the type_experimental settings in your own station.cfg file to enable them)
• When using fsk_demod, utilise the statistics output from the modem to:
  • Log estimated SNR values and display them on the web interface. These are also emitted in the payload_summary output as a 'snr' field.
  • Log estimated centre frequency of the sonde signal (based on the modem's estimate of the two FSK tones) and display on the web interface.
  • Resolves #204
• Removed station_code setting in configuration file (used to generate callsigns for iMet sondes, and was causing more trouble than it was worth...)
• Switch to rs1729 M10 decoder, and (hopefully) make M10 APRS callsign compatible with that produced by other decoder software (Resolves #225 )
• Minor changes to work towards continuous integration tests, and enable replacement of rtl_fm and rtl_sdr with other IQ sources.
• Add Dockerfile for easier setup! (Thanks @snh !) - Information on using Docker is available here
• Added auto_rx version to APRS packet comment as a default.

Finally, we will now no longer support auto_rx instances using Python 2.7. While the codebase is currently compatible with both Python 2.7 and Python 3.x, it is likely that future updates will start using Python >=3.7 exclusive features (e.g. asyncio).

Please report any problems encountered either on the mailing list, or by raising an issue on this repository.

PLEASE DO NOT USE THE GITHUB GENERATED RELEASE ZIP FILES - USE THE INSTALLATION/UPDATE STEPS DESCRIBED IN THE WIKI

DFM09 ID Fixes, DFM APRS Callsign Changes

This patch release fixes an issue where some newer DFM09 sondes would not obtain an ID. Thanks to pit711 for letting me know about the issue.

The APRS callsign format for DFM sondes has also been changed to match that used by dxlAPRS. The callsign is now generated from the last 5 hex digits of the sonde's serial number.

If you don't receive Graw DFM radiosondes, there is no need to update to this release.

Please report any problems encountered either on the mailing list, or by raising an issue on this repository.

PLEASE DO NOT USE THE GITHUB GENERATED RELEASE ZIP FILES - USE THE INSTALLATION/UPDATE STEPS DESCRIBED IN THE WIKI

Bugfix release for Habitat Upload Issue

This bug-fix release fixes an issue reported where the Habitat upload thread would break if upload_listener_position was set to False, with habitat_enabled set to True (often the case when auto_rx is used in a chase car). Thanks to Brian OZ1SKY for bringing the issue to my attention.

There is no need to update to this release if you are uploading your listener position.

Please report any problems encountered either on the mailing list, or by raising an issue on this repository.

PLEASE DO NOT USE THE GITHUB GENERATED RELEASE ZIP FILES - USE THE INSTALLATION/UPDATE STEPS DESCRIBED IN THE WIKI

Initial 400 & 1680 MHz Lockheed Martin LMS6 Support

This release adds initial support for both 400 MHz and 1680 MHz Lockheed Martin LMS6 radiosondes. 1680 MHz LMS6 support is still very experimental (awaiting a physical sonde sample to test with), but the 400 MHz support has been tested by a few stations in the US and appears to work well!
Both the 400 MHz and 1680 MHz decode chains have not been optimised, as I don't yet have access to a high-SNR sample to experiment with. Improvements will be made as more data becomes available.

Also added in this release is:

• Support for SSL/TLS email authentication.
• Enable setting station position via GPSD. (Note: This is not intended to be a replacement for ChaseMapper's chase-car position upload feature, but rather to assist when using auto_rx with a rotator in a portable situation)

A summary of the changes to station.cfg for this release are available here: https://github.com/projecthorus/radiosonde_auto_rx/wiki/Configuration-File-Changelog

Please report any problems encountered either on the mailing list, or by raising an issue on this repository.

PLEASE DO NOT USE THE GITHUB GENERATED RELEASE ZIP FILES - USE THE INSTALLATION/UPDATE STEPS DESCRIBED IN THE WIKI