Project Horus - v1.8.1 - RS41 X-Prefix telemetry support, KA9Q-Radio improvements

Important: We recommend all users update to this version to ensure the latest Vaisala RS41 telemetry formats can be received.

This release brings the following major changes:

• RS41: Support for the new 'multi-GNSS' telemetry format that has been observed on very new RS41 models (X-prefix). We highly recommend everyone update to 1.8.1 to ensure these newer RS41s are received correctly. Thanks to @rs1729 for quickly adding support for this new format!
  • This new telemetry format has only been seen on 'X' prefix RS41s (RSM425 PCB, 02.07.01 software version), but note that it is only used if a Vaisala MW51 ground station is used. We may see X-prefix RS41s not using this new telemetry format.
• M20: Updates to decoder to support some rarer serial number formats.
• Scanning & Detection: Detection bandwidth narrowed to 15 kHz to better handle adjacent-channel interference.
• RS41: Narrow frequency estimator bandwidth to +/- 5 kHz, and use a 4800 Hz mask estimator for improved decode performance.
• DFM: Narrow frequency estimator bandwidth to +/- 5 kHz for improved decode performance.
• SDR Handling general: Increase SDR 'test' timeout to 20 seconds, to work around some slowness with spyserver and ka9q-radio testing scripts.
• ka9q-radio: Updates and fixes to ka9q-radio support. Users will need to update to the latest recommended ka9q-radio commit, as described here, otherwise decoding will not work.
• Docker builds: Various fixes and improvements to docker builds (qemu issues, arm64 runners) - Thanks @snh !
• Web Interface: Various tweaks and improvements to the web interface layout - Thanks @ke5gdb and @argilo !

The pre-built Docker Image is now the recommended way to setup radiosonde_auto_rx on a new station. Using Docker avoids issues with updates to dependencies, and allows for fixes relating to system packages to be easily pushed out to users.

Please report any problems encountered either on the mailing list, or by raising an issue on this repository. We also now have a Discord server: https://sondehub.org/go/discord

PLEASE DO NOT USE THE GITHUB GENERATED RELEASE ZIP FILES - USE THE INSTALLATION/UPDATE STEPS DESCRIBED IN THE WIKI

Atmosphere - Atmospheric Composition and Dynamics - C
Published by darksidelemm 2 months ago

Project Horus - v1.8.0 - Full KA9Q-Radio Support!

I'd like to give a big thanks to the contributors that helped out with all the changes in this release! Big shout-outs to @argilo, @ke5gdb, @snh, @bddvlpr, and of course @rs1729 !

The big change this release is the addition of full support for ka9q-radio server! This provides a completely open-source way that stations can decode every sonde in their receive passband at once, with less CPU usage than Spyserver. This has been a long time coming, and I'd really like to thank @ke5gdb, @argilo , and of course Phil Karn, @ka9q for making this possible!
Right now we can support operation with ka9q-radio using Airspy Mini and Airspy R2 SDRs. It's now possible to monitor the entire radiosonde band with an Airspy R2 and a RPi 4, and monitor most of the band (5 MHz of it) with an Airspy Mini.
Support for using RTLSDRs may come in the future, though we really recommend using a wide-band SDR like the Airspy.

Check out the KA9Q-Radio Setup Notes wiki page for more information on this functionality.
Please note that as KA9Q-Radio is still a bit of a 'moving target', we will be continuing to update auto_rx as new updates and features become available.

There are also many other changes and improvements in this release, including:

• Decoders: Rebased all decoders to the latest from rs1729's repository.
• Decoders: Fix to an issue where auto_rx would crash if both ephemeris and almanac data could not be obtained when starting a RS92 decoder.
• Docker images: Updated to Debian bookworm as a base, numerous improvements to build process. (Thanks @snh !)
• 'Payload Summary' UDP output: More telemetry data has been added to these UDP packets.
• 'Payload Summary' UDP output: The target hostname for these packets can now be set, with the default still being broadcast. (Thanks @bddvlpr !)
• Rotator Control: Added azimuth-only rotator control option
• Rotator Control: Some rotator controls now added to the web interface (Thanks @ke5gdb !)
• Web Interface: Many fixes and improvements to the web interface, including fixing the map centring issues, making the frequency scales cleaner, log file loading improvements, and much more! (Thanks @argilo !)
• Web Interface: Removed decimation of scan plot data. Please let me know if you experience any web interface performance issues because of this.
• Web Interface: Improved representation of multiple receiver 'slots', particularly useful when using KA9Q or SpyServer (Thanks @argilo !)

The pre-built Docker Image is now the recommended way to setup radiosonde_auto_rx on a new station. Using Docker avoids issues with updates to dependencies, and allows for fixes relating to system packages to be easily pushed out to users.

Please report any problems encountered either on the mailing list, or by raising an issue on this repository. We also now have a Discord server: https://sondehub.org/go/discord

PLEASE DO NOT USE THE GITHUB GENERATED RELEASE ZIP FILES - USE THE INSTALLATION/UPDATE STEPS DESCRIBED IN THE WIKI

Atmosphere - Atmospheric Composition and Dynamics - C
Published by darksidelemm 4 months ago

Project Horus - v1.7.4 - DFM17 Mis-identification fixes (for real this time!)

This release brings the following updates and changes:

• Actually fix the DFM17/DFM09 mis-identification issue! (Thanks to @rs1729 for the help debugging this, and to WJ2B and KC7RW for sending through samples to test with).
• Fix handling of Graw PS-15 pilot-sondes.

Also please refer to the changes in v1.7.3 here: https://github.com/projecthorus/radiosonde_auto_rx/releases/tag/v1.7.3

Ongoing Known Issues:

• iMet-1 serial number generation still has issues, and will result in iMet-1 sondes being assigned 3-4 different serial numbers throughout the flight. This is due to the iMet-1 telemetry repeating data across multiple frames, and there's no easy fix (Thanks InterMet...). iMet-4 sondes should not be affected.

Note: We are aware that new installations may display the following message on startup:

The WebSocket transport is not available, you must install a WebSocket server that is compatible with your async mode to enable it. See the documentation for details. (further occurrences of this error will be logged with level INFO)

While this does not cause issues and auto_rx will continue to function, this can be resolved by installing the simple-websocket Python package. If you are using Docker, this will be included from the v1.6.2 release. Otherwise, you may need to run:

sudo pip3 install simple-websocket

The pre-built Docker Image is now the recommended way to setup radiosonde_auto_rx on a new station. Using Docker avoids issues with updates to dependencies, and allows for fixes relating to system packages to be easily pushed out to users.

Please report any problems encountered either on the mailing list, or by raising an issue on this repository. We also now have a Discord server: https://sondehub.org/go/discord

PLEASE DO NOT USE THE GITHUB GENERATED RELEASE ZIP FILES - USE THE INSTALLATION/UPDATE STEPS DESCRIBED IN THE WIKI

Atmosphere - Atmospheric Composition and Dynamics - C
Published by darksidelemm 10 months ago

Project Horus - v1.7.3 - Many small updates, DFM fix still to come.

Unfortunately this update doesn't quite fix the DFM mis-identification issue, I missed another place this identification occurs within the auto_rx code. I'll get a new version with a fix released in the next few days - apologies!

This release brings the following updates and changes:

• Build system: Various fixes, including removal of deprecated decoders (Thanks @pinkavaj !)
• Log Files: A log message will now be emitted if a shutdown timeout is set (Thanks @argilo !)
• Log Files: All log and temporary data files (e.g. scan, iq, raw data) should now be written to the log directory.
• Historical Data: Add a 'Generate KML' button, allowing downloading of historical sonde data as KML (Thanks @argilo !)
• Historical Data: Units should display as Imperial correctly (if selected)
• Web Interface: In the control section, add the ability to temporarily lock out a frequency.
• Graw DFM Sondes: Improve identification of newer DFM17 sondes, which were being mis-identified as DFM09s. (Thanks @rs1729 !)
• Meteomodem M20 sondes: Improve handling of M20 sondes with aux data (Thanks @rs1729 !)
• Meteo-Radiy MRZ sondes: Add support for a newer variant of these sondes, using a different GNSS receiver (Thanks @rs1729 !)
• Weathex WxR-301D sondes: Add support for a variant of these sondes which has been observed in Europe. (Thanks @rs1729 !)
• Meisei iMS-100 sondes: Handling of GPS week number rollover issues. (Thanks @rs1729 !)
• Scanning: Improvements to dft_detect to better handle wide-band radiosondes (Thanks @rs1729 !)
• Other: Various changes to support newer Python versions (Thanks @argilo !)

Note that this build also includes some very preliminary support for the ka9q-radio server, however this is still not complete and does not support scanning.
Properly finishing support for ka9q-radio is what has held up this release, but due to the Graw DFM problems I decided it was better to get the latest changes released ASAP.

Other Known Issues:

• iMet-1 serial number generation still has issues, and will result in iMet-1 sondes being assigned 3-4 different serial numbers throughout the flight. This is due to the iMet-1 telemetry repeating data across multiple frames, and there's no easy fix (Thanks InterMet...). iMet-4 sondes should not be affected.

Note: We are aware that new installations may display the following message on startup:

The WebSocket transport is not available, you must install a WebSocket server that is compatible with your async mode to enable it. See the documentation for details. (further occurrences of this error will be logged with level INFO)

While this does not cause issues and auto_rx will continue to function, this can be resolved by installing the simple-websocket Python package. If you are using Docker, this will be included from the v1.6.2 release. Otherwise, you may need to run:

sudo pip3 install simple-websocket

The pre-built Docker Image is now the recommended way to setup radiosonde_auto_rx on a new station. Using Docker avoids issues with updates to dependencies, and allows for fixes relating to system packages to be easily pushed out to users.

Please report any problems encountered either on the mailing list, or by raising an issue on this repository. We also now have a Discord server: https://sondehub.org/go/discord

PLEASE DO NOT USE THE GITHUB GENERATED RELEASE ZIP FILES - USE THE INSTALLATION/UPDATE STEPS DESCRIBED IN THE WIKI

Atmosphere - Atmospheric Composition and Dynamics - C
Published by darksidelemm 11 months ago

Project Horus - v1.7.2 - Meisei iMS100 Decoding Bugfix

A bugfix release to fix incorrect handling of dates for Meisei iMS-100 radiosondes.
If you don't receive these radiosonde there should be no need to update.

Warning: Users running 'native' installs may need to upgrade their version of the flask library and dependencies, otherwise you will see an error along the lines of ModuleNotFoundError: No module named 'werkzeug.middleware'. If you installed python3-flask via your system package manager, you will need to run:

$ sudo apt-get remove python3-flask
$ sudo pip3 install -U flask flask-socketio

Users of the Docker image will not have this issue, as all the appropriate package versions are included in the image.

Other Known Issues:

• iMet-1 serial number generation still has issues, and will result in iMet-1 sondes being assigned 3-4 different serial numbers throughout the flight. This is due to the iMet-1 telemetry repeating data across multiple frames, and there's no easy fix (Thanks InterMet...). iMet-4 sondes should not be affected.

Note: We are aware that new installations may display the following message on startup:

The WebSocket transport is not available, you must install a WebSocket server that is compatible with your async mode to enable it. See the documentation for details. (further occurrences of this error will be logged with level INFO)

While this does not cause issues and auto_rx will continue to function, this can be resolved by installing the simple-websocket Python package. If you are using Docker, this will be included from the v1.6.2 release. Otherwise, you may need to run:

sudo pip3 install simple-websocket

The pre-built Docker Image is now the recommended way to setup radiosonde_auto_rx on a new station. Using Docker avoids issues with updates to dependencies, and allows for fixes relating to system packages to be easily pushed out to users.

Please report any problems encountered either on the mailing list, or by raising an issue on this repository.

PLEASE DO NOT USE THE GITHUB GENERATED RELEASE ZIP FILES - USE THE INSTALLATION/UPDATE STEPS DESCRIBED IN THE WIKI

Atmosphere - Atmospheric Composition and Dynamics - C
Published by darksidelemm over 1 year ago

Project Horus - v1.7.1 - Bugfixes for iMet sondes, Record RS41 mainboard type and cal data

This is mainly a bug-fix release to resolve the iMet decoding issues from v1.7.0, though I have taken the opportunity to add some functionality to log and upload additional information for Vaisala RS41's.

Recently updated PCBs have been spotted in RS41s launched from Vaisala HQ in Helsinki, Finland. These new PCBs seem to have a mainboard version number of RSM424 (compared to RSM412 for the older models), and have a newer STM32 microcontroller and uBlox-10 GPS receiver. auto_rx will now upload the mainboard version information to SondeHub, where it will be visible on the tracker and help identify newer RS41 versions as they are rolled out!

This release brings the following updates:

• RS41 Decoding: Extract the RS41 Mainboard model number and firmware version, and upload these to SondeHub. This will allow us to keep track of the rollout of the new RSM42x 'refreshed' RS41 mainboards. If the mainboard version is not RSM412 (the 'standard' RS41 mainboard), then it will also be shown in the 'other' column on the web interface.
• RS41 Decoding: Upload complete subframe (calibration) data to SondeHub, and optionally save it to disk.
• iMet Decoding: Fix issue where iMets were detected as iMet-1 sondes when wideband_sondes was enabled.
• iMet Decoding: Fix bug where iMet telemetry with XDATA included was not being uploaded to SondeHub.
• Web Interface: If a sonde has XDATA, the type is now displayed as -XDATA instead of -Ozone.
• Log files & general: Log files will now have -XDATA appended to the sonde type instead of -Ozone if XDATA is present.

Configuration File Changes this release:

• Added save_cal_data option, which saves Vaisala RS41 raw calibration data to disk. Refer here for details.

Warning: Users running 'native' installs may need to upgrade their version of the flask library and dependencies, otherwise you will see an error along the lines of ModuleNotFoundError: No module named 'werkzeug.middleware'. If you installed python3-flask via your system package manager, you will need to run:

$ sudo apt-get remove python3-flask
$ sudo pip3 install -U flask flask-socketio

Users of the Docker image will not have this issue, as all the appropriate package versions are included in the image.

Other Known Issues:

• iMet-1 serial number generation still has issues, and will result in iMet-1 sondes being assigned 3-4 different serial numbers throughout the flight. This is due to the iMet-1 telemetry repeating data across multiple frames, and there's no easy fix (Thanks InterMet...). iMet-4 sondes should not be affected.

Note: We are aware that new installations may display the following message on startup:

The WebSocket transport is not available, you must install a WebSocket server that is compatible with your async mode to enable it. See the documentation for details. (further occurrences of this error will be logged with level INFO)

While this does not cause issues and auto_rx will continue to function, this can be resolved by installing the simple-websocket Python package. If you are using Docker, this will be included from the v1.6.2 release. Otherwise, you may need to run:

sudo pip3 install simple-websocket

The pre-built Docker Image is now the recommended way to setup radiosonde_auto_rx on a new station. Using Docker avoids issues with updates to dependencies, and allows for fixes relating to system packages to be easily pushed out to users.

Please report any problems encountered either on the mailing list, or by raising an issue on this repository.

PLEASE DO NOT USE THE GITHUB GENERATED RELEASE ZIP FILES - USE THE INSTALLATION/UPDATE STEPS DESCRIBED IN THE WIKI

Atmosphere - Atmospheric Composition and Dynamics - C
Published by darksidelemm over 1 year ago

Project Horus - v1.7.0 - Weathex WxR-301D support, Some Wideband iMet support, other fixes

This release brings the following updates:

• Weathex WxR-301D decoding & detection support. Thanks to @rs1729 for writing the decoder, and the Malaysian sonde hunters for sending me a sample radiosonde to test with! Reception of these sondes has a few important caveats, please refer here for more information.
• Support for a generic 'wideband' detection mode, which may improve detection and decoding of wideband iMet-1/4 radiosondes. Please take note of the caveats when using this mode, mentioned here.
• Better handling of missing rtl-sdr utilities (an error message will now be emitted)
• auto_rx should now shut down cleanly in the case of an SDR failure, allowing a restart by docker or systemd.
• Fix rotator pointing threshold calculations when near 0 degrees azimuth.
• Move detection and decode IQ recordings to the log directory, to enable them to be more easily accessed if running auto_rx in a docker container.
• Fixes to Skew-T calculations in the web interface.

Configuration File Changes this release:

• Added wideband_sondes setting. Refer here.

Warning: Users running 'native' installs may need to upgrade their version of the flask library and dependencies, otherwise you will see an error along the lines of ModuleNotFoundError: No module named 'werkzeug.middleware'. If you installed python3-flask via your system package manager, you will need to run:

$ sudo apt-get remove python3-flask
$ sudo pip3 install -U flask flask-socketio

Users of the Docker image will not have this issue, as all the appropriate package versions are included in the image.

Other Known Issues:

• iMet-1 serial number generation still has issues, and will result in iMet-1 sondes being assigned 3-4 different serial numbers throughout the flight. This is due to the iMet-1 telemetry repeating data across multiple frames, and there's no easy fix (Thanks InterMet...). iMet-4 sondes should not be affected.

Note: We are aware that new installations may display the following message on startup:

The WebSocket transport is not available, you must install a WebSocket server that is compatible with your async mode to enable it. See the documentation for details. (further occurrences of this error will be logged with level INFO)

While this does not cause issues and auto_rx will continue to function, this can be resolved by installing the simple-websocket Python package. If you are using Docker, this will be included from the v1.6.2 release. Otherwise, you may need to run:

sudo pip3 install simple-websocket

The pre-built Docker Image is now the recommended way to setup radiosonde_auto_rx on a new station. Using Docker avoids issues with updates to dependencies, and allows for fixes relating to system packages to be easily pushed out to users.

Please report any problems encountered either on the mailing list, or by raising an issue on this repository.

PLEASE DO NOT USE THE GITHUB GENERATED RELEASE ZIP FILES - USE THE INSTALLATION/UPDATE STEPS DESCRIBED IN THE WIKI

Atmosphere - Atmospheric Composition and Dynamics - C
Published by darksidelemm over 1 year ago

Project Horus - v1.6.2 - Scan Loop Fixes, Encrypted Sonde Notifications, Other Tweaks

This release brings the following updates:

• Scan Loop: Break out of scan loop faster when a sonde is detected. (Thanks @pasky!)
• Email: Landing notifications are now only sent if the radiosonde has risen above the landing_altitude_threshold setting during its flight, avoiding spurious notifications for sondes detected prior to launch.
• Email: Add option to send email when an encrypted RS41-SGM is detected. (Refer here)
• APRS: Added localhost and wettersonde.net to the allowed APRS-IS servers.
• Web Interface: Changes to make the web interface work via a reverse proxy. (Thanks @drid !) Note that this will require a recent version of flask to be installed. See below.
• KML Output: Fixes to ascent rate display. (Thanks @argilo!)
• Docker: Added simple-websocket to the Python dependency list, providing 'real' websockets!

Warning: Users running 'native' installs may need to upgrade their version of the flask library and dependencies, otherwise you will see an error along the lines of ModuleNotFoundError: No module named 'werkzeug.middleware'. If you installed python3-flask via your system package manager, you will need to run:

$ sudo apt-get remove python3-flask
$ sudo pip3 install -U flask flask-socketio

Users of the Docker image will not have this issue, as all the appropriate package versions are included in the image.

Other Known Issues:

• iMet-1 serial number generation still has issues, and will result in iMet-1 sondes being assigned 3-4 different serial numbers throughout the flight. This is due to the iMet-1 telemetry repeating data across multiple frames, and there's no easy fix (Thanks InterMet...). iMet-4 sondes should not be affected.

Configuration File Changes this release:

• Added encrypted_sonde_notifications setting. Refer here.

Note: We are aware that new installations may display the following message on startup:

The WebSocket transport is not available, you must install a WebSocket server that is compatible with your async mode to enable it. See the documentation for details. (further occurrences of this error will be logged with level INFO)

While this does not cause issues and auto_rx will continue to function, this can be resolved by installing the simple-websocket Python package. If you are using Docker, this will be included from the v1.6.2 release. Otherwise, you may need to run:

sudo pip3 install simple-websocket

The pre-built Docker Image is now the recommended way to setup radiosonde_auto_rx on a new station. Using Docker avoids issues with updates to dependencies, and allows for fixes relating to system packages to be easily pushed out to users.

Please report any problems encountered either on the mailing list, or by raising an issue on this repository.

PLEASE DO NOT USE THE GITHUB GENERATED RELEASE ZIP FILES - USE THE INSTALLATION/UPDATE STEPS DESCRIBED IN THE WIKI

Atmosphere - Atmospheric Composition and Dynamics - C
Published by darksidelemm over 1 year ago

Project Horus - v1.6.1 - iMet-50/54 & M10 decoder fixes, Web Interface Updates

This release brings the following updates:

• Decoders: Fix a bug in the handling of iMet-50/54 data.
• Decoders: Fix a bug that occurred when decoding M10 radiosondes with the 'save raw data' setting was enabled. (Thanks @rs1729 !)
• Decoders: Rebase M20 decoder, to better handle improbable PTU values. Note that the M20 decoder also decodes the new PS-20 pilot-sonde, though it is still reported as a M20 as the telemetry formats are the same. (Thanks @rs1729 !)
• Web Interface: Add customisable fields to the Historical View table. (Thanks @AstroTaka !)
• Web Interface: Possible stability improvements for the main Web Interface page, should result in the page hanging less often.

Other Known Issues:

• iMet-1 serial number generation still has issues, and will result in iMet-1 sondes being assigned 3-4 different serial numbers throughout the flight. This is due to the iMet-1 telemetry repeating data across multiple frames, and there's no easy fix (Thanks InterMet...). iMet-4 sondes should not be affected.

There are no configuration file changes in this release.

Note: We are aware that new installations may display the following message on startup:

The WebSocket transport is not available, you must install a WebSocket server that is compatible with your async mode to enable it. See the documentation for details. (further occurrences of this error will be logged with level INFO)

This can be safely ignored. The web interface should still continue to work as usual. Eventually we will figure out how to suppress it...

The pre-built Docker Image is now the recommended way to setup radiosonde_auto_rx on a new station. Using Docker avoids issues with updates to dependencies, and allows for fixes relating to system packages to be easily pushed out to users.

Please report any problems encountered either on the mailing list, or by raising an issue on this repository.

PLEASE DO NOT USE THE GITHUB GENERATED RELEASE ZIP FILES - USE THE INSTALLATION/UPDATE STEPS DESCRIBED IN THE WIKI

Atmosphere - Atmospheric Composition and Dynamics - C
Published by darksidelemm about 2 years ago

Project Horus - v1.6.0 - Major Decoder Restructure, SpyServer Support

This version of auto_rx has been a long time coming, and I apologise for how long it's taken! Thanks to all that have been running the testing branch and sending me all those bug reports :-)

There are many changes in this release, including many bug fixes and support for new radiosonde types, but the big new feature is the ability for auto_rx to connect to a AirSpy SpyServer instance. This allows auto_rx to decode any radiosonde signals within the passband of that SpyServer. For example with an Airspy Mini you can cover 4.8 MHz of spectrum simultaneously, and with an Airspy R2 you can cover 8 MHz! Details of this functionality (and the caveats involved) are available here.

An abridged list of changes is as follows:

• General: Build script now uses Makefiles

• General: Added ability to use a SpyServer for reception. Please refer to this page for details on how this is configured.

• Config: Various updates made (all backwards compatible). Refer Config File Changelog for details.

• Decoders: All demodulators re-based to latest from upstream repository.

• Decoders: iMet-1/4 decoder now uses IQ Input instead of FM

• Decoders: MRZ-H1 Decoder now uses IQ input instead of FM

• Decoders: All decode chains now use the abstracted IQ source functions, with a 'centred' signal.

• Decoders: Meteosis MTS01 decoder added. Basic temperature support.

• Decoders: PTU support for Meisei iMS-100 and RS-11G radiosondes.

• Decoders: Improvements to DFM telemetry handling.

• Decoders: Various issues fixed with handling of adjacent signals.

• Logging: Configuration file now includes options to enable system-level logging and debug logging, intended for use in getting detailed logs out of Docker Containers.

• Web Interface: Fixes to Historical Display

• Web Interface: When not using UTC time, times are now displayed use system locale settings.

• Web Interface: Line-of-sight lines now disappear after a timeout period.

I'd like to thank the following contributors to this release:

• @rs1729 - Providing all the amazing radiosonde telemetry decoders.
• @pinkavaj - Many small fixes throughout the codebase.
• @AstroTaka - Finding heaps of bugs I'd missed for so long, and providing IQ data for Meisei sonde support improvements.
• @icalik - Testing of Meteosis MTS01 support

Note: We are aware that new installations may display the following message on startup:

The WebSocket transport is not available, you must install a WebSocket server that is compatible with your async mode to enable it. See the documentation for details. (further occurrences of this error will be logged with level INFO)

This can be safely ignored. The web interface should still continue to work as usual. Eventually we will figure out how to suppress it...

The pre-built Docker Image is now the recommended way to setup radiosonde_auto_rx on a new station. Using Docker avoids issues with updates to dependencies, and allows for fixes relating to system packages to be easily pushed out to users.

Please report any problems encountered either on the mailing list, or by raising an issue on this repository.

PLEASE DO NOT USE THE GITHUB GENERATED RELEASE ZIP FILES - USE THE INSTALLATION/UPDATE STEPS DESCRIBED IN THE WIKI

Atmosphere - Atmospheric Composition and Dynamics - C
Published by darksidelemm about 2 years ago

Project Horus - DFM Decoder Updates, APRS output restricted to radiosondy.info

As of auto_rx version 1.5.10, we are limiting APRS output to only radiosondy.info, and only on the non-forwarding port.
This decision was not made lightly, and is a result of the considerable amount of non-amateur traffic that radiosonde flights are causing within the APRS-IS network.
Until some form of common format can be agreed to amongst the developers of all radiosonde tracking software to enable radiosonde telemetry to be de-duped, I have decided to help reduce the impact on the wider APRS-IS network by restricting the allowed servers and ports. Michal SQ6KXY has also configured radiosondy.info to stop forwarding radiosonde traffic onto APRS-IS.

If you are using another APRS-IS server that does not forward to the wider APRS-IS network and want it allowed, then please raise an issue at https://github.com/projecthorus/radiosonde_auto_rx/issues

You are of course free to fork and modify this codebase as you wish, but please be aware that this goes against the wishes of the radiosonde_auto_rx developers to not be part of the bigger problem of APRS-IS congestion.
As of 2022-03-01, radiosonde traffic has been filtered from aprs.fi, so even if you do modify the code, you still won't see sondes on that map.

APRS-IS is a shared resource, intended for the use of all amateur radio operators, and for many years we have been treating it as a playground to dump large amounts of non-amateur traffic into, so we can see weather balloons on a map.
Instead of congesting this shared resource with non-amateur traffic, we should instead be moving to using databases and sites specialised for this purpose, such as sondehub.org

This release brings the following updates:

• Decoders: DFM decoder should now be somewhat more robust to multiple DFMs appearing on the same frequency. This is not that well tested, so reports on how it performs when multiple sondes are present would be appreciated. - Thanks @rs1729 !
• SondeHub: Inhibit errors relating to Z-Match filtering.
• APRS: Removed the synchronous upload feature, which will help reduce instantaneous load on APRS-IS servers.
• APRS: Restricted the APRS server to radiosondy.info, and the APRS port to the radiosondy.info non-forwarding port.

Other Known Issues:

• iMet-1 serial number generation still has issues, and will result in iMet-1 sondes being assigned 3-4 different serial numbers throughout the flight. This is due to the iMet-1 telemetry repeating data across multiple frames. iMet-4 sondes should not be affected.

There are no configuration file changes in this release, though a note has been added regarding the APRS changes.

Note: We are aware that new installations may display the following message on startup:

The WebSocket transport is not available, you must install a WebSocket server that is compatible with your async mode to enable it. See the documentation for details. (further occurrences of this error will be logged with level INFO)

This can be safely ignored. The web interface should still continue to work as usual. Eventually we will figure out how to suppress it...

The pre-built Docker Image is now the recommended way to setup radiosonde_auto_rx on a new station. Using Docker avoids issues with updates to dependencies, and allows for fixes relating to system packages to be easily pushed out to users.

Please report any problems encountered either on the mailing list, or by raising an issue on this repository.

PLEASE DO NOT USE THE GITHUB GENERATED RELEASE ZIP FILES - USE THE INSTALLATION/UPDATE STEPS DESCRIBED IN THE WIKI

Atmosphere - Atmospheric Composition and Dynamics - C
Published by darksidelemm about 3 years ago

Project Horus - iMet XDATA Support, iMet-1/4 Detection

This release brings the following updates:

• Decoders: iMet-1 & 4 XDATA extraction support - Thanks @rs1729 !
• Decoders: Detection of iMet-1 vs iMet-4 sondes, based on frame rate vs time increment.

IMPORTANT NOTE: Due to issues with auto_Rx versions <=1.5.8 poorly handling iMet-1 sonde telemetry, it is extremely important that stations within range of iMet-1/4 sondes update ASAP. Uploading of iMet telemetry from any version of auto_rx below 1.5.9 into SondeHub will be blocked shortly.

There are no configuration file changes in this release.

Note: We are aware that new installations may display the following message on startup:

The WebSocket transport is not available, you must install a WebSocket server that is compatible with your async mode to enable it. See the documentation for details. (further occurrences of this error will be logged with level INFO)

This can be safely ignored. The web interface should still continue to work as usual. Eventually we will figure out how to suppress it...

The pre-built Docker Image is now the recommended way to setup radiosonde_auto_rx on a new station. Using Docker avoids issues with updates to dependencies, and allows for fixes relating to system packages to be easily pushed out to users.

Please report any problems encountered either on the mailing list, or by raising an issue on this repository.

PLEASE DO NOT USE THE GITHUB GENERATED RELEASE ZIP FILES - USE THE INSTALLATION/UPDATE STEPS DESCRIBED IN THE WIKI

Atmosphere - Atmospheric Composition and Dynamics - C
Published by darksidelemm about 3 years ago

Project Horus - M20 PTU Support, Multiple iMet-4 Fixes

This release brings the following updates:

• Decoders: M20 Pressure, Temperature, and Humidity support. Note that not all M20 sondes have a pressure sensor. Thanks to DF9DQ and @rs1729!
• Decoders: The iMet-4 decode chain should now gracefully handle up to 4 different iMet-4 sondes observed on the same frequency.
• Other: Small tweaks to some log levels.

There are no configuration file changes in this release.

Note: We are aware that new installations may display the following message on startup:

The WebSocket transport is not available, you must install a WebSocket server that is compatible with your async mode to enable it. See the documentation for details. (further occurrences of this error will be logged with level INFO)

This can be safely ignored. The web interface should still continue to work as usual. Eventually we will figure out how to suppress it...

The pre-built Docker Image is now the recommended way to setup radiosonde_auto_rx on a new station. Using Docker avoids issues with updates to dependencies, and allows for fixes relating to system packages to be easily pushed out to users.

Please report any problems encountered either on the mailing list, or by raising an issue on this repository.

PLEASE DO NOT USE THE GITHUB GENERATED RELEASE ZIP FILES - USE THE INSTALLATION/UPDATE STEPS DESCRIBED IN THE WIKI

Atmosphere - Atmospheric Composition and Dynamics - C
Published by darksidelemm over 3 years ago

Project Horus - Telemetry-derived transmit frequency, iMet-54 frame CRC, PS-15 sub-type support.

This release brings the following updates:

• Decoders: We now report the telemetry-derived transmit frequency for RS41, RS92 and iMS-100 sondes to SondeHub under the new tx_frequency optional field. This will allow identification of receivers with poorly-calibrated oscillators.
• Decoders: iMet-54 decoder updated to make use of a reverse-engineered frame CRC (more great work from @rs1729 !)
• Decoders: M10 decoder now only outputs the number-of-GPS-sats field for non-gTop M10s.
• Decoders: auto_rx now recognises the Graw DFM sub-type code of 0x7 as the PS-15 PilotSonde.
• Other: Some tweaks of logging levels.

There are no configuration file changes in this release.

Note: We are aware that new installations may display the following message on startup:

The WebSocket transport is not available, you must install a WebSocket server that is compatible with your async mode to enable it. See the documentation for details. (further occurrences of this error will be logged with level INFO)

This can be safely ignored. The web interface should still continue to work as usual. Eventually we will figure out how to suppress it...

The pre-built Docker Image is now the recommended way to setup radiosonde_auto_rx on a new station. Using Docker avoids issues with updates to dependencies, and allows for fixes relating to system packages to be easily pushed out to users.

Please report any problems encountered either on the mailing list, or by raising an issue on this repository.

PLEASE DO NOT USE THE GITHUB GENERATED RELEASE ZIP FILES - USE THE INSTALLATION/UPDATE STEPS DESCRIBED IN THE WIKI

Atmosphere - Atmospheric Composition and Dynamics - C
Published by darksidelemm over 3 years ago

Project Horus - iMet-50, 'new' LMS6-403 type support

This release brings the following updates:

• Decoders: Support for iMet-50 Pilot-sondes. These use the same telemetry format as the iMet-54, though without sensor data, and have been observed in Israel.
• Decoders: Changed references to LMS6-400 to LMS6-403 (better matches with manufacturer naming)
• Decoders: Support for 'new' LMS6-403 sondes, with slightly different framing format. These sondes have been observed to be launched from Vandenburg Space Force base, and stop transmitting shortly after burst. We are unsure if these are a new variant of LMS6 sondes, or the same sondes with a firmware modification.
• Docker: Minor changes to fsk_demod to support a switch to Alpine Linux in the future.

There are no configuration file changes in this release.

Note: We are aware that new installations may display the following message on startup:

The WebSocket transport is not available, you must install a WebSocket server that is compatible with your async mode to enable it. See the documentation for details. (further occurrences of this error will be logged with level INFO)

This can be safely ignored. The web interface should still continue to work as usual. Eventually we will figure out how to suppress it...

The pre-built Docker Image is now the recommended way to setup radiosonde_auto_rx on a new station. Using Docker avoids issues with updates to dependencies, and allows for fixes relating to system packages to be easily pushed out to users.

Please report any problems encountered either on the mailing list, or by raising an issue on this repository.

PLEASE DO NOT USE THE GITHUB GENERATED RELEASE ZIP FILES - USE THE INSTALLATION/UPDATE STEPS DESCRIBED IN THE WIKI

Atmosphere - Atmospheric Composition and Dynamics - C
Published by darksidelemm over 3 years ago

Project Horus - M20 APRS Support, Improved LMS6-1680 Decoding

This release brings the following updates:

• APRS: M20 telemetry can now be uploaded to APRS-IS (e.g. radiosondy.info)
• APRS: The recommended comment string has been changed to include the full sonde serial number. Refer to the configuration file change-log: https://github.com/projecthorus/radiosonde_auto_rx/wiki/Configuration-File-Changelog#version-155
• APRS: Removed the option to upload telemetry as position reports instead of APRS objects. The convention for telemetry uploading is to use Objects, and the position report option was causing more trouble than it was worth.
• Decoders: The LMS6-1680 decode chain has been improved, with a good few dB of improved sensitivity. There is also the option to enable an alternate decode chain which gives slightly higher performance again, which can be selected between in a new configuration file option (refer change-log linked above). However, this decode chain uses a considerable amount of CPU, so is only recommended for use on a RPI 3B+ or better.
• Scanning: Detection of LMS6-1680 sondes has been improved somewhat through the use of a wider FM filter bandwidth.
• Web Interface: Instead of the serial number in the table being a link, there are now small icons next to each serial number, linking to Sondehub and radiosondy.info.
• Historical Display: Table now shows Last Height, Maximum Height, and Maximum range for each sonde.
• Historical Display: The coverage map now sets any bearings with no sonde data to the station location and 0 range. This has the effect of making the coverage map a little 'spiky', but is a more accurate representation of the data.
• Docker: Fixes to running auto_rx on the Pi Zero W (Note that the Zero W is right on the bare edge of having enough CPU grunt to run auto_rx).

Note: We are aware that new installations may display the following message on startup:

The WebSocket transport is not available, you must install a WebSocket server that is compatible with your async mode to enable it. See the documentation for details. (further occurrences of this error will be logged with level INFO)

This can be safely ignored. The web interface should still continue to work as usual. Eventually we will figure out how to suppress it...

The pre-built Docker Image is now the recommended way to setup radiosonde_auto_rx on a new station. Using Docker avoids issues with updates to dependencies, and allows for fixes relating to system packages to be easily pushed out to users.

Please report any problems encountered either on the mailing list, or by raising an issue on this repository.

PLEASE DO NOT USE THE GITHUB GENERATED RELEASE ZIP FILES - USE THE INSTALLATION/UPDATE STEPS DESCRIBED IN THE WIKI

Atmosphere - Atmospheric Composition and Dynamics - C
Published by darksidelemm over 3 years ago

Project Horus - Minor Fixes & Updates, Docker rtl_fm performance improvements

This release brings the following updates:

• Docker Container: Switch to compiling rtl-sdr from source, to resolve an issue where the Debian rtl-sdr package uses very high CPU on recent Raspbian kernel versions (>5.0.0). Note: This affects native installations of auto_rx too, but can't be fixed as easily - If you are noticing extremely high CPU usage on your station (rtl_fm using ~70% CPU, when it should be using ~11%), it is recommended that you uninstall the system-provided rtl-sdr packages and compile/install rtl-sdr from source. Refer Section 4.2.1 of the auto_rx installation instructions
• Web Interface: Adjusted window detection width for mobile/desktop browsers. Should help get most table fields back when clearing cookies on the web interface.
• Historical Display: Re-named Plot Launches/Landings to Plot Last RX / Plot First RX.
• Historical Display: Added Plot Coverage button.
• Historical Display: Added Last Height & Maximum Range fields to table.
• RS41 Decoding: Relaxed RS41 serial number regex to permit older radiosondes (now allows letters C-Z), and any serial number, to allow research groups re-launching RS41s with modified serials to be received by auto_rx.
• RS92 Decoding: Handle error when downloading GPS Almanac correctly.
• Configuration File: Added 'save_raw_hex' debugging option, which saves hexadecimal frame data for a select number of sonde types to the log directory while decoding. Refer Config File Changelog
• Configuration File: Added a minimum time limit to the SondeHub upload rate (10 seconds). Uploading faster than this results in higher database load (and higher running costs!) for little benefit.

The pre-built Docker Image is now the recommended way to setup radiosonde_auto_rx on a new station. Using Docker avoids issues with updates to dependencies, and allows for fixes relating to system packages to be easily pushed out to users (e.g. the rtl-sdr issues).

IMPORTANT UPDATE NOTES:

• Once again, if you haven't updated to Python >3.6 - now is the time (auto_rx will no longer work on Python 2.7 or 3.5.). If your station is running on Python 2, please either do a fresh install with the latest Raspbian. It is highly recommended that you use the Docker installation referred to above.

If you are upgrading from an old release and are encountering issues with the web interface, please refer to the release notes for v1.5.1 for information on the Python package updates required: https://github.com/projecthorus/radiosonde_auto_rx/releases/tag/v1.5.1

Please report any problems encountered either on the mailing list, or by raising an issue on this repository.

PLEASE DO NOT USE THE GITHUB GENERATED RELEASE ZIP FILES - USE THE INSTALLATION/UPDATE STEPS DESCRIBED IN THE WIKI

Atmosphere - Atmospheric Composition and Dynamics - C
Published by darksidelemm almost 4 years ago

Project Horus - Historical Data View and Skew-T Plots

This release brings the much-requested ability to display historical log files! A huge thanks to @LukePrior for their work bringing us this new feature.

The new 'historical view', available from the top-right of the main auto_rx web interface provides the following functions:

• Plot the flight paths of selected radiosonde flights.
• Plot the landing locations of all received radiosonde flights.
• Generate a Skew-T plot for a selected radiosonde flight (if temperature/humidity data is available). This uses the skewt-js library from dfelix.
• Download selected logs as a Zip file.

You can find a guide to the new web interface on the auto_rx wiki here: https://github.com/projecthorus/radiosonde_auto_rx/wiki/Web-Interface-Guide

Skew-T plots are also available on the sondehub.org/card/ page used to display historical data from the SondeHub database. We hope to add Skew-T plots to the SondeHub tracker sometime in the near future.

Note: If you are using a 'native' install of auto_rx, you will need to install the 'semver' Python package by running: sudo pip3 install semver

Finally, we have now turned off the 'v1' SondeHub interface. radiosonde_auto_rx stations will no longer appear on tracker.habhub.org, nor will radiosonde telemetry be available via tracker.habhub.org. All radiosonde tracking is now located on https://tracker.sondehub.org/ and stations must be running at least v1.5.1 for their telemetry and station to appear on the map.

The pre-built Docker Image is now the recommended way to setup radiosonde_auto_rx on a new station. Using Docker avoids issues with updates to dependencies, like is occurring in this release.

IMPORTANT UPDATE NOTES:

• Once again, if you haven't updated to Python >3.6 - now is the time (auto_rx will no longer work on Python 2.7 or 3.5.). If your station is running on Python 2, please either do a fresh install (ideally with the latest version of Raspbian), or follow the Python 2 -> 3 upgrade guide here: https://github.com/projecthorus/radiosonde_auto_rx/wiki/Performing-Updates#upgrading-a-station-from-python-2-to-python-3

If you are upgrading from an old release and are encountering issues with the web interface, please refer to the release notes for v1.5.1 for information on the Python package updates required: https://github.com/projecthorus/radiosonde_auto_rx/releases/tag/v1.5.1

Please report any problems encountered either on the mailing list, or by raising an issue on this repository.

PLEASE DO NOT USE THE GITHUB GENERATED RELEASE ZIP FILES - USE THE INSTALLATION/UPDATE STEPS DESCRIBED IN THE WIKI

Atmosphere - Atmospheric Composition and Dynamics - C
Published by darksidelemm almost 4 years ago

Project Horus - Bugfix for 1.5.2

Fixes issues with station.cfg backwards compatibility (blacklist was being interpreted as the new only_scan list). If you hav re-named your configuration file entries to the new names there will be no issues.

Atmosphere - Atmospheric Composition and Dynamics - C
Published by darksidelemm almost 4 years ago

Project Horus - More Web Interface Improvements, Habitat DB Deprecated

This release of auto_rx brings the following new features & changes:

We have now cut-over to the new SondeHub v2 database! This means no more overloading of the Habitat database, which was intended for only a small number of amateur high-altitude balloon launches. The Habitat uploader has now been disabled permanently in this release. Habitat will stop accepting uploads from auto_rx stations around the end of May.

The Sondehub Tracker has been switched over to use this new database, with the following changes:

• Update rates are increased, with 1-second resolution telemetry available for sondes currently in the air (telemetry over larger time periods is decimated to avoid overloading browser clients).
• The telemetry graphs will work for all provided telemetry fields (temperature, pressure, humidity, battery voltage, satellites)
• The Signal-to-noise ratio observed by each received is shown next to their callsign in the list of radiosondes.
• The radiosonde type is shown next to the serial number in the list of radiosondes.
• Chase Car position uploading has been updated to use the new SondeHub listeners API. Chasemapper has also been updated to be able to use this API to show chase car positions on the new tracker.

The Sondehub v2 database is currently handling ~4 million telemetry packets per day, with peaks above 200 packets per second during the major radiosonde launch times. Running this database system is definitely not cost-free, so if you'd like to help support the ongoing running of the Sondehub DB and tracker, we have a Patreon page ( https://patreon.com/sondehub ) and a PayPal donate URL ( https://sondehub.org/go/donate .

Other updates in this release include:

• More improvements to the Web Interface (Thanks @LukePrior !). There are now some basic controls over the scanning & decoding system available from a button at the bottom of the Settings pane. These allow the user to halt the scanner, and manually stop/start a decoder on a provided frequency. I expect this functionality will mainly be useful for testing purposes, as the current scanning system works pretty well. These controls are only functional if web_control is set to True in the station.cfg file, and a web_password is set. Note: Stations that have their web interface exposed to the internet should use this feature with caution - no guarantee of web interface security is provided! You may need to Shift-Refresh the page, or clear your browser cache for full functionality after updating.

• Fixes to SNR reports from radiosonde signals that are fading. SNRs are now calculated using a 'peak hold'.

• Fixes to handling of telemetry from DFM radiosondes when the serial number has not yet been received. (Should stop the 'xxxxxxxx' sondes from appearing on the map)

• Fixed to e-mail notifications for radiosonde types that don't report ascent/descent rates.

• Update the URLs in the email notifications and the web interface to work with the new Sondehub v2 database. The main change here is the stripping off the sonde type prefix that is used on some serial numbers (DFM, M10/20, iMet...).

• Map movement in the web interface has been smoothed. This does increase CPU load in the browser - let us know if you experience issues on low-powered systems.

• Re-named the white/black/grey-list entries in the configuration file to have more sensible names: only_scan, always_scan and never_scan.

Refer to the Configuration File Changelog for details on what has changed. As always, auto_rx should be backwards-compatible with old station.cfg files, though you will see warnings on startup.

The pre-built Docker Image is now the recommended way to setup radiosonde_auto_rx on a new station. Using Docker avoids issues with updates to dependencies, like is occurring in this release.

IMPORTANT UPDATE NOTES:

• Once again, if you haven't updated to Python >3.6 - now is the time (auto_rx will no longer work on Python 2.7 or 3.5.). If your station is running on Python 2, please either do a fresh install (ideally with the latest version of Raspbian), or follow the Python 2 -> 3 upgrade guide here: https://github.com/projecthorus/radiosonde_auto_rx/wiki/Performing-Updates#upgrading-a-station-from-python-2-to-python-3

Please report any problems encountered either on the mailing list, or by raising an issue on this repository.

PLEASE DO NOT USE THE GITHUB GENERATED RELEASE ZIP FILES - USE THE INSTALLATION/UPDATE STEPS DESCRIBED IN THE WIKI

Atmosphere - Atmospheric Composition and Dynamics - C
Published by darksidelemm almost 4 years ago

Project Horus - Updated Web Interface, SondeHub Station Info, Dropped Python <3.6 support.

This release of auto_rx brings the following new features & changes:

• Support for Python versions older than 3.6 has been dropped completely. Users running Python 2.7 or 3.5 will encounter an error on startup and auto_rx will exit. Time to upgrade to Python 3! In particular, Python >=3.6 is required. This means that stations running Raspbian Stretch (which comes with Python 3.5) will need to update to the latest Raspbian distribution - Raspbian Buster.
• Thanks to the work of @LukePrior, a revamped web interface! This brings a much cleaner and customisable web interface, with better mobile support and a dark mode!
• Updated the socket.io JS library, and removed the version pinning for flask-socketio. You will need to update your flask-socketio version for the web interface to continue working. Upgrading can be performed by running sudo pip3 install -U flask-socketio . You will also likely need to clear your browser cache to get the new socketio Javascript library (e.g. hold down Shift and click the page refresh button).
• Additions to the SondeHub v2 uploader system, such that station locations appear on the v2 tracker map even if no telemetry has been uploaded recently.
• Added an optional station contact e-mail field. This information is only made available to the SondeHub admins (myself and Michaela), and will only be used if an issue with your station is noticed (or if we need your help observing something interesting!).
• Added some additional checks on the date/time reported in radiosonde telemetry.
• Fixes to the Docker image generation for armv6/armv7 systems.

The pre-built Docker Image is now the recommended way to setup radiosonde_auto_rx on a new station. Using Docker avoids issues with updates to dependencies, like is occurring in this release.

IMPORTANT UPDATE NOTES:

• Once again, if you haven't updated to Python >3.6 - now is the time (auto_rx will no longer work on Python 2.7 or 3.5.). If your station is running on Python 2, please either do a fresh install (ideally with the latest version of Raspbian), or follow the Python 2 -> 3 upgrade guide here: https://github.com/projecthorus/radiosonde_auto_rx/wiki/Performing-Updates#upgrading-a-station-from-python-2-to-python-3

Please report any problems encountered either on the mailing list, or by raising an issue on this repository.

PLEASE DO NOT USE THE GITHUB GENERATED RELEASE ZIP FILES - USE THE INSTALLATION/UPDATE STEPS DESCRIBED IN THE WIKI

Atmosphere - Atmospheric Composition and Dynamics - C
Published by darksidelemm about 4 years ago

Project Horus - Intermet Systems iMet-54 and Meteo-Radiy MRZ Support, RS92 PTU, SondeHub v2 DB Uploader

This release brings the following changes thanks to the hard work of rs1729:

• Support for the Intermet iMet-54 radiosonde, which is currently used in South Africa.
• Support for PTU data decoding for RS92-SGP and RS92-NGP sondes.
• Support for the Meteo-Radiy MRZ-H1 (Commonly used in Russia)

Also:

• Addition of the SondeHub DB uploader. This uploads all the telemetry that your station receives to a new ElasticSearch-based database that we're calling 'Sondehub v2'! We're working hard behind the scenes to make best use of this data, including building up a separate version of the habhub tracker which will use this new DB instead of Habitat. For now, data is uploaded to this DB so we have data to work with to help development. This data is also now available via the AWS Open Data program - see below for more information.
• Added checks to ensure decoder and auto_rx versions match. If you haven't re-built the decoders (./build.sh) you will get a critical error when a decoder is started up. Make sure you rebuild after each update!

Thanks to @snh, auto_rx is also now available as a Docker image! See here for more information: https://github.com/projecthorus/radiosonde_auto_rx/wiki/Docker

With the addition of the new Sondehub v2 uploader, we will be starting to disable uploading of telemetry from older auto_rx versions (1.4.1 and older). Users running older versions will soon start to see notices in their logs reminding them to update, and in a few months will have all telemetry uploads blocked. Please update!

This release took far too long to get out the door... I'll try and push out updates more regularly from now on.

Telemetry Data Licensing & AWS Open Data
We have recently had a few requests from auto_rx users wishing to make (non-commercial!) use of the radiosonde flight path data gathered by auto_rx users into the SondeHub database, and the question of data licensing has arisen. Additionally, we have been accepted into the Amazon Web Services Open Data program - making our collected radiosonde telemetry available by yet another mechanism. More information on this is available here.

To clarify the licensing situation of this data, we have chosen to use a very permissive license - Creative Commons BY-SA 2.0. This is a similar license to what other telemetry gathering systems (e.g. ADS-B systems, SatNOGS) use, and ensures that the project and it's contributors (you!) are attributed appropriately if any data is used.

By continuing to use auto_rx and uploading telemetry to Habitat and Sondehub, you agree to release the telemetry data you gather under this license. With the upgraded database we will be providing more ways to access the data collected by the whole auto_rx network - some initial information is available here.

IMPORTANT UPDATE NOTES:

• Once again, if you haven't updated to Python 3 - now is the time (Sondehub uploading will not work under Python 2). If your station is running on Python 2, please either do a fresh install (ideally with the latest version of Raspbian), or follow the Python 2 -> 3 upgrade guide here: https://github.com/projecthorus/radiosonde_auto_rx/wiki/Performing-Updates#upgrading-a-station-from-python-2-to-python-3

Please report any problems encountered either on the mailing list, or by raising an issue on this repository.

PLEASE DO NOT USE THE GITHUB GENERATED RELEASE ZIP FILES - USE THE INSTALLATION/UPDATE STEPS DESCRIBED IN THE WIKI

Atmosphere - Atmospheric Composition and Dynamics - C
Published by darksidelemm about 4 years ago

Project Horus - Decoder updates, Landing Notifications, Live KML, RS41 Pressure support, Ending of Python 2 support.

This release brings the following changes:

• Starting to deprecate support for Python 2. See notes below!
• Add dynamic KML link to web interface, allowing display of data via Google Earth. (Thanks drid!)
• Addition of pressure decoding for RS41-SGP sondes. (Thanks rs1729!)
• Improvements in RS41 humidity calculations (Accurate to ~+/- 2.5% Thanks rs1729!)
• Switch to using timestamps as unique frame IDs for DFM sondes, instead of the 1-byte frame ID used currently. This resolves some issues observed on the Sondehub map.
• Fix bug where the Habitat uploader would upload very old telemetry data if the station's internet connection temporarily failed.
• Fix issue in Meisei IMS100 callsign checking.
• Improve handling of telemetry arriving via a UDP socket.
• Add e-mail notification of failed RTLSDRs.
• Add e-mail notification of nearby landing sondes.
• Add geo links to lat/lon entries in the telemetry table.
• Added an option to set the APRS-IS server port in the config file. The default has been set to 14590, which for radiosondy.info means that packets will not be forwarded out to the wider APRS-IS network. Licensed amateur radio operators can set this back to 14580 so their packets are forwarded.
• Added ability to emit radiosonde humidity and pressure data in APRS comment fields. The new suggested default aprs_custom_comment value is now: aprs_custom_comment = Clb=<vel_v> t=<temp> h=<humidity> p=<pressure> <freq> Type=<type> Radiosonde
• Add additional config file checks before allowing custom APRS callsigns.
• Add minimum limits to APRS and Habitat upload rates - please be considerate of other users of these services and not upload at high rates!

IMPORTANT UPDATE NOTES:

• It's now time for all stations to upgrade to Python 3. If your station is running on Python 2, please either do a fresh install (ideally with the latest version of Raspbian), or follow the Python 2 -> 3 upgrade guide here: https://github.com/projecthorus/radiosonde_auto_rx/wiki/Performing-Updates#upgrading-a-station-from-python-2-to-python-3
• The KML link adds a new python dependency ('simplekml'). This can be installed by running: sudo pip3 install -r requirements.txt.
• If you really don't want to do the upgrade to Python 3 just yet, you can probably get away with just installing the simplekml dependency by running: sudo pip install simplekml (But remember that Python 2 support will be completely phased out in the near future)
• Due to the changes in the DFM decoder (the frame ID change), we will be blocking uploads of DFM telemetry to Sondehub from any stations running an auto_rx version older than 1.3.3 effective immediately. If you are in an area with DFM sondes, please update promptly, and ensure you re-build the decoders (e.g. run ./build.sh)
• The recommended aprs_custom_comment value is now: Clb=<vel_v> t=<temp> h=<humidity> p=<pressure> <freq> Type=<type> Radiosonde to best make use of humidity and pressure decoding improvements.
• If you want your APRS-IS packets forwarded out to the wider APRS-IS network (outside of radiosondy.info), then you will need to add in the aprs_port config file option, and set it to 14580. Refer here: https://github.com/projecthorus/radiosonde_auto_rx/wiki/Configuration-File-Changelog#version-133

Please report any problems encountered either on the mailing list, or by raising an issue on this repository.

PLEASE DO NOT USE THE GITHUB GENERATED RELEASE ZIP FILES - USE THE INSTALLATION/UPDATE STEPS DESCRIBED IN THE WIKI

Atmosphere - Atmospheric Composition and Dynamics - C
Published by darksidelemm over 4 years ago

Project Horus - Demod Improvements, Distance Filtering

This release brings the following changes:

• Move to soft-decision-based demodulation for most sonde decoders. This gives a few dB additional demodulation performance for DFM, M10, LMS6 and RS92 decoders. RS41 decoding performance is essentially unchanged.
• Fix issues with RS41 battery voltage decoding in some rare situations.
• Change CSV log file to include all possible fields, making it a bit more consistent.
• Update scripts that process log files to handle these changes.
• Drop SDRs which repeatedly fail from the global SDR list. If all SDRs have failed auto_rx will exit (and promptly be restarted by systemd, if your system is set up that way).
• SDRs are now used in alphanumerical order, with the lowest in the list used first.
• Add initial Meteomodem M20 decode capability. This will only upload to Habhub, until a common APRS callsign format has been agreed upon by other radiosonde decoding software developers.

A new feature which may be of interest to some is the addition of distance-based temporary blocking. This allows you to optimise your station to track only sondes within a certain radius range.
This feature adds a few optional parameters to the bottom of the configuration file. Their use is described here:
https://github.com/projecthorus/radiosonde_auto_rx/wiki/Configuration-File-Changelog#version-132

Remember to run ./build.sh within the auto_rx directory to re-compile the decoders after updating or decoding will not work!

Please report any problems encountered either on the mailing list, or by raising an issue on this repository.

PLEASE DO NOT USE THE GITHUB GENERATED RELEASE ZIP FILES - USE THE INSTALLATION/UPDATE STEPS DESCRIBED IN THE WIKI

Atmosphere - Atmospheric Composition and Dynamics - C
Published by darksidelemm almost 5 years ago

Project Horus - Disable Habitat Payload Document creation, other updates

This update stops the auto_rx software from creating new payload documents for each newly discovered radiosonde. I have recently made changes to the Habitat database to use a common payload document for all radiosonde telemetry (callsigns beginning with RS_), which has helped significantly reduce the load on the database. Historical radiosonde data is still accessible, at: http://habitat.sondehub.org/history/RS_ (please contact me if you are using this API regularly)

This update also makes the following changes:

• Fix typo in station.cfg.example (station_beacon_comment) - Thanks Tory!
• Add additional fields to the web interface telemetry table.
• Added horizontal/vertical velocity (m/s) and bearing fields to the log file output.
• The following updates courtesy of @vg1320:
  • Addition of battery voltage output to the DFM and M10 decoders.
  • Additional PTU output to the M10 decoder.

Remember to run ./build.sh within the auto_rx directory to re-compile the decoders after updating!

Please report any problems encountered either on the mailing list, or by raising an issue on this repository.

PLEASE DO NOT USE THE GITHUB GENERATED RELEASE ZIP FILES - USE THE INSTALLATION/UPDATE STEPS DESCRIBED IN THE WIKI

Atmosphere - Atmospheric Composition and Dynamics - C
Published by darksidelemm about 5 years ago

Project Horus - DFM Callsign Changes

This update changes the behaviour of Graw DFM radiosonde sub-type handling. Previously, both Habitat and APRS callsigns included an identification of the DFM sub-type (DFM06, DFM09, DFM17, etc...).
Unfortunately, there has been some issues regarding identification of the newer DFM sonde types (in particular the DFM17), with Graw themselves indicating that the current method of type identification is not necessarily reliable. This resulted in duplicates of the same sondes cluttering APRS.

After discussions with other radiosonde decoder developers, we have agreed to move away from using the interpreted DFM sub-types in any generated callsigns. Instead, only the serial number will be used, prefixed with 'D' - e.g. D19123456 for APRS, and RS_DFM-19123456 for Habitat.
The comment fields in both APRS and Habitat packets will still include the identified DFM sub-type.

This update will result in duplicate sondes appearing on Habitat and APRS as users upgrade. While we cannot do much about the APRS situation, we will be blocking DFM telemetry uploads to Habitat for auto_rx versions older than v1.3.0 effective immediately. Other radiosonde model uploads will not be affected.

Please report any problems encountered either on the mailing list, or by raising an issue on this repository.

PLEASE DO NOT USE THE GITHUB GENERATED RELEASE ZIP FILES - USE THE INSTALLATION/UPDATE STEPS DESCRIBED IN THE WIKI

Atmosphere - Atmospheric Composition and Dynamics - C
Published by darksidelemm about 5 years ago

Project Horus - Fix handling of DFMxB sondes, and handling of encrypted RS41s

Patch release to:

• Allow DFM sondes with a 0xB ID code (most likely DFM-17 sondes) to be processed.
• Fix issues with encrypted RS41 sondes not being blocked correctly due to the new automatic frequency correction features.

Important Note
In the next release (v1.3.0), the way Graw DFM sondes are handled will change. Graw have stated that the method that the radiosonde-decoding community currently uses to determine radiosonde types is not valid, particularly for the new DFM-17 radiosondes.
As such, I will be moving away from including the identified DFM sonde type in the generated callsign (for both Habhub and APRS), and only include it in the comment field.

On Habhub, DFM callsigns will change from DFM09- to DFM-. The format of DFM callsigns used on APRS is still to be agreed upon with developers of other radiosonde decoding software, to ensure we are consistent.

As this change is going to result in many duplicate sondes appearing on various maps as users upgrade, we will be immediately blocking all DFM sonde uploads to Habhub from versions older than v1.3.0 as soon as this version is released. Unfortunately it is not possible to do the same for APRS, so there is likely to be a large amount of duplicate sondes on radiosondy.info and similar sites for a while.

Please report any problems encountered either on the mailing list, or by raising an issue on this repository.

PLEASE DO NOT USE THE GITHUB GENERATED RELEASE ZIP FILES - USE THE INSTALLATION/UPDATE STEPS DESCRIBED IN THE WIKI

Atmosphere - Atmospheric Composition and Dynamics - C
Published by darksidelemm over 5 years ago

Project Horus - Fixes for unencrypted RS41-SGMs, iMet ID generation.

Patch release to fix:

• An issue with handling of unencrypted RS41-SGM telemetry, where no telemetry would be uploaded to APRS or Habitat
• Generation of iMet callsigns should now be consistent across multiple stations.
• The frequency field in APRS packets will now be the 'actual' frequency of the sonde, not the receiver tuned frequency

Atmosphere - Atmospheric Composition and Dynamics - C
Published by darksidelemm over 5 years ago

Project Horus - Meisei iMS-100 Support, Updated Decoders, SNR display

• Add support for Meisei iMS-100 Radiosondes.
• Add support for the yet-unnamed new Lockheed Martin radiosonde (LMS-X for now).
• Rebased all decoders to latest from @rs1729 's repo.
• Detection stage now uses IQ input, and provides an estimate of frequency offset which is used to adjust the starting frequency of the decoder step.
• Fix APRS high-precision coordinate calculation. (Resolves https://github.com/projecthorus/radiosonde_auto_rx/issues/207 )
• Fix scroll wheel unintentionally zooming the map on the web interface (Resolves https://github.com/projecthorus/radiosonde_auto_rx/pull/209 )
• Fix a few Python 3 compatibility issues (Thanks @snh!)
• Use fsk_demod decoder chains by default where possible (this is just a change to the defaults in the example configuration file, so you will need to change the type_experimental settings in your own station.cfg file to enable them)
• When using fsk_demod, utilise the statistics output from the modem to:
  • Log estimated SNR values and display them on the web interface. These are also emitted in the payload_summary output as a 'snr' field.
  • Log estimated centre frequency of the sonde signal (based on the modem's estimate of the two FSK tones) and display on the web interface.
  • Resolves https://github.com/projecthorus/radiosonde_auto_rx/issues/204
• Removed station_code setting in configuration file (used to generate callsigns for iMet sondes, and was causing more trouble than it was worth...)
• Switch to rs1729 M10 decoder, and (hopefully) make M10 APRS callsign compatible with that produced by other decoder software (Resolves https://github.com/projecthorus/radiosonde_auto_rx/issues/225 )
• Minor changes to work towards continuous integration tests, and enable replacement of rtl_fm and rtl_sdr with other IQ sources.
• Add Dockerfile for easier setup! (Thanks @snh !) - Information on using Docker is available here
• Added auto_rx version to APRS packet comment as a default.

Finally, we will now no longer support auto_rx instances using Python 2.7. While the codebase is currently compatible with both Python 2.7 and Python 3.x, it is likely that future updates will start using Python >=3.7 exclusive features (e.g. asyncio).

Please report any problems encountered either on the mailing list, or by raising an issue on this repository.

PLEASE DO NOT USE THE GITHUB GENERATED RELEASE ZIP FILES - USE THE INSTALLATION/UPDATE STEPS DESCRIBED IN THE WIKI

Atmosphere - Atmospheric Composition and Dynamics - C
Published by darksidelemm over 5 years ago

Project Horus - DFM09 ID Fixes, DFM APRS Callsign Changes

This patch release fixes an issue where some newer DFM09 sondes would not obtain an ID. Thanks to pit711 for letting me know about the issue.

The APRS callsign format for DFM sondes has also been changed to match that used by dxlAPRS. The callsign is now generated from the last 5 hex digits of the sonde's serial number.

If you don't receive Graw DFM radiosondes, there is no need to update to this release.

Please report any problems encountered either on the mailing list, or by raising an issue on this repository.

PLEASE DO NOT USE THE GITHUB GENERATED RELEASE ZIP FILES - USE THE INSTALLATION/UPDATE STEPS DESCRIBED IN THE WIKI

Atmosphere - Atmospheric Composition and Dynamics - C
Published by darksidelemm almost 6 years ago

Project Horus - Bugfix release for Habitat Upload Issue

This bug-fix release fixes an issue reported where the Habitat upload thread would break if upload_listener_position was set to False, with habitat_enabled set to True (often the case when auto_rx is used in a chase car). Thanks to Brian OZ1SKY for bringing the issue to my attention.

There is no need to update to this release if you are uploading your listener position.

Please report any problems encountered either on the mailing list, or by raising an issue on this repository.

PLEASE DO NOT USE THE GITHUB GENERATED RELEASE ZIP FILES - USE THE INSTALLATION/UPDATE STEPS DESCRIBED IN THE WIKI

Atmosphere - Atmospheric Composition and Dynamics - C
Published by darksidelemm almost 6 years ago

Project Horus - Initial 400 & 1680 MHz Lockheed Martin LMS6 Support

This release adds initial support for both 400 MHz and 1680 MHz Lockheed Martin LMS6 radiosondes. 1680 MHz LMS6 support is still very experimental (awaiting a physical sonde sample to test with), but the 400 MHz support has been tested by a few stations in the US and appears to work well!
Both the 400 MHz and 1680 MHz decode chains have not been optimised, as I don't yet have access to a high-SNR sample to experiment with. Improvements will be made as more data becomes available.

Also added in this release is:

• Support for SSL/TLS email authentication.
• Enable setting station position via GPSD. (Note: This is not intended to be a replacement for ChaseMapper's chase-car position upload feature, but rather to assist when using auto_rx with a rotator in a portable situation)

A summary of the changes to station.cfg for this release are available here: https://github.com/projecthorus/radiosonde_auto_rx/wiki/Configuration-File-Changelog

Please report any problems encountered either on the mailing list, or by raising an issue on this repository.

PLEASE DO NOT USE THE GITHUB GENERATED RELEASE ZIP FILES - USE THE INSTALLATION/UPDATE STEPS DESCRIBED IN THE WIKI

Atmosphere - Atmospheric Composition and Dynamics - C
Published by darksidelemm almost 6 years ago

Project Horus - Unencrypted RS41-SGM Support

This release adds:

• Support for unencrypted Vaisala RS41-SGM radiosondes, thanks to some excellent work by @rs1729. These sondes have a slightly different telemetry format to regular RS41-SG sondes.
• Support for RS41 battery voltage. This is currently only saved to the log file, though may be brought out to the web interface on the next release.

Other changes include:

• Default Horus UDP output port changed to 55673, and is enabled by default. Chasemapper has been updated to include this output as a default profile.
• The decoder spacing minimum limit has been set to a minimum of 15 kHz for all radiosonde types. Please let me know if you regularly observe radiosondes on adjacent (10kHz) channels, so I can revise this restriction if necessary.

Please report any problems encountered either on the mailing list, or by raising an issue on this repository.

PLEASE DO NOT USE THE GITHUB GENERATED RELEASE ZIP FILES - USE THE INSTALLATION/UPDATE STEPS DESCRIBED IN THE WIKI

Atmosphere - Atmospheric Composition and Dynamics - C
Published by darksidelemm almost 6 years ago

Project Horus - APRS Station Position Fixes, Experimental Demod filter improvements

A few small fixes, including:

• Improved channel filtering for the experimental demodulation chains.
• Updated to the latest DFM decoder.
• Changed APRS station position uploading to use position reports instead of objects. If you want to show up on radiosondy.info, then you will also need to set
  station_beacon_icon = /`
• Added a 'station' field to the Payload Summary UDP output packet (uses the habitat station callsign value), to allow recording of where a payload summary packet originated from in client applications.
• Some other changes in preparation for handling of unencrypted RS41-SGM sondes.

Please report any problems encountered either on the mailing list, or by raising an issue on this repository.

PLEASE DO NOT USE THE GITHUB GENERATED RELEASE ZIP FILES - USE THE INSTALLATION/UPDATE STEPS DESCRIBED IN THE WIKI

Atmosphere - Atmospheric Composition and Dynamics - C
Published by darksidelemm almost 6 years ago

Project Horus - New experimental demodulation chain, many other updates.

Note: There is now a slightly updated v1.1.1 release.

• Add 'experimental' demodulation chains, which use David Rowe's FSK Demodulator to enable better tracking of drifty sondes (DFMs mainly). Refer to this tech-note for details.
• Handle detection of sondes on adjacent 10kHz channels, caused by sondes that drift up/down considerably (i.e. DFMs..). This is best paired with the experimental DFM demodulation chain.
• Add a high-pass filter option for the 'regular' RS41 decoder, to better handle frequency offsets (up to ~2 kHz without significant degradation). For more details refer to this tech-note.
• Add SMTP-SSL support for e-mail notifications.
• A few small tweaks to the web interface (fixes https://github.com/projecthorus/radiosonde_auto_rx/issues/171 and https://github.com/projecthorus/radiosonde_auto_rx/issues/155).
• Fix the encoding of high-precision APRS positions.
• Fix a bug which occurred when a RS41-SGM sonde was received.
• Remove un-used directories from the upstream RS repo.

A large number of options have been added to the station.cfg file, so it is recommended that you make a new copy of the example file and edit as appropriate.

Please report any problems encountered either on the mailing list, or by raising an issue on this repository.

PLEASE DO NOT USE THE GITHUB GENERATED RELEASE ZIP FILES - USE THE INSTALLATION/UPDATE STEPS DESCRIBED IN THE WIKI

Atmosphere - Atmospheric Composition and Dynamics - C
Published by darksidelemm almost 6 years ago

Project Horus - Fix RS41 burst timer reversion.

• Re-adds the RS41 burst timer output from rs41mod, which was accidentally reverted when updating the demodulators.

Please report any problems encountered either on the mailing list, or by raising an issue on this repository.

PLEASE DO NOT USE THE GITHUB GENERATED RELEASE ZIP FILES - USE THE INSTALLATION/UPDATE STEPS DESCRIBED IN THE WIKI

Atmosphere - Atmospheric Composition and Dynamics - C
Published by darksidelemm about 6 years ago

Project Horus - Decoder Updates, Vaisala RS41 Humidity Support

Updates include:

• Update the sonde decoders to the new 'modular' decoders from rs1729's repository - Thanks to Zilog80 for these updates:
  • Preliminary Relative Humidity calculation for Vaisala RS41 sondes.
  • Reporting of encrypted RS41 telemetry. If encrypted telemetry is observed, auto_rx will immediately terminate that decoder with an error and go back to scanning.
  • Fix use of SEM Almanac for RS92s post the GPS week rollover.
• Add a temporary block-list function, which will block the frequency of a RS41-SGM for ~60 minutes. This will help avoid continuous detection and lock-on to an encrypted radiosonde. A new setting has been added to the configuration file ([advanced] -> temporary_block_time) which specified the block time.

Please report any problems encountered either on the mailing list, or by raising an issue on this repository.

PLEASE DO NOT USE THE GITHUB GENERATED RELEASE ZIP FILES - USE THE INSTALLATION/UPDATE STEPS DESCRIBED IN THE WIKI

Atmosphere - Atmospheric Composition and Dynamics - C
Published by darksidelemm about 6 years ago

Project Horus - Initial iMet-4 support

• Switched to the semantic versioning approach for version numbers.
• Added initial Intermet iMet-4 support. The narrowband iMet-1 sondes should also work. This has not been tested with 'in the wild' sondes, only on the bench, so please let us know how you go! Refer to the Model Specific Notes wiki page for information on issues with decoding iMet sondes.
• Added additional config file options - users will need to re-generate their configuration file from station.cfg.example.
• Added debug output options - the FM-demodulated audio for the detection and decode steps can be saved to disk - Note that this may use up a lot of disk space, and should only be enabled if absolutely necessary.

PLEASE DO NOT USE THE GITHUB GENERATED RELEASE ZIP FILES - USE THE INSTALLATION/UPDATE STEPS DESCRIBED IN THE WIKI

Atmosphere - Atmospheric Composition and Dynamics - C
Published by darksidelemm about 6 years ago