FTP upload issue (xdg-open: no method available...)

[frankhirsch]

Seems to be something strange in my Pi installation(s)
I have two Pi with AllSky installed as DEV and the MASTER branch - both are not able to execute the open command to upload files (manually, current and endOfNight). I checked the settings and credentials several times and finally noticed the upload script can not successfully execute the open command.

Any ideas what is required in Debian 11.6 to register the proper FTP client to handle uploads?

pi@rabbitjump:~/allsky/scripts $ xdg-open "ftp://93.90.178.127"
/usr/bin/xdg-open: 882: www-browser: not found
/usr/bin/xdg-open: 882: links2: not found
/usr/bin/xdg-open: 882: elinks: not found
/usr/bin/xdg-open: 882: links: not found
/usr/bin/xdg-open: 882: lynx: not found
/usr/bin/xdg-open: 882: w3m: not found
xdg-open: no method available for opening 'ftp://93.90.178.127'

pi@rabbitjump:~/allsky/scripts $ cat /home/pi/allsky/tmp/lftp_cmds/SaveImage.txt
set net:max-retries 2
set net:timeout 10
open --user 'rabbitjump.media' --env-password -p 21 'ftp://93.90.178.127'
quote PWD > /dev/null || cd . || exit 99
cd '/allsky.rabbitjump.media/current/' || (echo 'cd /allsky.rabbitjump.media/current/ failed!'; exit 1) || exit 1
glob --exist 'SaveImage-801*' && echo 'SaveImage-801 exists; removing...' && rm 'SaveImage-801'
put '/home/pi/allsky/tmp/image-20230212124235.jpg' -o 'SaveImage-801'
			|| (echo 'put of /home/pi/allsky/tmp/image-20230212124235.jpg to SaveImage-801 failed!  Trying again...'; (!sleep 3);  put '/home/pi/allsky/tmp/image-20230212124235.jpg' -o 'SaveImage-801' && echo 'WORKED' && exit 0)
			|| (echo '2nd put failed again, quitting'; exit 1)
			|| exit 2
rm  -f 'image.jpg'
glob --exist 'image.jpg*'
			&& (echo 'rm of image.jpg failed!  Trying again...';  (!sleep 3);  rm 'image.jpg' && echo 'WORKED' && exit 1)
			&& (echo '2nd rm failed, quiting.'; rm -f 'SaveImage-801'; exit 1)
			&& exit 3
mv 'SaveImage-801' 'image.jpg'
			|| (echo 'mv of SaveImage-801 to image.jpg failed!  Trying again...'; (!sleep 3); mv 'SaveImage-801' 'image.jpg' && echo 'WORKED' && exit 0)
			|| (echo '2nd mv failed, quitting.'; rm -f 'SaveImage-801'; exit 1)
			|| exit 4
exit 0

[EricClaeys]

@frankhirsch try:

export LFTP_PASSWORD=your_password
lftp -f /home/pi/allsky/tmp/lftp_cmds/SaveImage.txt

It will either work or produce an error message.
Also, try withOUT setting the port number in ftp-settings.sh.

[frankhirsch]

Hi @EricClaeys,
In the end seems to be a SSL certificate verification issue in lftp. The certificate used for FTP over TLS on the hosting server is a chained certificate issued by Let's Encrypt - and more than that, the server common name does not even match the hosting name :-/ After inspecting the server certificate I would expect it should work if the proper CN is being used when connecting - but probably lftp has issues withe chained certificates in general?

When disabling the SSL verifation option in the lftp_cmd it does work

set net:max-retries 2
set net:timeout 10
set ssl:verify-certificate no
open --user ...

Would this be a potential improvement for the DEV branch to made configurable - or do you have deeper knowledge how this should be solved?

[frankhirsch]

Note to myself... read the manual!
https://github.com/thomasjacquin/allsky/wiki/Troubleshooting-uploads

[EricClaeys]

Agree...
I spent several hours one evening debugging certificate errors and luckily the fixes were easy. What I would really like to do is have the Website installation do a test upload and check for certificate errors and let the user know.