Upload to my web server stopped

[BobW55]

I have not changed anything other than increased the exposure time on my nighttime images.
Last upload was YESTERDAY morning as usual and one jpg image today at 2:00AM. It was uploading an image every 5 minutes.
I stopped and restarted AllSky, and this did not help. I also tried a reboot.
All settings are correct and it is saving images to the PI's SDcard.

Ideas?

[EricClaeys]

@BobW55 See the Wiki page on Troubleshooting --> Uploads. It describes how to do a test upload. Also, look in /var/log/allsky.log for error messages.

[BobW55]

Yes allready working that route.
error returns:

*** upload.sh: ERROR: unable to log in to 's86.etcserver.com', user melvinwe'.

waiting on response from my WEB host. other programs are still able to upload into it.

[BobW55]

Just funny how it just quit this morning

[EricClaeys]

By any chance did you change your password?
The file ~/allsky/tmp/lftp_cmds/SaveImage.txt (or ~/allsky/tmp/SaveImage.txt) - I think those are the names - contains the commands lftp used. Type lftp then copy/paste each line from the file to the terminal and see what it says.

[BobW55]

I have NOT changed my password. this has been working non stop without issue till 2:00 AM February 14, 2023
I double checked and my password is correct. the folder location is also correct. public_html/allsky

set net:max-retries 2
set net:timeout 10
open --user 'melvinwe' --env-password -p 21 'ftp://s86.etcserver.com'
quote PWD > /dev/null || exit 99
cd '/public_html/allsky/' || (echo 'cd /public_html/allsky/ failed!'; exit 1) || exit 1
glob --exist 'SaveImage-17366*' && rm 'SaveImage-17366'
put '/home/pi/allsky/tmp/allsky-20230214224117.jpg' -o 'SaveImage-17366' || (echo 'put of /home/pi/allsky/tmp/allsky-20>rm  -f 'allsky.jpg'
glob --exist 'allsky.jpg*'
                        && (echo 'rm of allsky.jpg failed!  Trying again...';  (!sleep 3);  rm 'allsky.jpg' && echo 'WO>
                        && (echo '2nd rm failed, quiting.'; rm -f 'SaveImage-17366'; exit 1)
                        && exit 3
mv 'SaveImage-17366' 'allsky.jpg'
                        || (echo 'mv of SaveImage-17366 to allsky.jpg failed!  Trying again...'; (!sleep 3); mv 'SaveIm>
                        || (echo '2nd mv failed, quitting.'; rm -f 'SaveImage-17366'; exit 1) || exit 4
exit 0

[EricClaeys]

Bob, try the following:

export LFTP_PASSWORD=_your_REMOTE_PASSWORD_
lftp
set net:max-retries 2
set net:timeout 10
open --user 'melvinwe' --env-password -p 21 'ftp://s86.etcserver.com'
ls
quote PWD
exit

It's a long shot but it's possible your server no longer supports the "PWD" command.

[BobW55]

Im in a email convo with them now. I will ask

[BobW55]

  GNU nano 5.4                               /home/pi/allsky/tmp/lftp_cmds/x.txt                                        set net:max-retries 2
set net:timeout 10
open --user 'melvinwe' --env-password -p 21 'ftp://s86.etcserver.com'
quote PWD > /dev/null || exit 99
quote PWD
ls
debug 5
cd 's86.etcserver.com/' || (echo 'cd s86.etcserver.com/ failed!'; exit 1) || exit 1
glob --exist 'x-12630*' && rm 'x-12630'
put '/tmp/test.txt' -o 'x-12630' || (echo 'put of /tmp/test.txt to x-12630 failed!'; rm -f 'x-12630'; exit 1) || exit 2
rm  -f 'test.txt'
glob --exist 'test.txt*'
                        && (echo 'rm of test.txt failed!  Trying again...';  (!sleep 3);  rm 'test.txt' && echo 'WORKED>
                        && (echo '2nd rm failed, quiting.'; rm -f 'x-12630'; exit 1)
                        && exit 3
mv 'x-12630' 'test.txt'
                        || (echo 'mv of x-12630 to test.txt failed!  Trying again...'; (!sleep 3); mv 'x-12630' 'test.t>
                        || (echo '2nd mv failed, quitting.'; rm -f 'x-12630'; exit 1) || exit 4
exit 0

[BobW55]

reply from my host:
Hello,

Can you please let us know the IP address from which you are trying to connect to server, so that we can check further. Regarding the PWD command, command is working from our end.

[BobW55]

Pretty sure the problem is on my servers end

[BobW55]

reply from my host
Hello,

Upon checking the IP address is not blocked on our server side. It seems like the issue is from your end. Could you please reload the configuration or scripts or everything that you are using to connect? After that try to connect the FTP.

This drives me crazy. has been running like clock work all month and then some.

[EricClaeys]

@BobW55 Do you have another machine with FTP you can try? Either a Pi or a PC/Mac?
On the Pi, in the upload.sh file, replace --env-password with --password '${REMOTE_PASSWORD}' and see if that helps.

[EricClaeys]

Also, on the Pi try ping s86.etcserver.com.

[BobW55]

Can ping it all day.

pi@allsky1:~ $ ping s86.etcserver.com
PING s86.etcserver.com (23.111.131.26) 56(84) bytes of data.
64 bytes from s86.etcserver.com (23.111.131.26): icmp_seq=1 ttl=51 time=64.4 ms
64 bytes from s86.etcserver.com (23.111.131.26): icmp_seq=2 ttl=51 time=60.8 ms
64 bytes from s86.etcserver.com (23.111.131.26): icmp_seq=3 ttl=51 time=68.5 ms
64 bytes from s86.etcserver.com (23.111.131.26): icmp_seq=4 ttl=51 time=69.9 ms
64 bytes from s86.etcserver.com (23.111.131.26): icmp_seq=5 ttl=51 time=59.3 ms
64 bytes from s86.etcserver.com (23.111.131.26): icmp_seq=6 ttl=51 time=68.5 ms
64 bytes from s86.etcserver.com (23.111.131.26): icmp_seq=7 ttl=51 time=84.4 ms
64 bytes from s86.etcserver.com (23.111.131.26): icmp_seq=8 ttl=51 time=63.1 ms
64 bytes from s86.etcserver.com (23.111.131.26): icmp_seq=9 ttl=51 time=85.9 ms

[BobW55]

So my web host insist the problem is not on their end.
I have to replace the dome on my unit today anyway guess I'll have to reload it again.

[EricClaeys]

Bob,
If you can't connect when manually running lftp then it's not an Allsky issue. If you try again, set the debug level to 5 as the first command.
Have you run lftp manually, and if so, did it produce any error messages other than "cannot connect"?

[BobW55]

when I use the lftp command.
and enter

lftp :~> open --user 'melvinwe' --env-password -p 21 'ftp://s86.etcserver.com'

It then ask me for my password. When I enter my password it returns the following:

lftp [email protected]:~>

Some how it is not passing my password on to the system

[EricClaeys]

Use --password REMOTE_PASSWORD instead of --env-password.
If you don't get an error message, then type ls.

[BobW55]

That logged me in

[BobW55]

pi@allsky1:~ $ lftp
lftp :~> set net:timeout 10
lftp :~>  open --user 'melvinwe' --REMOTE_PASSWORD -p 21 'ftp://s86.etcserver.com'
open: unrecognized option '--REMOTE_PASSWORD'
Usage: open [-e cmd] [-p port] [-u user[,pass]] <host|url>
lftp :~> open --user 'melvinwe' --password REMOTE_PASSWORD -p 21 'ftp://s86.etcserver.com'
lftp [email protected]:~> ls
ls: Fatal error: Certificate verification: Not trusted (5F:CE:8B:09:24:83:D7:F9:18:B7:2B:C7:4F:2D:77:89:F5:3D:B2:1D)
lftp [email protected]:~>

[EricClaeys]

The "Troubleshooting--> uploads" page of the documentation describes how to fix certification errors.

[BobW55]

I tried what it posted....
this is the return

ssh -p 22 [email protected]
ssh: connect to host s86.etcserver.com port 22: Connection refused

[BobW55]

pi@allsky1:~ $ ssh -p 22 [email protected]
ssh: connect to host s86.etcserver.com port 22: Connection refused

[EricClaeys]

Bob, the certification error you received was "Not trusted" which is the third one described on the Troubleshooting page for certification errors. You tried the fix for a different error (ssh) that you don't have.

If you have a suggestion for how I can improve the Troubleshooting page so it's clearer which fix to apply, please let me know.

[BobW55]

Your instructions for trouble shooting the Certificates is very assuming that one knows their way around.
I have tried the instructions and can not get past step #1

pi@allsky1:~ $ ssh -p 22 [email protected]
ssh: connect to host s86.etcserver.com port 22: Connection refused
pi@allsky1:~ $

[EricClaeys]

Bob, go directly to the 3rd item, which is the problem you are having. Based on your feedback I will change the page so it doesn't look like an ordered list. Good point, thanks.

[BobW55]

Have done this already.

	# This setting does not apply to the "scp" PROTOCOL.
LFTP_COMMANDS="set ssl:verify-certificate no"

Still wont upload

[EricClaeys]

@BobW55. Try removing ~/.ssh/known_hosts.
If that doesn't work try the second fix, adding set ssl:check-hostname to LFTP_COMMANDS. The two commands need to be separated by ;.

[BobW55]

~/.ssh/known_hosts. <----- Where is this found?

[EricClaeys]

In Linux, ~ stands for the home directory of the current user. Assuming you log in aspiPi, then ~ is /home/pi, so the file is in /home/pi/.ssh/known_hosts.
If you use the ls command to list files, you need to add -a to show hidden files that begin with a ..

[BobW55]

Ahh thank you...... file was there but blank. I RMed it
Thinks now work. not sure why it suddenly quit.

[EricClaeys]

Gremlins?

[BobW55]

Thank you for putting up with an old fart. I left off with DOS and windows 286.
Everythig is working. Not sure why it suddenly quit, other than my WEB Host doing something. Has happened to me with my weather station from time to time as well. They make a change, and say nothing, and Im left jumping through hoops to make it work again.
Thank you

[EricClaeys]

From one old fart to another, I am glad you got it working. I don't like it when thins mysteriously stop and start working - often there is still an underlying problem.