Search code examples
linuxbashshellubuntusftp

How do I get the files from SFTP server and move them to another folder in bash script?


How do I get the one by one files from SFTP server and move them to another folder in Ubuntu bash script?

#!bin/sh
FOLDER=/home/SFTP/Folder1/    

sftp SFTP@ip_address    
cd /home/FSTP/Folder1/    
for file in "$FOLDER"*
<<EOF
cd /home/local/Folder1
get $file
EOF
mv $file /home/SFTP/Done
done

I know it's not right, but I've tried my best and if anyone can help me, I will appreciate it. Thanks in advance.


Solution

  • OpenSSH sftp is not very powerful client for such tasks. You would have to run it twice. First to collect list of files, use the list to generate list of commands, and execute those in a second run.

    Something like this:

    # Collect list of files
    files=`sftp -b - user@example.com <<EOF
    cd /source/folder
    ls
    EOF`
    files=`echo $files|sed "s/.*sftp> ls//"` 
    
    # Use the list to generate list of commands for the second run
    (
      echo cd /source/folder
      for file in $files; do
        echo get $file
        echo rename $file /backup/folder/$file
      done
    ) | sftp -b - user@example.com
    

    Before you run the script on production files, I suggest, you first output the generated command list to a file to check, if the results are as expected.

    Just replace the last line with:

    ) > commands.txt