Search code examples
downloadwgetdownload-managerhttrack

Downloading website with wget or httrack yields error "301 Moved Permanently"


I am trying to download https://untools.co/ with wget or httrack, but I repeatedly get the error "301 Moved Permanently". I get the main page downloaded, but once I open the index.html with a browser and try to click on some of the links I get redirected to a non-existing file.

I have tried commands like

wget --mirror --domains=untools.co untools.co
wget -np -r -k --convert-links "https://www.untools.co/"
httrack "https://untools.co/" -O "./untools" "+*.untools.co/*" --ext-depth 3

and tried to read a lot of documentation, but must admit I am somewhat lost, being completely new to those tools.

(I am on Linux Kubuntu - not sure if that is relevant.)


Solution

  • I run following command

    wget --mirror --convert-links https://www.untools.co/
    

    then opened index.html using Firefox and was able to access tools (I checked 3: Eisenhower Matrix, Ishikawa Diagram, Minto Pyramid) without issues. Be warned that wget convert links after all download are done therefore you must not open any file before wget finish running.