Search code examples
azureazure-machine-learning-serviceazureml-python-sdk

Load Azure ML experiment run information from datastore


I have lots of run files created by running PyTorch estimator/ ScriptRunStep experiments that are saved in azureml blob storage container. Previously, I'd been viewing these runs in the Experiments tab of the ml.azure.com portal and associating tags to these runs to categorise and load the desired models.

However, a coworker recently deleted my workspace. I created a new one which is connected to the previously-existing blob container, the run files therefore still exist and can be accessed on this new workspace, but they no longer show up in the Experiment viewer on ml.azure.com. Neither can I see the tags I'd associated to the runs.

Is there any way to load these old run files into the Experiment viewer or is it only possible to view runs created inside the current workspace?

Sample scriptrunconfig code:

data_ref = DataReference(datastore=ds,
                         data_reference_name="<name>",        
                         path_on_datastore = "<path>")
args = ['--data_dir',   str(data_ref),     
        '--num_epochs', 30,     
        '--lr',         0.01,          
        '--classifier', 'int_ext' ]  

src = ScriptRunConfig(source_directory='.',                       
                      arguments=args,                      
                      compute_target = compute_target,                       
                      environment = env,                       
                      script='train.py') 
src.run_config.data_references = {data_ref.data_reference_name: 
                                  data_ref.to_config()} 

Solution

  • Sorry for your loss! First, I'd make absolutely sure that you can't recover the deleted workspace. Definitely worthwhile to open an priority support ticket with Azure.

    Another thing you might try is:

    1. create a new workspace (which will create a new storage account for you for the new workspace's logs)
    2. copy your old workspace's data into the new workspace's storage account.