Azure Auto ML JobConfigurationMaxSizeExceeded error when using a cluster
I am running into the following error when I try to run Automated ML through the studio on a GPU compute cluster:
Error: AzureMLCompute job failed. JobConfigurationMaxSizeExceeded: The specified job configuration exceeds the max allowed size of 32768 characters. Please reduce the size of the job's command line arguments and environment settings
The attempted run is on a registered tabulated dataset in filestore and is a simple regression case. Strangely, it works just fine with the CPU compute instance I use for my other pipelines. I have been able to run it a few times using that and wanted to upgrade to a cluster only to be hit by this error. I found online that it could be a case of having the following setting: AZUREML_COMPUTE_USE_COMMON_RUNTIME:false; but I am not sure where to put this in when just running from the web studio.
It looks like the bug was fixed. I just ran it on a cluster without changing any of the parameters. Thank you Yutong for the help!
- Azure ML: Unable to find workspace
- When using an online endpoint for an AzureML classification model, how do I get a response including more fields than just the predicted value/proba?
- How to Output and Deploy Multiple Artifacts from Best Child in Sweep Job Component?
- ModuleNotFoundError: No module named 'azure.keyvault' - Azure pipeline run
- Set AzureML Job outputs path to working directory
- Concurrency on Azure VM for ML Endpoint
- Azure: there is no package called ‘dynlm’
- How to create Azure ML Registry using Terraform?
- Load a Registered Model in Azure ML Studio in an Interactive Notebook
- How to modify azureml python sdk v2 to serve custom use cases?
- How to prepare data for batch-inference in Azure ML?
- Azure Machine Learning - Online Endpoint Schedule/Cost management
- How can I access a OneLake in Fabric from Azure Machine Learning?
- Azure API Create Serverless Endpoint Not Working
- Control where Source Code for Azure ML Command gets Uploaded
- Unable to access azureml datastore
- Bicep Azure Machine learning custom role assignment
- Access individual files in a folder data asset in azure machine learning
- User XXX does not have access to compute instance YYY. Azure Machine Learning
- Unable to create an Azure Machine Learning Workspace using the CLI
- Can't change virtual environment within Azure ML notebook
- AzureML command job: 'Your file exceeds 100 MB.'
- Azure Machine Leraning Compute Cluster User Assigned Identities
- Azure AI Studio - ML Index GPT4 deployment API calls not working due to access_token error
- Register a Pandas Dataframe to Azure Machine Learning: NOT_SUPPORTED_API_USE_ATTEMPT
- Does Azure free student subscription require you to provide credit card details to start using?
- Authentication Error: Compute instance for Azure Machine Learning
- Streamclosed when trying to work with image imported from datastore into AzureML notebook
- Azure Machine Learning pin python version on notebook
- Retrieving current job for Azure ML v2