Azure VMSS 自定义脚本扩展错误 - 无法下载脚本文件

Question

我正在运行自定义模板部署，其中包括 Linux VM 和基于 Linux 的 VMSS。

这两个操作(VM 创建和 VMSS 创建)都涉及 CustomScriptExtension。
用于后配置的脚本对于 VM 和 VMSS 是相同的。
它们在模板内具有相同的引用。

但是，VM 的部署成功完成，但 VMSS 的部署因错误而结束。

在 Azure 门户中检查资源组时，VMSS 已成功创建并显示事件(CPU、内存等)。

在“扩展”边栏选项卡中，我可以看到我的预定义扩展:

但是状态为“失败”。单击“失败”查看详细信息时，显示以下错误:

Message: VM has reported a failure when processing extension 'filesextension'. Error message: "Enable failed: processing file downloads failed: failed to download file[1]: failed to download file: unexpected status code: actual=404 expected=200" More information on troubleshooting is available at https://aka.ms/VMExtensionCSELinuxTroubleshoot 

Azure 门户部署错误:

{
    "status": "Failed",
    "error": {
        "code": "ResourceDeploymentFailure",
        "message": "The resource operation completed with terminal provisioning state 'Failed'.",
        "details": [
            {
                "code": "VMExtensionProvisioningError",
                "message": "VM has reported a failure when processing extension 'filesextension'. Error message: \"Enable failed: processing file downloads failed: failed to download file[1]: failed to download file: unexpected status code: actual=404 expected=200\"\r\n\r\nMore information on troubleshooting is available at https://aka.ms/VMExtensionCSELinuxTroubleshoot "
            }
        ]
    }
}

通过 CLI 部署时出现同样的错误:

Deployment failed. Correlation ID: f077af77-405b-49fe-9f95-bf42a722c7ec. {
  "status": "Failed",
  "error": {
    "code": "ResourceDeploymentFailure",
    "message": "The resource operation completed with terminal provisioning state 'Failed'.",
    "details": [
      {
        "code": "VMExtensionProvisioningError",
        "message": "VM has reported a failure when processing extension 'filesextension'. Error message: \"Enable failed: processing file downloads failed: failed to download file[0]: failed to download file: unexpected status code: actual=404 expected=200\"\r\n\r\nMore information on troubleshooting is available at https://aka.ms/VMExtensionCSELinuxTroubleshoot "
      }

ARM 模板本身:

{
    "$schema": "https://schema.management.azure.com/schemas/2019-04-01/deploymentTemplate.json#",
    "contentVersion": "1.0.0.0",
    "parameters": {
        "location": {
            "defaultValue": "[resourceGroup().location]",
            "type": "String",
            "metadata": {
                "description": "Location for all resources"
            }
        },
        "dnsNameForJumpBox": {
            "type": "String",
            "metadata": {
                "description": "Unique DNS Name for the Public IP used to access the Docker Virtual Machine (master node)."
            }
        },
        "vmImageReference": {
            "defaultValue": {
                "publisher": "Canonical",
                "offer": "UbuntuServer",
                "sku": "16.04-LTS",
                "version": "latest"
            },
            "type": "Object",
            "metadata": {
                "description": "The image to use for VMs created. This can be marketplace or custom image",
                "link": "https://learn.microsoft.com/en-us/nodejs/api/azure-arm-compute/imagereference?view=azure-node-2.2.0"
            }
        },
        "vmNodeSku": {
            "defaultValue": "Standard_F8s_v2",
            "type": "String",
            "metadata": {
                "description": "Size of VMs in the VM Scale Set."
            }
        },
        "vmMasterSku": {
            "defaultValue": "Standard_F16s_v2",
            "type": "String",
            "metadata": {
                "description": "Size of the master node."
            }
        },
        "vmMasterDiskType": {
            "defaultValue": "Premium_LRS",
            "allowedValues": [
                "Premium_LRS",
                "Standard_LRS"
            ],
            "type": "String",
            "metadata": {
                "description": "Choose between a standard disk for and SSD disk for the master node's NFS fileshare"
            }
        },
        "vmMasterDiskSize": {
            "defaultValue": 256,
            "allowedValues": [
                32,
                64,
                128,
                256,
                512,
                1000,
                2000,
                4000,
                10000
            ],
            "type": "Int",
            "metadata": {
                "description": "The SSD Size to be used for the NFS file share. For pricing details see https://azure.microsoft.com/en-us/pricing/details/managed-disks/"
            }
        },
        "vmAdditionalInstallScriptUrl": {
            "defaultValue": "",
            "type": "String",
            "metadata": {
                "description": "An additional installs script (bash run as root) to be run after nodes/master are configured. Can be used to mount additional storage or do additional setup"
            }
        },
        "vmAdditionalInstallScriptArgument": {
            "defaultValue": "",
            "type": "String",
            "metadata": {
                "description": "An argument to be passed to the additional install script"
            }
        },
        "nextflowInstallUrl": {
            "defaultValue": "https://get.nextflow.io",
            "type": "String",
            "metadata": {
                "description": "The install URL for nextflow, this can be used to pin nextflow versions"
            }
        },
        "instanceCount": {
            "defaultValue": 2,
            "maxValue": 100,
            "type": "Int",
            "metadata": {
                "description": "Number of cluster VM instances (100 or less)."
            }
        },
        "adminUsername": {
            "type": "String",
            "metadata": {
                "description": "Admin username on all VMs."
            }
        },
        "vnetName": {
            "defaultValue": "nfvnet",
            "type": "String",
            "metadata": {
                "description": "Name of the virtual network to deploy the scale set into."
            }
        },
        "subnetName": {
            "defaultValue": "nfsubnet",
            "type": "String",
            "metadata": {
                "description": "Name of the subnet to deploy the scale set into."
            }
        },
        "shareName": {
            "defaultValue": "sharedstorage",
            "type": "String",
            "metadata": {
                "description": "Azure file share name."
            }
        },
        "mountpointPath": {
            "defaultValue": "/datadisks/disk1",
            "type": "String",
            "metadata": {
                "description": "Path on VM to mount file shares. '/datadisks/disk1/' is a Premium Managed disk with high iops, this will suit most uses."
            }
        },
        "nodeMaxCpus": {
            "defaultValue": 2,
            "type": "Int",
            "metadata": {
                "description": "Sets the cluster.maxCpus setting on all cluster nodes"
            }
        },
        "_artifactsLocation": {
            "defaultValue": "https://raw.githubusercontent.com/Azure/azure-quickstart-templates/master",
            "type": "String",
            "metadata": {
                "description": "*Advanced* This is best left as default unless you are an advanced user. The base URI where artifacts required by this template are located."
            }
        },
        "_artifactsLocationSasToken": {
            "defaultValue": "",
            "type": "SecureString",
            "metadata": {
                "description": "*Advanced* This should be left as default unless you are an advanced user. The sasToken required to access _artifactsLocation.  When the template is deployed using the accompanying scripts, a sasToken will be automatically generated."
            }
        },
        "_artifactsSharedFolder": {
            "defaultValue": "shared_scripts/ubuntu",
            "type": "String",
            "metadata": {
                "description": "*Advanced* This should be left as default unless you are an advanced user. The folder in the artifacts location were shared scripts are stored."
            }
        },
        "_artifactsNextflowFolder": {
            "defaultValue": "nextflow-genomics-cluster-ubuntu/scripts",
            "type": "String",
            "metadata": {
                "description": "*Advanced* This should be left as default unless you are an advanced user. The folder in the artifacts location were nextflow scripts are stored."
            }
        },
        "authenticationType": {
            "defaultValue": "sshPublicKey",
            "allowedValues": [
                "sshPublicKey",
                "password"
            ],
            "type": "String",
            "metadata": {
                "description": "Type of authentication to use on the Virtual Machine. SSH key is recommended."
            }
        },
        "adminPasswordOrKey": {
            "type": "SecureString",
            "metadata": {
                "description": "SSH Key or password for the Virtual Machine. SSH key is recommended."
            }
        }
    },
    "variables": {
        "nextflowInitScript": "[uri(parameters('_artifactsLocation'), concat(parameters('_artifactsNextflowFolder'), '/init.sh', parameters('_artifactsLocationSasToken')))]",
        "diskInitScript": "[uri(parameters('_artifactsLocation'), concat(parameters('_artifactsSharedFolder'), '/vm-disk-utils-0.1.sh', parameters('_artifactsLocationSasToken')))]",
        "jumpboxNICName": "jumpboxNIC",
        "addressPrefix": "10.0.0.0/16",
        "subnetPrefix": "10.0.0.0/24",
        "vmssName": "[concat('cluster', uniqueString(parameters('dnsNameForJumpBox')))]",
        "storageAccountType": "Standard_LRS",
        "storageAccountName": "[concat('nfstorage', uniqueString(resourceGroup().id))]",
        "publicIPAddressName": "jumpboxPublicIP",
        "publicIPAddressType": "Dynamic",
        "jumpboxVMName": "jumpboxVM",
        "subnetRef": "[resourceId('Microsoft.Network/virtualNetworks/subnets', parameters('vnetName'), parameters('subnetName'))]",
        "linuxConfiguration": {
            "disablePasswordAuthentication": true,
            "ssh": {
                "publicKeys": [
                    {
                        "path": "[concat('/home/', parameters('adminUsername'), '/.ssh/authorized_keys')]",
                        "keyData": "[parameters('adminPasswordOrKey')]"
                    }
                ]
            }
        },
        "networkSecurityGroupName": "default-NSG"
    },
    "resources": [
        {
            "type": "Microsoft.Storage/storageAccounts",
            "apiVersion": "2016-01-01",
            "name": "[variables('storageAccountName')]",
            "location": "[parameters('location')]",
            "sku": {
                "name": "[variables('storageAccountType')]"
            },
            "kind": "Storage"
        },
        {
            "type": "Microsoft.Network/publicIPAddresses",
            "apiVersion": "2017-06-01",
            "name": "[variables('publicIPAddressName')]",
            "location": "[parameters('location')]",
            "properties": {
                "publicIPAllocationMethod": "[variables('publicIPAddressType')]",
                "dnsSettings": {
                    "domainNameLabel": "[parameters('dnsNameForJumpBox')]"
                }
            }
        },
        {
            "type": "Microsoft.Network/networkSecurityGroups",
            "apiVersion": "2019-08-01",
            "name": "[variables('networkSecurityGroupName')]",
            "location": "[parameters('location')]",
            "properties": {
                "securityRules": [
                    {
                        "name": "default-allow-22",
                        "properties": {
                            "priority": 1000,
                            "access": "Allow",
                            "direction": "Inbound",
                            "destinationPortRange": "22",
                            "protocol": "Tcp",
                            "sourceAddressPrefix": "*",
                            "sourcePortRange": "*",
                            "destinationAddressPrefix": "*"
                        }
                    }
                ]
            }
        },
        {
            "type": "Microsoft.Network/virtualNetworks",
            "apiVersion": "2017-06-01",
            "name": "[parameters('vnetName')]",
            "location": "[parameters('location')]",
            "dependsOn": [
                "[resourceId('Microsoft.Network/networkSecurityGroups', variables('networkSecurityGroupName'))]"
            ],
            "properties": {
                "addressSpace": {
                    "addressPrefixes": [
                        "[variables('addressPrefix')]"
                    ]
                },
                "subnets": [
                    {
                        "name": "[parameters('subnetName')]",
                        "properties": {
                            "addressPrefix": "[variables('subnetPrefix')]",
                            "networkSecurityGroup": {
                                "id": "[resourceId('Microsoft.Network/networkSecurityGroups', variables('networkSecurityGroupName'))]"
                            }
                        }
                    }
                ]
            }
        },
        {
            "type": "Microsoft.Network/networkInterfaces",
            "apiVersion": "2017-06-01",
            "name": "[variables('jumpboxNICName')]",
            "location": "[parameters('location')]",
            "dependsOn": [
                "[concat('Microsoft.Network/publicIPAddresses/', variables('publicIPAddressName'))]",
                "[concat('Microsoft.Network/virtualNetworks/', parameters('vnetName'))]"
            ],
            "properties": {
                "ipConfigurations": [
                    {
                        "name": "ipconfig1",
                        "properties": {
                            "privateIPAllocationMethod": "Dynamic",
                            "publicIPAddress": {
                                "id": "[resourceId('Microsoft.Network/publicIPAddresses',variables('publicIPAddressName'))]"
                            },
                            "subnet": {
                                "id": "[variables('subnetRef')]"
                            }
                        }
                    }
                ]
            }
        },
        {
            "type": "Microsoft.Compute/virtualMachines",
            "apiVersion": "2017-03-30",
            "name": "[variables('jumpboxVMName')]",
            "location": "[parameters('location')]",
            "dependsOn": [
                "[concat('Microsoft.Storage/storageAccounts/', variables('storageAccountName'))]",
                "[concat('Microsoft.Network/networkInterfaces/', variables('jumpboxNICName'))]"
            ],
            "properties": {
                "hardwareProfile": {
                    "vmSize": "[parameters('vmMasterSKU')]"
                },
                "osProfile": {
                    "computerName": "[variables('jumpboxVMName')]",
                    "adminUsername": "[parameters('adminUsername')]",
                    "adminPassword": "[parameters('adminPasswordOrKey')]",
                    "linuxConfiguration": "[if(equals(parameters('authenticationType'), 'password'), json('null'), variables('linuxConfiguration'))]"
                },
                "storageProfile": {
                    "imageReference": "[parameters('vmImageReference')]",
                    "osDisk": {
                        "createOption": "FromImage"
                    },
                    "dataDisks": [
                        {
                            "lun": 0,
                            "name": "jumpboxdatadisk",
                            "diskSizeGB": "[parameters('vmMasterDiskSize')]",
                            "caching": "None",
                            "createOption": "Empty",
                            "managedDisk": {
                                "storageAccountType": "[parameters('vmMasterDiskType')]"
                            }
                        }
                    ]
                },
                "networkProfile": {
                    "networkInterfaces": [
                        {
                            "id": "[resourceId('Microsoft.Network/networkInterfaces',variables('jumpboxNICName'))]"
                        }
                    ]
                }
            }
        },
        {
            "type": "Microsoft.Compute/virtualMachines/extensions",
            "apiVersion": "2017-03-30",
            "name": "[concat(variables('jumpboxVMName'),'/nfinit')]",
            "location": "[parameters('location')]",
            "dependsOn": [
                "[concat('Microsoft.Compute/virtualMachines/', variables('jumpboxVMName'))]"
            ],
            "properties": {
                "publisher": "Microsoft.Azure.Extensions",
                "type": "CustomScript",
                "typeHandlerVersion": "2.0",
                "autoUpgradeMinorVersion": true,
                "forceUpdateTag": "rerunnow",
                "settings": {
                    "fileUris": [
                        "[variables('nextflowInitScript')]",
                        "[variables('diskInitScript')]"
                    ]
                },
                "protectedSettings": {
                    "commandToExecute": "[concat('bash init.sh ', variables('storageAccountName'), ' ', listKeys(resourceId('Microsoft.Storage/storageAccounts', variables('storageAccountName')), '2016-01-01').keys[0].value, ' ', parameters('shareName'), ' ', parameters('mountpointPath'), ' false ', parameters('adminUsername'), ' 0 ', parameters('nextflowInstallUrl'), ' ', parameters('vmAdditionalInstallScriptUrl'), ' ', parameters('vmAdditionalInstallScriptArgument'))]"
                }
            }
        },
        {
            "type": "Microsoft.Compute/virtualMachineScaleSets",
            "apiVersion": "2017-03-30",
            "name": "[variables('vmssName')]",
            "location": "[parameters('location')]",
            "dependsOn": [
                "[concat('Microsoft.Network/virtualNetworks/', parameters('vnetName'))]",
                "[concat('Microsoft.Storage/storageAccounts/', variables('storageAccountName'))]"
            ],
            "sku": {
                "name": "[parameters('vmNodeSKU')]",
                "capacity": "[parameters('instanceCount')]"
            },
            "properties": {
                "overprovision": true,
                "upgradePolicy": {
                    "mode": "Manual"
                },
                "virtualMachineProfile": {
                    "storageProfile": {
                        "osDisk": {
                            "createOption": "FromImage",
                            "caching": "ReadWrite"
                        },
                        "imageReference": "[parameters('vmImageReference')]"
                    },
                    "osProfile": {
                        "computerNamePrefix": "[variables('vmssName')]",
                        "adminUsername": "[parameters('adminUsername')]",
                        "adminPassword": "[parameters('adminPasswordOrKey')]",
                        "linuxConfiguration": "[if(equals(parameters('authenticationType'), 'password'), json('null'), variables('linuxConfiguration'))]"
                    },
                    "networkProfile": {
                        "networkInterfaceConfigurations": [
                            {
                                "name": "nic",
                                "properties": {
                                    "primary": true,
                                    "ipConfigurations": [
                                        {
                                            "name": "ipconfig",
                                            "properties": {
                                                "subnet": {
                                                    "id": "[resourceId(resourceGroup().name, 'Microsoft.Network/virtualNetworks/subnets', parameters('vnetName'), parameters('subnetName'))]"
                                                }
                                            }
                                        }
                                    ]
                                }
                            }
                        ]
                    },
                    "extensionProfile": {
                        "extensions": [
                            {
                                "name": "filesextension",
                                "properties": {
                                    "publisher": "Microsoft.Azure.Extensions",
                                    "type": "CustomScript",
                                    "typeHandlerVersion": "2.0",
                                    "autoUpgradeMinorVersion": true,
                                    "forceUpdateTag": "rerunnow",
                                    "settings": {
                                        "fileUris": [
                                            "[variables('nextflowInitScript')]",
                                            "[variables('diskInitScript')]"
                                        ]
                                    },
                                    "protectedSettings": {
                                        "commandToExecute": "[concat('bash init.sh ', variables('storageAccountName'), ' ', listKeys(resourceId('Microsoft.Storage/storageAccounts', variables('storageAccountName')), '2016-01-01').keys[0].value, ' ', parameters('shareName'), ' ', parameters('mountpointPath'), ' true ', parameters('adminUsername'), ' ', parameters('nodeMaxCpus'), ' ', parameters('nextflowInstallUrl'), ' ', parameters('vmAdditionalInstallScriptUrl'), ' ', parameters('vmAdditionalInstallScriptArgument'))]"
                                    }
                                }
                            }
                        ]
                    }
                }
            }
        }
    ],
    "outputs": {
        "JumpboxConnectionString": {
            "type": "String",
            "value": "[concat('ssh ', parameters('adminUsername'), '@', reference(variables('publicIPAddressName')).dnsSettings.fqdn)]"
        },
        "ExampleNextflowCommand": {
            "type": "String",
            "value": "[concat('nextflow run hello -process.executor ignite -cluster.join path:', parameters('mountpointPath'), '/cifs/cluster', ' -with-timeline runtimeline.html -with-trace -cluster.maxCpus 0')]"
        },
        "ExampleNextflowCommandWithDocker": {
            "type": "String",
            "value": "[concat('nextflow run nextflow-io/rnatoy -with-docker -process.executor ignite -cluster.join path:', parameters('mountpointPath'), '/cifs/cluster', ' -with-timeline runtimeline.html -with-trace -cluster.maxCpus 0')]"
        }
    }
}

我只有一个建议，即模板的 extensionProfile 部分未按预期工作，但无法找到任何证据。

"extensionProfile": {
                        "extensions": [
                            {
                                "name": "filesextension",
                                "properties": {
                                    "publisher": "Microsoft.Azure.Extensions",
                                    "type": "CustomScript",
                                    "typeHandlerVersion": "2.0",
                                    "autoUpgradeMinorVersion": true,
                                    "forceUpdateTag": "rerunnow",
                                    "settings": {
                                        "fileUris": [
                                            "[variables('nextflowInitScript')]",
                                            "[variables('diskInitScript')]"
                                        ]
                                    },
                                    "protectedSettings": {
                                        "commandToExecute": "[concat('bash init.sh ', variables('storageAccountName'), ' ', listKeys(resourceId('Microsoft.Storage/storageAccounts', variables('storageAccountName')), '2016-01-01').keys[0].value, ' ', parameters('shareName'), ' ', parameters('mountpointPath'), ' true ', parameters('adminUsername'), ' ', parameters('nodeMaxCpus'), ' ', parameters('nextflowInstallUrl'), ' ', parameters('vmAdditionalInstallScriptUrl'), ' ', parameters('vmAdditionalInstallScriptArgument'))]"
                                    }
                                }
                            }
                        ]
                    }
                }

Answer 1

带有 sas token 的 URL 是否有效？创建 sas token 后，尝试在浏览器中下载脚本来检查它。

如果它有效，然后又不起作用 - 这可能是由于 sas token 在设定的时间段后到期。您可以在部署 vmss 后尝试记录完整的 URL。然后重试并从浏览器下载脚本。