amazon-web-services - 通过 Lambda 函数触发 AWS Glue 工作流

Question

我是 AWS GLUE 的新手，并尝试使用 Lambda 函数触发 Glue 工作流程。

我正在使用属性 boto3.client('glue')但我收到一条错误消息:

Glue' object has no attribute start_workflow_run

这是我试图运行的一段代码:

import json
import boto3
def lambda_handler(event, context):
client = boto3.client('glue')
client.start_workflow_run(Name = 'Workflow_New', Arguments = {})

有没有其他方法可以实现我想要做的事情？

Answer 1

请参阅此 SO，了解如何从 lambda 调用 AWS Glue，以及代码片段。

How to Trigger Glue ETL Pyspark job through S3 Events or AWS Lambda?

import boto3
print('Loading function')

def lambda_handler(event, context):
    source_bucket = event['Records'][0]['s3']['bucket']['name']
    s3 = boto3.client('s3')
    glue = boto3.client('glue')
    gluejobname = "YOUR GLUE JOB NAME"

    try:
        runId = glue.start_job_run(JobName=gluejobname)
        status = glue.get_job_run(JobName=gluejobname, RunId=runId['JobRunId'])
        print("Job Status : ", status['JobRun']['JobRunState'])
    except Exception as e:
        print(e)
        print('Error getting object {} from bucket {}. Make sure they exist '
              'and your bucket is in the same region as this '
              'function.'.format(source_bucket, source_bucket))
    raise e

谢谢

尤瓦