gpt4 book ai didi

java - 使用 Java 从 Google Storage 下载文件

转载 作者:搜寻专家 更新时间:2023-10-30 21:32:45 25 4
gpt4 key购买 nike

我已经成功地自动化了将数据从 Google Big Query 移动到 Google Storage 的过程。现在我还需要以自动方式将数据从 Google Storage 下载到我的环境中。

我正在尝试执行普通的 HTTP 请求,但之前已授权。所以我的 HTTP 请求是

    HttpRequestFactory requestFactory = HTTP_TRANSPORT.createRequestFactory(authorize());
GenericUrl url = new GenericUrl(uri);
HttpRequest request = requestFactory.buildGetRequest(url);
HttpResponse response = request.execute();
String content = response.parseAsString();

我的授权码是

/** Authorizes the installed application to access user's protected data. */
private static Credential authorize() throws Exception
{
HttpTransport httpTransport = new NetHttpTransport();
JsonFactory jsonFactory = new JacksonFactory();

// load client secrets
GoogleClientSecrets clientSecrets = GoogleClientSecrets.load(JSON_FACTORY,
new InputStreamReader(BigQueryConsumer.class.getResourceAsStream("/secret.json")));

// This creates the credentials datastore at ~/.oauth-credentials/${credentialDatastore}
FileDataStoreFactory fileDataStoreFactory = new FileDataStoreFactory(new File(System.getProperty("user.home") + "/" + CREDENTIALS_DIRECTORY));

// set up authorization code flow
GoogleAuthorizationCodeFlow flow = new GoogleAuthorizationCodeFlow.Builder(
httpTransport, JSON_FACTORY, clientSecrets,
SCOPES).setDataStoreFactory(fileDataStoreFactory)
.build();
// authorize
return new AuthorizationCodeInstalledApp(flow, new LocalServerReceiver()).authorize("user");
}

下面的常量在哪里

  1. CREDENTIALS_DIRECTORY:“.oauth-credentials”
  2. JSON_FACTORY : JacksonFactory.getDefaultInstance()
  3. SCOPES:一个字符串列表,只有“https://www.googleapis.com/auth/devstorage.full_control
  4. HTTP_TRANSPORT : 新的 NetHttpTransport()

我在身份验证/授权过程中遗漏了什么?我得到了

    Exception in thread "main" com.google.api.client.http.HttpResponseException: 401 Unauthorized
<HTML>
<HEAD>
<TITLE>Unauthorized</TITLE>
</HEAD>
<BODY BGCOLOR="#FFFFFF" TEXT="#000000">
<H1>Unauthorized</H1>
<H2>Error 401</H2>
</BODY>
</HTML>

最佳答案

对于其他寻找答案的人。您需要执行几个步骤才能使用应用程序默认凭据...您可以执行以下步骤,或查看此 link .

  1. 首要任务:安装谷歌云存储 SDK
  2. 确保您可以从 SDK 运行命令。如果您没有安装 python,则需要安装 python 2.7 或更高版本,以及 pyopenssl...
  3. 您需要在 SDK 中通过运行gcloud auth activate-service-account [服务账户邮箱] --key-file [.p12 文件](编辑方括号中的值)。当你运行它时,你应该会收到一条消息,告诉你你已经激活了你的服务帐户
  4. 您需要通过设置从 SDK 设置环境变量GOOGLE_APPLICATION_CREDENTIALS 到 secret 的 JSON 路径(从开发人员控制台创建的服务帐户下载的那个)CLOUDSDK_PYTHON_SITEPACKAGES 为 1,同时设置项目

配置系统变量的命令...

set GOOGLE_APPLICATION_CREDENTIALS "secret.json path"set CLOUDSDK_PYTHON_SITEPACKAGES 1gcloud config set project "your project name"

在您验证并授权自己之后,您就可以开始使用应用程序的默认凭据,前提是您已经正确设置了您的环境。

当您成功设置您的环境后,您可以通过以下方式进行身份验证并获取默认凭据

        GoogleCredential credential = GoogleCredential.getApplicationDefault();        if (credential.createScopedRequired()) {            credential = credential.createScoped(StorageScopes.all());        }        HttpTransport httpTransport = GoogleNetHttpTransport.newTrustedTransport();        storageService = new Storage.Builder(httpTransport, jsonFactory, credential)                .setApplicationName(applicationName).build();

并使用 HTTP GET 从您的 Google 存储桶中获取对象,即类似于以下内容

// Set up and execute a Google Cloud Storage request.                String uri = "https://storage.googleapis.com/" + URLEncoder.encode("[your bucket name here]", "UTF-8") + "/" + googleStorageFileName + "/" + fileName;                httpTransport = GoogleNetHttpTransport.newTrustedTransport();                HttpRequestFactory requestFactory = httpTransport.createRequestFactory(                        credential);                GenericUrl url = new GenericUrl(uri);                HttpRequest request = requestFactory.buildGetRequest(url);                HttpResponse response = request.execute();                String content = response.parseAsString();                BufferedWriter writer = new BufferedWriter( new FileWriter( pathToSave + googleStorageFileName));                writer.write( content);

关于java - 使用 Java 从 Google Storage 下载文件,我们在Stack Overflow上找到一个类似的问题: https://stackoverflow.com/questions/33175993/

25 4 0
Copyright 2021 - 2024 cfsdn All Rights Reserved 蜀ICP备2022000587号
广告合作:1813099741@qq.com 6ren.com