oracle - 自动将数据从 Oracle DB 加载到 Google BigQuery

Question

再会，

我有一个 Oracle 数据库，我需要加载一些表，以便我可以在 BigQuery 中查询它们。

¿有没有办法每 24 小时自动将数据加载到 Google BigQuery？

任何方式都行。它可以加载到数据存储并从那里创建表，或者从服务器加载到谷歌驱动器。

我真的需要一些想法，我读了很多文章都没有运气。

Answer 1

按进度检查本教程:

https://www.progress.com/tutorials/cloud-and-hybrid/etl-on-premises-oracle-data-to-google-bigquery-using-google-cloud-dataflow

In this tutorial the main goal will be to connect to an On-Premises Oracle database, read the data, apply a simple transformation and write it to BigQuery. The code for this project has been uploaded to GitHub for your reference.

此解决方案使用 Dataflow and Progress 的混合数据管道工具:

Google Cloud Dataflow is a data processing service for both batch and real-time data streams. Dataflow allows you to build pipes to ingest data, then transform and process according to your needs before making that data available to analysis tools. DataDirect Hybrid Data Pipeline can be used to ingest both on-premises and cloud data with Google Cloud Dataflow.