sqlite - 是否可以从 SQLite 查询 Parquet 文件？

Question

是否可以使用 SQLite 查询 Parquet 文件？

CREATE TABLE test USING parquet('test.parquet');

SELECT * from test;

Answer 1

先使用Pandas导入数据!

import pandas as pd 
import sqlite3

parquet_path = 'my-data.parquet'
table_name = 'my_data_table'
query = f"SELECT * from {table_name}"

db_conn = sqlite3.connect(database='/tmp/my.db')

df_parquet = pd.read_parquet(parquet_path)
num_rows_inserted = df_parquet.to_sql(table_name, db_conn, index=False)

cursor = db_conn.execute(query)