python - App Engine 批量加载程序下载数据损坏文件

Question

我正在使用 Google App Engine，并且我当前的 Web 应用程序上有一个高复制数据存储。我正在尝试测试 AE 的批量加载器以从我的数据存储中下载“种类”。我在 CMD 中输入以下代码，以便下载输入“种类”的所有实体。

python appcfg.py download_data --kind=TestClass --url=http://bulkloader-testing.appspot.com/remote_api --filename=success.csv

The download seems to occur successfully:

Microsoft Windows [Version 6.1.7600]
Copyright (c) 2009 Microsoft Corporation.  All rights reserved.

C:\Users\Jack Frost>cd..

C:\Users>cd..

C:\>cd "Program Files (x86)"

C:\Program Files (x86)>cd "Google App Engine SDK"

C:\Program Files (x86)\Google App Engine SDK>python appcfg.py download_data  --kind=TestClass --url=http://bulkloader-testing.appspot.com/remote_api --filename=success.csv
Downloading data records.
[INFO    ] Logging to bulkloader-log-20120125.155035
[INFO    ] Throttling transfers:
[INFO    ] Bandwidth: 250000 bytes/second
[INFO    ] HTTP connections: 8/second
[INFO    ] Entities inserted/fetched/modified: 20/second
[INFO    ] Batch Size: 10
[INFO    ] Opening database: bulkloader-progress-20120125.155035.sql3
[INFO    ] Opening database: bulkloader-results-20120125.155035.sql3
[INFO    ] Connecting to bulkloader-testing.appspot.com/remote_api
[INFO    ] Downloading kinds: ['TestClass']
.[INFO    ] TestClass: No descending index on __key__, performing serial download
.
[INFO    ] Have 14 entities, 0 previously transferred
[INFO    ] 14 entities (4808 bytes) transferred in 2.3 seconds

However; when I open the .csv file on my computer it opens and is un-comprehensible (I have opened it both with excel and notepad...Any ideas as to what I am doing wrong? Below is what the output looks like:

SQLite format 3 @
ü Õ fÏÕ GGtablebulkloader_database_signaturebulkloader_database_signatureCREATE TABLE bulkloader_database_signature ( value TEXT not null)g)tableresultresultCREATE TABLE result ( id BLOB primary key, value BLOB not null, sort_key BLOB)+? indexsqlite_autoindex_result_1result ö ûö „ ML‚\ :TestClass 00000000000000001003j(js~bulkloader-testingr TestClassërid *Ò…ØÌrmobile * 9786978770rname *Bulkloader Test‚ TestClassëŠ! GAEGamer@gmail.com gmail.com )L‚ :TestClass 00000000000000001002j(js~bulkloader-testingr TestClassêrid *Ò…ØÌrmobile * 9786978770rname *Bulkloader Test‚ TestClassê)L‚ :TestClass 00000000000000001001j(js~bulkloader-testingr TestClassérid *Ò…ØÌrmobile * 9786978770rname *Bulkloader Test‚ TestClassé'L‚ :TestClass 00000000000000000002j'js~bulkloader-testingr TestClassrid *Ò…ØÌrmobile * 9786978770rname *Bulkloader Test‚ TestClass'L‚ :TestClass 00000000000000000001j'js~bulkloader-testingr TestClassrid *Ò…ØÌrmobile * 9786978770rname *Bulkloader Test‚ Te

ú Û¶‘lG"ýسŽiDú $L:TestClass 00000000000000006001$L:TestClass 00000000000000005001$L:测试类 00000000000000004001$L:测试类 00000000000000003003$L:测试类 00000000000000003002$L:测试类 00000000000000003001 $L:测试类 00000000000000002003$L:测试类 00000000000000002002$L:测试类 00000000000000002001$L:测试类 000000000000 00001003$L:测试类 00000000000000001002$L:测试类 00000000000000001001$L:测试类 00000000000000000002$L:测试类 00000000000000000001 {f} app_id: s~bulkloader-测试 网址:http://bulkloader-testing.appspot.com/remote_api 种类:测试类 下载:错误 map :错误 转储:真实 恢复:假 Progress_db:bulkloader-progress-20120125.155035.sql3 has_header:假

„ V¬ T „ ML‚\ :TestClass 00000000000000001003j(js~bulkloader-testingr TestClassërid *Ò…ØÌrmobile * 9786978770rname *Bulkloader Test‚ TestClassëŠ! GAEGamer@gmail.com gmail.com )L‚ :TestClass 00000000000000001002j(js~bulkloader-testingr TestClassêrid *Ò…ØÌrmobile * 9786978770rname *Bulkloader Test‚ TestClassê)L‚ :TestClass 00000000000000001001j(js~bulkloader-testingr TestClassérid *Ò…ØÌrmobile * 9786978770rname *Bulkloader Test‚ TestClassé'L‚ :TestClass 00000000000000000002j'js~bulkloader-testingr TestClassrid *Ò…ØÌrmobile * 9786978770rname *Bulkloader Test‚ TestClass'L‚ :TestClass 00000000000000000001j'js~bulkloader-testingr TestClassrid *Ò…ØÌrmobile * 9786978770rname *Bulkloader Test‚ TestClass ¤ T¨üP ¤ ) L‚ :TestClass 00000000000000003002j(js~bulkloader-testingr TestClassºrid *Ò…ØÌrmobile * 9786978770rname *Bulkloader Test‚ TestClassº) L‚ :TestClass 00000000000000003001j(js~bulkloader-testingr TestClass¹rid *Ò…ØÌrmobile * 9786978770rname *Bulkloader Test‚ TestClass¹)L‚ :TestClass 00000000000000002003j(js~bulkloader-testingr TestClassÓrid *Ò…ØÌrmobile * 9786978770rname *Bulkloader Test‚ TestClassÓ)L‚ :TestClass 00000000000000002002j(js~bulkloader-testingr TestClassÒrid *Ò…ØÌrmobile * 9786978770rname *Bulkloader Test‚ TestClassÒ)L‚ :TestClass 00000000000000002001j(js~bulkloader-testingr TestClassÑrid *Ò…ØÌrmobile * 9786978770rname *Bulkloader Test‚ TestClassÑ P T¨üP )L‚ :TestClass 00000000000000006001j(js~bulkloader-testingr TestClassñ.rid *Ò…ØÌrmobile * 9786978770rname *Bulkloader Test‚ TestClassñ.) L‚ :TestClass 00000000000000005001j(js~bulkloader-testingr TestClass‰'rid *Ò…ØÌrmobile * 9786978770rname *Bulkloader Test‚ TestClass‰')L‚ :TestClass 00000000000000004001j(js~bulkloader-testingr TestClass¡rid *Ò…ØÌrmobile * 9786978770rname *Bulkloader Test‚ TestClass¡)L‚ :TestClass 00000000000000003003j(js~bulkloader-testingr TestClass»rid *Ò…ØÌrmobile * 9786978770rname *Bulkloader Test‚ TestClass»

UPDATE: I assume the reason is because this is an SQLLite format and hence may not be a true CSV. I will check tomorrow when I come into work and update again...

Answer 1

批量下载器正在下载到 SQLite，而不是 CSV。如果您想要 CSV，则必须创建并配置bulkloader.yaml:http://code.google.com/appengine/docs/python/tools/uploadingdata.html#Editing_the_Configuration_File

在文件名中指定 csv 是不够的。