Mongodb 索引错误 "text contains invalid UTF-8"

Question

Whenever am trying to index an collection I get the following error> db.visits.ensureIndex({rawdata:"text"}){        "ok" : 0,        "errmsg" : "text contains invalid UTF-8",        "code" : 28755,        "codeName" : "Location28755"}>The rawdata contain Email:Time:UrlAm using Mongo / WindowsThe data were inserted using mongoimport from 2 tsv filesWhen I imported the 1st file alone in new collection , indexing was done normallyThe second file in new collection raised up the problem again while indexing itBut honestly I can't find the wrong lineBoth file contain around +50 million linesAny help would be appreciated

Answer 1

我通过使用 010 编辑器将非 UTF-8 字符串转换为 UTF 格式解决了这个问题如果有人有更好的解决方案，将受到欢迎