Javascript charAt() 打破多字节字符串

Question

此代码与 nodejs v0.10.21 不兼容

#!/usr/bin/env node
"use strict";

var urlEncoded = 'http://zh.wikipedia.org/wiki/%F0%A8%A8%8F';
var urlDecoded = decodeURI( urlEncoded );
var urlLeafEncoded = urlEncoded.substr( 29 );
var urlLeafDecoded = decodeURIComponent( urlLeafEncoded );
var urlLeafFirstCharacterDecoded = urlLeafDecoded.charAt( 0 );
var urlLeafFirstCharacterEncoded = encodeURIComponent( urlLeafFirstCharacterDecoded );

console.log( 'URL encoded = ' + urlEncoded );
console.log( 'URL decoded = ' + urlDecoded );
console.log( 'URL leaf encoded = ' + urlLeafEncoded );
console.log( 'URL leaf decoded = ' + urlLeafDecoded );
console.log( 'URL leaf first character encoded = ' + urlLeafEncoded );
console.log( 'URL leaf first character decoded = ' + urlLeafDecoded );

出现以下错误

var urlLeafFirstCharacterEncoded = encodeURIComponent( urlLeafFirstCharacterDe
                               ^
URIError: URI malformed
    at encodeURIComponent (native)
    at Object.<anonymous> (/media/data/tmp/mwoffliner/test.js:9:36)
    at Module._compile (module.js:456:26)
    at Object.Module._extensions..js (module.js:474:10)
    at Module.load (module.js:356:32)
    at Function.Module._load (module.js:312:12)
    at Function.Module.runMain (module.js:497:10)
    at startup (node.js:119:16)
    at node.js:901:3

Javascript 过去常常正确处理多字节字符，但在那种情况下却不行。看起来虽然“%F0%A8%A8%8F”代表一个汉字，javascript却认为是两个汉字。我很困惑这是否是 javascript 运行时中的错误、某种编码问题或我这边的误解。

Answer 1

𨨏位于 BMP 之外，并且由于 Javascript 仅使用 2 个字节来存储字符，因此表示为 surrogate pair .虽然 encodeURIComponent 可以对代理项对进行操作并为它们生成正确的 UTF8 编码，但它不能单独读取代理项。因此，虽然 encodeURIComponent("𨨏") 工作正常，但 encodeURIComponent("𨨏".charAt(0)) 会失败。

参见 http://mathiasbynens.be/notes/javascript-encoding更多细节。另外，https://developer.mozilla.org/en-US/docs/Web/JavaScript/Reference/Global_Objects/encodeURIComponent专门记录此用例。