javascript - JS : Convert URL into its simplest form

Question

我正在构建一个 NodeJS 应用程序，可以将 URL 存储在数据库中。我想使用 URL 作为主键，以避免存储重复项。为了做到这一点，我需要 url 尽可能采用最简单的形式，删除多余的斜杠、参数和前缀。

如何将下面列出的所有 URL 转换为与列出的第一个 URL 相同的字符串？有没有一种方法可以安全地做到这一点，以解释我可能没有在下面列出的其他变化？

website.com/coolpage/938921

https://website.com/coolpage/938921/

https://www.website.com/coolpage/938921/

http://website.com/coolpage/938921/

https://website.com/coolpage/938921/

https://website.com/coolpage/938921/?awesome=1

https://website.com/coolpage/938921?awesome=1

https:///website.com//coolpage//938921//

Answer 1

使用标准 Node.js url模块。

解决方案:

require('url');

function getBaseUrl(url){
    const u = new URL(url);
    const result =`${u.host}${u.pathname}`
        .split('//').join('/')
        .replace('www.', '');

    // cut off the trailing '/' character from the result
    if (result.length && result[result.length - 1] === '/')
        return result.substring(0, result.length - 1)

    return result;
}

测试:

const urls = [
    "https://website.com/coolpage/938921/",
    "https://www.website.com/coolpage/938921/",
    "http://website.com/coolpage/938921/",
    "https://website.com/coolpage/938921/",
    "https://website.com/coolpage/938921/?awesome=1",
    "https://website.com/coolpage/938921?awesome=1",
    "https:///website.com//coolpage//938921//"
    ];

for (let i = 0; i < urls.length; i++) {
    const u = getBaseUrl(urls[i]);
    console.log(`${i}: ${u}`);
}

控制台输出:

0: website.com/coolpage/9389211: website.com/coolpage/9389212: website.com/coolpage/9389213: website.com/coolpage/9389214: website.com/coolpage/9389215: website.com/coolpage/9389216: website.com/coolpage/938921

Live example on runkit.com