web-scraping - 错误: Page crashed! at Page._onTargetCrashed PUPPETEER

Question

即使通过catch处理并使用page.on(error)，我也遇到页面崩溃错误。请帮助我解决此错误。

  // open the headless browser
  var browser = await puppeteer.launch({ headless: true, args: ['--disable-gpu','--disable-dev-shm-usage', '--no-sandbox', '--disable-setuid-sandbox'] });
  // Open a new page
  var page = await browser.newPage();
  var hsURL =highschoolURL.concat(hsList[i].trim()).concat("/academics");
  await page.setDefaultNavigationTimeout(0);
  page.on('error', err=> {
    console.log('error happen at the page: ', err);
  });

  page.on('pageerror', pageerr=> {
    console.log('pageerror occurred: ', pageerr);
  })
  await page.goto(hsURL, {waitUntil : 'networkidle2'}).catch(e => console.error(e));

Answer 1

默认的setDefaultNavigationTimeout为3000(3秒)。您不应将setDefaultNavigationTimeout设置为0。只需将setDefaultNavigationTimeout设置为等待页面即可。setDefaultNavigationTimeout(3000); 或删除该句子