logo
down
shadow

Looping through page links puppeteer doesn't return values from the newly loaded page


Looping through page links puppeteer doesn't return values from the newly loaded page

By : user3099738
Date : January 11 2021, 03:34 PM


Share : facebook icon twitter icon
puppeteer newly loaded page after the form submit

puppeteer newly loaded page after the form submit


By : Niv Bonder
Date : March 29 2020, 07:55 AM
With these it helps I've got it working by waiting for the page to load first. Then I was able to click the correct element.
So I've added the following line:
code :
await page.waitForNavigation();
await page.click(".show-filters");
Looping inside a page.evaluate in Puppeteer

Looping inside a page.evaluate in Puppeteer


By : wangwenbin
Date : March 29 2020, 07:55 AM
To fix the issue you can do I have a loop inside a page.evaluate method. The loop iterates a query selector which catches an innerText from multiple instances of a text element in a page. , Try:
code :
const serpDesc = await page.evaluate(
  () => [...document.querySelectorAll(`#rso > div:nth-child(4) > div > div:nth-child(${i}) > div > div > div.s > div > span`)].map(elem => elem.innerText)
);
async function elSelector(i) {
            //Where i is the incremented value you pass
            
            await page.evaluate((i) => {
            
                let eval = $('yourSelector').toArray();
                $(eval[i]).innerText
            }, i)

        }
        
for (i=0; i<9; i++) {
  elSelector(i);
  }
Get title from newly opened page puppeteer

Get title from newly opened page puppeteer


By : niakb01
Date : March 29 2020, 07:55 AM
help you fix your problem According to the Puppeteer Documentation:
page.title() returns: <Promise<string>> Returns page's title.
code :
page._frameManager._mainFrame.evaluate(() => document.title)
puppeteer how to return page.on response values

puppeteer how to return page.on response values


By : Nejc Kotnik
Date : March 29 2020, 07:55 AM
it helps some times You shouldn't use the await operator before page.on().
The Puppeteer page class extends Node.js's native EventEmitter, which means that whenever you call page.on(), you are setting up an event listener using Node.js's emitter.on().
code :
const example_function = value => {
  console.log(value);
};

page.on('response', resp => {
  var header = resp.headers();
  example_function(header['content-disposition']);
});
Puppeteer get information about page loaded - list of files loaded and their sizes

Puppeteer get information about page loaded - list of files loaded and their sizes


By : HGDevelop
Date : March 29 2020, 07:55 AM
I wish this help you Page assets are not stored on disk, they are held in browser memory and sometimes cached, so it's impossible to know their sizes.
What you want to look at is web scraping, which can be done with modules like node-website-scraper or with puppeteer :
code :
page.on('response', async (response) => {
    const url = new URL(response.url());
    let filePath = path.resolve(`./output${url.pathname}`);
    if (path.extname(url.pathname).trim() === '') {
      filePath = `${filePath}/index.html`;
    }
    await fs_extra.outputFile(filePath, await response.buffer());
  });
Related Posts Related Posts :
  • redux how to use state
  • All data in the db is lost when closing a express based node js server
  • How to convert javascript code for Angular
  • XPath select on child nodes
  • Idle event on mouse move - how to stop script permanently on mouse move
  • Why do I get logic is not defined in this code
  • When I enter a number in the input, the first function starts
  • ES6 imports and node_modules hell
  • How to get css selector of clicked-on element?
  • How to auto input MySQL data (input column 1 data to auto input column 2 data with same column) in php?
  • Appending to Datalist Via Javascript
  • Customizing Material-UI Components with Styled-Components
  • Populate elements with class name using Javascript
  • How to execute promises in batches (first resolving 10, then next 10 and so on)
  • Maximo JS automation script: "importPackage" is not defined
  • How to surround selected text inside textarea with <em> on key combination CTRL+i?
  • Your configured registry does not support audit requests ~ On npm audit
  • What's the Angular equivalent of Vue <slot/>?
  • Iconify icon not updating when "data-icon" set with setAttribute()
  • Javascript newbie stuck with XMLHttpRequest return data
  • How to add obj to to state in my example Redux React
  • Loading "grunt-karma.js" tasks...ERROR >> SyntaxError: Unexpected identifier
  • Why do I get log is not defined
  • get the multiple index of the same string
  • How can I iterate over an Array object by using For IN or FOR OF
  • Launch local executable from web browser
  • How to prepare array of json objects to d3 hierarchical tree structure
  • VueJS - event emitted - show HTML before other calculations
  • Export SASS/SCSS variables to Javascript without exporting them to CSS
  • How to attach an event handler only once continuously
  • How to make button open a link in new tab in JavaScript?
  • Find range from the javascript object
  • How can I use my jQuery code as JavaScript?
  • How to show 5 images in a 2 row slider with bxslider
  • How to convert stream into variables in typescript
  • Three.js custom shader error on Chrome GL_INVALID_OPERATION: Active draw buffers with missing fragment shader outputs
  • My JavaScript doesn't work. How can I solve this problem?
  • Why is this async function is running synchronously?
  • Get updated variable from within react hook before return
  • I want to show all image preview but whenever I upload a new one the old one is gone
  • Would I be able to give access to specific electron APIs safely?
  • Why several clicks fire for each instance of a Class?
  • cant grab value from div using attr()
  • Instantiate subclass without constructing
  • Outputing a created object in javascript to a server side JSON file
  • Transition the numeric labels in a bar chart
  • createBottomTabNavigator: hide just one tab from the tabBar
  • iife vs simple statement behavior with document.title
  • showDialogPopup Refresh Page after Click
  • Child component does not set the initial value passed from the parent: ReactJS
  • Nodejs javascript added to button not responding
  • Trying to define a promise.all
  • Python GEE to extract featurecollection timeseries from Landsat imageries
  • How to write negative binary number?
  • Unable to set property of individual object
  • Why Named Function Expression itself cannot assign Name to another Value?
  • How to reset scroll position on single page pagination
  • How to scroll to bottom of page, when a new message is sent - Socket.io
  • How to reconstruct audio blob from a base64 encoded String?
  • How to calculate numbers within an array of objects
  • shadow
    Privacy Policy - Terms - Contact Us © festivalmusicasacra.org