如何使用Web scraper动态生成JavaScript数据[重复]

Question

This question already has an answer here:

• Scrape web page data generated by javascript 2 answers

The data from most webpages can be scraped by simply downloading the HTML and then parsing out the desired content. However some webpages load their content dynamically with JavaScript after the page loads so that the desired data is not found in the original HTML.

Please help me how I can get dynamically generated JavaScript data using web scraper.

</div>

Answer 1

You can use Web Developer Add-on for Firefox. Select View Source -> View generated source after the page finishes loading and you will get the contacts in HTML in a new window. You can then proceed with any parser you are currently using.