Home>

javascript - i want to scrape with gas

Reference site: https://www.kutil.org/2016/01/easy-data-scrapping-with-google-apps.html
I am practicing scraping.

Based on the reference site, I tried scraping under the following conditions.

-Products sold at Yahoo Auctions with a price of 5,000 yen or more
・ Get the product name, URL, and price

When scraped was executed to actually get the URL, for some reason, only Yahoo auction HTML information was included. .
I don't know what's wrong.
Is it hard to know more? .

function getData () {
    var url = "https://auctions.yahoo.co.jp/closedsearch/closedsearch?min=5000&max=&auccat=23176&b=1&n=20";
    var fromText = '
javascript
  • Answer # 1 

    function yahooData () {
var html = UrlFetchApp.fetch ('https://auctions.yahoo.co.jp/category/list/23176/?auccat=23176&aucminprice=3000&exflg=1&b=1&n=100&mode=1&isdd=0&isdr=0&rewrite_category=0&rewrite_ok_by_word=0') .getContentText ();
var doc = Parser.data (html)
.from ('')
.to ('')
.build ()
var url = Parser.data (doc)
.from ('")
.iterate ()
Logger.log (url);
}

    * The URL has been changed from the winning bid price to the exhibition price.

Related articles