Home>

Nice to learn scraping recently.
Code obtained by BeautifulSoupandcode verified by Googlemay be different. Why is it different from verification?

  • Answer # 1

    Is it Chrome verification?

    What can be considered

    Chrome completes tags (such as tbody)

    Dynamically rewrite tags with jQuery, Javascript, etc.

    I think

    .

    For

    1, you can see the source before it is complemented by displaying the source.
    If it is a browser source, tag rewriting is executed by jQuery or Javascript of 2 and so it may be different from beautifulsoup.

    About completion
    Differences between browsers in web browser HTML completion

    2 can be scraped after executing Javascript with Selenium and puppeteer.
    In the case of tag rewriting, please check the source because it is rewritten with Javascript after the target tag