Have a personal or library account? Click to login
Application Research of Crawler and Data Analysis Based on Python Cover

Application Research of Crawler and Data Analysis Based on Python

International Journal of Advanced Network, Monitoring and Controls
Volume 5 (2022): Issue 2 (January 2022)
By:
Open Access
|Jul 2020

Figures & Tables

Figure 1.

Basic principles of Scrapy frame
Basic principles of Scrapy frame

Figure 2.

Investigation of HTML page structure of steam manufacturers by using viewers
Investigation of HTML page structure of steam manufacturers by using viewers

Figure 3.

List of URLs obtained by selenium and beautiful soup
List of URLs obtained by selenium and beautiful soup

Figure 4.

Executing the start request method selenium pop-up browser to crawl the dynamic page
Executing the start request method selenium pop-up browser to crawl the dynamic page

Figure 5.

Crawled data list
Crawled data list

Figure 6.

Output the publisher platform follower ranking chart
Output the publisher platform follower ranking chart
DOI: https://doi.org/10.21307/ijanmc-2020-018 | Journal eISSN: 2470-8038
Journal RSS Feed
Language: English
Page range: 64 - 70
Published on: Jul 13, 2020
Published by: Sciendo
In partnership with: Paradigm Publishing Services
Publication frequency: 4 times per year
Keywords:
Python,
Scrapy,
Selenium,
BeautifulSoup
Related subjects:
Computer sciences,
Computer sciences, other

© 2020 Wu Hejing, Liu Fang, Zhao Long, Shao Yabin, Cui Ran, published by Sciendo
This work is licensed under the Creative Commons Attribution 4.0 License.

Previous articleVolume 5 (2022): Issue 2 (January 2022)Next article