Have a personal or library account? Click to login
Application Research of Crawler and Data Analysis Based on Python Cover

Application Research of Crawler and Data Analysis Based on Python

International Journal of Advanced Network, Monitoring and Controls
Volume 5 (2020): Issue 2 (January 2020)
By: Wu Hejing,  Liu Fang,  Zhao Long,  Shao Yabin and  Cui Ran  
Open Access
|Jul 2020

Figures & Tables

Figure 1.

Basic principles of Scrapy frame
Basic principles of Scrapy frame

Figure 2.

Investigation of HTML page structure of steam manufacturers by using viewers
Investigation of HTML page structure of steam manufacturers by using viewers

Figure 3.

List of URLs obtained by selenium and beautiful soup
List of URLs obtained by selenium and beautiful soup

Figure 4.

Executing the start request method selenium pop-up browser to crawl the dynamic page
Executing the start request method selenium pop-up browser to crawl the dynamic page

Figure 5.

Crawled data list
Crawled data list

Figure 6.

Output the publisher platform follower ranking chart
Output the publisher platform follower ranking chart
DOI: https://doi.org/10.21307/ijanmc-2020-018 | Journal eISSN: 2470-8038
Journal RSS Feed
Language: English
Page range: 64 - 70
Published on: Jul 13, 2020
Published by: Xi’an Technological University
In partnership with: Paradigm Publishing Services
Publication frequency: 4 issues per year
Keywords:
Python,
Scrapy,
Selenium,
BeautifulSoup
Related subjects:
Computer sciences,
Computer sciences, other

© 2020 Wu Hejing, Liu Fang, Zhao Long, Shao Yabin, Cui Ran, published by Xi’an Technological University
This work is licensed under the Creative Commons Attribution 4.0 License.

Previous articleVolume 5 (2020): Issue 2 (January 2020)Next article