
Figure 1.
Basic principles of Scrapy frame

Figure 2.
Investigation of HTML page structure of steam manufacturers by using viewers

Figure 3.
List of URLs obtained by selenium and beautiful soup

Figure 4.
Executing the start request method selenium pop-up browser to crawl the dynamic page

Figure 5.
Crawled data list

Figure 6.
Output the publisher platform follower ranking chart