假设页面不是用javascript呈现的，scrappy将是一个很好的工具。
我建议阅读安装文档和教程，以大致了解它是如何工作的，从哪里开始以及如何开始一个新项目。
下面是蜘蛛的一个示例：

import scrapy

class MySpider(scrapy.Spider):

    name = "myspider"
    start_urls = ["https://example.com/homepage"]

    def parse(self, response):
        for players_name in response.xpath_or_css_selector(some_selector_path_to_url).getall():
            yield scrapy.Request(url, callback=self.parse_player)

    def parse_player(self, response):
        # scrape the player data into a dictionary and then yield it as an item
        yield {player: data}

Installation docs
Scrapy Tutorial