**更新：**尝试了Driftr 95的脚本..在google-colab -并得到了一些问题-脚本失败-并不成功- queston.在脚本的开始，我注意到有些行是推荐出来.为什么会这样.我会尝试调查更多-同时感谢很多..-.真棒.

两个想法浮现在脑海中a.结果页面的整个站点包含更多的数据：见
查看一页（共700页）的结果：
数字创新中心：4PDIH -公私合作数字创新中心
https://s3platform.jrc.ec.europa.eu/digital-innovation-hubs-tool/-/dih/17265/view?_eu_europa_ec_jrc_dih_web_DihWebPortlet_backUrl=%2Fdigital-innovation-hubs-tool
具有以下类别的数据集：

Hub Information
Description
Contact Data
Organisation
Technologies
Market and Services
Service Examples
Funding
Customers
Partners

第二个想法：使用awesme-scripts：

NameError("name 'pd' is not defined") from https://s3platform.jrc.ec.europa.eu/digital-innovation-hubs-tool?_eu_europa_ec_jrc_dih_web_DihWebPortlet_cur=1
---------------------------------------------------------------------------
NameError                                 Traceback (most recent call last)
<ipython-input-3-c1f39e3c2547> in <module>
     11 
     12 # pd.concat(dfList).to_csv(output_fp, index=False) ## save without page numbers
---> 13 df=pd.concat(dfList, keys=list(range(1,len(dfList)+1)),names=['from_pg','pgi'])
     14 df.reset_index().drop('pgi',axis='columns').to_csv(output_fp, index=False)

NameError: name 'pd' is not defined

除此之外在下一次庭审中

NameError                                 Traceback (most recent call last)
<ipython-input-5-538670405002> in <module>
      1 # df = pd.concat(dfList.....
----> 2 orig_cols = list(df.columns)
      3 for ocn in orig_cols:
      4     if any(vals:=[cv for cv,*_ in df[ocn]]): df[ocn[0]] = vals
      5     if any(links:=[c[1] for c in df[ocn]]): df[ocn[0].split()[0]+' Links'] = links

NameError: name 'df' is not defined

下一条线索

NameError                                 Traceback (most recent call last)
<ipython-input-1-4a00208c3fe6> in <module>
     10     pg_num += 1
     11     if isinstance(max_pg, int) and pg_num>max_pg: break
---> 12     pgSoup = BeautifulSoup((pgReq:=requests.get(next_link)).content, 'lxml')
     13     rows = pgSoup.select('tr:has(td[data-ecl-table-header])')
     14     all_rows += [{'from_pg': pg_num, **get_row_dict(r)} for r in rows]

NameError: name 'BeautifulSoup' is not defined

更新结束：

完整的故事：

我目前正在尝试学习Beautiful Soup（BS 4），从获取数据开始。
与刮刀，应该与美丽的汤和刮this页面的数据集，并把数据转换为csv格式或使用Pandas。如果我在谷歌colab运行这个-我面临着一些奇怪的问题。见下文：

import requests
from bs4 import BeautifulSoup
import pandas as pd

# Make a request to the webpage
url = 'https://s3platform.jrc.ec.europa.eu/digital-innovation-hubs-tool'
response = requests.get(url)

# Parse the HTML content with Beautiful Soup
soup = BeautifulSoup(response.content, 'html.parser')

# Find the table with the data
table = soup.find('table')

# Extract the table headers
headers = []
for th in table.find_all('th'):
    headers.append(th.text.strip())

# Extract the table rows
rows = []
for tr in table.find_all('tr')[1:]:
    row = []
    for td in tr.find_all('td'):
        row.append(td.text.strip())
    rows.append(row)

# Find the total number of pages
num_pages = soup.find('input', {'id': 'paginationPagesNum'})['value']

# Loop through each page and extract the data
for page in range(2, int(num_pages) + 1):
    # Make a request to the next page
    page_url = f'{url}?page={page}'
    page_response = requests.get(page_url)

    # Parse the HTML content with Beautiful Soup
    page_soup = BeautifulSoup(page_response.content, 'html.parser')

    # Find the table with the data
    page_table = page_soup.find('table')

    # Extract the table rows
    for tr in page_table.find_all('tr')[1:]:
        row = []
        for td in tr.find_all('td'):
            row.append(td.text.strip())
        rows.append(row)

# Create a Pandas DataFrame with the data
df = pd.DataFrame(rows, columns=headers)

# Save the DataFrame to a CSV file
df.to_csv('digital-innovation-hubs.csv', index=False)

看看我得到了什么-如果我在Google-Colab中运行此操作

---------------------------------------------------------------------------
TypeError                                 Traceback (most recent call last)
<ipython-input-1-f87e37f02fde> in <module>
     27 
     28 # Find the total number of pages
---> 29 num_pages = soup.find('input', {'id': 'paginationPagesNum'})['value']
     30 
     31 # Loop through each page and extract the data

TypeError: 'NoneType' object is not subscriptable

更新：看看有什么回来：

由于riley.johnson3的帮助，我发现分页 Package 器应该被修复。

• 非常感谢您的快速帮助和解释-已经收集了一组数据-这是一个样本。现在必须找出如何获得完整的数据集。所有的700条记录-所有的数据.. -猜猜我们都在那里。-再次感谢您的杰出帮助。这是伟大的...和赞赏了很多...;）