python 抓取显示可用和已预订时隙的动态表时出现问题

2izufjch 于 2023-01-24 发布在 Python

关注(0)|答案(1)|浏览(164)

我想刮下面的网站：https://padelbox.de/koeln-weiden/padelplatz-buchen。我想每天刮规划工具，看看哪些插槽被预订，哪些没有。但是，使用下面的代码，一个错误代码表明值没有找到。有人能帮助我吗？

from selenium import webdriver
from selenium.webdriver.common.by import By
from selenium.webdriver.support.ui import WebDriverWait
from selenium.webdriver.support import expected_conditions as ec
import requests
import time

website = 'https://padelbox.de/koeln-weiden/padelplatz-buchen'
path = '/Users/joeplamers/Downloads/chromedriver_mac_arm64/chromedriver'

# Initialize the webdriver
driver = webdriver.Chrome(path)
# Open the website
driver.get(website)

#close the cookie pop-up and maximize window
all_matches_button = driver.find_element(By.XPATH, '//a[@class="_brlbs-btn _brlbs-btn-accept-    all _brlbs-cursor"]')
all_matches_button.click()
driver.maximize_window()

wait = WebDriverWait(driver, 60)
wait.until(ec.presence_of_element_located((By.CSS_SELECTOR,'[data-state="booked"]')))
booked_elements = driver.find_elements(By.CSS_SELECTOR,'[data-state="booked"]')
print(booked_elements)

#Close the browser
driver.quit()

python

来源：https://stackoverflow.com/questions/75202740/issues-scraping-a-dynamic-table-displaying-available-and-booked-time-slots

1条答案

按热度按时间

wbgh16ku1#

所需的元素位于<iframe>中，因此您必须：

诱导WebDriverWait以使所需 * 帧可用并切换到该帧 *。
导出WebDriverWait以使所需的 * 元素可见。
您可以使用以下locator strategies：

driver.get("https://padelbox.de/koeln-weiden/padelplatz-buchen")
WebDriverWait(driver, 20).until(EC.element_to_be_clickable((By.CSS_SELECTOR, "a._brlbs-btn-accept-all"))).click()
WebDriverWait(driver, 20).until(EC.frame_to_be_available_and_switch_to_it((By.CSS_SELECTOR,"iframe[src^='https://www.eversports.de/widget']")))
print(len(WebDriverWait(driver, 20).until(EC.visibility_of_all_elements_located((By.CSS_SELECTOR, "td[data-state='booked'][data-date]")))))

- - 注意**：您必须添加以下导入：

from selenium.webdriver.support.ui import WebDriverWait
from selenium.webdriver.common.by import By
from selenium.webdriver.support import expected_conditions as EC

控制台输出：

更新

下面是完整的代码：

from selenium import webdriver
from selenium.webdriver.chrome.options import Options
from selenium.webdriver.chrome.service import Service
from selenium.webdriver.support.ui import WebDriverWait
from selenium.webdriver.common.by import By
from selenium.webdriver.support import expected_conditions as EC

options = Options()
options.add_argument("start-maximized")
options.add_experimental_option("excludeSwitches", ["enable-automation"])
options.add_experimental_option('excludeSwitches', ['enable-logging'])
options.add_experimental_option('useAutomationExtension', False)
options.add_argument('--disable-blink-features=AutomationControlled')
s = Service('C:\\BrowserDrivers\\chromedriver.exe')
driver = webdriver.Chrome(service=s, options=options)
driver.get("https://padelbox.de/koeln-weiden/padelplatz-buchen")
WebDriverWait(driver, 20).until(EC.element_to_be_clickable((By.CSS_SELECTOR, "a._brlbs-btn-accept-all"))).click()
WebDriverWait(driver, 20).until(EC.frame_to_be_available_and_switch_to_it((By.CSS_SELECTOR,"iframe[src^='https://www.eversports.de/widget']")))
print(len(WebDriverWait(driver, 20).until(EC.visibility_of_all_elements_located((By.CSS_SELECTOR, "td[data-state='booked'][data-date]")))))
driver.quit()

赞(0）回复(0）举报 2023-01-24

我来回答

python 抓取显示可用和已预订时隙的动态表时出现问题

1条答案

更新

相关问题

热门标签

最新问答