我个人并不是crawlspider的忠实粉丝。在一些情况下，它很方便，但我认为在你的情况下，坚持手动爬取链接可能是一种更容易的方法。
由于您有多个具有相同格式的页面，因此您可以将每个链接反馈回主parse方法，直到它找到与td/h2/a链接相匹配的链接，此时它可以使用parse_new_item方法分配一个不同的回调来解析最终的产品页面。
例如：

import scrapy

class MySpider(scrapy.Spider):
    name = 'recursiveSpider'
    allowed_domains = ['industrialnetworking.com']
    start_urls = ['https://www.industrialnetworking.com/Manufacturers/Hirschmann']

    def parse(self, response):
        for url in response.xpath("//div[@class='catCell']/a/@href").getall():
            yield scrapy.Request(response.urljoin(url), callback=self.parse)
        for url in response.xpath("//td[@class='cellDesc']/h2/a/@href").getall():
            yield scrapy.Request(response.urljoin(url), callback=self.parse_new_item)

    def parse_new_item(self, response):
        print(response)
        item_name = response.xpath("//div[@id='itmNam']/h1/text()").get()
        item = {"name": item_name}
        yield item

输出很长，所以我把最后的计数放在下面。

输出

<200 https://www.industrialnetworking.com/Manufacturers/Hirschmann-Greyhound-Switch-Power-Accessories/Hirschmann-Greyhound-1040-Industrial-Power-Supply-GPS1-KSY9HH>
2022-09-14 13:32:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.industrialnetworking.com/Manufacturers/Hirschmann-Greyhound-Switch-Power-Accessories/Hirschmann-Greyhound-1040-Industrial-Power-Supply-GPS1-KSY9H
H>
{'name': 'GPS1-KSY9HH Power Supply'}
2022-09-14 13:32:12 [scrapy.core.engine] INFO: Closing spider (finished)
2022-09-14 13:32:12 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 380892,
 'downloader/request_count': 483,
 'downloader/request_method_count/GET': 483,
 'downloader/response_bytes': 9139340,
 'downloader/response_count': 483,
 'downloader/response_status_count/200': 471,
 'downloader/response_status_count/429': 12,
 'elapsed_time_seconds': 22.988552,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2022, 9, 14, 20, 32, 12, 287889),
 'httpcompression/response_bytes': 41356802,
 'httpcompression/response_count': 471,
 'httperror/response_ignored_count': 4,
 'httperror/response_ignored_status_count/429': 4,
 'item_scraped_count': 401,
 'log_count/DEBUG': 889,
 'log_count/ERROR': 4,
 'log_count/INFO': 14,
 'request_depth_max': 5,
 'response_received_count': 475,
 'retry/count': 8,
 'retry/max_reached': 4,
 'retry/reason_count/429 Unknown Status': 8,
 'scheduler/dequeued': 483,
 'scheduler/dequeued/memory': 483,
 'scheduler/enqueued': 483,
 'scheduler/enqueued/memory': 483,
 'start_time': datetime.datetime(2022, 9, 14, 20, 31, 49, 299337)}
2022-09-14 13:32:12 [scrapy.core.engine] INFO: Spider closed (finished)

你上面提到的网页包含14个列表urls.So你可以使用xpath或css选择器只和你必须使用follow = False摆脱不必要的url

from scrapy.crawler import CrawlerProcess
import scrapy
from scrapy.spiders import CrawlSpider, Rule
from scrapy.linkextractors import LinkExtractor

class TestSpider(CrawlSpider):
    name = 'test'

    allowed_domains = ['industrialnetworking.com']
    start_urls = ['https://www.industrialnetworking.com/Manufacturers/Hirschmann']

    rules = (
        Rule(LinkExtractor(allow=r'/Manufacturers/Hirschmann-'), follow = True, callback = 'parse_item'),
        )

    def parse_item(self, response):
        yield {
            'Title': response.xpath('//*[@id="itmNam"]/h1/text()').get()
            }

if __name__ == "__main__":
    process =CrawlerProcess()
    process.crawl(TestSpider)
    process.start()