将sparkDataframe写入awss3时出现问题

tv6aics1  于 2021-07-12  发布在  Spark
关注(0)|答案(0)|浏览(215)

你好,我有困难写SparkDataframe到s3。这些是我拥有的库aws-java-sdk-1.7.4.jar hadoop-aws-2.7.3.jar
我做了以下工作 dataframe.write.csv('s3a://this/is/path/', header=True) 我看到的错误是 com.amazonaws.AmazonClientException: Unable to verify integrity of data upload. Client calculated content hash didn't match hash calculated by Amazon S3.

暂无答案!

目前还没有任何答案,快来回答吧!

相关问题