aws glue上下文不支持sql查询

jc3wubiy  于 2021-05-17  发布在  Spark
关注(0)|答案(1)|浏览(444)

用例:用aws glue中的where子句传递查询。

source_df = glueContext.read.format("jdbc")
  .option("url","jdbc:oracle:thin://@xxxxx:1521/ORCL")
  .option("user","user")
  .option("password","password")
  .option("dbtable","(Select * from test) as test")
  .option("driver","oracle.jdbc.driver.OracleDriver")
  .load()

我得到以下错误:

Traceback (most recent call last): File "/tmp/comments_jdbc", line 17, in <module> source_df = spark.read.format("jdbc").option("url","jdbc:oracle:thin://xxxxx:1521/ORCL").option("user","user").option("password","password").option("dbtable","(Select * from test) as test").option("driver","oracle.jdbc.driver.OracleDriver").load()

File "/opt/amazon/spark/python/lib/pyspark.zip/pyspark/sql/readwriter.py", line 172, in load return self._df(self._jreader.load())

File "/opt/amazon/spark/python/lib/py4j-0.10.7-src.zip/py4j/java_gateway.py", line 1257, in __call__ answer, self.gateway_client, self.target_id, self.name)

File "/opt/amazon/spark/python/lib/pyspark.zip/pyspark/sql/utils.py", line 63, in deco return f(*a,**kw)

File "/opt/amazon/spark/python/lib/py4j-0.10.7-src.zip/py4j/protocol.py", line 328, in get_return_value format(target_id, ".", name), value) 

py4j.protocol.Py4JJavaError: An error occurred while calling o77.load. : java.sql.SQLSyntaxErrorException: ORA-00933: SQL command not properly ended at 

oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:447) at 

oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:396) at 

oracle.jdbc.driver.T4C8Oall.processError(T4C8Oall.java:951) at 

oracle.jdbc.driver.T4CTTIfun.receive(T4CTTIfun.java:513) at 

oracle.jdbc.driver.T4CTTIfun.doRPC(T4CTTIfun.java:227) at 

oracle.jdbc.driver.T4C8Oall.doOALL(T4C8Oall.java:531) at 

oracle.jdbc.driver.T4CPreparedStatement.doOall8(T4CPreparedStatement.java:208) at 

oracle.jdbc.driver.T4CPreparedStatement.executeForDescribe(T4CPreparedStatement.java:886) at 

oracle.jdbc.driver.OracleStatement.executeMaybeDescribe(OracleStatement.java:1175) at
oo7oh9g9

oo7oh9g91#

我在你的字典里没有看到where子句 option 为了 dbtable 但是我试着直接在oracle中运行查询,它抛出了与您收到的相同的错误。看起来oracle不支持表别名,只允许列。
如果仍要使用别名,请尝试在下面运行“从粘合作业查询”或只选择带外圆括号的查询。

select test.* from (select * from test) test

或者简单地使用where子句按原样运行查询:

select * from test where <some_col=value>

相关问题