本文整理了Java中org.apache.spark.sql.DataFrame.save()
方法的一些代码示例,展示了DataFrame.save()
的具体用法。这些代码示例主要来源于Github
/Stackoverflow
/Maven
等平台,是从一些精选项目中提取出来的代码,具有较强的参考意义,能在一定程度帮忙到你。DataFrame.save()
方法的具体详情如下:
包路径:org.apache.spark.sql.DataFrame
类名称:DataFrame
方法名:save
暂无
代码示例来源:origin: Impetus/Kundera
/**
* Write data in csv file.
*
* @param df
* the df
* @param outputFilePath
* the output file path
* @return true, if successful
*/
private boolean writeDataInCsvFile(DataFrame df, String outputFilePath)
{
// TODO change savemode to APPEND or ErrorIfExists as supported by
// latest version
df.save(outputFilePath, SparkPropertiesConstants.SOURCE_CSV, SaveMode.Overwrite);
return true;
}
代码示例来源:origin: Impetus/Kundera
/**
* Write data in json file.
*
* @param df
* the df
* @param m
* the m
* @param outputFilePath
* the output file path
* @param sqlContext
* the sql context
* @return true, if successful
*/
private boolean writeDataInJsonFile(DataFrame df, String outputFilePath)
{
// TODO change savemode to APPEND or ErrorIfExists as supported by
// latest version
df.save(outputFilePath, "json", SaveMode.Overwrite);
return true;
}
代码示例来源:origin: Impetus/Kundera
@Override
public void saveDataFrame(DataFrame dataFrame, Class<?> entityClazz, Map<String, Object> properties)
{
Map<String, String> options = new HashMap();
options.put("c_table", (String) properties.get(TABLE));
options.put(KEYSPACE, (String) properties.get(KEYSPACE));
// TODO update order
dataFrame.save(SparkPropertiesConstants.SOURCE_CASSANDRA,
SaveMode.Append, options);
}
代码示例来源:origin: Impetus/Kundera
@Override
public void saveDataFrame(DataFrame dataFrame, Class<?> entityClazz, Map<String, Object> properties)
{
dataFrame.save(getOutputFilePath(properties), "json");
}
内容来源于网络,如有侵权,请联系作者删除!