org.apache.spark.sql.DataFrame.save()方法的使用及代码示例

x33g5p2x  于2022-01-18 转载在 其他  
字(1.6k)|赞(0)|评价(0)|浏览(309)

本文整理了Java中org.apache.spark.sql.DataFrame.save()方法的一些代码示例,展示了DataFrame.save()的具体用法。这些代码示例主要来源于Github/Stackoverflow/Maven等平台,是从一些精选项目中提取出来的代码,具有较强的参考意义,能在一定程度帮忙到你。DataFrame.save()方法的具体详情如下:
包路径:org.apache.spark.sql.DataFrame
类名称:DataFrame
方法名:save

DataFrame.save介绍

暂无

代码示例

代码示例来源:origin: Impetus/Kundera

/**
 * Write data in csv file.
 * 
 * @param df
 *            the df
 * @param outputFilePath
 *            the output file path
 * @return true, if successful
 */
private boolean writeDataInCsvFile(DataFrame df, String outputFilePath)
{
  // TODO change savemode to APPEND or ErrorIfExists as supported by
  // latest version
  df.save(outputFilePath, SparkPropertiesConstants.SOURCE_CSV, SaveMode.Overwrite);
  return true;
}

代码示例来源:origin: Impetus/Kundera

/**
 * Write data in json file.
 * 
 * @param df
 *            the df
 * @param m
 *            the m
 * @param outputFilePath
 *            the output file path
 * @param sqlContext
 *            the sql context
 * @return true, if successful
 */
private boolean writeDataInJsonFile(DataFrame df, String outputFilePath)
{
  // TODO change savemode to APPEND or ErrorIfExists as supported by
  // latest version
  df.save(outputFilePath, "json", SaveMode.Overwrite);
  return true;
}

代码示例来源:origin: Impetus/Kundera

@Override
public void saveDataFrame(DataFrame dataFrame, Class<?> entityClazz, Map<String, Object> properties)
{
  Map<String, String> options = new HashMap();
  options.put("c_table", (String) properties.get(TABLE));
  options.put(KEYSPACE, (String) properties.get(KEYSPACE));
  // TODO update order
  dataFrame.save(SparkPropertiesConstants.SOURCE_CASSANDRA,
      SaveMode.Append, options);
}

代码示例来源:origin: Impetus/Kundera

@Override
public void saveDataFrame(DataFrame dataFrame, Class<?> entityClazz, Map<String, Object> properties)
{
  dataFrame.save(getOutputFilePath(properties), "json");
}

相关文章