org.apache.nifi.serialization.record.Record.getValue()方法的使用及代码示例

x33g5p2x  于2022-01-29 转载在 其他  
字(10.6k)|赞(0)|评价(0)|浏览(188)

本文整理了Java中org.apache.nifi.serialization.record.Record.getValue方法的一些代码示例，展示了Record.getValue的具体用法。这些代码示例主要来源于Github/Stackoverflow/Maven等平台，是从一些精选项目中提取出来的代码，具有较强的参考意义，能在一定程度帮忙到你。Record.getValue方法的具体详情如下：
包路径：org.apache.nifi.serialization.record.Record
类名称：Record
方法名：getValue

Record.getValue介绍

[英]Returns a view of the the values of the fields in this Record. Note that this method returns values only for those entries in the Record's schema. This allows the Record to guarantee that it will return the values in the order dictated by the schema.
NOTE: The array that is returned may be an underlying array that is backing the contents of the Record. As such, modifying the array in any way may result in modifying the record.
[中]返回此记录中字段值的视图。请注意，此方法仅为记录架构中的那些条目返回值。这允许记录保证它将按照模式指定的顺序返回值。
注意：返回的数组可能是支持记录内容的基础数组。因此，以任何方式修改数组都可能导致修改记录。

代码示例

代码示例来源：origin: apache/nifi

private Stream<FieldValue> getChildren(final FieldValue fieldValue) {
  if (fieldValue == null || fieldValue.getValue() == null || !Filters.isRecord(fieldValue)) {
    return Stream.empty();
  }
  final Record record = (Record) fieldValue.getValue();
  return Filters.presentValues(record.getSchema().getFields().stream()
    .map(field -> {
      final Object value = record.getValue(field);
      if (value == null) {
        return Optional.empty();
      }
      return Optional.of(new StandardFieldValue(value, field, fieldValue));
    }));
}

代码示例来源：origin: apache/nifi

map.put(recordFieldName, record.getValue(recordFieldName));

代码示例来源：origin: apache/nifi

private void recursivelyAddParentFields(Record recordToWrite, FieldValue fieldValue) {
    try {
      // we get the parent data
      FieldValue parentField = fieldValue.getParent().get();
      Record parentRecord = fieldValue.getParentRecord().get();
      // for each field of the parent
      for (String field : parentRecord.getSchema().getFieldNames()) {
        // if and only if there is not an already existing field with this name
        // (we want to give priority to the deeper existing fields)
        if(recordToWrite.getValue(field) == null) {
          // Updates the value of the field with the given name to the given value.
          // If the field specified is not present in the schema, will do nothing.
          recordToWrite.setValue(field, parentRecord.getValue(field));
        }
      }
      // recursive call
      recursivelyAddParentFields(recordToWrite, parentField);
    } catch (NoSuchElementException e) {
      return;
    }
  }
});

代码示例来源：origin: apache/nifi

public static GenericRecord createAvroRecord(final Record record, final Schema avroSchema, final Charset charset) throws IOException {
  final GenericRecord rec = new GenericData.Record(avroSchema);
  final RecordSchema recordSchema = record.getSchema();
  for (final RecordField recordField : recordSchema.getFields()) {
    final Object rawValue = record.getValue(recordField);
    Pair<String, Field> fieldPair = lookupField(avroSchema, recordField);
    final String fieldName = fieldPair.getLeft();
    final Field field = fieldPair.getRight();
    if (field == null) {
      continue;
    }
    final Object converted = convertToAvroObject(rawValue, field.schema(), fieldName, charset);
    rec.put(fieldName, converted);
  }
  // see if the Avro schema has any fields that aren't in the RecordSchema, and if those fields have a default
  // value then we want to populate it in the GenericRecord being produced
  for (final Field field : avroSchema.getFields()) {
    final Optional<RecordField> recordField = recordSchema.getField(field.name());
    if (!recordField.isPresent() && rec.get(field.name()) == null && field.defaultVal() != null) {
      rec.put(field.name(), field.defaultVal());
    }
  }
  return rec;
}

代码示例来源：origin: apache/nifi

@Override
public void write(final Record record) throws IOException {
  if (recordFields != null) {
    for (int i = 0; i < numRecordFields; i++) {
      final RecordField field = recordFields.get(i);
      final DataType fieldType = field.getDataType();
      final String fieldName = field.getFieldName();
      Object o = record.getValue(field);
      try {
        workingRow[i] = NiFiOrcUtils.convertToORCObject(NiFiOrcUtils.getOrcField(fieldType, hiveFieldNames), o, hiveFieldNames);
      } catch (ArrayIndexOutOfBoundsException aioobe) {
        final String errorMsg = "Index out of bounds for column " + i + ", type " + fieldName + ", and object " + o.toString();
        throw new IOException(errorMsg, aioobe);
      }
    }
    orcWriter.addRow(NiFiOrcUtils.createOrcStruct(orcSchema, workingRow));
  }
}

代码示例来源：origin: apache/nifi

private void writeRecord(final Record record, final RecordSchema writeSchema, final JsonGenerator generator)
    throws IOException {
  RecordSchema schema = record.getSchema();
  generator.writeStartObject();
  for (int i = 0; i < schema.getFieldCount(); i++) {
    final RecordField field = schema.getField(i);
    final String fieldName = field.getFieldName();
    final Object value = record.getValue(field);
    if (value == null) {
      if (nullSuppression.equals(NEVER_SUPPRESS.getValue()) || (nullSuppression.equals(SUPPRESS_MISSING.getValue())) && record.getRawFieldNames().contains(fieldName)) {
        generator.writeNullField(fieldName);
      }
      continue;
    }
    generator.writeFieldName(fieldName);
    final DataType dataType = schema.getDataType(fieldName).get();
    writeValue(generator, value, fieldName, dataType);
  }
  generator.writeEndObject();
}

代码示例来源：origin: apache/nifi

Object sql = currentRecord.getValue(sqlField);
if (sql == null || StringUtils.isEmpty((String) sql)) {
  throw new MalformedRecordException(format("Record had no (or null) value for Field Containing SQL: %s, FlowFile %s", sqlField, flowFile));

代码示例来源：origin: apache/nifi

final Object value = record.getValue(descendantName);
  if (value != null) {
    final FieldValue descendantFieldValue = new StandardFieldValue(value, childField, fieldValue);
final Object recordValue = record.getValue(childField.getFieldName());
if (recordValue == null) {
  continue;

代码示例来源：origin: apache/nifi

private boolean iterateThroughRecordWithoutSchema(Deque<String> tagsToOpen, Record record) throws XMLStreamException {
  boolean loopHasWritten = false;
  for (String fieldName : record.getRawFieldNames()) {
    Object value = record.getValue(fieldName);
    if (value != null) {
      boolean hasWritten = writeUnknownField(tagsToOpen, value, fieldName);
      if (hasWritten) {
        loopHasWritten = true;
      }
    } else {
      if (nullSuppression.equals(NullSuppression.NEVER_SUPPRESS) || nullSuppression.equals(NullSuppression.SUPPRESS_MISSING)) {
        writeAllTags(tagsToOpen, fieldName);
        writer.writeEndElement();
        loopHasWritten = true;
      }
    }
  }
  return loopHasWritten;
}

代码示例来源：origin: apache/nifi

private List<FieldValue> findDescendants(final FieldValue fieldValue) {
    if (fieldValue == null || fieldValue.getValue() == null) {
      return Collections.emptyList();
    }
    if (!Filters.isRecord(fieldValue)) {
      return Collections.emptyList();
    }

    final Record record = (Record) fieldValue.getValue();
    final List<FieldValue> matchingValues = new ArrayList<>();

    for (final RecordField childField : record.getSchema().getFields()) {
      final Object value = record.getValue(childField);
      if (value == null) {
        continue;
      }

      final FieldValue descendantFieldValue = new StandardFieldValue(value, childField, fieldValue);
      matchingValues.add(descendantFieldValue);

      if (Filters.isRecord(childField.getDataType(), value)) {
        final FieldValue childFieldValue = new StandardFieldValue(value, childField, fieldValue);
        matchingValues.addAll(findDescendants(childFieldValue));
      }
    }

    return matchingValues;
  }
}

代码示例来源：origin: apache/nifi

/**
 * Writes each Record as a SolrInputDocument.
 */
public static void writeRecord(final Record record, final SolrInputDocument inputDocument,final List<String> fieldsToIndex,String parentFieldName)
    throws IOException {
  RecordSchema schema = record.getSchema();
  for (int i = 0; i < schema.getFieldCount(); i++) {
    final RecordField field = schema.getField(i);
    String fieldName;
    if(!StringUtils.isBlank(parentFieldName)) {
      // Prefixing parent field name
      fieldName = parentFieldName+"_"+field.getFieldName();
    }else{
      fieldName = field.getFieldName();
    }
    final Object value = record.getValue(field);
    if (value == null) {
      continue;
    }else {
      final DataType dataType = schema.getDataType(field.getFieldName()).get();
      writeValue(inputDocument, value, fieldName, dataType,fieldsToIndex);
    }
  }
}

代码示例来源：origin: apache/nifi

private FieldValue getChild(final FieldValue fieldValue) {
  if (!Filters.isRecord(fieldValue)) {
    return missingChild(fieldValue);
  }
  final Record record = (Record) fieldValue.getValue();
  if(record == null) {
    return missingChild(fieldValue);
  }
  final Object value = record.getValue(childName);
  if (value == null) {
    return missingChild(fieldValue);
  }
  final Optional<RecordField> field = record.getSchema().getField(childName);
  if (!field.isPresent()) {
    return missingChild(fieldValue);
  }
  return new StandardFieldValue(value, field.get(), fieldValue);
}

代码示例来源：origin: apache/nifi

final DataType fieldDataType = field.getDataType();
final String fieldName = field.getFieldName();
Object fieldValue = record.getValue(fieldName);
if (fieldValue == null) {
  recordMap.put(fieldName, null);

代码示例来源：origin: apache/nifi

for (final RecordField field : writeSchema.getFields()) {
  final String fieldName = field.getFieldName();
  final Object value = record.getValue(field);
  if (value == null) {
    if (nullSuppression == NullSuppression.NEVER_SUPPRESS || (nullSuppression == NullSuppression.SUPPRESS_MISSING) && isFieldPresent(field, record)) {
  final Object value = record.getValue(fieldName);
  if (value == null) {
    if (nullSuppression == NullSuppression.NEVER_SUPPRESS || (nullSuppression == NullSuppression.SUPPRESS_MISSING) && record.getRawFieldNames().contains(fieldName)) {

代码示例来源：origin: apache/nifi

private boolean iterateThroughRecordUsingSchema(Deque<String> tagsToOpen, Record record, RecordSchema schema) throws XMLStreamException {
  boolean loopHasWritten = false;
  for (RecordField field : schema.getFields()) {
    String fieldName = field.getFieldName();
    DataType dataType = field.getDataType();
    Object value = record.getValue(field);
    final DataType chosenDataType = dataType.getFieldType() == RecordFieldType.CHOICE ? DataTypeUtils.chooseDataType(value, (ChoiceDataType) dataType) : dataType;
    final Object coercedValue = DataTypeUtils.convertType(value, chosenDataType, LAZY_DATE_FORMAT, LAZY_TIME_FORMAT, LAZY_TIMESTAMP_FORMAT, fieldName);
    if (coercedValue != null) {
      boolean hasWritten = writeFieldForType(tagsToOpen, coercedValue, chosenDataType, fieldName);
      if (hasWritten) {
        loopHasWritten = true;
      }
    } else {
      if (nullSuppression.equals(NullSuppression.NEVER_SUPPRESS) || nullSuppression.equals(NullSuppression.SUPPRESS_MISSING) && recordHasField(field, record)) {
        writeAllTags(tagsToOpen, fieldName);
        writer.writeEndElement();
        loopHasWritten = true;
      }
    }
  }
  return loopHasWritten;
}

代码示例来源：origin: apache/nifi

Object val = record.getValue(name);
final byte[] fieldValueBytes;
if (val == null && nullStrategy.equals(NULL_FIELD_SKIP.getValue())) {

代码示例来源：origin: apache/nifi

Type colType = colSchema.getType();
if (record.getValue(colName) == null) {
  row.setNull(colName);
  continue;

代码示例来源：origin: apache/nifi

final Object rawValue = record.getValue(field);

代码示例来源：origin: apache/nifi

assertEquals(1, record.getValue("id"));
assertEquals("John", record.getValue("firstName"));
assertEquals("Doe", record.getValue("lastName"));
assertEquals(2, record.getValue("id"));
assertEquals("Jane", record.getValue("firstName"));
assertEquals("Doe", record.getValue("lastName"));

代码示例来源：origin: apache/nifi

final Object childValue = record.getValue(childField);
if (childValue == null && !childField.isNullable()) {
  logger.debug("Value is not compatible with schema because field {} has a null value, which is not allowed in the schema", childField.getFieldName());

内容来源于网络，如有侵权，请联系作者删除！

record

相关文章

    查看更多

    热门标签

    更多
    JavaquerypythonNode开发语言requestUtil数据库Table后端算法LoggerMessageElementParser

    最新文章

    更多
    • 蜀ICP备2022004421号-2 NULL123 https://www.null123.com © All rights reserved
    • 本站内容来源互联网,如果侵犯您的权益请联系我们删除, 联系方式：448109455@qq.com