org.apache.hadoop.io.Text.readWithKnownLength()方法的使用及代码示例

x33g5p2x  于2022-01-29 转载在 其他  
字(5.2k)|赞(0)|评价(0)|浏览(104)

本文整理了Java中org.apache.hadoop.io.Text.readWithKnownLength()方法的一些代码示例,展示了Text.readWithKnownLength()的具体用法。这些代码示例主要来源于Github/Stackoverflow/Maven等平台,是从一些精选项目中提取出来的代码,具有较强的参考意义,能在一定程度帮忙到你。Text.readWithKnownLength()方法的具体详情如下:
包路径:org.apache.hadoop.io.Text
类名称:Text
方法名:readWithKnownLength

Text.readWithKnownLength介绍

[英]Read a Text object whose length is already known. This allows creating Text from a stream which uses a different serialization format.
[中]读取长度已知的文本对象。这允许从使用不同序列化格式的流中创建文本。

代码示例

代码示例来源:origin: org.apache.hadoop/hadoop-common

/** deserialize 
 */
@Override
public void readFields(DataInput in) throws IOException {
 int newLength = WritableUtils.readVInt(in);
 readWithKnownLength(in, newLength);
}

代码示例来源:origin: org.apache.hadoop/hadoop-common

public void readFields(DataInput in, int maxLength) throws IOException {
 int newLength = WritableUtils.readVInt(in);
 if (newLength < 0) {
  throw new IOException("tried to deserialize " + newLength +
    " bytes of data!  newLength must be non-negative.");
 } else if (newLength >= maxLength) {
  throw new IOException("tried to deserialize " + newLength +
    " bytes of data, but maxLength = " + maxLength);
 }
 readWithKnownLength(in, newLength);
}

代码示例来源:origin: org.apache.hive/hive-orc

@Override
 public void read(Text txt, int len) throws IOException {
  txt.readWithKnownLength(din, len);
 }
}

代码示例来源:origin: io.hops/hadoop-common

/** deserialize 
 */
@Override
public void readFields(DataInput in) throws IOException {
 int newLength = WritableUtils.readVInt(in);
 readWithKnownLength(in, newLength);
}

代码示例来源:origin: ch.cern.hadoop/hadoop-common

public void readFields(DataInput in, int maxLength) throws IOException {
 int newLength = WritableUtils.readVInt(in);
 if (newLength < 0) {
  throw new IOException("tried to deserialize " + newLength +
    " bytes of data!  newLength must be non-negative.");
 } else if (newLength >= maxLength) {
  throw new IOException("tried to deserialize " + newLength +
    " bytes of data, but maxLength = " + maxLength);
 }
 readWithKnownLength(in, newLength);
}

代码示例来源:origin: com.github.jiayuhan-it/hadoop-common

/** deserialize 
 */
@Override
public void readFields(DataInput in) throws IOException {
 int newLength = WritableUtils.readVInt(in);
 readWithKnownLength(in, newLength);
}

代码示例来源:origin: ch.cern.hadoop/hadoop-common

/** deserialize 
 */
@Override
public void readFields(DataInput in) throws IOException {
 int newLength = WritableUtils.readVInt(in);
 readWithKnownLength(in, newLength);
}

代码示例来源:origin: io.prestosql.hadoop/hadoop-apache

public void readFields(DataInput in, int maxLength) throws IOException {
 int newLength = WritableUtils.readVInt(in);
 if (newLength < 0) {
  throw new IOException("tried to deserialize " + newLength +
    " bytes of data!  newLength must be non-negative.");
 } else if (newLength >= maxLength) {
  throw new IOException("tried to deserialize " + newLength +
    " bytes of data, but maxLength = " + maxLength);
 }
 readWithKnownLength(in, newLength);
}

代码示例来源:origin: io.hops/hadoop-common

public void readFields(DataInput in, int maxLength) throws IOException {
 int newLength = WritableUtils.readVInt(in);
 if (newLength < 0) {
  throw new IOException("tried to deserialize " + newLength +
    " bytes of data!  newLength must be non-negative.");
 } else if (newLength >= maxLength) {
  throw new IOException("tried to deserialize " + newLength +
    " bytes of data, but maxLength = " + maxLength);
 }
 readWithKnownLength(in, newLength);
}

代码示例来源:origin: com.github.jiayuhan-it/hadoop-common

public void readFields(DataInput in, int maxLength) throws IOException {
 int newLength = WritableUtils.readVInt(in);
 if (newLength < 0) {
  throw new IOException("tried to deserialize " + newLength +
    " bytes of data!  newLength must be non-negative.");
 } else if (newLength >= maxLength) {
  throw new IOException("tried to deserialize " + newLength +
    " bytes of data, but maxLength = " + maxLength);
 }
 readWithKnownLength(in, newLength);
}

代码示例来源:origin: io.prestosql.hadoop/hadoop-apache

/** deserialize 
 */
@Override
public void readFields(DataInput in) throws IOException {
 int newLength = WritableUtils.readVInt(in);
 readWithKnownLength(in, newLength);
}

代码示例来源:origin: ch.cern.hadoop/hadoop-common

public void testReadWithKnownLength() throws IOException {
 String line = "hello world";
 byte[] inputBytes = line.getBytes(Charsets.UTF_8);
 DataInputBuffer in = new DataInputBuffer();
 Text text = new Text();
 in.reset(inputBytes, inputBytes.length);
 text.readWithKnownLength(in, 5);
 assertEquals("hello", text.toString());
 // Read longer length, make sure it lengthens
 in.reset(inputBytes, inputBytes.length);
 text.readWithKnownLength(in, 7);
 assertEquals("hello w", text.toString());
 // Read shorter length, make sure it shortens
 in.reset(inputBytes, inputBytes.length);
 text.readWithKnownLength(in, 2);
 assertEquals("he", text.toString());
}

代码示例来源:origin: com.github.jiayuhan-it/hadoop-common

public void testReadWithKnownLength() throws IOException {
 String line = "hello world";
 byte[] inputBytes = line.getBytes(Charsets.UTF_8);
 DataInputBuffer in = new DataInputBuffer();
 Text text = new Text();
 in.reset(inputBytes, inputBytes.length);
 text.readWithKnownLength(in, 5);
 assertEquals("hello", text.toString());
 // Read longer length, make sure it lengthens
 in.reset(inputBytes, inputBytes.length);
 text.readWithKnownLength(in, 7);
 assertEquals("hello w", text.toString());
 // Read shorter length, make sure it shortens
 in.reset(inputBytes, inputBytes.length);
 text.readWithKnownLength(in, 2);
 assertEquals("he", text.toString());
}

相关文章