Package org.gbif.utils.file

Class FileSplitter

java.lang.Object

org.gbif.utils.file.FileSplitter

public class FileSplitter
extends Object

A utility to split files into chucks. This is done on file size, but then extended to read to the end of the current line. Therefore a chunksize of 32meg will result in a split files of slightly more (assuming lines are not very long). This is done using NIO libraries for high performance.

Field Summary

Fields

Modifier and Type	Field	Description
static final int	READ_AHEAD_BYTES
static final String	SEPARATOR

Method Summary

Modifier and Type	Method	Description
static List<Long>	scanToChunk(File from, long chunkSizeBytes)
static List<File>	split(File from, File targetDirectory, String suffix, long chunkSizeBytes)	Splits a file "pumaConcolor.txt" into the target directory using the suffix ("part") like so: - pumaConcolor_part_0.txt - pumaConcolor_part_1.txt - pumaConcolor_part_2.txt Returns the files parts

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

SEPARATOR

public static final String SEPARATOR

See Also:

• Constant Field Values

READ_AHEAD_BYTES

public static final int READ_AHEAD_BYTES

See Also:

• Constant Field Values

Method Details

scanToChunk

public static List<Long> scanToChunk(File from,
 long chunkSizeBytes)
                              throws IOException

Throws:

IOException

split

public static List<File> split(File from,
 File targetDirectory,
 String suffix,
 long chunkSizeBytes)
                        throws IOException

Splits a file "pumaConcolor.txt" into the target directory using the suffix ("part") like so: - pumaConcolor_part_0.txt - pumaConcolor_part_1.txt - pumaConcolor_part_2.txt Returns the files parts

Throws:

IOException