org.gbif.utils.file

Class FileSplitter

java.lang.Object

org.gbif.utils.file.FileSplitter

public class FileSplitter
extends Object

A utility to split files into chucks. This is done on file size, but then extended to read to the end of the current line. Therefore a chunksize of 32meg will result in a split files of slightly more (assuming lines are not very long). This is done using NIO libraries for high performance.

Field Summary

Fields

Modifier and Type	Field and Description
static int	READ_AHEAD_BYTES
static String	SEPARATOR

Method Summary

Modifier and Type	Method and Description
static List<Long>	scanToChunk(File from, long chunkSizeBytes)
static List<File>	split(File from, File targetDirectory, String suffix, long chunkSizeBytes) Splits a file "pumaConcolor.txt" into the target directory using the suffix ("part") like so: - pumaConcolor_part_0.txt - pumaConcolor_part_1.txt - pumaConcolor_part_2.txt Returns the files parts

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

SEPARATOR

public static final String SEPARATOR

See Also:

Constant Field Values

READ_AHEAD_BYTES

public static final int READ_AHEAD_BYTES

See Also:

Constant Field Values

Method Detail

scanToChunk

public static List<Long> scanToChunk(File from,
                                     long chunkSizeBytes)
                              throws IOException

Throws:

IOException

split

public static List<File> split(File from,
                               File targetDirectory,
                               String suffix,
                               long chunkSizeBytes)
                        throws IOException

Splits a file "pumaConcolor.txt" into the target directory using the suffix ("part") like so: - pumaConcolor_part_0.txt - pumaConcolor_part_1.txt - pumaConcolor_part_2.txt Returns the files parts

Throws:

IOException