Package org.gbif.utils.file

Class FileUtilsTest

java.lang.Object

org.gbif.utils.file.FileUtilsTest

public class FileUtilsTest
extends Object

Author:

markus

Constructor Summary

Constructors

Constructor	Description
FileUtilsTest()

Method Summary

Modifier and Type	Method	Description
static void	assertUnixSortOrder(File sorted)
static void	assertUnixSortOrder(Iterator<String> it)
void	humanReadableByteCountTest()
void	testDeleteRecursive()	tests deleting directory recursively.
void	testMergeEmptyFiles()
void	testMergeSortedFiles()
void	testMergeSortedFilesSpeed()
void	testMultiFileSort()	Test sorting multiple fils into a single file.
void	testMultiFileSort2ndColumn()	Test sorting multiple files into a single file.
void	testSort()	Test using GNU sort (if available on this platform).
void	testSortingHeaderlessFile()
void	testSortingMac()	tests sorting mac line endings \r which don't work with unix sort
void	testSortingUnevenLengths()	Tests sorting by a column with uneven length strings as the sort column.
void	testSortingUnicodeFile()	Sorting strings containing characters which are surrogate pairs, meaning Unicode characters beyond U+FFFF, will give different results between GNU Sort and a Java String comparator.
void	testSortingUnix()	tests sorting unix line endings \n which work with unix sort
void	testSortingWindows()	tests sorting windows line endings \r\n which work with unix sort
void	testSortingWithHeaders()
void	testSortingWithNonFirstIdColumn()
void	testSortingWithQuotedDelimiters()	If only columns containing delimiters are quoted in CSV, we can't use GNU sort.
void	testSortInJava()	Test that ensures the chunk file is deleted at the end of sortInJava method.

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

FileUtilsTest

public FileUtilsTest()

Method Details

assertUnixSortOrder

public static void assertUnixSortOrder(File sorted)
                                throws IOException

Throws:

IOException

assertUnixSortOrder

public static void assertUnixSortOrder(Iterator<String> it)
                                throws IOException

Throws:

IOException

humanReadableByteCountTest

@Test
public void humanReadableByteCountTest()

testDeleteRecursive

@Test
public void testDeleteRecursive()
                         throws IOException

tests deleting directory recursively.

Throws:

IOException

testMergeSortedFilesSpeed

@Test
@Disabled("Run manually to check the performance of merging sorted files.")
public void testMergeSortedFilesSpeed()
                               throws IOException

Throws:

IOException

testMergeSortedFiles

@Test
public void testMergeSortedFiles()
                          throws IOException

Throws:

IOException

testMergeEmptyFiles

@Test
public void testMergeEmptyFiles()
                         throws IOException

Throws:

IOException

testSortingHeaderlessFile

@Test
public void testSortingHeaderlessFile()
                               throws IOException

Throws:

IOException

testSortingUnicodeFile

@Disabled("Expected to fail")
@Test
public void testSortingUnicodeFile()
                            throws IOException

Sorting strings containing characters which are surrogate pairs, meaning Unicode characters beyond U+FFFF, will give different results between GNU Sort and a Java String comparator. "fl LATIN SMALL LIGATURE FL" is U+FB02. "𐃍 LINEAR B IDEOGRAM B241 CHARIOT" is U+100CD. GNU sort will use this order, based on the value of the whole character. Java represents 𐃍 as a surrogate pair 𐃍 in UTF-16, and sorts based on parts of pairs. Therefore, it gives the wrong order.

Throws:

IOException

testSortingMac

@Test
public void testSortingMac()
                    throws IOException

tests sorting mac line endings \r which don't work with unix sort

Throws:

IOException

testSortingUnix

@Test
public void testSortingUnix()
                     throws IOException

tests sorting unix line endings \n which work with unix sort

Throws:

IOException

testSortingWindows

@Test
public void testSortingWindows()
                        throws IOException

tests sorting windows line endings \r\n which work with unix sort

Throws:

IOException

testSortingUnevenLengths

@Test
public void testSortingUnevenLengths()
                              throws IOException

Tests sorting by a column with uneven length strings as the sort column. The order musn't be different depending whether the column is last or not. The "-k×,×" argument to sort is essential here, otherwise the delimiter from the following column is part of the sort order.

Throws:

IOException

testSortingWithHeaders

@Test
public void testSortingWithHeaders()
                            throws IOException

Throws:

IOException

testSortingWithNonFirstIdColumn

@Test
public void testSortingWithNonFirstIdColumn()
                                     throws IOException

Throws:

IOException

testSortingWithQuotedDelimiters

@Test
public void testSortingWithQuotedDelimiters()
                                     throws IOException

If only columns containing delimiters are quoted in CSV, we can't use GNU sort. X,"Look, now!",1 X,Why should I,2

Throws:

IOException

testSortInJava

@Test
public void testSortInJava()
                    throws IOException

Test that ensures the chunk file is deleted at the end of sortInJava method. Otherwise, unwanted chunk files will be left over.

Throws:

IOException

testSort

@Test
public void testSort()
              throws IOException

Test using GNU sort (if available on this platform).

Throws:

IOException

testMultiFileSort

@Test
public void testMultiFileSort()
                       throws IOException

Test sorting multiple fils into a single file. First column, so GNU sort.

Throws:

IOException

testMultiFileSort2ndColumn

@Test
public void testMultiFileSort2ndColumn()
                                throws IOException

Test sorting multiple files into a single file. Second column, so Java sort.

Throws:

IOException