Package org.gbif.api.model.crawler
Class DatasetProcessStatus
java.lang.Object
org.gbif.api.model.crawler.DatasetProcessStatus
Information about a dataset that is currently being processed. That usually means that we are crawling it at the
moment or are in the process of persisting and interpreting its occurrences.
-
Nested Class Summary
Nested Classes -
Constructor Summary
ConstructorsConstructorDescriptionBuilds a new object from the builder validating it in the process. -
Method Summary
Modifier and TypeMethodDescriptionstatic DatasetProcessStatus.Builder
builder()
boolean
Last successful crawl context, this is a JSON string.Key that identifies the Dataset.Timestamp of when the crawl was finished.The reason a crawl is finished.@javax.validation.constraints.Min(0L) long
@javax.validation.constraints.Min(0L) long
Number of fragments that have been processed.@javax.validation.constraints.Min(0L) long
@javax.validation.constraints.Min(0L) long
@javax.validation.constraints.Min(0L) long
@javax.validation.constraints.Min(0L) long
Number of pages crawled in total.@javax.validation.constraints.Min(0L) long
@javax.validation.constraints.Min(0L) long
Number of pages that have been fragmented.@javax.validation.constraints.Min(0L) long
@javax.validation.constraints.Min(0L) long
@javax.validation.constraints.Min(0L) long
@javax.validation.constraints.Min(0L) long
Timestamp of when the crawl was actually started by a crawler.@javax.validation.constraints.Min(0L) long
@javax.validation.constraints.Min(0L) long
int
hashCode()
void
setCrawlContext
(String crawlContext) void
setCrawlJob
(CrawlJob crawlJob) void
setDatasetKey
(UUID datasetKey) void
setDeclaredCount
(Long declaredCount) void
setFinishedCrawling
(Date finishedCrawling) void
setFinishReason
(FinishReason finishReason) void
setFragmentsEmitted
(long fragmentsEmitted) void
setFragmentsProcessed
(long fragmentsProcessed) void
setFragmentsReceived
(long fragmentsReceived) void
setInterpretedOccurrencesPersistedError
(long interpretedOccurrencesPersistedError) void
setInterpretedOccurrencesPersistedSuccessful
(long interpretedOccurrencesPersistedSuccessful) void
setPagesCrawled
(long pagesCrawled) void
setPagesFragmentedError
(long pagesFragmentedError) void
setPagesFragmentedSuccessful
(long pagesFragmentedSuccessful) void
setProcessStateChecklist
(ProcessState processStateChecklist) void
setProcessStateOccurrence
(ProcessState processStateOccurrence) void
setProcessStateSample
(ProcessState processStateSample) void
setRawOccurrencesPersistedError
(long rawOccurrencesPersistedError) void
setRawOccurrencesPersistedNew
(long rawOccurrencesPersistedNew) void
setRawOccurrencesPersistedUnchanged
(long rawOccurrencesPersistedUnchanged) void
setRawOccurrencesPersistedUpdated
(long rawOccurrencesPersistedUpdated) void
setStartedCrawling
(Date startedCrawling) void
setVerbatimOccurrencesPersistedError
(long verbatimOccurrencesPersistedError) void
setVerbatimOccurrencesPersistedSuccessful
(long verbatimOccurrencesPersistedSuccessful) toString()
-
Constructor Details
-
DatasetProcessStatus
public DatasetProcessStatus() -
DatasetProcessStatus
Builds a new object from the builder validating it in the process. We only validate very little (all counts have to be greater than or equal to zero, a few null checks etc.) but not
-
-
Method Details
-
builder
-
getCrawlContext
Last successful crawl context, this is a JSON string.- Returns:
- the last successful crawl context, this is a JSON string
-
getCrawlJob
-
getDatasetKey
Key that identifies the Dataset.- Returns:
- the UUID key that identifies the dataset
-
getDeclaredCount
-
getFinishedCrawling
Timestamp of when the crawl was finished.- Returns:
- the timestamp when the crawl finished
-
getFinishReason
- Returns:
- the reason the crawl finished
-
getProcessStateOccurrence
-
getProcessStateChecklist
-
getProcessStateSample
-
getFragmentsEmitted
-
getFragmentsProcessed
Number of fragments that have been processed.- Returns:
- the number of fragments that have been processed
-
getFragmentsReceived
-
getInterpretedOccurrencesPersistedError
@Min(0L) public @javax.validation.constraints.Min(0L) long getInterpretedOccurrencesPersistedError() -
getInterpretedOccurrencesPersistedSuccessful
@Min(0L) public @javax.validation.constraints.Min(0L) long getInterpretedOccurrencesPersistedSuccessful() -
getPagesCrawled
Number of pages crawled in total.- Returns:
- number of pages crawled
-
getPagesFragmentedError
-
getPagesFragmentedSuccessful
Number of pages that have been fragmented.- Returns:
- the number of pages that have been fragmented
-
getRawOccurrencesPersistedError
-
getRawOccurrencesPersistedNew
-
getRawOccurrencesPersistedUnchanged
-
getRawOccurrencesPersistedUpdated
-
getStartedCrawling
Timestamp of when the crawl was actually started by a crawler.- Returns:
- the timestamp when the crawl started
-
getVerbatimOccurrencesPersistedError
-
getVerbatimOccurrencesPersistedSuccessful
@Min(0L) public @javax.validation.constraints.Min(0L) long getVerbatimOccurrencesPersistedSuccessful() -
setDatasetKey
-
setCrawlJob
-
setStartedCrawling
-
setFinishedCrawling
-
setCrawlContext
-
setFinishReason
-
setProcessStateOccurrence
-
setProcessStateChecklist
-
setProcessStateSample
-
setDeclaredCount
-
setPagesCrawled
-
setPagesFragmentedSuccessful
-
setPagesFragmentedError
-
setFragmentsEmitted
-
setFragmentsReceived
-
setRawOccurrencesPersistedNew
-
setRawOccurrencesPersistedUpdated
-
setRawOccurrencesPersistedUnchanged
-
setRawOccurrencesPersistedError
-
setFragmentsProcessed
-
setVerbatimOccurrencesPersistedSuccessful
-
setVerbatimOccurrencesPersistedError
-
setInterpretedOccurrencesPersistedSuccessful
public void setInterpretedOccurrencesPersistedSuccessful(long interpretedOccurrencesPersistedSuccessful) -
setInterpretedOccurrencesPersistedError
-
equals
-
hashCode
-
toString
-