Packages

case class LogSegment(logPath: Path, version: Long, deltas: Seq[FileStatus], checkpoint: Seq[FileStatus], checkpointVersionOpt: Option[Long], lastCommitTimestamp: Long) extends Product with Serializable

Provides information around which files in the transaction log need to be read to create the given version of the log.

logPath

The path to the _delta_log directory

version

The Snapshot version to generate

deltas

The delta commit files (.json) to read

checkpoint

The checkpoint file to read

checkpointVersionOpt

The checkpoint version used to start replay

lastCommitTimestamp

The "unadjusted" timestamp of the last commit within this segment. By unadjusted, we mean that the commit timestamps may not necessarily be monotonically increasing for the commits within this segment.

Linear Supertypes
Serializable, Product, Equals, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. LogSegment
  2. Serializable
  3. Product
  4. Equals
  5. AnyRef
  6. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. Protected

Instance Constructors

  1. new LogSegment(logPath: Path, version: Long, deltas: Seq[FileStatus], checkpoint: Seq[FileStatus], checkpointVersionOpt: Option[Long], lastCommitTimestamp: Long)

    logPath

    The path to the _delta_log directory

    version

    The Snapshot version to generate

    deltas

    The delta commit files (.json) to read

    checkpoint

    The checkpoint file to read

    checkpointVersionOpt

    The checkpoint version used to start replay

    lastCommitTimestamp

    The "unadjusted" timestamp of the last commit within this segment. By unadjusted, we mean that the commit timestamps may not necessarily be monotonically increasing for the commits within this segment.

Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##: Int
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  5. val checkpoint: Seq[FileStatus]
  6. val checkpointVersionOpt: Option[Long]
  7. def clone(): AnyRef
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.CloneNotSupportedException]) @native()
  8. val deltas: Seq[FileStatus]
  9. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  10. def equals(obj: Any): Boolean

    An efficient way to check if a cached Snapshot's contents actually correspond to a new segment returned through file listing.

    An efficient way to check if a cached Snapshot's contents actually correspond to a new segment returned through file listing.

    Definition Classes
    LogSegment → Equals → AnyRef → Any
  11. def finalize(): Unit
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.Throwable])
  12. final def getClass(): Class[_ <: AnyRef]
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  13. def hashCode(): Int
    Definition Classes
    LogSegment → AnyRef → Any
  14. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  15. val lastCommitTimestamp: Long
  16. val logPath: Path
  17. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  18. final def notify(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  19. final def notifyAll(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  20. def productElementNames: Iterator[String]
    Definition Classes
    Product
  21. final def synchronized[T0](arg0: => T0): T0
    Definition Classes
    AnyRef
  22. val version: Long
  23. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.InterruptedException])
  24. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.InterruptedException])
  25. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.InterruptedException]) @native()

Inherited from Serializable

Inherited from Product

Inherited from Equals

Inherited from AnyRef

Inherited from Any

Ungrouped