Packages

o

org.apache.spark.sql.delta

DeltaOperations

object DeltaOperations

Exhaustive list of operations that can be performed on a Delta table. These operations are tracked as the first line in delta logs, and power DESCRIBE HISTORY for Delta tables.

Linear Supertypes
AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. DeltaOperations
  2. AnyRef
  3. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. Protected

Type Members

  1. case class AddColumns(colsToAdd: Seq[QualifiedColTypeWithPositionForLog]) extends Operation with Product with Serializable

    Recorded when columns are added.

  2. case class AddConstraint(constraintName: String, expr: String) extends Operation with Product with Serializable
  3. case class ChangeColumn(columnPath: Seq[String], columnName: String, newColumn: StructField, colPosition: Option[String]) extends Operation with Product with Serializable

    Recorded when columns are changed.

  4. case class ComputeStats(predicate: Seq[String]) extends Operation with Product with Serializable

    Recorded when recomputing stats on the table.

  5. case class Convert(numFiles: Long, partitionBy: Seq[String], collectStats: Boolean, catalogTable: Option[String]) extends Operation with Product with Serializable

    Recorded when converting a table into a Delta table.

  6. case class CreateTable(metadata: Metadata, isManaged: Boolean, asSelect: Boolean = false) extends Operation with Product with Serializable

    Recorded when the table is created.

  7. case class Delete(predicate: Seq[String]) extends Operation with Product with Serializable

    Recorded while deleting certain partitions.

  8. case class DropColumns(colsToDrop: Seq[Seq[String]]) extends Operation with Product with Serializable

    Recorded when columns are dropped.

  9. case class DropConstraint(constraintName: String, expr: Option[String]) extends Operation with Product with Serializable
  10. case class Merge(predicate: Option[String], updatePredicate: Option[String], deletePredicate: Option[String], insertPredicate: Option[String], matchedPredicates: Seq[MergePredicate], notMatchedPredicates: Seq[MergePredicate]) extends Operation with Product with Serializable

    Recorded when a merge operation is committed to the table.

    Recorded when a merge operation is committed to the table.

    updatePredicate, deletePredicate, and insertPredicate are DEPRECATED. Only use predicate, matchedPredicates, and notMatchedPredicates to record the merge.

  11. case class MergePredicate(predicate: Option[String], actionType: String) extends Product with Serializable

    Represents the predicates and action type (insert, update, delete) for a Merge clause

  12. sealed abstract class Operation extends AnyRef

    An operation that can be performed on a Delta table.

  13. case class Optimize(predicate: Seq[String], zOrderBy: Seq[String] = Seq.empty) extends OptimizeOrReorg with Product with Serializable

    Recorded when optimizing the table.

  14. sealed abstract class OptimizeOrReorg extends Operation
  15. case class QualifiedColTypeWithPositionForLog(columnPath: Seq[String], column: StructField, colPosition: Option[String]) extends Product with Serializable

    Qualified column type with position.

    Qualified column type with position. We define a copy of the type here to avoid depending on the parser output classes in our logging.

  16. case class RenameColumn(oldColumnPath: Seq[String], newColumnPath: Seq[String]) extends Operation with Product with Serializable

    Recorded when column is renamed

  17. case class ReplaceColumns(columns: Seq[StructField]) extends Operation with Product with Serializable

    Recorded when columns are replaced.

  18. case class ReplaceTable(metadata: Metadata, isManaged: Boolean, orCreate: Boolean, asSelect: Boolean = false, userMetadata: Option[String] = None) extends Operation with Product with Serializable

    Recorded when the table is replaced.

  19. case class Restore(version: Option[Long], timestamp: Option[String]) extends Operation with Product with Serializable

    Recorded when restoring a Delta table to an older version.

  20. case class SetTableProperties(properties: Map[String, String]) extends Operation with Product with Serializable

    Recorded when the table properties are set.

  21. case class StreamingUpdate(outputMode: OutputMode, queryId: String, epochId: Long, userMetadata: Option[String] = None) extends Operation with Product with Serializable

    Recorded during streaming inserts.

  22. case class TestOperation(operationName: String = "TEST") extends Operation with Product with Serializable

    Dummy operation only for testing with arbitrary operation names

  23. case class Truncate() extends Operation with Product with Serializable

    Recorded when truncating the table.

  24. case class UnsetTableProperties(propKeys: Seq[String], ifExists: Boolean) extends Operation with Product with Serializable

    Recorded when the table properties are unset.

  25. case class Update(predicate: Option[String]) extends Operation with Product with Serializable

    Recorded when an update operation is committed to the table.

  26. case class UpdateColumnMetadata(operationName: String, columns: Seq[(Seq[String], StructField)]) extends Operation with Product with Serializable
  27. case class UpdateSchema(oldSchema: StructType, newSchema: StructType) extends Operation with Product with Serializable
  28. case class UpgradeProtocol(newProtocol: Protocol) extends Operation with Product with Serializable
  29. case class Write(mode: SaveMode, partitionBy: Option[Seq[String]] = None, predicate: Option[String] = None, userMetadata: Option[String] = None) extends Operation with Product with Serializable

    Recorded during batch inserts.

    Recorded during batch inserts. Predicates can be provided for overwrites.

Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##: Int
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  4. val OPTIMIZE_OPERATION_NAME: String

    operation name for OPTIMIZE command

  5. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  6. def clone(): AnyRef
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.CloneNotSupportedException]) @native()
  7. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  8. def equals(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef → Any
  9. def finalize(): Unit
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.Throwable])
  10. final def getClass(): Class[_ <: AnyRef]
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  11. def hashCode(): Int
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  12. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  13. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  14. final def notify(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  15. final def notifyAll(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  16. final def synchronized[T0](arg0: => T0): T0
    Definition Classes
    AnyRef
  17. def toString(): String
    Definition Classes
    AnyRef → Any
  18. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.InterruptedException])
  19. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.InterruptedException])
  20. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.InterruptedException]) @native()
  21. object ManualUpdate extends Operation
  22. object Merge extends Serializable
  23. object MergePredicate extends Serializable

Inherited from AnyRef

Inherited from Any

Ungrouped