Packages

o

org.apache.spark.sql.delta.skipping

MultiDimClusteringFunctions

object MultiDimClusteringFunctions

Functions for multi-dimensional clustering of the data

Linear Supertypes
AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. MultiDimClusteringFunctions
  2. AnyRef
  3. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. Protected

Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##: Int
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  5. def clone(): AnyRef
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.CloneNotSupportedException]) @native()
  6. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  7. def equals(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef → Any
  8. def finalize(): Unit
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.Throwable])
  9. final def getClass(): Class[_ <: AnyRef]
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  10. def hashCode(): Int
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  11. def interleave_bits(cols: Column*): Column

    Interleaves the bits of its input data in a round-robin fashion.

    Interleaves the bits of its input data in a round-robin fashion.

    If the input data is seen as a series of multidimensional points, this function computes the corresponding Z-values, in a way that's preserving data locality: input points that are close in the multidimensional space will be mapped to points that are close on the Z-order curve.

    The returned value is a byte array where the size of the array is 4 * num of input columns.

    Note

    Only supports input expressions of type Int for now.

    See also

    https://en.wikipedia.org/wiki/Z-order_curve

  12. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  13. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  14. final def notify(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  15. final def notifyAll(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  16. def range_partition_id(col: Column, numPartitions: Int): Column

    Conceptually range-partitions the domain of values of the given column into numPartitions partitions and computes the partition number that every value of that column corresponds to.

    Conceptually range-partitions the domain of values of the given column into numPartitions partitions and computes the partition number that every value of that column corresponds to. One can think of this as an approximate rank() function.

    Ex. For a column with values (0, 1, 3, 15, 36, 99) and numPartitions = 3 returns partition range ids as (0, 0, 1, 1, 2, 2).

  17. final def synchronized[T0](arg0: => T0): T0
    Definition Classes
    AnyRef
  18. def toString(): String
    Definition Classes
    AnyRef → Any
  19. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.InterruptedException])
  20. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.InterruptedException])
  21. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.InterruptedException]) @native()

Inherited from AnyRef

Inherited from Any

Ungrouped