Class

tech.sourced.engine

GitRelation

Related Doc: package engine

Permalink

case class GitRelation(session: SparkSession, schema: StructType, joinConditions: Option[Expression] = None, tableSource: Option[String] = None) extends BaseRelation with CatalystScan with Product with Serializable

A relation based on git data from rooted repositories in siva files. The data this relation will offer depends on the given tableSource, which controls the table that will be accessed. Also, the tech.sourced.engine.rule.GitOptimizer might merge some table sources into one by squashing joins, so the result will be the resultant table chained with the previous one using chained iterators.

session

Spark session

schema

schema of the relation

joinConditions

join conditions, if any

tableSource

source table if any

Linear Supertypes
Serializable, Serializable, Product, Equals, CatalystScan, BaseRelation, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. GitRelation
  2. Serializable
  3. Serializable
  4. Product
  5. Equals
  6. CatalystScan
  7. BaseRelation
  8. AnyRef
  9. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new GitRelation(session: SparkSession, schema: StructType, joinConditions: Option[Expression] = None, tableSource: Option[String] = None)

    Permalink

    session

    Spark session

    schema

    schema of the relation

    joinConditions

    join conditions, if any

    tableSource

    source table if any

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any

  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  4. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any

  5. def buildScan(requiredColumns: Seq[Attribute], filters: Seq[Expression]): RDD[Row]

    Permalink
    Definition Classes
    GitRelation → CatalystScan

  6. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  7. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef

  8. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )

  9. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any

  10. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any

  11. val joinConditions: Option[Expression]

    Permalink

    join conditions, if any

  12. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef

  13. def needConversion: Boolean

    Permalink
    Definition Classes
    BaseRelation

  14. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef

  15. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef

  16. val schema: StructType

    Permalink

    schema of the relation

    schema of the relation

    Definition Classes
    GitRelation → BaseRelation

  17. val session: SparkSession

    Permalink

    Spark session

  18. def sizeInBytes: Long

    Permalink
    Definition Classes
    BaseRelation

  19. def sqlContext: SQLContext

    Permalink
    Definition Classes
    GitRelation → BaseRelation

  20. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef

  21. val tableSource: Option[String]

    Permalink

    source table if any

  22. def unhandledFilters(filters: Array[Filter]): Array[Filter]

    Permalink
    Definition Classes
    GitRelation → BaseRelation

  23. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  24. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  25. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from Serializable

Inherited from Serializable

Inherited from Product

Inherited from Equals

Inherited from CatalystScan

Inherited from BaseRelation

Inherited from AnyRef

Inherited from Any

Ungrouped