c

io.smartdatalake.workflow.action.customlogic

CustomDfCreatorWrapper

class CustomDfCreatorWrapper extends CustomDfCreator

Linear Supertypes
CustomDfCreator, Serializable, Serializable, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. CustomDfCreatorWrapper
  2. CustomDfCreator
  3. Serializable
  4. Serializable
  5. AnyRef
  6. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new CustomDfCreatorWrapper(fnExec: fnExecType, fnSchema: fnSchemaType)

Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  5. def clone(): AnyRef
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native() @HotSpotIntrinsicCandidate()
  6. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  7. def equals(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  8. def exec(session: SparkSession, config: Map[String, String]): DataFrame

    This method creates a DataFrame based on custom code.

    This method creates a DataFrame based on custom code.

    session

    the Spark session

    config

    the input config of the associated action

    returns

    the custom DataFrame

    Definition Classes
    CustomDfCreatorWrapper → CustomDfCreator
  9. val fnExec: fnExecType
  10. val fnSchema: fnSchemaType
  11. final def getClass(): Class[_]
    Definition Classes
    AnyRef → Any
    Annotations
    @native() @HotSpotIntrinsicCandidate()
  12. def hashCode(): Int
    Definition Classes
    AnyRef → Any
    Annotations
    @native() @HotSpotIntrinsicCandidate()
  13. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  14. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  15. final def notify(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native() @HotSpotIntrinsicCandidate()
  16. final def notifyAll(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native() @HotSpotIntrinsicCandidate()
  17. def schema(session: SparkSession, config: Map[String, String]): Option[StructType]

    Adds the possibility to return a custom schema during init If no schema returned, init needs to call exec to get the schema, leading exec to be called twice

    Adds the possibility to return a custom schema during init If no schema returned, init needs to call exec to get the schema, leading exec to be called twice

    session

    the Spark Session

    config

    the input config of the associated action

    returns

    the schema of the custom DataFrame

    Definition Classes
    CustomDfCreatorWrapper → CustomDfCreator
  18. final def synchronized[T0](arg0: ⇒ T0): T0
    Definition Classes
    AnyRef
  19. def toString(): String
    Definition Classes
    AnyRef → Any
  20. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  21. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()
  22. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Deprecated Value Members

  1. def finalize(): Unit
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] ) @Deprecated
    Deprecated

Inherited from CustomDfCreator

Inherited from Serializable

Inherited from Serializable

Inherited from AnyRef

Inherited from Any

Ungrouped