Packages

  • package root
    Definition Classes
    root
  • package org
    Definition Classes
    root
  • package apache
    Definition Classes
    org
  • package flinkx
    Definition Classes
    apache
  • package api
    Definition Classes
    flinkx
  • class CoGroupedStreams[T1, T2] extends AnyRef

    CoGroupedStreams represents two DataStreams that have been co-grouped.

    CoGroupedStreams represents two DataStreams that have been co-grouped. A streaming co-group operation is evaluated over elements in a window.

    To finalize the co-group operation you also need to specify a KeySelector for both the first and second input and a WindowAssigner

    Note: Right now, the groups are being built in memory so you need to ensure that they don't get too big. Otherwise the JVM might crash.

    Example:

    val one: DataStream[(String, Int)]  = ...
val two: DataStream[(String, Int)] = ...

val result = one.coGroup(two)
    .where(new MyFirstKeySelector())
    .equalTo(new MyFirstKeySelector())
    .window(TumblingEventTimeWindows.of(Time.of(5, TimeUnit.SECONDS)))
    .apply(new MyCoGroupFunction())
}
    Definition Classes
    api
    Annotations
    @Public()
  • class Where[KEY] extends AnyRef

    A co-group operation that has KeySelectors defined for the first input.

    A co-group operation that has KeySelectors defined for the first input.

    You need to specify a KeySelector for the second input using equalTo() before you can proceed with specifying a WindowAssigner using EqualTo.window().

    KEY

    Type of the key. This must be the same for both inputs

    Definition Classes
    CoGroupedStreams
  • class EqualTo extends AnyRef

    A co-group operation that a KeySelector defined for the first and the second input.

    A co-group operation that a KeySelector defined for the first and the second input.

    A window can now be specified using window().

    Definition Classes
    Where
  • WithWindow

class WithWindow[W <: Window] extends AnyRef

A co-group operation that has KeySelectors defined for both inputs as well as a WindowAssigner.

W

Type of {@@linkWindow} on which the co-group operation works.

Annotations
@PublicEvolving()
Linear Supertypes
AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. WithWindow
  2. AnyRef
  3. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new WithWindow(windowAssigner: WindowAssigner[_ >: TaggedUnion[T1, T2], W], trigger: Trigger[_ >: TaggedUnion[T1, T2], _ >: W], evictor: Evictor[_ >: TaggedUnion[T1, T2], _ >: W], allowedLateness: Time)

Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  4. def allowedLateness(newLateness: Time): WithWindow[W]

    Sets the time by which elements are allowed to be late.

    Sets the time by which elements are allowed to be late. Delegates to WindowedStream#allowedLateness(Time)

    Annotations
    @PublicEvolving()
  5. val allowedLateness: Time
  6. def apply[T](function: CoGroupFunction[T1, T2, T])(implicit arg0: TypeInformation[T]): DataStream[T]

    Completes the co-group operation with the user function that is executed for windowed groups.

  7. def apply[O](fun: (Iterator[T1], Iterator[T2], Collector[O]) ⇒ Unit)(implicit arg0: TypeInformation[O]): DataStream[O]

    Completes the co-group operation with the user function that is executed for windowed groups.

  8. def apply[O](fun: (Iterator[T1], Iterator[T2]) ⇒ O)(implicit arg0: TypeInformation[O]): DataStream[O]

    Completes the co-group operation with the user function that is executed for windowed groups.

  9. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  10. def clone(): AnyRef
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native() @HotSpotIntrinsicCandidate()
  11. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  12. def equals(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  13. def evictor(newEvictor: Evictor[_ >: TaggedUnion[T1, T2], _ >: W]): WithWindow[W]

    Sets the Evictor that should be used to evict elements from a window before emission.

    Sets the Evictor that should be used to evict elements from a window before emission.

    Note: When using an evictor window performance will degrade significantly, since pre-aggregation of window results cannot be used.

    Annotations
    @PublicEvolving()
  14. final def getClass(): Class[_]
    Definition Classes
    AnyRef → Any
    Annotations
    @native() @HotSpotIntrinsicCandidate()
  15. def hashCode(): Int
    Definition Classes
    AnyRef → Any
    Annotations
    @native() @HotSpotIntrinsicCandidate()
  16. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  17. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  18. final def notify(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native() @HotSpotIntrinsicCandidate()
  19. final def notifyAll(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native() @HotSpotIntrinsicCandidate()
  20. final def synchronized[T0](arg0: ⇒ T0): T0
    Definition Classes
    AnyRef
  21. def toString(): String
    Definition Classes
    AnyRef → Any
  22. def trigger(newTrigger: Trigger[_ >: TaggedUnion[T1, T2], _ >: W]): WithWindow[W]

    Sets the Trigger that should be used to trigger window emission.

    Sets the Trigger that should be used to trigger window emission.

    Annotations
    @PublicEvolving()
  23. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  24. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()
  25. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Deprecated Value Members

  1. def finalize(): Unit
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] ) @Deprecated
    Deprecated

Inherited from AnyRef

Inherited from Any

Ungrouped