Packages

package proto

Type Members

  1. final class AddArtifactsRequest extends GeneratedMessageV3 with AddArtifactsRequestOrBuilder

    Request to transfer client-local artifacts.
    

    Request to transfer client-local artifacts.
    

    Protobuf type spark.connect.AddArtifactsRequest

  2. trait AddArtifactsRequestOrBuilder extends MessageOrBuilder
  3. final class AddArtifactsResponse extends GeneratedMessageV3 with AddArtifactsResponseOrBuilder

    Response to adding an artifact. Contains relevant metadata to verify successful transfer of
    artifact(s).
    

    Response to adding an artifact. Contains relevant metadata to verify successful transfer of
    artifact(s).
    

    Protobuf type spark.connect.AddArtifactsResponse

  4. trait AddArtifactsResponseOrBuilder extends MessageOrBuilder
  5. final class Aggregate extends GeneratedMessageV3 with AggregateOrBuilder

    Relation of type [[Aggregate]].
    

    Relation of type [[Aggregate]].
    

    Protobuf type spark.connect.Aggregate

  6. trait AggregateOrBuilder extends MessageOrBuilder
  7. final class AnalyzePlanRequest extends GeneratedMessageV3 with AnalyzePlanRequestOrBuilder

    Request to perform plan analyze, optionally to explain the plan.
    

    Request to perform plan analyze, optionally to explain the plan.
    

    Protobuf type spark.connect.AnalyzePlanRequest

  8. trait AnalyzePlanRequestOrBuilder extends MessageOrBuilder
  9. final class AnalyzePlanResponse extends GeneratedMessageV3 with AnalyzePlanResponseOrBuilder

    Response to performing analysis of the query. Contains relevant metadata to be able to
    reason about the performance.
    

    Response to performing analysis of the query. Contains relevant metadata to be able to
    reason about the performance.
    

    Protobuf type spark.connect.AnalyzePlanResponse

  10. trait AnalyzePlanResponseOrBuilder extends MessageOrBuilder
  11. final class ApplyInPandasWithState extends GeneratedMessageV3 with ApplyInPandasWithStateOrBuilder

    Protobuf type spark.connect.ApplyInPandasWithState

  12. trait ApplyInPandasWithStateOrBuilder extends MessageOrBuilder
  13. final class ArtifactStatusesRequest extends GeneratedMessageV3 with ArtifactStatusesRequestOrBuilder

    Request to get current statuses of artifacts at the server side.
    

    Request to get current statuses of artifacts at the server side.
    

    Protobuf type spark.connect.ArtifactStatusesRequest

  14. trait ArtifactStatusesRequestOrBuilder extends MessageOrBuilder
  15. final class ArtifactStatusesResponse extends GeneratedMessageV3 with ArtifactStatusesResponseOrBuilder

    Response to checking artifact statuses.
    

    Response to checking artifact statuses.
    

    Protobuf type spark.connect.ArtifactStatusesResponse

  16. trait ArtifactStatusesResponseOrBuilder extends MessageOrBuilder
  17. final class Base extends AnyRef
  18. final class CacheTable extends GeneratedMessageV3 with CacheTableOrBuilder

    See `spark.catalog.cacheTable`
    

    See `spark.catalog.cacheTable`
    

    Protobuf type spark.connect.CacheTable

  19. trait CacheTableOrBuilder extends MessageOrBuilder
  20. final class CachedLocalRelation extends GeneratedMessageV3 with CachedLocalRelationOrBuilder

    A local relation that has been cached already.
    

    A local relation that has been cached already.
    

    Protobuf type spark.connect.CachedLocalRelation

  21. trait CachedLocalRelationOrBuilder extends MessageOrBuilder
  22. final class CachedRemoteRelation extends GeneratedMessageV3 with CachedRemoteRelationOrBuilder

    Represents a remote relation that has been cached on server.
    

    Represents a remote relation that has been cached on server.
    

    Protobuf type spark.connect.CachedRemoteRelation

  23. trait CachedRemoteRelationOrBuilder extends MessageOrBuilder
  24. final class CallFunction extends GeneratedMessageV3 with CallFunctionOrBuilder

    Protobuf type spark.connect.CallFunction

  25. trait CallFunctionOrBuilder extends MessageOrBuilder
  26. final class Catalog extends GeneratedMessageV3 with CatalogOrBuilder

    Catalog messages are marked as unstable.
    

    Catalog messages are marked as unstable.
    

    Protobuf type spark.connect.Catalog

  27. trait CatalogOrBuilder extends MessageOrBuilder
  28. final class CatalogOuterClass extends AnyRef
  29. final class ClearCache extends GeneratedMessageV3 with ClearCacheOrBuilder

    See `spark.catalog.clearCache`
    

    See `spark.catalog.clearCache`
    

    Protobuf type spark.connect.ClearCache

  30. trait ClearCacheOrBuilder extends MessageOrBuilder
  31. final class CoGroupMap extends GeneratedMessageV3 with CoGroupMapOrBuilder

    Protobuf type spark.connect.CoGroupMap

  32. trait CoGroupMapOrBuilder extends MessageOrBuilder
  33. final class CollectMetrics extends GeneratedMessageV3 with CollectMetricsOrBuilder

    Collect arbitrary (named) metrics from a dataset.
    

    Collect arbitrary (named) metrics from a dataset.
    

    Protobuf type spark.connect.CollectMetrics

  34. trait CollectMetricsOrBuilder extends MessageOrBuilder
  35. final class Command extends GeneratedMessageV3 with CommandOrBuilder

    A [[Command]] is an operation that is executed by the server that does not directly consume or
    produce a relational result.
    

    A [[Command]] is an operation that is executed by the server that does not directly consume or
    produce a relational result.
    

    Protobuf type spark.connect.Command

  36. trait CommandOrBuilder extends MessageOrBuilder
  37. final class Commands extends AnyRef
  38. final class Common extends AnyRef
  39. final class CommonInlineUserDefinedFunction extends GeneratedMessageV3 with CommonInlineUserDefinedFunctionOrBuilder

    Protobuf type spark.connect.CommonInlineUserDefinedFunction

  40. trait CommonInlineUserDefinedFunctionOrBuilder extends MessageOrBuilder
  41. final class CommonInlineUserDefinedTableFunction extends GeneratedMessageV3 with CommonInlineUserDefinedTableFunctionOrBuilder

    Protobuf type spark.connect.CommonInlineUserDefinedTableFunction

  42. trait CommonInlineUserDefinedTableFunctionOrBuilder extends MessageOrBuilder
  43. final class ConfigRequest extends GeneratedMessageV3 with ConfigRequestOrBuilder

    Request to update or fetch the configurations.
    

    Request to update or fetch the configurations.
    

    Protobuf type spark.connect.ConfigRequest

  44. trait ConfigRequestOrBuilder extends MessageOrBuilder
  45. final class ConfigResponse extends GeneratedMessageV3 with ConfigResponseOrBuilder

    Response to the config request.
    

    Response to the config request.
    

    Protobuf type spark.connect.ConfigResponse

  46. trait ConfigResponseOrBuilder extends MessageOrBuilder
  47. final class CreateDataFrameViewCommand extends GeneratedMessageV3 with CreateDataFrameViewCommandOrBuilder

    A command that can create DataFrame global temp view or local temp view.
    

    A command that can create DataFrame global temp view or local temp view.
    

    Protobuf type spark.connect.CreateDataFrameViewCommand

  48. trait CreateDataFrameViewCommandOrBuilder extends MessageOrBuilder
  49. final class CreateExternalTable extends GeneratedMessageV3 with CreateExternalTableOrBuilder

    See `spark.catalog.createExternalTable`
    

    See `spark.catalog.createExternalTable`
    

    Protobuf type spark.connect.CreateExternalTable

  50. trait CreateExternalTableOrBuilder extends MessageOrBuilder
  51. final class CreateTable extends GeneratedMessageV3 with CreateTableOrBuilder

    See `spark.catalog.createTable`
    

    See `spark.catalog.createTable`
    

    Protobuf type spark.connect.CreateTable

  52. trait CreateTableOrBuilder extends MessageOrBuilder
  53. final class CurrentCatalog extends GeneratedMessageV3 with CurrentCatalogOrBuilder

    See `spark.catalog.currentCatalog`
    

    See `spark.catalog.currentCatalog`
    

    Protobuf type spark.connect.CurrentCatalog

  54. trait CurrentCatalogOrBuilder extends MessageOrBuilder
  55. final class CurrentDatabase extends GeneratedMessageV3 with CurrentDatabaseOrBuilder

    See `spark.catalog.currentDatabase`
    

    See `spark.catalog.currentDatabase`
    

    Protobuf type spark.connect.CurrentDatabase

  56. trait CurrentDatabaseOrBuilder extends MessageOrBuilder
  57. final class DataType extends GeneratedMessageV3 with DataTypeOrBuilder

    This message describes the logical [[DataType]] of something. It does not carry the value
    itself but only describes it.
    

    This message describes the logical [[DataType]] of something. It does not carry the value
    itself but only describes it.
    

    Protobuf type spark.connect.DataType

  58. trait DataTypeOrBuilder extends MessageOrBuilder
  59. final class DatabaseExists extends GeneratedMessageV3 with DatabaseExistsOrBuilder

    See `spark.catalog.databaseExists`
    

    See `spark.catalog.databaseExists`
    

    Protobuf type spark.connect.DatabaseExists

  60. trait DatabaseExistsOrBuilder extends MessageOrBuilder
  61. final class Deduplicate extends GeneratedMessageV3 with DeduplicateOrBuilder

    Relation of type [[Deduplicate]] which have duplicate rows removed, could consider either only
    the subset of columns or all the columns.
    

    Relation of type [[Deduplicate]] which have duplicate rows removed, could consider either only
    the subset of columns or all the columns.
    

    Protobuf type spark.connect.Deduplicate

  62. trait DeduplicateOrBuilder extends MessageOrBuilder
  63. final class Drop extends GeneratedMessageV3 with DropOrBuilder

    Drop specified columns.
    

    Drop specified columns.
    

    Protobuf type spark.connect.Drop

  64. final class DropGlobalTempView extends GeneratedMessageV3 with DropGlobalTempViewOrBuilder

    See `spark.catalog.dropGlobalTempView`
    

    See `spark.catalog.dropGlobalTempView`
    

    Protobuf type spark.connect.DropGlobalTempView

  65. trait DropGlobalTempViewOrBuilder extends MessageOrBuilder
  66. trait DropOrBuilder extends MessageOrBuilder
  67. final class DropTempView extends GeneratedMessageV3 with DropTempViewOrBuilder

    See `spark.catalog.dropTempView`
    

    See `spark.catalog.dropTempView`
    

    Protobuf type spark.connect.DropTempView

  68. trait DropTempViewOrBuilder extends MessageOrBuilder
  69. final class ExamplePluginCommand extends GeneratedMessageV3 with ExamplePluginCommandOrBuilder

    Protobuf type spark.connect.ExamplePluginCommand

  70. trait ExamplePluginCommandOrBuilder extends MessageOrBuilder
  71. final class ExamplePluginExpression extends GeneratedMessageV3 with ExamplePluginExpressionOrBuilder

    Protobuf type spark.connect.ExamplePluginExpression

  72. trait ExamplePluginExpressionOrBuilder extends MessageOrBuilder
  73. final class ExamplePluginRelation extends GeneratedMessageV3 with ExamplePluginRelationOrBuilder

    Protobuf type spark.connect.ExamplePluginRelation

  74. trait ExamplePluginRelationOrBuilder extends MessageOrBuilder
  75. final class ExamplePlugins extends AnyRef
  76. final class ExecutePlanRequest extends GeneratedMessageV3 with ExecutePlanRequestOrBuilder

    A request to be executed by the service.
    

    A request to be executed by the service.
    

    Protobuf type spark.connect.ExecutePlanRequest

  77. trait ExecutePlanRequestOrBuilder extends MessageOrBuilder
  78. final class ExecutePlanResponse extends GeneratedMessageV3 with ExecutePlanResponseOrBuilder

    The response of a query, can be one or more for each request. Responses belonging to the
    same input query, carry the same `session_id`.
    

    The response of a query, can be one or more for each request. Responses belonging to the
    same input query, carry the same `session_id`.
    

    Protobuf type spark.connect.ExecutePlanResponse

  79. trait ExecutePlanResponseOrBuilder extends MessageOrBuilder
  80. final class Expression extends GeneratedMessageV3 with ExpressionOrBuilder

    Expression used to refer to fields, functions and similar. This can be used everywhere
    expressions in SQL appear.
    

    Expression used to refer to fields, functions and similar. This can be used everywhere
    expressions in SQL appear.
    

    Protobuf type spark.connect.Expression

  81. trait ExpressionOrBuilder extends MessageOrBuilder
  82. final class Expressions extends AnyRef
  83. final class Filter extends GeneratedMessageV3 with FilterOrBuilder

    Relation that applies a boolean expression `condition` on each row of `input` to produce
    the output result.
    

    Relation that applies a boolean expression `condition` on each row of `input` to produce
    the output result.
    

    Protobuf type spark.connect.Filter

  84. trait FilterOrBuilder extends MessageOrBuilder
  85. final class FunctionExists extends GeneratedMessageV3 with FunctionExistsOrBuilder

    See `spark.catalog.functionExists`
    

    See `spark.catalog.functionExists`
    

    Protobuf type spark.connect.FunctionExists

  86. trait FunctionExistsOrBuilder extends MessageOrBuilder
  87. final class GetDatabase extends GeneratedMessageV3 with GetDatabaseOrBuilder

    See `spark.catalog.getDatabase`
    

    See `spark.catalog.getDatabase`
    

    Protobuf type spark.connect.GetDatabase

  88. trait GetDatabaseOrBuilder extends MessageOrBuilder
  89. final class GetFunction extends GeneratedMessageV3 with GetFunctionOrBuilder

    See `spark.catalog.getFunction`
    

    See `spark.catalog.getFunction`
    

    Protobuf type spark.connect.GetFunction

  90. trait GetFunctionOrBuilder extends MessageOrBuilder
  91. final class GetResourcesCommand extends GeneratedMessageV3 with GetResourcesCommandOrBuilder

    Command to get the output of 'SparkContext.resources'
    

    Command to get the output of 'SparkContext.resources'
    

    Protobuf type spark.connect.GetResourcesCommand

  92. trait GetResourcesCommandOrBuilder extends MessageOrBuilder
  93. final class GetResourcesCommandResult extends GeneratedMessageV3 with GetResourcesCommandResultOrBuilder

    Response for command 'GetResourcesCommand'.
    

    Response for command 'GetResourcesCommand'.
    

    Protobuf type spark.connect.GetResourcesCommandResult

  94. trait GetResourcesCommandResultOrBuilder extends MessageOrBuilder
  95. final class GetTable extends GeneratedMessageV3 with GetTableOrBuilder

    See `spark.catalog.getTable`
    

    See `spark.catalog.getTable`
    

    Protobuf type spark.connect.GetTable

  96. trait GetTableOrBuilder extends MessageOrBuilder
  97. final class GroupMap extends GeneratedMessageV3 with GroupMapOrBuilder

    Protobuf type spark.connect.GroupMap

  98. trait GroupMapOrBuilder extends MessageOrBuilder
  99. final class Hint extends GeneratedMessageV3 with HintOrBuilder

    Specify a hint over a relation. Hint should have a name and optional parameters.
    

    Specify a hint over a relation. Hint should have a name and optional parameters.
    

    Protobuf type spark.connect.Hint

  100. trait HintOrBuilder extends MessageOrBuilder
  101. final class HtmlString extends GeneratedMessageV3 with HtmlStringOrBuilder

    Compose the string representing rows for output.
    It will invoke 'Dataset.htmlString' to compute the results.
    

    Compose the string representing rows for output.
    It will invoke 'Dataset.htmlString' to compute the results.
    

    Protobuf type spark.connect.HtmlString

  102. trait HtmlStringOrBuilder extends MessageOrBuilder
  103. final class InterruptRequest extends GeneratedMessageV3 with InterruptRequestOrBuilder

    Protobuf type spark.connect.InterruptRequest

  104. trait InterruptRequestOrBuilder extends MessageOrBuilder
  105. final class InterruptResponse extends GeneratedMessageV3 with InterruptResponseOrBuilder

    Protobuf type spark.connect.InterruptResponse

  106. trait InterruptResponseOrBuilder extends MessageOrBuilder
  107. final class IsCached extends GeneratedMessageV3 with IsCachedOrBuilder

    See `spark.catalog.isCached`
    

    See `spark.catalog.isCached`
    

    Protobuf type spark.connect.IsCached

  108. trait IsCachedOrBuilder extends MessageOrBuilder
  109. final class JavaUDF extends GeneratedMessageV3 with JavaUDFOrBuilder

    Protobuf type spark.connect.JavaUDF

  110. trait JavaUDFOrBuilder extends MessageOrBuilder
  111. final class Join extends GeneratedMessageV3 with JoinOrBuilder

    Relation of type [[Join]].
    
    `left` and `right` must be present.
    

    Relation of type [[Join]].
    
    `left` and `right` must be present.
    

    Protobuf type spark.connect.Join

  112. trait JoinOrBuilder extends MessageOrBuilder
  113. final class KeyValue extends GeneratedMessageV3 with KeyValueOrBuilder

    The key-value pair for the config request and response.
    

    The key-value pair for the config request and response.
    

    Protobuf type spark.connect.KeyValue

  114. trait KeyValueOrBuilder extends MessageOrBuilder
  115. final class Limit extends GeneratedMessageV3 with LimitOrBuilder

    Relation of type [[Limit]] that is used to `limit` rows from the input relation.
    

    Relation of type [[Limit]] that is used to `limit` rows from the input relation.
    

    Protobuf type spark.connect.Limit

  116. trait LimitOrBuilder extends MessageOrBuilder
  117. final class ListCatalogs extends GeneratedMessageV3 with ListCatalogsOrBuilder

    See `spark.catalog.listCatalogs`
    

    See `spark.catalog.listCatalogs`
    

    Protobuf type spark.connect.ListCatalogs

  118. trait ListCatalogsOrBuilder extends MessageOrBuilder
  119. final class ListColumns extends GeneratedMessageV3 with ListColumnsOrBuilder

    See `spark.catalog.listColumns`
    

    See `spark.catalog.listColumns`
    

    Protobuf type spark.connect.ListColumns

  120. trait ListColumnsOrBuilder extends MessageOrBuilder
  121. final class ListDatabases extends GeneratedMessageV3 with ListDatabasesOrBuilder

    See `spark.catalog.listDatabases`
    

    See `spark.catalog.listDatabases`
    

    Protobuf type spark.connect.ListDatabases

  122. trait ListDatabasesOrBuilder extends MessageOrBuilder
  123. final class ListFunctions extends GeneratedMessageV3 with ListFunctionsOrBuilder

    See `spark.catalog.listFunctions`
    

    See `spark.catalog.listFunctions`
    

    Protobuf type spark.connect.ListFunctions

  124. trait ListFunctionsOrBuilder extends MessageOrBuilder
  125. final class ListTables extends GeneratedMessageV3 with ListTablesOrBuilder

    See `spark.catalog.listTables`
    

    See `spark.catalog.listTables`
    

    Protobuf type spark.connect.ListTables

  126. trait ListTablesOrBuilder extends MessageOrBuilder
  127. final class LocalRelation extends GeneratedMessageV3 with LocalRelationOrBuilder

    A relation that does not need to be qualified by name.
    

    A relation that does not need to be qualified by name.
    

    Protobuf type spark.connect.LocalRelation

  128. trait LocalRelationOrBuilder extends MessageOrBuilder
  129. final class MapPartitions extends GeneratedMessageV3 with MapPartitionsOrBuilder

    Protobuf type spark.connect.MapPartitions

  130. trait MapPartitionsOrBuilder extends MessageOrBuilder
  131. final class NADrop extends GeneratedMessageV3 with NADropOrBuilder

    Drop rows containing null values.
    It will invoke 'Dataset.na.drop' (same as 'DataFrameNaFunctions.drop') to compute the results.
    

    Drop rows containing null values.
    It will invoke 'Dataset.na.drop' (same as 'DataFrameNaFunctions.drop') to compute the results.
    

    Protobuf type spark.connect.NADrop

  132. trait NADropOrBuilder extends MessageOrBuilder
  133. final class NAFill extends GeneratedMessageV3 with NAFillOrBuilder

    Replaces null values.
    It will invoke 'Dataset.na.fill' (same as 'DataFrameNaFunctions.fill') to compute the results.
    Following 3 parameter combinations are supported:
     1, 'values' only contains 1 item, 'cols' is empty:
       replaces null values in all type-compatible columns.
     2, 'values' only contains 1 item, 'cols' is not empty:
       replaces null values in specified columns.
     3, 'values' contains more than 1 items, then 'cols' is required to have the same length:
       replaces each specified column with corresponding value.
    

    Replaces null values.
    It will invoke 'Dataset.na.fill' (same as 'DataFrameNaFunctions.fill') to compute the results.
    Following 3 parameter combinations are supported:
     1, 'values' only contains 1 item, 'cols' is empty:
       replaces null values in all type-compatible columns.
     2, 'values' only contains 1 item, 'cols' is not empty:
       replaces null values in specified columns.
     3, 'values' contains more than 1 items, then 'cols' is required to have the same length:
       replaces each specified column with corresponding value.
    

    Protobuf type spark.connect.NAFill

  134. trait NAFillOrBuilder extends MessageOrBuilder
  135. final class NAReplace extends GeneratedMessageV3 with NAReplaceOrBuilder

    Replaces old values with the corresponding values.
    It will invoke 'Dataset.na.replace' (same as 'DataFrameNaFunctions.replace')
    to compute the results.
    

    Replaces old values with the corresponding values.
    It will invoke 'Dataset.na.replace' (same as 'DataFrameNaFunctions.replace')
    to compute the results.
    

    Protobuf type spark.connect.NAReplace

  136. trait NAReplaceOrBuilder extends MessageOrBuilder
  137. final class Offset extends GeneratedMessageV3 with OffsetOrBuilder

    Relation of type [[Offset]] that is used to read rows staring from the `offset` on
    the input relation.
    

    Relation of type [[Offset]] that is used to read rows staring from the `offset` on
    the input relation.
    

    Protobuf type spark.connect.Offset

  138. trait OffsetOrBuilder extends MessageOrBuilder
  139. final class Parse extends GeneratedMessageV3 with ParseOrBuilder

    Protobuf type spark.connect.Parse

  140. trait ParseOrBuilder extends MessageOrBuilder
  141. final class Plan extends GeneratedMessageV3 with PlanOrBuilder

    A [[Plan]] is the structure that carries the runtime information for the execution from the
    client to the server. A [[Plan]] can either be of the type [[Relation]] which is a reference
    to the underlying logical plan or it can be of the [[Command]] type that is used to execute
    commands on the server.
    

    A [[Plan]] is the structure that carries the runtime information for the execution from the
    client to the server. A [[Plan]] can either be of the type [[Relation]] which is a reference
    to the underlying logical plan or it can be of the [[Command]] type that is used to execute
    commands on the server.
    

    Protobuf type spark.connect.Plan

  142. trait PlanOrBuilder extends MessageOrBuilder
  143. final class Project extends GeneratedMessageV3 with ProjectOrBuilder

    Projection of a bag of expressions for a given input relation.
    
    The input relation must be specified.
    The projected expression can be an arbitrary expression.
    

    Projection of a bag of expressions for a given input relation.
    
    The input relation must be specified.
    The projected expression can be an arbitrary expression.
    

    Protobuf type spark.connect.Project

  144. trait ProjectOrBuilder extends MessageOrBuilder
  145. final class PythonUDF extends GeneratedMessageV3 with PythonUDFOrBuilder

    Protobuf type spark.connect.PythonUDF

  146. trait PythonUDFOrBuilder extends MessageOrBuilder
  147. final class PythonUDTF extends GeneratedMessageV3 with PythonUDTFOrBuilder

    Protobuf type spark.connect.PythonUDTF

  148. trait PythonUDTFOrBuilder extends MessageOrBuilder
  149. final class Range extends GeneratedMessageV3 with RangeOrBuilder

    Relation of type [[Range]] that generates a sequence of integers.
    

    Relation of type [[Range]] that generates a sequence of integers.
    

    Protobuf type spark.connect.Range

  150. trait RangeOrBuilder extends MessageOrBuilder
  151. final class Read extends GeneratedMessageV3 with ReadOrBuilder

    Relation that reads from a file / table or other data source. Does not have additional
    inputs.
    

    Relation that reads from a file / table or other data source. Does not have additional
    inputs.
    

    Protobuf type spark.connect.Read

  152. trait ReadOrBuilder extends MessageOrBuilder
  153. final class ReattachExecuteRequest extends GeneratedMessageV3 with ReattachExecuteRequestOrBuilder

    Protobuf type spark.connect.ReattachExecuteRequest

  154. trait ReattachExecuteRequestOrBuilder extends MessageOrBuilder
  155. final class ReattachOptions extends GeneratedMessageV3 with ReattachOptionsOrBuilder

    Protobuf type spark.connect.ReattachOptions

  156. trait ReattachOptionsOrBuilder extends MessageOrBuilder
  157. final class RecoverPartitions extends GeneratedMessageV3 with RecoverPartitionsOrBuilder

    See `spark.catalog.recoverPartitions`
    

    See `spark.catalog.recoverPartitions`
    

    Protobuf type spark.connect.RecoverPartitions

  158. trait RecoverPartitionsOrBuilder extends MessageOrBuilder
  159. final class RefreshByPath extends GeneratedMessageV3 with RefreshByPathOrBuilder

    See `spark.catalog.refreshByPath`
    

    See `spark.catalog.refreshByPath`
    

    Protobuf type spark.connect.RefreshByPath

  160. trait RefreshByPathOrBuilder extends MessageOrBuilder
  161. final class RefreshTable extends GeneratedMessageV3 with RefreshTableOrBuilder

    See `spark.catalog.refreshTable`
    

    See `spark.catalog.refreshTable`
    

    Protobuf type spark.connect.RefreshTable

  162. trait RefreshTableOrBuilder extends MessageOrBuilder
  163. final class Relation extends GeneratedMessageV3 with RelationOrBuilder

    The main [[Relation]] type. Fundamentally, a relation is a typed container
    that has exactly one explicit relation type set.
    
    When adding new relation types, they have to be registered here.
    

    The main [[Relation]] type. Fundamentally, a relation is a typed container
    that has exactly one explicit relation type set.
    
    When adding new relation types, they have to be registered here.
    

    Protobuf type spark.connect.Relation

  164. final class RelationCommon extends GeneratedMessageV3 with RelationCommonOrBuilder

    Common metadata of all relations.
    

    Common metadata of all relations.
    

    Protobuf type spark.connect.RelationCommon

  165. trait RelationCommonOrBuilder extends MessageOrBuilder
  166. trait RelationOrBuilder extends MessageOrBuilder
  167. final class Relations extends AnyRef
  168. final class ReleaseExecuteRequest extends GeneratedMessageV3 with ReleaseExecuteRequestOrBuilder

    Protobuf type spark.connect.ReleaseExecuteRequest

  169. trait ReleaseExecuteRequestOrBuilder extends MessageOrBuilder
  170. final class ReleaseExecuteResponse extends GeneratedMessageV3 with ReleaseExecuteResponseOrBuilder

    Protobuf type spark.connect.ReleaseExecuteResponse

  171. trait ReleaseExecuteResponseOrBuilder extends MessageOrBuilder
  172. final class Repartition extends GeneratedMessageV3 with RepartitionOrBuilder

    Relation repartition.
    

    Relation repartition.
    

    Protobuf type spark.connect.Repartition

  173. final class RepartitionByExpression extends GeneratedMessageV3 with RepartitionByExpressionOrBuilder

    Protobuf type spark.connect.RepartitionByExpression

  174. trait RepartitionByExpressionOrBuilder extends MessageOrBuilder
  175. trait RepartitionOrBuilder extends MessageOrBuilder
  176. final class ResourceInformation extends GeneratedMessageV3 with ResourceInformationOrBuilder

    ResourceInformation to hold information about a type of Resource.
    The corresponding class is 'org.apache.spark.resource.ResourceInformation'
    

    ResourceInformation to hold information about a type of Resource.
    The corresponding class is 'org.apache.spark.resource.ResourceInformation'
    

    Protobuf type spark.connect.ResourceInformation

  177. trait ResourceInformationOrBuilder extends MessageOrBuilder
  178. final class SQL extends GeneratedMessageV3 with SQLOrBuilder

    Relation that uses a SQL query to generate the output.
    

    Relation that uses a SQL query to generate the output.
    

    Protobuf type spark.connect.SQL

  179. trait SQLOrBuilder extends MessageOrBuilder
  180. final class Sample extends GeneratedMessageV3 with SampleOrBuilder

    Relation of type [[Sample]] that samples a fraction of the dataset.
    

    Relation of type [[Sample]] that samples a fraction of the dataset.
    

    Protobuf type spark.connect.Sample

  181. trait SampleOrBuilder extends MessageOrBuilder
  182. final class ScalarScalaUDF extends GeneratedMessageV3 with ScalarScalaUDFOrBuilder

    Protobuf type spark.connect.ScalarScalaUDF

  183. trait ScalarScalaUDFOrBuilder extends MessageOrBuilder
  184. final class SetCurrentCatalog extends GeneratedMessageV3 with SetCurrentCatalogOrBuilder

    See `spark.catalog.setCurrentCatalog`
    

    See `spark.catalog.setCurrentCatalog`
    

    Protobuf type spark.connect.SetCurrentCatalog

  185. trait SetCurrentCatalogOrBuilder extends MessageOrBuilder
  186. final class SetCurrentDatabase extends GeneratedMessageV3 with SetCurrentDatabaseOrBuilder

    See `spark.catalog.setCurrentDatabase`
    

    See `spark.catalog.setCurrentDatabase`
    

    Protobuf type spark.connect.SetCurrentDatabase

  187. trait SetCurrentDatabaseOrBuilder extends MessageOrBuilder
  188. final class SetOperation extends GeneratedMessageV3 with SetOperationOrBuilder

    Relation of type [[SetOperation]]
    

    Relation of type [[SetOperation]]
    

    Protobuf type spark.connect.SetOperation

  189. trait SetOperationOrBuilder extends MessageOrBuilder
  190. final class ShowString extends GeneratedMessageV3 with ShowStringOrBuilder

    Compose the string representing rows for output.
    It will invoke 'Dataset.showString' to compute the results.
    

    Compose the string representing rows for output.
    It will invoke 'Dataset.showString' to compute the results.
    

    Protobuf type spark.connect.ShowString

  191. trait ShowStringOrBuilder extends MessageOrBuilder
  192. final class Sort extends GeneratedMessageV3 with SortOrBuilder

    Relation of type [[Sort]].
    

    Relation of type [[Sort]].
    

    Protobuf type spark.connect.Sort

  193. trait SortOrBuilder extends MessageOrBuilder
  194. final class SparkConnectServiceGrpc extends AnyRef

    Main interface for the SparkConnect service.
    

    Main interface for the SparkConnect service.
    

    Annotations
    @Generated() @GrpcGenerated()
  195. final class SqlCommand extends GeneratedMessageV3 with SqlCommandOrBuilder

    A SQL Command is used to trigger the eager evaluation of SQL commands in Spark.
    
    When the SQL provide as part of the message is a command it will be immediately evaluated
    and the result will be collected and returned as part of a LocalRelation. If the result is
    not a command, the operation will simply return a SQL Relation. This allows the client to be
    almost oblivious to the server-side behavior.
    

    A SQL Command is used to trigger the eager evaluation of SQL commands in Spark.
    
    When the SQL provide as part of the message is a command it will be immediately evaluated
    and the result will be collected and returned as part of a LocalRelation. If the result is
    not a command, the operation will simply return a SQL Relation. This allows the client to be
    almost oblivious to the server-side behavior.
    

    Protobuf type spark.connect.SqlCommand

  196. trait SqlCommandOrBuilder extends MessageOrBuilder
  197. final class StatApproxQuantile extends GeneratedMessageV3 with StatApproxQuantileOrBuilder

    Calculates the approximate quantiles of numerical columns of a DataFrame.
    It will invoke 'Dataset.stat.approxQuantile' (same as 'StatFunctions.approxQuantile')
    to compute the results.
    

    Calculates the approximate quantiles of numerical columns of a DataFrame.
    It will invoke 'Dataset.stat.approxQuantile' (same as 'StatFunctions.approxQuantile')
    to compute the results.
    

    Protobuf type spark.connect.StatApproxQuantile

  198. trait StatApproxQuantileOrBuilder extends MessageOrBuilder
  199. final class StatCorr extends GeneratedMessageV3 with StatCorrOrBuilder

    Calculates the correlation of two columns of a DataFrame. Currently only supports the Pearson
    Correlation Coefficient. It will invoke 'Dataset.stat.corr' (same as
    'StatFunctions.pearsonCorrelation') to compute the results.
    

    Calculates the correlation of two columns of a DataFrame. Currently only supports the Pearson
    Correlation Coefficient. It will invoke 'Dataset.stat.corr' (same as
    'StatFunctions.pearsonCorrelation') to compute the results.
    

    Protobuf type spark.connect.StatCorr

  200. trait StatCorrOrBuilder extends MessageOrBuilder
  201. final class StatCov extends GeneratedMessageV3 with StatCovOrBuilder

    Calculate the sample covariance of two numerical columns of a DataFrame.
    It will invoke 'Dataset.stat.cov' (same as 'StatFunctions.calculateCov') to compute the results.
    

    Calculate the sample covariance of two numerical columns of a DataFrame.
    It will invoke 'Dataset.stat.cov' (same as 'StatFunctions.calculateCov') to compute the results.
    

    Protobuf type spark.connect.StatCov

  202. trait StatCovOrBuilder extends MessageOrBuilder
  203. final class StatCrosstab extends GeneratedMessageV3 with StatCrosstabOrBuilder

    Computes a pair-wise frequency table of the given columns. Also known as a contingency table.
    It will invoke 'Dataset.stat.crosstab' (same as 'StatFunctions.crossTabulate')
    to compute the results.
    

    Computes a pair-wise frequency table of the given columns. Also known as a contingency table.
    It will invoke 'Dataset.stat.crosstab' (same as 'StatFunctions.crossTabulate')
    to compute the results.
    

    Protobuf type spark.connect.StatCrosstab

  204. trait StatCrosstabOrBuilder extends MessageOrBuilder
  205. final class StatDescribe extends GeneratedMessageV3 with StatDescribeOrBuilder

    Computes basic statistics for numeric and string columns, including count, mean, stddev, min,
    and max. If no columns are given, this function computes statistics for all numerical or
    string columns.
    

    Computes basic statistics for numeric and string columns, including count, mean, stddev, min,
    and max. If no columns are given, this function computes statistics for all numerical or
    string columns.
    

    Protobuf type spark.connect.StatDescribe

  206. trait StatDescribeOrBuilder extends MessageOrBuilder
  207. final class StatFreqItems extends GeneratedMessageV3 with StatFreqItemsOrBuilder

    Finding frequent items for columns, possibly with false positives.
    It will invoke 'Dataset.stat.freqItems' (same as 'StatFunctions.freqItems')
    to compute the results.
    

    Finding frequent items for columns, possibly with false positives.
    It will invoke 'Dataset.stat.freqItems' (same as 'StatFunctions.freqItems')
    to compute the results.
    

    Protobuf type spark.connect.StatFreqItems

  208. trait StatFreqItemsOrBuilder extends MessageOrBuilder
  209. final class StatSampleBy extends GeneratedMessageV3 with StatSampleByOrBuilder

    Returns a stratified sample without replacement based on the fraction
    given on each stratum.
    It will invoke 'Dataset.stat.freqItems' (same as 'StatFunctions.freqItems')
    to compute the results.
    

    Returns a stratified sample without replacement based on the fraction
    given on each stratum.
    It will invoke 'Dataset.stat.freqItems' (same as 'StatFunctions.freqItems')
    to compute the results.
    

    Protobuf type spark.connect.StatSampleBy

  210. trait StatSampleByOrBuilder extends MessageOrBuilder
  211. final class StatSummary extends GeneratedMessageV3 with StatSummaryOrBuilder

    Computes specified statistics for numeric and string columns.
    It will invoke 'Dataset.summary' (same as 'StatFunctions.summary')
    to compute the results.
    

    Computes specified statistics for numeric and string columns.
    It will invoke 'Dataset.summary' (same as 'StatFunctions.summary')
    to compute the results.
    

    Protobuf type spark.connect.StatSummary

  212. trait StatSummaryOrBuilder extends MessageOrBuilder
  213. final class StorageLevel extends GeneratedMessageV3 with StorageLevelOrBuilder

    StorageLevel for persisting Datasets/Tables.
    

    StorageLevel for persisting Datasets/Tables.
    

    Protobuf type spark.connect.StorageLevel

  214. trait StorageLevelOrBuilder extends MessageOrBuilder
  215. final class StreamingForeachFunction extends GeneratedMessageV3 with StreamingForeachFunctionOrBuilder

    Protobuf type spark.connect.StreamingForeachFunction

  216. trait StreamingForeachFunctionOrBuilder extends MessageOrBuilder
  217. final class StreamingQueryCommand extends GeneratedMessageV3 with StreamingQueryCommandOrBuilder

    Commands for a streaming query.
    

    Commands for a streaming query.
    

    Protobuf type spark.connect.StreamingQueryCommand

  218. trait StreamingQueryCommandOrBuilder extends MessageOrBuilder
  219. final class StreamingQueryCommandResult extends GeneratedMessageV3 with StreamingQueryCommandResultOrBuilder

    Response for commands on a streaming query.
    

    Response for commands on a streaming query.
    

    Protobuf type spark.connect.StreamingQueryCommandResult

  220. trait StreamingQueryCommandResultOrBuilder extends MessageOrBuilder
  221. final class StreamingQueryInstanceId extends GeneratedMessageV3 with StreamingQueryInstanceIdOrBuilder

    A tuple that uniquely identifies an instance of streaming query run. It consists of `id` that
    persists across the streaming runs and `run_id` that changes between each run of the
    streaming query that resumes from the checkpoint.
    

    A tuple that uniquely identifies an instance of streaming query run. It consists of `id` that
    persists across the streaming runs and `run_id` that changes between each run of the
    streaming query that resumes from the checkpoint.
    

    Protobuf type spark.connect.StreamingQueryInstanceId

  222. trait StreamingQueryInstanceIdOrBuilder extends MessageOrBuilder
  223. final class StreamingQueryManagerCommand extends GeneratedMessageV3 with StreamingQueryManagerCommandOrBuilder

    Commands for the streaming query manager.
    

    Commands for the streaming query manager.
    

    Protobuf type spark.connect.StreamingQueryManagerCommand

  224. trait StreamingQueryManagerCommandOrBuilder extends MessageOrBuilder
  225. final class StreamingQueryManagerCommandResult extends GeneratedMessageV3 with StreamingQueryManagerCommandResultOrBuilder

    Response for commands on the streaming query manager.
    

    Response for commands on the streaming query manager.
    

    Protobuf type spark.connect.StreamingQueryManagerCommandResult

  226. trait StreamingQueryManagerCommandResultOrBuilder extends MessageOrBuilder
  227. final class SubqueryAlias extends GeneratedMessageV3 with SubqueryAliasOrBuilder

    Relation alias.
    

    Relation alias.
    

    Protobuf type spark.connect.SubqueryAlias

  228. trait SubqueryAliasOrBuilder extends MessageOrBuilder
  229. final class TableExists extends GeneratedMessageV3 with TableExistsOrBuilder

    See `spark.catalog.tableExists`
    

    See `spark.catalog.tableExists`
    

    Protobuf type spark.connect.TableExists

  230. trait TableExistsOrBuilder extends MessageOrBuilder
  231. final class Tail extends GeneratedMessageV3 with TailOrBuilder

    Relation of type [[Tail]] that is used to fetch `limit` rows from the last of the input relation.
    

    Relation of type [[Tail]] that is used to fetch `limit` rows from the last of the input relation.
    

    Protobuf type spark.connect.Tail

  232. trait TailOrBuilder extends MessageOrBuilder
  233. final class ToDF extends GeneratedMessageV3 with ToDFOrBuilder

    Rename columns on the input relation by the same length of names.
    

    Rename columns on the input relation by the same length of names.
    

    Protobuf type spark.connect.ToDF

  234. trait ToDFOrBuilder extends MessageOrBuilder
  235. final class ToSchema extends GeneratedMessageV3 with ToSchemaOrBuilder

    Protobuf type spark.connect.ToSchema

  236. trait ToSchemaOrBuilder extends MessageOrBuilder
  237. final class Types extends AnyRef
  238. final class UncacheTable extends GeneratedMessageV3 with UncacheTableOrBuilder

    See `spark.catalog.uncacheTable`
    

    See `spark.catalog.uncacheTable`
    

    Protobuf type spark.connect.UncacheTable

  239. trait UncacheTableOrBuilder extends MessageOrBuilder
  240. final class Unknown extends GeneratedMessageV3 with UnknownOrBuilder

    Used for testing purposes only.
    

    Used for testing purposes only.
    

    Protobuf type spark.connect.Unknown

  241. trait UnknownOrBuilder extends MessageOrBuilder
  242. final class Unpivot extends GeneratedMessageV3 with UnpivotOrBuilder

    Unpivot a DataFrame from wide format to long format, optionally leaving identifier columns set.
    

    Unpivot a DataFrame from wide format to long format, optionally leaving identifier columns set.
    

    Protobuf type spark.connect.Unpivot

  243. trait UnpivotOrBuilder extends MessageOrBuilder
  244. final class UserContext extends GeneratedMessageV3 with UserContextOrBuilder

    User Context is used to refer to one particular user session that is executing
    queries in the backend.
    

    User Context is used to refer to one particular user session that is executing
    queries in the backend.
    

    Protobuf type spark.connect.UserContext

  245. trait UserContextOrBuilder extends MessageOrBuilder
  246. final class WithColumns extends GeneratedMessageV3 with WithColumnsOrBuilder

    Adding columns or replacing the existing columns that have the same names.
    

    Adding columns or replacing the existing columns that have the same names.
    

    Protobuf type spark.connect.WithColumns

  247. trait WithColumnsOrBuilder extends MessageOrBuilder
  248. final class WithColumnsRenamed extends GeneratedMessageV3 with WithColumnsRenamedOrBuilder

    Rename columns on the input relation by a map with name to name mapping.
    

    Rename columns on the input relation by a map with name to name mapping.
    

    Protobuf type spark.connect.WithColumnsRenamed

  249. trait WithColumnsRenamedOrBuilder extends MessageOrBuilder
  250. final class WithWatermark extends GeneratedMessageV3 with WithWatermarkOrBuilder

    Protobuf type spark.connect.WithWatermark

  251. trait WithWatermarkOrBuilder extends MessageOrBuilder
  252. final class WriteOperation extends GeneratedMessageV3 with WriteOperationOrBuilder

    As writes are not directly handled during analysis and planning, they are modeled as commands.
    

    As writes are not directly handled during analysis and planning, they are modeled as commands.
    

    Protobuf type spark.connect.WriteOperation

  253. trait WriteOperationOrBuilder extends MessageOrBuilder
  254. final class WriteOperationV2 extends GeneratedMessageV3 with WriteOperationV2OrBuilder

    As writes are not directly handled during analysis and planning, they are modeled as commands.
    

    As writes are not directly handled during analysis and planning, they are modeled as commands.
    

    Protobuf type spark.connect.WriteOperationV2

  255. trait WriteOperationV2OrBuilder extends MessageOrBuilder
  256. final class WriteStreamOperationStart extends GeneratedMessageV3 with WriteStreamOperationStartOrBuilder

    Starts write stream operation as streaming query. Query ID and Run ID of the streaming
    query are returned.
    

    Starts write stream operation as streaming query. Query ID and Run ID of the streaming
    query are returned.
    

    Protobuf type spark.connect.WriteStreamOperationStart

  257. trait WriteStreamOperationStartOrBuilder extends MessageOrBuilder
  258. final class WriteStreamOperationStartResult extends GeneratedMessageV3 with WriteStreamOperationStartResultOrBuilder

    Protobuf type spark.connect.WriteStreamOperationStartResult

  259. trait WriteStreamOperationStartResultOrBuilder extends MessageOrBuilder

Ungrouped