io.qdrant.spark

Class QdrantDataWriterFactory

java.lang.Object

io.qdrant.spark.QdrantDataWriterFactory

All Implemented Interfaces:

Serializable, org.apache.spark.sql.connector.write.DataWriterFactory, org.apache.spark.sql.connector.write.streaming.StreamingDataWriterFactory

public class QdrantDataWriterFactory
extends Object
implements org.apache.spark.sql.connector.write.streaming.StreamingDataWriterFactory, org.apache.spark.sql.connector.write.DataWriterFactory

Factory class for creating QdrantDataWriter instances for Spark Structured Streaming.

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
QdrantDataWriterFactory(QdrantOptions options, org.apache.spark.sql.types.StructType schema) Constructor for QdrantDataWriterFactory.

Method Summary

Modifier and Type	Method and Description
QdrantDataWriter	createWriter(int partitionId, long taskId)
QdrantDataWriter	createWriter(int partitionId, long taskId, long epochId)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

QdrantDataWriterFactory

public QdrantDataWriterFactory(QdrantOptions options,
                               org.apache.spark.sql.types.StructType schema)

Constructor for QdrantDataWriterFactory.

Parameters:

options - QdrantOptions instance containing configuration options for Qdrant.

schema - StructType instance containing schema information for the data being written.

Method Detail

createWriter

public QdrantDataWriter createWriter(int partitionId,
                                     long taskId,
                                     long epochId)

Specified by:

createWriter in interface org.apache.spark.sql.connector.write.streaming.StreamingDataWriterFactory

createWriter

public QdrantDataWriter createWriter(int partitionId,
                                     long taskId)

Specified by:

createWriter in interface org.apache.spark.sql.connector.write.DataWriterFactory