Function render_upload_operator

fn render_upload_operator<G, T>(
    scope: G,
    connection_context: ConnectionContext,
    aws_connection: AwsConnection,
    connection_id: CatalogItemId,
    connection_details: S3UploadInfo,
    sink_id: GlobalId,
    input_collection: Stream<G, Vec<TimelyStack<((Row, ()), G::Timestamp, Diff)>>>,
    up_to: Antichain<G::Timestamp>,
    start_stream: Stream<G, Result<(), String>>,
    params: CopyToParameters,
    output_batch_count: u64,
) -> (Stream<G, Result<u64, String>>, PressOnDropButton)
where
    G: Scope<Timestamp = Timestamp>,
    T: CopyToS3Uploader,

Renders the upload operator, which waits on the start_stream to ensure initialization is complete and then handles the uploads to S3. Returns a completion_stream which contains 1 event per worker of the result of the upload operation, either an error or the number of rows uploaded by the worker.

The input_collection must be a stream of chains, partitioned and exchanged by the row’s hash modulo the number of batches.