amazonka-kinesisanalyticsv2-2.0: Amazon Kinesis Analytics SDK.
Copyright(c) 2013-2023 Brendan Hay
LicenseMozilla Public License, v. 2.0.
MaintainerBrendan Hay
Stabilityauto-generated
Portabilitynon-portable (GHC extensions)
Safe HaskellSafe-Inferred
LanguageHaskell2010

Amazonka.KinesisAnalyticsV2.DiscoverInputSchema

Description

Infers a schema for a SQL-based Kinesis Data Analytics application by evaluating sample records on the specified streaming source (Kinesis data stream or Kinesis Data Firehose delivery stream) or Amazon S3 object. In the response, the operation returns the inferred schema and also the sample records that the operation used to infer the schema.

You can use the inferred schema when configuring a streaming source for your application. When you create an application using the Kinesis Data Analytics console, the console uses this operation to infer a schema and show it in the console user interface.

Synopsis

Creating a Request

data DiscoverInputSchema Source #

See: newDiscoverInputSchema smart constructor.

Constructors

DiscoverInputSchema' 

Fields

Instances

Instances details
ToJSON DiscoverInputSchema Source # 
Instance details

Defined in Amazonka.KinesisAnalyticsV2.DiscoverInputSchema

ToHeaders DiscoverInputSchema Source # 
Instance details

Defined in Amazonka.KinesisAnalyticsV2.DiscoverInputSchema

ToPath DiscoverInputSchema Source # 
Instance details

Defined in Amazonka.KinesisAnalyticsV2.DiscoverInputSchema

ToQuery DiscoverInputSchema Source # 
Instance details

Defined in Amazonka.KinesisAnalyticsV2.DiscoverInputSchema

AWSRequest DiscoverInputSchema Source # 
Instance details

Defined in Amazonka.KinesisAnalyticsV2.DiscoverInputSchema

Associated Types

type AWSResponse DiscoverInputSchema #

Generic DiscoverInputSchema Source # 
Instance details

Defined in Amazonka.KinesisAnalyticsV2.DiscoverInputSchema

Associated Types

type Rep DiscoverInputSchema :: Type -> Type #

Read DiscoverInputSchema Source # 
Instance details

Defined in Amazonka.KinesisAnalyticsV2.DiscoverInputSchema

Show DiscoverInputSchema Source # 
Instance details

Defined in Amazonka.KinesisAnalyticsV2.DiscoverInputSchema

NFData DiscoverInputSchema Source # 
Instance details

Defined in Amazonka.KinesisAnalyticsV2.DiscoverInputSchema

Methods

rnf :: DiscoverInputSchema -> () #

Eq DiscoverInputSchema Source # 
Instance details

Defined in Amazonka.KinesisAnalyticsV2.DiscoverInputSchema

Hashable DiscoverInputSchema Source # 
Instance details

Defined in Amazonka.KinesisAnalyticsV2.DiscoverInputSchema

type AWSResponse DiscoverInputSchema Source # 
Instance details

Defined in Amazonka.KinesisAnalyticsV2.DiscoverInputSchema

type Rep DiscoverInputSchema Source # 
Instance details

Defined in Amazonka.KinesisAnalyticsV2.DiscoverInputSchema

type Rep DiscoverInputSchema = D1 ('MetaData "DiscoverInputSchema" "Amazonka.KinesisAnalyticsV2.DiscoverInputSchema" "amazonka-kinesisanalyticsv2-2.0-EuRTRS4ROZrHrkll3mMtCB" 'False) (C1 ('MetaCons "DiscoverInputSchema'" 'PrefixI 'True) ((S1 ('MetaSel ('Just "inputProcessingConfiguration") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe InputProcessingConfiguration)) :*: S1 ('MetaSel ('Just "inputStartingPositionConfiguration") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe InputStartingPositionConfiguration))) :*: (S1 ('MetaSel ('Just "resourceARN") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: (S1 ('MetaSel ('Just "s3Configuration") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe S3Configuration)) :*: S1 ('MetaSel ('Just "serviceExecutionRole") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text)))))

newDiscoverInputSchema Source #

Create a value of DiscoverInputSchema with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

DiscoverInputSchema, discoverInputSchema_inputProcessingConfiguration - The InputProcessingConfiguration to use to preprocess the records before discovering the schema of the records.

DiscoverInputSchema, discoverInputSchema_inputStartingPositionConfiguration - The point at which you want Kinesis Data Analytics to start reading records from the specified streaming source discovery purposes.

DiscoverInputSchema, discoverInputSchema_resourceARN - The Amazon Resource Name (ARN) of the streaming source.

$sel:s3Configuration:DiscoverInputSchema', discoverInputSchema_s3Configuration - Specify this parameter to discover a schema from data in an Amazon S3 object.

DiscoverInputSchema, discoverInputSchema_serviceExecutionRole - The ARN of the role that is used to access the streaming source.

Request Lenses

discoverInputSchema_inputProcessingConfiguration :: Lens' DiscoverInputSchema (Maybe InputProcessingConfiguration) Source #

The InputProcessingConfiguration to use to preprocess the records before discovering the schema of the records.

discoverInputSchema_inputStartingPositionConfiguration :: Lens' DiscoverInputSchema (Maybe InputStartingPositionConfiguration) Source #

The point at which you want Kinesis Data Analytics to start reading records from the specified streaming source discovery purposes.

discoverInputSchema_resourceARN :: Lens' DiscoverInputSchema (Maybe Text) Source #

The Amazon Resource Name (ARN) of the streaming source.

discoverInputSchema_s3Configuration :: Lens' DiscoverInputSchema (Maybe S3Configuration) Source #

Specify this parameter to discover a schema from data in an Amazon S3 object.

discoverInputSchema_serviceExecutionRole :: Lens' DiscoverInputSchema Text Source #

The ARN of the role that is used to access the streaming source.

Destructuring the Response

data DiscoverInputSchemaResponse Source #

See: newDiscoverInputSchemaResponse smart constructor.

Constructors

DiscoverInputSchemaResponse' 

Fields

  • inputSchema :: Maybe SourceSchema

    The schema inferred from the streaming source. It identifies the format of the data in the streaming source and how each data element maps to corresponding columns in the in-application stream that you can create.

  • parsedInputRecords :: Maybe [[Text]]

    An array of elements, where each element corresponds to a row in a stream record (a stream record can have more than one row).

  • processedInputRecords :: Maybe [Text]

    The stream data that was modified by the processor specified in the InputProcessingConfiguration parameter.

  • rawInputRecords :: Maybe [Text]

    The raw stream data that was sampled to infer the schema.

  • httpStatus :: Int

    The response's http status code.

Instances

Instances details
Generic DiscoverInputSchemaResponse Source # 
Instance details

Defined in Amazonka.KinesisAnalyticsV2.DiscoverInputSchema

Associated Types

type Rep DiscoverInputSchemaResponse :: Type -> Type #

Read DiscoverInputSchemaResponse Source # 
Instance details

Defined in Amazonka.KinesisAnalyticsV2.DiscoverInputSchema

Show DiscoverInputSchemaResponse Source # 
Instance details

Defined in Amazonka.KinesisAnalyticsV2.DiscoverInputSchema

NFData DiscoverInputSchemaResponse Source # 
Instance details

Defined in Amazonka.KinesisAnalyticsV2.DiscoverInputSchema

Eq DiscoverInputSchemaResponse Source # 
Instance details

Defined in Amazonka.KinesisAnalyticsV2.DiscoverInputSchema

type Rep DiscoverInputSchemaResponse Source # 
Instance details

Defined in Amazonka.KinesisAnalyticsV2.DiscoverInputSchema

type Rep DiscoverInputSchemaResponse = D1 ('MetaData "DiscoverInputSchemaResponse" "Amazonka.KinesisAnalyticsV2.DiscoverInputSchema" "amazonka-kinesisanalyticsv2-2.0-EuRTRS4ROZrHrkll3mMtCB" 'False) (C1 ('MetaCons "DiscoverInputSchemaResponse'" 'PrefixI 'True) ((S1 ('MetaSel ('Just "inputSchema") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe SourceSchema)) :*: S1 ('MetaSel ('Just "parsedInputRecords") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe [[Text]]))) :*: (S1 ('MetaSel ('Just "processedInputRecords") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe [Text])) :*: (S1 ('MetaSel ('Just "rawInputRecords") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe [Text])) :*: S1 ('MetaSel ('Just "httpStatus") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Int)))))

newDiscoverInputSchemaResponse Source #

Create a value of DiscoverInputSchemaResponse with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

DiscoverInputSchemaResponse, discoverInputSchemaResponse_inputSchema - The schema inferred from the streaming source. It identifies the format of the data in the streaming source and how each data element maps to corresponding columns in the in-application stream that you can create.

$sel:parsedInputRecords:DiscoverInputSchemaResponse', discoverInputSchemaResponse_parsedInputRecords - An array of elements, where each element corresponds to a row in a stream record (a stream record can have more than one row).

$sel:processedInputRecords:DiscoverInputSchemaResponse', discoverInputSchemaResponse_processedInputRecords - The stream data that was modified by the processor specified in the InputProcessingConfiguration parameter.

$sel:rawInputRecords:DiscoverInputSchemaResponse', discoverInputSchemaResponse_rawInputRecords - The raw stream data that was sampled to infer the schema.

$sel:httpStatus:DiscoverInputSchemaResponse', discoverInputSchemaResponse_httpStatus - The response's http status code.

Response Lenses

discoverInputSchemaResponse_inputSchema :: Lens' DiscoverInputSchemaResponse (Maybe SourceSchema) Source #

The schema inferred from the streaming source. It identifies the format of the data in the streaming source and how each data element maps to corresponding columns in the in-application stream that you can create.

discoverInputSchemaResponse_parsedInputRecords :: Lens' DiscoverInputSchemaResponse (Maybe [[Text]]) Source #

An array of elements, where each element corresponds to a row in a stream record (a stream record can have more than one row).

discoverInputSchemaResponse_processedInputRecords :: Lens' DiscoverInputSchemaResponse (Maybe [Text]) Source #

The stream data that was modified by the processor specified in the InputProcessingConfiguration parameter.

discoverInputSchemaResponse_rawInputRecords :: Lens' DiscoverInputSchemaResponse (Maybe [Text]) Source #

The raw stream data that was sampled to infer the schema.