amazonka-appflow-2.0: Amazon Appflow SDK.
Copyright(c) 2013-2023 Brendan Hay
LicenseMozilla Public License, v. 2.0.
MaintainerBrendan Hay
Stabilityauto-generated
Portabilitynon-portable (GHC extensions)
Safe HaskellSafe-Inferred
LanguageHaskell2010

Amazonka.AppFlow.Types.S3OutputFormatConfig

Description

 
Synopsis

Documentation

data S3OutputFormatConfig Source #

The configuration that determines how Amazon AppFlow should format the flow output data when Amazon S3 is used as the destination.

See: newS3OutputFormatConfig smart constructor.

Constructors

S3OutputFormatConfig' 

Fields

  • aggregationConfig :: Maybe AggregationConfig
     
  • fileType :: Maybe FileType

    Indicates the file type that Amazon AppFlow places in the Amazon S3 bucket.

  • prefixConfig :: Maybe PrefixConfig

    Determines the prefix that Amazon AppFlow applies to the folder name in the Amazon S3 bucket. You can name folders according to the flow frequency and date.

  • preserveSourceDataTyping :: Maybe Bool

    If your file output format is Parquet, use this parameter to set whether Amazon AppFlow preserves the data types in your source data when it writes the output to Amazon S3.

    • true: Amazon AppFlow preserves the data types when it writes to Amazon S3. For example, an integer or 1 in your source data is still an integer in your output.
    • false: Amazon AppFlow converts all of the source data into strings when it writes to Amazon S3. For example, an integer of 1 in your source data becomes the string "1" in the output.

Instances

Instances details
FromJSON S3OutputFormatConfig Source # 
Instance details

Defined in Amazonka.AppFlow.Types.S3OutputFormatConfig

ToJSON S3OutputFormatConfig Source # 
Instance details

Defined in Amazonka.AppFlow.Types.S3OutputFormatConfig

Generic S3OutputFormatConfig Source # 
Instance details

Defined in Amazonka.AppFlow.Types.S3OutputFormatConfig

Associated Types

type Rep S3OutputFormatConfig :: Type -> Type #

Read S3OutputFormatConfig Source # 
Instance details

Defined in Amazonka.AppFlow.Types.S3OutputFormatConfig

Show S3OutputFormatConfig Source # 
Instance details

Defined in Amazonka.AppFlow.Types.S3OutputFormatConfig

NFData S3OutputFormatConfig Source # 
Instance details

Defined in Amazonka.AppFlow.Types.S3OutputFormatConfig

Methods

rnf :: S3OutputFormatConfig -> () #

Eq S3OutputFormatConfig Source # 
Instance details

Defined in Amazonka.AppFlow.Types.S3OutputFormatConfig

Hashable S3OutputFormatConfig Source # 
Instance details

Defined in Amazonka.AppFlow.Types.S3OutputFormatConfig

type Rep S3OutputFormatConfig Source # 
Instance details

Defined in Amazonka.AppFlow.Types.S3OutputFormatConfig

type Rep S3OutputFormatConfig = D1 ('MetaData "S3OutputFormatConfig" "Amazonka.AppFlow.Types.S3OutputFormatConfig" "amazonka-appflow-2.0-3aJWKTszi6ZKDtrkFSqVAB" 'False) (C1 ('MetaCons "S3OutputFormatConfig'" 'PrefixI 'True) ((S1 ('MetaSel ('Just "aggregationConfig") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe AggregationConfig)) :*: S1 ('MetaSel ('Just "fileType") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe FileType))) :*: (S1 ('MetaSel ('Just "prefixConfig") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe PrefixConfig)) :*: S1 ('MetaSel ('Just "preserveSourceDataTyping") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Bool)))))

newS3OutputFormatConfig :: S3OutputFormatConfig Source #

Create a value of S3OutputFormatConfig with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:aggregationConfig:S3OutputFormatConfig', s3OutputFormatConfig_aggregationConfig - Undocumented member.

$sel:fileType:S3OutputFormatConfig', s3OutputFormatConfig_fileType - Indicates the file type that Amazon AppFlow places in the Amazon S3 bucket.

$sel:prefixConfig:S3OutputFormatConfig', s3OutputFormatConfig_prefixConfig - Determines the prefix that Amazon AppFlow applies to the folder name in the Amazon S3 bucket. You can name folders according to the flow frequency and date.

$sel:preserveSourceDataTyping:S3OutputFormatConfig', s3OutputFormatConfig_preserveSourceDataTyping - If your file output format is Parquet, use this parameter to set whether Amazon AppFlow preserves the data types in your source data when it writes the output to Amazon S3.

  • true: Amazon AppFlow preserves the data types when it writes to Amazon S3. For example, an integer or 1 in your source data is still an integer in your output.
  • false: Amazon AppFlow converts all of the source data into strings when it writes to Amazon S3. For example, an integer of 1 in your source data becomes the string "1" in the output.

s3OutputFormatConfig_fileType :: Lens' S3OutputFormatConfig (Maybe FileType) Source #

Indicates the file type that Amazon AppFlow places in the Amazon S3 bucket.

s3OutputFormatConfig_prefixConfig :: Lens' S3OutputFormatConfig (Maybe PrefixConfig) Source #

Determines the prefix that Amazon AppFlow applies to the folder name in the Amazon S3 bucket. You can name folders according to the flow frequency and date.

s3OutputFormatConfig_preserveSourceDataTyping :: Lens' S3OutputFormatConfig (Maybe Bool) Source #

If your file output format is Parquet, use this parameter to set whether Amazon AppFlow preserves the data types in your source data when it writes the output to Amazon S3.

  • true: Amazon AppFlow preserves the data types when it writes to Amazon S3. For example, an integer or 1 in your source data is still an integer in your output.
  • false: Amazon AppFlow converts all of the source data into strings when it writes to Amazon S3. For example, an integer of 1 in your source data becomes the string "1" in the output.