Copyright	(c) 2013-2023 Brendan Hay
License	Mozilla Public License, v. 2.0.
Maintainer	Brendan Hay
Stability	auto-generated
Portability	non-portable (GHC extensions)
Safe Haskell	Safe-Inferred
Language	Haskell2010

Amazonka.Glue.Types.CodeGenConfigurationNode

Description

Synopsis

Documentation

data CodeGenConfigurationNode Source #

CodeGenConfigurationNode enumerates all valid Node types. One and only one of its member variables can be populated.

See: newCodeGenConfigurationNode smart constructor.

Constructors

CodeGenConfigurationNode'

Fields

aggregate :: Maybe Aggregate
Specifies a transform that groups rows by chosen fields and computes the aggregated value by specified function.
applyMapping :: Maybe ApplyMapping
Specifies a transform that maps data property keys in the data source to data property keys in the data target. You can rename keys, modify the data types for keys, and choose which keys to drop from the dataset.
athenaConnectorSource :: Maybe AthenaConnectorSource
Specifies a connector to an Amazon Athena data source.
catalogKafkaSource :: Maybe CatalogKafkaSource
Specifies an Apache Kafka data store in the Data Catalog.
catalogKinesisSource :: Maybe CatalogKinesisSource
Specifies a Kinesis data source in the Glue Data Catalog.
catalogSource :: Maybe CatalogSource
Specifies a data store in the Glue Data Catalog.
catalogTarget :: Maybe BasicCatalogTarget
Specifies a target that uses a Glue Data Catalog table.
customCode :: Maybe CustomCode
Specifies a transform that uses custom code you provide to perform the data transformation. The output is a collection of DynamicFrames.
directKafkaSource :: Maybe DirectKafkaSource
Specifies an Apache Kafka data store.
directKinesisSource :: Maybe DirectKinesisSource
Specifies a direct Amazon Kinesis data source.
dropDuplicates :: Maybe DropDuplicates
Specifies a transform that removes rows of repeating data from a data set.
dropFields :: Maybe DropFields
Specifies a transform that chooses the data property keys that you want to drop.
dropNullFields :: Maybe DropNullFields
Specifies a transform that removes columns from the dataset if all values in the column are 'null'. By default, Glue Studio will recognize null objects, but some values such as empty strings, strings that are "null", -1 integers or other placeholders such as zeros, are not automatically recognized as nulls.
dynamicTransform :: Maybe DynamicTransform
Specifies a custom visual transform created by a user.
dynamoDBCatalogSource :: Maybe DynamoDBCatalogSource
evaluateDataQuality :: Maybe EvaluateDataQuality
Specifies your data quality evaluation criteria.
fillMissingValues :: Maybe FillMissingValues
Specifies a transform that locates records in the dataset that have missing values and adds a new field with a value determined by imputation. The input data set is used to train the machine learning model that determines what the missing value should be.
filter' :: Maybe Filter
Specifies a transform that splits a dataset into two, based on a filter condition.
governedCatalogSource :: Maybe GovernedCatalogSource
Specifies a data source in a goverened Data Catalog.
governedCatalogTarget :: Maybe GovernedCatalogTarget
Specifies a data target that writes to a goverened catalog.
jDBCConnectorSource :: Maybe JDBCConnectorSource
Specifies a connector to a JDBC data source.
jDBCConnectorTarget :: Maybe JDBCConnectorTarget
Specifies a data target that writes to Amazon S3 in Apache Parquet columnar storage.
join :: Maybe Join
Specifies a transform that joins two datasets into one dataset using a comparison phrase on the specified data property keys. You can use inner, outer, left, right, left semi, and left anti joins.
merge :: Maybe Merge
Specifies a transform that merges a DynamicFrame with a staging DynamicFrame based on the specified primary keys to identify records. Duplicate records (records with the same primary keys) are not de-duplicated.
microsoftSQLServerCatalogSource :: Maybe MicrosoftSQLServerCatalogSource
Specifies a Microsoft SQL server data source in the Glue Data Catalog.
microsoftSQLServerCatalogTarget :: Maybe MicrosoftSQLServerCatalogTarget
Specifies a target that uses Microsoft SQL.
mySQLCatalogSource :: Maybe MySQLCatalogSource
Specifies a MySQL data source in the Glue Data Catalog.
mySQLCatalogTarget :: Maybe MySQLCatalogTarget
Specifies a target that uses MySQL.
oracleSQLCatalogSource :: Maybe OracleSQLCatalogSource
Specifies an Oracle data source in the Glue Data Catalog.
oracleSQLCatalogTarget :: Maybe OracleSQLCatalogTarget
Specifies a target that uses Oracle SQL.
pIIDetection :: Maybe PIIDetection
Specifies a transform that identifies, removes or masks PII data.
postgreSQLCatalogSource :: Maybe PostgreSQLCatalogSource
Specifies a PostgresSQL data source in the Glue Data Catalog.
postgreSQLCatalogTarget :: Maybe PostgreSQLCatalogTarget
Specifies a target that uses Postgres SQL.
redshiftSource :: Maybe RedshiftSource
Specifies an Amazon Redshift data store.
redshiftTarget :: Maybe RedshiftTarget
Specifies a target that uses Amazon Redshift.
relationalCatalogSource :: Maybe RelationalCatalogSource
renameField :: Maybe RenameField
Specifies a transform that renames a single data property key.
s3CatalogSource :: Maybe S3CatalogSource
Specifies an Amazon S3 data store in the Glue Data Catalog.
s3CatalogTarget :: Maybe S3CatalogTarget
Specifies a data target that writes to Amazon S3 using the Glue Data Catalog.
s3CsvSource :: Maybe S3CsvSource
Specifies a command-separated value (CSV) data store stored in Amazon S3.
s3DirectTarget :: Maybe S3DirectTarget
Specifies a data target that writes to Amazon S3.
s3GlueParquetTarget :: Maybe S3GlueParquetTarget
Specifies a data target that writes to Amazon S3 in Apache Parquet columnar storage.
s3JsonSource :: Maybe S3JsonSource
Specifies a JSON data store stored in Amazon S3.
s3ParquetSource :: Maybe S3ParquetSource
Specifies an Apache Parquet data store stored in Amazon S3.
selectFields :: Maybe SelectFields
Specifies a transform that chooses the data property keys that you want to keep.
selectFromCollection :: Maybe SelectFromCollection
Specifies a transform that chooses one DynamicFrame from a collection of DynamicFrames. The output is the selected DynamicFrame
sparkConnectorSource :: Maybe SparkConnectorSource
Specifies a connector to an Apache Spark data source.
sparkConnectorTarget :: Maybe SparkConnectorTarget
Specifies a target that uses an Apache Spark connector.
sparkSQL :: Maybe SparkSQL
Specifies a transform where you enter a SQL query using Spark SQL syntax to transform the data. The output is a single DynamicFrame.
spigot :: Maybe Spigot
Specifies a transform that writes samples of the data to an Amazon S3 bucket.
splitFields :: Maybe SplitFields
Specifies a transform that splits data property keys into two DynamicFrames. The output is a collection of DynamicFrames: one with selected data property keys, and one with the remaining data property keys.
union :: Maybe Union
Specifies a transform that combines the rows from two or more datasets into a single result.

Instances

Instances details

FromJSON CodeGenConfigurationNode Source #
Instance details Defined in Amazonka.Glue.Types.CodeGenConfigurationNode Methods parseJSON :: Value -> Parser CodeGenConfigurationNode # parseJSONList :: Value -> Parser [CodeGenConfigurationNode] #
ToJSON CodeGenConfigurationNode Source #
Instance details Defined in Amazonka.Glue.Types.CodeGenConfigurationNode Methods toJSON :: CodeGenConfigurationNode -> Value # toEncoding :: CodeGenConfigurationNode -> Encoding # toJSONList :: [CodeGenConfigurationNode] -> Value # toEncodingList :: [CodeGenConfigurationNode] -> Encoding #
Generic CodeGenConfigurationNode Source #
Instance details Defined in Amazonka.Glue.Types.CodeGenConfigurationNode Associated Types type Rep CodeGenConfigurationNode :: Type -> Type # Methods from :: CodeGenConfigurationNode -> Rep CodeGenConfigurationNode x # to :: Rep CodeGenConfigurationNode x -> CodeGenConfigurationNode #
Read CodeGenConfigurationNode Source #
Instance details Defined in Amazonka.Glue.Types.CodeGenConfigurationNode Methods readsPrec :: Int -> ReadS CodeGenConfigurationNode # readList :: ReadS [CodeGenConfigurationNode] # readPrec :: ReadPrec CodeGenConfigurationNode # readListPrec :: ReadPrec [CodeGenConfigurationNode] #
Show CodeGenConfigurationNode Source #
Instance details Defined in Amazonka.Glue.Types.CodeGenConfigurationNode Methods showsPrec :: Int -> CodeGenConfigurationNode -> ShowS # show :: CodeGenConfigurationNode -> String # showList :: [CodeGenConfigurationNode] -> ShowS #
NFData CodeGenConfigurationNode Source #
Instance details Defined in Amazonka.Glue.Types.CodeGenConfigurationNode Methods rnf :: CodeGenConfigurationNode -> () #
Eq CodeGenConfigurationNode Source #
Instance details Defined in Amazonka.Glue.Types.CodeGenConfigurationNode Methods (==) :: CodeGenConfigurationNode -> CodeGenConfigurationNode -> Bool # (/=) :: CodeGenConfigurationNode -> CodeGenConfigurationNode -> Bool #
Hashable CodeGenConfigurationNode Source #
Instance details Defined in Amazonka.Glue.Types.CodeGenConfigurationNode Methods hashWithSalt :: Int -> CodeGenConfigurationNode -> Int # hash :: CodeGenConfigurationNode -> Int #
type Rep CodeGenConfigurationNode Source #
Instance details Defined in Amazonka.Glue.Types.CodeGenConfigurationNode type Rep CodeGenConfigurationNode = D1 ('MetaData "CodeGenConfigurationNode" "Amazonka.Glue.Types.CodeGenConfigurationNode" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "CodeGenConfigurationNode'" 'PrefixI 'True) (((((S1 ('MetaSel ('Just "aggregate") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Aggregate)) :: (S1 ('MetaSel ('Just "applyMapping") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe ApplyMapping)) :: S1 ('MetaSel ('Just "athenaConnectorSource") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe AthenaConnectorSource)))) :: (S1 ('MetaSel ('Just "catalogKafkaSource") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe CatalogKafkaSource)) :: (S1 ('MetaSel ('Just "catalogKinesisSource") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe CatalogKinesisSource)) :: S1 ('MetaSel ('Just "catalogSource") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe CatalogSource))))) :: ((S1 ('MetaSel ('Just "catalogTarget") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe BasicCatalogTarget)) :: (S1 ('MetaSel ('Just "customCode") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe CustomCode)) :: S1 ('MetaSel ('Just "directKafkaSource") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe DirectKafkaSource)))) :: ((S1 ('MetaSel ('Just "directKinesisSource") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe DirectKinesisSource)) :: S1 ('MetaSel ('Just "dropDuplicates") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe DropDuplicates))) :: (S1 ('MetaSel ('Just "dropFields") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe DropFields)) :: S1 ('MetaSel ('Just "dropNullFields") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe DropNullFields)))))) :: (((S1 ('MetaSel ('Just "dynamicTransform") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe DynamicTransform)) :: (S1 ('MetaSel ('Just "dynamoDBCatalogSource") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe DynamoDBCatalogSource)) :: S1 ('MetaSel ('Just "evaluateDataQuality") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe EvaluateDataQuality)))) :: (S1 ('MetaSel ('Just "fillMissingValues") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe FillMissingValues)) :: (S1 ('MetaSel ('Just "filter'") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Filter)) :: S1 ('MetaSel ('Just "governedCatalogSource") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe GovernedCatalogSource))))) :: ((S1 ('MetaSel ('Just "governedCatalogTarget") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe GovernedCatalogTarget)) :: (S1 ('MetaSel ('Just "jDBCConnectorSource") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe JDBCConnectorSource)) :: S1 ('MetaSel ('Just "jDBCConnectorTarget") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe JDBCConnectorTarget)))) :: ((S1 ('MetaSel ('Just "join") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Join)) :: S1 ('MetaSel ('Just "merge") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Merge))) :: (S1 ('MetaSel ('Just "microsoftSQLServerCatalogSource") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe MicrosoftSQLServerCatalogSource)) :: S1 ('MetaSel ('Just "microsoftSQLServerCatalogTarget") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe MicrosoftSQLServerCatalogTarget))))))) :: ((((S1 ('MetaSel ('Just "mySQLCatalogSource") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe MySQLCatalogSource)) :: (S1 ('MetaSel ('Just "mySQLCatalogTarget") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe MySQLCatalogTarget)) :: S1 ('MetaSel ('Just "oracleSQLCatalogSource") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe OracleSQLCatalogSource)))) :: (S1 ('MetaSel ('Just "oracleSQLCatalogTarget") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe OracleSQLCatalogTarget)) :: (S1 ('MetaSel ('Just "pIIDetection") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe PIIDetection)) :: S1 ('MetaSel ('Just "postgreSQLCatalogSource") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe PostgreSQLCatalogSource))))) :: ((S1 ('MetaSel ('Just "postgreSQLCatalogTarget") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe PostgreSQLCatalogTarget)) :: (S1 ('MetaSel ('Just "redshiftSource") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe RedshiftSource)) :: S1 ('MetaSel ('Just "redshiftTarget") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe RedshiftTarget)))) :: ((S1 ('MetaSel ('Just "relationalCatalogSource") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe RelationalCatalogSource)) :: S1 ('MetaSel ('Just "renameField") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe RenameField))) :: (S1 ('MetaSel ('Just "s3CatalogSource") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe S3CatalogSource)) :: S1 ('MetaSel ('Just "s3CatalogTarget") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe S3CatalogTarget)))))) :: (((S1 ('MetaSel ('Just "s3CsvSource") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe S3CsvSource)) :: (S1 ('MetaSel ('Just "s3DirectTarget") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe S3DirectTarget)) :: S1 ('MetaSel ('Just "s3GlueParquetTarget") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe S3GlueParquetTarget)))) :: (S1 ('MetaSel ('Just "s3JsonSource") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe S3JsonSource)) :: (S1 ('MetaSel ('Just "s3ParquetSource") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe S3ParquetSource)) :: S1 ('MetaSel ('Just "selectFields") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe SelectFields))))) :: ((S1 ('MetaSel ('Just "selectFromCollection") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe SelectFromCollection)) :: (S1 ('MetaSel ('Just "sparkConnectorSource") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe SparkConnectorSource)) :: S1 ('MetaSel ('Just "sparkConnectorTarget") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe SparkConnectorTarget)))) :: ((S1 ('MetaSel ('Just "sparkSQL") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe SparkSQL)) :: S1 ('MetaSel ('Just "spigot") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Spigot))) :: (S1 ('MetaSel ('Just "splitFields") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe SplitFields)) :*: S1 ('MetaSel ('Just "union") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Union)))))))))

newCodeGenConfigurationNode :: CodeGenConfigurationNode Source #

Create a value of CodeGenConfigurationNode with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:aggregate:CodeGenConfigurationNode', codeGenConfigurationNode_aggregate - Specifies a transform that groups rows by chosen fields and computes the aggregated value by specified function.

$sel:applyMapping:CodeGenConfigurationNode', codeGenConfigurationNode_applyMapping - Specifies a transform that maps data property keys in the data source to data property keys in the data target. You can rename keys, modify the data types for keys, and choose which keys to drop from the dataset.

$sel:athenaConnectorSource:CodeGenConfigurationNode', codeGenConfigurationNode_athenaConnectorSource - Specifies a connector to an Amazon Athena data source.

$sel:catalogKafkaSource:CodeGenConfigurationNode', codeGenConfigurationNode_catalogKafkaSource - Specifies an Apache Kafka data store in the Data Catalog.

$sel:catalogKinesisSource:CodeGenConfigurationNode', codeGenConfigurationNode_catalogKinesisSource - Specifies a Kinesis data source in the Glue Data Catalog.

$sel:catalogSource:CodeGenConfigurationNode', codeGenConfigurationNode_catalogSource - Specifies a data store in the Glue Data Catalog.

$sel:catalogTarget:CodeGenConfigurationNode', codeGenConfigurationNode_catalogTarget - Specifies a target that uses a Glue Data Catalog table.

$sel:customCode:CodeGenConfigurationNode', codeGenConfigurationNode_customCode - Specifies a transform that uses custom code you provide to perform the data transformation. The output is a collection of DynamicFrames.

$sel:directKafkaSource:CodeGenConfigurationNode', codeGenConfigurationNode_directKafkaSource - Specifies an Apache Kafka data store.

$sel:directKinesisSource:CodeGenConfigurationNode', codeGenConfigurationNode_directKinesisSource - Specifies a direct Amazon Kinesis data source.

$sel:dropDuplicates:CodeGenConfigurationNode', codeGenConfigurationNode_dropDuplicates - Specifies a transform that removes rows of repeating data from a data set.

$sel:dropFields:CodeGenConfigurationNode', codeGenConfigurationNode_dropFields - Specifies a transform that chooses the data property keys that you want to drop.

$sel:dropNullFields:CodeGenConfigurationNode', codeGenConfigurationNode_dropNullFields - Specifies a transform that removes columns from the dataset if all values in the column are 'null'. By default, Glue Studio will recognize null objects, but some values such as empty strings, strings that are "null", -1 integers or other placeholders such as zeros, are not automatically recognized as nulls.

$sel:dynamicTransform:CodeGenConfigurationNode', codeGenConfigurationNode_dynamicTransform - Specifies a custom visual transform created by a user.

$sel:dynamoDBCatalogSource:CodeGenConfigurationNode', codeGenConfigurationNode_dynamoDBCatalogSource - Undocumented member.

$sel:evaluateDataQuality:CodeGenConfigurationNode', codeGenConfigurationNode_evaluateDataQuality - Specifies your data quality evaluation criteria.

$sel:fillMissingValues:CodeGenConfigurationNode', codeGenConfigurationNode_fillMissingValues - Specifies a transform that locates records in the dataset that have missing values and adds a new field with a value determined by imputation. The input data set is used to train the machine learning model that determines what the missing value should be.

$sel:filter':CodeGenConfigurationNode', codeGenConfigurationNode_filter - Specifies a transform that splits a dataset into two, based on a filter condition.

$sel:governedCatalogSource:CodeGenConfigurationNode', codeGenConfigurationNode_governedCatalogSource - Specifies a data source in a goverened Data Catalog.

$sel:governedCatalogTarget:CodeGenConfigurationNode', codeGenConfigurationNode_governedCatalogTarget - Specifies a data target that writes to a goverened catalog.

$sel:jDBCConnectorSource:CodeGenConfigurationNode', codeGenConfigurationNode_jDBCConnectorSource - Specifies a connector to a JDBC data source.

$sel:jDBCConnectorTarget:CodeGenConfigurationNode', codeGenConfigurationNode_jDBCConnectorTarget - Specifies a data target that writes to Amazon S3 in Apache Parquet columnar storage.

$sel:join:CodeGenConfigurationNode', codeGenConfigurationNode_join - Specifies a transform that joins two datasets into one dataset using a comparison phrase on the specified data property keys. You can use inner, outer, left, right, left semi, and left anti joins.

$sel:merge:CodeGenConfigurationNode', codeGenConfigurationNode_merge - Specifies a transform that merges a DynamicFrame with a staging DynamicFrame based on the specified primary keys to identify records. Duplicate records (records with the same primary keys) are not de-duplicated.

$sel:microsoftSQLServerCatalogSource:CodeGenConfigurationNode', codeGenConfigurationNode_microsoftSQLServerCatalogSource - Specifies a Microsoft SQL server data source in the Glue Data Catalog.

$sel:microsoftSQLServerCatalogTarget:CodeGenConfigurationNode', codeGenConfigurationNode_microsoftSQLServerCatalogTarget - Specifies a target that uses Microsoft SQL.

$sel:mySQLCatalogSource:CodeGenConfigurationNode', codeGenConfigurationNode_mySQLCatalogSource - Specifies a MySQL data source in the Glue Data Catalog.

$sel:mySQLCatalogTarget:CodeGenConfigurationNode', codeGenConfigurationNode_mySQLCatalogTarget - Specifies a target that uses MySQL.

$sel:oracleSQLCatalogSource:CodeGenConfigurationNode', codeGenConfigurationNode_oracleSQLCatalogSource - Specifies an Oracle data source in the Glue Data Catalog.

$sel:oracleSQLCatalogTarget:CodeGenConfigurationNode', codeGenConfigurationNode_oracleSQLCatalogTarget - Specifies a target that uses Oracle SQL.

$sel:pIIDetection:CodeGenConfigurationNode', codeGenConfigurationNode_pIIDetection - Specifies a transform that identifies, removes or masks PII data.

$sel:postgreSQLCatalogSource:CodeGenConfigurationNode', codeGenConfigurationNode_postgreSQLCatalogSource - Specifies a PostgresSQL data source in the Glue Data Catalog.

$sel:postgreSQLCatalogTarget:CodeGenConfigurationNode', codeGenConfigurationNode_postgreSQLCatalogTarget - Specifies a target that uses Postgres SQL.

$sel:redshiftSource:CodeGenConfigurationNode', codeGenConfigurationNode_redshiftSource - Specifies an Amazon Redshift data store.

$sel:redshiftTarget:CodeGenConfigurationNode', codeGenConfigurationNode_redshiftTarget - Specifies a target that uses Amazon Redshift.

$sel:relationalCatalogSource:CodeGenConfigurationNode', codeGenConfigurationNode_relationalCatalogSource - Undocumented member.

$sel:renameField:CodeGenConfigurationNode', codeGenConfigurationNode_renameField - Specifies a transform that renames a single data property key.

$sel:s3CatalogSource:CodeGenConfigurationNode', codeGenConfigurationNode_s3CatalogSource - Specifies an Amazon S3 data store in the Glue Data Catalog.

$sel:s3CatalogTarget:CodeGenConfigurationNode', codeGenConfigurationNode_s3CatalogTarget - Specifies a data target that writes to Amazon S3 using the Glue Data Catalog.

$sel:s3CsvSource:CodeGenConfigurationNode', codeGenConfigurationNode_s3CsvSource - Specifies a command-separated value (CSV) data store stored in Amazon S3.

$sel:s3DirectTarget:CodeGenConfigurationNode', codeGenConfigurationNode_s3DirectTarget - Specifies a data target that writes to Amazon S3.

$sel:s3GlueParquetTarget:CodeGenConfigurationNode', codeGenConfigurationNode_s3GlueParquetTarget - Specifies a data target that writes to Amazon S3 in Apache Parquet columnar storage.

$sel:s3JsonSource:CodeGenConfigurationNode', codeGenConfigurationNode_s3JsonSource - Specifies a JSON data store stored in Amazon S3.

$sel:s3ParquetSource:CodeGenConfigurationNode', codeGenConfigurationNode_s3ParquetSource - Specifies an Apache Parquet data store stored in Amazon S3.

$sel:selectFields:CodeGenConfigurationNode', codeGenConfigurationNode_selectFields - Specifies a transform that chooses the data property keys that you want to keep.

$sel:selectFromCollection:CodeGenConfigurationNode', codeGenConfigurationNode_selectFromCollection - Specifies a transform that chooses one DynamicFrame from a collection of DynamicFrames. The output is the selected DynamicFrame

$sel:sparkConnectorSource:CodeGenConfigurationNode', codeGenConfigurationNode_sparkConnectorSource - Specifies a connector to an Apache Spark data source.

$sel:sparkConnectorTarget:CodeGenConfigurationNode', codeGenConfigurationNode_sparkConnectorTarget - Specifies a target that uses an Apache Spark connector.

$sel:sparkSQL:CodeGenConfigurationNode', codeGenConfigurationNode_sparkSQL - Specifies a transform where you enter a SQL query using Spark SQL syntax to transform the data. The output is a single DynamicFrame.

$sel:spigot:CodeGenConfigurationNode', codeGenConfigurationNode_spigot - Specifies a transform that writes samples of the data to an Amazon S3 bucket.

$sel:splitFields:CodeGenConfigurationNode', codeGenConfigurationNode_splitFields - Specifies a transform that splits data property keys into two DynamicFrames. The output is a collection of DynamicFrames: one with selected data property keys, and one with the remaining data property keys.

$sel:union:CodeGenConfigurationNode', codeGenConfigurationNode_union - Specifies a transform that combines the rows from two or more datasets into a single result.

codeGenConfigurationNode_aggregate :: Lens' CodeGenConfigurationNode (Maybe Aggregate) Source #

Specifies a transform that groups rows by chosen fields and computes the aggregated value by specified function.

codeGenConfigurationNode_applyMapping :: Lens' CodeGenConfigurationNode (Maybe ApplyMapping) Source #

Specifies a transform that maps data property keys in the data source to data property keys in the data target. You can rename keys, modify the data types for keys, and choose which keys to drop from the dataset.

codeGenConfigurationNode_athenaConnectorSource :: Lens' CodeGenConfigurationNode (Maybe AthenaConnectorSource) Source #

Specifies a connector to an Amazon Athena data source.

codeGenConfigurationNode_catalogKafkaSource :: Lens' CodeGenConfigurationNode (Maybe CatalogKafkaSource) Source #

Specifies an Apache Kafka data store in the Data Catalog.

codeGenConfigurationNode_catalogKinesisSource :: Lens' CodeGenConfigurationNode (Maybe CatalogKinesisSource) Source #

Specifies a Kinesis data source in the Glue Data Catalog.

codeGenConfigurationNode_catalogSource :: Lens' CodeGenConfigurationNode (Maybe CatalogSource) Source #

Specifies a data store in the Glue Data Catalog.

codeGenConfigurationNode_catalogTarget :: Lens' CodeGenConfigurationNode (Maybe BasicCatalogTarget) Source #

Specifies a target that uses a Glue Data Catalog table.

codeGenConfigurationNode_customCode :: Lens' CodeGenConfigurationNode (Maybe CustomCode) Source #

Specifies a transform that uses custom code you provide to perform the data transformation. The output is a collection of DynamicFrames.

codeGenConfigurationNode_directKafkaSource :: Lens' CodeGenConfigurationNode (Maybe DirectKafkaSource) Source #

Specifies an Apache Kafka data store.

codeGenConfigurationNode_directKinesisSource :: Lens' CodeGenConfigurationNode (Maybe DirectKinesisSource) Source #

Specifies a direct Amazon Kinesis data source.

codeGenConfigurationNode_dropDuplicates :: Lens' CodeGenConfigurationNode (Maybe DropDuplicates) Source #

Specifies a transform that removes rows of repeating data from a data set.

codeGenConfigurationNode_dropFields :: Lens' CodeGenConfigurationNode (Maybe DropFields) Source #

Specifies a transform that chooses the data property keys that you want to drop.

codeGenConfigurationNode_dropNullFields :: Lens' CodeGenConfigurationNode (Maybe DropNullFields) Source #

Specifies a transform that removes columns from the dataset if all values in the column are 'null'. By default, Glue Studio will recognize null objects, but some values such as empty strings, strings that are "null", -1 integers or other placeholders such as zeros, are not automatically recognized as nulls.

codeGenConfigurationNode_dynamicTransform :: Lens' CodeGenConfigurationNode (Maybe DynamicTransform) Source #

Specifies a custom visual transform created by a user.

codeGenConfigurationNode_dynamoDBCatalogSource :: Lens' CodeGenConfigurationNode (Maybe DynamoDBCatalogSource) Source #

Undocumented member.

codeGenConfigurationNode_evaluateDataQuality :: Lens' CodeGenConfigurationNode (Maybe EvaluateDataQuality) Source #

Specifies your data quality evaluation criteria.

codeGenConfigurationNode_fillMissingValues :: Lens' CodeGenConfigurationNode (Maybe FillMissingValues) Source #

Specifies a transform that locates records in the dataset that have missing values and adds a new field with a value determined by imputation. The input data set is used to train the machine learning model that determines what the missing value should be.

codeGenConfigurationNode_filter :: Lens' CodeGenConfigurationNode (Maybe Filter) Source #

Specifies a transform that splits a dataset into two, based on a filter condition.

codeGenConfigurationNode_governedCatalogSource :: Lens' CodeGenConfigurationNode (Maybe GovernedCatalogSource) Source #

Specifies a data source in a goverened Data Catalog.

codeGenConfigurationNode_governedCatalogTarget :: Lens' CodeGenConfigurationNode (Maybe GovernedCatalogTarget) Source #

Specifies a data target that writes to a goverened catalog.

codeGenConfigurationNode_jDBCConnectorSource :: Lens' CodeGenConfigurationNode (Maybe JDBCConnectorSource) Source #

Specifies a connector to a JDBC data source.

codeGenConfigurationNode_jDBCConnectorTarget :: Lens' CodeGenConfigurationNode (Maybe JDBCConnectorTarget) Source #

Specifies a data target that writes to Amazon S3 in Apache Parquet columnar storage.

codeGenConfigurationNode_join :: Lens' CodeGenConfigurationNode (Maybe Join) Source #

Specifies a transform that joins two datasets into one dataset using a comparison phrase on the specified data property keys. You can use inner, outer, left, right, left semi, and left anti joins.

codeGenConfigurationNode_merge :: Lens' CodeGenConfigurationNode (Maybe Merge) Source #

Specifies a transform that merges a DynamicFrame with a staging DynamicFrame based on the specified primary keys to identify records. Duplicate records (records with the same primary keys) are not de-duplicated.

codeGenConfigurationNode_microsoftSQLServerCatalogSource :: Lens' CodeGenConfigurationNode (Maybe MicrosoftSQLServerCatalogSource) Source #

Specifies a Microsoft SQL server data source in the Glue Data Catalog.

codeGenConfigurationNode_microsoftSQLServerCatalogTarget :: Lens' CodeGenConfigurationNode (Maybe MicrosoftSQLServerCatalogTarget) Source #

Specifies a target that uses Microsoft SQL.

codeGenConfigurationNode_mySQLCatalogSource :: Lens' CodeGenConfigurationNode (Maybe MySQLCatalogSource) Source #

Specifies a MySQL data source in the Glue Data Catalog.

codeGenConfigurationNode_mySQLCatalogTarget :: Lens' CodeGenConfigurationNode (Maybe MySQLCatalogTarget) Source #

Specifies a target that uses MySQL.

codeGenConfigurationNode_oracleSQLCatalogSource :: Lens' CodeGenConfigurationNode (Maybe OracleSQLCatalogSource) Source #

Specifies an Oracle data source in the Glue Data Catalog.

codeGenConfigurationNode_oracleSQLCatalogTarget :: Lens' CodeGenConfigurationNode (Maybe OracleSQLCatalogTarget) Source #

Specifies a target that uses Oracle SQL.

codeGenConfigurationNode_pIIDetection :: Lens' CodeGenConfigurationNode (Maybe PIIDetection) Source #

Specifies a transform that identifies, removes or masks PII data.

codeGenConfigurationNode_postgreSQLCatalogSource :: Lens' CodeGenConfigurationNode (Maybe PostgreSQLCatalogSource) Source #

Specifies a PostgresSQL data source in the Glue Data Catalog.

codeGenConfigurationNode_postgreSQLCatalogTarget :: Lens' CodeGenConfigurationNode (Maybe PostgreSQLCatalogTarget) Source #

Specifies a target that uses Postgres SQL.

codeGenConfigurationNode_redshiftSource :: Lens' CodeGenConfigurationNode (Maybe RedshiftSource) Source #

Specifies an Amazon Redshift data store.

codeGenConfigurationNode_redshiftTarget :: Lens' CodeGenConfigurationNode (Maybe RedshiftTarget) Source #

Specifies a target that uses Amazon Redshift.

codeGenConfigurationNode_relationalCatalogSource :: Lens' CodeGenConfigurationNode (Maybe RelationalCatalogSource) Source #

Undocumented member.

codeGenConfigurationNode_renameField :: Lens' CodeGenConfigurationNode (Maybe RenameField) Source #

Specifies a transform that renames a single data property key.

codeGenConfigurationNode_s3CatalogSource :: Lens' CodeGenConfigurationNode (Maybe S3CatalogSource) Source #

Specifies an Amazon S3 data store in the Glue Data Catalog.

codeGenConfigurationNode_s3CatalogTarget :: Lens' CodeGenConfigurationNode (Maybe S3CatalogTarget) Source #

Specifies a data target that writes to Amazon S3 using the Glue Data Catalog.

codeGenConfigurationNode_s3CsvSource :: Lens' CodeGenConfigurationNode (Maybe S3CsvSource) Source #

Specifies a command-separated value (CSV) data store stored in Amazon S3.

codeGenConfigurationNode_s3DirectTarget :: Lens' CodeGenConfigurationNode (Maybe S3DirectTarget) Source #

Specifies a data target that writes to Amazon S3.

codeGenConfigurationNode_s3GlueParquetTarget :: Lens' CodeGenConfigurationNode (Maybe S3GlueParquetTarget) Source #

Specifies a data target that writes to Amazon S3 in Apache Parquet columnar storage.

codeGenConfigurationNode_s3JsonSource :: Lens' CodeGenConfigurationNode (Maybe S3JsonSource) Source #

Specifies a JSON data store stored in Amazon S3.

codeGenConfigurationNode_s3ParquetSource :: Lens' CodeGenConfigurationNode (Maybe S3ParquetSource) Source #

Specifies an Apache Parquet data store stored in Amazon S3.

codeGenConfigurationNode_selectFields :: Lens' CodeGenConfigurationNode (Maybe SelectFields) Source #

Specifies a transform that chooses the data property keys that you want to keep.

codeGenConfigurationNode_selectFromCollection :: Lens' CodeGenConfigurationNode (Maybe SelectFromCollection) Source #

Specifies a transform that chooses one DynamicFrame from a collection of DynamicFrames. The output is the selected DynamicFrame

codeGenConfigurationNode_sparkConnectorSource :: Lens' CodeGenConfigurationNode (Maybe SparkConnectorSource) Source #

Specifies a connector to an Apache Spark data source.

codeGenConfigurationNode_sparkConnectorTarget :: Lens' CodeGenConfigurationNode (Maybe SparkConnectorTarget) Source #

Specifies a target that uses an Apache Spark connector.

codeGenConfigurationNode_sparkSQL :: Lens' CodeGenConfigurationNode (Maybe SparkSQL) Source #

Specifies a transform where you enter a SQL query using Spark SQL syntax to transform the data. The output is a single DynamicFrame.

codeGenConfigurationNode_spigot :: Lens' CodeGenConfigurationNode (Maybe Spigot) Source #

Specifies a transform that writes samples of the data to an Amazon S3 bucket.

codeGenConfigurationNode_splitFields :: Lens' CodeGenConfigurationNode (Maybe SplitFields) Source #

Specifies a transform that splits data property keys into two DynamicFrames. The output is a collection of DynamicFrames: one with selected data property keys, and one with the remaining data property keys.

codeGenConfigurationNode_union :: Lens' CodeGenConfigurationNode (Maybe Union) Source #

Specifies a transform that combines the rows from two or more datasets into a single result.