amazonka-glue-2.0: Amazon Glue SDK.
Copyright(c) 2013-2023 Brendan Hay
LicenseMozilla Public License, v. 2.0.
MaintainerBrendan Hay
Stabilityauto-generated
Portabilitynon-portable (GHC extensions)
Safe HaskellSafe-Inferred
LanguageHaskell2010

Amazonka.Glue.Types

Contents

Description

 
Synopsis

Service Configuration

defaultService :: Service Source #

API version 2017-03-31 of the Amazon Glue SDK configuration.

Errors

_AccessDeniedException :: AsError a => Fold a ServiceError Source #

Access to a resource was denied.

_AlreadyExistsException :: AsError a => Fold a ServiceError Source #

A resource to be created or added already exists.

_ConcurrentModificationException :: AsError a => Fold a ServiceError Source #

Two processes are trying to modify a resource simultaneously.

_ConcurrentRunsExceededException :: AsError a => Fold a ServiceError Source #

Too many jobs are being run concurrently.

_ConditionCheckFailureException :: AsError a => Fold a ServiceError Source #

A specified condition was not satisfied.

_ConflictException :: AsError a => Fold a ServiceError Source #

The CreatePartitions API was called on a table that has indexes enabled.

_CrawlerNotRunningException :: AsError a => Fold a ServiceError Source #

The specified crawler is not running.

_CrawlerRunningException :: AsError a => Fold a ServiceError Source #

The operation cannot be performed because the crawler is already running.

_CrawlerStoppingException :: AsError a => Fold a ServiceError Source #

The specified crawler is stopping.

_EntityNotFoundException :: AsError a => Fold a ServiceError Source #

A specified entity does not exist

_GlueEncryptionException :: AsError a => Fold a ServiceError Source #

An encryption operation failed.

_IdempotentParameterMismatchException :: AsError a => Fold a ServiceError Source #

The same unique identifier was associated with two different records.

_IllegalBlueprintStateException :: AsError a => Fold a ServiceError Source #

The blueprint is in an invalid state to perform a requested operation.

_IllegalSessionStateException :: AsError a => Fold a ServiceError Source #

The session is in an invalid state to perform a requested operation.

_IllegalWorkflowStateException :: AsError a => Fold a ServiceError Source #

The workflow is in an invalid state to perform a requested operation.

_InternalServiceException :: AsError a => Fold a ServiceError Source #

An internal service error occurred.

_InvalidInputException :: AsError a => Fold a ServiceError Source #

The input provided was not valid.

_InvalidStateException :: AsError a => Fold a ServiceError Source #

An error that indicates your data is in an invalid state.

_MLTransformNotReadyException :: AsError a => Fold a ServiceError Source #

The machine learning transform is not ready to run.

_NoScheduleException :: AsError a => Fold a ServiceError Source #

There is no applicable schedule.

_OperationTimeoutException :: AsError a => Fold a ServiceError Source #

The operation timed out.

_PermissionTypeMismatchException :: AsError a => Fold a ServiceError Source #

Prism for PermissionTypeMismatchException' errors.

_ResourceNotReadyException :: AsError a => Fold a ServiceError Source #

A resource was not ready for a transaction.

_ResourceNumberLimitExceededException :: AsError a => Fold a ServiceError Source #

A resource numerical limit was exceeded.

_SchedulerNotRunningException :: AsError a => Fold a ServiceError Source #

The specified scheduler is not running.

_SchedulerRunningException :: AsError a => Fold a ServiceError Source #

The specified scheduler is already running.

_SchedulerTransitioningException :: AsError a => Fold a ServiceError Source #

The specified scheduler is transitioning.

_ValidationException :: AsError a => Fold a ServiceError Source #

A value could not be validated.

_VersionMismatchException :: AsError a => Fold a ServiceError Source #

There was a version conflict.

AggFunction

newtype AggFunction Source #

Constructors

AggFunction' 

Instances

Instances details
FromJSON AggFunction Source # 
Instance details

Defined in Amazonka.Glue.Types.AggFunction

FromJSONKey AggFunction Source # 
Instance details

Defined in Amazonka.Glue.Types.AggFunction

ToJSON AggFunction Source # 
Instance details

Defined in Amazonka.Glue.Types.AggFunction

ToJSONKey AggFunction Source # 
Instance details

Defined in Amazonka.Glue.Types.AggFunction

ToByteString AggFunction Source # 
Instance details

Defined in Amazonka.Glue.Types.AggFunction

ToHeader AggFunction Source # 
Instance details

Defined in Amazonka.Glue.Types.AggFunction

ToLog AggFunction Source # 
Instance details

Defined in Amazonka.Glue.Types.AggFunction

ToQuery AggFunction Source # 
Instance details

Defined in Amazonka.Glue.Types.AggFunction

FromText AggFunction Source # 
Instance details

Defined in Amazonka.Glue.Types.AggFunction

ToText AggFunction Source # 
Instance details

Defined in Amazonka.Glue.Types.AggFunction

Methods

toText :: AggFunction -> Text #

FromXML AggFunction Source # 
Instance details

Defined in Amazonka.Glue.Types.AggFunction

ToXML AggFunction Source # 
Instance details

Defined in Amazonka.Glue.Types.AggFunction

Methods

toXML :: AggFunction -> XML #

Generic AggFunction Source # 
Instance details

Defined in Amazonka.Glue.Types.AggFunction

Associated Types

type Rep AggFunction :: Type -> Type #

Read AggFunction Source # 
Instance details

Defined in Amazonka.Glue.Types.AggFunction

Show AggFunction Source # 
Instance details

Defined in Amazonka.Glue.Types.AggFunction

NFData AggFunction Source # 
Instance details

Defined in Amazonka.Glue.Types.AggFunction

Methods

rnf :: AggFunction -> () #

Eq AggFunction Source # 
Instance details

Defined in Amazonka.Glue.Types.AggFunction

Ord AggFunction Source # 
Instance details

Defined in Amazonka.Glue.Types.AggFunction

Hashable AggFunction Source # 
Instance details

Defined in Amazonka.Glue.Types.AggFunction

type Rep AggFunction Source # 
Instance details

Defined in Amazonka.Glue.Types.AggFunction

type Rep AggFunction = D1 ('MetaData "AggFunction" "Amazonka.Glue.Types.AggFunction" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'True) (C1 ('MetaCons "AggFunction'" 'PrefixI 'True) (S1 ('MetaSel ('Just "fromAggFunction") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedLazy) (Rec0 Text)))

BackfillErrorCode

newtype BackfillErrorCode Source #

Instances

Instances details
FromJSON BackfillErrorCode Source # 
Instance details

Defined in Amazonka.Glue.Types.BackfillErrorCode

FromJSONKey BackfillErrorCode Source # 
Instance details

Defined in Amazonka.Glue.Types.BackfillErrorCode

ToJSON BackfillErrorCode Source # 
Instance details

Defined in Amazonka.Glue.Types.BackfillErrorCode

ToJSONKey BackfillErrorCode Source # 
Instance details

Defined in Amazonka.Glue.Types.BackfillErrorCode

ToByteString BackfillErrorCode Source # 
Instance details

Defined in Amazonka.Glue.Types.BackfillErrorCode

ToHeader BackfillErrorCode Source # 
Instance details

Defined in Amazonka.Glue.Types.BackfillErrorCode

ToLog BackfillErrorCode Source # 
Instance details

Defined in Amazonka.Glue.Types.BackfillErrorCode

ToQuery BackfillErrorCode Source # 
Instance details

Defined in Amazonka.Glue.Types.BackfillErrorCode

FromText BackfillErrorCode Source # 
Instance details

Defined in Amazonka.Glue.Types.BackfillErrorCode

ToText BackfillErrorCode Source # 
Instance details

Defined in Amazonka.Glue.Types.BackfillErrorCode

FromXML BackfillErrorCode Source # 
Instance details

Defined in Amazonka.Glue.Types.BackfillErrorCode

ToXML BackfillErrorCode Source # 
Instance details

Defined in Amazonka.Glue.Types.BackfillErrorCode

Generic BackfillErrorCode Source # 
Instance details

Defined in Amazonka.Glue.Types.BackfillErrorCode

Associated Types

type Rep BackfillErrorCode :: Type -> Type #

Read BackfillErrorCode Source # 
Instance details

Defined in Amazonka.Glue.Types.BackfillErrorCode

Show BackfillErrorCode Source # 
Instance details

Defined in Amazonka.Glue.Types.BackfillErrorCode

NFData BackfillErrorCode Source # 
Instance details

Defined in Amazonka.Glue.Types.BackfillErrorCode

Methods

rnf :: BackfillErrorCode -> () #

Eq BackfillErrorCode Source # 
Instance details

Defined in Amazonka.Glue.Types.BackfillErrorCode

Ord BackfillErrorCode Source # 
Instance details

Defined in Amazonka.Glue.Types.BackfillErrorCode

Hashable BackfillErrorCode Source # 
Instance details

Defined in Amazonka.Glue.Types.BackfillErrorCode

type Rep BackfillErrorCode Source # 
Instance details

Defined in Amazonka.Glue.Types.BackfillErrorCode

type Rep BackfillErrorCode = D1 ('MetaData "BackfillErrorCode" "Amazonka.Glue.Types.BackfillErrorCode" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'True) (C1 ('MetaCons "BackfillErrorCode'" 'PrefixI 'True) (S1 ('MetaSel ('Just "fromBackfillErrorCode") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedLazy) (Rec0 Text)))

BlueprintRunState

newtype BlueprintRunState Source #

Instances

Instances details
FromJSON BlueprintRunState Source # 
Instance details

Defined in Amazonka.Glue.Types.BlueprintRunState

FromJSONKey BlueprintRunState Source # 
Instance details

Defined in Amazonka.Glue.Types.BlueprintRunState

ToJSON BlueprintRunState Source # 
Instance details

Defined in Amazonka.Glue.Types.BlueprintRunState

ToJSONKey BlueprintRunState Source # 
Instance details

Defined in Amazonka.Glue.Types.BlueprintRunState

ToByteString BlueprintRunState Source # 
Instance details

Defined in Amazonka.Glue.Types.BlueprintRunState

ToHeader BlueprintRunState Source # 
Instance details

Defined in Amazonka.Glue.Types.BlueprintRunState

ToLog BlueprintRunState Source # 
Instance details

Defined in Amazonka.Glue.Types.BlueprintRunState

ToQuery BlueprintRunState Source # 
Instance details

Defined in Amazonka.Glue.Types.BlueprintRunState

FromText BlueprintRunState Source # 
Instance details

Defined in Amazonka.Glue.Types.BlueprintRunState

ToText BlueprintRunState Source # 
Instance details

Defined in Amazonka.Glue.Types.BlueprintRunState

FromXML BlueprintRunState Source # 
Instance details

Defined in Amazonka.Glue.Types.BlueprintRunState

ToXML BlueprintRunState Source # 
Instance details

Defined in Amazonka.Glue.Types.BlueprintRunState

Generic BlueprintRunState Source # 
Instance details

Defined in Amazonka.Glue.Types.BlueprintRunState

Associated Types

type Rep BlueprintRunState :: Type -> Type #

Read BlueprintRunState Source # 
Instance details

Defined in Amazonka.Glue.Types.BlueprintRunState

Show BlueprintRunState Source # 
Instance details

Defined in Amazonka.Glue.Types.BlueprintRunState

NFData BlueprintRunState Source # 
Instance details

Defined in Amazonka.Glue.Types.BlueprintRunState

Methods

rnf :: BlueprintRunState -> () #

Eq BlueprintRunState Source # 
Instance details

Defined in Amazonka.Glue.Types.BlueprintRunState

Ord BlueprintRunState Source # 
Instance details

Defined in Amazonka.Glue.Types.BlueprintRunState

Hashable BlueprintRunState Source # 
Instance details

Defined in Amazonka.Glue.Types.BlueprintRunState

type Rep BlueprintRunState Source # 
Instance details

Defined in Amazonka.Glue.Types.BlueprintRunState

type Rep BlueprintRunState = D1 ('MetaData "BlueprintRunState" "Amazonka.Glue.Types.BlueprintRunState" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'True) (C1 ('MetaCons "BlueprintRunState'" 'PrefixI 'True) (S1 ('MetaSel ('Just "fromBlueprintRunState") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedLazy) (Rec0 Text)))

BlueprintStatus

newtype BlueprintStatus Source #

Constructors

BlueprintStatus' 

Instances

Instances details
FromJSON BlueprintStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.BlueprintStatus

FromJSONKey BlueprintStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.BlueprintStatus

ToJSON BlueprintStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.BlueprintStatus

ToJSONKey BlueprintStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.BlueprintStatus

ToByteString BlueprintStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.BlueprintStatus

ToHeader BlueprintStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.BlueprintStatus

ToLog BlueprintStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.BlueprintStatus

ToQuery BlueprintStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.BlueprintStatus

FromText BlueprintStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.BlueprintStatus

ToText BlueprintStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.BlueprintStatus

FromXML BlueprintStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.BlueprintStatus

ToXML BlueprintStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.BlueprintStatus

Methods

toXML :: BlueprintStatus -> XML #

Generic BlueprintStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.BlueprintStatus

Associated Types

type Rep BlueprintStatus :: Type -> Type #

Read BlueprintStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.BlueprintStatus

Show BlueprintStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.BlueprintStatus

NFData BlueprintStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.BlueprintStatus

Methods

rnf :: BlueprintStatus -> () #

Eq BlueprintStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.BlueprintStatus

Ord BlueprintStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.BlueprintStatus

Hashable BlueprintStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.BlueprintStatus

type Rep BlueprintStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.BlueprintStatus

type Rep BlueprintStatus = D1 ('MetaData "BlueprintStatus" "Amazonka.Glue.Types.BlueprintStatus" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'True) (C1 ('MetaCons "BlueprintStatus'" 'PrefixI 'True) (S1 ('MetaSel ('Just "fromBlueprintStatus") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedLazy) (Rec0 Text)))

CatalogEncryptionMode

newtype CatalogEncryptionMode Source #

Instances

Instances details
FromJSON CatalogEncryptionMode Source # 
Instance details

Defined in Amazonka.Glue.Types.CatalogEncryptionMode

FromJSONKey CatalogEncryptionMode Source # 
Instance details

Defined in Amazonka.Glue.Types.CatalogEncryptionMode

ToJSON CatalogEncryptionMode Source # 
Instance details

Defined in Amazonka.Glue.Types.CatalogEncryptionMode

ToJSONKey CatalogEncryptionMode Source # 
Instance details

Defined in Amazonka.Glue.Types.CatalogEncryptionMode

ToByteString CatalogEncryptionMode Source # 
Instance details

Defined in Amazonka.Glue.Types.CatalogEncryptionMode

ToHeader CatalogEncryptionMode Source # 
Instance details

Defined in Amazonka.Glue.Types.CatalogEncryptionMode

ToLog CatalogEncryptionMode Source # 
Instance details

Defined in Amazonka.Glue.Types.CatalogEncryptionMode

ToQuery CatalogEncryptionMode Source # 
Instance details

Defined in Amazonka.Glue.Types.CatalogEncryptionMode

FromText CatalogEncryptionMode Source # 
Instance details

Defined in Amazonka.Glue.Types.CatalogEncryptionMode

ToText CatalogEncryptionMode Source # 
Instance details

Defined in Amazonka.Glue.Types.CatalogEncryptionMode

FromXML CatalogEncryptionMode Source # 
Instance details

Defined in Amazonka.Glue.Types.CatalogEncryptionMode

ToXML CatalogEncryptionMode Source # 
Instance details

Defined in Amazonka.Glue.Types.CatalogEncryptionMode

Generic CatalogEncryptionMode Source # 
Instance details

Defined in Amazonka.Glue.Types.CatalogEncryptionMode

Associated Types

type Rep CatalogEncryptionMode :: Type -> Type #

Read CatalogEncryptionMode Source # 
Instance details

Defined in Amazonka.Glue.Types.CatalogEncryptionMode

Show CatalogEncryptionMode Source # 
Instance details

Defined in Amazonka.Glue.Types.CatalogEncryptionMode

NFData CatalogEncryptionMode Source # 
Instance details

Defined in Amazonka.Glue.Types.CatalogEncryptionMode

Methods

rnf :: CatalogEncryptionMode -> () #

Eq CatalogEncryptionMode Source # 
Instance details

Defined in Amazonka.Glue.Types.CatalogEncryptionMode

Ord CatalogEncryptionMode Source # 
Instance details

Defined in Amazonka.Glue.Types.CatalogEncryptionMode

Hashable CatalogEncryptionMode Source # 
Instance details

Defined in Amazonka.Glue.Types.CatalogEncryptionMode

type Rep CatalogEncryptionMode Source # 
Instance details

Defined in Amazonka.Glue.Types.CatalogEncryptionMode

type Rep CatalogEncryptionMode = D1 ('MetaData "CatalogEncryptionMode" "Amazonka.Glue.Types.CatalogEncryptionMode" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'True) (C1 ('MetaCons "CatalogEncryptionMode'" 'PrefixI 'True) (S1 ('MetaSel ('Just "fromCatalogEncryptionMode") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedLazy) (Rec0 Text)))

CloudWatchEncryptionMode

newtype CloudWatchEncryptionMode Source #

Instances

Instances details
FromJSON CloudWatchEncryptionMode Source # 
Instance details

Defined in Amazonka.Glue.Types.CloudWatchEncryptionMode

FromJSONKey CloudWatchEncryptionMode Source # 
Instance details

Defined in Amazonka.Glue.Types.CloudWatchEncryptionMode

ToJSON CloudWatchEncryptionMode Source # 
Instance details

Defined in Amazonka.Glue.Types.CloudWatchEncryptionMode

ToJSONKey CloudWatchEncryptionMode Source # 
Instance details

Defined in Amazonka.Glue.Types.CloudWatchEncryptionMode

ToByteString CloudWatchEncryptionMode Source # 
Instance details

Defined in Amazonka.Glue.Types.CloudWatchEncryptionMode

ToHeader CloudWatchEncryptionMode Source # 
Instance details

Defined in Amazonka.Glue.Types.CloudWatchEncryptionMode

ToLog CloudWatchEncryptionMode Source # 
Instance details

Defined in Amazonka.Glue.Types.CloudWatchEncryptionMode

ToQuery CloudWatchEncryptionMode Source # 
Instance details

Defined in Amazonka.Glue.Types.CloudWatchEncryptionMode

FromText CloudWatchEncryptionMode Source # 
Instance details

Defined in Amazonka.Glue.Types.CloudWatchEncryptionMode

ToText CloudWatchEncryptionMode Source # 
Instance details

Defined in Amazonka.Glue.Types.CloudWatchEncryptionMode

FromXML CloudWatchEncryptionMode Source # 
Instance details

Defined in Amazonka.Glue.Types.CloudWatchEncryptionMode

ToXML CloudWatchEncryptionMode Source # 
Instance details

Defined in Amazonka.Glue.Types.CloudWatchEncryptionMode

Generic CloudWatchEncryptionMode Source # 
Instance details

Defined in Amazonka.Glue.Types.CloudWatchEncryptionMode

Associated Types

type Rep CloudWatchEncryptionMode :: Type -> Type #

Read CloudWatchEncryptionMode Source # 
Instance details

Defined in Amazonka.Glue.Types.CloudWatchEncryptionMode

Show CloudWatchEncryptionMode Source # 
Instance details

Defined in Amazonka.Glue.Types.CloudWatchEncryptionMode

NFData CloudWatchEncryptionMode Source # 
Instance details

Defined in Amazonka.Glue.Types.CloudWatchEncryptionMode

Eq CloudWatchEncryptionMode Source # 
Instance details

Defined in Amazonka.Glue.Types.CloudWatchEncryptionMode

Ord CloudWatchEncryptionMode Source # 
Instance details

Defined in Amazonka.Glue.Types.CloudWatchEncryptionMode

Hashable CloudWatchEncryptionMode Source # 
Instance details

Defined in Amazonka.Glue.Types.CloudWatchEncryptionMode

type Rep CloudWatchEncryptionMode Source # 
Instance details

Defined in Amazonka.Glue.Types.CloudWatchEncryptionMode

type Rep CloudWatchEncryptionMode = D1 ('MetaData "CloudWatchEncryptionMode" "Amazonka.Glue.Types.CloudWatchEncryptionMode" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'True) (C1 ('MetaCons "CloudWatchEncryptionMode'" 'PrefixI 'True) (S1 ('MetaSel ('Just "fromCloudWatchEncryptionMode") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedLazy) (Rec0 Text)))

ColumnStatisticsType

newtype ColumnStatisticsType Source #

Instances

Instances details
FromJSON ColumnStatisticsType Source # 
Instance details

Defined in Amazonka.Glue.Types.ColumnStatisticsType

FromJSONKey ColumnStatisticsType Source # 
Instance details

Defined in Amazonka.Glue.Types.ColumnStatisticsType

ToJSON ColumnStatisticsType Source # 
Instance details

Defined in Amazonka.Glue.Types.ColumnStatisticsType

ToJSONKey ColumnStatisticsType Source # 
Instance details

Defined in Amazonka.Glue.Types.ColumnStatisticsType

ToByteString ColumnStatisticsType Source # 
Instance details

Defined in Amazonka.Glue.Types.ColumnStatisticsType

ToHeader ColumnStatisticsType Source # 
Instance details

Defined in Amazonka.Glue.Types.ColumnStatisticsType

ToLog ColumnStatisticsType Source # 
Instance details

Defined in Amazonka.Glue.Types.ColumnStatisticsType

ToQuery ColumnStatisticsType Source # 
Instance details

Defined in Amazonka.Glue.Types.ColumnStatisticsType

FromText ColumnStatisticsType Source # 
Instance details

Defined in Amazonka.Glue.Types.ColumnStatisticsType

ToText ColumnStatisticsType Source # 
Instance details

Defined in Amazonka.Glue.Types.ColumnStatisticsType

FromXML ColumnStatisticsType Source # 
Instance details

Defined in Amazonka.Glue.Types.ColumnStatisticsType

ToXML ColumnStatisticsType Source # 
Instance details

Defined in Amazonka.Glue.Types.ColumnStatisticsType

Generic ColumnStatisticsType Source # 
Instance details

Defined in Amazonka.Glue.Types.ColumnStatisticsType

Associated Types

type Rep ColumnStatisticsType :: Type -> Type #

Read ColumnStatisticsType Source # 
Instance details

Defined in Amazonka.Glue.Types.ColumnStatisticsType

Show ColumnStatisticsType Source # 
Instance details

Defined in Amazonka.Glue.Types.ColumnStatisticsType

NFData ColumnStatisticsType Source # 
Instance details

Defined in Amazonka.Glue.Types.ColumnStatisticsType

Methods

rnf :: ColumnStatisticsType -> () #

Eq ColumnStatisticsType Source # 
Instance details

Defined in Amazonka.Glue.Types.ColumnStatisticsType

Ord ColumnStatisticsType Source # 
Instance details

Defined in Amazonka.Glue.Types.ColumnStatisticsType

Hashable ColumnStatisticsType Source # 
Instance details

Defined in Amazonka.Glue.Types.ColumnStatisticsType

type Rep ColumnStatisticsType Source # 
Instance details

Defined in Amazonka.Glue.Types.ColumnStatisticsType

type Rep ColumnStatisticsType = D1 ('MetaData "ColumnStatisticsType" "Amazonka.Glue.Types.ColumnStatisticsType" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'True) (C1 ('MetaCons "ColumnStatisticsType'" 'PrefixI 'True) (S1 ('MetaSel ('Just "fromColumnStatisticsType") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedLazy) (Rec0 Text)))

Comparator

newtype Comparator Source #

Constructors

Comparator' 

Fields

Instances

Instances details
FromJSON Comparator Source # 
Instance details

Defined in Amazonka.Glue.Types.Comparator

FromJSONKey Comparator Source # 
Instance details

Defined in Amazonka.Glue.Types.Comparator

ToJSON Comparator Source # 
Instance details

Defined in Amazonka.Glue.Types.Comparator

ToJSONKey Comparator Source # 
Instance details

Defined in Amazonka.Glue.Types.Comparator

ToByteString Comparator Source # 
Instance details

Defined in Amazonka.Glue.Types.Comparator

ToHeader Comparator Source # 
Instance details

Defined in Amazonka.Glue.Types.Comparator

ToLog Comparator Source # 
Instance details

Defined in Amazonka.Glue.Types.Comparator

ToQuery Comparator Source # 
Instance details

Defined in Amazonka.Glue.Types.Comparator

FromText Comparator Source # 
Instance details

Defined in Amazonka.Glue.Types.Comparator

ToText Comparator Source # 
Instance details

Defined in Amazonka.Glue.Types.Comparator

Methods

toText :: Comparator -> Text #

FromXML Comparator Source # 
Instance details

Defined in Amazonka.Glue.Types.Comparator

ToXML Comparator Source # 
Instance details

Defined in Amazonka.Glue.Types.Comparator

Methods

toXML :: Comparator -> XML #

Generic Comparator Source # 
Instance details

Defined in Amazonka.Glue.Types.Comparator

Associated Types

type Rep Comparator :: Type -> Type #

Read Comparator Source # 
Instance details

Defined in Amazonka.Glue.Types.Comparator

Show Comparator Source # 
Instance details

Defined in Amazonka.Glue.Types.Comparator

NFData Comparator Source # 
Instance details

Defined in Amazonka.Glue.Types.Comparator

Methods

rnf :: Comparator -> () #

Eq Comparator Source # 
Instance details

Defined in Amazonka.Glue.Types.Comparator

Ord Comparator Source # 
Instance details

Defined in Amazonka.Glue.Types.Comparator

Hashable Comparator Source # 
Instance details

Defined in Amazonka.Glue.Types.Comparator

type Rep Comparator Source # 
Instance details

Defined in Amazonka.Glue.Types.Comparator

type Rep Comparator = D1 ('MetaData "Comparator" "Amazonka.Glue.Types.Comparator" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'True) (C1 ('MetaCons "Comparator'" 'PrefixI 'True) (S1 ('MetaSel ('Just "fromComparator") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedLazy) (Rec0 Text)))

Compatibility

newtype Compatibility Source #

Constructors

Compatibility' 

Instances

Instances details
FromJSON Compatibility Source # 
Instance details

Defined in Amazonka.Glue.Types.Compatibility

FromJSONKey Compatibility Source # 
Instance details

Defined in Amazonka.Glue.Types.Compatibility

ToJSON Compatibility Source # 
Instance details

Defined in Amazonka.Glue.Types.Compatibility

ToJSONKey Compatibility Source # 
Instance details

Defined in Amazonka.Glue.Types.Compatibility

ToByteString Compatibility Source # 
Instance details

Defined in Amazonka.Glue.Types.Compatibility

ToHeader Compatibility Source # 
Instance details

Defined in Amazonka.Glue.Types.Compatibility

ToLog Compatibility Source # 
Instance details

Defined in Amazonka.Glue.Types.Compatibility

ToQuery Compatibility Source # 
Instance details

Defined in Amazonka.Glue.Types.Compatibility

FromText Compatibility Source # 
Instance details

Defined in Amazonka.Glue.Types.Compatibility

ToText Compatibility Source # 
Instance details

Defined in Amazonka.Glue.Types.Compatibility

Methods

toText :: Compatibility -> Text #

FromXML Compatibility Source # 
Instance details

Defined in Amazonka.Glue.Types.Compatibility

ToXML Compatibility Source # 
Instance details

Defined in Amazonka.Glue.Types.Compatibility

Methods

toXML :: Compatibility -> XML #

Generic Compatibility Source # 
Instance details

Defined in Amazonka.Glue.Types.Compatibility

Associated Types

type Rep Compatibility :: Type -> Type #

Read Compatibility Source # 
Instance details

Defined in Amazonka.Glue.Types.Compatibility

Show Compatibility Source # 
Instance details

Defined in Amazonka.Glue.Types.Compatibility

NFData Compatibility Source # 
Instance details

Defined in Amazonka.Glue.Types.Compatibility

Methods

rnf :: Compatibility -> () #

Eq Compatibility Source # 
Instance details

Defined in Amazonka.Glue.Types.Compatibility

Ord Compatibility Source # 
Instance details

Defined in Amazonka.Glue.Types.Compatibility

Hashable Compatibility Source # 
Instance details

Defined in Amazonka.Glue.Types.Compatibility

type Rep Compatibility Source # 
Instance details

Defined in Amazonka.Glue.Types.Compatibility

type Rep Compatibility = D1 ('MetaData "Compatibility" "Amazonka.Glue.Types.Compatibility" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'True) (C1 ('MetaCons "Compatibility'" 'PrefixI 'True) (S1 ('MetaSel ('Just "fromCompatibility") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedLazy) (Rec0 Text)))

CompressionType

newtype CompressionType Source #

Constructors

CompressionType' 

Instances

Instances details
FromJSON CompressionType Source # 
Instance details

Defined in Amazonka.Glue.Types.CompressionType

FromJSONKey CompressionType Source # 
Instance details

Defined in Amazonka.Glue.Types.CompressionType

ToJSON CompressionType Source # 
Instance details

Defined in Amazonka.Glue.Types.CompressionType

ToJSONKey CompressionType Source # 
Instance details

Defined in Amazonka.Glue.Types.CompressionType

ToByteString CompressionType Source # 
Instance details

Defined in Amazonka.Glue.Types.CompressionType

ToHeader CompressionType Source # 
Instance details

Defined in Amazonka.Glue.Types.CompressionType

ToLog CompressionType Source # 
Instance details

Defined in Amazonka.Glue.Types.CompressionType

ToQuery CompressionType Source # 
Instance details

Defined in Amazonka.Glue.Types.CompressionType

FromText CompressionType Source # 
Instance details

Defined in Amazonka.Glue.Types.CompressionType

ToText CompressionType Source # 
Instance details

Defined in Amazonka.Glue.Types.CompressionType

FromXML CompressionType Source # 
Instance details

Defined in Amazonka.Glue.Types.CompressionType

ToXML CompressionType Source # 
Instance details

Defined in Amazonka.Glue.Types.CompressionType

Methods

toXML :: CompressionType -> XML #

Generic CompressionType Source # 
Instance details

Defined in Amazonka.Glue.Types.CompressionType

Associated Types

type Rep CompressionType :: Type -> Type #

Read CompressionType Source # 
Instance details

Defined in Amazonka.Glue.Types.CompressionType

Show CompressionType Source # 
Instance details

Defined in Amazonka.Glue.Types.CompressionType

NFData CompressionType Source # 
Instance details

Defined in Amazonka.Glue.Types.CompressionType

Methods

rnf :: CompressionType -> () #

Eq CompressionType Source # 
Instance details

Defined in Amazonka.Glue.Types.CompressionType

Ord CompressionType Source # 
Instance details

Defined in Amazonka.Glue.Types.CompressionType

Hashable CompressionType Source # 
Instance details

Defined in Amazonka.Glue.Types.CompressionType

type Rep CompressionType Source # 
Instance details

Defined in Amazonka.Glue.Types.CompressionType

type Rep CompressionType = D1 ('MetaData "CompressionType" "Amazonka.Glue.Types.CompressionType" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'True) (C1 ('MetaCons "CompressionType'" 'PrefixI 'True) (S1 ('MetaSel ('Just "fromCompressionType") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedLazy) (Rec0 Text)))

ConnectionPropertyKey

newtype ConnectionPropertyKey Source #

Bundled Patterns

pattern ConnectionPropertyKey_CONFIG_FILES :: ConnectionPropertyKey 
pattern ConnectionPropertyKey_CONNECTION_URL :: ConnectionPropertyKey 
pattern ConnectionPropertyKey_CONNECTOR_CLASS_NAME :: ConnectionPropertyKey 
pattern ConnectionPropertyKey_CONNECTOR_TYPE :: ConnectionPropertyKey 
pattern ConnectionPropertyKey_CONNECTOR_URL :: ConnectionPropertyKey 
pattern ConnectionPropertyKey_CUSTOM_JDBC_CERT :: ConnectionPropertyKey 
pattern ConnectionPropertyKey_CUSTOM_JDBC_CERT_STRING :: ConnectionPropertyKey 
pattern ConnectionPropertyKey_ENCRYPTED_KAFKA_CLIENT_KEYSTORE_PASSWORD :: ConnectionPropertyKey 
pattern ConnectionPropertyKey_ENCRYPTED_KAFKA_CLIENT_KEY_PASSWORD :: ConnectionPropertyKey 
pattern ConnectionPropertyKey_ENCRYPTED_PASSWORD :: ConnectionPropertyKey 
pattern ConnectionPropertyKey_HOST :: ConnectionPropertyKey 
pattern ConnectionPropertyKey_INSTANCE_ID :: ConnectionPropertyKey 
pattern ConnectionPropertyKey_JDBC_CONNECTION_URL :: ConnectionPropertyKey 
pattern ConnectionPropertyKey_JDBC_DRIVER_CLASS_NAME :: ConnectionPropertyKey 
pattern ConnectionPropertyKey_JDBC_DRIVER_JAR_URI :: ConnectionPropertyKey 
pattern ConnectionPropertyKey_JDBC_ENFORCE_SSL :: ConnectionPropertyKey 
pattern ConnectionPropertyKey_JDBC_ENGINE :: ConnectionPropertyKey 
pattern ConnectionPropertyKey_JDBC_ENGINE_VERSION :: ConnectionPropertyKey 
pattern ConnectionPropertyKey_KAFKA_BOOTSTRAP_SERVERS :: ConnectionPropertyKey 
pattern ConnectionPropertyKey_KAFKA_CLIENT_KEYSTORE :: ConnectionPropertyKey 
pattern ConnectionPropertyKey_KAFKA_CLIENT_KEYSTORE_PASSWORD :: ConnectionPropertyKey 
pattern ConnectionPropertyKey_KAFKA_CLIENT_KEY_PASSWORD :: ConnectionPropertyKey 
pattern ConnectionPropertyKey_KAFKA_CUSTOM_CERT :: ConnectionPropertyKey 
pattern ConnectionPropertyKey_KAFKA_SKIP_CUSTOM_CERT_VALIDATION :: ConnectionPropertyKey 
pattern ConnectionPropertyKey_KAFKA_SSL_ENABLED :: ConnectionPropertyKey 
pattern ConnectionPropertyKey_PASSWORD :: ConnectionPropertyKey 
pattern ConnectionPropertyKey_PORT :: ConnectionPropertyKey 
pattern ConnectionPropertyKey_SECRET_ID :: ConnectionPropertyKey 
pattern ConnectionPropertyKey_SKIP_CUSTOM_JDBC_CERT_VALIDATION :: ConnectionPropertyKey 
pattern ConnectionPropertyKey_USERNAME :: ConnectionPropertyKey 

Instances

Instances details
FromJSON ConnectionPropertyKey Source # 
Instance details

Defined in Amazonka.Glue.Types.ConnectionPropertyKey

FromJSONKey ConnectionPropertyKey Source # 
Instance details

Defined in Amazonka.Glue.Types.ConnectionPropertyKey

ToJSON ConnectionPropertyKey Source # 
Instance details

Defined in Amazonka.Glue.Types.ConnectionPropertyKey

ToJSONKey ConnectionPropertyKey Source # 
Instance details

Defined in Amazonka.Glue.Types.ConnectionPropertyKey

ToByteString ConnectionPropertyKey Source # 
Instance details

Defined in Amazonka.Glue.Types.ConnectionPropertyKey

ToHeader ConnectionPropertyKey Source # 
Instance details

Defined in Amazonka.Glue.Types.ConnectionPropertyKey

ToLog ConnectionPropertyKey Source # 
Instance details

Defined in Amazonka.Glue.Types.ConnectionPropertyKey

ToQuery ConnectionPropertyKey Source # 
Instance details

Defined in Amazonka.Glue.Types.ConnectionPropertyKey

FromText ConnectionPropertyKey Source # 
Instance details

Defined in Amazonka.Glue.Types.ConnectionPropertyKey

ToText ConnectionPropertyKey Source # 
Instance details

Defined in Amazonka.Glue.Types.ConnectionPropertyKey

FromXML ConnectionPropertyKey Source # 
Instance details

Defined in Amazonka.Glue.Types.ConnectionPropertyKey

ToXML ConnectionPropertyKey Source # 
Instance details

Defined in Amazonka.Glue.Types.ConnectionPropertyKey

Generic ConnectionPropertyKey Source # 
Instance details

Defined in Amazonka.Glue.Types.ConnectionPropertyKey

Associated Types

type Rep ConnectionPropertyKey :: Type -> Type #

Read ConnectionPropertyKey Source # 
Instance details

Defined in Amazonka.Glue.Types.ConnectionPropertyKey

Show ConnectionPropertyKey Source # 
Instance details

Defined in Amazonka.Glue.Types.ConnectionPropertyKey

NFData ConnectionPropertyKey Source # 
Instance details

Defined in Amazonka.Glue.Types.ConnectionPropertyKey

Methods

rnf :: ConnectionPropertyKey -> () #

Eq ConnectionPropertyKey Source # 
Instance details

Defined in Amazonka.Glue.Types.ConnectionPropertyKey

Ord ConnectionPropertyKey Source # 
Instance details

Defined in Amazonka.Glue.Types.ConnectionPropertyKey

Hashable ConnectionPropertyKey Source # 
Instance details

Defined in Amazonka.Glue.Types.ConnectionPropertyKey

type Rep ConnectionPropertyKey Source # 
Instance details

Defined in Amazonka.Glue.Types.ConnectionPropertyKey

type Rep ConnectionPropertyKey = D1 ('MetaData "ConnectionPropertyKey" "Amazonka.Glue.Types.ConnectionPropertyKey" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'True) (C1 ('MetaCons "ConnectionPropertyKey'" 'PrefixI 'True) (S1 ('MetaSel ('Just "fromConnectionPropertyKey") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedLazy) (Rec0 Text)))

ConnectionType

newtype ConnectionType Source #

Constructors

ConnectionType' 

Instances

Instances details
FromJSON ConnectionType Source # 
Instance details

Defined in Amazonka.Glue.Types.ConnectionType

FromJSONKey ConnectionType Source # 
Instance details

Defined in Amazonka.Glue.Types.ConnectionType

ToJSON ConnectionType Source # 
Instance details

Defined in Amazonka.Glue.Types.ConnectionType

ToJSONKey ConnectionType Source # 
Instance details

Defined in Amazonka.Glue.Types.ConnectionType

ToByteString ConnectionType Source # 
Instance details

Defined in Amazonka.Glue.Types.ConnectionType

ToHeader ConnectionType Source # 
Instance details

Defined in Amazonka.Glue.Types.ConnectionType

ToLog ConnectionType Source # 
Instance details

Defined in Amazonka.Glue.Types.ConnectionType

ToQuery ConnectionType Source # 
Instance details

Defined in Amazonka.Glue.Types.ConnectionType

FromText ConnectionType Source # 
Instance details

Defined in Amazonka.Glue.Types.ConnectionType

ToText ConnectionType Source # 
Instance details

Defined in Amazonka.Glue.Types.ConnectionType

FromXML ConnectionType Source # 
Instance details

Defined in Amazonka.Glue.Types.ConnectionType

ToXML ConnectionType Source # 
Instance details

Defined in Amazonka.Glue.Types.ConnectionType

Methods

toXML :: ConnectionType -> XML #

Generic ConnectionType Source # 
Instance details

Defined in Amazonka.Glue.Types.ConnectionType

Associated Types

type Rep ConnectionType :: Type -> Type #

Read ConnectionType Source # 
Instance details

Defined in Amazonka.Glue.Types.ConnectionType

Show ConnectionType Source # 
Instance details

Defined in Amazonka.Glue.Types.ConnectionType

NFData ConnectionType Source # 
Instance details

Defined in Amazonka.Glue.Types.ConnectionType

Methods

rnf :: ConnectionType -> () #

Eq ConnectionType Source # 
Instance details

Defined in Amazonka.Glue.Types.ConnectionType

Ord ConnectionType Source # 
Instance details

Defined in Amazonka.Glue.Types.ConnectionType

Hashable ConnectionType Source # 
Instance details

Defined in Amazonka.Glue.Types.ConnectionType

type Rep ConnectionType Source # 
Instance details

Defined in Amazonka.Glue.Types.ConnectionType

type Rep ConnectionType = D1 ('MetaData "ConnectionType" "Amazonka.Glue.Types.ConnectionType" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'True) (C1 ('MetaCons "ConnectionType'" 'PrefixI 'True) (S1 ('MetaSel ('Just "fromConnectionType") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedLazy) (Rec0 Text)))

CrawlState

newtype CrawlState Source #

Constructors

CrawlState' 

Fields

Instances

Instances details
FromJSON CrawlState Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlState

FromJSONKey CrawlState Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlState

ToJSON CrawlState Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlState

ToJSONKey CrawlState Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlState

ToByteString CrawlState Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlState

ToHeader CrawlState Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlState

ToLog CrawlState Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlState

ToQuery CrawlState Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlState

FromText CrawlState Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlState

ToText CrawlState Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlState

Methods

toText :: CrawlState -> Text #

FromXML CrawlState Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlState

ToXML CrawlState Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlState

Methods

toXML :: CrawlState -> XML #

Generic CrawlState Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlState

Associated Types

type Rep CrawlState :: Type -> Type #

Read CrawlState Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlState

Show CrawlState Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlState

NFData CrawlState Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlState

Methods

rnf :: CrawlState -> () #

Eq CrawlState Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlState

Ord CrawlState Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlState

Hashable CrawlState Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlState

type Rep CrawlState Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlState

type Rep CrawlState = D1 ('MetaData "CrawlState" "Amazonka.Glue.Types.CrawlState" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'True) (C1 ('MetaCons "CrawlState'" 'PrefixI 'True) (S1 ('MetaSel ('Just "fromCrawlState") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedLazy) (Rec0 Text)))

CrawlerHistoryState

newtype CrawlerHistoryState Source #

Instances

Instances details
FromJSON CrawlerHistoryState Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlerHistoryState

FromJSONKey CrawlerHistoryState Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlerHistoryState

ToJSON CrawlerHistoryState Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlerHistoryState

ToJSONKey CrawlerHistoryState Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlerHistoryState

ToByteString CrawlerHistoryState Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlerHistoryState

ToHeader CrawlerHistoryState Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlerHistoryState

ToLog CrawlerHistoryState Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlerHistoryState

ToQuery CrawlerHistoryState Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlerHistoryState

FromText CrawlerHistoryState Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlerHistoryState

ToText CrawlerHistoryState Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlerHistoryState

FromXML CrawlerHistoryState Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlerHistoryState

ToXML CrawlerHistoryState Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlerHistoryState

Generic CrawlerHistoryState Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlerHistoryState

Associated Types

type Rep CrawlerHistoryState :: Type -> Type #

Read CrawlerHistoryState Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlerHistoryState

Show CrawlerHistoryState Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlerHistoryState

NFData CrawlerHistoryState Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlerHistoryState

Methods

rnf :: CrawlerHistoryState -> () #

Eq CrawlerHistoryState Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlerHistoryState

Ord CrawlerHistoryState Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlerHistoryState

Hashable CrawlerHistoryState Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlerHistoryState

type Rep CrawlerHistoryState Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlerHistoryState

type Rep CrawlerHistoryState = D1 ('MetaData "CrawlerHistoryState" "Amazonka.Glue.Types.CrawlerHistoryState" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'True) (C1 ('MetaCons "CrawlerHistoryState'" 'PrefixI 'True) (S1 ('MetaSel ('Just "fromCrawlerHistoryState") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedLazy) (Rec0 Text)))

CrawlerLineageSettings

newtype CrawlerLineageSettings Source #

Instances

Instances details
FromJSON CrawlerLineageSettings Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlerLineageSettings

FromJSONKey CrawlerLineageSettings Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlerLineageSettings

ToJSON CrawlerLineageSettings Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlerLineageSettings

ToJSONKey CrawlerLineageSettings Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlerLineageSettings

ToByteString CrawlerLineageSettings Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlerLineageSettings

ToHeader CrawlerLineageSettings Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlerLineageSettings

ToLog CrawlerLineageSettings Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlerLineageSettings

ToQuery CrawlerLineageSettings Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlerLineageSettings

FromText CrawlerLineageSettings Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlerLineageSettings

ToText CrawlerLineageSettings Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlerLineageSettings

FromXML CrawlerLineageSettings Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlerLineageSettings

ToXML CrawlerLineageSettings Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlerLineageSettings

Generic CrawlerLineageSettings Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlerLineageSettings

Associated Types

type Rep CrawlerLineageSettings :: Type -> Type #

Read CrawlerLineageSettings Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlerLineageSettings

Show CrawlerLineageSettings Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlerLineageSettings

NFData CrawlerLineageSettings Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlerLineageSettings

Methods

rnf :: CrawlerLineageSettings -> () #

Eq CrawlerLineageSettings Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlerLineageSettings

Ord CrawlerLineageSettings Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlerLineageSettings

Hashable CrawlerLineageSettings Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlerLineageSettings

type Rep CrawlerLineageSettings Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlerLineageSettings

type Rep CrawlerLineageSettings = D1 ('MetaData "CrawlerLineageSettings" "Amazonka.Glue.Types.CrawlerLineageSettings" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'True) (C1 ('MetaCons "CrawlerLineageSettings'" 'PrefixI 'True) (S1 ('MetaSel ('Just "fromCrawlerLineageSettings") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedLazy) (Rec0 Text)))

CrawlerState

newtype CrawlerState Source #

Constructors

CrawlerState' 

Instances

Instances details
FromJSON CrawlerState Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlerState

FromJSONKey CrawlerState Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlerState

ToJSON CrawlerState Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlerState

ToJSONKey CrawlerState Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlerState

ToByteString CrawlerState Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlerState

ToHeader CrawlerState Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlerState

ToLog CrawlerState Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlerState

ToQuery CrawlerState Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlerState

FromText CrawlerState Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlerState

ToText CrawlerState Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlerState

Methods

toText :: CrawlerState -> Text #

FromXML CrawlerState Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlerState

ToXML CrawlerState Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlerState

Methods

toXML :: CrawlerState -> XML #

Generic CrawlerState Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlerState

Associated Types

type Rep CrawlerState :: Type -> Type #

Read CrawlerState Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlerState

Show CrawlerState Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlerState

NFData CrawlerState Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlerState

Methods

rnf :: CrawlerState -> () #

Eq CrawlerState Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlerState

Ord CrawlerState Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlerState

Hashable CrawlerState Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlerState

type Rep CrawlerState Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlerState

type Rep CrawlerState = D1 ('MetaData "CrawlerState" "Amazonka.Glue.Types.CrawlerState" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'True) (C1 ('MetaCons "CrawlerState'" 'PrefixI 'True) (S1 ('MetaSel ('Just "fromCrawlerState") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedLazy) (Rec0 Text)))

CsvHeaderOption

newtype CsvHeaderOption Source #

Constructors

CsvHeaderOption' 

Instances

Instances details
FromJSON CsvHeaderOption Source # 
Instance details

Defined in Amazonka.Glue.Types.CsvHeaderOption

FromJSONKey CsvHeaderOption Source # 
Instance details

Defined in Amazonka.Glue.Types.CsvHeaderOption

ToJSON CsvHeaderOption Source # 
Instance details

Defined in Amazonka.Glue.Types.CsvHeaderOption

ToJSONKey CsvHeaderOption Source # 
Instance details

Defined in Amazonka.Glue.Types.CsvHeaderOption

ToByteString CsvHeaderOption Source # 
Instance details

Defined in Amazonka.Glue.Types.CsvHeaderOption

ToHeader CsvHeaderOption Source # 
Instance details

Defined in Amazonka.Glue.Types.CsvHeaderOption

ToLog CsvHeaderOption Source # 
Instance details

Defined in Amazonka.Glue.Types.CsvHeaderOption

ToQuery CsvHeaderOption Source # 
Instance details

Defined in Amazonka.Glue.Types.CsvHeaderOption

FromText CsvHeaderOption Source # 
Instance details

Defined in Amazonka.Glue.Types.CsvHeaderOption

ToText CsvHeaderOption Source # 
Instance details

Defined in Amazonka.Glue.Types.CsvHeaderOption

FromXML CsvHeaderOption Source # 
Instance details

Defined in Amazonka.Glue.Types.CsvHeaderOption

ToXML CsvHeaderOption Source # 
Instance details

Defined in Amazonka.Glue.Types.CsvHeaderOption

Methods

toXML :: CsvHeaderOption -> XML #

Generic CsvHeaderOption Source # 
Instance details

Defined in Amazonka.Glue.Types.CsvHeaderOption

Associated Types

type Rep CsvHeaderOption :: Type -> Type #

Read CsvHeaderOption Source # 
Instance details

Defined in Amazonka.Glue.Types.CsvHeaderOption

Show CsvHeaderOption Source # 
Instance details

Defined in Amazonka.Glue.Types.CsvHeaderOption

NFData CsvHeaderOption Source # 
Instance details

Defined in Amazonka.Glue.Types.CsvHeaderOption

Methods

rnf :: CsvHeaderOption -> () #

Eq CsvHeaderOption Source # 
Instance details

Defined in Amazonka.Glue.Types.CsvHeaderOption

Ord CsvHeaderOption Source # 
Instance details

Defined in Amazonka.Glue.Types.CsvHeaderOption

Hashable CsvHeaderOption Source # 
Instance details

Defined in Amazonka.Glue.Types.CsvHeaderOption

type Rep CsvHeaderOption Source # 
Instance details

Defined in Amazonka.Glue.Types.CsvHeaderOption

type Rep CsvHeaderOption = D1 ('MetaData "CsvHeaderOption" "Amazonka.Glue.Types.CsvHeaderOption" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'True) (C1 ('MetaCons "CsvHeaderOption'" 'PrefixI 'True) (S1 ('MetaSel ('Just "fromCsvHeaderOption") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedLazy) (Rec0 Text)))

DQStopJobOnFailureTiming

newtype DQStopJobOnFailureTiming Source #

Instances

Instances details
FromJSON DQStopJobOnFailureTiming Source # 
Instance details

Defined in Amazonka.Glue.Types.DQStopJobOnFailureTiming

FromJSONKey DQStopJobOnFailureTiming Source # 
Instance details

Defined in Amazonka.Glue.Types.DQStopJobOnFailureTiming

ToJSON DQStopJobOnFailureTiming Source # 
Instance details

Defined in Amazonka.Glue.Types.DQStopJobOnFailureTiming

ToJSONKey DQStopJobOnFailureTiming Source # 
Instance details

Defined in Amazonka.Glue.Types.DQStopJobOnFailureTiming

ToByteString DQStopJobOnFailureTiming Source # 
Instance details

Defined in Amazonka.Glue.Types.DQStopJobOnFailureTiming

ToHeader DQStopJobOnFailureTiming Source # 
Instance details

Defined in Amazonka.Glue.Types.DQStopJobOnFailureTiming

ToLog DQStopJobOnFailureTiming Source # 
Instance details

Defined in Amazonka.Glue.Types.DQStopJobOnFailureTiming

ToQuery DQStopJobOnFailureTiming Source # 
Instance details

Defined in Amazonka.Glue.Types.DQStopJobOnFailureTiming

FromText DQStopJobOnFailureTiming Source # 
Instance details

Defined in Amazonka.Glue.Types.DQStopJobOnFailureTiming

ToText DQStopJobOnFailureTiming Source # 
Instance details

Defined in Amazonka.Glue.Types.DQStopJobOnFailureTiming

FromXML DQStopJobOnFailureTiming Source # 
Instance details

Defined in Amazonka.Glue.Types.DQStopJobOnFailureTiming

ToXML DQStopJobOnFailureTiming Source # 
Instance details

Defined in Amazonka.Glue.Types.DQStopJobOnFailureTiming

Generic DQStopJobOnFailureTiming Source # 
Instance details

Defined in Amazonka.Glue.Types.DQStopJobOnFailureTiming

Associated Types

type Rep DQStopJobOnFailureTiming :: Type -> Type #

Read DQStopJobOnFailureTiming Source # 
Instance details

Defined in Amazonka.Glue.Types.DQStopJobOnFailureTiming

Show DQStopJobOnFailureTiming Source # 
Instance details

Defined in Amazonka.Glue.Types.DQStopJobOnFailureTiming

NFData DQStopJobOnFailureTiming Source # 
Instance details

Defined in Amazonka.Glue.Types.DQStopJobOnFailureTiming

Eq DQStopJobOnFailureTiming Source # 
Instance details

Defined in Amazonka.Glue.Types.DQStopJobOnFailureTiming

Ord DQStopJobOnFailureTiming Source # 
Instance details

Defined in Amazonka.Glue.Types.DQStopJobOnFailureTiming

Hashable DQStopJobOnFailureTiming Source # 
Instance details

Defined in Amazonka.Glue.Types.DQStopJobOnFailureTiming

type Rep DQStopJobOnFailureTiming Source # 
Instance details

Defined in Amazonka.Glue.Types.DQStopJobOnFailureTiming

type Rep DQStopJobOnFailureTiming = D1 ('MetaData "DQStopJobOnFailureTiming" "Amazonka.Glue.Types.DQStopJobOnFailureTiming" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'True) (C1 ('MetaCons "DQStopJobOnFailureTiming'" 'PrefixI 'True) (S1 ('MetaSel ('Just "fromDQStopJobOnFailureTiming") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedLazy) (Rec0 Text)))

DQTransformOutput

newtype DQTransformOutput Source #

Instances

Instances details
FromJSON DQTransformOutput Source # 
Instance details

Defined in Amazonka.Glue.Types.DQTransformOutput

FromJSONKey DQTransformOutput Source # 
Instance details

Defined in Amazonka.Glue.Types.DQTransformOutput

ToJSON DQTransformOutput Source # 
Instance details

Defined in Amazonka.Glue.Types.DQTransformOutput

ToJSONKey DQTransformOutput Source # 
Instance details

Defined in Amazonka.Glue.Types.DQTransformOutput

ToByteString DQTransformOutput Source # 
Instance details

Defined in Amazonka.Glue.Types.DQTransformOutput

ToHeader DQTransformOutput Source # 
Instance details

Defined in Amazonka.Glue.Types.DQTransformOutput

ToLog DQTransformOutput Source # 
Instance details

Defined in Amazonka.Glue.Types.DQTransformOutput

ToQuery DQTransformOutput Source # 
Instance details

Defined in Amazonka.Glue.Types.DQTransformOutput

FromText DQTransformOutput Source # 
Instance details

Defined in Amazonka.Glue.Types.DQTransformOutput

ToText DQTransformOutput Source # 
Instance details

Defined in Amazonka.Glue.Types.DQTransformOutput

FromXML DQTransformOutput Source # 
Instance details

Defined in Amazonka.Glue.Types.DQTransformOutput

ToXML DQTransformOutput Source # 
Instance details

Defined in Amazonka.Glue.Types.DQTransformOutput

Generic DQTransformOutput Source # 
Instance details

Defined in Amazonka.Glue.Types.DQTransformOutput

Associated Types

type Rep DQTransformOutput :: Type -> Type #

Read DQTransformOutput Source # 
Instance details

Defined in Amazonka.Glue.Types.DQTransformOutput

Show DQTransformOutput Source # 
Instance details

Defined in Amazonka.Glue.Types.DQTransformOutput

NFData DQTransformOutput Source # 
Instance details

Defined in Amazonka.Glue.Types.DQTransformOutput

Methods

rnf :: DQTransformOutput -> () #

Eq DQTransformOutput Source # 
Instance details

Defined in Amazonka.Glue.Types.DQTransformOutput

Ord DQTransformOutput Source # 
Instance details

Defined in Amazonka.Glue.Types.DQTransformOutput

Hashable DQTransformOutput Source # 
Instance details

Defined in Amazonka.Glue.Types.DQTransformOutput

type Rep DQTransformOutput Source # 
Instance details

Defined in Amazonka.Glue.Types.DQTransformOutput

type Rep DQTransformOutput = D1 ('MetaData "DQTransformOutput" "Amazonka.Glue.Types.DQTransformOutput" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'True) (C1 ('MetaCons "DQTransformOutput'" 'PrefixI 'True) (S1 ('MetaSel ('Just "fromDQTransformOutput") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedLazy) (Rec0 Text)))

DataFormat

newtype DataFormat Source #

Constructors

DataFormat' 

Fields

Bundled Patterns

pattern DataFormat_AVRO :: DataFormat 
pattern DataFormat_JSON :: DataFormat 
pattern DataFormat_PROTOBUF :: DataFormat 

Instances

Instances details
FromJSON DataFormat Source # 
Instance details

Defined in Amazonka.Glue.Types.DataFormat

FromJSONKey DataFormat Source # 
Instance details

Defined in Amazonka.Glue.Types.DataFormat

ToJSON DataFormat Source # 
Instance details

Defined in Amazonka.Glue.Types.DataFormat

ToJSONKey DataFormat Source # 
Instance details

Defined in Amazonka.Glue.Types.DataFormat

ToByteString DataFormat Source # 
Instance details

Defined in Amazonka.Glue.Types.DataFormat

ToHeader DataFormat Source # 
Instance details

Defined in Amazonka.Glue.Types.DataFormat

ToLog DataFormat Source # 
Instance details

Defined in Amazonka.Glue.Types.DataFormat

ToQuery DataFormat Source # 
Instance details

Defined in Amazonka.Glue.Types.DataFormat

FromText DataFormat Source # 
Instance details

Defined in Amazonka.Glue.Types.DataFormat

ToText DataFormat Source # 
Instance details

Defined in Amazonka.Glue.Types.DataFormat

Methods

toText :: DataFormat -> Text #

FromXML DataFormat Source # 
Instance details

Defined in Amazonka.Glue.Types.DataFormat

ToXML DataFormat Source # 
Instance details

Defined in Amazonka.Glue.Types.DataFormat

Methods

toXML :: DataFormat -> XML #

Generic DataFormat Source # 
Instance details

Defined in Amazonka.Glue.Types.DataFormat

Associated Types

type Rep DataFormat :: Type -> Type #

Read DataFormat Source # 
Instance details

Defined in Amazonka.Glue.Types.DataFormat

Show DataFormat Source # 
Instance details

Defined in Amazonka.Glue.Types.DataFormat

NFData DataFormat Source # 
Instance details

Defined in Amazonka.Glue.Types.DataFormat

Methods

rnf :: DataFormat -> () #

Eq DataFormat Source # 
Instance details

Defined in Amazonka.Glue.Types.DataFormat

Ord DataFormat Source # 
Instance details

Defined in Amazonka.Glue.Types.DataFormat

Hashable DataFormat Source # 
Instance details

Defined in Amazonka.Glue.Types.DataFormat

type Rep DataFormat Source # 
Instance details

Defined in Amazonka.Glue.Types.DataFormat

type Rep DataFormat = D1 ('MetaData "DataFormat" "Amazonka.Glue.Types.DataFormat" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'True) (C1 ('MetaCons "DataFormat'" 'PrefixI 'True) (S1 ('MetaSel ('Just "fromDataFormat") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedLazy) (Rec0 Text)))

DataQualityRuleResultStatus

newtype DataQualityRuleResultStatus Source #

Instances

Instances details
FromJSON DataQualityRuleResultStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityRuleResultStatus

FromJSONKey DataQualityRuleResultStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityRuleResultStatus

ToJSON DataQualityRuleResultStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityRuleResultStatus

ToJSONKey DataQualityRuleResultStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityRuleResultStatus

ToByteString DataQualityRuleResultStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityRuleResultStatus

ToHeader DataQualityRuleResultStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityRuleResultStatus

ToLog DataQualityRuleResultStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityRuleResultStatus

ToQuery DataQualityRuleResultStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityRuleResultStatus

FromText DataQualityRuleResultStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityRuleResultStatus

ToText DataQualityRuleResultStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityRuleResultStatus

FromXML DataQualityRuleResultStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityRuleResultStatus

ToXML DataQualityRuleResultStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityRuleResultStatus

Generic DataQualityRuleResultStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityRuleResultStatus

Associated Types

type Rep DataQualityRuleResultStatus :: Type -> Type #

Read DataQualityRuleResultStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityRuleResultStatus

Show DataQualityRuleResultStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityRuleResultStatus

NFData DataQualityRuleResultStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityRuleResultStatus

Eq DataQualityRuleResultStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityRuleResultStatus

Ord DataQualityRuleResultStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityRuleResultStatus

Hashable DataQualityRuleResultStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityRuleResultStatus

type Rep DataQualityRuleResultStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityRuleResultStatus

type Rep DataQualityRuleResultStatus = D1 ('MetaData "DataQualityRuleResultStatus" "Amazonka.Glue.Types.DataQualityRuleResultStatus" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'True) (C1 ('MetaCons "DataQualityRuleResultStatus'" 'PrefixI 'True) (S1 ('MetaSel ('Just "fromDataQualityRuleResultStatus") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedLazy) (Rec0 Text)))

DeleteBehavior

newtype DeleteBehavior Source #

Constructors

DeleteBehavior' 

Instances

Instances details
FromJSON DeleteBehavior Source # 
Instance details

Defined in Amazonka.Glue.Types.DeleteBehavior

FromJSONKey DeleteBehavior Source # 
Instance details

Defined in Amazonka.Glue.Types.DeleteBehavior

ToJSON DeleteBehavior Source # 
Instance details

Defined in Amazonka.Glue.Types.DeleteBehavior

ToJSONKey DeleteBehavior Source # 
Instance details

Defined in Amazonka.Glue.Types.DeleteBehavior

ToByteString DeleteBehavior Source # 
Instance details

Defined in Amazonka.Glue.Types.DeleteBehavior

ToHeader DeleteBehavior Source # 
Instance details

Defined in Amazonka.Glue.Types.DeleteBehavior

ToLog DeleteBehavior Source # 
Instance details

Defined in Amazonka.Glue.Types.DeleteBehavior

ToQuery DeleteBehavior Source # 
Instance details

Defined in Amazonka.Glue.Types.DeleteBehavior

FromText DeleteBehavior Source # 
Instance details

Defined in Amazonka.Glue.Types.DeleteBehavior

ToText DeleteBehavior Source # 
Instance details

Defined in Amazonka.Glue.Types.DeleteBehavior

FromXML DeleteBehavior Source # 
Instance details

Defined in Amazonka.Glue.Types.DeleteBehavior

ToXML DeleteBehavior Source # 
Instance details

Defined in Amazonka.Glue.Types.DeleteBehavior

Methods

toXML :: DeleteBehavior -> XML #

Generic DeleteBehavior Source # 
Instance details

Defined in Amazonka.Glue.Types.DeleteBehavior

Associated Types

type Rep DeleteBehavior :: Type -> Type #

Read DeleteBehavior Source # 
Instance details

Defined in Amazonka.Glue.Types.DeleteBehavior

Show DeleteBehavior Source # 
Instance details

Defined in Amazonka.Glue.Types.DeleteBehavior

NFData DeleteBehavior Source # 
Instance details

Defined in Amazonka.Glue.Types.DeleteBehavior

Methods

rnf :: DeleteBehavior -> () #

Eq DeleteBehavior Source # 
Instance details

Defined in Amazonka.Glue.Types.DeleteBehavior

Ord DeleteBehavior Source # 
Instance details

Defined in Amazonka.Glue.Types.DeleteBehavior

Hashable DeleteBehavior Source # 
Instance details

Defined in Amazonka.Glue.Types.DeleteBehavior

type Rep DeleteBehavior Source # 
Instance details

Defined in Amazonka.Glue.Types.DeleteBehavior

type Rep DeleteBehavior = D1 ('MetaData "DeleteBehavior" "Amazonka.Glue.Types.DeleteBehavior" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'True) (C1 ('MetaCons "DeleteBehavior'" 'PrefixI 'True) (S1 ('MetaSel ('Just "fromDeleteBehavior") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedLazy) (Rec0 Text)))

EnableHybridValues

newtype EnableHybridValues Source #

Instances

Instances details
FromJSON EnableHybridValues Source # 
Instance details

Defined in Amazonka.Glue.Types.EnableHybridValues

FromJSONKey EnableHybridValues Source # 
Instance details

Defined in Amazonka.Glue.Types.EnableHybridValues

ToJSON EnableHybridValues Source # 
Instance details

Defined in Amazonka.Glue.Types.EnableHybridValues

ToJSONKey EnableHybridValues Source # 
Instance details

Defined in Amazonka.Glue.Types.EnableHybridValues

ToByteString EnableHybridValues Source # 
Instance details

Defined in Amazonka.Glue.Types.EnableHybridValues

ToHeader EnableHybridValues Source # 
Instance details

Defined in Amazonka.Glue.Types.EnableHybridValues

ToLog EnableHybridValues Source # 
Instance details

Defined in Amazonka.Glue.Types.EnableHybridValues

ToQuery EnableHybridValues Source # 
Instance details

Defined in Amazonka.Glue.Types.EnableHybridValues

FromText EnableHybridValues Source # 
Instance details

Defined in Amazonka.Glue.Types.EnableHybridValues

ToText EnableHybridValues Source # 
Instance details

Defined in Amazonka.Glue.Types.EnableHybridValues

FromXML EnableHybridValues Source # 
Instance details

Defined in Amazonka.Glue.Types.EnableHybridValues

ToXML EnableHybridValues Source # 
Instance details

Defined in Amazonka.Glue.Types.EnableHybridValues

Generic EnableHybridValues Source # 
Instance details

Defined in Amazonka.Glue.Types.EnableHybridValues

Associated Types

type Rep EnableHybridValues :: Type -> Type #

Read EnableHybridValues Source # 
Instance details

Defined in Amazonka.Glue.Types.EnableHybridValues

Show EnableHybridValues Source # 
Instance details

Defined in Amazonka.Glue.Types.EnableHybridValues

NFData EnableHybridValues Source # 
Instance details

Defined in Amazonka.Glue.Types.EnableHybridValues

Methods

rnf :: EnableHybridValues -> () #

Eq EnableHybridValues Source # 
Instance details

Defined in Amazonka.Glue.Types.EnableHybridValues

Ord EnableHybridValues Source # 
Instance details

Defined in Amazonka.Glue.Types.EnableHybridValues

Hashable EnableHybridValues Source # 
Instance details

Defined in Amazonka.Glue.Types.EnableHybridValues

type Rep EnableHybridValues Source # 
Instance details

Defined in Amazonka.Glue.Types.EnableHybridValues

type Rep EnableHybridValues = D1 ('MetaData "EnableHybridValues" "Amazonka.Glue.Types.EnableHybridValues" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'True) (C1 ('MetaCons "EnableHybridValues'" 'PrefixI 'True) (S1 ('MetaSel ('Just "fromEnableHybridValues") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedLazy) (Rec0 Text)))

ExecutionClass

newtype ExecutionClass Source #

Constructors

ExecutionClass' 

Instances

Instances details
FromJSON ExecutionClass Source # 
Instance details

Defined in Amazonka.Glue.Types.ExecutionClass

FromJSONKey ExecutionClass Source # 
Instance details

Defined in Amazonka.Glue.Types.ExecutionClass

ToJSON ExecutionClass Source # 
Instance details

Defined in Amazonka.Glue.Types.ExecutionClass

ToJSONKey ExecutionClass Source # 
Instance details

Defined in Amazonka.Glue.Types.ExecutionClass

ToByteString ExecutionClass Source # 
Instance details

Defined in Amazonka.Glue.Types.ExecutionClass

ToHeader ExecutionClass Source # 
Instance details

Defined in Amazonka.Glue.Types.ExecutionClass

ToLog ExecutionClass Source # 
Instance details

Defined in Amazonka.Glue.Types.ExecutionClass

ToQuery ExecutionClass Source # 
Instance details

Defined in Amazonka.Glue.Types.ExecutionClass

FromText ExecutionClass Source # 
Instance details

Defined in Amazonka.Glue.Types.ExecutionClass

ToText ExecutionClass Source # 
Instance details

Defined in Amazonka.Glue.Types.ExecutionClass

FromXML ExecutionClass Source # 
Instance details

Defined in Amazonka.Glue.Types.ExecutionClass

ToXML ExecutionClass Source # 
Instance details

Defined in Amazonka.Glue.Types.ExecutionClass

Methods

toXML :: ExecutionClass -> XML #

Generic ExecutionClass Source # 
Instance details

Defined in Amazonka.Glue.Types.ExecutionClass

Associated Types

type Rep ExecutionClass :: Type -> Type #

Read ExecutionClass Source # 
Instance details

Defined in Amazonka.Glue.Types.ExecutionClass

Show ExecutionClass Source # 
Instance details

Defined in Amazonka.Glue.Types.ExecutionClass

NFData ExecutionClass Source # 
Instance details

Defined in Amazonka.Glue.Types.ExecutionClass

Methods

rnf :: ExecutionClass -> () #

Eq ExecutionClass Source # 
Instance details

Defined in Amazonka.Glue.Types.ExecutionClass

Ord ExecutionClass Source # 
Instance details

Defined in Amazonka.Glue.Types.ExecutionClass

Hashable ExecutionClass Source # 
Instance details

Defined in Amazonka.Glue.Types.ExecutionClass

type Rep ExecutionClass Source # 
Instance details

Defined in Amazonka.Glue.Types.ExecutionClass

type Rep ExecutionClass = D1 ('MetaData "ExecutionClass" "Amazonka.Glue.Types.ExecutionClass" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'True) (C1 ('MetaCons "ExecutionClass'" 'PrefixI 'True) (S1 ('MetaSel ('Just "fromExecutionClass") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedLazy) (Rec0 Text)))

ExistCondition

newtype ExistCondition Source #

Constructors

ExistCondition' 

Instances

Instances details
FromJSON ExistCondition Source # 
Instance details

Defined in Amazonka.Glue.Types.ExistCondition

FromJSONKey ExistCondition Source # 
Instance details

Defined in Amazonka.Glue.Types.ExistCondition

ToJSON ExistCondition Source # 
Instance details

Defined in Amazonka.Glue.Types.ExistCondition

ToJSONKey ExistCondition Source # 
Instance details

Defined in Amazonka.Glue.Types.ExistCondition

ToByteString ExistCondition Source # 
Instance details

Defined in Amazonka.Glue.Types.ExistCondition

ToHeader ExistCondition Source # 
Instance details

Defined in Amazonka.Glue.Types.ExistCondition

ToLog ExistCondition Source # 
Instance details

Defined in Amazonka.Glue.Types.ExistCondition

ToQuery ExistCondition Source # 
Instance details

Defined in Amazonka.Glue.Types.ExistCondition

FromText ExistCondition Source # 
Instance details

Defined in Amazonka.Glue.Types.ExistCondition

ToText ExistCondition Source # 
Instance details

Defined in Amazonka.Glue.Types.ExistCondition

FromXML ExistCondition Source # 
Instance details

Defined in Amazonka.Glue.Types.ExistCondition

ToXML ExistCondition Source # 
Instance details

Defined in Amazonka.Glue.Types.ExistCondition

Methods

toXML :: ExistCondition -> XML #

Generic ExistCondition Source # 
Instance details

Defined in Amazonka.Glue.Types.ExistCondition

Associated Types

type Rep ExistCondition :: Type -> Type #

Read ExistCondition Source # 
Instance details

Defined in Amazonka.Glue.Types.ExistCondition

Show ExistCondition Source # 
Instance details

Defined in Amazonka.Glue.Types.ExistCondition

NFData ExistCondition Source # 
Instance details

Defined in Amazonka.Glue.Types.ExistCondition

Methods

rnf :: ExistCondition -> () #

Eq ExistCondition Source # 
Instance details

Defined in Amazonka.Glue.Types.ExistCondition

Ord ExistCondition Source # 
Instance details

Defined in Amazonka.Glue.Types.ExistCondition

Hashable ExistCondition Source # 
Instance details

Defined in Amazonka.Glue.Types.ExistCondition

type Rep ExistCondition Source # 
Instance details

Defined in Amazonka.Glue.Types.ExistCondition

type Rep ExistCondition = D1 ('MetaData "ExistCondition" "Amazonka.Glue.Types.ExistCondition" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'True) (C1 ('MetaCons "ExistCondition'" 'PrefixI 'True) (S1 ('MetaSel ('Just "fromExistCondition") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedLazy) (Rec0 Text)))

FieldName

newtype FieldName Source #

Constructors

FieldName' 

Fields

Instances

Instances details
FromJSON FieldName Source # 
Instance details

Defined in Amazonka.Glue.Types.FieldName

FromJSONKey FieldName Source # 
Instance details

Defined in Amazonka.Glue.Types.FieldName

ToJSON FieldName Source # 
Instance details

Defined in Amazonka.Glue.Types.FieldName

ToJSONKey FieldName Source # 
Instance details

Defined in Amazonka.Glue.Types.FieldName

ToByteString FieldName Source # 
Instance details

Defined in Amazonka.Glue.Types.FieldName

Methods

toBS :: FieldName -> ByteString #

ToHeader FieldName Source # 
Instance details

Defined in Amazonka.Glue.Types.FieldName

ToLog FieldName Source # 
Instance details

Defined in Amazonka.Glue.Types.FieldName

ToQuery FieldName Source # 
Instance details

Defined in Amazonka.Glue.Types.FieldName

FromText FieldName Source # 
Instance details

Defined in Amazonka.Glue.Types.FieldName

ToText FieldName Source # 
Instance details

Defined in Amazonka.Glue.Types.FieldName

Methods

toText :: FieldName -> Text #

FromXML FieldName Source # 
Instance details

Defined in Amazonka.Glue.Types.FieldName

ToXML FieldName Source # 
Instance details

Defined in Amazonka.Glue.Types.FieldName

Methods

toXML :: FieldName -> XML #

Generic FieldName Source # 
Instance details

Defined in Amazonka.Glue.Types.FieldName

Associated Types

type Rep FieldName :: Type -> Type #

Read FieldName Source # 
Instance details

Defined in Amazonka.Glue.Types.FieldName

Show FieldName Source # 
Instance details

Defined in Amazonka.Glue.Types.FieldName

NFData FieldName Source # 
Instance details

Defined in Amazonka.Glue.Types.FieldName

Methods

rnf :: FieldName -> () #

Eq FieldName Source # 
Instance details

Defined in Amazonka.Glue.Types.FieldName

Ord FieldName Source # 
Instance details

Defined in Amazonka.Glue.Types.FieldName

Hashable FieldName Source # 
Instance details

Defined in Amazonka.Glue.Types.FieldName

type Rep FieldName Source # 
Instance details

Defined in Amazonka.Glue.Types.FieldName

type Rep FieldName = D1 ('MetaData "FieldName" "Amazonka.Glue.Types.FieldName" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'True) (C1 ('MetaCons "FieldName'" 'PrefixI 'True) (S1 ('MetaSel ('Just "fromFieldName") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedLazy) (Rec0 Text)))

FilterLogicalOperator

newtype FilterLogicalOperator Source #

Instances

Instances details
FromJSON FilterLogicalOperator Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterLogicalOperator

FromJSONKey FilterLogicalOperator Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterLogicalOperator

ToJSON FilterLogicalOperator Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterLogicalOperator

ToJSONKey FilterLogicalOperator Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterLogicalOperator

ToByteString FilterLogicalOperator Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterLogicalOperator

ToHeader FilterLogicalOperator Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterLogicalOperator

ToLog FilterLogicalOperator Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterLogicalOperator

ToQuery FilterLogicalOperator Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterLogicalOperator

FromText FilterLogicalOperator Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterLogicalOperator

ToText FilterLogicalOperator Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterLogicalOperator

FromXML FilterLogicalOperator Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterLogicalOperator

ToXML FilterLogicalOperator Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterLogicalOperator

Generic FilterLogicalOperator Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterLogicalOperator

Associated Types

type Rep FilterLogicalOperator :: Type -> Type #

Read FilterLogicalOperator Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterLogicalOperator

Show FilterLogicalOperator Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterLogicalOperator

NFData FilterLogicalOperator Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterLogicalOperator

Methods

rnf :: FilterLogicalOperator -> () #

Eq FilterLogicalOperator Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterLogicalOperator

Ord FilterLogicalOperator Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterLogicalOperator

Hashable FilterLogicalOperator Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterLogicalOperator

type Rep FilterLogicalOperator Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterLogicalOperator

type Rep FilterLogicalOperator = D1 ('MetaData "FilterLogicalOperator" "Amazonka.Glue.Types.FilterLogicalOperator" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'True) (C1 ('MetaCons "FilterLogicalOperator'" 'PrefixI 'True) (S1 ('MetaSel ('Just "fromFilterLogicalOperator") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedLazy) (Rec0 Text)))

FilterOperation

newtype FilterOperation Source #

Constructors

FilterOperation' 

Instances

Instances details
FromJSON FilterOperation Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterOperation

FromJSONKey FilterOperation Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterOperation

ToJSON FilterOperation Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterOperation

ToJSONKey FilterOperation Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterOperation

ToByteString FilterOperation Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterOperation

ToHeader FilterOperation Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterOperation

ToLog FilterOperation Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterOperation

ToQuery FilterOperation Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterOperation

FromText FilterOperation Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterOperation

ToText FilterOperation Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterOperation

FromXML FilterOperation Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterOperation

ToXML FilterOperation Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterOperation

Methods

toXML :: FilterOperation -> XML #

Generic FilterOperation Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterOperation

Associated Types

type Rep FilterOperation :: Type -> Type #

Read FilterOperation Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterOperation

Show FilterOperation Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterOperation

NFData FilterOperation Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterOperation

Methods

rnf :: FilterOperation -> () #

Eq FilterOperation Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterOperation

Ord FilterOperation Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterOperation

Hashable FilterOperation Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterOperation

type Rep FilterOperation Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterOperation

type Rep FilterOperation = D1 ('MetaData "FilterOperation" "Amazonka.Glue.Types.FilterOperation" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'True) (C1 ('MetaCons "FilterOperation'" 'PrefixI 'True) (S1 ('MetaSel ('Just "fromFilterOperation") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedLazy) (Rec0 Text)))

FilterOperator

newtype FilterOperator Source #

Constructors

FilterOperator' 

Instances

Instances details
FromJSON FilterOperator Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterOperator

FromJSONKey FilterOperator Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterOperator

ToJSON FilterOperator Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterOperator

ToJSONKey FilterOperator Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterOperator

ToByteString FilterOperator Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterOperator

ToHeader FilterOperator Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterOperator

ToLog FilterOperator Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterOperator

ToQuery FilterOperator Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterOperator

FromText FilterOperator Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterOperator

ToText FilterOperator Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterOperator

FromXML FilterOperator Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterOperator

ToXML FilterOperator Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterOperator

Methods

toXML :: FilterOperator -> XML #

Generic FilterOperator Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterOperator

Associated Types

type Rep FilterOperator :: Type -> Type #

Read FilterOperator Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterOperator

Show FilterOperator Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterOperator

NFData FilterOperator Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterOperator

Methods

rnf :: FilterOperator -> () #

Eq FilterOperator Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterOperator

Ord FilterOperator Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterOperator

Hashable FilterOperator Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterOperator

type Rep FilterOperator Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterOperator

type Rep FilterOperator = D1 ('MetaData "FilterOperator" "Amazonka.Glue.Types.FilterOperator" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'True) (C1 ('MetaCons "FilterOperator'" 'PrefixI 'True) (S1 ('MetaSel ('Just "fromFilterOperator") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedLazy) (Rec0 Text)))

FilterValueType

newtype FilterValueType Source #

Constructors

FilterValueType' 

Instances

Instances details
FromJSON FilterValueType Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterValueType

FromJSONKey FilterValueType Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterValueType

ToJSON FilterValueType Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterValueType

ToJSONKey FilterValueType Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterValueType

ToByteString FilterValueType Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterValueType

ToHeader FilterValueType Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterValueType

ToLog FilterValueType Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterValueType

ToQuery FilterValueType Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterValueType

FromText FilterValueType Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterValueType

ToText FilterValueType Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterValueType

FromXML FilterValueType Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterValueType

ToXML FilterValueType Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterValueType

Methods

toXML :: FilterValueType -> XML #

Generic FilterValueType Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterValueType

Associated Types

type Rep FilterValueType :: Type -> Type #

Read FilterValueType Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterValueType

Show FilterValueType Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterValueType

NFData FilterValueType Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterValueType

Methods

rnf :: FilterValueType -> () #

Eq FilterValueType Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterValueType

Ord FilterValueType Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterValueType

Hashable FilterValueType Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterValueType

type Rep FilterValueType Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterValueType

type Rep FilterValueType = D1 ('MetaData "FilterValueType" "Amazonka.Glue.Types.FilterValueType" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'True) (C1 ('MetaCons "FilterValueType'" 'PrefixI 'True) (S1 ('MetaSel ('Just "fromFilterValueType") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedLazy) (Rec0 Text)))

GlueRecordType

newtype GlueRecordType Source #

Constructors

GlueRecordType' 

Instances

Instances details
FromJSON GlueRecordType Source # 
Instance details

Defined in Amazonka.Glue.Types.GlueRecordType

FromJSONKey GlueRecordType Source # 
Instance details

Defined in Amazonka.Glue.Types.GlueRecordType

ToJSON GlueRecordType Source # 
Instance details

Defined in Amazonka.Glue.Types.GlueRecordType

ToJSONKey GlueRecordType Source # 
Instance details

Defined in Amazonka.Glue.Types.GlueRecordType

ToByteString GlueRecordType Source # 
Instance details

Defined in Amazonka.Glue.Types.GlueRecordType

ToHeader GlueRecordType Source # 
Instance details

Defined in Amazonka.Glue.Types.GlueRecordType

ToLog GlueRecordType Source # 
Instance details

Defined in Amazonka.Glue.Types.GlueRecordType

ToQuery GlueRecordType Source # 
Instance details

Defined in Amazonka.Glue.Types.GlueRecordType

FromText GlueRecordType Source # 
Instance details

Defined in Amazonka.Glue.Types.GlueRecordType

ToText GlueRecordType Source # 
Instance details

Defined in Amazonka.Glue.Types.GlueRecordType

FromXML GlueRecordType Source # 
Instance details

Defined in Amazonka.Glue.Types.GlueRecordType

ToXML GlueRecordType Source # 
Instance details

Defined in Amazonka.Glue.Types.GlueRecordType

Methods

toXML :: GlueRecordType -> XML #

Generic GlueRecordType Source # 
Instance details

Defined in Amazonka.Glue.Types.GlueRecordType

Associated Types

type Rep GlueRecordType :: Type -> Type #

Read GlueRecordType Source # 
Instance details

Defined in Amazonka.Glue.Types.GlueRecordType

Show GlueRecordType Source # 
Instance details

Defined in Amazonka.Glue.Types.GlueRecordType

NFData GlueRecordType Source # 
Instance details

Defined in Amazonka.Glue.Types.GlueRecordType

Methods

rnf :: GlueRecordType -> () #

Eq GlueRecordType Source # 
Instance details

Defined in Amazonka.Glue.Types.GlueRecordType

Ord GlueRecordType Source # 
Instance details

Defined in Amazonka.Glue.Types.GlueRecordType

Hashable GlueRecordType Source # 
Instance details

Defined in Amazonka.Glue.Types.GlueRecordType

type Rep GlueRecordType Source # 
Instance details

Defined in Amazonka.Glue.Types.GlueRecordType

type Rep GlueRecordType = D1 ('MetaData "GlueRecordType" "Amazonka.Glue.Types.GlueRecordType" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'True) (C1 ('MetaCons "GlueRecordType'" 'PrefixI 'True) (S1 ('MetaSel ('Just "fromGlueRecordType") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedLazy) (Rec0 Text)))

JDBCDataType

newtype JDBCDataType Source #

Constructors

JDBCDataType' 

Bundled Patterns

pattern JDBCDataType_ARRAY :: JDBCDataType 
pattern JDBCDataType_BIGINT :: JDBCDataType 
pattern JDBCDataType_BINARY :: JDBCDataType 
pattern JDBCDataType_BIT :: JDBCDataType 
pattern JDBCDataType_BLOB :: JDBCDataType 
pattern JDBCDataType_BOOLEAN :: JDBCDataType 
pattern JDBCDataType_CHAR :: JDBCDataType 
pattern JDBCDataType_CLOB :: JDBCDataType 
pattern JDBCDataType_DATALINK :: JDBCDataType 
pattern JDBCDataType_DATE :: JDBCDataType 
pattern JDBCDataType_DECIMAL :: JDBCDataType 
pattern JDBCDataType_DISTINCT :: JDBCDataType 
pattern JDBCDataType_DOUBLE :: JDBCDataType 
pattern JDBCDataType_FLOAT :: JDBCDataType 
pattern JDBCDataType_INTEGER :: JDBCDataType 
pattern JDBCDataType_JAVA_OBJECT :: JDBCDataType 
pattern JDBCDataType_LONGNVARCHAR :: JDBCDataType 
pattern JDBCDataType_LONGVARBINARY :: JDBCDataType 
pattern JDBCDataType_LONGVARCHAR :: JDBCDataType 
pattern JDBCDataType_NCHAR :: JDBCDataType 
pattern JDBCDataType_NCLOB :: JDBCDataType 
pattern JDBCDataType_NULL :: JDBCDataType 
pattern JDBCDataType_NUMERIC :: JDBCDataType 
pattern JDBCDataType_NVARCHAR :: JDBCDataType 
pattern JDBCDataType_OTHER :: JDBCDataType 
pattern JDBCDataType_REAL :: JDBCDataType 
pattern JDBCDataType_REF :: JDBCDataType 
pattern JDBCDataType_REF_CURSOR :: JDBCDataType 
pattern JDBCDataType_ROWID :: JDBCDataType 
pattern JDBCDataType_SMALLINT :: JDBCDataType 
pattern JDBCDataType_SQLXML :: JDBCDataType 
pattern JDBCDataType_STRUCT :: JDBCDataType 
pattern JDBCDataType_TIME :: JDBCDataType 
pattern JDBCDataType_TIMESTAMP :: JDBCDataType 
pattern JDBCDataType_TIMESTAMP_WITH_TIMEZONE :: JDBCDataType 
pattern JDBCDataType_TIME_WITH_TIMEZONE :: JDBCDataType 
pattern JDBCDataType_TINYINT :: JDBCDataType 
pattern JDBCDataType_VARBINARY :: JDBCDataType 
pattern JDBCDataType_VARCHAR :: JDBCDataType 

Instances

Instances details
FromJSON JDBCDataType Source # 
Instance details

Defined in Amazonka.Glue.Types.JDBCDataType

FromJSONKey JDBCDataType Source # 
Instance details

Defined in Amazonka.Glue.Types.JDBCDataType

ToJSON JDBCDataType Source # 
Instance details

Defined in Amazonka.Glue.Types.JDBCDataType

ToJSONKey JDBCDataType Source # 
Instance details

Defined in Amazonka.Glue.Types.JDBCDataType

ToByteString JDBCDataType Source # 
Instance details

Defined in Amazonka.Glue.Types.JDBCDataType

ToHeader JDBCDataType Source # 
Instance details

Defined in Amazonka.Glue.Types.JDBCDataType

ToLog JDBCDataType Source # 
Instance details

Defined in Amazonka.Glue.Types.JDBCDataType

ToQuery JDBCDataType Source # 
Instance details

Defined in Amazonka.Glue.Types.JDBCDataType

FromText JDBCDataType Source # 
Instance details

Defined in Amazonka.Glue.Types.JDBCDataType

ToText JDBCDataType Source # 
Instance details

Defined in Amazonka.Glue.Types.JDBCDataType

Methods

toText :: JDBCDataType -> Text #

FromXML JDBCDataType Source # 
Instance details

Defined in Amazonka.Glue.Types.JDBCDataType

ToXML JDBCDataType Source # 
Instance details

Defined in Amazonka.Glue.Types.JDBCDataType

Methods

toXML :: JDBCDataType -> XML #

Generic JDBCDataType Source # 
Instance details

Defined in Amazonka.Glue.Types.JDBCDataType

Associated Types

type Rep JDBCDataType :: Type -> Type #

Read JDBCDataType Source # 
Instance details

Defined in Amazonka.Glue.Types.JDBCDataType

Show JDBCDataType Source # 
Instance details

Defined in Amazonka.Glue.Types.JDBCDataType

NFData JDBCDataType Source # 
Instance details

Defined in Amazonka.Glue.Types.JDBCDataType

Methods

rnf :: JDBCDataType -> () #

Eq JDBCDataType Source # 
Instance details

Defined in Amazonka.Glue.Types.JDBCDataType

Ord JDBCDataType Source # 
Instance details

Defined in Amazonka.Glue.Types.JDBCDataType

Hashable JDBCDataType Source # 
Instance details

Defined in Amazonka.Glue.Types.JDBCDataType

type Rep JDBCDataType Source # 
Instance details

Defined in Amazonka.Glue.Types.JDBCDataType

type Rep JDBCDataType = D1 ('MetaData "JDBCDataType" "Amazonka.Glue.Types.JDBCDataType" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'True) (C1 ('MetaCons "JDBCDataType'" 'PrefixI 'True) (S1 ('MetaSel ('Just "fromJDBCDataType") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedLazy) (Rec0 Text)))

JdbcMetadataEntry

newtype JdbcMetadataEntry Source #

Instances

Instances details
FromJSON JdbcMetadataEntry Source # 
Instance details

Defined in Amazonka.Glue.Types.JdbcMetadataEntry

FromJSONKey JdbcMetadataEntry Source # 
Instance details

Defined in Amazonka.Glue.Types.JdbcMetadataEntry

ToJSON JdbcMetadataEntry Source # 
Instance details

Defined in Amazonka.Glue.Types.JdbcMetadataEntry

ToJSONKey JdbcMetadataEntry Source # 
Instance details

Defined in Amazonka.Glue.Types.JdbcMetadataEntry

ToByteString JdbcMetadataEntry Source # 
Instance details

Defined in Amazonka.Glue.Types.JdbcMetadataEntry

ToHeader JdbcMetadataEntry Source # 
Instance details

Defined in Amazonka.Glue.Types.JdbcMetadataEntry

ToLog JdbcMetadataEntry Source # 
Instance details

Defined in Amazonka.Glue.Types.JdbcMetadataEntry

ToQuery JdbcMetadataEntry Source # 
Instance details

Defined in Amazonka.Glue.Types.JdbcMetadataEntry

FromText JdbcMetadataEntry Source # 
Instance details

Defined in Amazonka.Glue.Types.JdbcMetadataEntry

ToText JdbcMetadataEntry Source # 
Instance details

Defined in Amazonka.Glue.Types.JdbcMetadataEntry

FromXML JdbcMetadataEntry Source # 
Instance details

Defined in Amazonka.Glue.Types.JdbcMetadataEntry

ToXML JdbcMetadataEntry Source # 
Instance details

Defined in Amazonka.Glue.Types.JdbcMetadataEntry

Generic JdbcMetadataEntry Source # 
Instance details

Defined in Amazonka.Glue.Types.JdbcMetadataEntry

Associated Types

type Rep JdbcMetadataEntry :: Type -> Type #

Read JdbcMetadataEntry Source # 
Instance details

Defined in Amazonka.Glue.Types.JdbcMetadataEntry

Show JdbcMetadataEntry Source # 
Instance details

Defined in Amazonka.Glue.Types.JdbcMetadataEntry

NFData JdbcMetadataEntry Source # 
Instance details

Defined in Amazonka.Glue.Types.JdbcMetadataEntry

Methods

rnf :: JdbcMetadataEntry -> () #

Eq JdbcMetadataEntry Source # 
Instance details

Defined in Amazonka.Glue.Types.JdbcMetadataEntry

Ord JdbcMetadataEntry Source # 
Instance details

Defined in Amazonka.Glue.Types.JdbcMetadataEntry

Hashable JdbcMetadataEntry Source # 
Instance details

Defined in Amazonka.Glue.Types.JdbcMetadataEntry

type Rep JdbcMetadataEntry Source # 
Instance details

Defined in Amazonka.Glue.Types.JdbcMetadataEntry

type Rep JdbcMetadataEntry = D1 ('MetaData "JdbcMetadataEntry" "Amazonka.Glue.Types.JdbcMetadataEntry" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'True) (C1 ('MetaCons "JdbcMetadataEntry'" 'PrefixI 'True) (S1 ('MetaSel ('Just "fromJdbcMetadataEntry") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedLazy) (Rec0 Text)))

JobBookmarksEncryptionMode

newtype JobBookmarksEncryptionMode Source #

Instances

Instances details
FromJSON JobBookmarksEncryptionMode Source # 
Instance details

Defined in Amazonka.Glue.Types.JobBookmarksEncryptionMode

FromJSONKey JobBookmarksEncryptionMode Source # 
Instance details

Defined in Amazonka.Glue.Types.JobBookmarksEncryptionMode

ToJSON JobBookmarksEncryptionMode Source # 
Instance details

Defined in Amazonka.Glue.Types.JobBookmarksEncryptionMode

ToJSONKey JobBookmarksEncryptionMode Source # 
Instance details

Defined in Amazonka.Glue.Types.JobBookmarksEncryptionMode

ToByteString JobBookmarksEncryptionMode Source # 
Instance details

Defined in Amazonka.Glue.Types.JobBookmarksEncryptionMode

ToHeader JobBookmarksEncryptionMode Source # 
Instance details

Defined in Amazonka.Glue.Types.JobBookmarksEncryptionMode

ToLog JobBookmarksEncryptionMode Source # 
Instance details

Defined in Amazonka.Glue.Types.JobBookmarksEncryptionMode

ToQuery JobBookmarksEncryptionMode Source # 
Instance details

Defined in Amazonka.Glue.Types.JobBookmarksEncryptionMode

FromText JobBookmarksEncryptionMode Source # 
Instance details

Defined in Amazonka.Glue.Types.JobBookmarksEncryptionMode

ToText JobBookmarksEncryptionMode Source # 
Instance details

Defined in Amazonka.Glue.Types.JobBookmarksEncryptionMode

FromXML JobBookmarksEncryptionMode Source # 
Instance details

Defined in Amazonka.Glue.Types.JobBookmarksEncryptionMode

ToXML JobBookmarksEncryptionMode Source # 
Instance details

Defined in Amazonka.Glue.Types.JobBookmarksEncryptionMode

Generic JobBookmarksEncryptionMode Source # 
Instance details

Defined in Amazonka.Glue.Types.JobBookmarksEncryptionMode

Associated Types

type Rep JobBookmarksEncryptionMode :: Type -> Type #

Read JobBookmarksEncryptionMode Source # 
Instance details

Defined in Amazonka.Glue.Types.JobBookmarksEncryptionMode

Show JobBookmarksEncryptionMode Source # 
Instance details

Defined in Amazonka.Glue.Types.JobBookmarksEncryptionMode

NFData JobBookmarksEncryptionMode Source # 
Instance details

Defined in Amazonka.Glue.Types.JobBookmarksEncryptionMode

Eq JobBookmarksEncryptionMode Source # 
Instance details

Defined in Amazonka.Glue.Types.JobBookmarksEncryptionMode

Ord JobBookmarksEncryptionMode Source # 
Instance details

Defined in Amazonka.Glue.Types.JobBookmarksEncryptionMode

Hashable JobBookmarksEncryptionMode Source # 
Instance details

Defined in Amazonka.Glue.Types.JobBookmarksEncryptionMode

type Rep JobBookmarksEncryptionMode Source # 
Instance details

Defined in Amazonka.Glue.Types.JobBookmarksEncryptionMode

type Rep JobBookmarksEncryptionMode = D1 ('MetaData "JobBookmarksEncryptionMode" "Amazonka.Glue.Types.JobBookmarksEncryptionMode" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'True) (C1 ('MetaCons "JobBookmarksEncryptionMode'" 'PrefixI 'True) (S1 ('MetaSel ('Just "fromJobBookmarksEncryptionMode") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedLazy) (Rec0 Text)))

JobRunState

newtype JobRunState Source #

Constructors

JobRunState' 

Instances

Instances details
FromJSON JobRunState Source # 
Instance details

Defined in Amazonka.Glue.Types.JobRunState

FromJSONKey JobRunState Source # 
Instance details

Defined in Amazonka.Glue.Types.JobRunState

ToJSON JobRunState Source # 
Instance details

Defined in Amazonka.Glue.Types.JobRunState

ToJSONKey JobRunState Source # 
Instance details

Defined in Amazonka.Glue.Types.JobRunState

ToByteString JobRunState Source # 
Instance details

Defined in Amazonka.Glue.Types.JobRunState

ToHeader JobRunState Source # 
Instance details

Defined in Amazonka.Glue.Types.JobRunState

ToLog JobRunState Source # 
Instance details

Defined in Amazonka.Glue.Types.JobRunState

ToQuery JobRunState Source # 
Instance details

Defined in Amazonka.Glue.Types.JobRunState

FromText JobRunState Source # 
Instance details

Defined in Amazonka.Glue.Types.JobRunState

ToText JobRunState Source # 
Instance details

Defined in Amazonka.Glue.Types.JobRunState

Methods

toText :: JobRunState -> Text #

FromXML JobRunState Source # 
Instance details

Defined in Amazonka.Glue.Types.JobRunState

ToXML JobRunState Source # 
Instance details

Defined in Amazonka.Glue.Types.JobRunState

Methods

toXML :: JobRunState -> XML #

Generic JobRunState Source # 
Instance details

Defined in Amazonka.Glue.Types.JobRunState

Associated Types

type Rep JobRunState :: Type -> Type #

Read JobRunState Source # 
Instance details

Defined in Amazonka.Glue.Types.JobRunState

Show JobRunState Source # 
Instance details

Defined in Amazonka.Glue.Types.JobRunState

NFData JobRunState Source # 
Instance details

Defined in Amazonka.Glue.Types.JobRunState

Methods

rnf :: JobRunState -> () #

Eq JobRunState Source # 
Instance details

Defined in Amazonka.Glue.Types.JobRunState

Ord JobRunState Source # 
Instance details

Defined in Amazonka.Glue.Types.JobRunState

Hashable JobRunState Source # 
Instance details

Defined in Amazonka.Glue.Types.JobRunState

type Rep JobRunState Source # 
Instance details

Defined in Amazonka.Glue.Types.JobRunState

type Rep JobRunState = D1 ('MetaData "JobRunState" "Amazonka.Glue.Types.JobRunState" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'True) (C1 ('MetaCons "JobRunState'" 'PrefixI 'True) (S1 ('MetaSel ('Just "fromJobRunState") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedLazy) (Rec0 Text)))

JoinType

newtype JoinType Source #

Constructors

JoinType' 

Fields

Bundled Patterns

pattern JoinType_Equijoin :: JoinType 
pattern JoinType_Left :: JoinType 
pattern JoinType_Leftanti :: JoinType 
pattern JoinType_Leftsemi :: JoinType 
pattern JoinType_Outer :: JoinType 
pattern JoinType_Right :: JoinType 

Instances

Instances details
FromJSON JoinType Source # 
Instance details

Defined in Amazonka.Glue.Types.JoinType

FromJSONKey JoinType Source # 
Instance details

Defined in Amazonka.Glue.Types.JoinType

ToJSON JoinType Source # 
Instance details

Defined in Amazonka.Glue.Types.JoinType

ToJSONKey JoinType Source # 
Instance details

Defined in Amazonka.Glue.Types.JoinType

ToByteString JoinType Source # 
Instance details

Defined in Amazonka.Glue.Types.JoinType

Methods

toBS :: JoinType -> ByteString #

ToHeader JoinType Source # 
Instance details

Defined in Amazonka.Glue.Types.JoinType

Methods

toHeader :: HeaderName -> JoinType -> [Header] #

ToLog JoinType Source # 
Instance details

Defined in Amazonka.Glue.Types.JoinType

ToQuery JoinType Source # 
Instance details

Defined in Amazonka.Glue.Types.JoinType

FromText JoinType Source # 
Instance details

Defined in Amazonka.Glue.Types.JoinType

ToText JoinType Source # 
Instance details

Defined in Amazonka.Glue.Types.JoinType

Methods

toText :: JoinType -> Text #

FromXML JoinType Source # 
Instance details

Defined in Amazonka.Glue.Types.JoinType

ToXML JoinType Source # 
Instance details

Defined in Amazonka.Glue.Types.JoinType

Methods

toXML :: JoinType -> XML #

Generic JoinType Source # 
Instance details

Defined in Amazonka.Glue.Types.JoinType

Associated Types

type Rep JoinType :: Type -> Type #

Methods

from :: JoinType -> Rep JoinType x #

to :: Rep JoinType x -> JoinType #

Read JoinType Source # 
Instance details

Defined in Amazonka.Glue.Types.JoinType

Show JoinType Source # 
Instance details

Defined in Amazonka.Glue.Types.JoinType

NFData JoinType Source # 
Instance details

Defined in Amazonka.Glue.Types.JoinType

Methods

rnf :: JoinType -> () #

Eq JoinType Source # 
Instance details

Defined in Amazonka.Glue.Types.JoinType

Ord JoinType Source # 
Instance details

Defined in Amazonka.Glue.Types.JoinType

Hashable JoinType Source # 
Instance details

Defined in Amazonka.Glue.Types.JoinType

Methods

hashWithSalt :: Int -> JoinType -> Int #

hash :: JoinType -> Int #

type Rep JoinType Source # 
Instance details

Defined in Amazonka.Glue.Types.JoinType

type Rep JoinType = D1 ('MetaData "JoinType" "Amazonka.Glue.Types.JoinType" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'True) (C1 ('MetaCons "JoinType'" 'PrefixI 'True) (S1 ('MetaSel ('Just "fromJoinType") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedLazy) (Rec0 Text)))

Language

newtype Language Source #

Constructors

Language' 

Fields

Bundled Patterns

pattern Language_PYTHON :: Language 
pattern Language_SCALA :: Language 

Instances

Instances details
FromJSON Language Source # 
Instance details

Defined in Amazonka.Glue.Types.Language

FromJSONKey Language Source # 
Instance details

Defined in Amazonka.Glue.Types.Language

ToJSON Language Source # 
Instance details

Defined in Amazonka.Glue.Types.Language

ToJSONKey Language Source # 
Instance details

Defined in Amazonka.Glue.Types.Language

ToByteString Language Source # 
Instance details

Defined in Amazonka.Glue.Types.Language

Methods

toBS :: Language -> ByteString #

ToHeader Language Source # 
Instance details

Defined in Amazonka.Glue.Types.Language

Methods

toHeader :: HeaderName -> Language -> [Header] #

ToLog Language Source # 
Instance details

Defined in Amazonka.Glue.Types.Language

ToQuery Language Source # 
Instance details

Defined in Amazonka.Glue.Types.Language

FromText Language Source # 
Instance details

Defined in Amazonka.Glue.Types.Language

ToText Language Source # 
Instance details

Defined in Amazonka.Glue.Types.Language

Methods

toText :: Language -> Text #

FromXML Language Source # 
Instance details

Defined in Amazonka.Glue.Types.Language

ToXML Language Source # 
Instance details

Defined in Amazonka.Glue.Types.Language

Methods

toXML :: Language -> XML #

Generic Language Source # 
Instance details

Defined in Amazonka.Glue.Types.Language

Associated Types

type Rep Language :: Type -> Type #

Methods

from :: Language -> Rep Language x #

to :: Rep Language x -> Language #

Read Language Source # 
Instance details

Defined in Amazonka.Glue.Types.Language

Show Language Source # 
Instance details

Defined in Amazonka.Glue.Types.Language

NFData Language Source # 
Instance details

Defined in Amazonka.Glue.Types.Language

Methods

rnf :: Language -> () #

Eq Language Source # 
Instance details

Defined in Amazonka.Glue.Types.Language

Ord Language Source # 
Instance details

Defined in Amazonka.Glue.Types.Language

Hashable Language Source # 
Instance details

Defined in Amazonka.Glue.Types.Language

Methods

hashWithSalt :: Int -> Language -> Int #

hash :: Language -> Int #

type Rep Language Source # 
Instance details

Defined in Amazonka.Glue.Types.Language

type Rep Language = D1 ('MetaData "Language" "Amazonka.Glue.Types.Language" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'True) (C1 ('MetaCons "Language'" 'PrefixI 'True) (S1 ('MetaSel ('Just "fromLanguage") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedLazy) (Rec0 Text)))

LastCrawlStatus

newtype LastCrawlStatus Source #

Constructors

LastCrawlStatus' 

Instances

Instances details
FromJSON LastCrawlStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.LastCrawlStatus

FromJSONKey LastCrawlStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.LastCrawlStatus

ToJSON LastCrawlStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.LastCrawlStatus

ToJSONKey LastCrawlStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.LastCrawlStatus

ToByteString LastCrawlStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.LastCrawlStatus

ToHeader LastCrawlStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.LastCrawlStatus

ToLog LastCrawlStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.LastCrawlStatus

ToQuery LastCrawlStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.LastCrawlStatus

FromText LastCrawlStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.LastCrawlStatus

ToText LastCrawlStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.LastCrawlStatus

FromXML LastCrawlStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.LastCrawlStatus

ToXML LastCrawlStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.LastCrawlStatus

Methods

toXML :: LastCrawlStatus -> XML #

Generic LastCrawlStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.LastCrawlStatus

Associated Types

type Rep LastCrawlStatus :: Type -> Type #

Read LastCrawlStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.LastCrawlStatus

Show LastCrawlStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.LastCrawlStatus

NFData LastCrawlStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.LastCrawlStatus

Methods

rnf :: LastCrawlStatus -> () #

Eq LastCrawlStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.LastCrawlStatus

Ord LastCrawlStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.LastCrawlStatus

Hashable LastCrawlStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.LastCrawlStatus

type Rep LastCrawlStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.LastCrawlStatus

type Rep LastCrawlStatus = D1 ('MetaData "LastCrawlStatus" "Amazonka.Glue.Types.LastCrawlStatus" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'True) (C1 ('MetaCons "LastCrawlStatus'" 'PrefixI 'True) (S1 ('MetaSel ('Just "fromLastCrawlStatus") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedLazy) (Rec0 Text)))

Logical

newtype Logical Source #

Constructors

Logical' 

Fields

Bundled Patterns

pattern Logical_AND :: Logical 
pattern Logical_ANY :: Logical 

Instances

Instances details
FromJSON Logical Source # 
Instance details

Defined in Amazonka.Glue.Types.Logical

FromJSONKey Logical Source # 
Instance details

Defined in Amazonka.Glue.Types.Logical

ToJSON Logical Source # 
Instance details

Defined in Amazonka.Glue.Types.Logical

ToJSONKey Logical Source # 
Instance details

Defined in Amazonka.Glue.Types.Logical

ToByteString Logical Source # 
Instance details

Defined in Amazonka.Glue.Types.Logical

Methods

toBS :: Logical -> ByteString #

ToHeader Logical Source # 
Instance details

Defined in Amazonka.Glue.Types.Logical

Methods

toHeader :: HeaderName -> Logical -> [Header] #

ToLog Logical Source # 
Instance details

Defined in Amazonka.Glue.Types.Logical

ToQuery Logical Source # 
Instance details

Defined in Amazonka.Glue.Types.Logical

FromText Logical Source # 
Instance details

Defined in Amazonka.Glue.Types.Logical

ToText Logical Source # 
Instance details

Defined in Amazonka.Glue.Types.Logical

Methods

toText :: Logical -> Text #

FromXML Logical Source # 
Instance details

Defined in Amazonka.Glue.Types.Logical

ToXML Logical Source # 
Instance details

Defined in Amazonka.Glue.Types.Logical

Methods

toXML :: Logical -> XML #

Generic Logical Source # 
Instance details

Defined in Amazonka.Glue.Types.Logical

Associated Types

type Rep Logical :: Type -> Type #

Methods

from :: Logical -> Rep Logical x #

to :: Rep Logical x -> Logical #

Read Logical Source # 
Instance details

Defined in Amazonka.Glue.Types.Logical

Show Logical Source # 
Instance details

Defined in Amazonka.Glue.Types.Logical

NFData Logical Source # 
Instance details

Defined in Amazonka.Glue.Types.Logical

Methods

rnf :: Logical -> () #

Eq Logical Source # 
Instance details

Defined in Amazonka.Glue.Types.Logical

Methods

(==) :: Logical -> Logical -> Bool #

(/=) :: Logical -> Logical -> Bool #

Ord Logical Source # 
Instance details

Defined in Amazonka.Glue.Types.Logical

Hashable Logical Source # 
Instance details

Defined in Amazonka.Glue.Types.Logical

Methods

hashWithSalt :: Int -> Logical -> Int #

hash :: Logical -> Int #

type Rep Logical Source # 
Instance details

Defined in Amazonka.Glue.Types.Logical

type Rep Logical = D1 ('MetaData "Logical" "Amazonka.Glue.Types.Logical" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'True) (C1 ('MetaCons "Logical'" 'PrefixI 'True) (S1 ('MetaSel ('Just "fromLogical") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedLazy) (Rec0 Text)))

LogicalOperator

newtype LogicalOperator Source #

Constructors

LogicalOperator' 

Bundled Patterns

pattern LogicalOperator_EQUALS :: LogicalOperator 

Instances

Instances details
FromJSON LogicalOperator Source # 
Instance details

Defined in Amazonka.Glue.Types.LogicalOperator

FromJSONKey LogicalOperator Source # 
Instance details

Defined in Amazonka.Glue.Types.LogicalOperator

ToJSON LogicalOperator Source # 
Instance details

Defined in Amazonka.Glue.Types.LogicalOperator

ToJSONKey LogicalOperator Source # 
Instance details

Defined in Amazonka.Glue.Types.LogicalOperator

ToByteString LogicalOperator Source # 
Instance details

Defined in Amazonka.Glue.Types.LogicalOperator

ToHeader LogicalOperator Source # 
Instance details

Defined in Amazonka.Glue.Types.LogicalOperator

ToLog LogicalOperator Source # 
Instance details

Defined in Amazonka.Glue.Types.LogicalOperator

ToQuery LogicalOperator Source # 
Instance details

Defined in Amazonka.Glue.Types.LogicalOperator

FromText LogicalOperator Source # 
Instance details

Defined in Amazonka.Glue.Types.LogicalOperator

ToText LogicalOperator Source # 
Instance details

Defined in Amazonka.Glue.Types.LogicalOperator

FromXML LogicalOperator Source # 
Instance details

Defined in Amazonka.Glue.Types.LogicalOperator

ToXML LogicalOperator Source # 
Instance details

Defined in Amazonka.Glue.Types.LogicalOperator

Methods

toXML :: LogicalOperator -> XML #

Generic LogicalOperator Source # 
Instance details

Defined in Amazonka.Glue.Types.LogicalOperator

Associated Types

type Rep LogicalOperator :: Type -> Type #

Read LogicalOperator Source # 
Instance details

Defined in Amazonka.Glue.Types.LogicalOperator

Show LogicalOperator Source # 
Instance details

Defined in Amazonka.Glue.Types.LogicalOperator

NFData LogicalOperator Source # 
Instance details

Defined in Amazonka.Glue.Types.LogicalOperator

Methods

rnf :: LogicalOperator -> () #

Eq LogicalOperator Source # 
Instance details

Defined in Amazonka.Glue.Types.LogicalOperator

Ord LogicalOperator Source # 
Instance details

Defined in Amazonka.Glue.Types.LogicalOperator

Hashable LogicalOperator Source # 
Instance details

Defined in Amazonka.Glue.Types.LogicalOperator

type Rep LogicalOperator Source # 
Instance details

Defined in Amazonka.Glue.Types.LogicalOperator

type Rep LogicalOperator = D1 ('MetaData "LogicalOperator" "Amazonka.Glue.Types.LogicalOperator" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'True) (C1 ('MetaCons "LogicalOperator'" 'PrefixI 'True) (S1 ('MetaSel ('Just "fromLogicalOperator") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedLazy) (Rec0 Text)))

MLUserDataEncryptionModeString

newtype MLUserDataEncryptionModeString Source #

Instances

Instances details
FromJSON MLUserDataEncryptionModeString Source # 
Instance details

Defined in Amazonka.Glue.Types.MLUserDataEncryptionModeString

FromJSONKey MLUserDataEncryptionModeString Source # 
Instance details

Defined in Amazonka.Glue.Types.MLUserDataEncryptionModeString

ToJSON MLUserDataEncryptionModeString Source # 
Instance details

Defined in Amazonka.Glue.Types.MLUserDataEncryptionModeString

ToJSONKey MLUserDataEncryptionModeString Source # 
Instance details

Defined in Amazonka.Glue.Types.MLUserDataEncryptionModeString

ToByteString MLUserDataEncryptionModeString Source # 
Instance details

Defined in Amazonka.Glue.Types.MLUserDataEncryptionModeString

ToHeader MLUserDataEncryptionModeString Source # 
Instance details

Defined in Amazonka.Glue.Types.MLUserDataEncryptionModeString

ToLog MLUserDataEncryptionModeString Source # 
Instance details

Defined in Amazonka.Glue.Types.MLUserDataEncryptionModeString

ToQuery MLUserDataEncryptionModeString Source # 
Instance details

Defined in Amazonka.Glue.Types.MLUserDataEncryptionModeString

FromText MLUserDataEncryptionModeString Source # 
Instance details

Defined in Amazonka.Glue.Types.MLUserDataEncryptionModeString

ToText MLUserDataEncryptionModeString Source # 
Instance details

Defined in Amazonka.Glue.Types.MLUserDataEncryptionModeString

FromXML MLUserDataEncryptionModeString Source # 
Instance details

Defined in Amazonka.Glue.Types.MLUserDataEncryptionModeString

ToXML MLUserDataEncryptionModeString Source # 
Instance details

Defined in Amazonka.Glue.Types.MLUserDataEncryptionModeString

Generic MLUserDataEncryptionModeString Source # 
Instance details

Defined in Amazonka.Glue.Types.MLUserDataEncryptionModeString

Associated Types

type Rep MLUserDataEncryptionModeString :: Type -> Type #

Read MLUserDataEncryptionModeString Source # 
Instance details

Defined in Amazonka.Glue.Types.MLUserDataEncryptionModeString

Show MLUserDataEncryptionModeString Source # 
Instance details

Defined in Amazonka.Glue.Types.MLUserDataEncryptionModeString

NFData MLUserDataEncryptionModeString Source # 
Instance details

Defined in Amazonka.Glue.Types.MLUserDataEncryptionModeString

Eq MLUserDataEncryptionModeString Source # 
Instance details

Defined in Amazonka.Glue.Types.MLUserDataEncryptionModeString

Ord MLUserDataEncryptionModeString Source # 
Instance details

Defined in Amazonka.Glue.Types.MLUserDataEncryptionModeString

Hashable MLUserDataEncryptionModeString Source # 
Instance details

Defined in Amazonka.Glue.Types.MLUserDataEncryptionModeString

type Rep MLUserDataEncryptionModeString Source # 
Instance details

Defined in Amazonka.Glue.Types.MLUserDataEncryptionModeString

type Rep MLUserDataEncryptionModeString = D1 ('MetaData "MLUserDataEncryptionModeString" "Amazonka.Glue.Types.MLUserDataEncryptionModeString" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'True) (C1 ('MetaCons "MLUserDataEncryptionModeString'" 'PrefixI 'True) (S1 ('MetaSel ('Just "fromMLUserDataEncryptionModeString") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedLazy) (Rec0 Text)))

NodeType

newtype NodeType Source #

Constructors

NodeType' 

Fields

Bundled Patterns

pattern NodeType_CRAWLER :: NodeType 
pattern NodeType_JOB :: NodeType 
pattern NodeType_TRIGGER :: NodeType 

Instances

Instances details
FromJSON NodeType Source # 
Instance details

Defined in Amazonka.Glue.Types.NodeType

FromJSONKey NodeType Source # 
Instance details

Defined in Amazonka.Glue.Types.NodeType

ToJSON NodeType Source # 
Instance details

Defined in Amazonka.Glue.Types.NodeType

ToJSONKey NodeType Source # 
Instance details

Defined in Amazonka.Glue.Types.NodeType

ToByteString NodeType Source # 
Instance details

Defined in Amazonka.Glue.Types.NodeType

Methods

toBS :: NodeType -> ByteString #

ToHeader NodeType Source # 
Instance details

Defined in Amazonka.Glue.Types.NodeType

Methods

toHeader :: HeaderName -> NodeType -> [Header] #

ToLog NodeType Source # 
Instance details

Defined in Amazonka.Glue.Types.NodeType

ToQuery NodeType Source # 
Instance details

Defined in Amazonka.Glue.Types.NodeType

FromText NodeType Source # 
Instance details

Defined in Amazonka.Glue.Types.NodeType

ToText NodeType Source # 
Instance details

Defined in Amazonka.Glue.Types.NodeType

Methods

toText :: NodeType -> Text #

FromXML NodeType Source # 
Instance details

Defined in Amazonka.Glue.Types.NodeType

ToXML NodeType Source # 
Instance details

Defined in Amazonka.Glue.Types.NodeType

Methods

toXML :: NodeType -> XML #

Generic NodeType Source # 
Instance details

Defined in Amazonka.Glue.Types.NodeType

Associated Types

type Rep NodeType :: Type -> Type #

Methods

from :: NodeType -> Rep NodeType x #

to :: Rep NodeType x -> NodeType #

Read NodeType Source # 
Instance details

Defined in Amazonka.Glue.Types.NodeType

Show NodeType Source # 
Instance details

Defined in Amazonka.Glue.Types.NodeType

NFData NodeType Source # 
Instance details

Defined in Amazonka.Glue.Types.NodeType

Methods

rnf :: NodeType -> () #

Eq NodeType Source # 
Instance details

Defined in Amazonka.Glue.Types.NodeType

Ord NodeType Source # 
Instance details

Defined in Amazonka.Glue.Types.NodeType

Hashable NodeType Source # 
Instance details

Defined in Amazonka.Glue.Types.NodeType

Methods

hashWithSalt :: Int -> NodeType -> Int #

hash :: NodeType -> Int #

type Rep NodeType Source # 
Instance details

Defined in Amazonka.Glue.Types.NodeType

type Rep NodeType = D1 ('MetaData "NodeType" "Amazonka.Glue.Types.NodeType" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'True) (C1 ('MetaCons "NodeType'" 'PrefixI 'True) (S1 ('MetaSel ('Just "fromNodeType") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedLazy) (Rec0 Text)))

ParamType

newtype ParamType Source #

Constructors

ParamType' 

Fields

Bundled Patterns

pattern ParamType_Bool :: ParamType 
pattern ParamType_Complex :: ParamType 
pattern ParamType_Float :: ParamType 
pattern ParamType_Int :: ParamType 
pattern ParamType_List :: ParamType 
pattern ParamType_Null :: ParamType 
pattern ParamType_Str :: ParamType 

Instances

Instances details
FromJSON ParamType Source # 
Instance details

Defined in Amazonka.Glue.Types.ParamType

FromJSONKey ParamType Source # 
Instance details

Defined in Amazonka.Glue.Types.ParamType

ToJSON ParamType Source # 
Instance details

Defined in Amazonka.Glue.Types.ParamType

ToJSONKey ParamType Source # 
Instance details

Defined in Amazonka.Glue.Types.ParamType

ToByteString ParamType Source # 
Instance details

Defined in Amazonka.Glue.Types.ParamType

Methods

toBS :: ParamType -> ByteString #

ToHeader ParamType Source # 
Instance details

Defined in Amazonka.Glue.Types.ParamType

ToLog ParamType Source # 
Instance details

Defined in Amazonka.Glue.Types.ParamType

ToQuery ParamType Source # 
Instance details

Defined in Amazonka.Glue.Types.ParamType

FromText ParamType Source # 
Instance details

Defined in Amazonka.Glue.Types.ParamType

ToText ParamType Source # 
Instance details

Defined in Amazonka.Glue.Types.ParamType

Methods

toText :: ParamType -> Text #

FromXML ParamType Source # 
Instance details

Defined in Amazonka.Glue.Types.ParamType

ToXML ParamType Source # 
Instance details

Defined in Amazonka.Glue.Types.ParamType

Methods

toXML :: ParamType -> XML #

Generic ParamType Source # 
Instance details

Defined in Amazonka.Glue.Types.ParamType

Associated Types

type Rep ParamType :: Type -> Type #

Read ParamType Source # 
Instance details

Defined in Amazonka.Glue.Types.ParamType

Show ParamType Source # 
Instance details

Defined in Amazonka.Glue.Types.ParamType

NFData ParamType Source # 
Instance details

Defined in Amazonka.Glue.Types.ParamType

Methods

rnf :: ParamType -> () #

Eq ParamType Source # 
Instance details

Defined in Amazonka.Glue.Types.ParamType

Ord ParamType Source # 
Instance details

Defined in Amazonka.Glue.Types.ParamType

Hashable ParamType Source # 
Instance details

Defined in Amazonka.Glue.Types.ParamType

type Rep ParamType Source # 
Instance details

Defined in Amazonka.Glue.Types.ParamType

type Rep ParamType = D1 ('MetaData "ParamType" "Amazonka.Glue.Types.ParamType" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'True) (C1 ('MetaCons "ParamType'" 'PrefixI 'True) (S1 ('MetaSel ('Just "fromParamType") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedLazy) (Rec0 Text)))

ParquetCompressionType

newtype ParquetCompressionType Source #

Instances

Instances details
FromJSON ParquetCompressionType Source # 
Instance details

Defined in Amazonka.Glue.Types.ParquetCompressionType

FromJSONKey ParquetCompressionType Source # 
Instance details

Defined in Amazonka.Glue.Types.ParquetCompressionType

ToJSON ParquetCompressionType Source # 
Instance details

Defined in Amazonka.Glue.Types.ParquetCompressionType

ToJSONKey ParquetCompressionType Source # 
Instance details

Defined in Amazonka.Glue.Types.ParquetCompressionType

ToByteString ParquetCompressionType Source # 
Instance details

Defined in Amazonka.Glue.Types.ParquetCompressionType

ToHeader ParquetCompressionType Source # 
Instance details

Defined in Amazonka.Glue.Types.ParquetCompressionType

ToLog ParquetCompressionType Source # 
Instance details

Defined in Amazonka.Glue.Types.ParquetCompressionType

ToQuery ParquetCompressionType Source # 
Instance details

Defined in Amazonka.Glue.Types.ParquetCompressionType

FromText ParquetCompressionType Source # 
Instance details

Defined in Amazonka.Glue.Types.ParquetCompressionType

ToText ParquetCompressionType Source # 
Instance details

Defined in Amazonka.Glue.Types.ParquetCompressionType

FromXML ParquetCompressionType Source # 
Instance details

Defined in Amazonka.Glue.Types.ParquetCompressionType

ToXML ParquetCompressionType Source # 
Instance details

Defined in Amazonka.Glue.Types.ParquetCompressionType

Generic ParquetCompressionType Source # 
Instance details

Defined in Amazonka.Glue.Types.ParquetCompressionType

Associated Types

type Rep ParquetCompressionType :: Type -> Type #

Read ParquetCompressionType Source # 
Instance details

Defined in Amazonka.Glue.Types.ParquetCompressionType

Show ParquetCompressionType Source # 
Instance details

Defined in Amazonka.Glue.Types.ParquetCompressionType

NFData ParquetCompressionType Source # 
Instance details

Defined in Amazonka.Glue.Types.ParquetCompressionType

Methods

rnf :: ParquetCompressionType -> () #

Eq ParquetCompressionType Source # 
Instance details

Defined in Amazonka.Glue.Types.ParquetCompressionType

Ord ParquetCompressionType Source # 
Instance details

Defined in Amazonka.Glue.Types.ParquetCompressionType

Hashable ParquetCompressionType Source # 
Instance details

Defined in Amazonka.Glue.Types.ParquetCompressionType

type Rep ParquetCompressionType Source # 
Instance details

Defined in Amazonka.Glue.Types.ParquetCompressionType

type Rep ParquetCompressionType = D1 ('MetaData "ParquetCompressionType" "Amazonka.Glue.Types.ParquetCompressionType" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'True) (C1 ('MetaCons "ParquetCompressionType'" 'PrefixI 'True) (S1 ('MetaSel ('Just "fromParquetCompressionType") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedLazy) (Rec0 Text)))

PartitionIndexStatus

newtype PartitionIndexStatus Source #

Instances

Instances details
FromJSON PartitionIndexStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.PartitionIndexStatus

FromJSONKey PartitionIndexStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.PartitionIndexStatus

ToJSON PartitionIndexStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.PartitionIndexStatus

ToJSONKey PartitionIndexStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.PartitionIndexStatus

ToByteString PartitionIndexStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.PartitionIndexStatus

ToHeader PartitionIndexStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.PartitionIndexStatus

ToLog PartitionIndexStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.PartitionIndexStatus

ToQuery PartitionIndexStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.PartitionIndexStatus

FromText PartitionIndexStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.PartitionIndexStatus

ToText PartitionIndexStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.PartitionIndexStatus

FromXML PartitionIndexStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.PartitionIndexStatus

ToXML PartitionIndexStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.PartitionIndexStatus

Generic PartitionIndexStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.PartitionIndexStatus

Associated Types

type Rep PartitionIndexStatus :: Type -> Type #

Read PartitionIndexStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.PartitionIndexStatus

Show PartitionIndexStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.PartitionIndexStatus

NFData PartitionIndexStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.PartitionIndexStatus

Methods

rnf :: PartitionIndexStatus -> () #

Eq PartitionIndexStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.PartitionIndexStatus

Ord PartitionIndexStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.PartitionIndexStatus

Hashable PartitionIndexStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.PartitionIndexStatus

type Rep PartitionIndexStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.PartitionIndexStatus

type Rep PartitionIndexStatus = D1 ('MetaData "PartitionIndexStatus" "Amazonka.Glue.Types.PartitionIndexStatus" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'True) (C1 ('MetaCons "PartitionIndexStatus'" 'PrefixI 'True) (S1 ('MetaSel ('Just "fromPartitionIndexStatus") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedLazy) (Rec0 Text)))

Permission

newtype Permission Source #

Constructors

Permission' 

Fields

Instances

Instances details
FromJSON Permission Source # 
Instance details

Defined in Amazonka.Glue.Types.Permission

FromJSONKey Permission Source # 
Instance details

Defined in Amazonka.Glue.Types.Permission

ToJSON Permission Source # 
Instance details

Defined in Amazonka.Glue.Types.Permission

ToJSONKey Permission Source # 
Instance details

Defined in Amazonka.Glue.Types.Permission

ToByteString Permission Source # 
Instance details

Defined in Amazonka.Glue.Types.Permission

ToHeader Permission Source # 
Instance details

Defined in Amazonka.Glue.Types.Permission

ToLog Permission Source # 
Instance details

Defined in Amazonka.Glue.Types.Permission

ToQuery Permission Source # 
Instance details

Defined in Amazonka.Glue.Types.Permission

FromText Permission Source # 
Instance details

Defined in Amazonka.Glue.Types.Permission

ToText Permission Source # 
Instance details

Defined in Amazonka.Glue.Types.Permission

Methods

toText :: Permission -> Text #

FromXML Permission Source # 
Instance details

Defined in Amazonka.Glue.Types.Permission

ToXML Permission Source # 
Instance details

Defined in Amazonka.Glue.Types.Permission

Methods

toXML :: Permission -> XML #

Generic Permission Source # 
Instance details

Defined in Amazonka.Glue.Types.Permission

Associated Types

type Rep Permission :: Type -> Type #

Read Permission Source # 
Instance details

Defined in Amazonka.Glue.Types.Permission

Show Permission Source # 
Instance details

Defined in Amazonka.Glue.Types.Permission

NFData Permission Source # 
Instance details

Defined in Amazonka.Glue.Types.Permission

Methods

rnf :: Permission -> () #

Eq Permission Source # 
Instance details

Defined in Amazonka.Glue.Types.Permission

Ord Permission Source # 
Instance details

Defined in Amazonka.Glue.Types.Permission

Hashable Permission Source # 
Instance details

Defined in Amazonka.Glue.Types.Permission

type Rep Permission Source # 
Instance details

Defined in Amazonka.Glue.Types.Permission

type Rep Permission = D1 ('MetaData "Permission" "Amazonka.Glue.Types.Permission" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'True) (C1 ('MetaCons "Permission'" 'PrefixI 'True) (S1 ('MetaSel ('Just "fromPermission") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedLazy) (Rec0 Text)))

PermissionType

newtype PermissionType Source #

Constructors

PermissionType' 

Instances

Instances details
FromJSON PermissionType Source # 
Instance details

Defined in Amazonka.Glue.Types.PermissionType

FromJSONKey PermissionType Source # 
Instance details

Defined in Amazonka.Glue.Types.PermissionType

ToJSON PermissionType Source # 
Instance details

Defined in Amazonka.Glue.Types.PermissionType

ToJSONKey PermissionType Source # 
Instance details

Defined in Amazonka.Glue.Types.PermissionType

ToByteString PermissionType Source # 
Instance details

Defined in Amazonka.Glue.Types.PermissionType

ToHeader PermissionType Source # 
Instance details

Defined in Amazonka.Glue.Types.PermissionType

ToLog PermissionType Source # 
Instance details

Defined in Amazonka.Glue.Types.PermissionType

ToQuery PermissionType Source # 
Instance details

Defined in Amazonka.Glue.Types.PermissionType

FromText PermissionType Source # 
Instance details

Defined in Amazonka.Glue.Types.PermissionType

ToText PermissionType Source # 
Instance details

Defined in Amazonka.Glue.Types.PermissionType

FromXML PermissionType Source # 
Instance details

Defined in Amazonka.Glue.Types.PermissionType

ToXML PermissionType Source # 
Instance details

Defined in Amazonka.Glue.Types.PermissionType

Methods

toXML :: PermissionType -> XML #

Generic PermissionType Source # 
Instance details

Defined in Amazonka.Glue.Types.PermissionType

Associated Types

type Rep PermissionType :: Type -> Type #

Read PermissionType Source # 
Instance details

Defined in Amazonka.Glue.Types.PermissionType

Show PermissionType Source # 
Instance details

Defined in Amazonka.Glue.Types.PermissionType

NFData PermissionType Source # 
Instance details

Defined in Amazonka.Glue.Types.PermissionType

Methods

rnf :: PermissionType -> () #

Eq PermissionType Source # 
Instance details

Defined in Amazonka.Glue.Types.PermissionType

Ord PermissionType Source # 
Instance details

Defined in Amazonka.Glue.Types.PermissionType

Hashable PermissionType Source # 
Instance details

Defined in Amazonka.Glue.Types.PermissionType

type Rep PermissionType Source # 
Instance details

Defined in Amazonka.Glue.Types.PermissionType

type Rep PermissionType = D1 ('MetaData "PermissionType" "Amazonka.Glue.Types.PermissionType" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'True) (C1 ('MetaCons "PermissionType'" 'PrefixI 'True) (S1 ('MetaSel ('Just "fromPermissionType") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedLazy) (Rec0 Text)))

PiiType

newtype PiiType Source #

Constructors

PiiType' 

Fields

Bundled Patterns

pattern PiiType_ColumnAudit :: PiiType 
pattern PiiType_ColumnMasking :: PiiType 
pattern PiiType_RowAudit :: PiiType 
pattern PiiType_RowMasking :: PiiType 

Instances

Instances details
FromJSON PiiType Source # 
Instance details

Defined in Amazonka.Glue.Types.PiiType

FromJSONKey PiiType Source # 
Instance details

Defined in Amazonka.Glue.Types.PiiType

ToJSON PiiType Source # 
Instance details

Defined in Amazonka.Glue.Types.PiiType

ToJSONKey PiiType Source # 
Instance details

Defined in Amazonka.Glue.Types.PiiType

ToByteString PiiType Source # 
Instance details

Defined in Amazonka.Glue.Types.PiiType

Methods

toBS :: PiiType -> ByteString #

ToHeader PiiType Source # 
Instance details

Defined in Amazonka.Glue.Types.PiiType

Methods

toHeader :: HeaderName -> PiiType -> [Header] #

ToLog PiiType Source # 
Instance details

Defined in Amazonka.Glue.Types.PiiType

ToQuery PiiType Source # 
Instance details

Defined in Amazonka.Glue.Types.PiiType

FromText PiiType Source # 
Instance details

Defined in Amazonka.Glue.Types.PiiType

ToText PiiType Source # 
Instance details

Defined in Amazonka.Glue.Types.PiiType

Methods

toText :: PiiType -> Text #

FromXML PiiType Source # 
Instance details

Defined in Amazonka.Glue.Types.PiiType

ToXML PiiType Source # 
Instance details

Defined in Amazonka.Glue.Types.PiiType

Methods

toXML :: PiiType -> XML #

Generic PiiType Source # 
Instance details

Defined in Amazonka.Glue.Types.PiiType

Associated Types

type Rep PiiType :: Type -> Type #

Methods

from :: PiiType -> Rep PiiType x #

to :: Rep PiiType x -> PiiType #

Read PiiType Source # 
Instance details

Defined in Amazonka.Glue.Types.PiiType

Show PiiType Source # 
Instance details

Defined in Amazonka.Glue.Types.PiiType

NFData PiiType Source # 
Instance details

Defined in Amazonka.Glue.Types.PiiType

Methods

rnf :: PiiType -> () #

Eq PiiType Source # 
Instance details

Defined in Amazonka.Glue.Types.PiiType

Methods

(==) :: PiiType -> PiiType -> Bool #

(/=) :: PiiType -> PiiType -> Bool #

Ord PiiType Source # 
Instance details

Defined in Amazonka.Glue.Types.PiiType

Hashable PiiType Source # 
Instance details

Defined in Amazonka.Glue.Types.PiiType

Methods

hashWithSalt :: Int -> PiiType -> Int #

hash :: PiiType -> Int #

type Rep PiiType Source # 
Instance details

Defined in Amazonka.Glue.Types.PiiType

type Rep PiiType = D1 ('MetaData "PiiType" "Amazonka.Glue.Types.PiiType" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'True) (C1 ('MetaCons "PiiType'" 'PrefixI 'True) (S1 ('MetaSel ('Just "fromPiiType") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedLazy) (Rec0 Text)))

PrincipalType

newtype PrincipalType Source #

Constructors

PrincipalType' 

Instances

Instances details
FromJSON PrincipalType Source # 
Instance details

Defined in Amazonka.Glue.Types.PrincipalType

FromJSONKey PrincipalType Source # 
Instance details

Defined in Amazonka.Glue.Types.PrincipalType

ToJSON PrincipalType Source # 
Instance details

Defined in Amazonka.Glue.Types.PrincipalType

ToJSONKey PrincipalType Source # 
Instance details

Defined in Amazonka.Glue.Types.PrincipalType

ToByteString PrincipalType Source # 
Instance details

Defined in Amazonka.Glue.Types.PrincipalType

ToHeader PrincipalType Source # 
Instance details

Defined in Amazonka.Glue.Types.PrincipalType

ToLog PrincipalType Source # 
Instance details

Defined in Amazonka.Glue.Types.PrincipalType

ToQuery PrincipalType Source # 
Instance details

Defined in Amazonka.Glue.Types.PrincipalType

FromText PrincipalType Source # 
Instance details

Defined in Amazonka.Glue.Types.PrincipalType

ToText PrincipalType Source # 
Instance details

Defined in Amazonka.Glue.Types.PrincipalType

Methods

toText :: PrincipalType -> Text #

FromXML PrincipalType Source # 
Instance details

Defined in Amazonka.Glue.Types.PrincipalType

ToXML PrincipalType Source # 
Instance details

Defined in Amazonka.Glue.Types.PrincipalType

Methods

toXML :: PrincipalType -> XML #

Generic PrincipalType Source # 
Instance details

Defined in Amazonka.Glue.Types.PrincipalType

Associated Types

type Rep PrincipalType :: Type -> Type #

Read PrincipalType Source # 
Instance details

Defined in Amazonka.Glue.Types.PrincipalType

Show PrincipalType Source # 
Instance details

Defined in Amazonka.Glue.Types.PrincipalType

NFData PrincipalType Source # 
Instance details

Defined in Amazonka.Glue.Types.PrincipalType

Methods

rnf :: PrincipalType -> () #

Eq PrincipalType Source # 
Instance details

Defined in Amazonka.Glue.Types.PrincipalType

Ord PrincipalType Source # 
Instance details

Defined in Amazonka.Glue.Types.PrincipalType

Hashable PrincipalType Source # 
Instance details

Defined in Amazonka.Glue.Types.PrincipalType

type Rep PrincipalType Source # 
Instance details

Defined in Amazonka.Glue.Types.PrincipalType

type Rep PrincipalType = D1 ('MetaData "PrincipalType" "Amazonka.Glue.Types.PrincipalType" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'True) (C1 ('MetaCons "PrincipalType'" 'PrefixI 'True) (S1 ('MetaSel ('Just "fromPrincipalType") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedLazy) (Rec0 Text)))

QuoteChar

newtype QuoteChar Source #

Constructors

QuoteChar' 

Fields

Instances

Instances details
FromJSON QuoteChar Source # 
Instance details

Defined in Amazonka.Glue.Types.QuoteChar

FromJSONKey QuoteChar Source # 
Instance details

Defined in Amazonka.Glue.Types.QuoteChar

ToJSON QuoteChar Source # 
Instance details

Defined in Amazonka.Glue.Types.QuoteChar

ToJSONKey QuoteChar Source # 
Instance details

Defined in Amazonka.Glue.Types.QuoteChar

ToByteString QuoteChar Source # 
Instance details

Defined in Amazonka.Glue.Types.QuoteChar

Methods

toBS :: QuoteChar -> ByteString #

ToHeader QuoteChar Source # 
Instance details

Defined in Amazonka.Glue.Types.QuoteChar

ToLog QuoteChar Source # 
Instance details

Defined in Amazonka.Glue.Types.QuoteChar

ToQuery QuoteChar Source # 
Instance details

Defined in Amazonka.Glue.Types.QuoteChar

FromText QuoteChar Source # 
Instance details

Defined in Amazonka.Glue.Types.QuoteChar

ToText QuoteChar Source # 
Instance details

Defined in Amazonka.Glue.Types.QuoteChar

Methods

toText :: QuoteChar -> Text #

FromXML QuoteChar Source # 
Instance details

Defined in Amazonka.Glue.Types.QuoteChar

ToXML QuoteChar Source # 
Instance details

Defined in Amazonka.Glue.Types.QuoteChar

Methods

toXML :: QuoteChar -> XML #

Generic QuoteChar Source # 
Instance details

Defined in Amazonka.Glue.Types.QuoteChar

Associated Types

type Rep QuoteChar :: Type -> Type #

Read QuoteChar Source # 
Instance details

Defined in Amazonka.Glue.Types.QuoteChar

Show QuoteChar Source # 
Instance details

Defined in Amazonka.Glue.Types.QuoteChar

NFData QuoteChar Source # 
Instance details

Defined in Amazonka.Glue.Types.QuoteChar

Methods

rnf :: QuoteChar -> () #

Eq QuoteChar Source # 
Instance details

Defined in Amazonka.Glue.Types.QuoteChar

Ord QuoteChar Source # 
Instance details

Defined in Amazonka.Glue.Types.QuoteChar

Hashable QuoteChar Source # 
Instance details

Defined in Amazonka.Glue.Types.QuoteChar

type Rep QuoteChar Source # 
Instance details

Defined in Amazonka.Glue.Types.QuoteChar

type Rep QuoteChar = D1 ('MetaData "QuoteChar" "Amazonka.Glue.Types.QuoteChar" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'True) (C1 ('MetaCons "QuoteChar'" 'PrefixI 'True) (S1 ('MetaSel ('Just "fromQuoteChar") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedLazy) (Rec0 Text)))

RecrawlBehavior

newtype RecrawlBehavior Source #

Constructors

RecrawlBehavior' 

Instances

Instances details
FromJSON RecrawlBehavior Source # 
Instance details

Defined in Amazonka.Glue.Types.RecrawlBehavior

FromJSONKey RecrawlBehavior Source # 
Instance details

Defined in Amazonka.Glue.Types.RecrawlBehavior

ToJSON RecrawlBehavior Source # 
Instance details

Defined in Amazonka.Glue.Types.RecrawlBehavior

ToJSONKey RecrawlBehavior Source # 
Instance details

Defined in Amazonka.Glue.Types.RecrawlBehavior

ToByteString RecrawlBehavior Source # 
Instance details

Defined in Amazonka.Glue.Types.RecrawlBehavior

ToHeader RecrawlBehavior Source # 
Instance details

Defined in Amazonka.Glue.Types.RecrawlBehavior

ToLog RecrawlBehavior Source # 
Instance details

Defined in Amazonka.Glue.Types.RecrawlBehavior

ToQuery RecrawlBehavior Source # 
Instance details

Defined in Amazonka.Glue.Types.RecrawlBehavior

FromText RecrawlBehavior Source # 
Instance details

Defined in Amazonka.Glue.Types.RecrawlBehavior

ToText RecrawlBehavior Source # 
Instance details

Defined in Amazonka.Glue.Types.RecrawlBehavior

FromXML RecrawlBehavior Source # 
Instance details

Defined in Amazonka.Glue.Types.RecrawlBehavior

ToXML RecrawlBehavior Source # 
Instance details

Defined in Amazonka.Glue.Types.RecrawlBehavior

Methods

toXML :: RecrawlBehavior -> XML #

Generic RecrawlBehavior Source # 
Instance details

Defined in Amazonka.Glue.Types.RecrawlBehavior

Associated Types

type Rep RecrawlBehavior :: Type -> Type #

Read RecrawlBehavior Source # 
Instance details

Defined in Amazonka.Glue.Types.RecrawlBehavior

Show RecrawlBehavior Source # 
Instance details

Defined in Amazonka.Glue.Types.RecrawlBehavior

NFData RecrawlBehavior Source # 
Instance details

Defined in Amazonka.Glue.Types.RecrawlBehavior

Methods

rnf :: RecrawlBehavior -> () #

Eq RecrawlBehavior Source # 
Instance details

Defined in Amazonka.Glue.Types.RecrawlBehavior

Ord RecrawlBehavior Source # 
Instance details

Defined in Amazonka.Glue.Types.RecrawlBehavior

Hashable RecrawlBehavior Source # 
Instance details

Defined in Amazonka.Glue.Types.RecrawlBehavior

type Rep RecrawlBehavior Source # 
Instance details

Defined in Amazonka.Glue.Types.RecrawlBehavior

type Rep RecrawlBehavior = D1 ('MetaData "RecrawlBehavior" "Amazonka.Glue.Types.RecrawlBehavior" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'True) (C1 ('MetaCons "RecrawlBehavior'" 'PrefixI 'True) (S1 ('MetaSel ('Just "fromRecrawlBehavior") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedLazy) (Rec0 Text)))

RegistryStatus

newtype RegistryStatus Source #

Constructors

RegistryStatus' 

Instances

Instances details
FromJSON RegistryStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.RegistryStatus

FromJSONKey RegistryStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.RegistryStatus

ToJSON RegistryStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.RegistryStatus

ToJSONKey RegistryStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.RegistryStatus

ToByteString RegistryStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.RegistryStatus

ToHeader RegistryStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.RegistryStatus

ToLog RegistryStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.RegistryStatus

ToQuery RegistryStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.RegistryStatus

FromText RegistryStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.RegistryStatus

ToText RegistryStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.RegistryStatus

FromXML RegistryStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.RegistryStatus

ToXML RegistryStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.RegistryStatus

Methods

toXML :: RegistryStatus -> XML #

Generic RegistryStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.RegistryStatus

Associated Types

type Rep RegistryStatus :: Type -> Type #

Read RegistryStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.RegistryStatus

Show RegistryStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.RegistryStatus

NFData RegistryStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.RegistryStatus

Methods

rnf :: RegistryStatus -> () #

Eq RegistryStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.RegistryStatus

Ord RegistryStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.RegistryStatus

Hashable RegistryStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.RegistryStatus

type Rep RegistryStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.RegistryStatus

type Rep RegistryStatus = D1 ('MetaData "RegistryStatus" "Amazonka.Glue.Types.RegistryStatus" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'True) (C1 ('MetaCons "RegistryStatus'" 'PrefixI 'True) (S1 ('MetaSel ('Just "fromRegistryStatus") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedLazy) (Rec0 Text)))

ResourceShareType

newtype ResourceShareType Source #

Instances

Instances details
FromJSON ResourceShareType Source # 
Instance details

Defined in Amazonka.Glue.Types.ResourceShareType

FromJSONKey ResourceShareType Source # 
Instance details

Defined in Amazonka.Glue.Types.ResourceShareType

ToJSON ResourceShareType Source # 
Instance details

Defined in Amazonka.Glue.Types.ResourceShareType

ToJSONKey ResourceShareType Source # 
Instance details

Defined in Amazonka.Glue.Types.ResourceShareType

ToByteString ResourceShareType Source # 
Instance details

Defined in Amazonka.Glue.Types.ResourceShareType

ToHeader ResourceShareType Source # 
Instance details

Defined in Amazonka.Glue.Types.ResourceShareType

ToLog ResourceShareType Source # 
Instance details

Defined in Amazonka.Glue.Types.ResourceShareType

ToQuery ResourceShareType Source # 
Instance details

Defined in Amazonka.Glue.Types.ResourceShareType

FromText ResourceShareType Source # 
Instance details

Defined in Amazonka.Glue.Types.ResourceShareType

ToText ResourceShareType Source # 
Instance details

Defined in Amazonka.Glue.Types.ResourceShareType

FromXML ResourceShareType Source # 
Instance details

Defined in Amazonka.Glue.Types.ResourceShareType

ToXML ResourceShareType Source # 
Instance details

Defined in Amazonka.Glue.Types.ResourceShareType

Generic ResourceShareType Source # 
Instance details

Defined in Amazonka.Glue.Types.ResourceShareType

Associated Types

type Rep ResourceShareType :: Type -> Type #

Read ResourceShareType Source # 
Instance details

Defined in Amazonka.Glue.Types.ResourceShareType

Show ResourceShareType Source # 
Instance details

Defined in Amazonka.Glue.Types.ResourceShareType

NFData ResourceShareType Source # 
Instance details

Defined in Amazonka.Glue.Types.ResourceShareType

Methods

rnf :: ResourceShareType -> () #

Eq ResourceShareType Source # 
Instance details

Defined in Amazonka.Glue.Types.ResourceShareType

Ord ResourceShareType Source # 
Instance details

Defined in Amazonka.Glue.Types.ResourceShareType

Hashable ResourceShareType Source # 
Instance details

Defined in Amazonka.Glue.Types.ResourceShareType

type Rep ResourceShareType Source # 
Instance details

Defined in Amazonka.Glue.Types.ResourceShareType

type Rep ResourceShareType = D1 ('MetaData "ResourceShareType" "Amazonka.Glue.Types.ResourceShareType" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'True) (C1 ('MetaCons "ResourceShareType'" 'PrefixI 'True) (S1 ('MetaSel ('Just "fromResourceShareType") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedLazy) (Rec0 Text)))

ResourceType

newtype ResourceType Source #

Constructors

ResourceType' 

Instances

Instances details
FromJSON ResourceType Source # 
Instance details

Defined in Amazonka.Glue.Types.ResourceType

FromJSONKey ResourceType Source # 
Instance details

Defined in Amazonka.Glue.Types.ResourceType

ToJSON ResourceType Source # 
Instance details

Defined in Amazonka.Glue.Types.ResourceType

ToJSONKey ResourceType Source # 
Instance details

Defined in Amazonka.Glue.Types.ResourceType

ToByteString ResourceType Source # 
Instance details

Defined in Amazonka.Glue.Types.ResourceType

ToHeader ResourceType Source # 
Instance details

Defined in Amazonka.Glue.Types.ResourceType

ToLog ResourceType Source # 
Instance details

Defined in Amazonka.Glue.Types.ResourceType

ToQuery ResourceType Source # 
Instance details

Defined in Amazonka.Glue.Types.ResourceType

FromText ResourceType Source # 
Instance details

Defined in Amazonka.Glue.Types.ResourceType

ToText ResourceType Source # 
Instance details

Defined in Amazonka.Glue.Types.ResourceType

Methods

toText :: ResourceType -> Text #

FromXML ResourceType Source # 
Instance details

Defined in Amazonka.Glue.Types.ResourceType

ToXML ResourceType Source # 
Instance details

Defined in Amazonka.Glue.Types.ResourceType

Methods

toXML :: ResourceType -> XML #

Generic ResourceType Source # 
Instance details

Defined in Amazonka.Glue.Types.ResourceType

Associated Types

type Rep ResourceType :: Type -> Type #

Read ResourceType Source # 
Instance details

Defined in Amazonka.Glue.Types.ResourceType

Show ResourceType Source # 
Instance details

Defined in Amazonka.Glue.Types.ResourceType

NFData ResourceType Source # 
Instance details

Defined in Amazonka.Glue.Types.ResourceType

Methods

rnf :: ResourceType -> () #

Eq ResourceType Source # 
Instance details

Defined in Amazonka.Glue.Types.ResourceType

Ord ResourceType Source # 
Instance details

Defined in Amazonka.Glue.Types.ResourceType

Hashable ResourceType Source # 
Instance details

Defined in Amazonka.Glue.Types.ResourceType

type Rep ResourceType Source # 
Instance details

Defined in Amazonka.Glue.Types.ResourceType

type Rep ResourceType = D1 ('MetaData "ResourceType" "Amazonka.Glue.Types.ResourceType" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'True) (C1 ('MetaCons "ResourceType'" 'PrefixI 'True) (S1 ('MetaSel ('Just "fromResourceType") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedLazy) (Rec0 Text)))

S3EncryptionMode

newtype S3EncryptionMode Source #

Instances

Instances details
FromJSON S3EncryptionMode Source # 
Instance details

Defined in Amazonka.Glue.Types.S3EncryptionMode

FromJSONKey S3EncryptionMode Source # 
Instance details

Defined in Amazonka.Glue.Types.S3EncryptionMode

ToJSON S3EncryptionMode Source # 
Instance details

Defined in Amazonka.Glue.Types.S3EncryptionMode

ToJSONKey S3EncryptionMode Source # 
Instance details

Defined in Amazonka.Glue.Types.S3EncryptionMode

ToByteString S3EncryptionMode Source # 
Instance details

Defined in Amazonka.Glue.Types.S3EncryptionMode

ToHeader S3EncryptionMode Source # 
Instance details

Defined in Amazonka.Glue.Types.S3EncryptionMode

ToLog S3EncryptionMode Source # 
Instance details

Defined in Amazonka.Glue.Types.S3EncryptionMode

ToQuery S3EncryptionMode Source # 
Instance details

Defined in Amazonka.Glue.Types.S3EncryptionMode

FromText S3EncryptionMode Source # 
Instance details

Defined in Amazonka.Glue.Types.S3EncryptionMode

ToText S3EncryptionMode Source # 
Instance details

Defined in Amazonka.Glue.Types.S3EncryptionMode

FromXML S3EncryptionMode Source # 
Instance details

Defined in Amazonka.Glue.Types.S3EncryptionMode

ToXML S3EncryptionMode Source # 
Instance details

Defined in Amazonka.Glue.Types.S3EncryptionMode

Generic S3EncryptionMode Source # 
Instance details

Defined in Amazonka.Glue.Types.S3EncryptionMode

Associated Types

type Rep S3EncryptionMode :: Type -> Type #

Read S3EncryptionMode Source # 
Instance details

Defined in Amazonka.Glue.Types.S3EncryptionMode

Show S3EncryptionMode Source # 
Instance details

Defined in Amazonka.Glue.Types.S3EncryptionMode

NFData S3EncryptionMode Source # 
Instance details

Defined in Amazonka.Glue.Types.S3EncryptionMode

Methods

rnf :: S3EncryptionMode -> () #

Eq S3EncryptionMode Source # 
Instance details

Defined in Amazonka.Glue.Types.S3EncryptionMode

Ord S3EncryptionMode Source # 
Instance details

Defined in Amazonka.Glue.Types.S3EncryptionMode

Hashable S3EncryptionMode Source # 
Instance details

Defined in Amazonka.Glue.Types.S3EncryptionMode

type Rep S3EncryptionMode Source # 
Instance details

Defined in Amazonka.Glue.Types.S3EncryptionMode

type Rep S3EncryptionMode = D1 ('MetaData "S3EncryptionMode" "Amazonka.Glue.Types.S3EncryptionMode" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'True) (C1 ('MetaCons "S3EncryptionMode'" 'PrefixI 'True) (S1 ('MetaSel ('Just "fromS3EncryptionMode") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedLazy) (Rec0 Text)))

ScheduleState

newtype ScheduleState Source #

Constructors

ScheduleState' 

Instances

Instances details
FromJSON ScheduleState Source # 
Instance details

Defined in Amazonka.Glue.Types.ScheduleState

FromJSONKey ScheduleState Source # 
Instance details

Defined in Amazonka.Glue.Types.ScheduleState

ToJSON ScheduleState Source # 
Instance details

Defined in Amazonka.Glue.Types.ScheduleState

ToJSONKey ScheduleState Source # 
Instance details

Defined in Amazonka.Glue.Types.ScheduleState

ToByteString ScheduleState Source # 
Instance details

Defined in Amazonka.Glue.Types.ScheduleState

ToHeader ScheduleState Source # 
Instance details

Defined in Amazonka.Glue.Types.ScheduleState

ToLog ScheduleState Source # 
Instance details

Defined in Amazonka.Glue.Types.ScheduleState

ToQuery ScheduleState Source # 
Instance details

Defined in Amazonka.Glue.Types.ScheduleState

FromText ScheduleState Source # 
Instance details

Defined in Amazonka.Glue.Types.ScheduleState

ToText ScheduleState Source # 
Instance details

Defined in Amazonka.Glue.Types.ScheduleState

Methods

toText :: ScheduleState -> Text #

FromXML ScheduleState Source # 
Instance details

Defined in Amazonka.Glue.Types.ScheduleState

ToXML ScheduleState Source # 
Instance details

Defined in Amazonka.Glue.Types.ScheduleState

Methods

toXML :: ScheduleState -> XML #

Generic ScheduleState Source # 
Instance details

Defined in Amazonka.Glue.Types.ScheduleState

Associated Types

type Rep ScheduleState :: Type -> Type #

Read ScheduleState Source # 
Instance details

Defined in Amazonka.Glue.Types.ScheduleState

Show ScheduleState Source # 
Instance details

Defined in Amazonka.Glue.Types.ScheduleState

NFData ScheduleState Source # 
Instance details

Defined in Amazonka.Glue.Types.ScheduleState

Methods

rnf :: ScheduleState -> () #

Eq ScheduleState Source # 
Instance details

Defined in Amazonka.Glue.Types.ScheduleState

Ord ScheduleState Source # 
Instance details

Defined in Amazonka.Glue.Types.ScheduleState

Hashable ScheduleState Source # 
Instance details

Defined in Amazonka.Glue.Types.ScheduleState

type Rep ScheduleState Source # 
Instance details

Defined in Amazonka.Glue.Types.ScheduleState

type Rep ScheduleState = D1 ('MetaData "ScheduleState" "Amazonka.Glue.Types.ScheduleState" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'True) (C1 ('MetaCons "ScheduleState'" 'PrefixI 'True) (S1 ('MetaSel ('Just "fromScheduleState") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedLazy) (Rec0 Text)))

SchemaDiffType

newtype SchemaDiffType Source #

Constructors

SchemaDiffType' 

Bundled Patterns

pattern SchemaDiffType_SYNTAX_DIFF :: SchemaDiffType 

Instances

Instances details
FromJSON SchemaDiffType Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaDiffType

FromJSONKey SchemaDiffType Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaDiffType

ToJSON SchemaDiffType Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaDiffType

ToJSONKey SchemaDiffType Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaDiffType

ToByteString SchemaDiffType Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaDiffType

ToHeader SchemaDiffType Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaDiffType

ToLog SchemaDiffType Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaDiffType

ToQuery SchemaDiffType Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaDiffType

FromText SchemaDiffType Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaDiffType

ToText SchemaDiffType Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaDiffType

FromXML SchemaDiffType Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaDiffType

ToXML SchemaDiffType Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaDiffType

Methods

toXML :: SchemaDiffType -> XML #

Generic SchemaDiffType Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaDiffType

Associated Types

type Rep SchemaDiffType :: Type -> Type #

Read SchemaDiffType Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaDiffType

Show SchemaDiffType Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaDiffType

NFData SchemaDiffType Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaDiffType

Methods

rnf :: SchemaDiffType -> () #

Eq SchemaDiffType Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaDiffType

Ord SchemaDiffType Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaDiffType

Hashable SchemaDiffType Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaDiffType

type Rep SchemaDiffType Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaDiffType

type Rep SchemaDiffType = D1 ('MetaData "SchemaDiffType" "Amazonka.Glue.Types.SchemaDiffType" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'True) (C1 ('MetaCons "SchemaDiffType'" 'PrefixI 'True) (S1 ('MetaSel ('Just "fromSchemaDiffType") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedLazy) (Rec0 Text)))

SchemaStatus

newtype SchemaStatus Source #

Constructors

SchemaStatus' 

Instances

Instances details
FromJSON SchemaStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaStatus

FromJSONKey SchemaStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaStatus

ToJSON SchemaStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaStatus

ToJSONKey SchemaStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaStatus

ToByteString SchemaStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaStatus

ToHeader SchemaStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaStatus

ToLog SchemaStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaStatus

ToQuery SchemaStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaStatus

FromText SchemaStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaStatus

ToText SchemaStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaStatus

Methods

toText :: SchemaStatus -> Text #

FromXML SchemaStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaStatus

ToXML SchemaStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaStatus

Methods

toXML :: SchemaStatus -> XML #

Generic SchemaStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaStatus

Associated Types

type Rep SchemaStatus :: Type -> Type #

Read SchemaStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaStatus

Show SchemaStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaStatus

NFData SchemaStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaStatus

Methods

rnf :: SchemaStatus -> () #

Eq SchemaStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaStatus

Ord SchemaStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaStatus

Hashable SchemaStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaStatus

type Rep SchemaStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaStatus

type Rep SchemaStatus = D1 ('MetaData "SchemaStatus" "Amazonka.Glue.Types.SchemaStatus" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'True) (C1 ('MetaCons "SchemaStatus'" 'PrefixI 'True) (S1 ('MetaSel ('Just "fromSchemaStatus") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedLazy) (Rec0 Text)))

SchemaVersionStatus

newtype SchemaVersionStatus Source #

Instances

Instances details
FromJSON SchemaVersionStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaVersionStatus

FromJSONKey SchemaVersionStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaVersionStatus

ToJSON SchemaVersionStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaVersionStatus

ToJSONKey SchemaVersionStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaVersionStatus

ToByteString SchemaVersionStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaVersionStatus

ToHeader SchemaVersionStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaVersionStatus

ToLog SchemaVersionStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaVersionStatus

ToQuery SchemaVersionStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaVersionStatus

FromText SchemaVersionStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaVersionStatus

ToText SchemaVersionStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaVersionStatus

FromXML SchemaVersionStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaVersionStatus

ToXML SchemaVersionStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaVersionStatus

Generic SchemaVersionStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaVersionStatus

Associated Types

type Rep SchemaVersionStatus :: Type -> Type #

Read SchemaVersionStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaVersionStatus

Show SchemaVersionStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaVersionStatus

NFData SchemaVersionStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaVersionStatus

Methods

rnf :: SchemaVersionStatus -> () #

Eq SchemaVersionStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaVersionStatus

Ord SchemaVersionStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaVersionStatus

Hashable SchemaVersionStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaVersionStatus

type Rep SchemaVersionStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaVersionStatus

type Rep SchemaVersionStatus = D1 ('MetaData "SchemaVersionStatus" "Amazonka.Glue.Types.SchemaVersionStatus" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'True) (C1 ('MetaCons "SchemaVersionStatus'" 'PrefixI 'True) (S1 ('MetaSel ('Just "fromSchemaVersionStatus") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedLazy) (Rec0 Text)))

Separator

newtype Separator Source #

Constructors

Separator' 

Fields

Bundled Patterns

pattern Separator_Comma :: Separator 
pattern Separator_Ctrla :: Separator 
pattern Separator_Pipe :: Separator 
pattern Separator_Semicolon :: Separator 
pattern Separator_Tab :: Separator 

Instances

Instances details
FromJSON Separator Source # 
Instance details

Defined in Amazonka.Glue.Types.Separator

FromJSONKey Separator Source # 
Instance details

Defined in Amazonka.Glue.Types.Separator

ToJSON Separator Source # 
Instance details

Defined in Amazonka.Glue.Types.Separator

ToJSONKey Separator Source # 
Instance details

Defined in Amazonka.Glue.Types.Separator

ToByteString Separator Source # 
Instance details

Defined in Amazonka.Glue.Types.Separator

Methods

toBS :: Separator -> ByteString #

ToHeader Separator Source # 
Instance details

Defined in Amazonka.Glue.Types.Separator

ToLog Separator Source # 
Instance details

Defined in Amazonka.Glue.Types.Separator

ToQuery Separator Source # 
Instance details

Defined in Amazonka.Glue.Types.Separator

FromText Separator Source # 
Instance details

Defined in Amazonka.Glue.Types.Separator

ToText Separator Source # 
Instance details

Defined in Amazonka.Glue.Types.Separator

Methods

toText :: Separator -> Text #

FromXML Separator Source # 
Instance details

Defined in Amazonka.Glue.Types.Separator

ToXML Separator Source # 
Instance details

Defined in Amazonka.Glue.Types.Separator

Methods

toXML :: Separator -> XML #

Generic Separator Source # 
Instance details

Defined in Amazonka.Glue.Types.Separator

Associated Types

type Rep Separator :: Type -> Type #

Read Separator Source # 
Instance details

Defined in Amazonka.Glue.Types.Separator

Show Separator Source # 
Instance details

Defined in Amazonka.Glue.Types.Separator

NFData Separator Source # 
Instance details

Defined in Amazonka.Glue.Types.Separator

Methods

rnf :: Separator -> () #

Eq Separator Source # 
Instance details

Defined in Amazonka.Glue.Types.Separator

Ord Separator Source # 
Instance details

Defined in Amazonka.Glue.Types.Separator

Hashable Separator Source # 
Instance details

Defined in Amazonka.Glue.Types.Separator

type Rep Separator Source # 
Instance details

Defined in Amazonka.Glue.Types.Separator

type Rep Separator = D1 ('MetaData "Separator" "Amazonka.Glue.Types.Separator" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'True) (C1 ('MetaCons "Separator'" 'PrefixI 'True) (S1 ('MetaSel ('Just "fromSeparator") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedLazy) (Rec0 Text)))

SessionStatus

newtype SessionStatus Source #

Constructors

SessionStatus' 

Instances

Instances details
FromJSON SessionStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.SessionStatus

FromJSONKey SessionStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.SessionStatus

ToJSON SessionStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.SessionStatus

ToJSONKey SessionStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.SessionStatus

ToByteString SessionStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.SessionStatus

ToHeader SessionStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.SessionStatus

ToLog SessionStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.SessionStatus

ToQuery SessionStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.SessionStatus

FromText SessionStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.SessionStatus

ToText SessionStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.SessionStatus

Methods

toText :: SessionStatus -> Text #

FromXML SessionStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.SessionStatus

ToXML SessionStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.SessionStatus

Methods

toXML :: SessionStatus -> XML #

Generic SessionStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.SessionStatus

Associated Types

type Rep SessionStatus :: Type -> Type #

Read SessionStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.SessionStatus

Show SessionStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.SessionStatus

NFData SessionStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.SessionStatus

Methods

rnf :: SessionStatus -> () #

Eq SessionStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.SessionStatus

Ord SessionStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.SessionStatus

Hashable SessionStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.SessionStatus

type Rep SessionStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.SessionStatus

type Rep SessionStatus = D1 ('MetaData "SessionStatus" "Amazonka.Glue.Types.SessionStatus" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'True) (C1 ('MetaCons "SessionStatus'" 'PrefixI 'True) (S1 ('MetaSel ('Just "fromSessionStatus") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedLazy) (Rec0 Text)))

Sort

newtype Sort Source #

Constructors

Sort' 

Fields

Bundled Patterns

pattern Sort_ASC :: Sort 
pattern Sort_DESC :: Sort 

Instances

Instances details
FromJSON Sort Source # 
Instance details

Defined in Amazonka.Glue.Types.Sort

FromJSONKey Sort Source # 
Instance details

Defined in Amazonka.Glue.Types.Sort

ToJSON Sort Source # 
Instance details

Defined in Amazonka.Glue.Types.Sort

ToJSONKey Sort Source # 
Instance details

Defined in Amazonka.Glue.Types.Sort

ToByteString Sort Source # 
Instance details

Defined in Amazonka.Glue.Types.Sort

Methods

toBS :: Sort -> ByteString #

ToHeader Sort Source # 
Instance details

Defined in Amazonka.Glue.Types.Sort

Methods

toHeader :: HeaderName -> Sort -> [Header] #

ToLog Sort Source # 
Instance details

Defined in Amazonka.Glue.Types.Sort

ToQuery Sort Source # 
Instance details

Defined in Amazonka.Glue.Types.Sort

Methods

toQuery :: Sort -> QueryString #

FromText Sort Source # 
Instance details

Defined in Amazonka.Glue.Types.Sort

ToText Sort Source # 
Instance details

Defined in Amazonka.Glue.Types.Sort

Methods

toText :: Sort -> Text #

FromXML Sort Source # 
Instance details

Defined in Amazonka.Glue.Types.Sort

Methods

parseXML :: [Node] -> Either String Sort #

ToXML Sort Source # 
Instance details

Defined in Amazonka.Glue.Types.Sort

Methods

toXML :: Sort -> XML #

Generic Sort Source # 
Instance details

Defined in Amazonka.Glue.Types.Sort

Associated Types

type Rep Sort :: Type -> Type #

Methods

from :: Sort -> Rep Sort x #

to :: Rep Sort x -> Sort #

Read Sort Source # 
Instance details

Defined in Amazonka.Glue.Types.Sort

Show Sort Source # 
Instance details

Defined in Amazonka.Glue.Types.Sort

Methods

showsPrec :: Int -> Sort -> ShowS #

show :: Sort -> String #

showList :: [Sort] -> ShowS #

NFData Sort Source # 
Instance details

Defined in Amazonka.Glue.Types.Sort

Methods

rnf :: Sort -> () #

Eq Sort Source # 
Instance details

Defined in Amazonka.Glue.Types.Sort

Methods

(==) :: Sort -> Sort -> Bool #

(/=) :: Sort -> Sort -> Bool #

Ord Sort Source # 
Instance details

Defined in Amazonka.Glue.Types.Sort

Methods

compare :: Sort -> Sort -> Ordering #

(<) :: Sort -> Sort -> Bool #

(<=) :: Sort -> Sort -> Bool #

(>) :: Sort -> Sort -> Bool #

(>=) :: Sort -> Sort -> Bool #

max :: Sort -> Sort -> Sort #

min :: Sort -> Sort -> Sort #

Hashable Sort Source # 
Instance details

Defined in Amazonka.Glue.Types.Sort

Methods

hashWithSalt :: Int -> Sort -> Int #

hash :: Sort -> Int #

type Rep Sort Source # 
Instance details

Defined in Amazonka.Glue.Types.Sort

type Rep Sort = D1 ('MetaData "Sort" "Amazonka.Glue.Types.Sort" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'True) (C1 ('MetaCons "Sort'" 'PrefixI 'True) (S1 ('MetaSel ('Just "fromSort") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedLazy) (Rec0 Text)))

SortDirectionType

newtype SortDirectionType Source #

Instances

Instances details
FromJSON SortDirectionType Source # 
Instance details

Defined in Amazonka.Glue.Types.SortDirectionType

FromJSONKey SortDirectionType Source # 
Instance details

Defined in Amazonka.Glue.Types.SortDirectionType

ToJSON SortDirectionType Source # 
Instance details

Defined in Amazonka.Glue.Types.SortDirectionType

ToJSONKey SortDirectionType Source # 
Instance details

Defined in Amazonka.Glue.Types.SortDirectionType

ToByteString SortDirectionType Source # 
Instance details

Defined in Amazonka.Glue.Types.SortDirectionType

ToHeader SortDirectionType Source # 
Instance details

Defined in Amazonka.Glue.Types.SortDirectionType

ToLog SortDirectionType Source # 
Instance details

Defined in Amazonka.Glue.Types.SortDirectionType

ToQuery SortDirectionType Source # 
Instance details

Defined in Amazonka.Glue.Types.SortDirectionType

FromText SortDirectionType Source # 
Instance details

Defined in Amazonka.Glue.Types.SortDirectionType

ToText SortDirectionType Source # 
Instance details

Defined in Amazonka.Glue.Types.SortDirectionType

FromXML SortDirectionType Source # 
Instance details

Defined in Amazonka.Glue.Types.SortDirectionType

ToXML SortDirectionType Source # 
Instance details

Defined in Amazonka.Glue.Types.SortDirectionType

Generic SortDirectionType Source # 
Instance details

Defined in Amazonka.Glue.Types.SortDirectionType

Associated Types

type Rep SortDirectionType :: Type -> Type #

Read SortDirectionType Source # 
Instance details

Defined in Amazonka.Glue.Types.SortDirectionType

Show SortDirectionType Source # 
Instance details

Defined in Amazonka.Glue.Types.SortDirectionType

NFData SortDirectionType Source # 
Instance details

Defined in Amazonka.Glue.Types.SortDirectionType

Methods

rnf :: SortDirectionType -> () #

Eq SortDirectionType Source # 
Instance details

Defined in Amazonka.Glue.Types.SortDirectionType

Ord SortDirectionType Source # 
Instance details

Defined in Amazonka.Glue.Types.SortDirectionType

Hashable SortDirectionType Source # 
Instance details

Defined in Amazonka.Glue.Types.SortDirectionType

type Rep SortDirectionType Source # 
Instance details

Defined in Amazonka.Glue.Types.SortDirectionType

type Rep SortDirectionType = D1 ('MetaData "SortDirectionType" "Amazonka.Glue.Types.SortDirectionType" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'True) (C1 ('MetaCons "SortDirectionType'" 'PrefixI 'True) (S1 ('MetaSel ('Just "fromSortDirectionType") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedLazy) (Rec0 Text)))

SourceControlAuthStrategy

newtype SourceControlAuthStrategy Source #

Instances

Instances details
FromJSON SourceControlAuthStrategy Source # 
Instance details

Defined in Amazonka.Glue.Types.SourceControlAuthStrategy

FromJSONKey SourceControlAuthStrategy Source # 
Instance details

Defined in Amazonka.Glue.Types.SourceControlAuthStrategy

ToJSON SourceControlAuthStrategy Source # 
Instance details

Defined in Amazonka.Glue.Types.SourceControlAuthStrategy

ToJSONKey SourceControlAuthStrategy Source # 
Instance details

Defined in Amazonka.Glue.Types.SourceControlAuthStrategy

ToByteString SourceControlAuthStrategy Source # 
Instance details

Defined in Amazonka.Glue.Types.SourceControlAuthStrategy

ToHeader SourceControlAuthStrategy Source # 
Instance details

Defined in Amazonka.Glue.Types.SourceControlAuthStrategy

ToLog SourceControlAuthStrategy Source # 
Instance details

Defined in Amazonka.Glue.Types.SourceControlAuthStrategy

ToQuery SourceControlAuthStrategy Source # 
Instance details

Defined in Amazonka.Glue.Types.SourceControlAuthStrategy

FromText SourceControlAuthStrategy Source # 
Instance details

Defined in Amazonka.Glue.Types.SourceControlAuthStrategy

ToText SourceControlAuthStrategy Source # 
Instance details

Defined in Amazonka.Glue.Types.SourceControlAuthStrategy

FromXML SourceControlAuthStrategy Source # 
Instance details

Defined in Amazonka.Glue.Types.SourceControlAuthStrategy

ToXML SourceControlAuthStrategy Source # 
Instance details

Defined in Amazonka.Glue.Types.SourceControlAuthStrategy

Generic SourceControlAuthStrategy Source # 
Instance details

Defined in Amazonka.Glue.Types.SourceControlAuthStrategy

Associated Types

type Rep SourceControlAuthStrategy :: Type -> Type #

Read SourceControlAuthStrategy Source # 
Instance details

Defined in Amazonka.Glue.Types.SourceControlAuthStrategy

Show SourceControlAuthStrategy Source # 
Instance details

Defined in Amazonka.Glue.Types.SourceControlAuthStrategy

NFData SourceControlAuthStrategy Source # 
Instance details

Defined in Amazonka.Glue.Types.SourceControlAuthStrategy

Eq SourceControlAuthStrategy Source # 
Instance details

Defined in Amazonka.Glue.Types.SourceControlAuthStrategy

Ord SourceControlAuthStrategy Source # 
Instance details

Defined in Amazonka.Glue.Types.SourceControlAuthStrategy

Hashable SourceControlAuthStrategy Source # 
Instance details

Defined in Amazonka.Glue.Types.SourceControlAuthStrategy

type Rep SourceControlAuthStrategy Source # 
Instance details

Defined in Amazonka.Glue.Types.SourceControlAuthStrategy

type Rep SourceControlAuthStrategy = D1 ('MetaData "SourceControlAuthStrategy" "Amazonka.Glue.Types.SourceControlAuthStrategy" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'True) (C1 ('MetaCons "SourceControlAuthStrategy'" 'PrefixI 'True) (S1 ('MetaSel ('Just "fromSourceControlAuthStrategy") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedLazy) (Rec0 Text)))

SourceControlProvider

newtype SourceControlProvider Source #

Instances

Instances details
FromJSON SourceControlProvider Source # 
Instance details

Defined in Amazonka.Glue.Types.SourceControlProvider

FromJSONKey SourceControlProvider Source # 
Instance details

Defined in Amazonka.Glue.Types.SourceControlProvider

ToJSON SourceControlProvider Source # 
Instance details

Defined in Amazonka.Glue.Types.SourceControlProvider

ToJSONKey SourceControlProvider Source # 
Instance details

Defined in Amazonka.Glue.Types.SourceControlProvider

ToByteString SourceControlProvider Source # 
Instance details

Defined in Amazonka.Glue.Types.SourceControlProvider

ToHeader SourceControlProvider Source # 
Instance details

Defined in Amazonka.Glue.Types.SourceControlProvider

ToLog SourceControlProvider Source # 
Instance details

Defined in Amazonka.Glue.Types.SourceControlProvider

ToQuery SourceControlProvider Source # 
Instance details

Defined in Amazonka.Glue.Types.SourceControlProvider

FromText SourceControlProvider Source # 
Instance details

Defined in Amazonka.Glue.Types.SourceControlProvider

ToText SourceControlProvider Source # 
Instance details

Defined in Amazonka.Glue.Types.SourceControlProvider

FromXML SourceControlProvider Source # 
Instance details

Defined in Amazonka.Glue.Types.SourceControlProvider

ToXML SourceControlProvider Source # 
Instance details

Defined in Amazonka.Glue.Types.SourceControlProvider

Generic SourceControlProvider Source # 
Instance details

Defined in Amazonka.Glue.Types.SourceControlProvider

Associated Types

type Rep SourceControlProvider :: Type -> Type #

Read SourceControlProvider Source # 
Instance details

Defined in Amazonka.Glue.Types.SourceControlProvider

Show SourceControlProvider Source # 
Instance details

Defined in Amazonka.Glue.Types.SourceControlProvider

NFData SourceControlProvider Source # 
Instance details

Defined in Amazonka.Glue.Types.SourceControlProvider

Methods

rnf :: SourceControlProvider -> () #

Eq SourceControlProvider Source # 
Instance details

Defined in Amazonka.Glue.Types.SourceControlProvider

Ord SourceControlProvider Source # 
Instance details

Defined in Amazonka.Glue.Types.SourceControlProvider

Hashable SourceControlProvider Source # 
Instance details

Defined in Amazonka.Glue.Types.SourceControlProvider

type Rep SourceControlProvider Source # 
Instance details

Defined in Amazonka.Glue.Types.SourceControlProvider

type Rep SourceControlProvider = D1 ('MetaData "SourceControlProvider" "Amazonka.Glue.Types.SourceControlProvider" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'True) (C1 ('MetaCons "SourceControlProvider'" 'PrefixI 'True) (S1 ('MetaSel ('Just "fromSourceControlProvider") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedLazy) (Rec0 Text)))

StartingPosition

newtype StartingPosition Source #

Instances

Instances details
FromJSON StartingPosition Source # 
Instance details

Defined in Amazonka.Glue.Types.StartingPosition

FromJSONKey StartingPosition Source # 
Instance details

Defined in Amazonka.Glue.Types.StartingPosition

ToJSON StartingPosition Source # 
Instance details

Defined in Amazonka.Glue.Types.StartingPosition

ToJSONKey StartingPosition Source # 
Instance details

Defined in Amazonka.Glue.Types.StartingPosition

ToByteString StartingPosition Source # 
Instance details

Defined in Amazonka.Glue.Types.StartingPosition

ToHeader StartingPosition Source # 
Instance details

Defined in Amazonka.Glue.Types.StartingPosition

ToLog StartingPosition Source # 
Instance details

Defined in Amazonka.Glue.Types.StartingPosition

ToQuery StartingPosition Source # 
Instance details

Defined in Amazonka.Glue.Types.StartingPosition

FromText StartingPosition Source # 
Instance details

Defined in Amazonka.Glue.Types.StartingPosition

ToText StartingPosition Source # 
Instance details

Defined in Amazonka.Glue.Types.StartingPosition

FromXML StartingPosition Source # 
Instance details

Defined in Amazonka.Glue.Types.StartingPosition

ToXML StartingPosition Source # 
Instance details

Defined in Amazonka.Glue.Types.StartingPosition

Generic StartingPosition Source # 
Instance details

Defined in Amazonka.Glue.Types.StartingPosition

Associated Types

type Rep StartingPosition :: Type -> Type #

Read StartingPosition Source # 
Instance details

Defined in Amazonka.Glue.Types.StartingPosition

Show StartingPosition Source # 
Instance details

Defined in Amazonka.Glue.Types.StartingPosition

NFData StartingPosition Source # 
Instance details

Defined in Amazonka.Glue.Types.StartingPosition

Methods

rnf :: StartingPosition -> () #

Eq StartingPosition Source # 
Instance details

Defined in Amazonka.Glue.Types.StartingPosition

Ord StartingPosition Source # 
Instance details

Defined in Amazonka.Glue.Types.StartingPosition

Hashable StartingPosition Source # 
Instance details

Defined in Amazonka.Glue.Types.StartingPosition

type Rep StartingPosition Source # 
Instance details

Defined in Amazonka.Glue.Types.StartingPosition

type Rep StartingPosition = D1 ('MetaData "StartingPosition" "Amazonka.Glue.Types.StartingPosition" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'True) (C1 ('MetaCons "StartingPosition'" 'PrefixI 'True) (S1 ('MetaSel ('Just "fromStartingPosition") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedLazy) (Rec0 Text)))

StatementState

newtype StatementState Source #

Constructors

StatementState' 

Instances

Instances details
FromJSON StatementState Source # 
Instance details

Defined in Amazonka.Glue.Types.StatementState

FromJSONKey StatementState Source # 
Instance details

Defined in Amazonka.Glue.Types.StatementState

ToJSON StatementState Source # 
Instance details

Defined in Amazonka.Glue.Types.StatementState

ToJSONKey StatementState Source # 
Instance details

Defined in Amazonka.Glue.Types.StatementState

ToByteString StatementState Source # 
Instance details

Defined in Amazonka.Glue.Types.StatementState

ToHeader StatementState Source # 
Instance details

Defined in Amazonka.Glue.Types.StatementState

ToLog StatementState Source # 
Instance details

Defined in Amazonka.Glue.Types.StatementState

ToQuery StatementState Source # 
Instance details

Defined in Amazonka.Glue.Types.StatementState

FromText StatementState Source # 
Instance details

Defined in Amazonka.Glue.Types.StatementState

ToText StatementState Source # 
Instance details

Defined in Amazonka.Glue.Types.StatementState

FromXML StatementState Source # 
Instance details

Defined in Amazonka.Glue.Types.StatementState

ToXML StatementState Source # 
Instance details

Defined in Amazonka.Glue.Types.StatementState

Methods

toXML :: StatementState -> XML #

Generic StatementState Source # 
Instance details

Defined in Amazonka.Glue.Types.StatementState

Associated Types

type Rep StatementState :: Type -> Type #

Read StatementState Source # 
Instance details

Defined in Amazonka.Glue.Types.StatementState

Show StatementState Source # 
Instance details

Defined in Amazonka.Glue.Types.StatementState

NFData StatementState Source # 
Instance details

Defined in Amazonka.Glue.Types.StatementState

Methods

rnf :: StatementState -> () #

Eq StatementState Source # 
Instance details

Defined in Amazonka.Glue.Types.StatementState

Ord StatementState Source # 
Instance details

Defined in Amazonka.Glue.Types.StatementState

Hashable StatementState Source # 
Instance details

Defined in Amazonka.Glue.Types.StatementState

type Rep StatementState Source # 
Instance details

Defined in Amazonka.Glue.Types.StatementState

type Rep StatementState = D1 ('MetaData "StatementState" "Amazonka.Glue.Types.StatementState" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'True) (C1 ('MetaCons "StatementState'" 'PrefixI 'True) (S1 ('MetaSel ('Just "fromStatementState") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedLazy) (Rec0 Text)))

TargetFormat

newtype TargetFormat Source #

Constructors

TargetFormat' 

Instances

Instances details
FromJSON TargetFormat Source # 
Instance details

Defined in Amazonka.Glue.Types.TargetFormat

FromJSONKey TargetFormat Source # 
Instance details

Defined in Amazonka.Glue.Types.TargetFormat

ToJSON TargetFormat Source # 
Instance details

Defined in Amazonka.Glue.Types.TargetFormat

ToJSONKey TargetFormat Source # 
Instance details

Defined in Amazonka.Glue.Types.TargetFormat

ToByteString TargetFormat Source # 
Instance details

Defined in Amazonka.Glue.Types.TargetFormat

ToHeader TargetFormat Source # 
Instance details

Defined in Amazonka.Glue.Types.TargetFormat

ToLog TargetFormat Source # 
Instance details

Defined in Amazonka.Glue.Types.TargetFormat

ToQuery TargetFormat Source # 
Instance details

Defined in Amazonka.Glue.Types.TargetFormat

FromText TargetFormat Source # 
Instance details

Defined in Amazonka.Glue.Types.TargetFormat

ToText TargetFormat Source # 
Instance details

Defined in Amazonka.Glue.Types.TargetFormat

Methods

toText :: TargetFormat -> Text #

FromXML TargetFormat Source # 
Instance details

Defined in Amazonka.Glue.Types.TargetFormat

ToXML TargetFormat Source # 
Instance details

Defined in Amazonka.Glue.Types.TargetFormat

Methods

toXML :: TargetFormat -> XML #

Generic TargetFormat Source # 
Instance details

Defined in Amazonka.Glue.Types.TargetFormat

Associated Types

type Rep TargetFormat :: Type -> Type #

Read TargetFormat Source # 
Instance details

Defined in Amazonka.Glue.Types.TargetFormat

Show TargetFormat Source # 
Instance details

Defined in Amazonka.Glue.Types.TargetFormat

NFData TargetFormat Source # 
Instance details

Defined in Amazonka.Glue.Types.TargetFormat

Methods

rnf :: TargetFormat -> () #

Eq TargetFormat Source # 
Instance details

Defined in Amazonka.Glue.Types.TargetFormat

Ord TargetFormat Source # 
Instance details

Defined in Amazonka.Glue.Types.TargetFormat

Hashable TargetFormat Source # 
Instance details

Defined in Amazonka.Glue.Types.TargetFormat

type Rep TargetFormat Source # 
Instance details

Defined in Amazonka.Glue.Types.TargetFormat

type Rep TargetFormat = D1 ('MetaData "TargetFormat" "Amazonka.Glue.Types.TargetFormat" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'True) (C1 ('MetaCons "TargetFormat'" 'PrefixI 'True) (S1 ('MetaSel ('Just "fromTargetFormat") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedLazy) (Rec0 Text)))

TaskRunSortColumnType

newtype TaskRunSortColumnType Source #

Instances

Instances details
FromJSON TaskRunSortColumnType Source # 
Instance details

Defined in Amazonka.Glue.Types.TaskRunSortColumnType

FromJSONKey TaskRunSortColumnType Source # 
Instance details

Defined in Amazonka.Glue.Types.TaskRunSortColumnType

ToJSON TaskRunSortColumnType Source # 
Instance details

Defined in Amazonka.Glue.Types.TaskRunSortColumnType

ToJSONKey TaskRunSortColumnType Source # 
Instance details

Defined in Amazonka.Glue.Types.TaskRunSortColumnType

ToByteString TaskRunSortColumnType Source # 
Instance details

Defined in Amazonka.Glue.Types.TaskRunSortColumnType

ToHeader TaskRunSortColumnType Source # 
Instance details

Defined in Amazonka.Glue.Types.TaskRunSortColumnType

ToLog TaskRunSortColumnType Source # 
Instance details

Defined in Amazonka.Glue.Types.TaskRunSortColumnType

ToQuery TaskRunSortColumnType Source # 
Instance details

Defined in Amazonka.Glue.Types.TaskRunSortColumnType

FromText TaskRunSortColumnType Source # 
Instance details

Defined in Amazonka.Glue.Types.TaskRunSortColumnType

ToText TaskRunSortColumnType Source # 
Instance details

Defined in Amazonka.Glue.Types.TaskRunSortColumnType

FromXML TaskRunSortColumnType Source # 
Instance details

Defined in Amazonka.Glue.Types.TaskRunSortColumnType

ToXML TaskRunSortColumnType Source # 
Instance details

Defined in Amazonka.Glue.Types.TaskRunSortColumnType

Generic TaskRunSortColumnType Source # 
Instance details

Defined in Amazonka.Glue.Types.TaskRunSortColumnType

Associated Types

type Rep TaskRunSortColumnType :: Type -> Type #

Read TaskRunSortColumnType Source # 
Instance details

Defined in Amazonka.Glue.Types.TaskRunSortColumnType

Show TaskRunSortColumnType Source # 
Instance details

Defined in Amazonka.Glue.Types.TaskRunSortColumnType

NFData TaskRunSortColumnType Source # 
Instance details

Defined in Amazonka.Glue.Types.TaskRunSortColumnType

Methods

rnf :: TaskRunSortColumnType -> () #

Eq TaskRunSortColumnType Source # 
Instance details

Defined in Amazonka.Glue.Types.TaskRunSortColumnType

Ord TaskRunSortColumnType Source # 
Instance details

Defined in Amazonka.Glue.Types.TaskRunSortColumnType

Hashable TaskRunSortColumnType Source # 
Instance details

Defined in Amazonka.Glue.Types.TaskRunSortColumnType

type Rep TaskRunSortColumnType Source # 
Instance details

Defined in Amazonka.Glue.Types.TaskRunSortColumnType

type Rep TaskRunSortColumnType = D1 ('MetaData "TaskRunSortColumnType" "Amazonka.Glue.Types.TaskRunSortColumnType" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'True) (C1 ('MetaCons "TaskRunSortColumnType'" 'PrefixI 'True) (S1 ('MetaSel ('Just "fromTaskRunSortColumnType") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedLazy) (Rec0 Text)))

TaskStatusType

newtype TaskStatusType Source #

Constructors

TaskStatusType' 

Instances

Instances details
FromJSON TaskStatusType Source # 
Instance details

Defined in Amazonka.Glue.Types.TaskStatusType

FromJSONKey TaskStatusType Source # 
Instance details

Defined in Amazonka.Glue.Types.TaskStatusType

ToJSON TaskStatusType Source # 
Instance details

Defined in Amazonka.Glue.Types.TaskStatusType

ToJSONKey TaskStatusType Source # 
Instance details

Defined in Amazonka.Glue.Types.TaskStatusType

ToByteString TaskStatusType Source # 
Instance details

Defined in Amazonka.Glue.Types.TaskStatusType

ToHeader TaskStatusType Source # 
Instance details

Defined in Amazonka.Glue.Types.TaskStatusType

ToLog TaskStatusType Source # 
Instance details

Defined in Amazonka.Glue.Types.TaskStatusType

ToQuery TaskStatusType Source # 
Instance details

Defined in Amazonka.Glue.Types.TaskStatusType

FromText TaskStatusType Source # 
Instance details

Defined in Amazonka.Glue.Types.TaskStatusType

ToText TaskStatusType Source # 
Instance details

Defined in Amazonka.Glue.Types.TaskStatusType

FromXML TaskStatusType Source # 
Instance details

Defined in Amazonka.Glue.Types.TaskStatusType

ToXML TaskStatusType Source # 
Instance details

Defined in Amazonka.Glue.Types.TaskStatusType

Methods

toXML :: TaskStatusType -> XML #

Generic TaskStatusType Source # 
Instance details

Defined in Amazonka.Glue.Types.TaskStatusType

Associated Types

type Rep TaskStatusType :: Type -> Type #

Read TaskStatusType Source # 
Instance details

Defined in Amazonka.Glue.Types.TaskStatusType

Show TaskStatusType Source # 
Instance details

Defined in Amazonka.Glue.Types.TaskStatusType

NFData TaskStatusType Source # 
Instance details

Defined in Amazonka.Glue.Types.TaskStatusType

Methods

rnf :: TaskStatusType -> () #

Eq TaskStatusType Source # 
Instance details

Defined in Amazonka.Glue.Types.TaskStatusType

Ord TaskStatusType Source # 
Instance details

Defined in Amazonka.Glue.Types.TaskStatusType

Hashable TaskStatusType Source # 
Instance details

Defined in Amazonka.Glue.Types.TaskStatusType

type Rep TaskStatusType Source # 
Instance details

Defined in Amazonka.Glue.Types.TaskStatusType

type Rep TaskStatusType = D1 ('MetaData "TaskStatusType" "Amazonka.Glue.Types.TaskStatusType" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'True) (C1 ('MetaCons "TaskStatusType'" 'PrefixI 'True) (S1 ('MetaSel ('Just "fromTaskStatusType") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedLazy) (Rec0 Text)))

TaskType

newtype TaskType Source #

Constructors

TaskType' 

Fields

Instances

Instances details
FromJSON TaskType Source # 
Instance details

Defined in Amazonka.Glue.Types.TaskType

FromJSONKey TaskType Source # 
Instance details

Defined in Amazonka.Glue.Types.TaskType

ToJSON TaskType Source # 
Instance details

Defined in Amazonka.Glue.Types.TaskType

ToJSONKey TaskType Source # 
Instance details

Defined in Amazonka.Glue.Types.TaskType

ToByteString TaskType Source # 
Instance details

Defined in Amazonka.Glue.Types.TaskType

Methods

toBS :: TaskType -> ByteString #

ToHeader TaskType Source # 
Instance details

Defined in Amazonka.Glue.Types.TaskType

Methods

toHeader :: HeaderName -> TaskType -> [Header] #

ToLog TaskType Source # 
Instance details

Defined in Amazonka.Glue.Types.TaskType

ToQuery TaskType Source # 
Instance details

Defined in Amazonka.Glue.Types.TaskType

FromText TaskType Source # 
Instance details

Defined in Amazonka.Glue.Types.TaskType

ToText TaskType Source # 
Instance details

Defined in Amazonka.Glue.Types.TaskType

Methods

toText :: TaskType -> Text #

FromXML TaskType Source # 
Instance details

Defined in Amazonka.Glue.Types.TaskType

ToXML TaskType Source # 
Instance details

Defined in Amazonka.Glue.Types.TaskType

Methods

toXML :: TaskType -> XML #

Generic TaskType Source # 
Instance details

Defined in Amazonka.Glue.Types.TaskType

Associated Types

type Rep TaskType :: Type -> Type #

Methods

from :: TaskType -> Rep TaskType x #

to :: Rep TaskType x -> TaskType #

Read TaskType Source # 
Instance details

Defined in Amazonka.Glue.Types.TaskType

Show TaskType Source # 
Instance details

Defined in Amazonka.Glue.Types.TaskType

NFData TaskType Source # 
Instance details

Defined in Amazonka.Glue.Types.TaskType

Methods

rnf :: TaskType -> () #

Eq TaskType Source # 
Instance details

Defined in Amazonka.Glue.Types.TaskType

Ord TaskType Source # 
Instance details

Defined in Amazonka.Glue.Types.TaskType

Hashable TaskType Source # 
Instance details

Defined in Amazonka.Glue.Types.TaskType

Methods

hashWithSalt :: Int -> TaskType -> Int #

hash :: TaskType -> Int #

type Rep TaskType Source # 
Instance details

Defined in Amazonka.Glue.Types.TaskType

type Rep TaskType = D1 ('MetaData "TaskType" "Amazonka.Glue.Types.TaskType" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'True) (C1 ('MetaCons "TaskType'" 'PrefixI 'True) (S1 ('MetaSel ('Just "fromTaskType") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedLazy) (Rec0 Text)))

TransformSortColumnType

newtype TransformSortColumnType Source #

Instances

Instances details
FromJSON TransformSortColumnType Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformSortColumnType

FromJSONKey TransformSortColumnType Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformSortColumnType

ToJSON TransformSortColumnType Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformSortColumnType

ToJSONKey TransformSortColumnType Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformSortColumnType

ToByteString TransformSortColumnType Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformSortColumnType

ToHeader TransformSortColumnType Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformSortColumnType

ToLog TransformSortColumnType Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformSortColumnType

ToQuery TransformSortColumnType Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformSortColumnType

FromText TransformSortColumnType Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformSortColumnType

ToText TransformSortColumnType Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformSortColumnType

FromXML TransformSortColumnType Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformSortColumnType

ToXML TransformSortColumnType Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformSortColumnType

Generic TransformSortColumnType Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformSortColumnType

Associated Types

type Rep TransformSortColumnType :: Type -> Type #

Read TransformSortColumnType Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformSortColumnType

Show TransformSortColumnType Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformSortColumnType

NFData TransformSortColumnType Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformSortColumnType

Methods

rnf :: TransformSortColumnType -> () #

Eq TransformSortColumnType Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformSortColumnType

Ord TransformSortColumnType Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformSortColumnType

Hashable TransformSortColumnType Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformSortColumnType

type Rep TransformSortColumnType Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformSortColumnType

type Rep TransformSortColumnType = D1 ('MetaData "TransformSortColumnType" "Amazonka.Glue.Types.TransformSortColumnType" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'True) (C1 ('MetaCons "TransformSortColumnType'" 'PrefixI 'True) (S1 ('MetaSel ('Just "fromTransformSortColumnType") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedLazy) (Rec0 Text)))

TransformStatusType

newtype TransformStatusType Source #

Instances

Instances details
FromJSON TransformStatusType Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformStatusType

FromJSONKey TransformStatusType Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformStatusType

ToJSON TransformStatusType Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformStatusType

ToJSONKey TransformStatusType Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformStatusType

ToByteString TransformStatusType Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformStatusType

ToHeader TransformStatusType Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformStatusType

ToLog TransformStatusType Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformStatusType

ToQuery TransformStatusType Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformStatusType

FromText TransformStatusType Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformStatusType

ToText TransformStatusType Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformStatusType

FromXML TransformStatusType Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformStatusType

ToXML TransformStatusType Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformStatusType

Generic TransformStatusType Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformStatusType

Associated Types

type Rep TransformStatusType :: Type -> Type #

Read TransformStatusType Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformStatusType

Show TransformStatusType Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformStatusType

NFData TransformStatusType Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformStatusType

Methods

rnf :: TransformStatusType -> () #

Eq TransformStatusType Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformStatusType

Ord TransformStatusType Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformStatusType

Hashable TransformStatusType Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformStatusType

type Rep TransformStatusType Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformStatusType

type Rep TransformStatusType = D1 ('MetaData "TransformStatusType" "Amazonka.Glue.Types.TransformStatusType" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'True) (C1 ('MetaCons "TransformStatusType'" 'PrefixI 'True) (S1 ('MetaSel ('Just "fromTransformStatusType") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedLazy) (Rec0 Text)))

TransformType

newtype TransformType Source #

Constructors

TransformType' 

Bundled Patterns

pattern TransformType_FIND_MATCHES :: TransformType 

Instances

Instances details
FromJSON TransformType Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformType

FromJSONKey TransformType Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformType

ToJSON TransformType Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformType

ToJSONKey TransformType Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformType

ToByteString TransformType Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformType

ToHeader TransformType Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformType

ToLog TransformType Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformType

ToQuery TransformType Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformType

FromText TransformType Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformType

ToText TransformType Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformType

Methods

toText :: TransformType -> Text #

FromXML TransformType Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformType

ToXML TransformType Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformType

Methods

toXML :: TransformType -> XML #

Generic TransformType Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformType

Associated Types

type Rep TransformType :: Type -> Type #

Read TransformType Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformType

Show TransformType Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformType

NFData TransformType Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformType

Methods

rnf :: TransformType -> () #

Eq TransformType Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformType

Ord TransformType Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformType

Hashable TransformType Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformType

type Rep TransformType Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformType

type Rep TransformType = D1 ('MetaData "TransformType" "Amazonka.Glue.Types.TransformType" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'True) (C1 ('MetaCons "TransformType'" 'PrefixI 'True) (S1 ('MetaSel ('Just "fromTransformType") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedLazy) (Rec0 Text)))

TriggerState

newtype TriggerState Source #

Constructors

TriggerState' 

Instances

Instances details
FromJSON TriggerState Source # 
Instance details

Defined in Amazonka.Glue.Types.TriggerState

FromJSONKey TriggerState Source # 
Instance details

Defined in Amazonka.Glue.Types.TriggerState

ToJSON TriggerState Source # 
Instance details

Defined in Amazonka.Glue.Types.TriggerState

ToJSONKey TriggerState Source # 
Instance details

Defined in Amazonka.Glue.Types.TriggerState

ToByteString TriggerState Source # 
Instance details

Defined in Amazonka.Glue.Types.TriggerState

ToHeader TriggerState Source # 
Instance details

Defined in Amazonka.Glue.Types.TriggerState

ToLog TriggerState Source # 
Instance details

Defined in Amazonka.Glue.Types.TriggerState

ToQuery TriggerState Source # 
Instance details

Defined in Amazonka.Glue.Types.TriggerState

FromText TriggerState Source # 
Instance details

Defined in Amazonka.Glue.Types.TriggerState

ToText TriggerState Source # 
Instance details

Defined in Amazonka.Glue.Types.TriggerState

Methods

toText :: TriggerState -> Text #

FromXML TriggerState Source # 
Instance details

Defined in Amazonka.Glue.Types.TriggerState

ToXML TriggerState Source # 
Instance details

Defined in Amazonka.Glue.Types.TriggerState

Methods

toXML :: TriggerState -> XML #

Generic TriggerState Source # 
Instance details

Defined in Amazonka.Glue.Types.TriggerState

Associated Types

type Rep TriggerState :: Type -> Type #

Read TriggerState Source # 
Instance details

Defined in Amazonka.Glue.Types.TriggerState

Show TriggerState Source # 
Instance details

Defined in Amazonka.Glue.Types.TriggerState

NFData TriggerState Source # 
Instance details

Defined in Amazonka.Glue.Types.TriggerState

Methods

rnf :: TriggerState -> () #

Eq TriggerState Source # 
Instance details

Defined in Amazonka.Glue.Types.TriggerState

Ord TriggerState Source # 
Instance details

Defined in Amazonka.Glue.Types.TriggerState

Hashable TriggerState Source # 
Instance details

Defined in Amazonka.Glue.Types.TriggerState

type Rep TriggerState Source # 
Instance details

Defined in Amazonka.Glue.Types.TriggerState

type Rep TriggerState = D1 ('MetaData "TriggerState" "Amazonka.Glue.Types.TriggerState" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'True) (C1 ('MetaCons "TriggerState'" 'PrefixI 'True) (S1 ('MetaSel ('Just "fromTriggerState") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedLazy) (Rec0 Text)))

TriggerType

newtype TriggerType Source #

Constructors

TriggerType' 

Instances

Instances details
FromJSON TriggerType Source # 
Instance details

Defined in Amazonka.Glue.Types.TriggerType

FromJSONKey TriggerType Source # 
Instance details

Defined in Amazonka.Glue.Types.TriggerType

ToJSON TriggerType Source # 
Instance details

Defined in Amazonka.Glue.Types.TriggerType

ToJSONKey TriggerType Source # 
Instance details

Defined in Amazonka.Glue.Types.TriggerType

ToByteString TriggerType Source # 
Instance details

Defined in Amazonka.Glue.Types.TriggerType

ToHeader TriggerType Source # 
Instance details

Defined in Amazonka.Glue.Types.TriggerType

ToLog TriggerType Source # 
Instance details

Defined in Amazonka.Glue.Types.TriggerType

ToQuery TriggerType Source # 
Instance details

Defined in Amazonka.Glue.Types.TriggerType

FromText TriggerType Source # 
Instance details

Defined in Amazonka.Glue.Types.TriggerType

ToText TriggerType Source # 
Instance details

Defined in Amazonka.Glue.Types.TriggerType

Methods

toText :: TriggerType -> Text #

FromXML TriggerType Source # 
Instance details

Defined in Amazonka.Glue.Types.TriggerType

ToXML TriggerType Source # 
Instance details

Defined in Amazonka.Glue.Types.TriggerType

Methods

toXML :: TriggerType -> XML #

Generic TriggerType Source # 
Instance details

Defined in Amazonka.Glue.Types.TriggerType

Associated Types

type Rep TriggerType :: Type -> Type #

Read TriggerType Source # 
Instance details

Defined in Amazonka.Glue.Types.TriggerType

Show TriggerType Source # 
Instance details

Defined in Amazonka.Glue.Types.TriggerType

NFData TriggerType Source # 
Instance details

Defined in Amazonka.Glue.Types.TriggerType

Methods

rnf :: TriggerType -> () #

Eq TriggerType Source # 
Instance details

Defined in Amazonka.Glue.Types.TriggerType

Ord TriggerType Source # 
Instance details

Defined in Amazonka.Glue.Types.TriggerType

Hashable TriggerType Source # 
Instance details

Defined in Amazonka.Glue.Types.TriggerType

type Rep TriggerType Source # 
Instance details

Defined in Amazonka.Glue.Types.TriggerType

type Rep TriggerType = D1 ('MetaData "TriggerType" "Amazonka.Glue.Types.TriggerType" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'True) (C1 ('MetaCons "TriggerType'" 'PrefixI 'True) (S1 ('MetaSel ('Just "fromTriggerType") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedLazy) (Rec0 Text)))

UnionType

newtype UnionType Source #

Constructors

UnionType' 

Fields

Bundled Patterns

pattern UnionType_ALL :: UnionType 
pattern UnionType_DISTINCT :: UnionType 

Instances

Instances details
FromJSON UnionType Source # 
Instance details

Defined in Amazonka.Glue.Types.UnionType

FromJSONKey UnionType Source # 
Instance details

Defined in Amazonka.Glue.Types.UnionType

ToJSON UnionType Source # 
Instance details

Defined in Amazonka.Glue.Types.UnionType

ToJSONKey UnionType Source # 
Instance details

Defined in Amazonka.Glue.Types.UnionType

ToByteString UnionType Source # 
Instance details

Defined in Amazonka.Glue.Types.UnionType

Methods

toBS :: UnionType -> ByteString #

ToHeader UnionType Source # 
Instance details

Defined in Amazonka.Glue.Types.UnionType

ToLog UnionType Source # 
Instance details

Defined in Amazonka.Glue.Types.UnionType

ToQuery UnionType Source # 
Instance details

Defined in Amazonka.Glue.Types.UnionType

FromText UnionType Source # 
Instance details

Defined in Amazonka.Glue.Types.UnionType

ToText UnionType Source # 
Instance details

Defined in Amazonka.Glue.Types.UnionType

Methods

toText :: UnionType -> Text #

FromXML UnionType Source # 
Instance details

Defined in Amazonka.Glue.Types.UnionType

ToXML UnionType Source # 
Instance details

Defined in Amazonka.Glue.Types.UnionType

Methods

toXML :: UnionType -> XML #

Generic UnionType Source # 
Instance details

Defined in Amazonka.Glue.Types.UnionType

Associated Types

type Rep UnionType :: Type -> Type #

Read UnionType Source # 
Instance details

Defined in Amazonka.Glue.Types.UnionType

Show UnionType Source # 
Instance details

Defined in Amazonka.Glue.Types.UnionType

NFData UnionType Source # 
Instance details

Defined in Amazonka.Glue.Types.UnionType

Methods

rnf :: UnionType -> () #

Eq UnionType Source # 
Instance details

Defined in Amazonka.Glue.Types.UnionType

Ord UnionType Source # 
Instance details

Defined in Amazonka.Glue.Types.UnionType

Hashable UnionType Source # 
Instance details

Defined in Amazonka.Glue.Types.UnionType

type Rep UnionType Source # 
Instance details

Defined in Amazonka.Glue.Types.UnionType

type Rep UnionType = D1 ('MetaData "UnionType" "Amazonka.Glue.Types.UnionType" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'True) (C1 ('MetaCons "UnionType'" 'PrefixI 'True) (S1 ('MetaSel ('Just "fromUnionType") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedLazy) (Rec0 Text)))

UpdateBehavior

newtype UpdateBehavior Source #

Constructors

UpdateBehavior' 

Instances

Instances details
FromJSON UpdateBehavior Source # 
Instance details

Defined in Amazonka.Glue.Types.UpdateBehavior

FromJSONKey UpdateBehavior Source # 
Instance details

Defined in Amazonka.Glue.Types.UpdateBehavior

ToJSON UpdateBehavior Source # 
Instance details

Defined in Amazonka.Glue.Types.UpdateBehavior

ToJSONKey UpdateBehavior Source # 
Instance details

Defined in Amazonka.Glue.Types.UpdateBehavior

ToByteString UpdateBehavior Source # 
Instance details

Defined in Amazonka.Glue.Types.UpdateBehavior

ToHeader UpdateBehavior Source # 
Instance details

Defined in Amazonka.Glue.Types.UpdateBehavior

ToLog UpdateBehavior Source # 
Instance details

Defined in Amazonka.Glue.Types.UpdateBehavior

ToQuery UpdateBehavior Source # 
Instance details

Defined in Amazonka.Glue.Types.UpdateBehavior

FromText UpdateBehavior Source # 
Instance details

Defined in Amazonka.Glue.Types.UpdateBehavior

ToText UpdateBehavior Source # 
Instance details

Defined in Amazonka.Glue.Types.UpdateBehavior

FromXML UpdateBehavior Source # 
Instance details

Defined in Amazonka.Glue.Types.UpdateBehavior

ToXML UpdateBehavior Source # 
Instance details

Defined in Amazonka.Glue.Types.UpdateBehavior

Methods

toXML :: UpdateBehavior -> XML #

Generic UpdateBehavior Source # 
Instance details

Defined in Amazonka.Glue.Types.UpdateBehavior

Associated Types

type Rep UpdateBehavior :: Type -> Type #

Read UpdateBehavior Source # 
Instance details

Defined in Amazonka.Glue.Types.UpdateBehavior

Show UpdateBehavior Source # 
Instance details

Defined in Amazonka.Glue.Types.UpdateBehavior

NFData UpdateBehavior Source # 
Instance details

Defined in Amazonka.Glue.Types.UpdateBehavior

Methods

rnf :: UpdateBehavior -> () #

Eq UpdateBehavior Source # 
Instance details

Defined in Amazonka.Glue.Types.UpdateBehavior

Ord UpdateBehavior Source # 
Instance details

Defined in Amazonka.Glue.Types.UpdateBehavior

Hashable UpdateBehavior Source # 
Instance details

Defined in Amazonka.Glue.Types.UpdateBehavior

type Rep UpdateBehavior Source # 
Instance details

Defined in Amazonka.Glue.Types.UpdateBehavior

type Rep UpdateBehavior = D1 ('MetaData "UpdateBehavior" "Amazonka.Glue.Types.UpdateBehavior" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'True) (C1 ('MetaCons "UpdateBehavior'" 'PrefixI 'True) (S1 ('MetaSel ('Just "fromUpdateBehavior") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedLazy) (Rec0 Text)))

UpdateCatalogBehavior

newtype UpdateCatalogBehavior Source #

Instances

Instances details
FromJSON UpdateCatalogBehavior Source # 
Instance details

Defined in Amazonka.Glue.Types.UpdateCatalogBehavior

FromJSONKey UpdateCatalogBehavior Source # 
Instance details

Defined in Amazonka.Glue.Types.UpdateCatalogBehavior

ToJSON UpdateCatalogBehavior Source # 
Instance details

Defined in Amazonka.Glue.Types.UpdateCatalogBehavior

ToJSONKey UpdateCatalogBehavior Source # 
Instance details

Defined in Amazonka.Glue.Types.UpdateCatalogBehavior

ToByteString UpdateCatalogBehavior Source # 
Instance details

Defined in Amazonka.Glue.Types.UpdateCatalogBehavior

ToHeader UpdateCatalogBehavior Source # 
Instance details

Defined in Amazonka.Glue.Types.UpdateCatalogBehavior

ToLog UpdateCatalogBehavior Source # 
Instance details

Defined in Amazonka.Glue.Types.UpdateCatalogBehavior

ToQuery UpdateCatalogBehavior Source # 
Instance details

Defined in Amazonka.Glue.Types.UpdateCatalogBehavior

FromText UpdateCatalogBehavior Source # 
Instance details

Defined in Amazonka.Glue.Types.UpdateCatalogBehavior

ToText UpdateCatalogBehavior Source # 
Instance details

Defined in Amazonka.Glue.Types.UpdateCatalogBehavior

FromXML UpdateCatalogBehavior Source # 
Instance details

Defined in Amazonka.Glue.Types.UpdateCatalogBehavior

ToXML UpdateCatalogBehavior Source # 
Instance details

Defined in Amazonka.Glue.Types.UpdateCatalogBehavior

Generic UpdateCatalogBehavior Source # 
Instance details

Defined in Amazonka.Glue.Types.UpdateCatalogBehavior

Associated Types

type Rep UpdateCatalogBehavior :: Type -> Type #

Read UpdateCatalogBehavior Source # 
Instance details

Defined in Amazonka.Glue.Types.UpdateCatalogBehavior

Show UpdateCatalogBehavior Source # 
Instance details

Defined in Amazonka.Glue.Types.UpdateCatalogBehavior

NFData UpdateCatalogBehavior Source # 
Instance details

Defined in Amazonka.Glue.Types.UpdateCatalogBehavior

Methods

rnf :: UpdateCatalogBehavior -> () #

Eq UpdateCatalogBehavior Source # 
Instance details

Defined in Amazonka.Glue.Types.UpdateCatalogBehavior

Ord UpdateCatalogBehavior Source # 
Instance details

Defined in Amazonka.Glue.Types.UpdateCatalogBehavior

Hashable UpdateCatalogBehavior Source # 
Instance details

Defined in Amazonka.Glue.Types.UpdateCatalogBehavior

type Rep UpdateCatalogBehavior Source # 
Instance details

Defined in Amazonka.Glue.Types.UpdateCatalogBehavior

type Rep UpdateCatalogBehavior = D1 ('MetaData "UpdateCatalogBehavior" "Amazonka.Glue.Types.UpdateCatalogBehavior" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'True) (C1 ('MetaCons "UpdateCatalogBehavior'" 'PrefixI 'True) (S1 ('MetaSel ('Just "fromUpdateCatalogBehavior") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedLazy) (Rec0 Text)))

WorkerType

newtype WorkerType Source #

Constructors

WorkerType' 

Fields

Bundled Patterns

pattern WorkerType_G_025X :: WorkerType 
pattern WorkerType_G_1X :: WorkerType 
pattern WorkerType_G_2X :: WorkerType 
pattern WorkerType_Standard :: WorkerType 

Instances

Instances details
FromJSON WorkerType Source # 
Instance details

Defined in Amazonka.Glue.Types.WorkerType

FromJSONKey WorkerType Source # 
Instance details

Defined in Amazonka.Glue.Types.WorkerType

ToJSON WorkerType Source # 
Instance details

Defined in Amazonka.Glue.Types.WorkerType

ToJSONKey WorkerType Source # 
Instance details

Defined in Amazonka.Glue.Types.WorkerType

ToByteString WorkerType Source # 
Instance details

Defined in Amazonka.Glue.Types.WorkerType

ToHeader WorkerType Source # 
Instance details

Defined in Amazonka.Glue.Types.WorkerType

ToLog WorkerType Source # 
Instance details

Defined in Amazonka.Glue.Types.WorkerType

ToQuery WorkerType Source # 
Instance details

Defined in Amazonka.Glue.Types.WorkerType

FromText WorkerType Source # 
Instance details

Defined in Amazonka.Glue.Types.WorkerType

ToText WorkerType Source # 
Instance details

Defined in Amazonka.Glue.Types.WorkerType

Methods

toText :: WorkerType -> Text #

FromXML WorkerType Source # 
Instance details

Defined in Amazonka.Glue.Types.WorkerType

ToXML WorkerType Source # 
Instance details

Defined in Amazonka.Glue.Types.WorkerType

Methods

toXML :: WorkerType -> XML #

Generic WorkerType Source # 
Instance details

Defined in Amazonka.Glue.Types.WorkerType

Associated Types

type Rep WorkerType :: Type -> Type #

Read WorkerType Source # 
Instance details

Defined in Amazonka.Glue.Types.WorkerType

Show WorkerType Source # 
Instance details

Defined in Amazonka.Glue.Types.WorkerType

NFData WorkerType Source # 
Instance details

Defined in Amazonka.Glue.Types.WorkerType

Methods

rnf :: WorkerType -> () #

Eq WorkerType Source # 
Instance details

Defined in Amazonka.Glue.Types.WorkerType

Ord WorkerType Source # 
Instance details

Defined in Amazonka.Glue.Types.WorkerType

Hashable WorkerType Source # 
Instance details

Defined in Amazonka.Glue.Types.WorkerType

type Rep WorkerType Source # 
Instance details

Defined in Amazonka.Glue.Types.WorkerType

type Rep WorkerType = D1 ('MetaData "WorkerType" "Amazonka.Glue.Types.WorkerType" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'True) (C1 ('MetaCons "WorkerType'" 'PrefixI 'True) (S1 ('MetaSel ('Just "fromWorkerType") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedLazy) (Rec0 Text)))

WorkflowRunStatus

newtype WorkflowRunStatus Source #

Instances

Instances details
FromJSON WorkflowRunStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.WorkflowRunStatus

FromJSONKey WorkflowRunStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.WorkflowRunStatus

ToJSON WorkflowRunStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.WorkflowRunStatus

ToJSONKey WorkflowRunStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.WorkflowRunStatus

ToByteString WorkflowRunStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.WorkflowRunStatus

ToHeader WorkflowRunStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.WorkflowRunStatus

ToLog WorkflowRunStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.WorkflowRunStatus

ToQuery WorkflowRunStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.WorkflowRunStatus

FromText WorkflowRunStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.WorkflowRunStatus

ToText WorkflowRunStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.WorkflowRunStatus

FromXML WorkflowRunStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.WorkflowRunStatus

ToXML WorkflowRunStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.WorkflowRunStatus

Generic WorkflowRunStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.WorkflowRunStatus

Associated Types

type Rep WorkflowRunStatus :: Type -> Type #

Read WorkflowRunStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.WorkflowRunStatus

Show WorkflowRunStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.WorkflowRunStatus

NFData WorkflowRunStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.WorkflowRunStatus

Methods

rnf :: WorkflowRunStatus -> () #

Eq WorkflowRunStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.WorkflowRunStatus

Ord WorkflowRunStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.WorkflowRunStatus

Hashable WorkflowRunStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.WorkflowRunStatus

type Rep WorkflowRunStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.WorkflowRunStatus

type Rep WorkflowRunStatus = D1 ('MetaData "WorkflowRunStatus" "Amazonka.Glue.Types.WorkflowRunStatus" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'True) (C1 ('MetaCons "WorkflowRunStatus'" 'PrefixI 'True) (S1 ('MetaSel ('Just "fromWorkflowRunStatus") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedLazy) (Rec0 Text)))

Action

data Action Source #

Defines an action to be initiated by a trigger.

See: newAction smart constructor.

Constructors

Action' 

Fields

  • arguments :: Maybe (HashMap Text Text)

    The job arguments used when this trigger fires. For this job run, they replace the default arguments set in the job definition itself.

    You can specify arguments here that your own job-execution script consumes, as well as arguments that Glue itself consumes.

    For information about how to specify and consume your own Job arguments, see the Calling Glue APIs in Python topic in the developer guide.

    For information about the key-value pairs that Glue consumes to set up your job, see the Special Parameters Used by Glue topic in the developer guide.

  • crawlerName :: Maybe Text

    The name of the crawler to be used with this action.

  • jobName :: Maybe Text

    The name of a job to be run.

  • notificationProperty :: Maybe NotificationProperty

    Specifies configuration properties of a job run notification.

  • securityConfiguration :: Maybe Text

    The name of the SecurityConfiguration structure to be used with this action.

  • timeout :: Maybe Natural

    The JobRun timeout in minutes. This is the maximum time that a job run can consume resources before it is terminated and enters TIMEOUT status. The default is 2,880 minutes (48 hours). This overrides the timeout value set in the parent job.

Instances

Instances details
FromJSON Action Source # 
Instance details

Defined in Amazonka.Glue.Types.Action

ToJSON Action Source # 
Instance details

Defined in Amazonka.Glue.Types.Action

Generic Action Source # 
Instance details

Defined in Amazonka.Glue.Types.Action

Associated Types

type Rep Action :: Type -> Type #

Methods

from :: Action -> Rep Action x #

to :: Rep Action x -> Action #

Read Action Source # 
Instance details

Defined in Amazonka.Glue.Types.Action

Show Action Source # 
Instance details

Defined in Amazonka.Glue.Types.Action

NFData Action Source # 
Instance details

Defined in Amazonka.Glue.Types.Action

Methods

rnf :: Action -> () #

Eq Action Source # 
Instance details

Defined in Amazonka.Glue.Types.Action

Methods

(==) :: Action -> Action -> Bool #

(/=) :: Action -> Action -> Bool #

Hashable Action Source # 
Instance details

Defined in Amazonka.Glue.Types.Action

Methods

hashWithSalt :: Int -> Action -> Int #

hash :: Action -> Int #

type Rep Action Source # 
Instance details

Defined in Amazonka.Glue.Types.Action

newAction :: Action Source #

Create a value of Action with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:arguments:Action', action_arguments - The job arguments used when this trigger fires. For this job run, they replace the default arguments set in the job definition itself.

You can specify arguments here that your own job-execution script consumes, as well as arguments that Glue itself consumes.

For information about how to specify and consume your own Job arguments, see the Calling Glue APIs in Python topic in the developer guide.

For information about the key-value pairs that Glue consumes to set up your job, see the Special Parameters Used by Glue topic in the developer guide.

$sel:crawlerName:Action', action_crawlerName - The name of the crawler to be used with this action.

$sel:jobName:Action', action_jobName - The name of a job to be run.

$sel:notificationProperty:Action', action_notificationProperty - Specifies configuration properties of a job run notification.

$sel:securityConfiguration:Action', action_securityConfiguration - The name of the SecurityConfiguration structure to be used with this action.

$sel:timeout:Action', action_timeout - The JobRun timeout in minutes. This is the maximum time that a job run can consume resources before it is terminated and enters TIMEOUT status. The default is 2,880 minutes (48 hours). This overrides the timeout value set in the parent job.

action_arguments :: Lens' Action (Maybe (HashMap Text Text)) Source #

The job arguments used when this trigger fires. For this job run, they replace the default arguments set in the job definition itself.

You can specify arguments here that your own job-execution script consumes, as well as arguments that Glue itself consumes.

For information about how to specify and consume your own Job arguments, see the Calling Glue APIs in Python topic in the developer guide.

For information about the key-value pairs that Glue consumes to set up your job, see the Special Parameters Used by Glue topic in the developer guide.

action_crawlerName :: Lens' Action (Maybe Text) Source #

The name of the crawler to be used with this action.

action_jobName :: Lens' Action (Maybe Text) Source #

The name of a job to be run.

action_notificationProperty :: Lens' Action (Maybe NotificationProperty) Source #

Specifies configuration properties of a job run notification.

action_securityConfiguration :: Lens' Action (Maybe Text) Source #

The name of the SecurityConfiguration structure to be used with this action.

action_timeout :: Lens' Action (Maybe Natural) Source #

The JobRun timeout in minutes. This is the maximum time that a job run can consume resources before it is terminated and enters TIMEOUT status. The default is 2,880 minutes (48 hours). This overrides the timeout value set in the parent job.

Aggregate

data Aggregate Source #

Specifies a transform that groups rows by chosen fields and computes the aggregated value by specified function.

See: newAggregate smart constructor.

Constructors

Aggregate' 

Fields

Instances

Instances details
FromJSON Aggregate Source # 
Instance details

Defined in Amazonka.Glue.Types.Aggregate

ToJSON Aggregate Source # 
Instance details

Defined in Amazonka.Glue.Types.Aggregate

Generic Aggregate Source # 
Instance details

Defined in Amazonka.Glue.Types.Aggregate

Associated Types

type Rep Aggregate :: Type -> Type #

Read Aggregate Source # 
Instance details

Defined in Amazonka.Glue.Types.Aggregate

Show Aggregate Source # 
Instance details

Defined in Amazonka.Glue.Types.Aggregate

NFData Aggregate Source # 
Instance details

Defined in Amazonka.Glue.Types.Aggregate

Methods

rnf :: Aggregate -> () #

Eq Aggregate Source # 
Instance details

Defined in Amazonka.Glue.Types.Aggregate

Hashable Aggregate Source # 
Instance details

Defined in Amazonka.Glue.Types.Aggregate

type Rep Aggregate Source # 
Instance details

Defined in Amazonka.Glue.Types.Aggregate

type Rep Aggregate = D1 ('MetaData "Aggregate" "Amazonka.Glue.Types.Aggregate" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "Aggregate'" 'PrefixI 'True) ((S1 ('MetaSel ('Just "name") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text) :*: S1 ('MetaSel ('Just "inputs") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (NonEmpty Text))) :*: (S1 ('MetaSel ('Just "groups") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 [[Text]]) :*: S1 ('MetaSel ('Just "aggs") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (NonEmpty AggregateOperation)))))

newAggregate Source #

Create a value of Aggregate with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:name:Aggregate', aggregate_name - The name of the transform node.

$sel:inputs:Aggregate', aggregate_inputs - Specifies the fields and rows to use as inputs for the aggregate transform.

$sel:groups:Aggregate', aggregate_groups - Specifies the fields to group by.

$sel:aggs:Aggregate', aggregate_aggs - Specifies the aggregate functions to be performed on specified fields.

aggregate_name :: Lens' Aggregate Text Source #

The name of the transform node.

aggregate_inputs :: Lens' Aggregate (NonEmpty Text) Source #

Specifies the fields and rows to use as inputs for the aggregate transform.

aggregate_groups :: Lens' Aggregate [[Text]] Source #

Specifies the fields to group by.

aggregate_aggs :: Lens' Aggregate (NonEmpty AggregateOperation) Source #

Specifies the aggregate functions to be performed on specified fields.

AggregateOperation

data AggregateOperation Source #

Specifies the set of parameters needed to perform aggregation in the aggregate transform.

See: newAggregateOperation smart constructor.

Constructors

AggregateOperation' 

Fields

  • column :: [Text]

    Specifies the column on the data set on which the aggregation function will be applied.

  • aggFunc :: AggFunction

    Specifies the aggregation function to apply.

    Possible aggregation functions include: avg countDistinct, count, first, last, kurtosis, max, min, skewness, stddev_samp, stddev_pop, sum, sumDistinct, var_samp, var_pop

Instances

Instances details
FromJSON AggregateOperation Source # 
Instance details

Defined in Amazonka.Glue.Types.AggregateOperation

ToJSON AggregateOperation Source # 
Instance details

Defined in Amazonka.Glue.Types.AggregateOperation

Generic AggregateOperation Source # 
Instance details

Defined in Amazonka.Glue.Types.AggregateOperation

Associated Types

type Rep AggregateOperation :: Type -> Type #

Read AggregateOperation Source # 
Instance details

Defined in Amazonka.Glue.Types.AggregateOperation

Show AggregateOperation Source # 
Instance details

Defined in Amazonka.Glue.Types.AggregateOperation

NFData AggregateOperation Source # 
Instance details

Defined in Amazonka.Glue.Types.AggregateOperation

Methods

rnf :: AggregateOperation -> () #

Eq AggregateOperation Source # 
Instance details

Defined in Amazonka.Glue.Types.AggregateOperation

Hashable AggregateOperation Source # 
Instance details

Defined in Amazonka.Glue.Types.AggregateOperation

type Rep AggregateOperation Source # 
Instance details

Defined in Amazonka.Glue.Types.AggregateOperation

type Rep AggregateOperation = D1 ('MetaData "AggregateOperation" "Amazonka.Glue.Types.AggregateOperation" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "AggregateOperation'" 'PrefixI 'True) (S1 ('MetaSel ('Just "column") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 [Text]) :*: S1 ('MetaSel ('Just "aggFunc") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 AggFunction)))

newAggregateOperation Source #

Create a value of AggregateOperation with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:column:AggregateOperation', aggregateOperation_column - Specifies the column on the data set on which the aggregation function will be applied.

$sel:aggFunc:AggregateOperation', aggregateOperation_aggFunc - Specifies the aggregation function to apply.

Possible aggregation functions include: avg countDistinct, count, first, last, kurtosis, max, min, skewness, stddev_samp, stddev_pop, sum, sumDistinct, var_samp, var_pop

aggregateOperation_column :: Lens' AggregateOperation [Text] Source #

Specifies the column on the data set on which the aggregation function will be applied.

aggregateOperation_aggFunc :: Lens' AggregateOperation AggFunction Source #

Specifies the aggregation function to apply.

Possible aggregation functions include: avg countDistinct, count, first, last, kurtosis, max, min, skewness, stddev_samp, stddev_pop, sum, sumDistinct, var_samp, var_pop

ApplyMapping

data ApplyMapping Source #

Specifies a transform that maps data property keys in the data source to data property keys in the data target. You can rename keys, modify the data types for keys, and choose which keys to drop from the dataset.

See: newApplyMapping smart constructor.

Constructors

ApplyMapping' 

Fields

  • name :: Text

    The name of the transform node.

  • inputs :: NonEmpty Text

    The data inputs identified by their node names.

  • mapping :: [Mapping]

    Specifies the mapping of data property keys in the data source to data property keys in the data target.

Instances

Instances details
FromJSON ApplyMapping Source # 
Instance details

Defined in Amazonka.Glue.Types.ApplyMapping

ToJSON ApplyMapping Source # 
Instance details

Defined in Amazonka.Glue.Types.ApplyMapping

Generic ApplyMapping Source # 
Instance details

Defined in Amazonka.Glue.Types.ApplyMapping

Associated Types

type Rep ApplyMapping :: Type -> Type #

Read ApplyMapping Source # 
Instance details

Defined in Amazonka.Glue.Types.ApplyMapping

Show ApplyMapping Source # 
Instance details

Defined in Amazonka.Glue.Types.ApplyMapping

NFData ApplyMapping Source # 
Instance details

Defined in Amazonka.Glue.Types.ApplyMapping

Methods

rnf :: ApplyMapping -> () #

Eq ApplyMapping Source # 
Instance details

Defined in Amazonka.Glue.Types.ApplyMapping

Hashable ApplyMapping Source # 
Instance details

Defined in Amazonka.Glue.Types.ApplyMapping

type Rep ApplyMapping Source # 
Instance details

Defined in Amazonka.Glue.Types.ApplyMapping

type Rep ApplyMapping = D1 ('MetaData "ApplyMapping" "Amazonka.Glue.Types.ApplyMapping" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "ApplyMapping'" 'PrefixI 'True) (S1 ('MetaSel ('Just "name") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text) :*: (S1 ('MetaSel ('Just "inputs") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (NonEmpty Text)) :*: S1 ('MetaSel ('Just "mapping") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 [Mapping]))))

newApplyMapping Source #

Create a value of ApplyMapping with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:name:ApplyMapping', applyMapping_name - The name of the transform node.

$sel:inputs:ApplyMapping', applyMapping_inputs - The data inputs identified by their node names.

$sel:mapping:ApplyMapping', applyMapping_mapping - Specifies the mapping of data property keys in the data source to data property keys in the data target.

applyMapping_name :: Lens' ApplyMapping Text Source #

The name of the transform node.

applyMapping_inputs :: Lens' ApplyMapping (NonEmpty Text) Source #

The data inputs identified by their node names.

applyMapping_mapping :: Lens' ApplyMapping [Mapping] Source #

Specifies the mapping of data property keys in the data source to data property keys in the data target.

AthenaConnectorSource

data AthenaConnectorSource Source #

Specifies a connector to an Amazon Athena data source.

See: newAthenaConnectorSource smart constructor.

Constructors

AthenaConnectorSource' 

Fields

  • connectionTable :: Maybe Text

    The name of the table in the data source.

  • outputSchemas :: Maybe [GlueSchema]

    Specifies the data schema for the custom Athena source.

  • name :: Text

    The name of the data source.

  • connectionName :: Text

    The name of the connection that is associated with the connector.

  • connectorName :: Text

    The name of a connector that assists with accessing the data store in Glue Studio.

  • connectionType :: Text

    The type of connection, such as marketplace.athena or custom.athena, designating a connection to an Amazon Athena data store.

  • schemaName :: Text

    The name of the Cloudwatch log group to read from. For example, /aws-glue/jobs/output.

Instances

Instances details
FromJSON AthenaConnectorSource Source # 
Instance details

Defined in Amazonka.Glue.Types.AthenaConnectorSource

ToJSON AthenaConnectorSource Source # 
Instance details

Defined in Amazonka.Glue.Types.AthenaConnectorSource

Generic AthenaConnectorSource Source # 
Instance details

Defined in Amazonka.Glue.Types.AthenaConnectorSource

Associated Types

type Rep AthenaConnectorSource :: Type -> Type #

Read AthenaConnectorSource Source # 
Instance details

Defined in Amazonka.Glue.Types.AthenaConnectorSource

Show AthenaConnectorSource Source # 
Instance details

Defined in Amazonka.Glue.Types.AthenaConnectorSource

NFData AthenaConnectorSource Source # 
Instance details

Defined in Amazonka.Glue.Types.AthenaConnectorSource

Methods

rnf :: AthenaConnectorSource -> () #

Eq AthenaConnectorSource Source # 
Instance details

Defined in Amazonka.Glue.Types.AthenaConnectorSource

Hashable AthenaConnectorSource Source # 
Instance details

Defined in Amazonka.Glue.Types.AthenaConnectorSource

type Rep AthenaConnectorSource Source # 
Instance details

Defined in Amazonka.Glue.Types.AthenaConnectorSource

type Rep AthenaConnectorSource = D1 ('MetaData "AthenaConnectorSource" "Amazonka.Glue.Types.AthenaConnectorSource" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "AthenaConnectorSource'" 'PrefixI 'True) ((S1 ('MetaSel ('Just "connectionTable") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: (S1 ('MetaSel ('Just "outputSchemas") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe [GlueSchema])) :*: S1 ('MetaSel ('Just "name") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text))) :*: ((S1 ('MetaSel ('Just "connectionName") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text) :*: S1 ('MetaSel ('Just "connectorName") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text)) :*: (S1 ('MetaSel ('Just "connectionType") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text) :*: S1 ('MetaSel ('Just "schemaName") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text)))))

newAthenaConnectorSource Source #

Create a value of AthenaConnectorSource with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:connectionTable:AthenaConnectorSource', athenaConnectorSource_connectionTable - The name of the table in the data source.

$sel:outputSchemas:AthenaConnectorSource', athenaConnectorSource_outputSchemas - Specifies the data schema for the custom Athena source.

$sel:name:AthenaConnectorSource', athenaConnectorSource_name - The name of the data source.

$sel:connectionName:AthenaConnectorSource', athenaConnectorSource_connectionName - The name of the connection that is associated with the connector.

$sel:connectorName:AthenaConnectorSource', athenaConnectorSource_connectorName - The name of a connector that assists with accessing the data store in Glue Studio.

$sel:connectionType:AthenaConnectorSource', athenaConnectorSource_connectionType - The type of connection, such as marketplace.athena or custom.athena, designating a connection to an Amazon Athena data store.

$sel:schemaName:AthenaConnectorSource', athenaConnectorSource_schemaName - The name of the Cloudwatch log group to read from. For example, /aws-glue/jobs/output.

athenaConnectorSource_outputSchemas :: Lens' AthenaConnectorSource (Maybe [GlueSchema]) Source #

Specifies the data schema for the custom Athena source.

athenaConnectorSource_connectionName :: Lens' AthenaConnectorSource Text Source #

The name of the connection that is associated with the connector.

athenaConnectorSource_connectorName :: Lens' AthenaConnectorSource Text Source #

The name of a connector that assists with accessing the data store in Glue Studio.

athenaConnectorSource_connectionType :: Lens' AthenaConnectorSource Text Source #

The type of connection, such as marketplace.athena or custom.athena, designating a connection to an Amazon Athena data store.

athenaConnectorSource_schemaName :: Lens' AthenaConnectorSource Text Source #

The name of the Cloudwatch log group to read from. For example, /aws-glue/jobs/output.

AuditContext

data AuditContext Source #

A structure containing information for audit.

See: newAuditContext smart constructor.

Constructors

AuditContext' 

Fields

Instances

Instances details
ToJSON AuditContext Source # 
Instance details

Defined in Amazonka.Glue.Types.AuditContext

Generic AuditContext Source # 
Instance details

Defined in Amazonka.Glue.Types.AuditContext

Associated Types

type Rep AuditContext :: Type -> Type #

Read AuditContext Source # 
Instance details

Defined in Amazonka.Glue.Types.AuditContext

Show AuditContext Source # 
Instance details

Defined in Amazonka.Glue.Types.AuditContext

NFData AuditContext Source # 
Instance details

Defined in Amazonka.Glue.Types.AuditContext

Methods

rnf :: AuditContext -> () #

Eq AuditContext Source # 
Instance details

Defined in Amazonka.Glue.Types.AuditContext

Hashable AuditContext Source # 
Instance details

Defined in Amazonka.Glue.Types.AuditContext

type Rep AuditContext Source # 
Instance details

Defined in Amazonka.Glue.Types.AuditContext

type Rep AuditContext = D1 ('MetaData "AuditContext" "Amazonka.Glue.Types.AuditContext" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "AuditContext'" 'PrefixI 'True) (S1 ('MetaSel ('Just "additionalAuditContext") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: (S1 ('MetaSel ('Just "allColumnsRequested") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Bool)) :*: S1 ('MetaSel ('Just "requestedColumns") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe [Text])))))

newAuditContext :: AuditContext Source #

Create a value of AuditContext with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:additionalAuditContext:AuditContext', auditContext_additionalAuditContext - The context for the audit..

$sel:allColumnsRequested:AuditContext', auditContext_allColumnsRequested - All columns request for audit.

$sel:requestedColumns:AuditContext', auditContext_requestedColumns - The requested columns for audit.

auditContext_requestedColumns :: Lens' AuditContext (Maybe [Text]) Source #

The requested columns for audit.

BackfillError

data BackfillError Source #

A list of errors that can occur when registering partition indexes for an existing table.

These errors give the details about why an index registration failed and provide a limited number of partitions in the response, so that you can fix the partitions at fault and try registering the index again. The most common set of errors that can occur are categorized as follows:

  • EncryptedPartitionError: The partitions are encrypted.
  • InvalidPartitionTypeDataError: The partition value doesn't match the data type for that partition column.
  • MissingPartitionValueError: The partitions are encrypted.
  • UnsupportedPartitionCharacterError: Characters inside the partition value are not supported. For example: U+0000 , U+0001, U+0002.
  • InternalError: Any error which does not belong to other error codes.

See: newBackfillError smart constructor.

Constructors

BackfillError' 

Fields

Instances

Instances details
FromJSON BackfillError Source # 
Instance details

Defined in Amazonka.Glue.Types.BackfillError

Generic BackfillError Source # 
Instance details

Defined in Amazonka.Glue.Types.BackfillError

Associated Types

type Rep BackfillError :: Type -> Type #

Read BackfillError Source # 
Instance details

Defined in Amazonka.Glue.Types.BackfillError

Show BackfillError Source # 
Instance details

Defined in Amazonka.Glue.Types.BackfillError

NFData BackfillError Source # 
Instance details

Defined in Amazonka.Glue.Types.BackfillError

Methods

rnf :: BackfillError -> () #

Eq BackfillError Source # 
Instance details

Defined in Amazonka.Glue.Types.BackfillError

Hashable BackfillError Source # 
Instance details

Defined in Amazonka.Glue.Types.BackfillError

type Rep BackfillError Source # 
Instance details

Defined in Amazonka.Glue.Types.BackfillError

type Rep BackfillError = D1 ('MetaData "BackfillError" "Amazonka.Glue.Types.BackfillError" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "BackfillError'" 'PrefixI 'True) (S1 ('MetaSel ('Just "code") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe BackfillErrorCode)) :*: S1 ('MetaSel ('Just "partitions") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe [PartitionValueList]))))

newBackfillError :: BackfillError Source #

Create a value of BackfillError with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:code:BackfillError', backfillError_code - The error code for an error that occurred when registering partition indexes for an existing table.

$sel:partitions:BackfillError', backfillError_partitions - A list of a limited number of partitions in the response.

backfillError_code :: Lens' BackfillError (Maybe BackfillErrorCode) Source #

The error code for an error that occurred when registering partition indexes for an existing table.

backfillError_partitions :: Lens' BackfillError (Maybe [PartitionValueList]) Source #

A list of a limited number of partitions in the response.

BasicCatalogTarget

data BasicCatalogTarget Source #

Specifies a target that uses a Glue Data Catalog table.

See: newBasicCatalogTarget smart constructor.

Constructors

BasicCatalogTarget' 

Fields

  • name :: Text

    The name of your data target.

  • inputs :: NonEmpty Text

    The nodes that are inputs to the data target.

  • database :: Text

    The database that contains the table you want to use as the target. This database must already exist in the Data Catalog.

  • table :: Text

    The table that defines the schema of your output data. This table must already exist in the Data Catalog.

Instances

Instances details
FromJSON BasicCatalogTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.BasicCatalogTarget

ToJSON BasicCatalogTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.BasicCatalogTarget

Generic BasicCatalogTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.BasicCatalogTarget

Associated Types

type Rep BasicCatalogTarget :: Type -> Type #

Read BasicCatalogTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.BasicCatalogTarget

Show BasicCatalogTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.BasicCatalogTarget

NFData BasicCatalogTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.BasicCatalogTarget

Methods

rnf :: BasicCatalogTarget -> () #

Eq BasicCatalogTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.BasicCatalogTarget

Hashable BasicCatalogTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.BasicCatalogTarget

type Rep BasicCatalogTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.BasicCatalogTarget

type Rep BasicCatalogTarget = D1 ('MetaData "BasicCatalogTarget" "Amazonka.Glue.Types.BasicCatalogTarget" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "BasicCatalogTarget'" 'PrefixI 'True) ((S1 ('MetaSel ('Just "name") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text) :*: S1 ('MetaSel ('Just "inputs") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (NonEmpty Text))) :*: (S1 ('MetaSel ('Just "database") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text) :*: S1 ('MetaSel ('Just "table") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text))))

newBasicCatalogTarget Source #

Create a value of BasicCatalogTarget with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:name:BasicCatalogTarget', basicCatalogTarget_name - The name of your data target.

$sel:inputs:BasicCatalogTarget', basicCatalogTarget_inputs - The nodes that are inputs to the data target.

$sel:database:BasicCatalogTarget', basicCatalogTarget_database - The database that contains the table you want to use as the target. This database must already exist in the Data Catalog.

$sel:table:BasicCatalogTarget', basicCatalogTarget_table - The table that defines the schema of your output data. This table must already exist in the Data Catalog.

basicCatalogTarget_inputs :: Lens' BasicCatalogTarget (NonEmpty Text) Source #

The nodes that are inputs to the data target.

basicCatalogTarget_database :: Lens' BasicCatalogTarget Text Source #

The database that contains the table you want to use as the target. This database must already exist in the Data Catalog.

basicCatalogTarget_table :: Lens' BasicCatalogTarget Text Source #

The table that defines the schema of your output data. This table must already exist in the Data Catalog.

BatchStopJobRunError

data BatchStopJobRunError Source #

Records an error that occurred when attempting to stop a specified job run.

See: newBatchStopJobRunError smart constructor.

Constructors

BatchStopJobRunError' 

Fields

Instances

Instances details
FromJSON BatchStopJobRunError Source # 
Instance details

Defined in Amazonka.Glue.Types.BatchStopJobRunError

Generic BatchStopJobRunError Source # 
Instance details

Defined in Amazonka.Glue.Types.BatchStopJobRunError

Associated Types

type Rep BatchStopJobRunError :: Type -> Type #

Read BatchStopJobRunError Source # 
Instance details

Defined in Amazonka.Glue.Types.BatchStopJobRunError

Show BatchStopJobRunError Source # 
Instance details

Defined in Amazonka.Glue.Types.BatchStopJobRunError

NFData BatchStopJobRunError Source # 
Instance details

Defined in Amazonka.Glue.Types.BatchStopJobRunError

Methods

rnf :: BatchStopJobRunError -> () #

Eq BatchStopJobRunError Source # 
Instance details

Defined in Amazonka.Glue.Types.BatchStopJobRunError

Hashable BatchStopJobRunError Source # 
Instance details

Defined in Amazonka.Glue.Types.BatchStopJobRunError

type Rep BatchStopJobRunError Source # 
Instance details

Defined in Amazonka.Glue.Types.BatchStopJobRunError

type Rep BatchStopJobRunError = D1 ('MetaData "BatchStopJobRunError" "Amazonka.Glue.Types.BatchStopJobRunError" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "BatchStopJobRunError'" 'PrefixI 'True) (S1 ('MetaSel ('Just "errorDetail") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe ErrorDetail)) :*: (S1 ('MetaSel ('Just "jobName") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "jobRunId") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)))))

newBatchStopJobRunError :: BatchStopJobRunError Source #

Create a value of BatchStopJobRunError with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:errorDetail:BatchStopJobRunError', batchStopJobRunError_errorDetail - Specifies details about the error that was encountered.

$sel:jobName:BatchStopJobRunError', batchStopJobRunError_jobName - The name of the job definition that is used in the job run in question.

$sel:jobRunId:BatchStopJobRunError', batchStopJobRunError_jobRunId - The JobRunId of the job run in question.

batchStopJobRunError_errorDetail :: Lens' BatchStopJobRunError (Maybe ErrorDetail) Source #

Specifies details about the error that was encountered.

batchStopJobRunError_jobName :: Lens' BatchStopJobRunError (Maybe Text) Source #

The name of the job definition that is used in the job run in question.

batchStopJobRunError_jobRunId :: Lens' BatchStopJobRunError (Maybe Text) Source #

The JobRunId of the job run in question.

BatchStopJobRunSuccessfulSubmission

data BatchStopJobRunSuccessfulSubmission Source #

Records a successful request to stop a specified JobRun.

See: newBatchStopJobRunSuccessfulSubmission smart constructor.

Constructors

BatchStopJobRunSuccessfulSubmission' 

Fields

Instances

Instances details
FromJSON BatchStopJobRunSuccessfulSubmission Source # 
Instance details

Defined in Amazonka.Glue.Types.BatchStopJobRunSuccessfulSubmission

Generic BatchStopJobRunSuccessfulSubmission Source # 
Instance details

Defined in Amazonka.Glue.Types.BatchStopJobRunSuccessfulSubmission

Read BatchStopJobRunSuccessfulSubmission Source # 
Instance details

Defined in Amazonka.Glue.Types.BatchStopJobRunSuccessfulSubmission

Show BatchStopJobRunSuccessfulSubmission Source # 
Instance details

Defined in Amazonka.Glue.Types.BatchStopJobRunSuccessfulSubmission

NFData BatchStopJobRunSuccessfulSubmission Source # 
Instance details

Defined in Amazonka.Glue.Types.BatchStopJobRunSuccessfulSubmission

Eq BatchStopJobRunSuccessfulSubmission Source # 
Instance details

Defined in Amazonka.Glue.Types.BatchStopJobRunSuccessfulSubmission

Hashable BatchStopJobRunSuccessfulSubmission Source # 
Instance details

Defined in Amazonka.Glue.Types.BatchStopJobRunSuccessfulSubmission

type Rep BatchStopJobRunSuccessfulSubmission Source # 
Instance details

Defined in Amazonka.Glue.Types.BatchStopJobRunSuccessfulSubmission

type Rep BatchStopJobRunSuccessfulSubmission = D1 ('MetaData "BatchStopJobRunSuccessfulSubmission" "Amazonka.Glue.Types.BatchStopJobRunSuccessfulSubmission" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "BatchStopJobRunSuccessfulSubmission'" 'PrefixI 'True) (S1 ('MetaSel ('Just "jobName") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "jobRunId") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text))))

newBatchStopJobRunSuccessfulSubmission :: BatchStopJobRunSuccessfulSubmission Source #

Create a value of BatchStopJobRunSuccessfulSubmission with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:jobName:BatchStopJobRunSuccessfulSubmission', batchStopJobRunSuccessfulSubmission_jobName - The name of the job definition used in the job run that was stopped.

$sel:jobRunId:BatchStopJobRunSuccessfulSubmission', batchStopJobRunSuccessfulSubmission_jobRunId - The JobRunId of the job run that was stopped.

batchStopJobRunSuccessfulSubmission_jobName :: Lens' BatchStopJobRunSuccessfulSubmission (Maybe Text) Source #

The name of the job definition used in the job run that was stopped.

BatchUpdatePartitionFailureEntry

data BatchUpdatePartitionFailureEntry Source #

Contains information about a batch update partition error.

See: newBatchUpdatePartitionFailureEntry smart constructor.

Constructors

BatchUpdatePartitionFailureEntry' 

Fields

Instances

Instances details
FromJSON BatchUpdatePartitionFailureEntry Source # 
Instance details

Defined in Amazonka.Glue.Types.BatchUpdatePartitionFailureEntry

Generic BatchUpdatePartitionFailureEntry Source # 
Instance details

Defined in Amazonka.Glue.Types.BatchUpdatePartitionFailureEntry

Associated Types

type Rep BatchUpdatePartitionFailureEntry :: Type -> Type #

Read BatchUpdatePartitionFailureEntry Source # 
Instance details

Defined in Amazonka.Glue.Types.BatchUpdatePartitionFailureEntry

Show BatchUpdatePartitionFailureEntry Source # 
Instance details

Defined in Amazonka.Glue.Types.BatchUpdatePartitionFailureEntry

NFData BatchUpdatePartitionFailureEntry Source # 
Instance details

Defined in Amazonka.Glue.Types.BatchUpdatePartitionFailureEntry

Eq BatchUpdatePartitionFailureEntry Source # 
Instance details

Defined in Amazonka.Glue.Types.BatchUpdatePartitionFailureEntry

Hashable BatchUpdatePartitionFailureEntry Source # 
Instance details

Defined in Amazonka.Glue.Types.BatchUpdatePartitionFailureEntry

type Rep BatchUpdatePartitionFailureEntry Source # 
Instance details

Defined in Amazonka.Glue.Types.BatchUpdatePartitionFailureEntry

type Rep BatchUpdatePartitionFailureEntry = D1 ('MetaData "BatchUpdatePartitionFailureEntry" "Amazonka.Glue.Types.BatchUpdatePartitionFailureEntry" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "BatchUpdatePartitionFailureEntry'" 'PrefixI 'True) (S1 ('MetaSel ('Just "errorDetail") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe ErrorDetail)) :*: S1 ('MetaSel ('Just "partitionValueList") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe [Text]))))

newBatchUpdatePartitionFailureEntry :: BatchUpdatePartitionFailureEntry Source #

Create a value of BatchUpdatePartitionFailureEntry with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:errorDetail:BatchUpdatePartitionFailureEntry', batchUpdatePartitionFailureEntry_errorDetail - The details about the batch update partition error.

$sel:partitionValueList:BatchUpdatePartitionFailureEntry', batchUpdatePartitionFailureEntry_partitionValueList - A list of values defining the partitions.

BatchUpdatePartitionRequestEntry

data BatchUpdatePartitionRequestEntry Source #

A structure that contains the values and structure used to update a partition.

See: newBatchUpdatePartitionRequestEntry smart constructor.

Constructors

BatchUpdatePartitionRequestEntry' 

Fields

Instances

Instances details
ToJSON BatchUpdatePartitionRequestEntry Source # 
Instance details

Defined in Amazonka.Glue.Types.BatchUpdatePartitionRequestEntry

Generic BatchUpdatePartitionRequestEntry Source # 
Instance details

Defined in Amazonka.Glue.Types.BatchUpdatePartitionRequestEntry

Associated Types

type Rep BatchUpdatePartitionRequestEntry :: Type -> Type #

Read BatchUpdatePartitionRequestEntry Source # 
Instance details

Defined in Amazonka.Glue.Types.BatchUpdatePartitionRequestEntry

Show BatchUpdatePartitionRequestEntry Source # 
Instance details

Defined in Amazonka.Glue.Types.BatchUpdatePartitionRequestEntry

NFData BatchUpdatePartitionRequestEntry Source # 
Instance details

Defined in Amazonka.Glue.Types.BatchUpdatePartitionRequestEntry

Eq BatchUpdatePartitionRequestEntry Source # 
Instance details

Defined in Amazonka.Glue.Types.BatchUpdatePartitionRequestEntry

Hashable BatchUpdatePartitionRequestEntry Source # 
Instance details

Defined in Amazonka.Glue.Types.BatchUpdatePartitionRequestEntry

type Rep BatchUpdatePartitionRequestEntry Source # 
Instance details

Defined in Amazonka.Glue.Types.BatchUpdatePartitionRequestEntry

type Rep BatchUpdatePartitionRequestEntry = D1 ('MetaData "BatchUpdatePartitionRequestEntry" "Amazonka.Glue.Types.BatchUpdatePartitionRequestEntry" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "BatchUpdatePartitionRequestEntry'" 'PrefixI 'True) (S1 ('MetaSel ('Just "partitionValueList") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 [Text]) :*: S1 ('MetaSel ('Just "partitionInput") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 PartitionInput)))

newBatchUpdatePartitionRequestEntry Source #

Create a value of BatchUpdatePartitionRequestEntry with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:partitionValueList:BatchUpdatePartitionRequestEntry', batchUpdatePartitionRequestEntry_partitionValueList - A list of values defining the partitions.

$sel:partitionInput:BatchUpdatePartitionRequestEntry', batchUpdatePartitionRequestEntry_partitionInput - The structure used to update a partition.

BinaryColumnStatisticsData

data BinaryColumnStatisticsData Source #

Defines column statistics supported for bit sequence data values.

See: newBinaryColumnStatisticsData smart constructor.

Constructors

BinaryColumnStatisticsData' 

Fields

Instances

Instances details
FromJSON BinaryColumnStatisticsData Source # 
Instance details

Defined in Amazonka.Glue.Types.BinaryColumnStatisticsData

ToJSON BinaryColumnStatisticsData Source # 
Instance details

Defined in Amazonka.Glue.Types.BinaryColumnStatisticsData

Generic BinaryColumnStatisticsData Source # 
Instance details

Defined in Amazonka.Glue.Types.BinaryColumnStatisticsData

Associated Types

type Rep BinaryColumnStatisticsData :: Type -> Type #

Read BinaryColumnStatisticsData Source # 
Instance details

Defined in Amazonka.Glue.Types.BinaryColumnStatisticsData

Show BinaryColumnStatisticsData Source # 
Instance details

Defined in Amazonka.Glue.Types.BinaryColumnStatisticsData

NFData BinaryColumnStatisticsData Source # 
Instance details

Defined in Amazonka.Glue.Types.BinaryColumnStatisticsData

Eq BinaryColumnStatisticsData Source # 
Instance details

Defined in Amazonka.Glue.Types.BinaryColumnStatisticsData

Hashable BinaryColumnStatisticsData Source # 
Instance details

Defined in Amazonka.Glue.Types.BinaryColumnStatisticsData

type Rep BinaryColumnStatisticsData Source # 
Instance details

Defined in Amazonka.Glue.Types.BinaryColumnStatisticsData

type Rep BinaryColumnStatisticsData = D1 ('MetaData "BinaryColumnStatisticsData" "Amazonka.Glue.Types.BinaryColumnStatisticsData" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "BinaryColumnStatisticsData'" 'PrefixI 'True) (S1 ('MetaSel ('Just "maximumLength") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Natural) :*: (S1 ('MetaSel ('Just "averageLength") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Double) :*: S1 ('MetaSel ('Just "numberOfNulls") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Natural))))

newBinaryColumnStatisticsData Source #

Create a value of BinaryColumnStatisticsData with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:maximumLength:BinaryColumnStatisticsData', binaryColumnStatisticsData_maximumLength - The size of the longest bit sequence in the column.

$sel:averageLength:BinaryColumnStatisticsData', binaryColumnStatisticsData_averageLength - The average bit sequence length in the column.

$sel:numberOfNulls:BinaryColumnStatisticsData', binaryColumnStatisticsData_numberOfNulls - The number of null values in the column.

binaryColumnStatisticsData_maximumLength :: Lens' BinaryColumnStatisticsData Natural Source #

The size of the longest bit sequence in the column.

Blueprint

data Blueprint Source #

The details of a blueprint.

See: newBlueprint smart constructor.

Constructors

Blueprint' 

Fields

Instances

Instances details
FromJSON Blueprint Source # 
Instance details

Defined in Amazonka.Glue.Types.Blueprint

Generic Blueprint Source # 
Instance details

Defined in Amazonka.Glue.Types.Blueprint

Associated Types

type Rep Blueprint :: Type -> Type #

Read Blueprint Source # 
Instance details

Defined in Amazonka.Glue.Types.Blueprint

Show Blueprint Source # 
Instance details

Defined in Amazonka.Glue.Types.Blueprint

NFData Blueprint Source # 
Instance details

Defined in Amazonka.Glue.Types.Blueprint

Methods

rnf :: Blueprint -> () #

Eq Blueprint Source # 
Instance details

Defined in Amazonka.Glue.Types.Blueprint

Hashable Blueprint Source # 
Instance details

Defined in Amazonka.Glue.Types.Blueprint

type Rep Blueprint Source # 
Instance details

Defined in Amazonka.Glue.Types.Blueprint

newBlueprint :: Blueprint Source #

Create a value of Blueprint with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

Blueprint, blueprint_blueprintLocation - Specifies the path in Amazon S3 where the blueprint is published.

Blueprint, blueprint_blueprintServiceLocation - Specifies a path in Amazon S3 where the blueprint is copied when you call CreateBlueprint/UpdateBlueprint to register the blueprint in Glue.

$sel:createdOn:Blueprint', blueprint_createdOn - The date and time the blueprint was registered.

Blueprint, blueprint_description - The description of the blueprint.

$sel:errorMessage:Blueprint', blueprint_errorMessage - An error message.

$sel:lastActiveDefinition:Blueprint', blueprint_lastActiveDefinition - When there are multiple versions of a blueprint and the latest version has some errors, this attribute indicates the last successful blueprint definition that is available with the service.

Blueprint, blueprint_lastModifiedOn - The date and time the blueprint was last modified.

$sel:name:Blueprint', blueprint_name - The name of the blueprint.

Blueprint, blueprint_parameterSpec - A JSON string that indicates the list of parameter specifications for the blueprint.

$sel:status:Blueprint', blueprint_status - The status of the blueprint registration.

  • Creating — The blueprint registration is in progress.
  • Active — The blueprint has been successfully registered.
  • Updating — An update to the blueprint registration is in progress.
  • Failed — The blueprint registration failed.

blueprint_blueprintLocation :: Lens' Blueprint (Maybe Text) Source #

Specifies the path in Amazon S3 where the blueprint is published.

blueprint_blueprintServiceLocation :: Lens' Blueprint (Maybe Text) Source #

Specifies a path in Amazon S3 where the blueprint is copied when you call CreateBlueprint/UpdateBlueprint to register the blueprint in Glue.

blueprint_createdOn :: Lens' Blueprint (Maybe UTCTime) Source #

The date and time the blueprint was registered.

blueprint_description :: Lens' Blueprint (Maybe Text) Source #

The description of the blueprint.

blueprint_lastActiveDefinition :: Lens' Blueprint (Maybe LastActiveDefinition) Source #

When there are multiple versions of a blueprint and the latest version has some errors, this attribute indicates the last successful blueprint definition that is available with the service.

blueprint_lastModifiedOn :: Lens' Blueprint (Maybe UTCTime) Source #

The date and time the blueprint was last modified.

blueprint_name :: Lens' Blueprint (Maybe Text) Source #

The name of the blueprint.

blueprint_parameterSpec :: Lens' Blueprint (Maybe Text) Source #

A JSON string that indicates the list of parameter specifications for the blueprint.

blueprint_status :: Lens' Blueprint (Maybe BlueprintStatus) Source #

The status of the blueprint registration.

  • Creating — The blueprint registration is in progress.
  • Active — The blueprint has been successfully registered.
  • Updating — An update to the blueprint registration is in progress.
  • Failed — The blueprint registration failed.

BlueprintDetails

data BlueprintDetails Source #

The details of a blueprint.

See: newBlueprintDetails smart constructor.

Constructors

BlueprintDetails' 

Fields

Instances

Instances details
FromJSON BlueprintDetails Source # 
Instance details

Defined in Amazonka.Glue.Types.BlueprintDetails

Generic BlueprintDetails Source # 
Instance details

Defined in Amazonka.Glue.Types.BlueprintDetails

Associated Types

type Rep BlueprintDetails :: Type -> Type #

Read BlueprintDetails Source # 
Instance details

Defined in Amazonka.Glue.Types.BlueprintDetails

Show BlueprintDetails Source # 
Instance details

Defined in Amazonka.Glue.Types.BlueprintDetails

NFData BlueprintDetails Source # 
Instance details

Defined in Amazonka.Glue.Types.BlueprintDetails

Methods

rnf :: BlueprintDetails -> () #

Eq BlueprintDetails Source # 
Instance details

Defined in Amazonka.Glue.Types.BlueprintDetails

Hashable BlueprintDetails Source # 
Instance details

Defined in Amazonka.Glue.Types.BlueprintDetails

type Rep BlueprintDetails Source # 
Instance details

Defined in Amazonka.Glue.Types.BlueprintDetails

type Rep BlueprintDetails = D1 ('MetaData "BlueprintDetails" "Amazonka.Glue.Types.BlueprintDetails" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "BlueprintDetails'" 'PrefixI 'True) (S1 ('MetaSel ('Just "blueprintName") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "runId") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text))))

newBlueprintDetails :: BlueprintDetails Source #

Create a value of BlueprintDetails with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:blueprintName:BlueprintDetails', blueprintDetails_blueprintName - The name of the blueprint.

$sel:runId:BlueprintDetails', blueprintDetails_runId - The run ID for this blueprint.

blueprintDetails_runId :: Lens' BlueprintDetails (Maybe Text) Source #

The run ID for this blueprint.

BlueprintRun

data BlueprintRun Source #

The details of a blueprint run.

See: newBlueprintRun smart constructor.

Constructors

BlueprintRun' 

Fields

  • blueprintName :: Maybe Text

    The name of the blueprint.

  • completedOn :: Maybe POSIX

    The date and time that the blueprint run completed.

  • errorMessage :: Maybe Text

    Indicates any errors that are seen while running the blueprint.

  • parameters :: Maybe Text

    The blueprint parameters as a string. You will have to provide a value for each key that is required from the parameter spec that is defined in the Blueprint$ParameterSpec.

  • roleArn :: Maybe Text

    The role ARN. This role will be assumed by the Glue service and will be used to create the workflow and other entities of a workflow.

  • rollbackErrorMessage :: Maybe Text

    If there are any errors while creating the entities of a workflow, we try to roll back the created entities until that point and delete them. This attribute indicates the errors seen while trying to delete the entities that are created.

  • runId :: Maybe Text

    The run ID for this blueprint run.

  • startedOn :: Maybe POSIX

    The date and time that the blueprint run started.

  • state :: Maybe BlueprintRunState

    The state of the blueprint run. Possible values are:

    • Running — The blueprint run is in progress.
    • Succeeded — The blueprint run completed successfully.
    • Failed — The blueprint run failed and rollback is complete.
    • Rolling Back — The blueprint run failed and rollback is in progress.
  • workflowName :: Maybe Text

    The name of a workflow that is created as a result of a successful blueprint run. If a blueprint run has an error, there will not be a workflow created.

Instances

Instances details
FromJSON BlueprintRun Source # 
Instance details

Defined in Amazonka.Glue.Types.BlueprintRun

Generic BlueprintRun Source # 
Instance details

Defined in Amazonka.Glue.Types.BlueprintRun

Associated Types

type Rep BlueprintRun :: Type -> Type #

Read BlueprintRun Source # 
Instance details

Defined in Amazonka.Glue.Types.BlueprintRun

Show BlueprintRun Source # 
Instance details

Defined in Amazonka.Glue.Types.BlueprintRun

NFData BlueprintRun Source # 
Instance details

Defined in Amazonka.Glue.Types.BlueprintRun

Methods

rnf :: BlueprintRun -> () #

Eq BlueprintRun Source # 
Instance details

Defined in Amazonka.Glue.Types.BlueprintRun

Hashable BlueprintRun Source # 
Instance details

Defined in Amazonka.Glue.Types.BlueprintRun

type Rep BlueprintRun Source # 
Instance details

Defined in Amazonka.Glue.Types.BlueprintRun

newBlueprintRun :: BlueprintRun Source #

Create a value of BlueprintRun with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:blueprintName:BlueprintRun', blueprintRun_blueprintName - The name of the blueprint.

$sel:completedOn:BlueprintRun', blueprintRun_completedOn - The date and time that the blueprint run completed.

$sel:errorMessage:BlueprintRun', blueprintRun_errorMessage - Indicates any errors that are seen while running the blueprint.

$sel:parameters:BlueprintRun', blueprintRun_parameters - The blueprint parameters as a string. You will have to provide a value for each key that is required from the parameter spec that is defined in the Blueprint$ParameterSpec.

$sel:roleArn:BlueprintRun', blueprintRun_roleArn - The role ARN. This role will be assumed by the Glue service and will be used to create the workflow and other entities of a workflow.

$sel:rollbackErrorMessage:BlueprintRun', blueprintRun_rollbackErrorMessage - If there are any errors while creating the entities of a workflow, we try to roll back the created entities until that point and delete them. This attribute indicates the errors seen while trying to delete the entities that are created.

$sel:runId:BlueprintRun', blueprintRun_runId - The run ID for this blueprint run.

$sel:startedOn:BlueprintRun', blueprintRun_startedOn - The date and time that the blueprint run started.

$sel:state:BlueprintRun', blueprintRun_state - The state of the blueprint run. Possible values are:

  • Running — The blueprint run is in progress.
  • Succeeded — The blueprint run completed successfully.
  • Failed — The blueprint run failed and rollback is complete.
  • Rolling Back — The blueprint run failed and rollback is in progress.

$sel:workflowName:BlueprintRun', blueprintRun_workflowName - The name of a workflow that is created as a result of a successful blueprint run. If a blueprint run has an error, there will not be a workflow created.

blueprintRun_completedOn :: Lens' BlueprintRun (Maybe UTCTime) Source #

The date and time that the blueprint run completed.

blueprintRun_errorMessage :: Lens' BlueprintRun (Maybe Text) Source #

Indicates any errors that are seen while running the blueprint.

blueprintRun_parameters :: Lens' BlueprintRun (Maybe Text) Source #

The blueprint parameters as a string. You will have to provide a value for each key that is required from the parameter spec that is defined in the Blueprint$ParameterSpec.

blueprintRun_roleArn :: Lens' BlueprintRun (Maybe Text) Source #

The role ARN. This role will be assumed by the Glue service and will be used to create the workflow and other entities of a workflow.

blueprintRun_rollbackErrorMessage :: Lens' BlueprintRun (Maybe Text) Source #

If there are any errors while creating the entities of a workflow, we try to roll back the created entities until that point and delete them. This attribute indicates the errors seen while trying to delete the entities that are created.

blueprintRun_runId :: Lens' BlueprintRun (Maybe Text) Source #

The run ID for this blueprint run.

blueprintRun_startedOn :: Lens' BlueprintRun (Maybe UTCTime) Source #

The date and time that the blueprint run started.

blueprintRun_state :: Lens' BlueprintRun (Maybe BlueprintRunState) Source #

The state of the blueprint run. Possible values are:

  • Running — The blueprint run is in progress.
  • Succeeded — The blueprint run completed successfully.
  • Failed — The blueprint run failed and rollback is complete.
  • Rolling Back — The blueprint run failed and rollback is in progress.

blueprintRun_workflowName :: Lens' BlueprintRun (Maybe Text) Source #

The name of a workflow that is created as a result of a successful blueprint run. If a blueprint run has an error, there will not be a workflow created.

BooleanColumnStatisticsData

data BooleanColumnStatisticsData Source #

Defines column statistics supported for Boolean data columns.

See: newBooleanColumnStatisticsData smart constructor.

Constructors

BooleanColumnStatisticsData' 

Fields

Instances

Instances details
FromJSON BooleanColumnStatisticsData Source # 
Instance details

Defined in Amazonka.Glue.Types.BooleanColumnStatisticsData

ToJSON BooleanColumnStatisticsData Source # 
Instance details

Defined in Amazonka.Glue.Types.BooleanColumnStatisticsData

Generic BooleanColumnStatisticsData Source # 
Instance details

Defined in Amazonka.Glue.Types.BooleanColumnStatisticsData

Associated Types

type Rep BooleanColumnStatisticsData :: Type -> Type #

Read BooleanColumnStatisticsData Source # 
Instance details

Defined in Amazonka.Glue.Types.BooleanColumnStatisticsData

Show BooleanColumnStatisticsData Source # 
Instance details

Defined in Amazonka.Glue.Types.BooleanColumnStatisticsData

NFData BooleanColumnStatisticsData Source # 
Instance details

Defined in Amazonka.Glue.Types.BooleanColumnStatisticsData

Eq BooleanColumnStatisticsData Source # 
Instance details

Defined in Amazonka.Glue.Types.BooleanColumnStatisticsData

Hashable BooleanColumnStatisticsData Source # 
Instance details

Defined in Amazonka.Glue.Types.BooleanColumnStatisticsData

type Rep BooleanColumnStatisticsData Source # 
Instance details

Defined in Amazonka.Glue.Types.BooleanColumnStatisticsData

type Rep BooleanColumnStatisticsData = D1 ('MetaData "BooleanColumnStatisticsData" "Amazonka.Glue.Types.BooleanColumnStatisticsData" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "BooleanColumnStatisticsData'" 'PrefixI 'True) (S1 ('MetaSel ('Just "numberOfTrues") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Natural) :*: (S1 ('MetaSel ('Just "numberOfFalses") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Natural) :*: S1 ('MetaSel ('Just "numberOfNulls") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Natural))))

newBooleanColumnStatisticsData Source #

Create a value of BooleanColumnStatisticsData with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:numberOfTrues:BooleanColumnStatisticsData', booleanColumnStatisticsData_numberOfTrues - The number of true values in the column.

$sel:numberOfFalses:BooleanColumnStatisticsData', booleanColumnStatisticsData_numberOfFalses - The number of false values in the column.

$sel:numberOfNulls:BooleanColumnStatisticsData', booleanColumnStatisticsData_numberOfNulls - The number of null values in the column.

CatalogEntry

data CatalogEntry Source #

Specifies a table definition in the Glue Data Catalog.

See: newCatalogEntry smart constructor.

Constructors

CatalogEntry' 

Fields

Instances

Instances details
ToJSON CatalogEntry Source # 
Instance details

Defined in Amazonka.Glue.Types.CatalogEntry

Generic CatalogEntry Source # 
Instance details

Defined in Amazonka.Glue.Types.CatalogEntry

Associated Types

type Rep CatalogEntry :: Type -> Type #

Read CatalogEntry Source # 
Instance details

Defined in Amazonka.Glue.Types.CatalogEntry

Show CatalogEntry Source # 
Instance details

Defined in Amazonka.Glue.Types.CatalogEntry

NFData CatalogEntry Source # 
Instance details

Defined in Amazonka.Glue.Types.CatalogEntry

Methods

rnf :: CatalogEntry -> () #

Eq CatalogEntry Source # 
Instance details

Defined in Amazonka.Glue.Types.CatalogEntry

Hashable CatalogEntry Source # 
Instance details

Defined in Amazonka.Glue.Types.CatalogEntry

type Rep CatalogEntry Source # 
Instance details

Defined in Amazonka.Glue.Types.CatalogEntry

type Rep CatalogEntry = D1 ('MetaData "CatalogEntry" "Amazonka.Glue.Types.CatalogEntry" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "CatalogEntry'" 'PrefixI 'True) (S1 ('MetaSel ('Just "databaseName") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text) :*: S1 ('MetaSel ('Just "tableName") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text)))

newCatalogEntry Source #

Create a value of CatalogEntry with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:databaseName:CatalogEntry', catalogEntry_databaseName - The database in which the table metadata resides.

$sel:tableName:CatalogEntry', catalogEntry_tableName - The name of the table in question.

catalogEntry_databaseName :: Lens' CatalogEntry Text Source #

The database in which the table metadata resides.

catalogEntry_tableName :: Lens' CatalogEntry Text Source #

The name of the table in question.

CatalogImportStatus

data CatalogImportStatus Source #

A structure containing migration status information.

See: newCatalogImportStatus smart constructor.

Constructors

CatalogImportStatus' 

Fields

Instances

Instances details
FromJSON CatalogImportStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.CatalogImportStatus

Generic CatalogImportStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.CatalogImportStatus

Associated Types

type Rep CatalogImportStatus :: Type -> Type #

Read CatalogImportStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.CatalogImportStatus

Show CatalogImportStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.CatalogImportStatus

NFData CatalogImportStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.CatalogImportStatus

Methods

rnf :: CatalogImportStatus -> () #

Eq CatalogImportStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.CatalogImportStatus

Hashable CatalogImportStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.CatalogImportStatus

type Rep CatalogImportStatus Source # 
Instance details

Defined in Amazonka.Glue.Types.CatalogImportStatus

type Rep CatalogImportStatus = D1 ('MetaData "CatalogImportStatus" "Amazonka.Glue.Types.CatalogImportStatus" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "CatalogImportStatus'" 'PrefixI 'True) (S1 ('MetaSel ('Just "importCompleted") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Bool)) :*: (S1 ('MetaSel ('Just "importTime") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe POSIX)) :*: S1 ('MetaSel ('Just "importedBy") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)))))

newCatalogImportStatus :: CatalogImportStatus Source #

Create a value of CatalogImportStatus with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:importCompleted:CatalogImportStatus', catalogImportStatus_importCompleted - True if the migration has completed, or False otherwise.

$sel:importTime:CatalogImportStatus', catalogImportStatus_importTime - The time that the migration was started.

$sel:importedBy:CatalogImportStatus', catalogImportStatus_importedBy - The name of the person who initiated the migration.

catalogImportStatus_importCompleted :: Lens' CatalogImportStatus (Maybe Bool) Source #

True if the migration has completed, or False otherwise.

catalogImportStatus_importTime :: Lens' CatalogImportStatus (Maybe UTCTime) Source #

The time that the migration was started.

catalogImportStatus_importedBy :: Lens' CatalogImportStatus (Maybe Text) Source #

The name of the person who initiated the migration.

CatalogKafkaSource

data CatalogKafkaSource Source #

Specifies an Apache Kafka data store in the Data Catalog.

See: newCatalogKafkaSource smart constructor.

Constructors

CatalogKafkaSource' 

Fields

Instances

Instances details
FromJSON CatalogKafkaSource Source # 
Instance details

Defined in Amazonka.Glue.Types.CatalogKafkaSource

ToJSON CatalogKafkaSource Source # 
Instance details

Defined in Amazonka.Glue.Types.CatalogKafkaSource

Generic CatalogKafkaSource Source # 
Instance details

Defined in Amazonka.Glue.Types.CatalogKafkaSource

Associated Types

type Rep CatalogKafkaSource :: Type -> Type #

Read CatalogKafkaSource Source # 
Instance details

Defined in Amazonka.Glue.Types.CatalogKafkaSource

Show CatalogKafkaSource Source # 
Instance details

Defined in Amazonka.Glue.Types.CatalogKafkaSource

NFData CatalogKafkaSource Source # 
Instance details

Defined in Amazonka.Glue.Types.CatalogKafkaSource

Methods

rnf :: CatalogKafkaSource -> () #

Eq CatalogKafkaSource Source # 
Instance details

Defined in Amazonka.Glue.Types.CatalogKafkaSource

Hashable CatalogKafkaSource Source # 
Instance details

Defined in Amazonka.Glue.Types.CatalogKafkaSource

type Rep CatalogKafkaSource Source # 
Instance details

Defined in Amazonka.Glue.Types.CatalogKafkaSource

newCatalogKafkaSource Source #

Create a value of CatalogKafkaSource with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:dataPreviewOptions:CatalogKafkaSource', catalogKafkaSource_dataPreviewOptions - Specifies options related to data preview for viewing a sample of your data.

$sel:detectSchema:CatalogKafkaSource', catalogKafkaSource_detectSchema - Whether to automatically determine the schema from the incoming data.

$sel:streamingOptions:CatalogKafkaSource', catalogKafkaSource_streamingOptions - Specifies the streaming options.

$sel:windowSize:CatalogKafkaSource', catalogKafkaSource_windowSize - The amount of time to spend processing each micro batch.

$sel:name:CatalogKafkaSource', catalogKafkaSource_name - The name of the data store.

$sel:table:CatalogKafkaSource', catalogKafkaSource_table - The name of the table in the database to read from.

$sel:database:CatalogKafkaSource', catalogKafkaSource_database - The name of the database to read from.

catalogKafkaSource_dataPreviewOptions :: Lens' CatalogKafkaSource (Maybe StreamingDataPreviewOptions) Source #

Specifies options related to data preview for viewing a sample of your data.

catalogKafkaSource_detectSchema :: Lens' CatalogKafkaSource (Maybe Bool) Source #

Whether to automatically determine the schema from the incoming data.

catalogKafkaSource_windowSize :: Lens' CatalogKafkaSource (Maybe Natural) Source #

The amount of time to spend processing each micro batch.

catalogKafkaSource_table :: Lens' CatalogKafkaSource Text Source #

The name of the table in the database to read from.

catalogKafkaSource_database :: Lens' CatalogKafkaSource Text Source #

The name of the database to read from.

CatalogKinesisSource

data CatalogKinesisSource Source #

Specifies a Kinesis data source in the Glue Data Catalog.

See: newCatalogKinesisSource smart constructor.

Constructors

CatalogKinesisSource' 

Fields

Instances

Instances details
FromJSON CatalogKinesisSource Source # 
Instance details

Defined in Amazonka.Glue.Types.CatalogKinesisSource

ToJSON CatalogKinesisSource Source # 
Instance details

Defined in Amazonka.Glue.Types.CatalogKinesisSource

Generic CatalogKinesisSource Source # 
Instance details

Defined in Amazonka.Glue.Types.CatalogKinesisSource

Associated Types

type Rep CatalogKinesisSource :: Type -> Type #

Read CatalogKinesisSource Source # 
Instance details

Defined in Amazonka.Glue.Types.CatalogKinesisSource

Show CatalogKinesisSource Source # 
Instance details

Defined in Amazonka.Glue.Types.CatalogKinesisSource

NFData CatalogKinesisSource Source # 
Instance details

Defined in Amazonka.Glue.Types.CatalogKinesisSource

Methods

rnf :: CatalogKinesisSource -> () #

Eq CatalogKinesisSource Source # 
Instance details

Defined in Amazonka.Glue.Types.CatalogKinesisSource

Hashable CatalogKinesisSource Source # 
Instance details

Defined in Amazonka.Glue.Types.CatalogKinesisSource

type Rep CatalogKinesisSource Source # 
Instance details

Defined in Amazonka.Glue.Types.CatalogKinesisSource

newCatalogKinesisSource Source #

Create a value of CatalogKinesisSource with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:dataPreviewOptions:CatalogKinesisSource', catalogKinesisSource_dataPreviewOptions - Additional options for data preview.

$sel:detectSchema:CatalogKinesisSource', catalogKinesisSource_detectSchema - Whether to automatically determine the schema from the incoming data.

$sel:streamingOptions:CatalogKinesisSource', catalogKinesisSource_streamingOptions - Additional options for the Kinesis streaming data source.

$sel:windowSize:CatalogKinesisSource', catalogKinesisSource_windowSize - The amount of time to spend processing each micro batch.

$sel:name:CatalogKinesisSource', catalogKinesisSource_name - The name of the data source.

$sel:table:CatalogKinesisSource', catalogKinesisSource_table - The name of the table in the database to read from.

$sel:database:CatalogKinesisSource', catalogKinesisSource_database - The name of the database to read from.

catalogKinesisSource_detectSchema :: Lens' CatalogKinesisSource (Maybe Bool) Source #

Whether to automatically determine the schema from the incoming data.

catalogKinesisSource_windowSize :: Lens' CatalogKinesisSource (Maybe Natural) Source #

The amount of time to spend processing each micro batch.

catalogKinesisSource_table :: Lens' CatalogKinesisSource Text Source #

The name of the table in the database to read from.

catalogKinesisSource_database :: Lens' CatalogKinesisSource Text Source #

The name of the database to read from.

CatalogSchemaChangePolicy

data CatalogSchemaChangePolicy Source #

A policy that specifies update behavior for the crawler.

See: newCatalogSchemaChangePolicy smart constructor.

Constructors

CatalogSchemaChangePolicy' 

Fields

Instances

Instances details
FromJSON CatalogSchemaChangePolicy Source # 
Instance details

Defined in Amazonka.Glue.Types.CatalogSchemaChangePolicy

ToJSON CatalogSchemaChangePolicy Source # 
Instance details

Defined in Amazonka.Glue.Types.CatalogSchemaChangePolicy

Generic CatalogSchemaChangePolicy Source # 
Instance details

Defined in Amazonka.Glue.Types.CatalogSchemaChangePolicy

Associated Types

type Rep CatalogSchemaChangePolicy :: Type -> Type #

Read CatalogSchemaChangePolicy Source # 
Instance details

Defined in Amazonka.Glue.Types.CatalogSchemaChangePolicy

Show CatalogSchemaChangePolicy Source # 
Instance details

Defined in Amazonka.Glue.Types.CatalogSchemaChangePolicy

NFData CatalogSchemaChangePolicy Source # 
Instance details

Defined in Amazonka.Glue.Types.CatalogSchemaChangePolicy

Eq CatalogSchemaChangePolicy Source # 
Instance details

Defined in Amazonka.Glue.Types.CatalogSchemaChangePolicy

Hashable CatalogSchemaChangePolicy Source # 
Instance details

Defined in Amazonka.Glue.Types.CatalogSchemaChangePolicy

type Rep CatalogSchemaChangePolicy Source # 
Instance details

Defined in Amazonka.Glue.Types.CatalogSchemaChangePolicy

type Rep CatalogSchemaChangePolicy = D1 ('MetaData "CatalogSchemaChangePolicy" "Amazonka.Glue.Types.CatalogSchemaChangePolicy" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "CatalogSchemaChangePolicy'" 'PrefixI 'True) (S1 ('MetaSel ('Just "enableUpdateCatalog") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Bool)) :*: S1 ('MetaSel ('Just "updateBehavior") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe UpdateCatalogBehavior))))

newCatalogSchemaChangePolicy :: CatalogSchemaChangePolicy Source #

Create a value of CatalogSchemaChangePolicy with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:enableUpdateCatalog:CatalogSchemaChangePolicy', catalogSchemaChangePolicy_enableUpdateCatalog - Whether to use the specified update behavior when the crawler finds a changed schema.

$sel:updateBehavior:CatalogSchemaChangePolicy', catalogSchemaChangePolicy_updateBehavior - The update behavior when the crawler finds a changed schema.

catalogSchemaChangePolicy_enableUpdateCatalog :: Lens' CatalogSchemaChangePolicy (Maybe Bool) Source #

Whether to use the specified update behavior when the crawler finds a changed schema.

catalogSchemaChangePolicy_updateBehavior :: Lens' CatalogSchemaChangePolicy (Maybe UpdateCatalogBehavior) Source #

The update behavior when the crawler finds a changed schema.

CatalogSource

data CatalogSource Source #

Specifies a data store in the Glue Data Catalog.

See: newCatalogSource smart constructor.

Constructors

CatalogSource' 

Fields

  • name :: Text

    The name of the data store.

  • database :: Text

    The name of the database to read from.

  • table :: Text

    The name of the table in the database to read from.

Instances

Instances details
FromJSON CatalogSource Source # 
Instance details

Defined in Amazonka.Glue.Types.CatalogSource

ToJSON CatalogSource Source # 
Instance details

Defined in Amazonka.Glue.Types.CatalogSource

Generic CatalogSource Source # 
Instance details

Defined in Amazonka.Glue.Types.CatalogSource

Associated Types

type Rep CatalogSource :: Type -> Type #

Read CatalogSource Source # 
Instance details

Defined in Amazonka.Glue.Types.CatalogSource

Show CatalogSource Source # 
Instance details

Defined in Amazonka.Glue.Types.CatalogSource

NFData CatalogSource Source # 
Instance details

Defined in Amazonka.Glue.Types.CatalogSource

Methods

rnf :: CatalogSource -> () #

Eq CatalogSource Source # 
Instance details

Defined in Amazonka.Glue.Types.CatalogSource

Hashable CatalogSource Source # 
Instance details

Defined in Amazonka.Glue.Types.CatalogSource

type Rep CatalogSource Source # 
Instance details

Defined in Amazonka.Glue.Types.CatalogSource

type Rep CatalogSource = D1 ('MetaData "CatalogSource" "Amazonka.Glue.Types.CatalogSource" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "CatalogSource'" 'PrefixI 'True) (S1 ('MetaSel ('Just "name") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text) :*: (S1 ('MetaSel ('Just "database") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text) :*: S1 ('MetaSel ('Just "table") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text))))

newCatalogSource Source #

Create a value of CatalogSource with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:name:CatalogSource', catalogSource_name - The name of the data store.

$sel:database:CatalogSource', catalogSource_database - The name of the database to read from.

$sel:table:CatalogSource', catalogSource_table - The name of the table in the database to read from.

catalogSource_name :: Lens' CatalogSource Text Source #

The name of the data store.

catalogSource_database :: Lens' CatalogSource Text Source #

The name of the database to read from.

catalogSource_table :: Lens' CatalogSource Text Source #

The name of the table in the database to read from.

CatalogTarget

data CatalogTarget Source #

Specifies an Glue Data Catalog target.

See: newCatalogTarget smart constructor.

Constructors

CatalogTarget' 

Fields

  • connectionName :: Maybe Text

    The name of the connection for an Amazon S3-backed Data Catalog table to be a target of the crawl when using a Catalog connection type paired with a NETWORK Connection type.

  • dlqEventQueueArn :: Maybe Text

    A valid Amazon dead-letter SQS ARN. For example, arn:aws:sqs:region:account:deadLetterQueue.

  • eventQueueArn :: Maybe Text

    A valid Amazon SQS ARN. For example, arn:aws:sqs:region:account:sqs.

  • databaseName :: Text

    The name of the database to be synchronized.

  • tables :: NonEmpty Text

    A list of the tables to be synchronized.

Instances

Instances details
FromJSON CatalogTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.CatalogTarget

ToJSON CatalogTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.CatalogTarget

Generic CatalogTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.CatalogTarget

Associated Types

type Rep CatalogTarget :: Type -> Type #

Read CatalogTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.CatalogTarget

Show CatalogTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.CatalogTarget

NFData CatalogTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.CatalogTarget

Methods

rnf :: CatalogTarget -> () #

Eq CatalogTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.CatalogTarget

Hashable CatalogTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.CatalogTarget

type Rep CatalogTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.CatalogTarget

type Rep CatalogTarget = D1 ('MetaData "CatalogTarget" "Amazonka.Glue.Types.CatalogTarget" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "CatalogTarget'" 'PrefixI 'True) ((S1 ('MetaSel ('Just "connectionName") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "dlqEventQueueArn") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text))) :*: (S1 ('MetaSel ('Just "eventQueueArn") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: (S1 ('MetaSel ('Just "databaseName") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text) :*: S1 ('MetaSel ('Just "tables") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (NonEmpty Text))))))

newCatalogTarget Source #

Create a value of CatalogTarget with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:connectionName:CatalogTarget', catalogTarget_connectionName - The name of the connection for an Amazon S3-backed Data Catalog table to be a target of the crawl when using a Catalog connection type paired with a NETWORK Connection type.

$sel:dlqEventQueueArn:CatalogTarget', catalogTarget_dlqEventQueueArn - A valid Amazon dead-letter SQS ARN. For example, arn:aws:sqs:region:account:deadLetterQueue.

$sel:eventQueueArn:CatalogTarget', catalogTarget_eventQueueArn - A valid Amazon SQS ARN. For example, arn:aws:sqs:region:account:sqs.

$sel:databaseName:CatalogTarget', catalogTarget_databaseName - The name of the database to be synchronized.

$sel:tables:CatalogTarget', catalogTarget_tables - A list of the tables to be synchronized.

catalogTarget_connectionName :: Lens' CatalogTarget (Maybe Text) Source #

The name of the connection for an Amazon S3-backed Data Catalog table to be a target of the crawl when using a Catalog connection type paired with a NETWORK Connection type.

catalogTarget_dlqEventQueueArn :: Lens' CatalogTarget (Maybe Text) Source #

A valid Amazon dead-letter SQS ARN. For example, arn:aws:sqs:region:account:deadLetterQueue.

catalogTarget_eventQueueArn :: Lens' CatalogTarget (Maybe Text) Source #

A valid Amazon SQS ARN. For example, arn:aws:sqs:region:account:sqs.

catalogTarget_databaseName :: Lens' CatalogTarget Text Source #

The name of the database to be synchronized.

catalogTarget_tables :: Lens' CatalogTarget (NonEmpty Text) Source #

A list of the tables to be synchronized.

Classifier

data Classifier Source #

Classifiers are triggered during a crawl task. A classifier checks whether a given file is in a format it can handle. If it is, the classifier creates a schema in the form of a StructType object that matches that data format.

You can use the standard classifiers that Glue provides, or you can write your own classifiers to best categorize your data sources and specify the appropriate schemas to use for them. A classifier can be a grok classifier, an XML classifier, a JSON classifier, or a custom CSV classifier, as specified in one of the fields in the Classifier object.

See: newClassifier smart constructor.

Constructors

Classifier' 

Fields

Instances

Instances details
FromJSON Classifier Source # 
Instance details

Defined in Amazonka.Glue.Types.Classifier

Generic Classifier Source # 
Instance details

Defined in Amazonka.Glue.Types.Classifier

Associated Types

type Rep Classifier :: Type -> Type #

Read Classifier Source # 
Instance details

Defined in Amazonka.Glue.Types.Classifier

Show Classifier Source # 
Instance details

Defined in Amazonka.Glue.Types.Classifier

NFData Classifier Source # 
Instance details

Defined in Amazonka.Glue.Types.Classifier

Methods

rnf :: Classifier -> () #

Eq Classifier Source # 
Instance details

Defined in Amazonka.Glue.Types.Classifier

Hashable Classifier Source # 
Instance details

Defined in Amazonka.Glue.Types.Classifier

type Rep Classifier Source # 
Instance details

Defined in Amazonka.Glue.Types.Classifier

type Rep Classifier = D1 ('MetaData "Classifier" "Amazonka.Glue.Types.Classifier" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "Classifier'" 'PrefixI 'True) ((S1 ('MetaSel ('Just "csvClassifier") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe CsvClassifier)) :*: S1 ('MetaSel ('Just "grokClassifier") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe GrokClassifier))) :*: (S1 ('MetaSel ('Just "jsonClassifier") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe JsonClassifier)) :*: S1 ('MetaSel ('Just "xMLClassifier") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe XMLClassifier)))))

newClassifier :: Classifier Source #

Create a value of Classifier with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:csvClassifier:Classifier', classifier_csvClassifier - A classifier for comma-separated values (CSV).

$sel:grokClassifier:Classifier', classifier_grokClassifier - A classifier that uses grok.

$sel:jsonClassifier:Classifier', classifier_jsonClassifier - A classifier for JSON content.

$sel:xMLClassifier:Classifier', classifier_xMLClassifier - A classifier for XML content.

classifier_csvClassifier :: Lens' Classifier (Maybe CsvClassifier) Source #

A classifier for comma-separated values (CSV).

CloudWatchEncryption

data CloudWatchEncryption Source #

Specifies how Amazon CloudWatch data should be encrypted.

See: newCloudWatchEncryption smart constructor.

Constructors

CloudWatchEncryption' 

Fields

Instances

Instances details
FromJSON CloudWatchEncryption Source # 
Instance details

Defined in Amazonka.Glue.Types.CloudWatchEncryption

ToJSON CloudWatchEncryption Source # 
Instance details

Defined in Amazonka.Glue.Types.CloudWatchEncryption

Generic CloudWatchEncryption Source # 
Instance details

Defined in Amazonka.Glue.Types.CloudWatchEncryption

Associated Types

type Rep CloudWatchEncryption :: Type -> Type #

Read CloudWatchEncryption Source # 
Instance details

Defined in Amazonka.Glue.Types.CloudWatchEncryption

Show CloudWatchEncryption Source # 
Instance details

Defined in Amazonka.Glue.Types.CloudWatchEncryption

NFData CloudWatchEncryption Source # 
Instance details

Defined in Amazonka.Glue.Types.CloudWatchEncryption

Methods

rnf :: CloudWatchEncryption -> () #

Eq CloudWatchEncryption Source # 
Instance details

Defined in Amazonka.Glue.Types.CloudWatchEncryption

Hashable CloudWatchEncryption Source # 
Instance details

Defined in Amazonka.Glue.Types.CloudWatchEncryption

type Rep CloudWatchEncryption Source # 
Instance details

Defined in Amazonka.Glue.Types.CloudWatchEncryption

type Rep CloudWatchEncryption = D1 ('MetaData "CloudWatchEncryption" "Amazonka.Glue.Types.CloudWatchEncryption" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "CloudWatchEncryption'" 'PrefixI 'True) (S1 ('MetaSel ('Just "cloudWatchEncryptionMode") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe CloudWatchEncryptionMode)) :*: S1 ('MetaSel ('Just "kmsKeyArn") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text))))

newCloudWatchEncryption :: CloudWatchEncryption Source #

Create a value of CloudWatchEncryption with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:cloudWatchEncryptionMode:CloudWatchEncryption', cloudWatchEncryption_cloudWatchEncryptionMode - The encryption mode to use for CloudWatch data.

$sel:kmsKeyArn:CloudWatchEncryption', cloudWatchEncryption_kmsKeyArn - The Amazon Resource Name (ARN) of the KMS key to be used to encrypt the data.

cloudWatchEncryption_kmsKeyArn :: Lens' CloudWatchEncryption (Maybe Text) Source #

The Amazon Resource Name (ARN) of the KMS key to be used to encrypt the data.

CodeGenConfigurationNode

data CodeGenConfigurationNode Source #

CodeGenConfigurationNode enumerates all valid Node types. One and only one of its member variables can be populated.

See: newCodeGenConfigurationNode smart constructor.

Constructors

CodeGenConfigurationNode' 

Fields

Instances

Instances details
FromJSON CodeGenConfigurationNode Source # 
Instance details

Defined in Amazonka.Glue.Types.CodeGenConfigurationNode

ToJSON CodeGenConfigurationNode Source # 
Instance details

Defined in Amazonka.Glue.Types.CodeGenConfigurationNode

Generic CodeGenConfigurationNode Source # 
Instance details

Defined in Amazonka.Glue.Types.CodeGenConfigurationNode

Associated Types

type Rep CodeGenConfigurationNode :: Type -> Type #

Read CodeGenConfigurationNode Source # 
Instance details

Defined in Amazonka.Glue.Types.CodeGenConfigurationNode

Show CodeGenConfigurationNode Source # 
Instance details

Defined in Amazonka.Glue.Types.CodeGenConfigurationNode

NFData CodeGenConfigurationNode Source # 
Instance details

Defined in Amazonka.Glue.Types.CodeGenConfigurationNode

Eq CodeGenConfigurationNode Source # 
Instance details

Defined in Amazonka.Glue.Types.CodeGenConfigurationNode

Hashable CodeGenConfigurationNode Source # 
Instance details

Defined in Amazonka.Glue.Types.CodeGenConfigurationNode

type Rep CodeGenConfigurationNode Source # 
Instance details

Defined in Amazonka.Glue.Types.CodeGenConfigurationNode

type Rep CodeGenConfigurationNode = D1 ('MetaData "CodeGenConfigurationNode" "Amazonka.Glue.Types.CodeGenConfigurationNode" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "CodeGenConfigurationNode'" 'PrefixI 'True) (((((S1 ('MetaSel ('Just "aggregate") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Aggregate)) :*: (S1 ('MetaSel ('Just "applyMapping") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe ApplyMapping)) :*: S1 ('MetaSel ('Just "athenaConnectorSource") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe AthenaConnectorSource)))) :*: (S1 ('MetaSel ('Just "catalogKafkaSource") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe CatalogKafkaSource)) :*: (S1 ('MetaSel ('Just "catalogKinesisSource") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe CatalogKinesisSource)) :*: S1 ('MetaSel ('Just "catalogSource") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe CatalogSource))))) :*: ((S1 ('MetaSel ('Just "catalogTarget") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe BasicCatalogTarget)) :*: (S1 ('MetaSel ('Just "customCode") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe CustomCode)) :*: S1 ('MetaSel ('Just "directKafkaSource") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe DirectKafkaSource)))) :*: ((S1 ('MetaSel ('Just "directKinesisSource") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe DirectKinesisSource)) :*: S1 ('MetaSel ('Just "dropDuplicates") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe DropDuplicates))) :*: (S1 ('MetaSel ('Just "dropFields") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe DropFields)) :*: S1 ('MetaSel ('Just "dropNullFields") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe DropNullFields)))))) :*: (((S1 ('MetaSel ('Just "dynamicTransform") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe DynamicTransform)) :*: (S1 ('MetaSel ('Just "dynamoDBCatalogSource") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe DynamoDBCatalogSource)) :*: S1 ('MetaSel ('Just "evaluateDataQuality") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe EvaluateDataQuality)))) :*: (S1 ('MetaSel ('Just "fillMissingValues") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe FillMissingValues)) :*: (S1 ('MetaSel ('Just "filter'") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Filter)) :*: S1 ('MetaSel ('Just "governedCatalogSource") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe GovernedCatalogSource))))) :*: ((S1 ('MetaSel ('Just "governedCatalogTarget") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe GovernedCatalogTarget)) :*: (S1 ('MetaSel ('Just "jDBCConnectorSource") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe JDBCConnectorSource)) :*: S1 ('MetaSel ('Just "jDBCConnectorTarget") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe JDBCConnectorTarget)))) :*: ((S1 ('MetaSel ('Just "join") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Join)) :*: S1 ('MetaSel ('Just "merge") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Merge))) :*: (S1 ('MetaSel ('Just "microsoftSQLServerCatalogSource") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe MicrosoftSQLServerCatalogSource)) :*: S1 ('MetaSel ('Just "microsoftSQLServerCatalogTarget") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe MicrosoftSQLServerCatalogTarget))))))) :*: ((((S1 ('MetaSel ('Just "mySQLCatalogSource") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe MySQLCatalogSource)) :*: (S1 ('MetaSel ('Just "mySQLCatalogTarget") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe MySQLCatalogTarget)) :*: S1 ('MetaSel ('Just "oracleSQLCatalogSource") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe OracleSQLCatalogSource)))) :*: (S1 ('MetaSel ('Just "oracleSQLCatalogTarget") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe OracleSQLCatalogTarget)) :*: (S1 ('MetaSel ('Just "pIIDetection") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe PIIDetection)) :*: S1 ('MetaSel ('Just "postgreSQLCatalogSource") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe PostgreSQLCatalogSource))))) :*: ((S1 ('MetaSel ('Just "postgreSQLCatalogTarget") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe PostgreSQLCatalogTarget)) :*: (S1 ('MetaSel ('Just "redshiftSource") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe RedshiftSource)) :*: S1 ('MetaSel ('Just "redshiftTarget") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe RedshiftTarget)))) :*: ((S1 ('MetaSel ('Just "relationalCatalogSource") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe RelationalCatalogSource)) :*: S1 ('MetaSel ('Just "renameField") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe RenameField))) :*: (S1 ('MetaSel ('Just "s3CatalogSource") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe S3CatalogSource)) :*: S1 ('MetaSel ('Just "s3CatalogTarget") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe S3CatalogTarget)))))) :*: (((S1 ('MetaSel ('Just "s3CsvSource") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe S3CsvSource)) :*: (S1 ('MetaSel ('Just "s3DirectTarget") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe S3DirectTarget)) :*: S1 ('MetaSel ('Just "s3GlueParquetTarget") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe S3GlueParquetTarget)))) :*: (S1 ('MetaSel ('Just "s3JsonSource") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe S3JsonSource)) :*: (S1 ('MetaSel ('Just "s3ParquetSource") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe S3ParquetSource)) :*: S1 ('MetaSel ('Just "selectFields") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe SelectFields))))) :*: ((S1 ('MetaSel ('Just "selectFromCollection") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe SelectFromCollection)) :*: (S1 ('MetaSel ('Just "sparkConnectorSource") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe SparkConnectorSource)) :*: S1 ('MetaSel ('Just "sparkConnectorTarget") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe SparkConnectorTarget)))) :*: ((S1 ('MetaSel ('Just "sparkSQL") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe SparkSQL)) :*: S1 ('MetaSel ('Just "spigot") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Spigot))) :*: (S1 ('MetaSel ('Just "splitFields") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe SplitFields)) :*: S1 ('MetaSel ('Just "union") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Union)))))))))

newCodeGenConfigurationNode :: CodeGenConfigurationNode Source #

Create a value of CodeGenConfigurationNode with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:aggregate:CodeGenConfigurationNode', codeGenConfigurationNode_aggregate - Specifies a transform that groups rows by chosen fields and computes the aggregated value by specified function.

$sel:applyMapping:CodeGenConfigurationNode', codeGenConfigurationNode_applyMapping - Specifies a transform that maps data property keys in the data source to data property keys in the data target. You can rename keys, modify the data types for keys, and choose which keys to drop from the dataset.

$sel:athenaConnectorSource:CodeGenConfigurationNode', codeGenConfigurationNode_athenaConnectorSource - Specifies a connector to an Amazon Athena data source.

$sel:catalogKafkaSource:CodeGenConfigurationNode', codeGenConfigurationNode_catalogKafkaSource - Specifies an Apache Kafka data store in the Data Catalog.

$sel:catalogKinesisSource:CodeGenConfigurationNode', codeGenConfigurationNode_catalogKinesisSource - Specifies a Kinesis data source in the Glue Data Catalog.

$sel:catalogSource:CodeGenConfigurationNode', codeGenConfigurationNode_catalogSource - Specifies a data store in the Glue Data Catalog.

$sel:catalogTarget:CodeGenConfigurationNode', codeGenConfigurationNode_catalogTarget - Specifies a target that uses a Glue Data Catalog table.

$sel:customCode:CodeGenConfigurationNode', codeGenConfigurationNode_customCode - Specifies a transform that uses custom code you provide to perform the data transformation. The output is a collection of DynamicFrames.

$sel:directKafkaSource:CodeGenConfigurationNode', codeGenConfigurationNode_directKafkaSource - Specifies an Apache Kafka data store.

$sel:directKinesisSource:CodeGenConfigurationNode', codeGenConfigurationNode_directKinesisSource - Specifies a direct Amazon Kinesis data source.

$sel:dropDuplicates:CodeGenConfigurationNode', codeGenConfigurationNode_dropDuplicates - Specifies a transform that removes rows of repeating data from a data set.

$sel:dropFields:CodeGenConfigurationNode', codeGenConfigurationNode_dropFields - Specifies a transform that chooses the data property keys that you want to drop.

$sel:dropNullFields:CodeGenConfigurationNode', codeGenConfigurationNode_dropNullFields - Specifies a transform that removes columns from the dataset if all values in the column are 'null'. By default, Glue Studio will recognize null objects, but some values such as empty strings, strings that are "null", -1 integers or other placeholders such as zeros, are not automatically recognized as nulls.

$sel:dynamicTransform:CodeGenConfigurationNode', codeGenConfigurationNode_dynamicTransform - Specifies a custom visual transform created by a user.

$sel:dynamoDBCatalogSource:CodeGenConfigurationNode', codeGenConfigurationNode_dynamoDBCatalogSource - Undocumented member.

$sel:evaluateDataQuality:CodeGenConfigurationNode', codeGenConfigurationNode_evaluateDataQuality - Specifies your data quality evaluation criteria.

$sel:fillMissingValues:CodeGenConfigurationNode', codeGenConfigurationNode_fillMissingValues - Specifies a transform that locates records in the dataset that have missing values and adds a new field with a value determined by imputation. The input data set is used to train the machine learning model that determines what the missing value should be.

$sel:filter':CodeGenConfigurationNode', codeGenConfigurationNode_filter - Specifies a transform that splits a dataset into two, based on a filter condition.

$sel:governedCatalogSource:CodeGenConfigurationNode', codeGenConfigurationNode_governedCatalogSource - Specifies a data source in a goverened Data Catalog.

$sel:governedCatalogTarget:CodeGenConfigurationNode', codeGenConfigurationNode_governedCatalogTarget - Specifies a data target that writes to a goverened catalog.

$sel:jDBCConnectorSource:CodeGenConfigurationNode', codeGenConfigurationNode_jDBCConnectorSource - Specifies a connector to a JDBC data source.

$sel:jDBCConnectorTarget:CodeGenConfigurationNode', codeGenConfigurationNode_jDBCConnectorTarget - Specifies a data target that writes to Amazon S3 in Apache Parquet columnar storage.

$sel:join:CodeGenConfigurationNode', codeGenConfigurationNode_join - Specifies a transform that joins two datasets into one dataset using a comparison phrase on the specified data property keys. You can use inner, outer, left, right, left semi, and left anti joins.

$sel:merge:CodeGenConfigurationNode', codeGenConfigurationNode_merge - Specifies a transform that merges a DynamicFrame with a staging DynamicFrame based on the specified primary keys to identify records. Duplicate records (records with the same primary keys) are not de-duplicated.

$sel:microsoftSQLServerCatalogSource:CodeGenConfigurationNode', codeGenConfigurationNode_microsoftSQLServerCatalogSource - Specifies a Microsoft SQL server data source in the Glue Data Catalog.

$sel:microsoftSQLServerCatalogTarget:CodeGenConfigurationNode', codeGenConfigurationNode_microsoftSQLServerCatalogTarget - Specifies a target that uses Microsoft SQL.

$sel:mySQLCatalogSource:CodeGenConfigurationNode', codeGenConfigurationNode_mySQLCatalogSource - Specifies a MySQL data source in the Glue Data Catalog.

$sel:mySQLCatalogTarget:CodeGenConfigurationNode', codeGenConfigurationNode_mySQLCatalogTarget - Specifies a target that uses MySQL.

$sel:oracleSQLCatalogSource:CodeGenConfigurationNode', codeGenConfigurationNode_oracleSQLCatalogSource - Specifies an Oracle data source in the Glue Data Catalog.

$sel:oracleSQLCatalogTarget:CodeGenConfigurationNode', codeGenConfigurationNode_oracleSQLCatalogTarget - Specifies a target that uses Oracle SQL.

$sel:pIIDetection:CodeGenConfigurationNode', codeGenConfigurationNode_pIIDetection - Specifies a transform that identifies, removes or masks PII data.

$sel:postgreSQLCatalogSource:CodeGenConfigurationNode', codeGenConfigurationNode_postgreSQLCatalogSource - Specifies a PostgresSQL data source in the Glue Data Catalog.

$sel:postgreSQLCatalogTarget:CodeGenConfigurationNode', codeGenConfigurationNode_postgreSQLCatalogTarget - Specifies a target that uses Postgres SQL.

$sel:redshiftSource:CodeGenConfigurationNode', codeGenConfigurationNode_redshiftSource - Specifies an Amazon Redshift data store.

$sel:redshiftTarget:CodeGenConfigurationNode', codeGenConfigurationNode_redshiftTarget - Specifies a target that uses Amazon Redshift.

$sel:relationalCatalogSource:CodeGenConfigurationNode', codeGenConfigurationNode_relationalCatalogSource - Undocumented member.

$sel:renameField:CodeGenConfigurationNode', codeGenConfigurationNode_renameField - Specifies a transform that renames a single data property key.

$sel:s3CatalogSource:CodeGenConfigurationNode', codeGenConfigurationNode_s3CatalogSource - Specifies an Amazon S3 data store in the Glue Data Catalog.

$sel:s3CatalogTarget:CodeGenConfigurationNode', codeGenConfigurationNode_s3CatalogTarget - Specifies a data target that writes to Amazon S3 using the Glue Data Catalog.

$sel:s3CsvSource:CodeGenConfigurationNode', codeGenConfigurationNode_s3CsvSource - Specifies a command-separated value (CSV) data store stored in Amazon S3.

$sel:s3DirectTarget:CodeGenConfigurationNode', codeGenConfigurationNode_s3DirectTarget - Specifies a data target that writes to Amazon S3.

$sel:s3GlueParquetTarget:CodeGenConfigurationNode', codeGenConfigurationNode_s3GlueParquetTarget - Specifies a data target that writes to Amazon S3 in Apache Parquet columnar storage.

$sel:s3JsonSource:CodeGenConfigurationNode', codeGenConfigurationNode_s3JsonSource - Specifies a JSON data store stored in Amazon S3.

$sel:s3ParquetSource:CodeGenConfigurationNode', codeGenConfigurationNode_s3ParquetSource - Specifies an Apache Parquet data store stored in Amazon S3.

$sel:selectFields:CodeGenConfigurationNode', codeGenConfigurationNode_selectFields - Specifies a transform that chooses the data property keys that you want to keep.

$sel:selectFromCollection:CodeGenConfigurationNode', codeGenConfigurationNode_selectFromCollection - Specifies a transform that chooses one DynamicFrame from a collection of DynamicFrames. The output is the selected DynamicFrame

$sel:sparkConnectorSource:CodeGenConfigurationNode', codeGenConfigurationNode_sparkConnectorSource - Specifies a connector to an Apache Spark data source.

$sel:sparkConnectorTarget:CodeGenConfigurationNode', codeGenConfigurationNode_sparkConnectorTarget - Specifies a target that uses an Apache Spark connector.

$sel:sparkSQL:CodeGenConfigurationNode', codeGenConfigurationNode_sparkSQL - Specifies a transform where you enter a SQL query using Spark SQL syntax to transform the data. The output is a single DynamicFrame.

$sel:spigot:CodeGenConfigurationNode', codeGenConfigurationNode_spigot - Specifies a transform that writes samples of the data to an Amazon S3 bucket.

$sel:splitFields:CodeGenConfigurationNode', codeGenConfigurationNode_splitFields - Specifies a transform that splits data property keys into two DynamicFrames. The output is a collection of DynamicFrames: one with selected data property keys, and one with the remaining data property keys.

$sel:union:CodeGenConfigurationNode', codeGenConfigurationNode_union - Specifies a transform that combines the rows from two or more datasets into a single result.

codeGenConfigurationNode_aggregate :: Lens' CodeGenConfigurationNode (Maybe Aggregate) Source #

Specifies a transform that groups rows by chosen fields and computes the aggregated value by specified function.

codeGenConfigurationNode_applyMapping :: Lens' CodeGenConfigurationNode (Maybe ApplyMapping) Source #

Specifies a transform that maps data property keys in the data source to data property keys in the data target. You can rename keys, modify the data types for keys, and choose which keys to drop from the dataset.

codeGenConfigurationNode_catalogKafkaSource :: Lens' CodeGenConfigurationNode (Maybe CatalogKafkaSource) Source #

Specifies an Apache Kafka data store in the Data Catalog.

codeGenConfigurationNode_catalogTarget :: Lens' CodeGenConfigurationNode (Maybe BasicCatalogTarget) Source #

Specifies a target that uses a Glue Data Catalog table.

codeGenConfigurationNode_customCode :: Lens' CodeGenConfigurationNode (Maybe CustomCode) Source #

Specifies a transform that uses custom code you provide to perform the data transformation. The output is a collection of DynamicFrames.

codeGenConfigurationNode_dropDuplicates :: Lens' CodeGenConfigurationNode (Maybe DropDuplicates) Source #

Specifies a transform that removes rows of repeating data from a data set.

codeGenConfigurationNode_dropFields :: Lens' CodeGenConfigurationNode (Maybe DropFields) Source #

Specifies a transform that chooses the data property keys that you want to drop.

codeGenConfigurationNode_dropNullFields :: Lens' CodeGenConfigurationNode (Maybe DropNullFields) Source #

Specifies a transform that removes columns from the dataset if all values in the column are 'null'. By default, Glue Studio will recognize null objects, but some values such as empty strings, strings that are "null", -1 integers or other placeholders such as zeros, are not automatically recognized as nulls.

codeGenConfigurationNode_fillMissingValues :: Lens' CodeGenConfigurationNode (Maybe FillMissingValues) Source #

Specifies a transform that locates records in the dataset that have missing values and adds a new field with a value determined by imputation. The input data set is used to train the machine learning model that determines what the missing value should be.

codeGenConfigurationNode_filter :: Lens' CodeGenConfigurationNode (Maybe Filter) Source #

Specifies a transform that splits a dataset into two, based on a filter condition.

codeGenConfigurationNode_jDBCConnectorTarget :: Lens' CodeGenConfigurationNode (Maybe JDBCConnectorTarget) Source #

Specifies a data target that writes to Amazon S3 in Apache Parquet columnar storage.

codeGenConfigurationNode_join :: Lens' CodeGenConfigurationNode (Maybe Join) Source #

Specifies a transform that joins two datasets into one dataset using a comparison phrase on the specified data property keys. You can use inner, outer, left, right, left semi, and left anti joins.

codeGenConfigurationNode_merge :: Lens' CodeGenConfigurationNode (Maybe Merge) Source #

Specifies a transform that merges a DynamicFrame with a staging DynamicFrame based on the specified primary keys to identify records. Duplicate records (records with the same primary keys) are not de-duplicated.

codeGenConfigurationNode_pIIDetection :: Lens' CodeGenConfigurationNode (Maybe PIIDetection) Source #

Specifies a transform that identifies, removes or masks PII data.

codeGenConfigurationNode_renameField :: Lens' CodeGenConfigurationNode (Maybe RenameField) Source #

Specifies a transform that renames a single data property key.

codeGenConfigurationNode_s3CatalogSource :: Lens' CodeGenConfigurationNode (Maybe S3CatalogSource) Source #

Specifies an Amazon S3 data store in the Glue Data Catalog.

codeGenConfigurationNode_s3CatalogTarget :: Lens' CodeGenConfigurationNode (Maybe S3CatalogTarget) Source #

Specifies a data target that writes to Amazon S3 using the Glue Data Catalog.

codeGenConfigurationNode_s3CsvSource :: Lens' CodeGenConfigurationNode (Maybe S3CsvSource) Source #

Specifies a command-separated value (CSV) data store stored in Amazon S3.

codeGenConfigurationNode_s3GlueParquetTarget :: Lens' CodeGenConfigurationNode (Maybe S3GlueParquetTarget) Source #

Specifies a data target that writes to Amazon S3 in Apache Parquet columnar storage.

codeGenConfigurationNode_s3ParquetSource :: Lens' CodeGenConfigurationNode (Maybe S3ParquetSource) Source #

Specifies an Apache Parquet data store stored in Amazon S3.

codeGenConfigurationNode_selectFields :: Lens' CodeGenConfigurationNode (Maybe SelectFields) Source #

Specifies a transform that chooses the data property keys that you want to keep.

codeGenConfigurationNode_selectFromCollection :: Lens' CodeGenConfigurationNode (Maybe SelectFromCollection) Source #

Specifies a transform that chooses one DynamicFrame from a collection of DynamicFrames. The output is the selected DynamicFrame

codeGenConfigurationNode_sparkSQL :: Lens' CodeGenConfigurationNode (Maybe SparkSQL) Source #

Specifies a transform where you enter a SQL query using Spark SQL syntax to transform the data. The output is a single DynamicFrame.

codeGenConfigurationNode_spigot :: Lens' CodeGenConfigurationNode (Maybe Spigot) Source #

Specifies a transform that writes samples of the data to an Amazon S3 bucket.

codeGenConfigurationNode_splitFields :: Lens' CodeGenConfigurationNode (Maybe SplitFields) Source #

Specifies a transform that splits data property keys into two DynamicFrames. The output is a collection of DynamicFrames: one with selected data property keys, and one with the remaining data property keys.

codeGenConfigurationNode_union :: Lens' CodeGenConfigurationNode (Maybe Union) Source #

Specifies a transform that combines the rows from two or more datasets into a single result.

CodeGenEdge

data CodeGenEdge Source #

Represents a directional edge in a directed acyclic graph (DAG).

See: newCodeGenEdge smart constructor.

Constructors

CodeGenEdge' 

Fields

Instances

Instances details
FromJSON CodeGenEdge Source # 
Instance details

Defined in Amazonka.Glue.Types.CodeGenEdge

ToJSON CodeGenEdge Source # 
Instance details

Defined in Amazonka.Glue.Types.CodeGenEdge

Generic CodeGenEdge Source # 
Instance details

Defined in Amazonka.Glue.Types.CodeGenEdge

Associated Types

type Rep CodeGenEdge :: Type -> Type #

Read CodeGenEdge Source # 
Instance details

Defined in Amazonka.Glue.Types.CodeGenEdge

Show CodeGenEdge Source # 
Instance details

Defined in Amazonka.Glue.Types.CodeGenEdge

NFData CodeGenEdge Source # 
Instance details

Defined in Amazonka.Glue.Types.CodeGenEdge

Methods

rnf :: CodeGenEdge -> () #

Eq CodeGenEdge Source # 
Instance details

Defined in Amazonka.Glue.Types.CodeGenEdge

Hashable CodeGenEdge Source # 
Instance details

Defined in Amazonka.Glue.Types.CodeGenEdge

type Rep CodeGenEdge Source # 
Instance details

Defined in Amazonka.Glue.Types.CodeGenEdge

type Rep CodeGenEdge = D1 ('MetaData "CodeGenEdge" "Amazonka.Glue.Types.CodeGenEdge" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "CodeGenEdge'" 'PrefixI 'True) (S1 ('MetaSel ('Just "targetParameter") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: (S1 ('MetaSel ('Just "source") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text) :*: S1 ('MetaSel ('Just "target") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text))))

newCodeGenEdge Source #

Create a value of CodeGenEdge with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:targetParameter:CodeGenEdge', codeGenEdge_targetParameter - The target of the edge.

$sel:source:CodeGenEdge', codeGenEdge_source - The ID of the node at which the edge starts.

$sel:target:CodeGenEdge', codeGenEdge_target - The ID of the node at which the edge ends.

codeGenEdge_source :: Lens' CodeGenEdge Text Source #

The ID of the node at which the edge starts.

codeGenEdge_target :: Lens' CodeGenEdge Text Source #

The ID of the node at which the edge ends.

CodeGenNode

data CodeGenNode Source #

Represents a node in a directed acyclic graph (DAG)

See: newCodeGenNode smart constructor.

Constructors

CodeGenNode' 

Fields

Instances

Instances details
FromJSON CodeGenNode Source # 
Instance details

Defined in Amazonka.Glue.Types.CodeGenNode

ToJSON CodeGenNode Source # 
Instance details

Defined in Amazonka.Glue.Types.CodeGenNode

Generic CodeGenNode Source # 
Instance details

Defined in Amazonka.Glue.Types.CodeGenNode

Associated Types

type Rep CodeGenNode :: Type -> Type #

Read CodeGenNode Source # 
Instance details

Defined in Amazonka.Glue.Types.CodeGenNode

Show CodeGenNode Source # 
Instance details

Defined in Amazonka.Glue.Types.CodeGenNode

NFData CodeGenNode Source # 
Instance details

Defined in Amazonka.Glue.Types.CodeGenNode

Methods

rnf :: CodeGenNode -> () #

Eq CodeGenNode Source # 
Instance details

Defined in Amazonka.Glue.Types.CodeGenNode

Hashable CodeGenNode Source # 
Instance details

Defined in Amazonka.Glue.Types.CodeGenNode

type Rep CodeGenNode Source # 
Instance details

Defined in Amazonka.Glue.Types.CodeGenNode

type Rep CodeGenNode = D1 ('MetaData "CodeGenNode" "Amazonka.Glue.Types.CodeGenNode" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "CodeGenNode'" 'PrefixI 'True) ((S1 ('MetaSel ('Just "lineNumber") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Int)) :*: S1 ('MetaSel ('Just "id") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text)) :*: (S1 ('MetaSel ('Just "nodeType") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text) :*: S1 ('MetaSel ('Just "args") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 [CodeGenNodeArg]))))

newCodeGenNode Source #

Create a value of CodeGenNode with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:lineNumber:CodeGenNode', codeGenNode_lineNumber - The line number of the node.

$sel:id:CodeGenNode', codeGenNode_id - A node identifier that is unique within the node's graph.

$sel:nodeType:CodeGenNode', codeGenNode_nodeType - The type of node that this is.

$sel:args:CodeGenNode', codeGenNode_args - Properties of the node, in the form of name-value pairs.

codeGenNode_lineNumber :: Lens' CodeGenNode (Maybe Int) Source #

The line number of the node.

codeGenNode_id :: Lens' CodeGenNode Text Source #

A node identifier that is unique within the node's graph.

codeGenNode_nodeType :: Lens' CodeGenNode Text Source #

The type of node that this is.

codeGenNode_args :: Lens' CodeGenNode [CodeGenNodeArg] Source #

Properties of the node, in the form of name-value pairs.

CodeGenNodeArg

data CodeGenNodeArg Source #

An argument or property of a node.

See: newCodeGenNodeArg smart constructor.

Constructors

CodeGenNodeArg' 

Fields

  • param :: Maybe Bool

    True if the value is used as a parameter.

  • name :: Text

    The name of the argument or property.

  • value :: Text

    The value of the argument or property.

Instances

Instances details
FromJSON CodeGenNodeArg Source # 
Instance details

Defined in Amazonka.Glue.Types.CodeGenNodeArg

ToJSON CodeGenNodeArg Source # 
Instance details

Defined in Amazonka.Glue.Types.CodeGenNodeArg

Generic CodeGenNodeArg Source # 
Instance details

Defined in Amazonka.Glue.Types.CodeGenNodeArg

Associated Types

type Rep CodeGenNodeArg :: Type -> Type #

Read CodeGenNodeArg Source # 
Instance details

Defined in Amazonka.Glue.Types.CodeGenNodeArg

Show CodeGenNodeArg Source # 
Instance details

Defined in Amazonka.Glue.Types.CodeGenNodeArg

NFData CodeGenNodeArg Source # 
Instance details

Defined in Amazonka.Glue.Types.CodeGenNodeArg

Methods

rnf :: CodeGenNodeArg -> () #

Eq CodeGenNodeArg Source # 
Instance details

Defined in Amazonka.Glue.Types.CodeGenNodeArg

Hashable CodeGenNodeArg Source # 
Instance details

Defined in Amazonka.Glue.Types.CodeGenNodeArg

type Rep CodeGenNodeArg Source # 
Instance details

Defined in Amazonka.Glue.Types.CodeGenNodeArg

type Rep CodeGenNodeArg = D1 ('MetaData "CodeGenNodeArg" "Amazonka.Glue.Types.CodeGenNodeArg" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "CodeGenNodeArg'" 'PrefixI 'True) (S1 ('MetaSel ('Just "param") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Bool)) :*: (S1 ('MetaSel ('Just "name") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text) :*: S1 ('MetaSel ('Just "value") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text))))

newCodeGenNodeArg Source #

Create a value of CodeGenNodeArg with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:param:CodeGenNodeArg', codeGenNodeArg_param - True if the value is used as a parameter.

$sel:name:CodeGenNodeArg', codeGenNodeArg_name - The name of the argument or property.

$sel:value:CodeGenNodeArg', codeGenNodeArg_value - The value of the argument or property.

codeGenNodeArg_param :: Lens' CodeGenNodeArg (Maybe Bool) Source #

True if the value is used as a parameter.

codeGenNodeArg_name :: Lens' CodeGenNodeArg Text Source #

The name of the argument or property.

codeGenNodeArg_value :: Lens' CodeGenNodeArg Text Source #

The value of the argument or property.

Column

data Column Source #

A column in a Table.

See: newColumn smart constructor.

Constructors

Column' 

Fields

Instances

Instances details
FromJSON Column Source # 
Instance details

Defined in Amazonka.Glue.Types.Column

ToJSON Column Source # 
Instance details

Defined in Amazonka.Glue.Types.Column

Generic Column Source # 
Instance details

Defined in Amazonka.Glue.Types.Column

Associated Types

type Rep Column :: Type -> Type #

Methods

from :: Column -> Rep Column x #

to :: Rep Column x -> Column #

Read Column Source # 
Instance details

Defined in Amazonka.Glue.Types.Column

Show Column Source # 
Instance details

Defined in Amazonka.Glue.Types.Column

NFData Column Source # 
Instance details

Defined in Amazonka.Glue.Types.Column

Methods

rnf :: Column -> () #

Eq Column Source # 
Instance details

Defined in Amazonka.Glue.Types.Column

Methods

(==) :: Column -> Column -> Bool #

(/=) :: Column -> Column -> Bool #

Hashable Column Source # 
Instance details

Defined in Amazonka.Glue.Types.Column

Methods

hashWithSalt :: Int -> Column -> Int #

hash :: Column -> Int #

type Rep Column Source # 
Instance details

Defined in Amazonka.Glue.Types.Column

type Rep Column = D1 ('MetaData "Column" "Amazonka.Glue.Types.Column" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "Column'" 'PrefixI 'True) ((S1 ('MetaSel ('Just "comment") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "parameters") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe (HashMap Text Text)))) :*: (S1 ('MetaSel ('Just "type'") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "name") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text))))

newColumn Source #

Create a value of Column with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:comment:Column', column_comment - A free-form text comment.

$sel:parameters:Column', column_parameters - These key-value pairs define properties associated with the column.

$sel:type':Column', column_type - The data type of the Column.

$sel:name:Column', column_name - The name of the Column.

column_comment :: Lens' Column (Maybe Text) Source #

A free-form text comment.

column_parameters :: Lens' Column (Maybe (HashMap Text Text)) Source #

These key-value pairs define properties associated with the column.

column_type :: Lens' Column (Maybe Text) Source #

The data type of the Column.

column_name :: Lens' Column Text Source #

The name of the Column.

ColumnError

data ColumnError Source #

Encapsulates a column name that failed and the reason for failure.

See: newColumnError smart constructor.

Constructors

ColumnError' 

Fields

Instances

Instances details
FromJSON ColumnError Source # 
Instance details

Defined in Amazonka.Glue.Types.ColumnError

Generic ColumnError Source # 
Instance details

Defined in Amazonka.Glue.Types.ColumnError

Associated Types

type Rep ColumnError :: Type -> Type #

Read ColumnError Source # 
Instance details

Defined in Amazonka.Glue.Types.ColumnError

Show ColumnError Source # 
Instance details

Defined in Amazonka.Glue.Types.ColumnError

NFData ColumnError Source # 
Instance details

Defined in Amazonka.Glue.Types.ColumnError

Methods

rnf :: ColumnError -> () #

Eq ColumnError Source # 
Instance details

Defined in Amazonka.Glue.Types.ColumnError

Hashable ColumnError Source # 
Instance details

Defined in Amazonka.Glue.Types.ColumnError

type Rep ColumnError Source # 
Instance details

Defined in Amazonka.Glue.Types.ColumnError

type Rep ColumnError = D1 ('MetaData "ColumnError" "Amazonka.Glue.Types.ColumnError" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "ColumnError'" 'PrefixI 'True) (S1 ('MetaSel ('Just "columnName") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "error") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe ErrorDetail))))

newColumnError :: ColumnError Source #

Create a value of ColumnError with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:columnName:ColumnError', columnError_columnName - The name of the column that failed.

$sel:error:ColumnError', columnError_error - An error message with the reason for the failure of an operation.

columnError_columnName :: Lens' ColumnError (Maybe Text) Source #

The name of the column that failed.

columnError_error :: Lens' ColumnError (Maybe ErrorDetail) Source #

An error message with the reason for the failure of an operation.

ColumnImportance

data ColumnImportance Source #

A structure containing the column name and column importance score for a column.

Column importance helps you understand how columns contribute to your model, by identifying which columns in your records are more important than others.

See: newColumnImportance smart constructor.

Constructors

ColumnImportance' 

Fields

Instances

Instances details
FromJSON ColumnImportance Source # 
Instance details

Defined in Amazonka.Glue.Types.ColumnImportance

Generic ColumnImportance Source # 
Instance details

Defined in Amazonka.Glue.Types.ColumnImportance

Associated Types

type Rep ColumnImportance :: Type -> Type #

Read ColumnImportance Source # 
Instance details

Defined in Amazonka.Glue.Types.ColumnImportance

Show ColumnImportance Source # 
Instance details

Defined in Amazonka.Glue.Types.ColumnImportance

NFData ColumnImportance Source # 
Instance details

Defined in Amazonka.Glue.Types.ColumnImportance

Methods

rnf :: ColumnImportance -> () #

Eq ColumnImportance Source # 
Instance details

Defined in Amazonka.Glue.Types.ColumnImportance

Hashable ColumnImportance Source # 
Instance details

Defined in Amazonka.Glue.Types.ColumnImportance

type Rep ColumnImportance Source # 
Instance details

Defined in Amazonka.Glue.Types.ColumnImportance

type Rep ColumnImportance = D1 ('MetaData "ColumnImportance" "Amazonka.Glue.Types.ColumnImportance" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "ColumnImportance'" 'PrefixI 'True) (S1 ('MetaSel ('Just "columnName") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "importance") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Double))))

newColumnImportance :: ColumnImportance Source #

Create a value of ColumnImportance with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:columnName:ColumnImportance', columnImportance_columnName - The name of a column.

$sel:importance:ColumnImportance', columnImportance_importance - The column importance score for the column, as a decimal.

columnImportance_importance :: Lens' ColumnImportance (Maybe Double) Source #

The column importance score for the column, as a decimal.

ColumnRowFilter

data ColumnRowFilter Source #

See: newColumnRowFilter smart constructor.

Instances

Instances details
FromJSON ColumnRowFilter Source # 
Instance details

Defined in Amazonka.Glue.Types.ColumnRowFilter

Generic ColumnRowFilter Source # 
Instance details

Defined in Amazonka.Glue.Types.ColumnRowFilter

Associated Types

type Rep ColumnRowFilter :: Type -> Type #

Read ColumnRowFilter Source # 
Instance details

Defined in Amazonka.Glue.Types.ColumnRowFilter

Show ColumnRowFilter Source # 
Instance details

Defined in Amazonka.Glue.Types.ColumnRowFilter

NFData ColumnRowFilter Source # 
Instance details

Defined in Amazonka.Glue.Types.ColumnRowFilter

Methods

rnf :: ColumnRowFilter -> () #

Eq ColumnRowFilter Source # 
Instance details

Defined in Amazonka.Glue.Types.ColumnRowFilter

Hashable ColumnRowFilter Source # 
Instance details

Defined in Amazonka.Glue.Types.ColumnRowFilter

type Rep ColumnRowFilter Source # 
Instance details

Defined in Amazonka.Glue.Types.ColumnRowFilter

type Rep ColumnRowFilter = D1 ('MetaData "ColumnRowFilter" "Amazonka.Glue.Types.ColumnRowFilter" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "ColumnRowFilter'" 'PrefixI 'True) (S1 ('MetaSel ('Just "columnName") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "rowFilterExpression") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text))))

newColumnRowFilter :: ColumnRowFilter Source #

Create a value of ColumnRowFilter with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:columnName:ColumnRowFilter', columnRowFilter_columnName - Undocumented member.

$sel:rowFilterExpression:ColumnRowFilter', columnRowFilter_rowFilterExpression - Undocumented member.

ColumnStatistics

data ColumnStatistics Source #

Represents the generated column-level statistics for a table or partition.

See: newColumnStatistics smart constructor.

Constructors

ColumnStatistics' 

Fields

Instances

Instances details
FromJSON ColumnStatistics Source # 
Instance details

Defined in Amazonka.Glue.Types.ColumnStatistics

ToJSON ColumnStatistics Source # 
Instance details

Defined in Amazonka.Glue.Types.ColumnStatistics

Generic ColumnStatistics Source # 
Instance details

Defined in Amazonka.Glue.Types.ColumnStatistics

Associated Types

type Rep ColumnStatistics :: Type -> Type #

Read ColumnStatistics Source # 
Instance details

Defined in Amazonka.Glue.Types.ColumnStatistics

Show ColumnStatistics Source # 
Instance details

Defined in Amazonka.Glue.Types.ColumnStatistics

NFData ColumnStatistics Source # 
Instance details

Defined in Amazonka.Glue.Types.ColumnStatistics

Methods

rnf :: ColumnStatistics -> () #

Eq ColumnStatistics Source # 
Instance details

Defined in Amazonka.Glue.Types.ColumnStatistics

Hashable ColumnStatistics Source # 
Instance details

Defined in Amazonka.Glue.Types.ColumnStatistics

type Rep ColumnStatistics Source # 
Instance details

Defined in Amazonka.Glue.Types.ColumnStatistics

type Rep ColumnStatistics = D1 ('MetaData "ColumnStatistics" "Amazonka.Glue.Types.ColumnStatistics" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "ColumnStatistics'" 'PrefixI 'True) ((S1 ('MetaSel ('Just "columnName") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text) :*: S1 ('MetaSel ('Just "columnType") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text)) :*: (S1 ('MetaSel ('Just "analyzedTime") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 POSIX) :*: S1 ('MetaSel ('Just "statisticsData") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 ColumnStatisticsData))))

newColumnStatistics Source #

Create a value of ColumnStatistics with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:columnName:ColumnStatistics', columnStatistics_columnName - Name of column which statistics belong to.

$sel:columnType:ColumnStatistics', columnStatistics_columnType - The data type of the column.

$sel:analyzedTime:ColumnStatistics', columnStatistics_analyzedTime - The timestamp of when column statistics were generated.

$sel:statisticsData:ColumnStatistics', columnStatistics_statisticsData - A ColumnStatisticData object that contains the statistics data values.

columnStatistics_columnName :: Lens' ColumnStatistics Text Source #

Name of column which statistics belong to.

columnStatistics_analyzedTime :: Lens' ColumnStatistics UTCTime Source #

The timestamp of when column statistics were generated.

columnStatistics_statisticsData :: Lens' ColumnStatistics ColumnStatisticsData Source #

A ColumnStatisticData object that contains the statistics data values.

ColumnStatisticsData

data ColumnStatisticsData Source #

Contains the individual types of column statistics data. Only one data object should be set and indicated by the Type attribute.

See: newColumnStatisticsData smart constructor.

Constructors

ColumnStatisticsData' 

Fields

Instances

Instances details
FromJSON ColumnStatisticsData Source # 
Instance details

Defined in Amazonka.Glue.Types.ColumnStatisticsData

ToJSON ColumnStatisticsData Source # 
Instance details

Defined in Amazonka.Glue.Types.ColumnStatisticsData

Generic ColumnStatisticsData Source # 
Instance details

Defined in Amazonka.Glue.Types.ColumnStatisticsData

Associated Types

type Rep ColumnStatisticsData :: Type -> Type #

Read ColumnStatisticsData Source # 
Instance details

Defined in Amazonka.Glue.Types.ColumnStatisticsData

Show ColumnStatisticsData Source # 
Instance details

Defined in Amazonka.Glue.Types.ColumnStatisticsData

NFData ColumnStatisticsData Source # 
Instance details

Defined in Amazonka.Glue.Types.ColumnStatisticsData

Methods

rnf :: ColumnStatisticsData -> () #

Eq ColumnStatisticsData Source # 
Instance details

Defined in Amazonka.Glue.Types.ColumnStatisticsData

Hashable ColumnStatisticsData Source # 
Instance details

Defined in Amazonka.Glue.Types.ColumnStatisticsData

type Rep ColumnStatisticsData Source # 
Instance details

Defined in Amazonka.Glue.Types.ColumnStatisticsData

ColumnStatisticsError

data ColumnStatisticsError Source #

Encapsulates a ColumnStatistics object that failed and the reason for failure.

See: newColumnStatisticsError smart constructor.

Constructors

ColumnStatisticsError' 

Fields

Instances

Instances details
FromJSON ColumnStatisticsError Source # 
Instance details

Defined in Amazonka.Glue.Types.ColumnStatisticsError

Generic ColumnStatisticsError Source # 
Instance details

Defined in Amazonka.Glue.Types.ColumnStatisticsError

Associated Types

type Rep ColumnStatisticsError :: Type -> Type #

Read ColumnStatisticsError Source # 
Instance details

Defined in Amazonka.Glue.Types.ColumnStatisticsError

Show ColumnStatisticsError Source # 
Instance details

Defined in Amazonka.Glue.Types.ColumnStatisticsError

NFData ColumnStatisticsError Source # 
Instance details

Defined in Amazonka.Glue.Types.ColumnStatisticsError

Methods

rnf :: ColumnStatisticsError -> () #

Eq ColumnStatisticsError Source # 
Instance details

Defined in Amazonka.Glue.Types.ColumnStatisticsError

Hashable ColumnStatisticsError Source # 
Instance details

Defined in Amazonka.Glue.Types.ColumnStatisticsError

type Rep ColumnStatisticsError Source # 
Instance details

Defined in Amazonka.Glue.Types.ColumnStatisticsError

type Rep ColumnStatisticsError = D1 ('MetaData "ColumnStatisticsError" "Amazonka.Glue.Types.ColumnStatisticsError" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "ColumnStatisticsError'" 'PrefixI 'True) (S1 ('MetaSel ('Just "columnStatistics") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe ColumnStatistics)) :*: S1 ('MetaSel ('Just "error") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe ErrorDetail))))

newColumnStatisticsError :: ColumnStatisticsError Source #

Create a value of ColumnStatisticsError with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:columnStatistics:ColumnStatisticsError', columnStatisticsError_columnStatistics - The ColumnStatistics of the column.

$sel:error:ColumnStatisticsError', columnStatisticsError_error - An error message with the reason for the failure of an operation.

columnStatisticsError_error :: Lens' ColumnStatisticsError (Maybe ErrorDetail) Source #

An error message with the reason for the failure of an operation.

Condition

data Condition Source #

Defines a condition under which a trigger fires.

See: newCondition smart constructor.

Constructors

Condition' 

Fields

  • crawlState :: Maybe CrawlState

    The state of the crawler to which this condition applies.

  • crawlerName :: Maybe Text

    The name of the crawler to which this condition applies.

  • jobName :: Maybe Text

    The name of the job whose JobRuns this condition applies to, and on which this trigger waits.

  • logicalOperator :: Maybe LogicalOperator

    A logical operator.

  • state :: Maybe JobRunState

    The condition state. Currently, the only job states that a trigger can listen for are SUCCEEDED, STOPPED, FAILED, and TIMEOUT. The only crawler states that a trigger can listen for are SUCCEEDED, FAILED, and CANCELLED.

Instances

Instances details
FromJSON Condition Source # 
Instance details

Defined in Amazonka.Glue.Types.Condition

ToJSON Condition Source # 
Instance details

Defined in Amazonka.Glue.Types.Condition

Generic Condition Source # 
Instance details

Defined in Amazonka.Glue.Types.Condition

Associated Types

type Rep Condition :: Type -> Type #

Read Condition Source # 
Instance details

Defined in Amazonka.Glue.Types.Condition

Show Condition Source # 
Instance details

Defined in Amazonka.Glue.Types.Condition

NFData Condition Source # 
Instance details

Defined in Amazonka.Glue.Types.Condition

Methods

rnf :: Condition -> () #

Eq Condition Source # 
Instance details

Defined in Amazonka.Glue.Types.Condition

Hashable Condition Source # 
Instance details

Defined in Amazonka.Glue.Types.Condition

type Rep Condition Source # 
Instance details

Defined in Amazonka.Glue.Types.Condition

newCondition :: Condition Source #

Create a value of Condition with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:crawlState:Condition', condition_crawlState - The state of the crawler to which this condition applies.

$sel:crawlerName:Condition', condition_crawlerName - The name of the crawler to which this condition applies.

$sel:jobName:Condition', condition_jobName - The name of the job whose JobRuns this condition applies to, and on which this trigger waits.

$sel:logicalOperator:Condition', condition_logicalOperator - A logical operator.

$sel:state:Condition', condition_state - The condition state. Currently, the only job states that a trigger can listen for are SUCCEEDED, STOPPED, FAILED, and TIMEOUT. The only crawler states that a trigger can listen for are SUCCEEDED, FAILED, and CANCELLED.

condition_crawlState :: Lens' Condition (Maybe CrawlState) Source #

The state of the crawler to which this condition applies.

condition_crawlerName :: Lens' Condition (Maybe Text) Source #

The name of the crawler to which this condition applies.

condition_jobName :: Lens' Condition (Maybe Text) Source #

The name of the job whose JobRuns this condition applies to, and on which this trigger waits.

condition_state :: Lens' Condition (Maybe JobRunState) Source #

The condition state. Currently, the only job states that a trigger can listen for are SUCCEEDED, STOPPED, FAILED, and TIMEOUT. The only crawler states that a trigger can listen for are SUCCEEDED, FAILED, and CANCELLED.

ConfusionMatrix

data ConfusionMatrix Source #

The confusion matrix shows you what your transform is predicting accurately and what types of errors it is making.

For more information, see Confusion matrix in Wikipedia.

See: newConfusionMatrix smart constructor.

Constructors

ConfusionMatrix' 

Fields

  • numFalseNegatives :: Maybe Integer

    The number of matches in the data that the transform didn't find, in the confusion matrix for your transform.

  • numFalsePositives :: Maybe Integer

    The number of nonmatches in the data that the transform incorrectly classified as a match, in the confusion matrix for your transform.

  • numTrueNegatives :: Maybe Integer

    The number of nonmatches in the data that the transform correctly rejected, in the confusion matrix for your transform.

  • numTruePositives :: Maybe Integer

    The number of matches in the data that the transform correctly found, in the confusion matrix for your transform.

Instances

Instances details
FromJSON ConfusionMatrix Source # 
Instance details

Defined in Amazonka.Glue.Types.ConfusionMatrix

Generic ConfusionMatrix Source # 
Instance details

Defined in Amazonka.Glue.Types.ConfusionMatrix

Associated Types

type Rep ConfusionMatrix :: Type -> Type #

Read ConfusionMatrix Source # 
Instance details

Defined in Amazonka.Glue.Types.ConfusionMatrix

Show ConfusionMatrix Source # 
Instance details

Defined in Amazonka.Glue.Types.ConfusionMatrix

NFData ConfusionMatrix Source # 
Instance details

Defined in Amazonka.Glue.Types.ConfusionMatrix

Methods

rnf :: ConfusionMatrix -> () #

Eq ConfusionMatrix Source # 
Instance details

Defined in Amazonka.Glue.Types.ConfusionMatrix

Hashable ConfusionMatrix Source # 
Instance details

Defined in Amazonka.Glue.Types.ConfusionMatrix

type Rep ConfusionMatrix Source # 
Instance details

Defined in Amazonka.Glue.Types.ConfusionMatrix

type Rep ConfusionMatrix = D1 ('MetaData "ConfusionMatrix" "Amazonka.Glue.Types.ConfusionMatrix" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "ConfusionMatrix'" 'PrefixI 'True) ((S1 ('MetaSel ('Just "numFalseNegatives") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Integer)) :*: S1 ('MetaSel ('Just "numFalsePositives") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Integer))) :*: (S1 ('MetaSel ('Just "numTrueNegatives") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Integer)) :*: S1 ('MetaSel ('Just "numTruePositives") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Integer)))))

newConfusionMatrix :: ConfusionMatrix Source #

Create a value of ConfusionMatrix with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:numFalseNegatives:ConfusionMatrix', confusionMatrix_numFalseNegatives - The number of matches in the data that the transform didn't find, in the confusion matrix for your transform.

$sel:numFalsePositives:ConfusionMatrix', confusionMatrix_numFalsePositives - The number of nonmatches in the data that the transform incorrectly classified as a match, in the confusion matrix for your transform.

$sel:numTrueNegatives:ConfusionMatrix', confusionMatrix_numTrueNegatives - The number of nonmatches in the data that the transform correctly rejected, in the confusion matrix for your transform.

$sel:numTruePositives:ConfusionMatrix', confusionMatrix_numTruePositives - The number of matches in the data that the transform correctly found, in the confusion matrix for your transform.

confusionMatrix_numFalseNegatives :: Lens' ConfusionMatrix (Maybe Integer) Source #

The number of matches in the data that the transform didn't find, in the confusion matrix for your transform.

confusionMatrix_numFalsePositives :: Lens' ConfusionMatrix (Maybe Integer) Source #

The number of nonmatches in the data that the transform incorrectly classified as a match, in the confusion matrix for your transform.

confusionMatrix_numTrueNegatives :: Lens' ConfusionMatrix (Maybe Integer) Source #

The number of nonmatches in the data that the transform correctly rejected, in the confusion matrix for your transform.

confusionMatrix_numTruePositives :: Lens' ConfusionMatrix (Maybe Integer) Source #

The number of matches in the data that the transform correctly found, in the confusion matrix for your transform.

Connection

data Connection Source #

Defines a connection to a data source.

See: newConnection smart constructor.

Constructors

Connection' 

Fields

  • connectionProperties :: Maybe (HashMap ConnectionPropertyKey Text)

    These key-value pairs define parameters for the connection:

    • HOST - The host URI: either the fully qualified domain name (FQDN) or the IPv4 address of the database host.
    • PORT - The port number, between 1024 and 65535, of the port on which the database host is listening for database connections.
    • USER_NAME - The name under which to log in to the database. The value string for USER_NAME is "USERNAME".
    • PASSWORD - A password, if one is used, for the user name.
    • ENCRYPTED_PASSWORD - When you enable connection password protection by setting ConnectionPasswordEncryption in the Data Catalog encryption settings, this field stores the encrypted password.
    • JDBC_DRIVER_JAR_URI - The Amazon Simple Storage Service (Amazon S3) path of the JAR file that contains the JDBC driver to use.
    • JDBC_DRIVER_CLASS_NAME - The class name of the JDBC driver to use.
    • JDBC_ENGINE - The name of the JDBC engine to use.
    • JDBC_ENGINE_VERSION - The version of the JDBC engine to use.
    • CONFIG_FILES - (Reserved for future use.)
    • INSTANCE_ID - The instance ID to use.
    • JDBC_CONNECTION_URL - The URL for connecting to a JDBC data source.
    • JDBC_ENFORCE_SSL - A Boolean string (true, false) specifying whether Secure Sockets Layer (SSL) with hostname matching is enforced for the JDBC connection on the client. The default is false.
    • CUSTOM_JDBC_CERT - An Amazon S3 location specifying the customer's root certificate. Glue uses this root certificate to validate the customer’s certificate when connecting to the customer database. Glue only handles X.509 certificates. The certificate provided must be DER-encoded and supplied in Base64 encoding PEM format.
    • SKIP_CUSTOM_JDBC_CERT_VALIDATION - By default, this is false. Glue validates the Signature algorithm and Subject Public Key Algorithm for the customer certificate. The only permitted algorithms for the Signature algorithm are SHA256withRSA, SHA384withRSA or SHA512withRSA. For the Subject Public Key Algorithm, the key length must be at least 2048. You can set the value of this property to true to skip Glue’s validation of the customer certificate.
    • CUSTOM_JDBC_CERT_STRING - A custom JDBC certificate string which is used for domain match or distinguished name match to prevent a man-in-the-middle attack. In Oracle database, this is used as the SSL_SERVER_CERT_DN; in Microsoft SQL Server, this is used as the hostNameInCertificate.
    • CONNECTION_URL - The URL for connecting to a general (non-JDBC) data source.
    • SECRET_ID - The secret ID used for the secret manager of credentials.
    • CONNECTOR_URL - The connector URL for a MARKETPLACE or CUSTOM connection.
    • CONNECTOR_TYPE - The connector type for a MARKETPLACE or CUSTOM connection.
    • CONNECTOR_CLASS_NAME - The connector class name for a MARKETPLACE or CUSTOM connection.
    • KAFKA_BOOTSTRAP_SERVERS - A comma-separated list of host and port pairs that are the addresses of the Apache Kafka brokers in a Kafka cluster to which a Kafka client will connect to and bootstrap itself.
    • KAFKA_SSL_ENABLED - Whether to enable or disable SSL on an Apache Kafka connection. Default value is "true".
    • KAFKA_CUSTOM_CERT - The Amazon S3 URL for the private CA cert file (.pem format). The default is an empty string.
    • KAFKA_SKIP_CUSTOM_CERT_VALIDATION - Whether to skip the validation of the CA cert file or not. Glue validates for three algorithms: SHA256withRSA, SHA384withRSA and SHA512withRSA. Default value is "false".
    • KAFKA_CLIENT_KEYSTORE - The Amazon S3 location of the client keystore file for Kafka client side authentication (Optional).
    • KAFKA_CLIENT_KEYSTORE_PASSWORD - The password to access the provided keystore (Optional).
    • KAFKA_CLIENT_KEY_PASSWORD - A keystore can consist of multiple keys, so this is the password to access the client key to be used with the Kafka server side key (Optional).
    • ENCRYPTED_KAFKA_CLIENT_KEYSTORE_PASSWORD - The encrypted version of the Kafka client keystore password (if the user has the Glue encrypt passwords setting selected).
    • ENCRYPTED_KAFKA_CLIENT_KEY_PASSWORD - The encrypted version of the Kafka client key password (if the user has the Glue encrypt passwords setting selected).
    • KAFKA_SASL_MECHANISM - "SCRAM-SHA-512" or "GSSAPI". These are the two supported SASL Mechanisms.
    • KAFKA_SASL_SCRAM_USERNAME - A plaintext username used to authenticate with the "SCRAM-SHA-512" mechanism.
    • KAFKA_SASL_SCRAM_PASSWORD - A plaintext password used to authenticate with the "SCRAM-SHA-512" mechanism.
    • ENCRYPTED_KAFKA_SASL_SCRAM_PASSWORD - The encrypted version of the Kafka SASL SCRAM password (if the user has the Glue encrypt passwords setting selected).
    • KAFKA_SASL_GSSAPI_KEYTAB - The S3 location of a Kerberos keytab file. A keytab stores long-term keys for one or more principals. For more information, see MIT Kerberos Documentation: Keytab.
    • KAFKA_SASL_GSSAPI_KRB5_CONF - The S3 location of a Kerberos krb5.conf file. A krb5.conf stores Kerberos configuration information, such as the location of the KDC server. For more information, see MIT Kerberos Documentation: krb5.conf.
    • KAFKA_SASL_GSSAPI_SERVICE - The Kerberos service name, as set with sasl.kerberos.service.name in your Kafka Configuration.
    • KAFKA_SASL_GSSAPI_PRINCIPAL - The name of the Kerberos princial used by Glue. For more information, see Kafka Documentation: Configuring Kafka Brokers.
  • connectionType :: Maybe ConnectionType

    The type of the connection. Currently, SFTP is not supported.

  • creationTime :: Maybe POSIX

    The time that this connection definition was created.

  • description :: Maybe Text

    The description of the connection.

  • lastUpdatedBy :: Maybe Text

    The user, group, or role that last updated this connection definition.

  • lastUpdatedTime :: Maybe POSIX

    The last time that this connection definition was updated.

  • matchCriteria :: Maybe [Text]

    A list of criteria that can be used in selecting this connection.

  • name :: Maybe Text

    The name of the connection definition.

  • physicalConnectionRequirements :: Maybe PhysicalConnectionRequirements

    A map of physical connection requirements, such as virtual private cloud (VPC) and SecurityGroup, that are needed to make this connection successfully.

Instances

Instances details
FromJSON Connection Source # 
Instance details

Defined in Amazonka.Glue.Types.Connection

Generic Connection Source # 
Instance details

Defined in Amazonka.Glue.Types.Connection

Associated Types

type Rep Connection :: Type -> Type #

Read Connection Source # 
Instance details

Defined in Amazonka.Glue.Types.Connection

Show Connection Source # 
Instance details

Defined in Amazonka.Glue.Types.Connection

NFData Connection Source # 
Instance details

Defined in Amazonka.Glue.Types.Connection

Methods

rnf :: Connection -> () #

Eq Connection Source # 
Instance details

Defined in Amazonka.Glue.Types.Connection

Hashable Connection Source # 
Instance details

Defined in Amazonka.Glue.Types.Connection

type Rep Connection Source # 
Instance details

Defined in Amazonka.Glue.Types.Connection

newConnection :: Connection Source #

Create a value of Connection with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:connectionProperties:Connection', connection_connectionProperties - These key-value pairs define parameters for the connection:

  • HOST - The host URI: either the fully qualified domain name (FQDN) or the IPv4 address of the database host.
  • PORT - The port number, between 1024 and 65535, of the port on which the database host is listening for database connections.
  • USER_NAME - The name under which to log in to the database. The value string for USER_NAME is "USERNAME".
  • PASSWORD - A password, if one is used, for the user name.
  • ENCRYPTED_PASSWORD - When you enable connection password protection by setting ConnectionPasswordEncryption in the Data Catalog encryption settings, this field stores the encrypted password.
  • JDBC_DRIVER_JAR_URI - The Amazon Simple Storage Service (Amazon S3) path of the JAR file that contains the JDBC driver to use.
  • JDBC_DRIVER_CLASS_NAME - The class name of the JDBC driver to use.
  • JDBC_ENGINE - The name of the JDBC engine to use.
  • JDBC_ENGINE_VERSION - The version of the JDBC engine to use.
  • CONFIG_FILES - (Reserved for future use.)
  • INSTANCE_ID - The instance ID to use.
  • JDBC_CONNECTION_URL - The URL for connecting to a JDBC data source.
  • JDBC_ENFORCE_SSL - A Boolean string (true, false) specifying whether Secure Sockets Layer (SSL) with hostname matching is enforced for the JDBC connection on the client. The default is false.
  • CUSTOM_JDBC_CERT - An Amazon S3 location specifying the customer's root certificate. Glue uses this root certificate to validate the customer’s certificate when connecting to the customer database. Glue only handles X.509 certificates. The certificate provided must be DER-encoded and supplied in Base64 encoding PEM format.
  • SKIP_CUSTOM_JDBC_CERT_VALIDATION - By default, this is false. Glue validates the Signature algorithm and Subject Public Key Algorithm for the customer certificate. The only permitted algorithms for the Signature algorithm are SHA256withRSA, SHA384withRSA or SHA512withRSA. For the Subject Public Key Algorithm, the key length must be at least 2048. You can set the value of this property to true to skip Glue’s validation of the customer certificate.
  • CUSTOM_JDBC_CERT_STRING - A custom JDBC certificate string which is used for domain match or distinguished name match to prevent a man-in-the-middle attack. In Oracle database, this is used as the SSL_SERVER_CERT_DN; in Microsoft SQL Server, this is used as the hostNameInCertificate.
  • CONNECTION_URL - The URL for connecting to a general (non-JDBC) data source.
  • SECRET_ID - The secret ID used for the secret manager of credentials.
  • CONNECTOR_URL - The connector URL for a MARKETPLACE or CUSTOM connection.
  • CONNECTOR_TYPE - The connector type for a MARKETPLACE or CUSTOM connection.
  • CONNECTOR_CLASS_NAME - The connector class name for a MARKETPLACE or CUSTOM connection.
  • KAFKA_BOOTSTRAP_SERVERS - A comma-separated list of host and port pairs that are the addresses of the Apache Kafka brokers in a Kafka cluster to which a Kafka client will connect to and bootstrap itself.
  • KAFKA_SSL_ENABLED - Whether to enable or disable SSL on an Apache Kafka connection. Default value is "true".
  • KAFKA_CUSTOM_CERT - The Amazon S3 URL for the private CA cert file (.pem format). The default is an empty string.
  • KAFKA_SKIP_CUSTOM_CERT_VALIDATION - Whether to skip the validation of the CA cert file or not. Glue validates for three algorithms: SHA256withRSA, SHA384withRSA and SHA512withRSA. Default value is "false".
  • KAFKA_CLIENT_KEYSTORE - The Amazon S3 location of the client keystore file for Kafka client side authentication (Optional).
  • KAFKA_CLIENT_KEYSTORE_PASSWORD - The password to access the provided keystore (Optional).
  • KAFKA_CLIENT_KEY_PASSWORD - A keystore can consist of multiple keys, so this is the password to access the client key to be used with the Kafka server side key (Optional).
  • ENCRYPTED_KAFKA_CLIENT_KEYSTORE_PASSWORD - The encrypted version of the Kafka client keystore password (if the user has the Glue encrypt passwords setting selected).
  • ENCRYPTED_KAFKA_CLIENT_KEY_PASSWORD - The encrypted version of the Kafka client key password (if the user has the Glue encrypt passwords setting selected).
  • KAFKA_SASL_MECHANISM - "SCRAM-SHA-512" or "GSSAPI". These are the two supported SASL Mechanisms.
  • KAFKA_SASL_SCRAM_USERNAME - A plaintext username used to authenticate with the "SCRAM-SHA-512" mechanism.
  • KAFKA_SASL_SCRAM_PASSWORD - A plaintext password used to authenticate with the "SCRAM-SHA-512" mechanism.
  • ENCRYPTED_KAFKA_SASL_SCRAM_PASSWORD - The encrypted version of the Kafka SASL SCRAM password (if the user has the Glue encrypt passwords setting selected).
  • KAFKA_SASL_GSSAPI_KEYTAB - The S3 location of a Kerberos keytab file. A keytab stores long-term keys for one or more principals. For more information, see MIT Kerberos Documentation: Keytab.
  • KAFKA_SASL_GSSAPI_KRB5_CONF - The S3 location of a Kerberos krb5.conf file. A krb5.conf stores Kerberos configuration information, such as the location of the KDC server. For more information, see MIT Kerberos Documentation: krb5.conf.
  • KAFKA_SASL_GSSAPI_SERVICE - The Kerberos service name, as set with sasl.kerberos.service.name in your Kafka Configuration.
  • KAFKA_SASL_GSSAPI_PRINCIPAL - The name of the Kerberos princial used by Glue. For more information, see Kafka Documentation: Configuring Kafka Brokers.

$sel:connectionType:Connection', connection_connectionType - The type of the connection. Currently, SFTP is not supported.

$sel:creationTime:Connection', connection_creationTime - The time that this connection definition was created.

$sel:description:Connection', connection_description - The description of the connection.

$sel:lastUpdatedBy:Connection', connection_lastUpdatedBy - The user, group, or role that last updated this connection definition.

$sel:lastUpdatedTime:Connection', connection_lastUpdatedTime - The last time that this connection definition was updated.

$sel:matchCriteria:Connection', connection_matchCriteria - A list of criteria that can be used in selecting this connection.

$sel:name:Connection', connection_name - The name of the connection definition.

$sel:physicalConnectionRequirements:Connection', connection_physicalConnectionRequirements - A map of physical connection requirements, such as virtual private cloud (VPC) and SecurityGroup, that are needed to make this connection successfully.

connection_connectionProperties :: Lens' Connection (Maybe (HashMap ConnectionPropertyKey Text)) Source #

These key-value pairs define parameters for the connection:

  • HOST - The host URI: either the fully qualified domain name (FQDN) or the IPv4 address of the database host.
  • PORT - The port number, between 1024 and 65535, of the port on which the database host is listening for database connections.
  • USER_NAME - The name under which to log in to the database. The value string for USER_NAME is "USERNAME".
  • PASSWORD - A password, if one is used, for the user name.
  • ENCRYPTED_PASSWORD - When you enable connection password protection by setting ConnectionPasswordEncryption in the Data Catalog encryption settings, this field stores the encrypted password.
  • JDBC_DRIVER_JAR_URI - The Amazon Simple Storage Service (Amazon S3) path of the JAR file that contains the JDBC driver to use.
  • JDBC_DRIVER_CLASS_NAME - The class name of the JDBC driver to use.
  • JDBC_ENGINE - The name of the JDBC engine to use.
  • JDBC_ENGINE_VERSION - The version of the JDBC engine to use.
  • CONFIG_FILES - (Reserved for future use.)
  • INSTANCE_ID - The instance ID to use.
  • JDBC_CONNECTION_URL - The URL for connecting to a JDBC data source.
  • JDBC_ENFORCE_SSL - A Boolean string (true, false) specifying whether Secure Sockets Layer (SSL) with hostname matching is enforced for the JDBC connection on the client. The default is false.
  • CUSTOM_JDBC_CERT - An Amazon S3 location specifying the customer's root certificate. Glue uses this root certificate to validate the customer’s certificate when connecting to the customer database. Glue only handles X.509 certificates. The certificate provided must be DER-encoded and supplied in Base64 encoding PEM format.
  • SKIP_CUSTOM_JDBC_CERT_VALIDATION - By default, this is false. Glue validates the Signature algorithm and Subject Public Key Algorithm for the customer certificate. The only permitted algorithms for the Signature algorithm are SHA256withRSA, SHA384withRSA or SHA512withRSA. For the Subject Public Key Algorithm, the key length must be at least 2048. You can set the value of this property to true to skip Glue’s validation of the customer certificate.
  • CUSTOM_JDBC_CERT_STRING - A custom JDBC certificate string which is used for domain match or distinguished name match to prevent a man-in-the-middle attack. In Oracle database, this is used as the SSL_SERVER_CERT_DN; in Microsoft SQL Server, this is used as the hostNameInCertificate.
  • CONNECTION_URL - The URL for connecting to a general (non-JDBC) data source.
  • SECRET_ID - The secret ID used for the secret manager of credentials.
  • CONNECTOR_URL - The connector URL for a MARKETPLACE or CUSTOM connection.
  • CONNECTOR_TYPE - The connector type for a MARKETPLACE or CUSTOM connection.
  • CONNECTOR_CLASS_NAME - The connector class name for a MARKETPLACE or CUSTOM connection.
  • KAFKA_BOOTSTRAP_SERVERS - A comma-separated list of host and port pairs that are the addresses of the Apache Kafka brokers in a Kafka cluster to which a Kafka client will connect to and bootstrap itself.
  • KAFKA_SSL_ENABLED - Whether to enable or disable SSL on an Apache Kafka connection. Default value is "true".
  • KAFKA_CUSTOM_CERT - The Amazon S3 URL for the private CA cert file (.pem format). The default is an empty string.
  • KAFKA_SKIP_CUSTOM_CERT_VALIDATION - Whether to skip the validation of the CA cert file or not. Glue validates for three algorithms: SHA256withRSA, SHA384withRSA and SHA512withRSA. Default value is "false".
  • KAFKA_CLIENT_KEYSTORE - The Amazon S3 location of the client keystore file for Kafka client side authentication (Optional).
  • KAFKA_CLIENT_KEYSTORE_PASSWORD - The password to access the provided keystore (Optional).
  • KAFKA_CLIENT_KEY_PASSWORD - A keystore can consist of multiple keys, so this is the password to access the client key to be used with the Kafka server side key (Optional).
  • ENCRYPTED_KAFKA_CLIENT_KEYSTORE_PASSWORD - The encrypted version of the Kafka client keystore password (if the user has the Glue encrypt passwords setting selected).
  • ENCRYPTED_KAFKA_CLIENT_KEY_PASSWORD - The encrypted version of the Kafka client key password (if the user has the Glue encrypt passwords setting selected).
  • KAFKA_SASL_MECHANISM - "SCRAM-SHA-512" or "GSSAPI". These are the two supported SASL Mechanisms.
  • KAFKA_SASL_SCRAM_USERNAME - A plaintext username used to authenticate with the "SCRAM-SHA-512" mechanism.
  • KAFKA_SASL_SCRAM_PASSWORD - A plaintext password used to authenticate with the "SCRAM-SHA-512" mechanism.
  • ENCRYPTED_KAFKA_SASL_SCRAM_PASSWORD - The encrypted version of the Kafka SASL SCRAM password (if the user has the Glue encrypt passwords setting selected).
  • KAFKA_SASL_GSSAPI_KEYTAB - The S3 location of a Kerberos keytab file. A keytab stores long-term keys for one or more principals. For more information, see MIT Kerberos Documentation: Keytab.
  • KAFKA_SASL_GSSAPI_KRB5_CONF - The S3 location of a Kerberos krb5.conf file. A krb5.conf stores Kerberos configuration information, such as the location of the KDC server. For more information, see MIT Kerberos Documentation: krb5.conf.
  • KAFKA_SASL_GSSAPI_SERVICE - The Kerberos service name, as set with sasl.kerberos.service.name in your Kafka Configuration.
  • KAFKA_SASL_GSSAPI_PRINCIPAL - The name of the Kerberos princial used by Glue. For more information, see Kafka Documentation: Configuring Kafka Brokers.

connection_connectionType :: Lens' Connection (Maybe ConnectionType) Source #

The type of the connection. Currently, SFTP is not supported.

connection_creationTime :: Lens' Connection (Maybe UTCTime) Source #

The time that this connection definition was created.

connection_description :: Lens' Connection (Maybe Text) Source #

The description of the connection.

connection_lastUpdatedBy :: Lens' Connection (Maybe Text) Source #

The user, group, or role that last updated this connection definition.

connection_lastUpdatedTime :: Lens' Connection (Maybe UTCTime) Source #

The last time that this connection definition was updated.

connection_matchCriteria :: Lens' Connection (Maybe [Text]) Source #

A list of criteria that can be used in selecting this connection.

connection_name :: Lens' Connection (Maybe Text) Source #

The name of the connection definition.

connection_physicalConnectionRequirements :: Lens' Connection (Maybe PhysicalConnectionRequirements) Source #

A map of physical connection requirements, such as virtual private cloud (VPC) and SecurityGroup, that are needed to make this connection successfully.

ConnectionInput

data ConnectionInput Source #

A structure that is used to specify a connection to create or update.

See: newConnectionInput smart constructor.

Constructors

ConnectionInput' 

Fields

  • description :: Maybe Text

    The description of the connection.

  • matchCriteria :: Maybe [Text]

    A list of criteria that can be used in selecting this connection.

  • physicalConnectionRequirements :: Maybe PhysicalConnectionRequirements

    A map of physical connection requirements, such as virtual private cloud (VPC) and SecurityGroup, that are needed to successfully make this connection.

  • name :: Text

    The name of the connection.

  • connectionType :: ConnectionType

    The type of the connection. Currently, these types are supported:

    • JDBC - Designates a connection to a database through Java Database Connectivity (JDBC).
    • KAFKA - Designates a connection to an Apache Kafka streaming platform.
    • MONGODB - Designates a connection to a MongoDB document database.
    • NETWORK - Designates a network connection to a data source within an Amazon Virtual Private Cloud environment (Amazon VPC).
    • MARKETPLACE - Uses configuration settings contained in a connector purchased from Amazon Web Services Marketplace to read from and write to data stores that are not natively supported by Glue.
    • CUSTOM - Uses configuration settings contained in a custom connector to read from and write to data stores that are not natively supported by Glue.

    SFTP is not supported.

  • connectionProperties :: HashMap ConnectionPropertyKey Text

    These key-value pairs define parameters for the connection.

Instances

Instances details
ToJSON ConnectionInput Source # 
Instance details

Defined in Amazonka.Glue.Types.ConnectionInput

Generic ConnectionInput Source # 
Instance details

Defined in Amazonka.Glue.Types.ConnectionInput

Associated Types

type Rep ConnectionInput :: Type -> Type #

Read ConnectionInput Source # 
Instance details

Defined in Amazonka.Glue.Types.ConnectionInput

Show ConnectionInput Source # 
Instance details

Defined in Amazonka.Glue.Types.ConnectionInput

NFData ConnectionInput Source # 
Instance details

Defined in Amazonka.Glue.Types.ConnectionInput

Methods

rnf :: ConnectionInput -> () #

Eq ConnectionInput Source # 
Instance details

Defined in Amazonka.Glue.Types.ConnectionInput

Hashable ConnectionInput Source # 
Instance details

Defined in Amazonka.Glue.Types.ConnectionInput

type Rep ConnectionInput Source # 
Instance details

Defined in Amazonka.Glue.Types.ConnectionInput

type Rep ConnectionInput = D1 ('MetaData "ConnectionInput" "Amazonka.Glue.Types.ConnectionInput" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "ConnectionInput'" 'PrefixI 'True) ((S1 ('MetaSel ('Just "description") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: (S1 ('MetaSel ('Just "matchCriteria") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe [Text])) :*: S1 ('MetaSel ('Just "physicalConnectionRequirements") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe PhysicalConnectionRequirements)))) :*: (S1 ('MetaSel ('Just "name") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text) :*: (S1 ('MetaSel ('Just "connectionType") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 ConnectionType) :*: S1 ('MetaSel ('Just "connectionProperties") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (HashMap ConnectionPropertyKey Text))))))

newConnectionInput Source #

Create a value of ConnectionInput with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:description:ConnectionInput', connectionInput_description - The description of the connection.

$sel:matchCriteria:ConnectionInput', connectionInput_matchCriteria - A list of criteria that can be used in selecting this connection.

$sel:physicalConnectionRequirements:ConnectionInput', connectionInput_physicalConnectionRequirements - A map of physical connection requirements, such as virtual private cloud (VPC) and SecurityGroup, that are needed to successfully make this connection.

$sel:name:ConnectionInput', connectionInput_name - The name of the connection.

$sel:connectionType:ConnectionInput', connectionInput_connectionType - The type of the connection. Currently, these types are supported:

  • JDBC - Designates a connection to a database through Java Database Connectivity (JDBC).
  • KAFKA - Designates a connection to an Apache Kafka streaming platform.
  • MONGODB - Designates a connection to a MongoDB document database.
  • NETWORK - Designates a network connection to a data source within an Amazon Virtual Private Cloud environment (Amazon VPC).
  • MARKETPLACE - Uses configuration settings contained in a connector purchased from Amazon Web Services Marketplace to read from and write to data stores that are not natively supported by Glue.
  • CUSTOM - Uses configuration settings contained in a custom connector to read from and write to data stores that are not natively supported by Glue.

SFTP is not supported.

$sel:connectionProperties:ConnectionInput', connectionInput_connectionProperties - These key-value pairs define parameters for the connection.

connectionInput_description :: Lens' ConnectionInput (Maybe Text) Source #

The description of the connection.

connectionInput_matchCriteria :: Lens' ConnectionInput (Maybe [Text]) Source #

A list of criteria that can be used in selecting this connection.

connectionInput_physicalConnectionRequirements :: Lens' ConnectionInput (Maybe PhysicalConnectionRequirements) Source #

A map of physical connection requirements, such as virtual private cloud (VPC) and SecurityGroup, that are needed to successfully make this connection.

connectionInput_name :: Lens' ConnectionInput Text Source #

The name of the connection.

connectionInput_connectionType :: Lens' ConnectionInput ConnectionType Source #

The type of the connection. Currently, these types are supported:

  • JDBC - Designates a connection to a database through Java Database Connectivity (JDBC).
  • KAFKA - Designates a connection to an Apache Kafka streaming platform.
  • MONGODB - Designates a connection to a MongoDB document database.
  • NETWORK - Designates a network connection to a data source within an Amazon Virtual Private Cloud environment (Amazon VPC).
  • MARKETPLACE - Uses configuration settings contained in a connector purchased from Amazon Web Services Marketplace to read from and write to data stores that are not natively supported by Glue.
  • CUSTOM - Uses configuration settings contained in a custom connector to read from and write to data stores that are not natively supported by Glue.

SFTP is not supported.

connectionInput_connectionProperties :: Lens' ConnectionInput (HashMap ConnectionPropertyKey Text) Source #

These key-value pairs define parameters for the connection.

ConnectionPasswordEncryption

data ConnectionPasswordEncryption Source #

The data structure used by the Data Catalog to encrypt the password as part of CreateConnection or UpdateConnection and store it in the ENCRYPTED_PASSWORD field in the connection properties. You can enable catalog encryption or only password encryption.

When a CreationConnection request arrives containing a password, the Data Catalog first encrypts the password using your KMS key. It then encrypts the whole connection object again if catalog encryption is also enabled.

This encryption requires that you set KMS key permissions to enable or restrict access on the password key according to your security requirements. For example, you might want only administrators to have decrypt permission on the password key.

See: newConnectionPasswordEncryption smart constructor.

Constructors

ConnectionPasswordEncryption' 

Fields

  • awsKmsKeyId :: Maybe Text

    An KMS key that is used to encrypt the connection password.

    If connection password protection is enabled, the caller of CreateConnection and UpdateConnection needs at least kms:Encrypt permission on the specified KMS key, to encrypt passwords before storing them in the Data Catalog.

    You can set the decrypt permission to enable or restrict access on the password key according to your security requirements.

  • returnConnectionPasswordEncrypted :: Bool

    When the ReturnConnectionPasswordEncrypted flag is set to "true", passwords remain encrypted in the responses of GetConnection and GetConnections. This encryption takes effect independently from catalog encryption.

Instances

Instances details
FromJSON ConnectionPasswordEncryption Source # 
Instance details

Defined in Amazonka.Glue.Types.ConnectionPasswordEncryption

ToJSON ConnectionPasswordEncryption Source # 
Instance details

Defined in Amazonka.Glue.Types.ConnectionPasswordEncryption

Generic ConnectionPasswordEncryption Source # 
Instance details

Defined in Amazonka.Glue.Types.ConnectionPasswordEncryption

Associated Types

type Rep ConnectionPasswordEncryption :: Type -> Type #

Read ConnectionPasswordEncryption Source # 
Instance details

Defined in Amazonka.Glue.Types.ConnectionPasswordEncryption

Show ConnectionPasswordEncryption Source # 
Instance details

Defined in Amazonka.Glue.Types.ConnectionPasswordEncryption

NFData ConnectionPasswordEncryption Source # 
Instance details

Defined in Amazonka.Glue.Types.ConnectionPasswordEncryption

Eq ConnectionPasswordEncryption Source # 
Instance details

Defined in Amazonka.Glue.Types.ConnectionPasswordEncryption

Hashable ConnectionPasswordEncryption Source # 
Instance details

Defined in Amazonka.Glue.Types.ConnectionPasswordEncryption

type Rep ConnectionPasswordEncryption Source # 
Instance details

Defined in Amazonka.Glue.Types.ConnectionPasswordEncryption

type Rep ConnectionPasswordEncryption = D1 ('MetaData "ConnectionPasswordEncryption" "Amazonka.Glue.Types.ConnectionPasswordEncryption" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "ConnectionPasswordEncryption'" 'PrefixI 'True) (S1 ('MetaSel ('Just "awsKmsKeyId") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "returnConnectionPasswordEncrypted") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Bool)))

newConnectionPasswordEncryption Source #

Create a value of ConnectionPasswordEncryption with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:awsKmsKeyId:ConnectionPasswordEncryption', connectionPasswordEncryption_awsKmsKeyId - An KMS key that is used to encrypt the connection password.

If connection password protection is enabled, the caller of CreateConnection and UpdateConnection needs at least kms:Encrypt permission on the specified KMS key, to encrypt passwords before storing them in the Data Catalog.

You can set the decrypt permission to enable or restrict access on the password key according to your security requirements.

$sel:returnConnectionPasswordEncrypted:ConnectionPasswordEncryption', connectionPasswordEncryption_returnConnectionPasswordEncrypted - When the ReturnConnectionPasswordEncrypted flag is set to "true", passwords remain encrypted in the responses of GetConnection and GetConnections. This encryption takes effect independently from catalog encryption.

connectionPasswordEncryption_awsKmsKeyId :: Lens' ConnectionPasswordEncryption (Maybe Text) Source #

An KMS key that is used to encrypt the connection password.

If connection password protection is enabled, the caller of CreateConnection and UpdateConnection needs at least kms:Encrypt permission on the specified KMS key, to encrypt passwords before storing them in the Data Catalog.

You can set the decrypt permission to enable or restrict access on the password key according to your security requirements.

connectionPasswordEncryption_returnConnectionPasswordEncrypted :: Lens' ConnectionPasswordEncryption Bool Source #

When the ReturnConnectionPasswordEncrypted flag is set to "true", passwords remain encrypted in the responses of GetConnection and GetConnections. This encryption takes effect independently from catalog encryption.

ConnectionsList

data ConnectionsList Source #

Specifies the connections used by a job.

See: newConnectionsList smart constructor.

Constructors

ConnectionsList' 

Fields

Instances

Instances details
FromJSON ConnectionsList Source # 
Instance details

Defined in Amazonka.Glue.Types.ConnectionsList

ToJSON ConnectionsList Source # 
Instance details

Defined in Amazonka.Glue.Types.ConnectionsList

Generic ConnectionsList Source # 
Instance details

Defined in Amazonka.Glue.Types.ConnectionsList

Associated Types

type Rep ConnectionsList :: Type -> Type #

Read ConnectionsList Source # 
Instance details

Defined in Amazonka.Glue.Types.ConnectionsList

Show ConnectionsList Source # 
Instance details

Defined in Amazonka.Glue.Types.ConnectionsList

NFData ConnectionsList Source # 
Instance details

Defined in Amazonka.Glue.Types.ConnectionsList

Methods

rnf :: ConnectionsList -> () #

Eq ConnectionsList Source # 
Instance details

Defined in Amazonka.Glue.Types.ConnectionsList

Hashable ConnectionsList Source # 
Instance details

Defined in Amazonka.Glue.Types.ConnectionsList

type Rep ConnectionsList Source # 
Instance details

Defined in Amazonka.Glue.Types.ConnectionsList

type Rep ConnectionsList = D1 ('MetaData "ConnectionsList" "Amazonka.Glue.Types.ConnectionsList" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "ConnectionsList'" 'PrefixI 'True) (S1 ('MetaSel ('Just "connections") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe [Text]))))

newConnectionsList :: ConnectionsList Source #

Create a value of ConnectionsList with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:connections:ConnectionsList', connectionsList_connections - A list of connections used by the job.

connectionsList_connections :: Lens' ConnectionsList (Maybe [Text]) Source #

A list of connections used by the job.

Crawl

data Crawl Source #

The details of a crawl in the workflow.

See: newCrawl smart constructor.

Constructors

Crawl' 

Fields

Instances

Instances details
FromJSON Crawl Source # 
Instance details

Defined in Amazonka.Glue.Types.Crawl

Generic Crawl Source # 
Instance details

Defined in Amazonka.Glue.Types.Crawl

Associated Types

type Rep Crawl :: Type -> Type #

Methods

from :: Crawl -> Rep Crawl x #

to :: Rep Crawl x -> Crawl #

Read Crawl Source # 
Instance details

Defined in Amazonka.Glue.Types.Crawl

Show Crawl Source # 
Instance details

Defined in Amazonka.Glue.Types.Crawl

Methods

showsPrec :: Int -> Crawl -> ShowS #

show :: Crawl -> String #

showList :: [Crawl] -> ShowS #

NFData Crawl Source # 
Instance details

Defined in Amazonka.Glue.Types.Crawl

Methods

rnf :: Crawl -> () #

Eq Crawl Source # 
Instance details

Defined in Amazonka.Glue.Types.Crawl

Methods

(==) :: Crawl -> Crawl -> Bool #

(/=) :: Crawl -> Crawl -> Bool #

Hashable Crawl Source # 
Instance details

Defined in Amazonka.Glue.Types.Crawl

Methods

hashWithSalt :: Int -> Crawl -> Int #

hash :: Crawl -> Int #

type Rep Crawl Source # 
Instance details

Defined in Amazonka.Glue.Types.Crawl

newCrawl :: Crawl Source #

Create a value of Crawl with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:completedOn:Crawl', crawl_completedOn - The date and time on which the crawl completed.

$sel:errorMessage:Crawl', crawl_errorMessage - The error message associated with the crawl.

$sel:logGroup:Crawl', crawl_logGroup - The log group associated with the crawl.

$sel:logStream:Crawl', crawl_logStream - The log stream associated with the crawl.

$sel:startedOn:Crawl', crawl_startedOn - The date and time on which the crawl started.

$sel:state:Crawl', crawl_state - The state of the crawler.

crawl_completedOn :: Lens' Crawl (Maybe UTCTime) Source #

The date and time on which the crawl completed.

crawl_errorMessage :: Lens' Crawl (Maybe Text) Source #

The error message associated with the crawl.

crawl_logGroup :: Lens' Crawl (Maybe Text) Source #

The log group associated with the crawl.

crawl_logStream :: Lens' Crawl (Maybe Text) Source #

The log stream associated with the crawl.

crawl_startedOn :: Lens' Crawl (Maybe UTCTime) Source #

The date and time on which the crawl started.

crawl_state :: Lens' Crawl (Maybe CrawlState) Source #

The state of the crawler.

Crawler

data Crawler Source #

Specifies a crawler program that examines a data source and uses classifiers to try to determine its schema. If successful, the crawler records metadata concerning the data source in the Glue Data Catalog.

See: newCrawler smart constructor.

Constructors

Crawler' 

Fields

Instances

Instances details
FromJSON Crawler Source # 
Instance details

Defined in Amazonka.Glue.Types.Crawler

Generic Crawler Source # 
Instance details

Defined in Amazonka.Glue.Types.Crawler

Associated Types

type Rep Crawler :: Type -> Type #

Methods

from :: Crawler -> Rep Crawler x #

to :: Rep Crawler x -> Crawler #

Read Crawler Source # 
Instance details

Defined in Amazonka.Glue.Types.Crawler

Show Crawler Source # 
Instance details

Defined in Amazonka.Glue.Types.Crawler

NFData Crawler Source # 
Instance details

Defined in Amazonka.Glue.Types.Crawler

Methods

rnf :: Crawler -> () #

Eq Crawler Source # 
Instance details

Defined in Amazonka.Glue.Types.Crawler

Methods

(==) :: Crawler -> Crawler -> Bool #

(/=) :: Crawler -> Crawler -> Bool #

Hashable Crawler Source # 
Instance details

Defined in Amazonka.Glue.Types.Crawler

Methods

hashWithSalt :: Int -> Crawler -> Int #

hash :: Crawler -> Int #

type Rep Crawler Source # 
Instance details

Defined in Amazonka.Glue.Types.Crawler

type Rep Crawler = D1 ('MetaData "Crawler" "Amazonka.Glue.Types.Crawler" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "Crawler'" 'PrefixI 'True) ((((S1 ('MetaSel ('Just "classifiers") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe [Text])) :*: S1 ('MetaSel ('Just "configuration") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text))) :*: (S1 ('MetaSel ('Just "crawlElapsedTime") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Integer)) :*: (S1 ('MetaSel ('Just "crawlerSecurityConfiguration") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "creationTime") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe POSIX))))) :*: ((S1 ('MetaSel ('Just "databaseName") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "description") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text))) :*: (S1 ('MetaSel ('Just "lakeFormationConfiguration") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe LakeFormationConfiguration)) :*: (S1 ('MetaSel ('Just "lastCrawl") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe LastCrawlInfo)) :*: S1 ('MetaSel ('Just "lastUpdated") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe POSIX)))))) :*: (((S1 ('MetaSel ('Just "lineageConfiguration") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe LineageConfiguration)) :*: S1 ('MetaSel ('Just "name") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text))) :*: (S1 ('MetaSel ('Just "recrawlPolicy") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe RecrawlPolicy)) :*: (S1 ('MetaSel ('Just "role'") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "schedule") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Schedule))))) :*: ((S1 ('MetaSel ('Just "schemaChangePolicy") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe SchemaChangePolicy)) :*: S1 ('MetaSel ('Just "state") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe CrawlerState))) :*: (S1 ('MetaSel ('Just "tablePrefix") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: (S1 ('MetaSel ('Just "targets") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe CrawlerTargets)) :*: S1 ('MetaSel ('Just "version") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Integer))))))))

newCrawler :: Crawler Source #

Create a value of Crawler with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:classifiers:Crawler', crawler_classifiers - A list of UTF-8 strings that specify the custom classifiers that are associated with the crawler.

$sel:configuration:Crawler', crawler_configuration - Crawler configuration information. This versioned JSON string allows users to specify aspects of a crawler's behavior. For more information, see Setting crawler configuration options.

$sel:crawlElapsedTime:Crawler', crawler_crawlElapsedTime - If the crawler is running, contains the total time elapsed since the last crawl began.

$sel:crawlerSecurityConfiguration:Crawler', crawler_crawlerSecurityConfiguration - The name of the SecurityConfiguration structure to be used by this crawler.

$sel:creationTime:Crawler', crawler_creationTime - The time that the crawler was created.

$sel:databaseName:Crawler', crawler_databaseName - The name of the database in which the crawler's output is stored.

$sel:description:Crawler', crawler_description - A description of the crawler.

$sel:lakeFormationConfiguration:Crawler', crawler_lakeFormationConfiguration - Specifies whether the crawler should use Lake Formation credentials for the crawler instead of the IAM role credentials.

$sel:lastCrawl:Crawler', crawler_lastCrawl - The status of the last crawl, and potentially error information if an error occurred.

$sel:lastUpdated:Crawler', crawler_lastUpdated - The time that the crawler was last updated.

$sel:lineageConfiguration:Crawler', crawler_lineageConfiguration - A configuration that specifies whether data lineage is enabled for the crawler.

$sel:name:Crawler', crawler_name - The name of the crawler.

$sel:recrawlPolicy:Crawler', crawler_recrawlPolicy - A policy that specifies whether to crawl the entire dataset again, or to crawl only folders that were added since the last crawler run.

$sel:role':Crawler', crawler_role - The Amazon Resource Name (ARN) of an IAM role that's used to access customer resources, such as Amazon Simple Storage Service (Amazon S3) data.

$sel:schedule:Crawler', crawler_schedule - For scheduled crawlers, the schedule when the crawler runs.

$sel:schemaChangePolicy:Crawler', crawler_schemaChangePolicy - The policy that specifies update and delete behaviors for the crawler.

Crawler, crawler_state - Indicates whether the crawler is running, or whether a run is pending.

$sel:tablePrefix:Crawler', crawler_tablePrefix - The prefix added to the names of tables that are created.

$sel:targets:Crawler', crawler_targets - A collection of targets to crawl.

$sel:version:Crawler', crawler_version - The version of the crawler.

crawler_classifiers :: Lens' Crawler (Maybe [Text]) Source #

A list of UTF-8 strings that specify the custom classifiers that are associated with the crawler.

crawler_configuration :: Lens' Crawler (Maybe Text) Source #

Crawler configuration information. This versioned JSON string allows users to specify aspects of a crawler's behavior. For more information, see Setting crawler configuration options.

crawler_crawlElapsedTime :: Lens' Crawler (Maybe Integer) Source #

If the crawler is running, contains the total time elapsed since the last crawl began.

crawler_crawlerSecurityConfiguration :: Lens' Crawler (Maybe Text) Source #

The name of the SecurityConfiguration structure to be used by this crawler.

crawler_creationTime :: Lens' Crawler (Maybe UTCTime) Source #

The time that the crawler was created.

crawler_databaseName :: Lens' Crawler (Maybe Text) Source #

The name of the database in which the crawler's output is stored.

crawler_description :: Lens' Crawler (Maybe Text) Source #

A description of the crawler.

crawler_lakeFormationConfiguration :: Lens' Crawler (Maybe LakeFormationConfiguration) Source #

Specifies whether the crawler should use Lake Formation credentials for the crawler instead of the IAM role credentials.

crawler_lastCrawl :: Lens' Crawler (Maybe LastCrawlInfo) Source #

The status of the last crawl, and potentially error information if an error occurred.

crawler_lastUpdated :: Lens' Crawler (Maybe UTCTime) Source #

The time that the crawler was last updated.

crawler_lineageConfiguration :: Lens' Crawler (Maybe LineageConfiguration) Source #

A configuration that specifies whether data lineage is enabled for the crawler.

crawler_name :: Lens' Crawler (Maybe Text) Source #

The name of the crawler.

crawler_recrawlPolicy :: Lens' Crawler (Maybe RecrawlPolicy) Source #

A policy that specifies whether to crawl the entire dataset again, or to crawl only folders that were added since the last crawler run.

crawler_role :: Lens' Crawler (Maybe Text) Source #

The Amazon Resource Name (ARN) of an IAM role that's used to access customer resources, such as Amazon Simple Storage Service (Amazon S3) data.

crawler_schedule :: Lens' Crawler (Maybe Schedule) Source #

For scheduled crawlers, the schedule when the crawler runs.

crawler_schemaChangePolicy :: Lens' Crawler (Maybe SchemaChangePolicy) Source #

The policy that specifies update and delete behaviors for the crawler.

crawler_state :: Lens' Crawler (Maybe CrawlerState) Source #

Indicates whether the crawler is running, or whether a run is pending.

crawler_tablePrefix :: Lens' Crawler (Maybe Text) Source #

The prefix added to the names of tables that are created.

crawler_targets :: Lens' Crawler (Maybe CrawlerTargets) Source #

A collection of targets to crawl.

crawler_version :: Lens' Crawler (Maybe Integer) Source #

The version of the crawler.

CrawlerHistory

data CrawlerHistory Source #

Contains the information for a run of a crawler.

See: newCrawlerHistory smart constructor.

Constructors

CrawlerHistory' 

Fields

Instances

Instances details
FromJSON CrawlerHistory Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlerHistory

Generic CrawlerHistory Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlerHistory

Associated Types

type Rep CrawlerHistory :: Type -> Type #

Read CrawlerHistory Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlerHistory

Show CrawlerHistory Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlerHistory

NFData CrawlerHistory Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlerHistory

Methods

rnf :: CrawlerHistory -> () #

Eq CrawlerHistory Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlerHistory

Hashable CrawlerHistory Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlerHistory

type Rep CrawlerHistory Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlerHistory

newCrawlerHistory :: CrawlerHistory Source #

Create a value of CrawlerHistory with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:crawlId:CrawlerHistory', crawlerHistory_crawlId - A UUID identifier for each crawl.

$sel:dPUHour:CrawlerHistory', crawlerHistory_dPUHour - The number of data processing units (DPU) used in hours for the crawl.

$sel:endTime:CrawlerHistory', crawlerHistory_endTime - The date and time on which the crawl ended.

$sel:errorMessage:CrawlerHistory', crawlerHistory_errorMessage - If an error occurred, the error message associated with the crawl.

$sel:logGroup:CrawlerHistory', crawlerHistory_logGroup - The log group associated with the crawl.

$sel:logStream:CrawlerHistory', crawlerHistory_logStream - The log stream associated with the crawl.

$sel:messagePrefix:CrawlerHistory', crawlerHistory_messagePrefix - The prefix for a CloudWatch message about this crawl.

$sel:startTime:CrawlerHistory', crawlerHistory_startTime - The date and time on which the crawl started.

$sel:state:CrawlerHistory', crawlerHistory_state - The state of the crawl.

$sel:summary:CrawlerHistory', crawlerHistory_summary - A run summary for the specific crawl in JSON. Contains the catalog tables and partitions that were added, updated, or deleted.

crawlerHistory_crawlId :: Lens' CrawlerHistory (Maybe Text) Source #

A UUID identifier for each crawl.

crawlerHistory_dPUHour :: Lens' CrawlerHistory (Maybe Double) Source #

The number of data processing units (DPU) used in hours for the crawl.

crawlerHistory_endTime :: Lens' CrawlerHistory (Maybe UTCTime) Source #

The date and time on which the crawl ended.

crawlerHistory_errorMessage :: Lens' CrawlerHistory (Maybe Text) Source #

If an error occurred, the error message associated with the crawl.

crawlerHistory_logGroup :: Lens' CrawlerHistory (Maybe Text) Source #

The log group associated with the crawl.

crawlerHistory_logStream :: Lens' CrawlerHistory (Maybe Text) Source #

The log stream associated with the crawl.

crawlerHistory_messagePrefix :: Lens' CrawlerHistory (Maybe Text) Source #

The prefix for a CloudWatch message about this crawl.

crawlerHistory_startTime :: Lens' CrawlerHistory (Maybe UTCTime) Source #

The date and time on which the crawl started.

crawlerHistory_summary :: Lens' CrawlerHistory (Maybe Text) Source #

A run summary for the specific crawl in JSON. Contains the catalog tables and partitions that were added, updated, or deleted.

CrawlerMetrics

data CrawlerMetrics Source #

Metrics for a specified crawler.

See: newCrawlerMetrics smart constructor.

Constructors

CrawlerMetrics' 

Fields

Instances

Instances details
FromJSON CrawlerMetrics Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlerMetrics

Generic CrawlerMetrics Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlerMetrics

Associated Types

type Rep CrawlerMetrics :: Type -> Type #

Read CrawlerMetrics Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlerMetrics

Show CrawlerMetrics Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlerMetrics

NFData CrawlerMetrics Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlerMetrics

Methods

rnf :: CrawlerMetrics -> () #

Eq CrawlerMetrics Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlerMetrics

Hashable CrawlerMetrics Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlerMetrics

type Rep CrawlerMetrics Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlerMetrics

type Rep CrawlerMetrics = D1 ('MetaData "CrawlerMetrics" "Amazonka.Glue.Types.CrawlerMetrics" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "CrawlerMetrics'" 'PrefixI 'True) (((S1 ('MetaSel ('Just "crawlerName") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "lastRuntimeSeconds") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Double))) :*: (S1 ('MetaSel ('Just "medianRuntimeSeconds") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Double)) :*: S1 ('MetaSel ('Just "stillEstimating") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Bool)))) :*: ((S1 ('MetaSel ('Just "tablesCreated") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Natural)) :*: S1 ('MetaSel ('Just "tablesDeleted") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Natural))) :*: (S1 ('MetaSel ('Just "tablesUpdated") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Natural)) :*: S1 ('MetaSel ('Just "timeLeftSeconds") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Double))))))

newCrawlerMetrics :: CrawlerMetrics Source #

Create a value of CrawlerMetrics with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:crawlerName:CrawlerMetrics', crawlerMetrics_crawlerName - The name of the crawler.

$sel:lastRuntimeSeconds:CrawlerMetrics', crawlerMetrics_lastRuntimeSeconds - The duration of the crawler's most recent run, in seconds.

$sel:medianRuntimeSeconds:CrawlerMetrics', crawlerMetrics_medianRuntimeSeconds - The median duration of this crawler's runs, in seconds.

$sel:stillEstimating:CrawlerMetrics', crawlerMetrics_stillEstimating - True if the crawler is still estimating how long it will take to complete this run.

$sel:tablesCreated:CrawlerMetrics', crawlerMetrics_tablesCreated - The number of tables created by this crawler.

$sel:tablesDeleted:CrawlerMetrics', crawlerMetrics_tablesDeleted - The number of tables deleted by this crawler.

$sel:tablesUpdated:CrawlerMetrics', crawlerMetrics_tablesUpdated - The number of tables updated by this crawler.

$sel:timeLeftSeconds:CrawlerMetrics', crawlerMetrics_timeLeftSeconds - The estimated time left to complete a running crawl.

crawlerMetrics_lastRuntimeSeconds :: Lens' CrawlerMetrics (Maybe Double) Source #

The duration of the crawler's most recent run, in seconds.

crawlerMetrics_medianRuntimeSeconds :: Lens' CrawlerMetrics (Maybe Double) Source #

The median duration of this crawler's runs, in seconds.

crawlerMetrics_stillEstimating :: Lens' CrawlerMetrics (Maybe Bool) Source #

True if the crawler is still estimating how long it will take to complete this run.

crawlerMetrics_tablesCreated :: Lens' CrawlerMetrics (Maybe Natural) Source #

The number of tables created by this crawler.

crawlerMetrics_tablesDeleted :: Lens' CrawlerMetrics (Maybe Natural) Source #

The number of tables deleted by this crawler.

crawlerMetrics_tablesUpdated :: Lens' CrawlerMetrics (Maybe Natural) Source #

The number of tables updated by this crawler.

crawlerMetrics_timeLeftSeconds :: Lens' CrawlerMetrics (Maybe Double) Source #

The estimated time left to complete a running crawl.

CrawlerNodeDetails

data CrawlerNodeDetails Source #

The details of a Crawler node present in the workflow.

See: newCrawlerNodeDetails smart constructor.

Constructors

CrawlerNodeDetails' 

Fields

Instances

Instances details
FromJSON CrawlerNodeDetails Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlerNodeDetails

Generic CrawlerNodeDetails Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlerNodeDetails

Associated Types

type Rep CrawlerNodeDetails :: Type -> Type #

Read CrawlerNodeDetails Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlerNodeDetails

Show CrawlerNodeDetails Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlerNodeDetails

NFData CrawlerNodeDetails Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlerNodeDetails

Methods

rnf :: CrawlerNodeDetails -> () #

Eq CrawlerNodeDetails Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlerNodeDetails

Hashable CrawlerNodeDetails Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlerNodeDetails

type Rep CrawlerNodeDetails Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlerNodeDetails

type Rep CrawlerNodeDetails = D1 ('MetaData "CrawlerNodeDetails" "Amazonka.Glue.Types.CrawlerNodeDetails" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "CrawlerNodeDetails'" 'PrefixI 'True) (S1 ('MetaSel ('Just "crawls") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe [Crawl]))))

newCrawlerNodeDetails :: CrawlerNodeDetails Source #

Create a value of CrawlerNodeDetails with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:crawls:CrawlerNodeDetails', crawlerNodeDetails_crawls - A list of crawls represented by the crawl node.

crawlerNodeDetails_crawls :: Lens' CrawlerNodeDetails (Maybe [Crawl]) Source #

A list of crawls represented by the crawl node.

CrawlerTargets

data CrawlerTargets Source #

Specifies data stores to crawl.

See: newCrawlerTargets smart constructor.

Constructors

CrawlerTargets' 

Fields

Instances

Instances details
FromJSON CrawlerTargets Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlerTargets

ToJSON CrawlerTargets Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlerTargets

Generic CrawlerTargets Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlerTargets

Associated Types

type Rep CrawlerTargets :: Type -> Type #

Read CrawlerTargets Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlerTargets

Show CrawlerTargets Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlerTargets

NFData CrawlerTargets Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlerTargets

Methods

rnf :: CrawlerTargets -> () #

Eq CrawlerTargets Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlerTargets

Hashable CrawlerTargets Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlerTargets

type Rep CrawlerTargets Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlerTargets

type Rep CrawlerTargets = D1 ('MetaData "CrawlerTargets" "Amazonka.Glue.Types.CrawlerTargets" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "CrawlerTargets'" 'PrefixI 'True) ((S1 ('MetaSel ('Just "catalogTargets") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe [CatalogTarget])) :*: (S1 ('MetaSel ('Just "deltaTargets") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe [DeltaTarget])) :*: S1 ('MetaSel ('Just "dynamoDBTargets") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe [DynamoDBTarget])))) :*: (S1 ('MetaSel ('Just "jdbcTargets") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe [JdbcTarget])) :*: (S1 ('MetaSel ('Just "mongoDBTargets") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe [MongoDBTarget])) :*: S1 ('MetaSel ('Just "s3Targets") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe [S3Target]))))))

newCrawlerTargets :: CrawlerTargets Source #

Create a value of CrawlerTargets with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:catalogTargets:CrawlerTargets', crawlerTargets_catalogTargets - Specifies Glue Data Catalog targets.

$sel:deltaTargets:CrawlerTargets', crawlerTargets_deltaTargets - Specifies Delta data store targets.

$sel:dynamoDBTargets:CrawlerTargets', crawlerTargets_dynamoDBTargets - Specifies Amazon DynamoDB targets.

$sel:jdbcTargets:CrawlerTargets', crawlerTargets_jdbcTargets - Specifies JDBC targets.

$sel:mongoDBTargets:CrawlerTargets', crawlerTargets_mongoDBTargets - Specifies Amazon DocumentDB or MongoDB targets.

$sel:s3Targets:CrawlerTargets', crawlerTargets_s3Targets - Specifies Amazon Simple Storage Service (Amazon S3) targets.

crawlerTargets_catalogTargets :: Lens' CrawlerTargets (Maybe [CatalogTarget]) Source #

Specifies Glue Data Catalog targets.

crawlerTargets_deltaTargets :: Lens' CrawlerTargets (Maybe [DeltaTarget]) Source #

Specifies Delta data store targets.

crawlerTargets_mongoDBTargets :: Lens' CrawlerTargets (Maybe [MongoDBTarget]) Source #

Specifies Amazon DocumentDB or MongoDB targets.

crawlerTargets_s3Targets :: Lens' CrawlerTargets (Maybe [S3Target]) Source #

Specifies Amazon Simple Storage Service (Amazon S3) targets.

CrawlsFilter

data CrawlsFilter Source #

A list of fields, comparators and value that you can use to filter the crawler runs for a specified crawler.

See: newCrawlsFilter smart constructor.

Constructors

CrawlsFilter' 

Fields

  • fieldName :: Maybe FieldName

    A key used to filter the crawler runs for a specified crawler. Valid values for each of the field names are:

    • CRAWL_ID: A string representing the UUID identifier for a crawl.
    • STATE: A string representing the state of the crawl.
    • START_TIME and END_TIME: The epoch timestamp in milliseconds.
    • DPU_HOUR: The number of data processing unit (DPU) hours used for the crawl.
  • fieldValue :: Maybe Text

    The value provided for comparison on the crawl field.

  • filterOperator :: Maybe FilterOperator

    A defined comparator that operates on the value. The available operators are:

    • GT: Greater than.
    • GE: Greater than or equal to.
    • LT: Less than.
    • LE: Less than or equal to.
    • EQ: Equal to.
    • NE: Not equal to.

Instances

Instances details
ToJSON CrawlsFilter Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlsFilter

Generic CrawlsFilter Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlsFilter

Associated Types

type Rep CrawlsFilter :: Type -> Type #

Read CrawlsFilter Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlsFilter

Show CrawlsFilter Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlsFilter

NFData CrawlsFilter Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlsFilter

Methods

rnf :: CrawlsFilter -> () #

Eq CrawlsFilter Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlsFilter

Hashable CrawlsFilter Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlsFilter

type Rep CrawlsFilter Source # 
Instance details

Defined in Amazonka.Glue.Types.CrawlsFilter

type Rep CrawlsFilter = D1 ('MetaData "CrawlsFilter" "Amazonka.Glue.Types.CrawlsFilter" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "CrawlsFilter'" 'PrefixI 'True) (S1 ('MetaSel ('Just "fieldName") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe FieldName)) :*: (S1 ('MetaSel ('Just "fieldValue") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "filterOperator") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe FilterOperator)))))

newCrawlsFilter :: CrawlsFilter Source #

Create a value of CrawlsFilter with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:fieldName:CrawlsFilter', crawlsFilter_fieldName - A key used to filter the crawler runs for a specified crawler. Valid values for each of the field names are:

  • CRAWL_ID: A string representing the UUID identifier for a crawl.
  • STATE: A string representing the state of the crawl.
  • START_TIME and END_TIME: The epoch timestamp in milliseconds.
  • DPU_HOUR: The number of data processing unit (DPU) hours used for the crawl.

$sel:fieldValue:CrawlsFilter', crawlsFilter_fieldValue - The value provided for comparison on the crawl field.

$sel:filterOperator:CrawlsFilter', crawlsFilter_filterOperator - A defined comparator that operates on the value. The available operators are:

  • GT: Greater than.
  • GE: Greater than or equal to.
  • LT: Less than.
  • LE: Less than or equal to.
  • EQ: Equal to.
  • NE: Not equal to.

crawlsFilter_fieldName :: Lens' CrawlsFilter (Maybe FieldName) Source #

A key used to filter the crawler runs for a specified crawler. Valid values for each of the field names are:

  • CRAWL_ID: A string representing the UUID identifier for a crawl.
  • STATE: A string representing the state of the crawl.
  • START_TIME and END_TIME: The epoch timestamp in milliseconds.
  • DPU_HOUR: The number of data processing unit (DPU) hours used for the crawl.

crawlsFilter_fieldValue :: Lens' CrawlsFilter (Maybe Text) Source #

The value provided for comparison on the crawl field.

crawlsFilter_filterOperator :: Lens' CrawlsFilter (Maybe FilterOperator) Source #

A defined comparator that operates on the value. The available operators are:

  • GT: Greater than.
  • GE: Greater than or equal to.
  • LT: Less than.
  • LE: Less than or equal to.
  • EQ: Equal to.
  • NE: Not equal to.

CreateCsvClassifierRequest

data CreateCsvClassifierRequest Source #

Specifies a custom CSV classifier for CreateClassifier to create.

See: newCreateCsvClassifierRequest smart constructor.

Constructors

CreateCsvClassifierRequest' 

Fields

Instances

Instances details
ToJSON CreateCsvClassifierRequest Source # 
Instance details

Defined in Amazonka.Glue.Types.CreateCsvClassifierRequest

Generic CreateCsvClassifierRequest Source # 
Instance details

Defined in Amazonka.Glue.Types.CreateCsvClassifierRequest

Associated Types

type Rep CreateCsvClassifierRequest :: Type -> Type #

Read CreateCsvClassifierRequest Source # 
Instance details

Defined in Amazonka.Glue.Types.CreateCsvClassifierRequest

Show CreateCsvClassifierRequest Source # 
Instance details

Defined in Amazonka.Glue.Types.CreateCsvClassifierRequest

NFData CreateCsvClassifierRequest Source # 
Instance details

Defined in Amazonka.Glue.Types.CreateCsvClassifierRequest

Eq CreateCsvClassifierRequest Source # 
Instance details

Defined in Amazonka.Glue.Types.CreateCsvClassifierRequest

Hashable CreateCsvClassifierRequest Source # 
Instance details

Defined in Amazonka.Glue.Types.CreateCsvClassifierRequest

type Rep CreateCsvClassifierRequest Source # 
Instance details

Defined in Amazonka.Glue.Types.CreateCsvClassifierRequest

type Rep CreateCsvClassifierRequest = D1 ('MetaData "CreateCsvClassifierRequest" "Amazonka.Glue.Types.CreateCsvClassifierRequest" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "CreateCsvClassifierRequest'" 'PrefixI 'True) (((S1 ('MetaSel ('Just "allowSingleColumn") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Bool)) :*: S1 ('MetaSel ('Just "containsHeader") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe CsvHeaderOption))) :*: (S1 ('MetaSel ('Just "customDatatypeConfigured") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Bool)) :*: S1 ('MetaSel ('Just "customDatatypes") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe [Text])))) :*: ((S1 ('MetaSel ('Just "delimiter") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "disableValueTrimming") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Bool))) :*: (S1 ('MetaSel ('Just "header") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe [Text])) :*: (S1 ('MetaSel ('Just "quoteSymbol") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "name") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text))))))

newCreateCsvClassifierRequest Source #

Create a value of CreateCsvClassifierRequest with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:allowSingleColumn:CreateCsvClassifierRequest', createCsvClassifierRequest_allowSingleColumn - Enables the processing of files that contain only one column.

$sel:containsHeader:CreateCsvClassifierRequest', createCsvClassifierRequest_containsHeader - Indicates whether the CSV file contains a header.

$sel:customDatatypeConfigured:CreateCsvClassifierRequest', createCsvClassifierRequest_customDatatypeConfigured - Enables the configuration of custom datatypes.

$sel:customDatatypes:CreateCsvClassifierRequest', createCsvClassifierRequest_customDatatypes - Creates a list of supported custom datatypes.

$sel:delimiter:CreateCsvClassifierRequest', createCsvClassifierRequest_delimiter - A custom symbol to denote what separates each column entry in the row.

$sel:disableValueTrimming:CreateCsvClassifierRequest', createCsvClassifierRequest_disableValueTrimming - Specifies not to trim values before identifying the type of column values. The default value is true.

$sel:header:CreateCsvClassifierRequest', createCsvClassifierRequest_header - A list of strings representing column names.

$sel:quoteSymbol:CreateCsvClassifierRequest', createCsvClassifierRequest_quoteSymbol - A custom symbol to denote what combines content into a single column value. Must be different from the column delimiter.

$sel:name:CreateCsvClassifierRequest', createCsvClassifierRequest_name - The name of the classifier.

createCsvClassifierRequest_allowSingleColumn :: Lens' CreateCsvClassifierRequest (Maybe Bool) Source #

Enables the processing of files that contain only one column.

createCsvClassifierRequest_delimiter :: Lens' CreateCsvClassifierRequest (Maybe Text) Source #

A custom symbol to denote what separates each column entry in the row.

createCsvClassifierRequest_disableValueTrimming :: Lens' CreateCsvClassifierRequest (Maybe Bool) Source #

Specifies not to trim values before identifying the type of column values. The default value is true.

createCsvClassifierRequest_header :: Lens' CreateCsvClassifierRequest (Maybe [Text]) Source #

A list of strings representing column names.

createCsvClassifierRequest_quoteSymbol :: Lens' CreateCsvClassifierRequest (Maybe Text) Source #

A custom symbol to denote what combines content into a single column value. Must be different from the column delimiter.

CreateGrokClassifierRequest

data CreateGrokClassifierRequest Source #

Specifies a grok classifier for CreateClassifier to create.

See: newCreateGrokClassifierRequest smart constructor.

Constructors

CreateGrokClassifierRequest' 

Fields

  • customPatterns :: Maybe Text

    Optional custom grok patterns used by this classifier.

  • classification :: Text

    An identifier of the data format that the classifier matches, such as Twitter, JSON, Omniture logs, Amazon CloudWatch Logs, and so on.

  • name :: Text

    The name of the new classifier.

  • grokPattern :: Text

    The grok pattern used by this classifier.

Instances

Instances details
ToJSON CreateGrokClassifierRequest Source # 
Instance details

Defined in Amazonka.Glue.Types.CreateGrokClassifierRequest

Generic CreateGrokClassifierRequest Source # 
Instance details

Defined in Amazonka.Glue.Types.CreateGrokClassifierRequest

Associated Types

type Rep CreateGrokClassifierRequest :: Type -> Type #

Read CreateGrokClassifierRequest Source # 
Instance details

Defined in Amazonka.Glue.Types.CreateGrokClassifierRequest

Show CreateGrokClassifierRequest Source # 
Instance details

Defined in Amazonka.Glue.Types.CreateGrokClassifierRequest

NFData CreateGrokClassifierRequest Source # 
Instance details

Defined in Amazonka.Glue.Types.CreateGrokClassifierRequest

Eq CreateGrokClassifierRequest Source # 
Instance details

Defined in Amazonka.Glue.Types.CreateGrokClassifierRequest

Hashable CreateGrokClassifierRequest Source # 
Instance details

Defined in Amazonka.Glue.Types.CreateGrokClassifierRequest

type Rep CreateGrokClassifierRequest Source # 
Instance details

Defined in Amazonka.Glue.Types.CreateGrokClassifierRequest

type Rep CreateGrokClassifierRequest = D1 ('MetaData "CreateGrokClassifierRequest" "Amazonka.Glue.Types.CreateGrokClassifierRequest" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "CreateGrokClassifierRequest'" 'PrefixI 'True) ((S1 ('MetaSel ('Just "customPatterns") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "classification") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text)) :*: (S1 ('MetaSel ('Just "name") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text) :*: S1 ('MetaSel ('Just "grokPattern") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text))))

newCreateGrokClassifierRequest Source #

Create a value of CreateGrokClassifierRequest with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:customPatterns:CreateGrokClassifierRequest', createGrokClassifierRequest_customPatterns - Optional custom grok patterns used by this classifier.

$sel:classification:CreateGrokClassifierRequest', createGrokClassifierRequest_classification - An identifier of the data format that the classifier matches, such as Twitter, JSON, Omniture logs, Amazon CloudWatch Logs, and so on.

$sel:name:CreateGrokClassifierRequest', createGrokClassifierRequest_name - The name of the new classifier.

$sel:grokPattern:CreateGrokClassifierRequest', createGrokClassifierRequest_grokPattern - The grok pattern used by this classifier.

createGrokClassifierRequest_customPatterns :: Lens' CreateGrokClassifierRequest (Maybe Text) Source #

Optional custom grok patterns used by this classifier.

createGrokClassifierRequest_classification :: Lens' CreateGrokClassifierRequest Text Source #

An identifier of the data format that the classifier matches, such as Twitter, JSON, Omniture logs, Amazon CloudWatch Logs, and so on.

CreateJsonClassifierRequest

data CreateJsonClassifierRequest Source #

Specifies a JSON classifier for CreateClassifier to create.

See: newCreateJsonClassifierRequest smart constructor.

Constructors

CreateJsonClassifierRequest' 

Fields

Instances

Instances details
ToJSON CreateJsonClassifierRequest Source # 
Instance details

Defined in Amazonka.Glue.Types.CreateJsonClassifierRequest

Generic CreateJsonClassifierRequest Source # 
Instance details

Defined in Amazonka.Glue.Types.CreateJsonClassifierRequest

Associated Types

type Rep CreateJsonClassifierRequest :: Type -> Type #

Read CreateJsonClassifierRequest Source # 
Instance details

Defined in Amazonka.Glue.Types.CreateJsonClassifierRequest

Show CreateJsonClassifierRequest Source # 
Instance details

Defined in Amazonka.Glue.Types.CreateJsonClassifierRequest

NFData CreateJsonClassifierRequest Source # 
Instance details

Defined in Amazonka.Glue.Types.CreateJsonClassifierRequest

Eq CreateJsonClassifierRequest Source # 
Instance details

Defined in Amazonka.Glue.Types.CreateJsonClassifierRequest

Hashable CreateJsonClassifierRequest Source # 
Instance details

Defined in Amazonka.Glue.Types.CreateJsonClassifierRequest

type Rep CreateJsonClassifierRequest Source # 
Instance details

Defined in Amazonka.Glue.Types.CreateJsonClassifierRequest

type Rep CreateJsonClassifierRequest = D1 ('MetaData "CreateJsonClassifierRequest" "Amazonka.Glue.Types.CreateJsonClassifierRequest" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "CreateJsonClassifierRequest'" 'PrefixI 'True) (S1 ('MetaSel ('Just "name") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text) :*: S1 ('MetaSel ('Just "jsonPath") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text)))

newCreateJsonClassifierRequest Source #

Create a value of CreateJsonClassifierRequest with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:name:CreateJsonClassifierRequest', createJsonClassifierRequest_name - The name of the classifier.

$sel:jsonPath:CreateJsonClassifierRequest', createJsonClassifierRequest_jsonPath - A JsonPath string defining the JSON data for the classifier to classify. Glue supports a subset of JsonPath, as described in Writing JsonPath Custom Classifiers.

createJsonClassifierRequest_jsonPath :: Lens' CreateJsonClassifierRequest Text Source #

A JsonPath string defining the JSON data for the classifier to classify. Glue supports a subset of JsonPath, as described in Writing JsonPath Custom Classifiers.

CreateXMLClassifierRequest

data CreateXMLClassifierRequest Source #

Specifies an XML classifier for CreateClassifier to create.

See: newCreateXMLClassifierRequest smart constructor.

Constructors

CreateXMLClassifierRequest' 

Fields

  • rowTag :: Maybe Text

    The XML tag designating the element that contains each record in an XML document being parsed. This can't identify a self-closing element (closed by />). An empty row element that contains only attributes can be parsed as long as it ends with a closing tag (for example, <row item_a="A" item_b="B"></row> is okay, but <row item_a="A" item_b="B" /> is not).

  • classification :: Text

    An identifier of the data format that the classifier matches.

  • name :: Text

    The name of the classifier.

Instances

Instances details
ToJSON CreateXMLClassifierRequest Source # 
Instance details

Defined in Amazonka.Glue.Types.CreateXMLClassifierRequest

Generic CreateXMLClassifierRequest Source # 
Instance details

Defined in Amazonka.Glue.Types.CreateXMLClassifierRequest

Associated Types

type Rep CreateXMLClassifierRequest :: Type -> Type #

Read CreateXMLClassifierRequest Source # 
Instance details

Defined in Amazonka.Glue.Types.CreateXMLClassifierRequest

Show CreateXMLClassifierRequest Source # 
Instance details

Defined in Amazonka.Glue.Types.CreateXMLClassifierRequest

NFData CreateXMLClassifierRequest Source # 
Instance details

Defined in Amazonka.Glue.Types.CreateXMLClassifierRequest

Eq CreateXMLClassifierRequest Source # 
Instance details

Defined in Amazonka.Glue.Types.CreateXMLClassifierRequest

Hashable CreateXMLClassifierRequest Source # 
Instance details

Defined in Amazonka.Glue.Types.CreateXMLClassifierRequest

type Rep CreateXMLClassifierRequest Source # 
Instance details

Defined in Amazonka.Glue.Types.CreateXMLClassifierRequest

type Rep CreateXMLClassifierRequest = D1 ('MetaData "CreateXMLClassifierRequest" "Amazonka.Glue.Types.CreateXMLClassifierRequest" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "CreateXMLClassifierRequest'" 'PrefixI 'True) (S1 ('MetaSel ('Just "rowTag") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: (S1 ('MetaSel ('Just "classification") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text) :*: S1 ('MetaSel ('Just "name") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text))))

newCreateXMLClassifierRequest Source #

Create a value of CreateXMLClassifierRequest with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:rowTag:CreateXMLClassifierRequest', createXMLClassifierRequest_rowTag - The XML tag designating the element that contains each record in an XML document being parsed. This can't identify a self-closing element (closed by />). An empty row element that contains only attributes can be parsed as long as it ends with a closing tag (for example, <row item_a="A" item_b="B"></row> is okay, but <row item_a="A" item_b="B" /> is not).

$sel:classification:CreateXMLClassifierRequest', createXMLClassifierRequest_classification - An identifier of the data format that the classifier matches.

$sel:name:CreateXMLClassifierRequest', createXMLClassifierRequest_name - The name of the classifier.

createXMLClassifierRequest_rowTag :: Lens' CreateXMLClassifierRequest (Maybe Text) Source #

The XML tag designating the element that contains each record in an XML document being parsed. This can't identify a self-closing element (closed by />). An empty row element that contains only attributes can be parsed as long as it ends with a closing tag (for example, <row item_a="A" item_b="B"></row> is okay, but <row item_a="A" item_b="B" /> is not).

createXMLClassifierRequest_classification :: Lens' CreateXMLClassifierRequest Text Source #

An identifier of the data format that the classifier matches.

CsvClassifier

data CsvClassifier Source #

A classifier for custom CSV content.

See: newCsvClassifier smart constructor.

Constructors

CsvClassifier' 

Fields

Instances

Instances details
FromJSON CsvClassifier Source # 
Instance details

Defined in Amazonka.Glue.Types.CsvClassifier

Generic CsvClassifier Source # 
Instance details

Defined in Amazonka.Glue.Types.CsvClassifier

Associated Types

type Rep CsvClassifier :: Type -> Type #

Read CsvClassifier Source # 
Instance details

Defined in Amazonka.Glue.Types.CsvClassifier

Show CsvClassifier Source # 
Instance details

Defined in Amazonka.Glue.Types.CsvClassifier

NFData CsvClassifier Source # 
Instance details

Defined in Amazonka.Glue.Types.CsvClassifier

Methods

rnf :: CsvClassifier -> () #

Eq CsvClassifier Source # 
Instance details

Defined in Amazonka.Glue.Types.CsvClassifier

Hashable CsvClassifier Source # 
Instance details

Defined in Amazonka.Glue.Types.CsvClassifier

type Rep CsvClassifier Source # 
Instance details

Defined in Amazonka.Glue.Types.CsvClassifier

type Rep CsvClassifier = D1 ('MetaData "CsvClassifier" "Amazonka.Glue.Types.CsvClassifier" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "CsvClassifier'" 'PrefixI 'True) (((S1 ('MetaSel ('Just "allowSingleColumn") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Bool)) :*: (S1 ('MetaSel ('Just "containsHeader") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe CsvHeaderOption)) :*: S1 ('MetaSel ('Just "creationTime") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe POSIX)))) :*: (S1 ('MetaSel ('Just "customDatatypeConfigured") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Bool)) :*: (S1 ('MetaSel ('Just "customDatatypes") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe [Text])) :*: S1 ('MetaSel ('Just "delimiter") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text))))) :*: ((S1 ('MetaSel ('Just "disableValueTrimming") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Bool)) :*: (S1 ('MetaSel ('Just "header") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe [Text])) :*: S1 ('MetaSel ('Just "lastUpdated") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe POSIX)))) :*: (S1 ('MetaSel ('Just "quoteSymbol") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: (S1 ('MetaSel ('Just "version") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Integer)) :*: S1 ('MetaSel ('Just "name") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text))))))

newCsvClassifier Source #

Create a value of CsvClassifier with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:allowSingleColumn:CsvClassifier', csvClassifier_allowSingleColumn - Enables the processing of files that contain only one column.

$sel:containsHeader:CsvClassifier', csvClassifier_containsHeader - Indicates whether the CSV file contains a header.

$sel:creationTime:CsvClassifier', csvClassifier_creationTime - The time that this classifier was registered.

$sel:customDatatypeConfigured:CsvClassifier', csvClassifier_customDatatypeConfigured - Enables the custom datatype to be configured.

$sel:customDatatypes:CsvClassifier', csvClassifier_customDatatypes - A list of custom datatypes including "BINARY", "BOOLEAN", "DATE", "DECIMAL", "DOUBLE", "FLOAT", "INT", "LONG", "SHORT", "STRING", "TIMESTAMP".

$sel:delimiter:CsvClassifier', csvClassifier_delimiter - A custom symbol to denote what separates each column entry in the row.

$sel:disableValueTrimming:CsvClassifier', csvClassifier_disableValueTrimming - Specifies not to trim values before identifying the type of column values. The default value is true.

$sel:header:CsvClassifier', csvClassifier_header - A list of strings representing column names.

$sel:lastUpdated:CsvClassifier', csvClassifier_lastUpdated - The time that this classifier was last updated.

$sel:quoteSymbol:CsvClassifier', csvClassifier_quoteSymbol - A custom symbol to denote what combines content into a single column value. It must be different from the column delimiter.

$sel:version:CsvClassifier', csvClassifier_version - The version of this classifier.

$sel:name:CsvClassifier', csvClassifier_name - The name of the classifier.

csvClassifier_allowSingleColumn :: Lens' CsvClassifier (Maybe Bool) Source #

Enables the processing of files that contain only one column.

csvClassifier_containsHeader :: Lens' CsvClassifier (Maybe CsvHeaderOption) Source #

Indicates whether the CSV file contains a header.

csvClassifier_creationTime :: Lens' CsvClassifier (Maybe UTCTime) Source #

The time that this classifier was registered.

csvClassifier_customDatatypeConfigured :: Lens' CsvClassifier (Maybe Bool) Source #

Enables the custom datatype to be configured.

csvClassifier_customDatatypes :: Lens' CsvClassifier (Maybe [Text]) Source #

A list of custom datatypes including "BINARY", "BOOLEAN", "DATE", "DECIMAL", "DOUBLE", "FLOAT", "INT", "LONG", "SHORT", "STRING", "TIMESTAMP".

csvClassifier_delimiter :: Lens' CsvClassifier (Maybe Text) Source #

A custom symbol to denote what separates each column entry in the row.

csvClassifier_disableValueTrimming :: Lens' CsvClassifier (Maybe Bool) Source #

Specifies not to trim values before identifying the type of column values. The default value is true.

csvClassifier_header :: Lens' CsvClassifier (Maybe [Text]) Source #

A list of strings representing column names.

csvClassifier_lastUpdated :: Lens' CsvClassifier (Maybe UTCTime) Source #

The time that this classifier was last updated.

csvClassifier_quoteSymbol :: Lens' CsvClassifier (Maybe Text) Source #

A custom symbol to denote what combines content into a single column value. It must be different from the column delimiter.

csvClassifier_version :: Lens' CsvClassifier (Maybe Integer) Source #

The version of this classifier.

csvClassifier_name :: Lens' CsvClassifier Text Source #

The name of the classifier.

CustomCode

data CustomCode Source #

Specifies a transform that uses custom code you provide to perform the data transformation. The output is a collection of DynamicFrames.

See: newCustomCode smart constructor.

Constructors

CustomCode' 

Fields

Instances

Instances details
FromJSON CustomCode Source # 
Instance details

Defined in Amazonka.Glue.Types.CustomCode

ToJSON CustomCode Source # 
Instance details

Defined in Amazonka.Glue.Types.CustomCode

Generic CustomCode Source # 
Instance details

Defined in Amazonka.Glue.Types.CustomCode

Associated Types

type Rep CustomCode :: Type -> Type #

Read CustomCode Source # 
Instance details

Defined in Amazonka.Glue.Types.CustomCode

Show CustomCode Source # 
Instance details

Defined in Amazonka.Glue.Types.CustomCode

NFData CustomCode Source # 
Instance details

Defined in Amazonka.Glue.Types.CustomCode

Methods

rnf :: CustomCode -> () #

Eq CustomCode Source # 
Instance details

Defined in Amazonka.Glue.Types.CustomCode

Hashable CustomCode Source # 
Instance details

Defined in Amazonka.Glue.Types.CustomCode

type Rep CustomCode Source # 
Instance details

Defined in Amazonka.Glue.Types.CustomCode

type Rep CustomCode = D1 ('MetaData "CustomCode" "Amazonka.Glue.Types.CustomCode" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "CustomCode'" 'PrefixI 'True) ((S1 ('MetaSel ('Just "outputSchemas") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe [GlueSchema])) :*: S1 ('MetaSel ('Just "name") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text)) :*: (S1 ('MetaSel ('Just "inputs") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (NonEmpty Text)) :*: (S1 ('MetaSel ('Just "code") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text) :*: S1 ('MetaSel ('Just "className") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text)))))

newCustomCode Source #

Create a value of CustomCode with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:outputSchemas:CustomCode', customCode_outputSchemas - Specifies the data schema for the custom code transform.

$sel:name:CustomCode', customCode_name - The name of the transform node.

$sel:inputs:CustomCode', customCode_inputs - The data inputs identified by their node names.

$sel:code:CustomCode', customCode_code - The custom code that is used to perform the data transformation.

$sel:className:CustomCode', customCode_className - The name defined for the custom code node class.

customCode_outputSchemas :: Lens' CustomCode (Maybe [GlueSchema]) Source #

Specifies the data schema for the custom code transform.

customCode_name :: Lens' CustomCode Text Source #

The name of the transform node.

customCode_inputs :: Lens' CustomCode (NonEmpty Text) Source #

The data inputs identified by their node names.

customCode_code :: Lens' CustomCode Text Source #

The custom code that is used to perform the data transformation.

customCode_className :: Lens' CustomCode Text Source #

The name defined for the custom code node class.

CustomEntityType

data CustomEntityType Source #

An object representing a custom pattern for detecting sensitive data across the columns and rows of your structured data.

See: newCustomEntityType smart constructor.

Constructors

CustomEntityType' 

Fields

  • contextWords :: Maybe (NonEmpty Text)

    A list of context words. If none of these context words are found within the vicinity of the regular expression the data will not be detected as sensitive data.

    If no context words are passed only a regular expression is checked.

  • name :: Text

    A name for the custom pattern that allows it to be retrieved or deleted later. This name must be unique per Amazon Web Services account.

  • regexString :: Text

    A regular expression string that is used for detecting sensitive data in a custom pattern.

Instances

Instances details
FromJSON CustomEntityType Source # 
Instance details

Defined in Amazonka.Glue.Types.CustomEntityType

Generic CustomEntityType Source # 
Instance details

Defined in Amazonka.Glue.Types.CustomEntityType

Associated Types

type Rep CustomEntityType :: Type -> Type #

Read CustomEntityType Source # 
Instance details

Defined in Amazonka.Glue.Types.CustomEntityType

Show CustomEntityType Source # 
Instance details

Defined in Amazonka.Glue.Types.CustomEntityType

NFData CustomEntityType Source # 
Instance details

Defined in Amazonka.Glue.Types.CustomEntityType

Methods

rnf :: CustomEntityType -> () #

Eq CustomEntityType Source # 
Instance details

Defined in Amazonka.Glue.Types.CustomEntityType

Hashable CustomEntityType Source # 
Instance details

Defined in Amazonka.Glue.Types.CustomEntityType

type Rep CustomEntityType Source # 
Instance details

Defined in Amazonka.Glue.Types.CustomEntityType

type Rep CustomEntityType = D1 ('MetaData "CustomEntityType" "Amazonka.Glue.Types.CustomEntityType" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "CustomEntityType'" 'PrefixI 'True) (S1 ('MetaSel ('Just "contextWords") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe (NonEmpty Text))) :*: (S1 ('MetaSel ('Just "name") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text) :*: S1 ('MetaSel ('Just "regexString") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text))))

newCustomEntityType Source #

Create a value of CustomEntityType with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:contextWords:CustomEntityType', customEntityType_contextWords - A list of context words. If none of these context words are found within the vicinity of the regular expression the data will not be detected as sensitive data.

If no context words are passed only a regular expression is checked.

$sel:name:CustomEntityType', customEntityType_name - A name for the custom pattern that allows it to be retrieved or deleted later. This name must be unique per Amazon Web Services account.

$sel:regexString:CustomEntityType', customEntityType_regexString - A regular expression string that is used for detecting sensitive data in a custom pattern.

customEntityType_contextWords :: Lens' CustomEntityType (Maybe (NonEmpty Text)) Source #

A list of context words. If none of these context words are found within the vicinity of the regular expression the data will not be detected as sensitive data.

If no context words are passed only a regular expression is checked.

customEntityType_name :: Lens' CustomEntityType Text Source #

A name for the custom pattern that allows it to be retrieved or deleted later. This name must be unique per Amazon Web Services account.

customEntityType_regexString :: Lens' CustomEntityType Text Source #

A regular expression string that is used for detecting sensitive data in a custom pattern.

DQResultsPublishingOptions

data DQResultsPublishingOptions Source #

Options to configure how your data quality evaluation results are published.

See: newDQResultsPublishingOptions smart constructor.

Constructors

DQResultsPublishingOptions' 

Fields

Instances

Instances details
FromJSON DQResultsPublishingOptions Source # 
Instance details

Defined in Amazonka.Glue.Types.DQResultsPublishingOptions

ToJSON DQResultsPublishingOptions Source # 
Instance details

Defined in Amazonka.Glue.Types.DQResultsPublishingOptions

Generic DQResultsPublishingOptions Source # 
Instance details

Defined in Amazonka.Glue.Types.DQResultsPublishingOptions

Associated Types

type Rep DQResultsPublishingOptions :: Type -> Type #

Read DQResultsPublishingOptions Source # 
Instance details

Defined in Amazonka.Glue.Types.DQResultsPublishingOptions

Show DQResultsPublishingOptions Source # 
Instance details

Defined in Amazonka.Glue.Types.DQResultsPublishingOptions

NFData DQResultsPublishingOptions Source # 
Instance details

Defined in Amazonka.Glue.Types.DQResultsPublishingOptions

Eq DQResultsPublishingOptions Source # 
Instance details

Defined in Amazonka.Glue.Types.DQResultsPublishingOptions

Hashable DQResultsPublishingOptions Source # 
Instance details

Defined in Amazonka.Glue.Types.DQResultsPublishingOptions

type Rep DQResultsPublishingOptions Source # 
Instance details

Defined in Amazonka.Glue.Types.DQResultsPublishingOptions

type Rep DQResultsPublishingOptions = D1 ('MetaData "DQResultsPublishingOptions" "Amazonka.Glue.Types.DQResultsPublishingOptions" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "DQResultsPublishingOptions'" 'PrefixI 'True) ((S1 ('MetaSel ('Just "cloudWatchMetricsEnabled") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Bool)) :*: S1 ('MetaSel ('Just "evaluationContext") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text))) :*: (S1 ('MetaSel ('Just "resultsPublishingEnabled") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Bool)) :*: S1 ('MetaSel ('Just "resultsS3Prefix") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)))))

newDQResultsPublishingOptions :: DQResultsPublishingOptions Source #

Create a value of DQResultsPublishingOptions with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:cloudWatchMetricsEnabled:DQResultsPublishingOptions', dQResultsPublishingOptions_cloudWatchMetricsEnabled - Enable metrics for your data quality results.

$sel:evaluationContext:DQResultsPublishingOptions', dQResultsPublishingOptions_evaluationContext - The context of the evaluation.

$sel:resultsPublishingEnabled:DQResultsPublishingOptions', dQResultsPublishingOptions_resultsPublishingEnabled - Enable publishing for your data quality results.

$sel:resultsS3Prefix:DQResultsPublishingOptions', dQResultsPublishingOptions_resultsS3Prefix - The Amazon S3 prefix prepended to the results.

DQStopJobOnFailureOptions

data DQStopJobOnFailureOptions Source #

Options to configure how your job will stop if your data quality evaluation fails.

See: newDQStopJobOnFailureOptions smart constructor.

Constructors

DQStopJobOnFailureOptions' 

Fields

Instances

Instances details
FromJSON DQStopJobOnFailureOptions Source # 
Instance details

Defined in Amazonka.Glue.Types.DQStopJobOnFailureOptions

ToJSON DQStopJobOnFailureOptions Source # 
Instance details

Defined in Amazonka.Glue.Types.DQStopJobOnFailureOptions

Generic DQStopJobOnFailureOptions Source # 
Instance details

Defined in Amazonka.Glue.Types.DQStopJobOnFailureOptions

Associated Types

type Rep DQStopJobOnFailureOptions :: Type -> Type #

Read DQStopJobOnFailureOptions Source # 
Instance details

Defined in Amazonka.Glue.Types.DQStopJobOnFailureOptions

Show DQStopJobOnFailureOptions Source # 
Instance details

Defined in Amazonka.Glue.Types.DQStopJobOnFailureOptions

NFData DQStopJobOnFailureOptions Source # 
Instance details

Defined in Amazonka.Glue.Types.DQStopJobOnFailureOptions

Eq DQStopJobOnFailureOptions Source # 
Instance details

Defined in Amazonka.Glue.Types.DQStopJobOnFailureOptions

Hashable DQStopJobOnFailureOptions Source # 
Instance details

Defined in Amazonka.Glue.Types.DQStopJobOnFailureOptions

type Rep DQStopJobOnFailureOptions Source # 
Instance details

Defined in Amazonka.Glue.Types.DQStopJobOnFailureOptions

type Rep DQStopJobOnFailureOptions = D1 ('MetaData "DQStopJobOnFailureOptions" "Amazonka.Glue.Types.DQStopJobOnFailureOptions" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "DQStopJobOnFailureOptions'" 'PrefixI 'True) (S1 ('MetaSel ('Just "stopJobOnFailureTiming") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe DQStopJobOnFailureTiming))))

newDQStopJobOnFailureOptions :: DQStopJobOnFailureOptions Source #

Create a value of DQStopJobOnFailureOptions with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:stopJobOnFailureTiming:DQStopJobOnFailureOptions', dQStopJobOnFailureOptions_stopJobOnFailureTiming - When to stop job if your data quality evaluation fails. Options are Immediate or AfterDataLoad.

dQStopJobOnFailureOptions_stopJobOnFailureTiming :: Lens' DQStopJobOnFailureOptions (Maybe DQStopJobOnFailureTiming) Source #

When to stop job if your data quality evaluation fails. Options are Immediate or AfterDataLoad.

DataCatalogEncryptionSettings

data DataCatalogEncryptionSettings Source #

Contains configuration information for maintaining Data Catalog security.

See: newDataCatalogEncryptionSettings smart constructor.

Constructors

DataCatalogEncryptionSettings' 

Fields

Instances

Instances details
FromJSON DataCatalogEncryptionSettings Source # 
Instance details

Defined in Amazonka.Glue.Types.DataCatalogEncryptionSettings

ToJSON DataCatalogEncryptionSettings Source # 
Instance details

Defined in Amazonka.Glue.Types.DataCatalogEncryptionSettings

Generic DataCatalogEncryptionSettings Source # 
Instance details

Defined in Amazonka.Glue.Types.DataCatalogEncryptionSettings

Associated Types

type Rep DataCatalogEncryptionSettings :: Type -> Type #

Read DataCatalogEncryptionSettings Source # 
Instance details

Defined in Amazonka.Glue.Types.DataCatalogEncryptionSettings

Show DataCatalogEncryptionSettings Source # 
Instance details

Defined in Amazonka.Glue.Types.DataCatalogEncryptionSettings

NFData DataCatalogEncryptionSettings Source # 
Instance details

Defined in Amazonka.Glue.Types.DataCatalogEncryptionSettings

Eq DataCatalogEncryptionSettings Source # 
Instance details

Defined in Amazonka.Glue.Types.DataCatalogEncryptionSettings

Hashable DataCatalogEncryptionSettings Source # 
Instance details

Defined in Amazonka.Glue.Types.DataCatalogEncryptionSettings

type Rep DataCatalogEncryptionSettings Source # 
Instance details

Defined in Amazonka.Glue.Types.DataCatalogEncryptionSettings

type Rep DataCatalogEncryptionSettings = D1 ('MetaData "DataCatalogEncryptionSettings" "Amazonka.Glue.Types.DataCatalogEncryptionSettings" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "DataCatalogEncryptionSettings'" 'PrefixI 'True) (S1 ('MetaSel ('Just "connectionPasswordEncryption") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe ConnectionPasswordEncryption)) :*: S1 ('MetaSel ('Just "encryptionAtRest") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe EncryptionAtRest))))

newDataCatalogEncryptionSettings :: DataCatalogEncryptionSettings Source #

Create a value of DataCatalogEncryptionSettings with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:connectionPasswordEncryption:DataCatalogEncryptionSettings', dataCatalogEncryptionSettings_connectionPasswordEncryption - When connection password protection is enabled, the Data Catalog uses a customer-provided key to encrypt the password as part of CreateConnection or UpdateConnection and store it in the ENCRYPTED_PASSWORD field in the connection properties. You can enable catalog encryption or only password encryption.

$sel:encryptionAtRest:DataCatalogEncryptionSettings', dataCatalogEncryptionSettings_encryptionAtRest - Specifies the encryption-at-rest configuration for the Data Catalog.

dataCatalogEncryptionSettings_connectionPasswordEncryption :: Lens' DataCatalogEncryptionSettings (Maybe ConnectionPasswordEncryption) Source #

When connection password protection is enabled, the Data Catalog uses a customer-provided key to encrypt the password as part of CreateConnection or UpdateConnection and store it in the ENCRYPTED_PASSWORD field in the connection properties. You can enable catalog encryption or only password encryption.

dataCatalogEncryptionSettings_encryptionAtRest :: Lens' DataCatalogEncryptionSettings (Maybe EncryptionAtRest) Source #

Specifies the encryption-at-rest configuration for the Data Catalog.

DataLakePrincipal

data DataLakePrincipal Source #

The Lake Formation principal.

See: newDataLakePrincipal smart constructor.

Constructors

DataLakePrincipal' 

Fields

Instances

Instances details
FromJSON DataLakePrincipal Source # 
Instance details

Defined in Amazonka.Glue.Types.DataLakePrincipal

ToJSON DataLakePrincipal Source # 
Instance details

Defined in Amazonka.Glue.Types.DataLakePrincipal

Generic DataLakePrincipal Source # 
Instance details

Defined in Amazonka.Glue.Types.DataLakePrincipal

Associated Types

type Rep DataLakePrincipal :: Type -> Type #

Read DataLakePrincipal Source # 
Instance details

Defined in Amazonka.Glue.Types.DataLakePrincipal

Show DataLakePrincipal Source # 
Instance details

Defined in Amazonka.Glue.Types.DataLakePrincipal

NFData DataLakePrincipal Source # 
Instance details

Defined in Amazonka.Glue.Types.DataLakePrincipal

Methods

rnf :: DataLakePrincipal -> () #

Eq DataLakePrincipal Source # 
Instance details

Defined in Amazonka.Glue.Types.DataLakePrincipal

Hashable DataLakePrincipal Source # 
Instance details

Defined in Amazonka.Glue.Types.DataLakePrincipal

type Rep DataLakePrincipal Source # 
Instance details

Defined in Amazonka.Glue.Types.DataLakePrincipal

type Rep DataLakePrincipal = D1 ('MetaData "DataLakePrincipal" "Amazonka.Glue.Types.DataLakePrincipal" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "DataLakePrincipal'" 'PrefixI 'True) (S1 ('MetaSel ('Just "dataLakePrincipalIdentifier") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text))))

newDataLakePrincipal :: DataLakePrincipal Source #

Create a value of DataLakePrincipal with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:dataLakePrincipalIdentifier:DataLakePrincipal', dataLakePrincipal_dataLakePrincipalIdentifier - An identifier for the Lake Formation principal.

dataLakePrincipal_dataLakePrincipalIdentifier :: Lens' DataLakePrincipal (Maybe Text) Source #

An identifier for the Lake Formation principal.

DataQualityEvaluationRunAdditionalRunOptions

data DataQualityEvaluationRunAdditionalRunOptions Source #

Additional run options you can specify for an evaluation run.

See: newDataQualityEvaluationRunAdditionalRunOptions smart constructor.

Constructors

DataQualityEvaluationRunAdditionalRunOptions' 

Fields

Instances

Instances details
FromJSON DataQualityEvaluationRunAdditionalRunOptions Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityEvaluationRunAdditionalRunOptions

ToJSON DataQualityEvaluationRunAdditionalRunOptions Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityEvaluationRunAdditionalRunOptions

Generic DataQualityEvaluationRunAdditionalRunOptions Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityEvaluationRunAdditionalRunOptions

Read DataQualityEvaluationRunAdditionalRunOptions Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityEvaluationRunAdditionalRunOptions

Show DataQualityEvaluationRunAdditionalRunOptions Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityEvaluationRunAdditionalRunOptions

NFData DataQualityEvaluationRunAdditionalRunOptions Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityEvaluationRunAdditionalRunOptions

Eq DataQualityEvaluationRunAdditionalRunOptions Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityEvaluationRunAdditionalRunOptions

Hashable DataQualityEvaluationRunAdditionalRunOptions Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityEvaluationRunAdditionalRunOptions

type Rep DataQualityEvaluationRunAdditionalRunOptions Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityEvaluationRunAdditionalRunOptions

type Rep DataQualityEvaluationRunAdditionalRunOptions = D1 ('MetaData "DataQualityEvaluationRunAdditionalRunOptions" "Amazonka.Glue.Types.DataQualityEvaluationRunAdditionalRunOptions" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "DataQualityEvaluationRunAdditionalRunOptions'" 'PrefixI 'True) (S1 ('MetaSel ('Just "cloudWatchMetricsEnabled") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Bool)) :*: S1 ('MetaSel ('Just "resultsS3Prefix") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text))))

newDataQualityEvaluationRunAdditionalRunOptions :: DataQualityEvaluationRunAdditionalRunOptions Source #

Create a value of DataQualityEvaluationRunAdditionalRunOptions with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:cloudWatchMetricsEnabled:DataQualityEvaluationRunAdditionalRunOptions', dataQualityEvaluationRunAdditionalRunOptions_cloudWatchMetricsEnabled - Whether or not to enable CloudWatch metrics.

$sel:resultsS3Prefix:DataQualityEvaluationRunAdditionalRunOptions', dataQualityEvaluationRunAdditionalRunOptions_resultsS3Prefix - Prefix for Amazon S3 to store results.

DataQualityResult

data DataQualityResult Source #

Describes a data quality result.

See: newDataQualityResult smart constructor.

Constructors

DataQualityResult' 

Fields

Instances

Instances details
FromJSON DataQualityResult Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityResult

Generic DataQualityResult Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityResult

Associated Types

type Rep DataQualityResult :: Type -> Type #

Read DataQualityResult Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityResult

Show DataQualityResult Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityResult

NFData DataQualityResult Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityResult

Methods

rnf :: DataQualityResult -> () #

Eq DataQualityResult Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityResult

Hashable DataQualityResult Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityResult

type Rep DataQualityResult Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityResult

type Rep DataQualityResult = D1 ('MetaData "DataQualityResult" "Amazonka.Glue.Types.DataQualityResult" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "DataQualityResult'" 'PrefixI 'True) (((S1 ('MetaSel ('Just "completedOn") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe POSIX)) :*: S1 ('MetaSel ('Just "dataSource") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe DataSource))) :*: (S1 ('MetaSel ('Just "evaluationContext") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: (S1 ('MetaSel ('Just "jobName") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "jobRunId") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text))))) :*: ((S1 ('MetaSel ('Just "resultId") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: (S1 ('MetaSel ('Just "ruleResults") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe (NonEmpty DataQualityRuleResult))) :*: S1 ('MetaSel ('Just "rulesetEvaluationRunId") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)))) :*: (S1 ('MetaSel ('Just "rulesetName") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: (S1 ('MetaSel ('Just "score") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Double)) :*: S1 ('MetaSel ('Just "startedOn") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe POSIX)))))))

newDataQualityResult :: DataQualityResult Source #

Create a value of DataQualityResult with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:completedOn:DataQualityResult', dataQualityResult_completedOn - The date and time when this data quality run completed.

$sel:dataSource:DataQualityResult', dataQualityResult_dataSource - The table associated with the data quality result, if any.

$sel:evaluationContext:DataQualityResult', dataQualityResult_evaluationContext - In the context of a job in Glue Studio, each node in the canvas is typically assigned some sort of name and data quality nodes will have names. In the case of multiple nodes, the evaluationContext can differentiate the nodes.

$sel:jobName:DataQualityResult', dataQualityResult_jobName - The job name associated with the data quality result, if any.

$sel:jobRunId:DataQualityResult', dataQualityResult_jobRunId - The job run ID associated with the data quality result, if any.

$sel:resultId:DataQualityResult', dataQualityResult_resultId - A unique result ID for the data quality result.

$sel:ruleResults:DataQualityResult', dataQualityResult_ruleResults - A list of DataQualityRuleResult objects representing the results for each rule.

$sel:rulesetEvaluationRunId:DataQualityResult', dataQualityResult_rulesetEvaluationRunId - The unique run ID for the ruleset evaluation for this data quality result.

$sel:rulesetName:DataQualityResult', dataQualityResult_rulesetName - The name of the ruleset associated with the data quality result.

$sel:score:DataQualityResult', dataQualityResult_score - An aggregate data quality score. Represents the ratio of rules that passed to the total number of rules.

$sel:startedOn:DataQualityResult', dataQualityResult_startedOn - The date and time when this data quality run started.

dataQualityResult_completedOn :: Lens' DataQualityResult (Maybe UTCTime) Source #

The date and time when this data quality run completed.

dataQualityResult_dataSource :: Lens' DataQualityResult (Maybe DataSource) Source #

The table associated with the data quality result, if any.

dataQualityResult_evaluationContext :: Lens' DataQualityResult (Maybe Text) Source #

In the context of a job in Glue Studio, each node in the canvas is typically assigned some sort of name and data quality nodes will have names. In the case of multiple nodes, the evaluationContext can differentiate the nodes.

dataQualityResult_jobName :: Lens' DataQualityResult (Maybe Text) Source #

The job name associated with the data quality result, if any.

dataQualityResult_jobRunId :: Lens' DataQualityResult (Maybe Text) Source #

The job run ID associated with the data quality result, if any.

dataQualityResult_resultId :: Lens' DataQualityResult (Maybe Text) Source #

A unique result ID for the data quality result.

dataQualityResult_ruleResults :: Lens' DataQualityResult (Maybe (NonEmpty DataQualityRuleResult)) Source #

A list of DataQualityRuleResult objects representing the results for each rule.

dataQualityResult_rulesetEvaluationRunId :: Lens' DataQualityResult (Maybe Text) Source #

The unique run ID for the ruleset evaluation for this data quality result.

dataQualityResult_rulesetName :: Lens' DataQualityResult (Maybe Text) Source #

The name of the ruleset associated with the data quality result.

dataQualityResult_score :: Lens' DataQualityResult (Maybe Double) Source #

An aggregate data quality score. Represents the ratio of rules that passed to the total number of rules.

dataQualityResult_startedOn :: Lens' DataQualityResult (Maybe UTCTime) Source #

The date and time when this data quality run started.

DataQualityResultDescription

data DataQualityResultDescription Source #

Describes a data quality result.

See: newDataQualityResultDescription smart constructor.

Constructors

DataQualityResultDescription' 

Fields

Instances

Instances details
FromJSON DataQualityResultDescription Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityResultDescription

Generic DataQualityResultDescription Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityResultDescription

Associated Types

type Rep DataQualityResultDescription :: Type -> Type #

Read DataQualityResultDescription Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityResultDescription

Show DataQualityResultDescription Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityResultDescription

NFData DataQualityResultDescription Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityResultDescription

Eq DataQualityResultDescription Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityResultDescription

Hashable DataQualityResultDescription Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityResultDescription

type Rep DataQualityResultDescription Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityResultDescription

type Rep DataQualityResultDescription = D1 ('MetaData "DataQualityResultDescription" "Amazonka.Glue.Types.DataQualityResultDescription" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "DataQualityResultDescription'" 'PrefixI 'True) ((S1 ('MetaSel ('Just "dataSource") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe DataSource)) :*: S1 ('MetaSel ('Just "jobName") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text))) :*: (S1 ('MetaSel ('Just "jobRunId") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: (S1 ('MetaSel ('Just "resultId") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "startedOn") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe POSIX))))))

newDataQualityResultDescription :: DataQualityResultDescription Source #

Create a value of DataQualityResultDescription with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:dataSource:DataQualityResultDescription', dataQualityResultDescription_dataSource - The table name associated with the data quality result.

$sel:jobName:DataQualityResultDescription', dataQualityResultDescription_jobName - The job name associated with the data quality result.

$sel:jobRunId:DataQualityResultDescription', dataQualityResultDescription_jobRunId - The job run ID associated with the data quality result.

$sel:resultId:DataQualityResultDescription', dataQualityResultDescription_resultId - The unique result ID for this data quality result.

$sel:startedOn:DataQualityResultDescription', dataQualityResultDescription_startedOn - The time that the run started for this data quality result.

dataQualityResultDescription_dataSource :: Lens' DataQualityResultDescription (Maybe DataSource) Source #

The table name associated with the data quality result.

dataQualityResultDescription_jobName :: Lens' DataQualityResultDescription (Maybe Text) Source #

The job name associated with the data quality result.

dataQualityResultDescription_jobRunId :: Lens' DataQualityResultDescription (Maybe Text) Source #

The job run ID associated with the data quality result.

dataQualityResultDescription_resultId :: Lens' DataQualityResultDescription (Maybe Text) Source #

The unique result ID for this data quality result.

dataQualityResultDescription_startedOn :: Lens' DataQualityResultDescription (Maybe UTCTime) Source #

The time that the run started for this data quality result.

DataQualityResultFilterCriteria

data DataQualityResultFilterCriteria Source #

Criteria used to return data quality results.

See: newDataQualityResultFilterCriteria smart constructor.

Constructors

DataQualityResultFilterCriteria' 

Fields

Instances

Instances details
ToJSON DataQualityResultFilterCriteria Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityResultFilterCriteria

Generic DataQualityResultFilterCriteria Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityResultFilterCriteria

Associated Types

type Rep DataQualityResultFilterCriteria :: Type -> Type #

Read DataQualityResultFilterCriteria Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityResultFilterCriteria

Show DataQualityResultFilterCriteria Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityResultFilterCriteria

NFData DataQualityResultFilterCriteria Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityResultFilterCriteria

Eq DataQualityResultFilterCriteria Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityResultFilterCriteria

Hashable DataQualityResultFilterCriteria Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityResultFilterCriteria

type Rep DataQualityResultFilterCriteria Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityResultFilterCriteria

type Rep DataQualityResultFilterCriteria = D1 ('MetaData "DataQualityResultFilterCriteria" "Amazonka.Glue.Types.DataQualityResultFilterCriteria" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "DataQualityResultFilterCriteria'" 'PrefixI 'True) ((S1 ('MetaSel ('Just "dataSource") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe DataSource)) :*: S1 ('MetaSel ('Just "jobName") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text))) :*: (S1 ('MetaSel ('Just "jobRunId") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: (S1 ('MetaSel ('Just "startedAfter") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe POSIX)) :*: S1 ('MetaSel ('Just "startedBefore") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe POSIX))))))

newDataQualityResultFilterCriteria :: DataQualityResultFilterCriteria Source #

Create a value of DataQualityResultFilterCriteria with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:dataSource:DataQualityResultFilterCriteria', dataQualityResultFilterCriteria_dataSource - Filter results by the specified data source. For example, retrieving all results for an Glue table.

$sel:jobName:DataQualityResultFilterCriteria', dataQualityResultFilterCriteria_jobName - Filter results by the specified job name.

$sel:jobRunId:DataQualityResultFilterCriteria', dataQualityResultFilterCriteria_jobRunId - Filter results by the specified job run ID.

$sel:startedAfter:DataQualityResultFilterCriteria', dataQualityResultFilterCriteria_startedAfter - Filter results by runs that started after this time.

$sel:startedBefore:DataQualityResultFilterCriteria', dataQualityResultFilterCriteria_startedBefore - Filter results by runs that started before this time.

dataQualityResultFilterCriteria_dataSource :: Lens' DataQualityResultFilterCriteria (Maybe DataSource) Source #

Filter results by the specified data source. For example, retrieving all results for an Glue table.

DataQualityRuleRecommendationRunDescription

data DataQualityRuleRecommendationRunDescription Source #

Describes the result of a data quality rule recommendation run.

See: newDataQualityRuleRecommendationRunDescription smart constructor.

Constructors

DataQualityRuleRecommendationRunDescription' 

Fields

Instances

Instances details
FromJSON DataQualityRuleRecommendationRunDescription Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityRuleRecommendationRunDescription

Generic DataQualityRuleRecommendationRunDescription Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityRuleRecommendationRunDescription

Read DataQualityRuleRecommendationRunDescription Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityRuleRecommendationRunDescription

Show DataQualityRuleRecommendationRunDescription Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityRuleRecommendationRunDescription

NFData DataQualityRuleRecommendationRunDescription Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityRuleRecommendationRunDescription

Eq DataQualityRuleRecommendationRunDescription Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityRuleRecommendationRunDescription

Hashable DataQualityRuleRecommendationRunDescription Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityRuleRecommendationRunDescription

type Rep DataQualityRuleRecommendationRunDescription Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityRuleRecommendationRunDescription

type Rep DataQualityRuleRecommendationRunDescription = D1 ('MetaData "DataQualityRuleRecommendationRunDescription" "Amazonka.Glue.Types.DataQualityRuleRecommendationRunDescription" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "DataQualityRuleRecommendationRunDescription'" 'PrefixI 'True) ((S1 ('MetaSel ('Just "dataSource") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe DataSource)) :*: S1 ('MetaSel ('Just "runId") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text))) :*: (S1 ('MetaSel ('Just "startedOn") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe POSIX)) :*: S1 ('MetaSel ('Just "status") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe TaskStatusType)))))

newDataQualityRuleRecommendationRunDescription :: DataQualityRuleRecommendationRunDescription Source #

Create a value of DataQualityRuleRecommendationRunDescription with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:dataSource:DataQualityRuleRecommendationRunDescription', dataQualityRuleRecommendationRunDescription_dataSource - The data source (Glue table) associated with the recommendation run.

$sel:runId:DataQualityRuleRecommendationRunDescription', dataQualityRuleRecommendationRunDescription_runId - The unique run identifier associated with this run.

$sel:startedOn:DataQualityRuleRecommendationRunDescription', dataQualityRuleRecommendationRunDescription_startedOn - The date and time when this run started.

$sel:status:DataQualityRuleRecommendationRunDescription', dataQualityRuleRecommendationRunDescription_status - The status for this run.

DataQualityRuleRecommendationRunFilter

data DataQualityRuleRecommendationRunFilter Source #

A filter for listing data quality recommendation runs.

See: newDataQualityRuleRecommendationRunFilter smart constructor.

Constructors

DataQualityRuleRecommendationRunFilter' 

Fields

Instances

Instances details
ToJSON DataQualityRuleRecommendationRunFilter Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityRuleRecommendationRunFilter

Generic DataQualityRuleRecommendationRunFilter Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityRuleRecommendationRunFilter

Read DataQualityRuleRecommendationRunFilter Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityRuleRecommendationRunFilter

Show DataQualityRuleRecommendationRunFilter Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityRuleRecommendationRunFilter

NFData DataQualityRuleRecommendationRunFilter Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityRuleRecommendationRunFilter

Eq DataQualityRuleRecommendationRunFilter Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityRuleRecommendationRunFilter

Hashable DataQualityRuleRecommendationRunFilter Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityRuleRecommendationRunFilter

type Rep DataQualityRuleRecommendationRunFilter Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityRuleRecommendationRunFilter

type Rep DataQualityRuleRecommendationRunFilter = D1 ('MetaData "DataQualityRuleRecommendationRunFilter" "Amazonka.Glue.Types.DataQualityRuleRecommendationRunFilter" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "DataQualityRuleRecommendationRunFilter'" 'PrefixI 'True) (S1 ('MetaSel ('Just "startedAfter") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe POSIX)) :*: (S1 ('MetaSel ('Just "startedBefore") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe POSIX)) :*: S1 ('MetaSel ('Just "dataSource") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 DataSource))))

newDataQualityRuleRecommendationRunFilter Source #

Create a value of DataQualityRuleRecommendationRunFilter with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:startedAfter:DataQualityRuleRecommendationRunFilter', dataQualityRuleRecommendationRunFilter_startedAfter - Filter based on time for results started after provided time.

$sel:startedBefore:DataQualityRuleRecommendationRunFilter', dataQualityRuleRecommendationRunFilter_startedBefore - Filter based on time for results started before provided time.

$sel:dataSource:DataQualityRuleRecommendationRunFilter', dataQualityRuleRecommendationRunFilter_dataSource - Filter based on a specified data source (Glue table).

DataQualityRuleResult

data DataQualityRuleResult Source #

Describes the result of the evaluation of a data quality rule.

See: newDataQualityRuleResult smart constructor.

Constructors

DataQualityRuleResult' 

Fields

Instances

Instances details
FromJSON DataQualityRuleResult Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityRuleResult

Generic DataQualityRuleResult Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityRuleResult

Associated Types

type Rep DataQualityRuleResult :: Type -> Type #

Read DataQualityRuleResult Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityRuleResult

Show DataQualityRuleResult Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityRuleResult

NFData DataQualityRuleResult Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityRuleResult

Methods

rnf :: DataQualityRuleResult -> () #

Eq DataQualityRuleResult Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityRuleResult

Hashable DataQualityRuleResult Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityRuleResult

type Rep DataQualityRuleResult Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityRuleResult

type Rep DataQualityRuleResult = D1 ('MetaData "DataQualityRuleResult" "Amazonka.Glue.Types.DataQualityRuleResult" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "DataQualityRuleResult'" 'PrefixI 'True) ((S1 ('MetaSel ('Just "description") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "evaluationMessage") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text))) :*: (S1 ('MetaSel ('Just "name") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "result") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe DataQualityRuleResultStatus)))))

newDataQualityRuleResult :: DataQualityRuleResult Source #

Create a value of DataQualityRuleResult with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:description:DataQualityRuleResult', dataQualityRuleResult_description - A description of the data quality rule.

$sel:evaluationMessage:DataQualityRuleResult', dataQualityRuleResult_evaluationMessage - An evaluation message.

$sel:name:DataQualityRuleResult', dataQualityRuleResult_name - The name of the data quality rule.

$sel:result:DataQualityRuleResult', dataQualityRuleResult_result - A pass or fail status for the rule.

dataQualityRuleResult_description :: Lens' DataQualityRuleResult (Maybe Text) Source #

A description of the data quality rule.

DataQualityRulesetEvaluationRunDescription

data DataQualityRulesetEvaluationRunDescription Source #

Describes the result of a data quality ruleset evaluation run.

See: newDataQualityRulesetEvaluationRunDescription smart constructor.

Constructors

DataQualityRulesetEvaluationRunDescription' 

Fields

Instances

Instances details
FromJSON DataQualityRulesetEvaluationRunDescription Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityRulesetEvaluationRunDescription

Generic DataQualityRulesetEvaluationRunDescription Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityRulesetEvaluationRunDescription

Read DataQualityRulesetEvaluationRunDescription Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityRulesetEvaluationRunDescription

Show DataQualityRulesetEvaluationRunDescription Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityRulesetEvaluationRunDescription

NFData DataQualityRulesetEvaluationRunDescription Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityRulesetEvaluationRunDescription

Eq DataQualityRulesetEvaluationRunDescription Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityRulesetEvaluationRunDescription

Hashable DataQualityRulesetEvaluationRunDescription Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityRulesetEvaluationRunDescription

type Rep DataQualityRulesetEvaluationRunDescription Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityRulesetEvaluationRunDescription

type Rep DataQualityRulesetEvaluationRunDescription = D1 ('MetaData "DataQualityRulesetEvaluationRunDescription" "Amazonka.Glue.Types.DataQualityRulesetEvaluationRunDescription" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "DataQualityRulesetEvaluationRunDescription'" 'PrefixI 'True) ((S1 ('MetaSel ('Just "dataSource") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe DataSource)) :*: S1 ('MetaSel ('Just "runId") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text))) :*: (S1 ('MetaSel ('Just "startedOn") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe POSIX)) :*: S1 ('MetaSel ('Just "status") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe TaskStatusType)))))

newDataQualityRulesetEvaluationRunDescription :: DataQualityRulesetEvaluationRunDescription Source #

Create a value of DataQualityRulesetEvaluationRunDescription with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:dataSource:DataQualityRulesetEvaluationRunDescription', dataQualityRulesetEvaluationRunDescription_dataSource - The data source (an Glue table) associated with the run.

$sel:runId:DataQualityRulesetEvaluationRunDescription', dataQualityRulesetEvaluationRunDescription_runId - The unique run identifier associated with this run.

$sel:startedOn:DataQualityRulesetEvaluationRunDescription', dataQualityRulesetEvaluationRunDescription_startedOn - The date and time when the run started.

$sel:status:DataQualityRulesetEvaluationRunDescription', dataQualityRulesetEvaluationRunDescription_status - The status for this run.

DataQualityRulesetEvaluationRunFilter

data DataQualityRulesetEvaluationRunFilter Source #

The filter criteria.

See: newDataQualityRulesetEvaluationRunFilter smart constructor.

Constructors

DataQualityRulesetEvaluationRunFilter' 

Fields

Instances

Instances details
ToJSON DataQualityRulesetEvaluationRunFilter Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityRulesetEvaluationRunFilter

Generic DataQualityRulesetEvaluationRunFilter Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityRulesetEvaluationRunFilter

Read DataQualityRulesetEvaluationRunFilter Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityRulesetEvaluationRunFilter

Show DataQualityRulesetEvaluationRunFilter Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityRulesetEvaluationRunFilter

NFData DataQualityRulesetEvaluationRunFilter Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityRulesetEvaluationRunFilter

Eq DataQualityRulesetEvaluationRunFilter Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityRulesetEvaluationRunFilter

Hashable DataQualityRulesetEvaluationRunFilter Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityRulesetEvaluationRunFilter

type Rep DataQualityRulesetEvaluationRunFilter Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityRulesetEvaluationRunFilter

type Rep DataQualityRulesetEvaluationRunFilter = D1 ('MetaData "DataQualityRulesetEvaluationRunFilter" "Amazonka.Glue.Types.DataQualityRulesetEvaluationRunFilter" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "DataQualityRulesetEvaluationRunFilter'" 'PrefixI 'True) (S1 ('MetaSel ('Just "startedAfter") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe POSIX)) :*: (S1 ('MetaSel ('Just "startedBefore") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe POSIX)) :*: S1 ('MetaSel ('Just "dataSource") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 DataSource))))

newDataQualityRulesetEvaluationRunFilter Source #

Create a value of DataQualityRulesetEvaluationRunFilter with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:startedAfter:DataQualityRulesetEvaluationRunFilter', dataQualityRulesetEvaluationRunFilter_startedAfter - Filter results by runs that started after this time.

$sel:startedBefore:DataQualityRulesetEvaluationRunFilter', dataQualityRulesetEvaluationRunFilter_startedBefore - Filter results by runs that started before this time.

$sel:dataSource:DataQualityRulesetEvaluationRunFilter', dataQualityRulesetEvaluationRunFilter_dataSource - Filter based on a data source (an Glue table) associated with the run.

dataQualityRulesetEvaluationRunFilter_dataSource :: Lens' DataQualityRulesetEvaluationRunFilter DataSource Source #

Filter based on a data source (an Glue table) associated with the run.

DataQualityRulesetFilterCriteria

data DataQualityRulesetFilterCriteria Source #

The criteria used to filter data quality rulesets.

See: newDataQualityRulesetFilterCriteria smart constructor.

Constructors

DataQualityRulesetFilterCriteria' 

Fields

Instances

Instances details
ToJSON DataQualityRulesetFilterCriteria Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityRulesetFilterCriteria

Generic DataQualityRulesetFilterCriteria Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityRulesetFilterCriteria

Associated Types

type Rep DataQualityRulesetFilterCriteria :: Type -> Type #

Read DataQualityRulesetFilterCriteria Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityRulesetFilterCriteria

Show DataQualityRulesetFilterCriteria Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityRulesetFilterCriteria

NFData DataQualityRulesetFilterCriteria Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityRulesetFilterCriteria

Eq DataQualityRulesetFilterCriteria Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityRulesetFilterCriteria

Hashable DataQualityRulesetFilterCriteria Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityRulesetFilterCriteria

type Rep DataQualityRulesetFilterCriteria Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityRulesetFilterCriteria

type Rep DataQualityRulesetFilterCriteria = D1 ('MetaData "DataQualityRulesetFilterCriteria" "Amazonka.Glue.Types.DataQualityRulesetFilterCriteria" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "DataQualityRulesetFilterCriteria'" 'PrefixI 'True) ((S1 ('MetaSel ('Just "createdAfter") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe POSIX)) :*: (S1 ('MetaSel ('Just "createdBefore") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe POSIX)) :*: S1 ('MetaSel ('Just "description") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)))) :*: ((S1 ('MetaSel ('Just "lastModifiedAfter") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe POSIX)) :*: S1 ('MetaSel ('Just "lastModifiedBefore") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe POSIX))) :*: (S1 ('MetaSel ('Just "name") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "targetTable") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe DataQualityTargetTable))))))

newDataQualityRulesetFilterCriteria :: DataQualityRulesetFilterCriteria Source #

Create a value of DataQualityRulesetFilterCriteria with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:createdAfter:DataQualityRulesetFilterCriteria', dataQualityRulesetFilterCriteria_createdAfter - Filter on rulesets created after this date.

$sel:createdBefore:DataQualityRulesetFilterCriteria', dataQualityRulesetFilterCriteria_createdBefore - Filter on rulesets created before this date.

$sel:description:DataQualityRulesetFilterCriteria', dataQualityRulesetFilterCriteria_description - The description of the ruleset filter criteria.

$sel:lastModifiedAfter:DataQualityRulesetFilterCriteria', dataQualityRulesetFilterCriteria_lastModifiedAfter - Filter on rulesets last modified after this date.

$sel:lastModifiedBefore:DataQualityRulesetFilterCriteria', dataQualityRulesetFilterCriteria_lastModifiedBefore - Filter on rulesets last modified before this date.

$sel:name:DataQualityRulesetFilterCriteria', dataQualityRulesetFilterCriteria_name - The name of the ruleset filter criteria.

$sel:targetTable:DataQualityRulesetFilterCriteria', dataQualityRulesetFilterCriteria_targetTable - The name and database name of the target table.

DataQualityRulesetListDetails

data DataQualityRulesetListDetails Source #

Describes a data quality ruleset returned by GetDataQualityRuleset.

See: newDataQualityRulesetListDetails smart constructor.

Constructors

DataQualityRulesetListDetails' 

Fields

Instances

Instances details
FromJSON DataQualityRulesetListDetails Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityRulesetListDetails

Generic DataQualityRulesetListDetails Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityRulesetListDetails

Associated Types

type Rep DataQualityRulesetListDetails :: Type -> Type #

Read DataQualityRulesetListDetails Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityRulesetListDetails

Show DataQualityRulesetListDetails Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityRulesetListDetails

NFData DataQualityRulesetListDetails Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityRulesetListDetails

Eq DataQualityRulesetListDetails Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityRulesetListDetails

Hashable DataQualityRulesetListDetails Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityRulesetListDetails

type Rep DataQualityRulesetListDetails Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityRulesetListDetails

type Rep DataQualityRulesetListDetails = D1 ('MetaData "DataQualityRulesetListDetails" "Amazonka.Glue.Types.DataQualityRulesetListDetails" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "DataQualityRulesetListDetails'" 'PrefixI 'True) ((S1 ('MetaSel ('Just "createdOn") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe POSIX)) :*: (S1 ('MetaSel ('Just "description") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "lastModifiedOn") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe POSIX)))) :*: ((S1 ('MetaSel ('Just "name") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "recommendationRunId") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text))) :*: (S1 ('MetaSel ('Just "ruleCount") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Int)) :*: S1 ('MetaSel ('Just "targetTable") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe DataQualityTargetTable))))))

newDataQualityRulesetListDetails :: DataQualityRulesetListDetails Source #

Create a value of DataQualityRulesetListDetails with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:createdOn:DataQualityRulesetListDetails', dataQualityRulesetListDetails_createdOn - The date and time the data quality ruleset was created.

$sel:description:DataQualityRulesetListDetails', dataQualityRulesetListDetails_description - A description of the data quality ruleset.

$sel:lastModifiedOn:DataQualityRulesetListDetails', dataQualityRulesetListDetails_lastModifiedOn - The date and time the data quality ruleset was last modified.

$sel:name:DataQualityRulesetListDetails', dataQualityRulesetListDetails_name - The name of the data quality ruleset.

$sel:recommendationRunId:DataQualityRulesetListDetails', dataQualityRulesetListDetails_recommendationRunId - When a ruleset was created from a recommendation run, this run ID is generated to link the two together.

$sel:ruleCount:DataQualityRulesetListDetails', dataQualityRulesetListDetails_ruleCount - The number of rules in the ruleset.

$sel:targetTable:DataQualityRulesetListDetails', dataQualityRulesetListDetails_targetTable - An object representing an Glue table.

dataQualityRulesetListDetails_createdOn :: Lens' DataQualityRulesetListDetails (Maybe UTCTime) Source #

The date and time the data quality ruleset was created.

dataQualityRulesetListDetails_lastModifiedOn :: Lens' DataQualityRulesetListDetails (Maybe UTCTime) Source #

The date and time the data quality ruleset was last modified.

dataQualityRulesetListDetails_recommendationRunId :: Lens' DataQualityRulesetListDetails (Maybe Text) Source #

When a ruleset was created from a recommendation run, this run ID is generated to link the two together.

DataQualityTargetTable

data DataQualityTargetTable Source #

An object representing an Glue table.

See: newDataQualityTargetTable smart constructor.

Constructors

DataQualityTargetTable' 

Fields

Instances

Instances details
FromJSON DataQualityTargetTable Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityTargetTable

ToJSON DataQualityTargetTable Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityTargetTable

Generic DataQualityTargetTable Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityTargetTable

Associated Types

type Rep DataQualityTargetTable :: Type -> Type #

Read DataQualityTargetTable Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityTargetTable

Show DataQualityTargetTable Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityTargetTable

NFData DataQualityTargetTable Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityTargetTable

Methods

rnf :: DataQualityTargetTable -> () #

Eq DataQualityTargetTable Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityTargetTable

Hashable DataQualityTargetTable Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityTargetTable

type Rep DataQualityTargetTable Source # 
Instance details

Defined in Amazonka.Glue.Types.DataQualityTargetTable

type Rep DataQualityTargetTable = D1 ('MetaData "DataQualityTargetTable" "Amazonka.Glue.Types.DataQualityTargetTable" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "DataQualityTargetTable'" 'PrefixI 'True) (S1 ('MetaSel ('Just "tableName") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text) :*: S1 ('MetaSel ('Just "databaseName") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text)))

newDataQualityTargetTable Source #

Create a value of DataQualityTargetTable with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:tableName:DataQualityTargetTable', dataQualityTargetTable_tableName - The name of the Glue table.

$sel:databaseName:DataQualityTargetTable', dataQualityTargetTable_databaseName - The name of the database where the Glue table exists.

dataQualityTargetTable_databaseName :: Lens' DataQualityTargetTable Text Source #

The name of the database where the Glue table exists.

DataSource

data DataSource Source #

A data source (an Glue table) for which you want data quality results.

See: newDataSource smart constructor.

Constructors

DataSource' 

Fields

Instances

Instances details
FromJSON DataSource Source # 
Instance details

Defined in Amazonka.Glue.Types.DataSource

ToJSON DataSource Source # 
Instance details

Defined in Amazonka.Glue.Types.DataSource

Generic DataSource Source # 
Instance details

Defined in Amazonka.Glue.Types.DataSource

Associated Types

type Rep DataSource :: Type -> Type #

Read DataSource Source # 
Instance details

Defined in Amazonka.Glue.Types.DataSource

Show DataSource Source # 
Instance details

Defined in Amazonka.Glue.Types.DataSource

NFData DataSource Source # 
Instance details

Defined in Amazonka.Glue.Types.DataSource

Methods

rnf :: DataSource -> () #

Eq DataSource Source # 
Instance details

Defined in Amazonka.Glue.Types.DataSource

Hashable DataSource Source # 
Instance details

Defined in Amazonka.Glue.Types.DataSource

type Rep DataSource Source # 
Instance details

Defined in Amazonka.Glue.Types.DataSource

type Rep DataSource = D1 ('MetaData "DataSource" "Amazonka.Glue.Types.DataSource" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "DataSource'" 'PrefixI 'True) (S1 ('MetaSel ('Just "glueTable") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 GlueTable)))

newDataSource Source #

Create a value of DataSource with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:glueTable:DataSource', dataSource_glueTable - An Glue table.

Database

data Database Source #

The Database object represents a logical grouping of tables that might reside in a Hive metastore or an RDBMS.

See: newDatabase smart constructor.

Constructors

Database' 

Fields

Instances

Instances details
FromJSON Database Source # 
Instance details

Defined in Amazonka.Glue.Types.Database

Generic Database Source # 
Instance details

Defined in Amazonka.Glue.Types.Database

Associated Types

type Rep Database :: Type -> Type #

Methods

from :: Database -> Rep Database x #

to :: Rep Database x -> Database #

Read Database Source # 
Instance details

Defined in Amazonka.Glue.Types.Database

Show Database Source # 
Instance details

Defined in Amazonka.Glue.Types.Database

NFData Database Source # 
Instance details

Defined in Amazonka.Glue.Types.Database

Methods

rnf :: Database -> () #

Eq Database Source # 
Instance details

Defined in Amazonka.Glue.Types.Database

Hashable Database Source # 
Instance details

Defined in Amazonka.Glue.Types.Database

Methods

hashWithSalt :: Int -> Database -> Int #

hash :: Database -> Int #

type Rep Database Source # 
Instance details

Defined in Amazonka.Glue.Types.Database

newDatabase Source #

Create a value of Database with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

Database, database_catalogId - The ID of the Data Catalog in which the database resides.

$sel:createTableDefaultPermissions:Database', database_createTableDefaultPermissions - Creates a set of default permissions on the table for principals.

$sel:createTime:Database', database_createTime - The time at which the metadata database was created in the catalog.

$sel:description:Database', database_description - A description of the database.

$sel:locationUri:Database', database_locationUri - The location of the database (for example, an HDFS path).

$sel:parameters:Database', database_parameters - These key-value pairs define parameters and properties of the database.

$sel:targetDatabase:Database', database_targetDatabase - A DatabaseIdentifier structure that describes a target database for resource linking.

$sel:name:Database', database_name - The name of the database. For Hive compatibility, this is folded to lowercase when it is stored.

database_catalogId :: Lens' Database (Maybe Text) Source #

The ID of the Data Catalog in which the database resides.

database_createTableDefaultPermissions :: Lens' Database (Maybe [PrincipalPermissions]) Source #

Creates a set of default permissions on the table for principals.

database_createTime :: Lens' Database (Maybe UTCTime) Source #

The time at which the metadata database was created in the catalog.

database_description :: Lens' Database (Maybe Text) Source #

A description of the database.

database_locationUri :: Lens' Database (Maybe Text) Source #

The location of the database (for example, an HDFS path).

database_parameters :: Lens' Database (Maybe (HashMap Text Text)) Source #

These key-value pairs define parameters and properties of the database.

database_targetDatabase :: Lens' Database (Maybe DatabaseIdentifier) Source #

A DatabaseIdentifier structure that describes a target database for resource linking.

database_name :: Lens' Database Text Source #

The name of the database. For Hive compatibility, this is folded to lowercase when it is stored.

DatabaseIdentifier

data DatabaseIdentifier Source #

A structure that describes a target database for resource linking.

See: newDatabaseIdentifier smart constructor.

Constructors

DatabaseIdentifier' 

Fields

Instances

Instances details
FromJSON DatabaseIdentifier Source # 
Instance details

Defined in Amazonka.Glue.Types.DatabaseIdentifier

ToJSON DatabaseIdentifier Source # 
Instance details

Defined in Amazonka.Glue.Types.DatabaseIdentifier

Generic DatabaseIdentifier Source # 
Instance details

Defined in Amazonka.Glue.Types.DatabaseIdentifier

Associated Types

type Rep DatabaseIdentifier :: Type -> Type #

Read DatabaseIdentifier Source # 
Instance details

Defined in Amazonka.Glue.Types.DatabaseIdentifier

Show DatabaseIdentifier Source # 
Instance details

Defined in Amazonka.Glue.Types.DatabaseIdentifier

NFData DatabaseIdentifier Source # 
Instance details

Defined in Amazonka.Glue.Types.DatabaseIdentifier

Methods

rnf :: DatabaseIdentifier -> () #

Eq DatabaseIdentifier Source # 
Instance details

Defined in Amazonka.Glue.Types.DatabaseIdentifier

Hashable DatabaseIdentifier Source # 
Instance details

Defined in Amazonka.Glue.Types.DatabaseIdentifier

type Rep DatabaseIdentifier Source # 
Instance details

Defined in Amazonka.Glue.Types.DatabaseIdentifier

type Rep DatabaseIdentifier = D1 ('MetaData "DatabaseIdentifier" "Amazonka.Glue.Types.DatabaseIdentifier" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "DatabaseIdentifier'" 'PrefixI 'True) (S1 ('MetaSel ('Just "catalogId") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "databaseName") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text))))

newDatabaseIdentifier :: DatabaseIdentifier Source #

Create a value of DatabaseIdentifier with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:catalogId:DatabaseIdentifier', databaseIdentifier_catalogId - The ID of the Data Catalog in which the database resides.

$sel:databaseName:DatabaseIdentifier', databaseIdentifier_databaseName - The name of the catalog database.

databaseIdentifier_catalogId :: Lens' DatabaseIdentifier (Maybe Text) Source #

The ID of the Data Catalog in which the database resides.

DatabaseInput

data DatabaseInput Source #

The structure used to create or update a database.

See: newDatabaseInput smart constructor.

Constructors

DatabaseInput' 

Fields

Instances

Instances details
ToJSON DatabaseInput Source # 
Instance details

Defined in Amazonka.Glue.Types.DatabaseInput

Generic DatabaseInput Source # 
Instance details

Defined in Amazonka.Glue.Types.DatabaseInput

Associated Types

type Rep DatabaseInput :: Type -> Type #

Read DatabaseInput Source # 
Instance details

Defined in Amazonka.Glue.Types.DatabaseInput

Show DatabaseInput Source # 
Instance details

Defined in Amazonka.Glue.Types.DatabaseInput

NFData DatabaseInput Source # 
Instance details

Defined in Amazonka.Glue.Types.DatabaseInput

Methods

rnf :: DatabaseInput -> () #

Eq DatabaseInput Source # 
Instance details

Defined in Amazonka.Glue.Types.DatabaseInput

Hashable DatabaseInput Source # 
Instance details

Defined in Amazonka.Glue.Types.DatabaseInput

type Rep DatabaseInput Source # 
Instance details

Defined in Amazonka.Glue.Types.DatabaseInput

type Rep DatabaseInput = D1 ('MetaData "DatabaseInput" "Amazonka.Glue.Types.DatabaseInput" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "DatabaseInput'" 'PrefixI 'True) ((S1 ('MetaSel ('Just "createTableDefaultPermissions") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe [PrincipalPermissions])) :*: (S1 ('MetaSel ('Just "description") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "locationUri") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)))) :*: (S1 ('MetaSel ('Just "parameters") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe (HashMap Text Text))) :*: (S1 ('MetaSel ('Just "targetDatabase") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe DatabaseIdentifier)) :*: S1 ('MetaSel ('Just "name") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text)))))

newDatabaseInput Source #

Create a value of DatabaseInput with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:createTableDefaultPermissions:DatabaseInput', databaseInput_createTableDefaultPermissions - Creates a set of default permissions on the table for principals.

$sel:description:DatabaseInput', databaseInput_description - A description of the database.

$sel:locationUri:DatabaseInput', databaseInput_locationUri - The location of the database (for example, an HDFS path).

$sel:parameters:DatabaseInput', databaseInput_parameters - These key-value pairs define parameters and properties of the database.

These key-value pairs define parameters and properties of the database.

$sel:targetDatabase:DatabaseInput', databaseInput_targetDatabase - A DatabaseIdentifier structure that describes a target database for resource linking.

$sel:name:DatabaseInput', databaseInput_name - The name of the database. For Hive compatibility, this is folded to lowercase when it is stored.

databaseInput_createTableDefaultPermissions :: Lens' DatabaseInput (Maybe [PrincipalPermissions]) Source #

Creates a set of default permissions on the table for principals.

databaseInput_description :: Lens' DatabaseInput (Maybe Text) Source #

A description of the database.

databaseInput_locationUri :: Lens' DatabaseInput (Maybe Text) Source #

The location of the database (for example, an HDFS path).

databaseInput_parameters :: Lens' DatabaseInput (Maybe (HashMap Text Text)) Source #

These key-value pairs define parameters and properties of the database.

These key-value pairs define parameters and properties of the database.

databaseInput_targetDatabase :: Lens' DatabaseInput (Maybe DatabaseIdentifier) Source #

A DatabaseIdentifier structure that describes a target database for resource linking.

databaseInput_name :: Lens' DatabaseInput Text Source #

The name of the database. For Hive compatibility, this is folded to lowercase when it is stored.

Datatype

data Datatype Source #

A structure representing the datatype of the value.

See: newDatatype smart constructor.

Constructors

Datatype' 

Fields

  • id :: Text

    The datatype of the value.

  • label :: Text

    A label assigned to the datatype.

Instances

Instances details
FromJSON Datatype Source # 
Instance details

Defined in Amazonka.Glue.Types.Datatype

ToJSON Datatype Source # 
Instance details

Defined in Amazonka.Glue.Types.Datatype

Generic Datatype Source # 
Instance details

Defined in Amazonka.Glue.Types.Datatype

Associated Types

type Rep Datatype :: Type -> Type #

Methods

from :: Datatype -> Rep Datatype x #

to :: Rep Datatype x -> Datatype #

Read Datatype Source # 
Instance details

Defined in Amazonka.Glue.Types.Datatype

Show Datatype Source # 
Instance details

Defined in Amazonka.Glue.Types.Datatype

NFData Datatype Source # 
Instance details

Defined in Amazonka.Glue.Types.Datatype

Methods

rnf :: Datatype -> () #

Eq Datatype Source # 
Instance details

Defined in Amazonka.Glue.Types.Datatype

Hashable Datatype Source # 
Instance details

Defined in Amazonka.Glue.Types.Datatype

Methods

hashWithSalt :: Int -> Datatype -> Int #

hash :: Datatype -> Int #

type Rep Datatype Source # 
Instance details

Defined in Amazonka.Glue.Types.Datatype

type Rep Datatype = D1 ('MetaData "Datatype" "Amazonka.Glue.Types.Datatype" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "Datatype'" 'PrefixI 'True) (S1 ('MetaSel ('Just "id") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text) :*: S1 ('MetaSel ('Just "label") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text)))

newDatatype Source #

Create a value of Datatype with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:id:Datatype', datatype_id - The datatype of the value.

$sel:label:Datatype', datatype_label - A label assigned to the datatype.

datatype_id :: Lens' Datatype Text Source #

The datatype of the value.

datatype_label :: Lens' Datatype Text Source #

A label assigned to the datatype.

DateColumnStatisticsData

data DateColumnStatisticsData Source #

Defines column statistics supported for timestamp data columns.

See: newDateColumnStatisticsData smart constructor.

Constructors

DateColumnStatisticsData' 

Fields

Instances

Instances details
FromJSON DateColumnStatisticsData Source # 
Instance details

Defined in Amazonka.Glue.Types.DateColumnStatisticsData

ToJSON DateColumnStatisticsData Source # 
Instance details

Defined in Amazonka.Glue.Types.DateColumnStatisticsData

Generic DateColumnStatisticsData Source # 
Instance details

Defined in Amazonka.Glue.Types.DateColumnStatisticsData

Associated Types

type Rep DateColumnStatisticsData :: Type -> Type #

Read DateColumnStatisticsData Source # 
Instance details

Defined in Amazonka.Glue.Types.DateColumnStatisticsData

Show DateColumnStatisticsData Source # 
Instance details

Defined in Amazonka.Glue.Types.DateColumnStatisticsData

NFData DateColumnStatisticsData Source # 
Instance details

Defined in Amazonka.Glue.Types.DateColumnStatisticsData

Eq DateColumnStatisticsData Source # 
Instance details

Defined in Amazonka.Glue.Types.DateColumnStatisticsData

Hashable DateColumnStatisticsData Source # 
Instance details

Defined in Amazonka.Glue.Types.DateColumnStatisticsData

type Rep DateColumnStatisticsData Source # 
Instance details

Defined in Amazonka.Glue.Types.DateColumnStatisticsData

type Rep DateColumnStatisticsData = D1 ('MetaData "DateColumnStatisticsData" "Amazonka.Glue.Types.DateColumnStatisticsData" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "DateColumnStatisticsData'" 'PrefixI 'True) ((S1 ('MetaSel ('Just "maximumValue") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe POSIX)) :*: S1 ('MetaSel ('Just "minimumValue") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe POSIX))) :*: (S1 ('MetaSel ('Just "numberOfNulls") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Natural) :*: S1 ('MetaSel ('Just "numberOfDistinctValues") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Natural))))

newDateColumnStatisticsData Source #

Create a value of DateColumnStatisticsData with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:maximumValue:DateColumnStatisticsData', dateColumnStatisticsData_maximumValue - The highest value in the column.

$sel:minimumValue:DateColumnStatisticsData', dateColumnStatisticsData_minimumValue - The lowest value in the column.

$sel:numberOfNulls:DateColumnStatisticsData', dateColumnStatisticsData_numberOfNulls - The number of null values in the column.

$sel:numberOfDistinctValues:DateColumnStatisticsData', dateColumnStatisticsData_numberOfDistinctValues - The number of distinct values in a column.

DecimalColumnStatisticsData

data DecimalColumnStatisticsData Source #

Defines column statistics supported for fixed-point number data columns.

See: newDecimalColumnStatisticsData smart constructor.

Constructors

DecimalColumnStatisticsData' 

Fields

Instances

Instances details
FromJSON DecimalColumnStatisticsData Source # 
Instance details

Defined in Amazonka.Glue.Types.DecimalColumnStatisticsData

ToJSON DecimalColumnStatisticsData Source # 
Instance details

Defined in Amazonka.Glue.Types.DecimalColumnStatisticsData

Generic DecimalColumnStatisticsData Source # 
Instance details

Defined in Amazonka.Glue.Types.DecimalColumnStatisticsData

Associated Types

type Rep DecimalColumnStatisticsData :: Type -> Type #

Read DecimalColumnStatisticsData Source # 
Instance details

Defined in Amazonka.Glue.Types.DecimalColumnStatisticsData

Show DecimalColumnStatisticsData Source # 
Instance details

Defined in Amazonka.Glue.Types.DecimalColumnStatisticsData

NFData DecimalColumnStatisticsData Source # 
Instance details

Defined in Amazonka.Glue.Types.DecimalColumnStatisticsData

Eq DecimalColumnStatisticsData Source # 
Instance details

Defined in Amazonka.Glue.Types.DecimalColumnStatisticsData

Hashable DecimalColumnStatisticsData Source # 
Instance details

Defined in Amazonka.Glue.Types.DecimalColumnStatisticsData

type Rep DecimalColumnStatisticsData Source # 
Instance details

Defined in Amazonka.Glue.Types.DecimalColumnStatisticsData

type Rep DecimalColumnStatisticsData = D1 ('MetaData "DecimalColumnStatisticsData" "Amazonka.Glue.Types.DecimalColumnStatisticsData" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "DecimalColumnStatisticsData'" 'PrefixI 'True) ((S1 ('MetaSel ('Just "maximumValue") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe DecimalNumber)) :*: S1 ('MetaSel ('Just "minimumValue") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe DecimalNumber))) :*: (S1 ('MetaSel ('Just "numberOfNulls") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Natural) :*: S1 ('MetaSel ('Just "numberOfDistinctValues") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Natural))))

DecimalNumber

data DecimalNumber Source #

Contains a numeric value in decimal format.

See: newDecimalNumber smart constructor.

Constructors

DecimalNumber' 

Fields

  • unscaledValue :: Base64

    The unscaled numeric value.

  • scale :: Int

    The scale that determines where the decimal point falls in the unscaled value.

Instances

Instances details
FromJSON DecimalNumber Source # 
Instance details

Defined in Amazonka.Glue.Types.DecimalNumber

ToJSON DecimalNumber Source # 
Instance details

Defined in Amazonka.Glue.Types.DecimalNumber

Generic DecimalNumber Source # 
Instance details

Defined in Amazonka.Glue.Types.DecimalNumber

Associated Types

type Rep DecimalNumber :: Type -> Type #

Read DecimalNumber Source # 
Instance details

Defined in Amazonka.Glue.Types.DecimalNumber

Show DecimalNumber Source # 
Instance details

Defined in Amazonka.Glue.Types.DecimalNumber

NFData DecimalNumber Source # 
Instance details

Defined in Amazonka.Glue.Types.DecimalNumber

Methods

rnf :: DecimalNumber -> () #

Eq DecimalNumber Source # 
Instance details

Defined in Amazonka.Glue.Types.DecimalNumber

Hashable DecimalNumber Source # 
Instance details

Defined in Amazonka.Glue.Types.DecimalNumber

type Rep DecimalNumber Source # 
Instance details

Defined in Amazonka.Glue.Types.DecimalNumber

type Rep DecimalNumber = D1 ('MetaData "DecimalNumber" "Amazonka.Glue.Types.DecimalNumber" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "DecimalNumber'" 'PrefixI 'True) (S1 ('MetaSel ('Just "unscaledValue") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Base64) :*: S1 ('MetaSel ('Just "scale") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Int)))

newDecimalNumber Source #

Create a value of DecimalNumber with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:unscaledValue:DecimalNumber', decimalNumber_unscaledValue - The unscaled numeric value.-- -- Note: This Lens automatically encodes and decodes Base64 data. -- The underlying isomorphism will encode to Base64 representation during -- serialisation, and decode from Base64 representation during deserialisation. -- This Lens accepts and returns only raw unencoded data.

$sel:scale:DecimalNumber', decimalNumber_scale - The scale that determines where the decimal point falls in the unscaled value.

decimalNumber_unscaledValue :: Lens' DecimalNumber ByteString Source #

The unscaled numeric value.-- -- Note: This Lens automatically encodes and decodes Base64 data. -- The underlying isomorphism will encode to Base64 representation during -- serialisation, and decode from Base64 representation during deserialisation. -- This Lens accepts and returns only raw unencoded data.

decimalNumber_scale :: Lens' DecimalNumber Int Source #

The scale that determines where the decimal point falls in the unscaled value.

DeltaTarget

data DeltaTarget Source #

Specifies a Delta data store to crawl one or more Delta tables.

See: newDeltaTarget smart constructor.

Constructors

DeltaTarget' 

Fields

Instances

Instances details
FromJSON DeltaTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.DeltaTarget

ToJSON DeltaTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.DeltaTarget

Generic DeltaTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.DeltaTarget

Associated Types

type Rep DeltaTarget :: Type -> Type #

Read DeltaTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.DeltaTarget

Show DeltaTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.DeltaTarget

NFData DeltaTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.DeltaTarget

Methods

rnf :: DeltaTarget -> () #

Eq DeltaTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.DeltaTarget

Hashable DeltaTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.DeltaTarget

type Rep DeltaTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.DeltaTarget

type Rep DeltaTarget = D1 ('MetaData "DeltaTarget" "Amazonka.Glue.Types.DeltaTarget" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "DeltaTarget'" 'PrefixI 'True) ((S1 ('MetaSel ('Just "connectionName") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "createNativeDeltaTable") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Bool))) :*: (S1 ('MetaSel ('Just "deltaTables") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe [Text])) :*: S1 ('MetaSel ('Just "writeManifest") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Bool)))))

newDeltaTarget :: DeltaTarget Source #

Create a value of DeltaTarget with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:connectionName:DeltaTarget', deltaTarget_connectionName - The name of the connection to use to connect to the Delta table target.

$sel:createNativeDeltaTable:DeltaTarget', deltaTarget_createNativeDeltaTable - Specifies whether the crawler will create native tables, to allow integration with query engines that support querying of the Delta transaction log directly.

$sel:deltaTables:DeltaTarget', deltaTarget_deltaTables - A list of the Amazon S3 paths to the Delta tables.

$sel:writeManifest:DeltaTarget', deltaTarget_writeManifest - Specifies whether to write the manifest files to the Delta table path.

deltaTarget_connectionName :: Lens' DeltaTarget (Maybe Text) Source #

The name of the connection to use to connect to the Delta table target.

deltaTarget_createNativeDeltaTable :: Lens' DeltaTarget (Maybe Bool) Source #

Specifies whether the crawler will create native tables, to allow integration with query engines that support querying of the Delta transaction log directly.

deltaTarget_deltaTables :: Lens' DeltaTarget (Maybe [Text]) Source #

A list of the Amazon S3 paths to the Delta tables.

deltaTarget_writeManifest :: Lens' DeltaTarget (Maybe Bool) Source #

Specifies whether to write the manifest files to the Delta table path.

DevEndpoint

data DevEndpoint Source #

A development endpoint where a developer can remotely debug extract, transform, and load (ETL) scripts.

See: newDevEndpoint smart constructor.

Constructors

DevEndpoint' 

Fields

  • arguments :: Maybe (HashMap Text Text)

    A map of arguments used to configure the DevEndpoint.

    Valid arguments are:

    • "--enable-glue-datacatalog": ""

    You can specify a version of Python support for development endpoints by using the Arguments parameter in the CreateDevEndpoint or UpdateDevEndpoint APIs. If no arguments are provided, the version defaults to Python 2.

  • availabilityZone :: Maybe Text

    The Amazon Web Services Availability Zone where this DevEndpoint is located.

  • createdTimestamp :: Maybe POSIX

    The point in time at which this DevEndpoint was created.

  • endpointName :: Maybe Text

    The name of the DevEndpoint.

  • extraJarsS3Path :: Maybe Text

    The path to one or more Java .jar files in an S3 bucket that should be loaded in your DevEndpoint.

    You can only use pure Java/Scala libraries with a DevEndpoint.

  • extraPythonLibsS3Path :: Maybe Text

    The paths to one or more Python libraries in an Amazon S3 bucket that should be loaded in your DevEndpoint. Multiple values must be complete paths separated by a comma.

    You can only use pure Python libraries with a DevEndpoint. Libraries that rely on C extensions, such as the pandas Python data analysis library, are not currently supported.

  • failureReason :: Maybe Text

    The reason for a current failure in this DevEndpoint.

  • glueVersion :: Maybe Text

    Glue version determines the versions of Apache Spark and Python that Glue supports. The Python version indicates the version supported for running your ETL scripts on development endpoints.

    For more information about the available Glue versions and corresponding Spark and Python versions, see Glue version in the developer guide.

    Development endpoints that are created without specifying a Glue version default to Glue 0.9.

    You can specify a version of Python support for development endpoints by using the Arguments parameter in the CreateDevEndpoint or UpdateDevEndpoint APIs. If no arguments are provided, the version defaults to Python 2.

  • lastModifiedTimestamp :: Maybe POSIX

    The point in time at which this DevEndpoint was last modified.

  • lastUpdateStatus :: Maybe Text

    The status of the last update.

  • numberOfNodes :: Maybe Int

    The number of Glue Data Processing Units (DPUs) allocated to this DevEndpoint.

  • numberOfWorkers :: Maybe Int

    The number of workers of a defined workerType that are allocated to the development endpoint.

    The maximum number of workers you can define are 299 for G.1X, and 149 for G.2X.

  • privateAddress :: Maybe Text

    A private IP address to access the DevEndpoint within a VPC if the DevEndpoint is created within one. The PrivateAddress field is present only when you create the DevEndpoint within your VPC.

  • publicAddress :: Maybe Text

    The public IP address used by this DevEndpoint. The PublicAddress field is present only when you create a non-virtual private cloud (VPC) DevEndpoint.

  • publicKey :: Maybe Text

    The public key to be used by this DevEndpoint for authentication. This attribute is provided for backward compatibility because the recommended attribute to use is public keys.

  • publicKeys :: Maybe [Text]

    A list of public keys to be used by the DevEndpoints for authentication. Using this attribute is preferred over a single public key because the public keys allow you to have a different private key per client.

    If you previously created an endpoint with a public key, you must remove that key to be able to set a list of public keys. Call the UpdateDevEndpoint API operation with the public key content in the deletePublicKeys attribute, and the list of new keys in the addPublicKeys attribute.

  • roleArn :: Maybe Text

    The Amazon Resource Name (ARN) of the IAM role used in this DevEndpoint.

  • securityConfiguration :: Maybe Text

    The name of the SecurityConfiguration structure to be used with this DevEndpoint.

  • securityGroupIds :: Maybe [Text]

    A list of security group identifiers used in this DevEndpoint.

  • status :: Maybe Text

    The current status of this DevEndpoint.

  • subnetId :: Maybe Text

    The subnet ID for this DevEndpoint.

  • vpcId :: Maybe Text

    The ID of the virtual private cloud (VPC) used by this DevEndpoint.

  • workerType :: Maybe WorkerType

    The type of predefined worker that is allocated to the development endpoint. Accepts a value of Standard, G.1X, or G.2X.

    • For the Standard worker type, each worker provides 4 vCPU, 16 GB of memory and a 50GB disk, and 2 executors per worker.
    • For the G.1X worker type, each worker maps to 1 DPU (4 vCPU, 16 GB of memory, 64 GB disk), and provides 1 executor per worker. We recommend this worker type for memory-intensive jobs.
    • For the G.2X worker type, each worker maps to 2 DPU (8 vCPU, 32 GB of memory, 128 GB disk), and provides 1 executor per worker. We recommend this worker type for memory-intensive jobs.

    Known issue: when a development endpoint is created with the G.2X WorkerType configuration, the Spark drivers for the development endpoint will run on 4 vCPU, 16 GB of memory, and a 64 GB disk.

  • yarnEndpointAddress :: Maybe Text

    The YARN endpoint address used by this DevEndpoint.

  • zeppelinRemoteSparkInterpreterPort :: Maybe Int

    The Apache Zeppelin port for the remote Apache Spark interpreter.

Instances

Instances details
FromJSON DevEndpoint Source # 
Instance details

Defined in Amazonka.Glue.Types.DevEndpoint

Generic DevEndpoint Source # 
Instance details

Defined in Amazonka.Glue.Types.DevEndpoint

Associated Types

type Rep DevEndpoint :: Type -> Type #

Read DevEndpoint Source # 
Instance details

Defined in Amazonka.Glue.Types.DevEndpoint

Show DevEndpoint Source # 
Instance details

Defined in Amazonka.Glue.Types.DevEndpoint

NFData DevEndpoint Source # 
Instance details

Defined in Amazonka.Glue.Types.DevEndpoint

Methods

rnf :: DevEndpoint -> () #

Eq DevEndpoint Source # 
Instance details

Defined in Amazonka.Glue.Types.DevEndpoint

Hashable DevEndpoint Source # 
Instance details

Defined in Amazonka.Glue.Types.DevEndpoint

type Rep DevEndpoint Source # 
Instance details

Defined in Amazonka.Glue.Types.DevEndpoint

type Rep DevEndpoint = D1 ('MetaData "DevEndpoint" "Amazonka.Glue.Types.DevEndpoint" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "DevEndpoint'" 'PrefixI 'True) ((((S1 ('MetaSel ('Just "arguments") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe (HashMap Text Text))) :*: (S1 ('MetaSel ('Just "availabilityZone") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "createdTimestamp") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe POSIX)))) :*: (S1 ('MetaSel ('Just "endpointName") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: (S1 ('MetaSel ('Just "extraJarsS3Path") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "extraPythonLibsS3Path") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text))))) :*: ((S1 ('MetaSel ('Just "failureReason") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: (S1 ('MetaSel ('Just "glueVersion") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "lastModifiedTimestamp") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe POSIX)))) :*: (S1 ('MetaSel ('Just "lastUpdateStatus") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: (S1 ('MetaSel ('Just "numberOfNodes") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Int)) :*: S1 ('MetaSel ('Just "numberOfWorkers") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Int)))))) :*: (((S1 ('MetaSel ('Just "privateAddress") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: (S1 ('MetaSel ('Just "publicAddress") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "publicKey") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)))) :*: (S1 ('MetaSel ('Just "publicKeys") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe [Text])) :*: (S1 ('MetaSel ('Just "roleArn") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "securityConfiguration") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text))))) :*: ((S1 ('MetaSel ('Just "securityGroupIds") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe [Text])) :*: (S1 ('MetaSel ('Just "status") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "subnetId") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)))) :*: ((S1 ('MetaSel ('Just "vpcId") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "workerType") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe WorkerType))) :*: (S1 ('MetaSel ('Just "yarnEndpointAddress") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "zeppelinRemoteSparkInterpreterPort") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Int))))))))

newDevEndpoint :: DevEndpoint Source #

Create a value of DevEndpoint with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:arguments:DevEndpoint', devEndpoint_arguments - A map of arguments used to configure the DevEndpoint.

Valid arguments are:

  • "--enable-glue-datacatalog": ""

You can specify a version of Python support for development endpoints by using the Arguments parameter in the CreateDevEndpoint or UpdateDevEndpoint APIs. If no arguments are provided, the version defaults to Python 2.

$sel:availabilityZone:DevEndpoint', devEndpoint_availabilityZone - The Amazon Web Services Availability Zone where this DevEndpoint is located.

$sel:createdTimestamp:DevEndpoint', devEndpoint_createdTimestamp - The point in time at which this DevEndpoint was created.

$sel:endpointName:DevEndpoint', devEndpoint_endpointName - The name of the DevEndpoint.

$sel:extraJarsS3Path:DevEndpoint', devEndpoint_extraJarsS3Path - The path to one or more Java .jar files in an S3 bucket that should be loaded in your DevEndpoint.

You can only use pure Java/Scala libraries with a DevEndpoint.

$sel:extraPythonLibsS3Path:DevEndpoint', devEndpoint_extraPythonLibsS3Path - The paths to one or more Python libraries in an Amazon S3 bucket that should be loaded in your DevEndpoint. Multiple values must be complete paths separated by a comma.

You can only use pure Python libraries with a DevEndpoint. Libraries that rely on C extensions, such as the pandas Python data analysis library, are not currently supported.

$sel:failureReason:DevEndpoint', devEndpoint_failureReason - The reason for a current failure in this DevEndpoint.

$sel:glueVersion:DevEndpoint', devEndpoint_glueVersion - Glue version determines the versions of Apache Spark and Python that Glue supports. The Python version indicates the version supported for running your ETL scripts on development endpoints.

For more information about the available Glue versions and corresponding Spark and Python versions, see Glue version in the developer guide.

Development endpoints that are created without specifying a Glue version default to Glue 0.9.

You can specify a version of Python support for development endpoints by using the Arguments parameter in the CreateDevEndpoint or UpdateDevEndpoint APIs. If no arguments are provided, the version defaults to Python 2.

$sel:lastModifiedTimestamp:DevEndpoint', devEndpoint_lastModifiedTimestamp - The point in time at which this DevEndpoint was last modified.

$sel:lastUpdateStatus:DevEndpoint', devEndpoint_lastUpdateStatus - The status of the last update.

$sel:numberOfNodes:DevEndpoint', devEndpoint_numberOfNodes - The number of Glue Data Processing Units (DPUs) allocated to this DevEndpoint.

$sel:numberOfWorkers:DevEndpoint', devEndpoint_numberOfWorkers - The number of workers of a defined workerType that are allocated to the development endpoint.

The maximum number of workers you can define are 299 for G.1X, and 149 for G.2X.

$sel:privateAddress:DevEndpoint', devEndpoint_privateAddress - A private IP address to access the DevEndpoint within a VPC if the DevEndpoint is created within one. The PrivateAddress field is present only when you create the DevEndpoint within your VPC.

$sel:publicAddress:DevEndpoint', devEndpoint_publicAddress - The public IP address used by this DevEndpoint. The PublicAddress field is present only when you create a non-virtual private cloud (VPC) DevEndpoint.

$sel:publicKey:DevEndpoint', devEndpoint_publicKey - The public key to be used by this DevEndpoint for authentication. This attribute is provided for backward compatibility because the recommended attribute to use is public keys.

$sel:publicKeys:DevEndpoint', devEndpoint_publicKeys - A list of public keys to be used by the DevEndpoints for authentication. Using this attribute is preferred over a single public key because the public keys allow you to have a different private key per client.

If you previously created an endpoint with a public key, you must remove that key to be able to set a list of public keys. Call the UpdateDevEndpoint API operation with the public key content in the deletePublicKeys attribute, and the list of new keys in the addPublicKeys attribute.

$sel:roleArn:DevEndpoint', devEndpoint_roleArn - The Amazon Resource Name (ARN) of the IAM role used in this DevEndpoint.

$sel:securityConfiguration:DevEndpoint', devEndpoint_securityConfiguration - The name of the SecurityConfiguration structure to be used with this DevEndpoint.

$sel:securityGroupIds:DevEndpoint', devEndpoint_securityGroupIds - A list of security group identifiers used in this DevEndpoint.

$sel:status:DevEndpoint', devEndpoint_status - The current status of this DevEndpoint.

$sel:subnetId:DevEndpoint', devEndpoint_subnetId - The subnet ID for this DevEndpoint.

$sel:vpcId:DevEndpoint', devEndpoint_vpcId - The ID of the virtual private cloud (VPC) used by this DevEndpoint.

$sel:workerType:DevEndpoint', devEndpoint_workerType - The type of predefined worker that is allocated to the development endpoint. Accepts a value of Standard, G.1X, or G.2X.

  • For the Standard worker type, each worker provides 4 vCPU, 16 GB of memory and a 50GB disk, and 2 executors per worker.
  • For the G.1X worker type, each worker maps to 1 DPU (4 vCPU, 16 GB of memory, 64 GB disk), and provides 1 executor per worker. We recommend this worker type for memory-intensive jobs.
  • For the G.2X worker type, each worker maps to 2 DPU (8 vCPU, 32 GB of memory, 128 GB disk), and provides 1 executor per worker. We recommend this worker type for memory-intensive jobs.

Known issue: when a development endpoint is created with the G.2X WorkerType configuration, the Spark drivers for the development endpoint will run on 4 vCPU, 16 GB of memory, and a 64 GB disk.

$sel:yarnEndpointAddress:DevEndpoint', devEndpoint_yarnEndpointAddress - The YARN endpoint address used by this DevEndpoint.

$sel:zeppelinRemoteSparkInterpreterPort:DevEndpoint', devEndpoint_zeppelinRemoteSparkInterpreterPort - The Apache Zeppelin port for the remote Apache Spark interpreter.

devEndpoint_arguments :: Lens' DevEndpoint (Maybe (HashMap Text Text)) Source #

A map of arguments used to configure the DevEndpoint.

Valid arguments are:

  • "--enable-glue-datacatalog": ""

You can specify a version of Python support for development endpoints by using the Arguments parameter in the CreateDevEndpoint or UpdateDevEndpoint APIs. If no arguments are provided, the version defaults to Python 2.

devEndpoint_availabilityZone :: Lens' DevEndpoint (Maybe Text) Source #

The Amazon Web Services Availability Zone where this DevEndpoint is located.

devEndpoint_createdTimestamp :: Lens' DevEndpoint (Maybe UTCTime) Source #

The point in time at which this DevEndpoint was created.

devEndpoint_endpointName :: Lens' DevEndpoint (Maybe Text) Source #

The name of the DevEndpoint.

devEndpoint_extraJarsS3Path :: Lens' DevEndpoint (Maybe Text) Source #

The path to one or more Java .jar files in an S3 bucket that should be loaded in your DevEndpoint.

You can only use pure Java/Scala libraries with a DevEndpoint.

devEndpoint_extraPythonLibsS3Path :: Lens' DevEndpoint (Maybe Text) Source #

The paths to one or more Python libraries in an Amazon S3 bucket that should be loaded in your DevEndpoint. Multiple values must be complete paths separated by a comma.

You can only use pure Python libraries with a DevEndpoint. Libraries that rely on C extensions, such as the pandas Python data analysis library, are not currently supported.

devEndpoint_failureReason :: Lens' DevEndpoint (Maybe Text) Source #

The reason for a current failure in this DevEndpoint.

devEndpoint_glueVersion :: Lens' DevEndpoint (Maybe Text) Source #

Glue version determines the versions of Apache Spark and Python that Glue supports. The Python version indicates the version supported for running your ETL scripts on development endpoints.

For more information about the available Glue versions and corresponding Spark and Python versions, see Glue version in the developer guide.

Development endpoints that are created without specifying a Glue version default to Glue 0.9.

You can specify a version of Python support for development endpoints by using the Arguments parameter in the CreateDevEndpoint or UpdateDevEndpoint APIs. If no arguments are provided, the version defaults to Python 2.

devEndpoint_lastModifiedTimestamp :: Lens' DevEndpoint (Maybe UTCTime) Source #

The point in time at which this DevEndpoint was last modified.

devEndpoint_lastUpdateStatus :: Lens' DevEndpoint (Maybe Text) Source #

The status of the last update.

devEndpoint_numberOfNodes :: Lens' DevEndpoint (Maybe Int) Source #

The number of Glue Data Processing Units (DPUs) allocated to this DevEndpoint.

devEndpoint_numberOfWorkers :: Lens' DevEndpoint (Maybe Int) Source #

The number of workers of a defined workerType that are allocated to the development endpoint.

The maximum number of workers you can define are 299 for G.1X, and 149 for G.2X.

devEndpoint_privateAddress :: Lens' DevEndpoint (Maybe Text) Source #

A private IP address to access the DevEndpoint within a VPC if the DevEndpoint is created within one. The PrivateAddress field is present only when you create the DevEndpoint within your VPC.

devEndpoint_publicAddress :: Lens' DevEndpoint (Maybe Text) Source #

The public IP address used by this DevEndpoint. The PublicAddress field is present only when you create a non-virtual private cloud (VPC) DevEndpoint.

devEndpoint_publicKey :: Lens' DevEndpoint (Maybe Text) Source #

The public key to be used by this DevEndpoint for authentication. This attribute is provided for backward compatibility because the recommended attribute to use is public keys.

devEndpoint_publicKeys :: Lens' DevEndpoint (Maybe [Text]) Source #

A list of public keys to be used by the DevEndpoints for authentication. Using this attribute is preferred over a single public key because the public keys allow you to have a different private key per client.

If you previously created an endpoint with a public key, you must remove that key to be able to set a list of public keys. Call the UpdateDevEndpoint API operation with the public key content in the deletePublicKeys attribute, and the list of new keys in the addPublicKeys attribute.

devEndpoint_roleArn :: Lens' DevEndpoint (Maybe Text) Source #

The Amazon Resource Name (ARN) of the IAM role used in this DevEndpoint.

devEndpoint_securityConfiguration :: Lens' DevEndpoint (Maybe Text) Source #

The name of the SecurityConfiguration structure to be used with this DevEndpoint.

devEndpoint_securityGroupIds :: Lens' DevEndpoint (Maybe [Text]) Source #

A list of security group identifiers used in this DevEndpoint.

devEndpoint_status :: Lens' DevEndpoint (Maybe Text) Source #

The current status of this DevEndpoint.

devEndpoint_subnetId :: Lens' DevEndpoint (Maybe Text) Source #

The subnet ID for this DevEndpoint.

devEndpoint_vpcId :: Lens' DevEndpoint (Maybe Text) Source #

The ID of the virtual private cloud (VPC) used by this DevEndpoint.

devEndpoint_workerType :: Lens' DevEndpoint (Maybe WorkerType) Source #

The type of predefined worker that is allocated to the development endpoint. Accepts a value of Standard, G.1X, or G.2X.

  • For the Standard worker type, each worker provides 4 vCPU, 16 GB of memory and a 50GB disk, and 2 executors per worker.
  • For the G.1X worker type, each worker maps to 1 DPU (4 vCPU, 16 GB of memory, 64 GB disk), and provides 1 executor per worker. We recommend this worker type for memory-intensive jobs.
  • For the G.2X worker type, each worker maps to 2 DPU (8 vCPU, 32 GB of memory, 128 GB disk), and provides 1 executor per worker. We recommend this worker type for memory-intensive jobs.

Known issue: when a development endpoint is created with the G.2X WorkerType configuration, the Spark drivers for the development endpoint will run on 4 vCPU, 16 GB of memory, and a 64 GB disk.

devEndpoint_yarnEndpointAddress :: Lens' DevEndpoint (Maybe Text) Source #

The YARN endpoint address used by this DevEndpoint.

devEndpoint_zeppelinRemoteSparkInterpreterPort :: Lens' DevEndpoint (Maybe Int) Source #

The Apache Zeppelin port for the remote Apache Spark interpreter.

DevEndpointCustomLibraries

data DevEndpointCustomLibraries Source #

Custom libraries to be loaded into a development endpoint.

See: newDevEndpointCustomLibraries smart constructor.

Constructors

DevEndpointCustomLibraries' 

Fields

  • extraJarsS3Path :: Maybe Text

    The path to one or more Java .jar files in an S3 bucket that should be loaded in your DevEndpoint.

    You can only use pure Java/Scala libraries with a DevEndpoint.

  • extraPythonLibsS3Path :: Maybe Text

    The paths to one or more Python libraries in an Amazon Simple Storage Service (Amazon S3) bucket that should be loaded in your DevEndpoint. Multiple values must be complete paths separated by a comma.

    You can only use pure Python libraries with a DevEndpoint. Libraries that rely on C extensions, such as the pandas Python data analysis library, are not currently supported.

Instances

Instances details
ToJSON DevEndpointCustomLibraries Source # 
Instance details

Defined in Amazonka.Glue.Types.DevEndpointCustomLibraries

Generic DevEndpointCustomLibraries Source # 
Instance details

Defined in Amazonka.Glue.Types.DevEndpointCustomLibraries

Associated Types

type Rep DevEndpointCustomLibraries :: Type -> Type #

Read DevEndpointCustomLibraries Source # 
Instance details

Defined in Amazonka.Glue.Types.DevEndpointCustomLibraries

Show DevEndpointCustomLibraries Source # 
Instance details

Defined in Amazonka.Glue.Types.DevEndpointCustomLibraries

NFData DevEndpointCustomLibraries Source # 
Instance details

Defined in Amazonka.Glue.Types.DevEndpointCustomLibraries

Eq DevEndpointCustomLibraries Source # 
Instance details

Defined in Amazonka.Glue.Types.DevEndpointCustomLibraries

Hashable DevEndpointCustomLibraries Source # 
Instance details

Defined in Amazonka.Glue.Types.DevEndpointCustomLibraries

type Rep DevEndpointCustomLibraries Source # 
Instance details

Defined in Amazonka.Glue.Types.DevEndpointCustomLibraries

type Rep DevEndpointCustomLibraries = D1 ('MetaData "DevEndpointCustomLibraries" "Amazonka.Glue.Types.DevEndpointCustomLibraries" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "DevEndpointCustomLibraries'" 'PrefixI 'True) (S1 ('MetaSel ('Just "extraJarsS3Path") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "extraPythonLibsS3Path") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text))))

newDevEndpointCustomLibraries :: DevEndpointCustomLibraries Source #

Create a value of DevEndpointCustomLibraries with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:extraJarsS3Path:DevEndpointCustomLibraries', devEndpointCustomLibraries_extraJarsS3Path - The path to one or more Java .jar files in an S3 bucket that should be loaded in your DevEndpoint.

You can only use pure Java/Scala libraries with a DevEndpoint.

$sel:extraPythonLibsS3Path:DevEndpointCustomLibraries', devEndpointCustomLibraries_extraPythonLibsS3Path - The paths to one or more Python libraries in an Amazon Simple Storage Service (Amazon S3) bucket that should be loaded in your DevEndpoint. Multiple values must be complete paths separated by a comma.

You can only use pure Python libraries with a DevEndpoint. Libraries that rely on C extensions, such as the pandas Python data analysis library, are not currently supported.

devEndpointCustomLibraries_extraJarsS3Path :: Lens' DevEndpointCustomLibraries (Maybe Text) Source #

The path to one or more Java .jar files in an S3 bucket that should be loaded in your DevEndpoint.

You can only use pure Java/Scala libraries with a DevEndpoint.

devEndpointCustomLibraries_extraPythonLibsS3Path :: Lens' DevEndpointCustomLibraries (Maybe Text) Source #

The paths to one or more Python libraries in an Amazon Simple Storage Service (Amazon S3) bucket that should be loaded in your DevEndpoint. Multiple values must be complete paths separated by a comma.

You can only use pure Python libraries with a DevEndpoint. Libraries that rely on C extensions, such as the pandas Python data analysis library, are not currently supported.

DirectKafkaSource

data DirectKafkaSource Source #

Specifies an Apache Kafka data store.

See: newDirectKafkaSource smart constructor.

Constructors

DirectKafkaSource' 

Fields

Instances

Instances details
FromJSON DirectKafkaSource Source # 
Instance details

Defined in Amazonka.Glue.Types.DirectKafkaSource

ToJSON DirectKafkaSource Source # 
Instance details

Defined in Amazonka.Glue.Types.DirectKafkaSource

Generic DirectKafkaSource Source # 
Instance details

Defined in Amazonka.Glue.Types.DirectKafkaSource

Associated Types

type Rep DirectKafkaSource :: Type -> Type #

Read DirectKafkaSource Source # 
Instance details

Defined in Amazonka.Glue.Types.DirectKafkaSource

Show DirectKafkaSource Source # 
Instance details

Defined in Amazonka.Glue.Types.DirectKafkaSource

NFData DirectKafkaSource Source # 
Instance details

Defined in Amazonka.Glue.Types.DirectKafkaSource

Methods

rnf :: DirectKafkaSource -> () #

Eq DirectKafkaSource Source # 
Instance details

Defined in Amazonka.Glue.Types.DirectKafkaSource

Hashable DirectKafkaSource Source # 
Instance details

Defined in Amazonka.Glue.Types.DirectKafkaSource

type Rep DirectKafkaSource Source # 
Instance details

Defined in Amazonka.Glue.Types.DirectKafkaSource

type Rep DirectKafkaSource = D1 ('MetaData "DirectKafkaSource" "Amazonka.Glue.Types.DirectKafkaSource" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "DirectKafkaSource'" 'PrefixI 'True) ((S1 ('MetaSel ('Just "dataPreviewOptions") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe StreamingDataPreviewOptions)) :*: S1 ('MetaSel ('Just "detectSchema") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Bool))) :*: (S1 ('MetaSel ('Just "streamingOptions") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe KafkaStreamingSourceOptions)) :*: (S1 ('MetaSel ('Just "windowSize") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Natural)) :*: S1 ('MetaSel ('Just "name") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text)))))

newDirectKafkaSource Source #

Create a value of DirectKafkaSource with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:dataPreviewOptions:DirectKafkaSource', directKafkaSource_dataPreviewOptions - Specifies options related to data preview for viewing a sample of your data.

$sel:detectSchema:DirectKafkaSource', directKafkaSource_detectSchema - Whether to automatically determine the schema from the incoming data.

$sel:streamingOptions:DirectKafkaSource', directKafkaSource_streamingOptions - Specifies the streaming options.

$sel:windowSize:DirectKafkaSource', directKafkaSource_windowSize - The amount of time to spend processing each micro batch.

$sel:name:DirectKafkaSource', directKafkaSource_name - The name of the data store.

directKafkaSource_dataPreviewOptions :: Lens' DirectKafkaSource (Maybe StreamingDataPreviewOptions) Source #

Specifies options related to data preview for viewing a sample of your data.

directKafkaSource_detectSchema :: Lens' DirectKafkaSource (Maybe Bool) Source #

Whether to automatically determine the schema from the incoming data.

directKafkaSource_windowSize :: Lens' DirectKafkaSource (Maybe Natural) Source #

The amount of time to spend processing each micro batch.

DirectKinesisSource

data DirectKinesisSource Source #

Specifies a direct Amazon Kinesis data source.

See: newDirectKinesisSource smart constructor.

Constructors

DirectKinesisSource' 

Fields

Instances

Instances details
FromJSON DirectKinesisSource Source # 
Instance details

Defined in Amazonka.Glue.Types.DirectKinesisSource

ToJSON DirectKinesisSource Source # 
Instance details

Defined in Amazonka.Glue.Types.DirectKinesisSource

Generic DirectKinesisSource Source # 
Instance details

Defined in Amazonka.Glue.Types.DirectKinesisSource

Associated Types

type Rep DirectKinesisSource :: Type -> Type #

Read DirectKinesisSource Source # 
Instance details

Defined in Amazonka.Glue.Types.DirectKinesisSource

Show DirectKinesisSource Source # 
Instance details

Defined in Amazonka.Glue.Types.DirectKinesisSource

NFData DirectKinesisSource Source # 
Instance details

Defined in Amazonka.Glue.Types.DirectKinesisSource

Methods

rnf :: DirectKinesisSource -> () #

Eq DirectKinesisSource Source # 
Instance details

Defined in Amazonka.Glue.Types.DirectKinesisSource

Hashable DirectKinesisSource Source # 
Instance details

Defined in Amazonka.Glue.Types.DirectKinesisSource

type Rep DirectKinesisSource Source # 
Instance details

Defined in Amazonka.Glue.Types.DirectKinesisSource

type Rep DirectKinesisSource = D1 ('MetaData "DirectKinesisSource" "Amazonka.Glue.Types.DirectKinesisSource" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "DirectKinesisSource'" 'PrefixI 'True) ((S1 ('MetaSel ('Just "dataPreviewOptions") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe StreamingDataPreviewOptions)) :*: S1 ('MetaSel ('Just "detectSchema") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Bool))) :*: (S1 ('MetaSel ('Just "streamingOptions") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe KinesisStreamingSourceOptions)) :*: (S1 ('MetaSel ('Just "windowSize") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Natural)) :*: S1 ('MetaSel ('Just "name") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text)))))

newDirectKinesisSource Source #

Create a value of DirectKinesisSource with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:dataPreviewOptions:DirectKinesisSource', directKinesisSource_dataPreviewOptions - Additional options for data preview.

$sel:detectSchema:DirectKinesisSource', directKinesisSource_detectSchema - Whether to automatically determine the schema from the incoming data.

$sel:streamingOptions:DirectKinesisSource', directKinesisSource_streamingOptions - Additional options for the Kinesis streaming data source.

$sel:windowSize:DirectKinesisSource', directKinesisSource_windowSize - The amount of time to spend processing each micro batch.

$sel:name:DirectKinesisSource', directKinesisSource_name - The name of the data source.

directKinesisSource_detectSchema :: Lens' DirectKinesisSource (Maybe Bool) Source #

Whether to automatically determine the schema from the incoming data.

directKinesisSource_streamingOptions :: Lens' DirectKinesisSource (Maybe KinesisStreamingSourceOptions) Source #

Additional options for the Kinesis streaming data source.

directKinesisSource_windowSize :: Lens' DirectKinesisSource (Maybe Natural) Source #

The amount of time to spend processing each micro batch.

DirectSchemaChangePolicy

data DirectSchemaChangePolicy Source #

A policy that specifies update behavior for the crawler.

See: newDirectSchemaChangePolicy smart constructor.

Constructors

DirectSchemaChangePolicy' 

Fields

Instances

Instances details
FromJSON DirectSchemaChangePolicy Source # 
Instance details

Defined in Amazonka.Glue.Types.DirectSchemaChangePolicy

ToJSON DirectSchemaChangePolicy Source # 
Instance details

Defined in Amazonka.Glue.Types.DirectSchemaChangePolicy

Generic DirectSchemaChangePolicy Source # 
Instance details

Defined in Amazonka.Glue.Types.DirectSchemaChangePolicy

Associated Types

type Rep DirectSchemaChangePolicy :: Type -> Type #

Read DirectSchemaChangePolicy Source # 
Instance details

Defined in Amazonka.Glue.Types.DirectSchemaChangePolicy

Show DirectSchemaChangePolicy Source # 
Instance details

Defined in Amazonka.Glue.Types.DirectSchemaChangePolicy

NFData DirectSchemaChangePolicy Source # 
Instance details

Defined in Amazonka.Glue.Types.DirectSchemaChangePolicy

Eq DirectSchemaChangePolicy Source # 
Instance details

Defined in Amazonka.Glue.Types.DirectSchemaChangePolicy

Hashable DirectSchemaChangePolicy Source # 
Instance details

Defined in Amazonka.Glue.Types.DirectSchemaChangePolicy

type Rep DirectSchemaChangePolicy Source # 
Instance details

Defined in Amazonka.Glue.Types.DirectSchemaChangePolicy

type Rep DirectSchemaChangePolicy = D1 ('MetaData "DirectSchemaChangePolicy" "Amazonka.Glue.Types.DirectSchemaChangePolicy" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "DirectSchemaChangePolicy'" 'PrefixI 'True) ((S1 ('MetaSel ('Just "database") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "enableUpdateCatalog") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Bool))) :*: (S1 ('MetaSel ('Just "table") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "updateBehavior") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe UpdateCatalogBehavior)))))

newDirectSchemaChangePolicy :: DirectSchemaChangePolicy Source #

Create a value of DirectSchemaChangePolicy with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:database:DirectSchemaChangePolicy', directSchemaChangePolicy_database - Specifies the database that the schema change policy applies to.

$sel:enableUpdateCatalog:DirectSchemaChangePolicy', directSchemaChangePolicy_enableUpdateCatalog - Whether to use the specified update behavior when the crawler finds a changed schema.

$sel:table:DirectSchemaChangePolicy', directSchemaChangePolicy_table - Specifies the table in the database that the schema change policy applies to.

$sel:updateBehavior:DirectSchemaChangePolicy', directSchemaChangePolicy_updateBehavior - The update behavior when the crawler finds a changed schema.

directSchemaChangePolicy_database :: Lens' DirectSchemaChangePolicy (Maybe Text) Source #

Specifies the database that the schema change policy applies to.

directSchemaChangePolicy_enableUpdateCatalog :: Lens' DirectSchemaChangePolicy (Maybe Bool) Source #

Whether to use the specified update behavior when the crawler finds a changed schema.

directSchemaChangePolicy_table :: Lens' DirectSchemaChangePolicy (Maybe Text) Source #

Specifies the table in the database that the schema change policy applies to.

directSchemaChangePolicy_updateBehavior :: Lens' DirectSchemaChangePolicy (Maybe UpdateCatalogBehavior) Source #

The update behavior when the crawler finds a changed schema.

DoubleColumnStatisticsData

data DoubleColumnStatisticsData Source #

Defines column statistics supported for floating-point number data columns.

See: newDoubleColumnStatisticsData smart constructor.

Constructors

DoubleColumnStatisticsData' 

Fields

Instances

Instances details
FromJSON DoubleColumnStatisticsData Source # 
Instance details

Defined in Amazonka.Glue.Types.DoubleColumnStatisticsData

ToJSON DoubleColumnStatisticsData Source # 
Instance details

Defined in Amazonka.Glue.Types.DoubleColumnStatisticsData

Generic DoubleColumnStatisticsData Source # 
Instance details

Defined in Amazonka.Glue.Types.DoubleColumnStatisticsData

Associated Types

type Rep DoubleColumnStatisticsData :: Type -> Type #

Read DoubleColumnStatisticsData Source # 
Instance details

Defined in Amazonka.Glue.Types.DoubleColumnStatisticsData

Show DoubleColumnStatisticsData Source # 
Instance details

Defined in Amazonka.Glue.Types.DoubleColumnStatisticsData

NFData DoubleColumnStatisticsData Source # 
Instance details

Defined in Amazonka.Glue.Types.DoubleColumnStatisticsData

Eq DoubleColumnStatisticsData Source # 
Instance details

Defined in Amazonka.Glue.Types.DoubleColumnStatisticsData

Hashable DoubleColumnStatisticsData Source # 
Instance details

Defined in Amazonka.Glue.Types.DoubleColumnStatisticsData

type Rep DoubleColumnStatisticsData Source # 
Instance details

Defined in Amazonka.Glue.Types.DoubleColumnStatisticsData

type Rep DoubleColumnStatisticsData = D1 ('MetaData "DoubleColumnStatisticsData" "Amazonka.Glue.Types.DoubleColumnStatisticsData" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "DoubleColumnStatisticsData'" 'PrefixI 'True) ((S1 ('MetaSel ('Just "maximumValue") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Double)) :*: S1 ('MetaSel ('Just "minimumValue") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Double))) :*: (S1 ('MetaSel ('Just "numberOfNulls") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Natural) :*: S1 ('MetaSel ('Just "numberOfDistinctValues") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Natural))))

newDoubleColumnStatisticsData Source #

Create a value of DoubleColumnStatisticsData with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:maximumValue:DoubleColumnStatisticsData', doubleColumnStatisticsData_maximumValue - The highest value in the column.

$sel:minimumValue:DoubleColumnStatisticsData', doubleColumnStatisticsData_minimumValue - The lowest value in the column.

$sel:numberOfNulls:DoubleColumnStatisticsData', doubleColumnStatisticsData_numberOfNulls - The number of null values in the column.

$sel:numberOfDistinctValues:DoubleColumnStatisticsData', doubleColumnStatisticsData_numberOfDistinctValues - The number of distinct values in a column.

DropDuplicates

data DropDuplicates Source #

Specifies a transform that removes rows of repeating data from a data set.

See: newDropDuplicates smart constructor.

Constructors

DropDuplicates' 

Fields

Instances

Instances details
FromJSON DropDuplicates Source # 
Instance details

Defined in Amazonka.Glue.Types.DropDuplicates

ToJSON DropDuplicates Source # 
Instance details

Defined in Amazonka.Glue.Types.DropDuplicates

Generic DropDuplicates Source # 
Instance details

Defined in Amazonka.Glue.Types.DropDuplicates

Associated Types

type Rep DropDuplicates :: Type -> Type #

Read DropDuplicates Source # 
Instance details

Defined in Amazonka.Glue.Types.DropDuplicates

Show DropDuplicates Source # 
Instance details

Defined in Amazonka.Glue.Types.DropDuplicates

NFData DropDuplicates Source # 
Instance details

Defined in Amazonka.Glue.Types.DropDuplicates

Methods

rnf :: DropDuplicates -> () #

Eq DropDuplicates Source # 
Instance details

Defined in Amazonka.Glue.Types.DropDuplicates

Hashable DropDuplicates Source # 
Instance details

Defined in Amazonka.Glue.Types.DropDuplicates

type Rep DropDuplicates Source # 
Instance details

Defined in Amazonka.Glue.Types.DropDuplicates

type Rep DropDuplicates = D1 ('MetaData "DropDuplicates" "Amazonka.Glue.Types.DropDuplicates" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "DropDuplicates'" 'PrefixI 'True) (S1 ('MetaSel ('Just "columns") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe [[Text]])) :*: (S1 ('MetaSel ('Just "name") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text) :*: S1 ('MetaSel ('Just "inputs") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (NonEmpty Text)))))

newDropDuplicates Source #

Create a value of DropDuplicates with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:columns:DropDuplicates', dropDuplicates_columns - The name of the columns to be merged or removed if repeating.

$sel:name:DropDuplicates', dropDuplicates_name - The name of the transform node.

$sel:inputs:DropDuplicates', dropDuplicates_inputs - The data inputs identified by their node names.

dropDuplicates_columns :: Lens' DropDuplicates (Maybe [[Text]]) Source #

The name of the columns to be merged or removed if repeating.

dropDuplicates_name :: Lens' DropDuplicates Text Source #

The name of the transform node.

dropDuplicates_inputs :: Lens' DropDuplicates (NonEmpty Text) Source #

The data inputs identified by their node names.

DropFields

data DropFields Source #

Specifies a transform that chooses the data property keys that you want to drop.

See: newDropFields smart constructor.

Constructors

DropFields' 

Fields

  • name :: Text

    The name of the transform node.

  • inputs :: NonEmpty Text

    The data inputs identified by their node names.

  • paths :: [[Text]]

    A JSON path to a variable in the data structure.

Instances

Instances details
FromJSON DropFields Source # 
Instance details

Defined in Amazonka.Glue.Types.DropFields

ToJSON DropFields Source # 
Instance details

Defined in Amazonka.Glue.Types.DropFields

Generic DropFields Source # 
Instance details

Defined in Amazonka.Glue.Types.DropFields

Associated Types

type Rep DropFields :: Type -> Type #

Read DropFields Source # 
Instance details

Defined in Amazonka.Glue.Types.DropFields

Show DropFields Source # 
Instance details

Defined in Amazonka.Glue.Types.DropFields

NFData DropFields Source # 
Instance details

Defined in Amazonka.Glue.Types.DropFields

Methods

rnf :: DropFields -> () #

Eq DropFields Source # 
Instance details

Defined in Amazonka.Glue.Types.DropFields

Hashable DropFields Source # 
Instance details

Defined in Amazonka.Glue.Types.DropFields

type Rep DropFields Source # 
Instance details

Defined in Amazonka.Glue.Types.DropFields

type Rep DropFields = D1 ('MetaData "DropFields" "Amazonka.Glue.Types.DropFields" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "DropFields'" 'PrefixI 'True) (S1 ('MetaSel ('Just "name") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text) :*: (S1 ('MetaSel ('Just "inputs") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (NonEmpty Text)) :*: S1 ('MetaSel ('Just "paths") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 [[Text]]))))

newDropFields Source #

Create a value of DropFields with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:name:DropFields', dropFields_name - The name of the transform node.

$sel:inputs:DropFields', dropFields_inputs - The data inputs identified by their node names.

$sel:paths:DropFields', dropFields_paths - A JSON path to a variable in the data structure.

dropFields_name :: Lens' DropFields Text Source #

The name of the transform node.

dropFields_inputs :: Lens' DropFields (NonEmpty Text) Source #

The data inputs identified by their node names.

dropFields_paths :: Lens' DropFields [[Text]] Source #

A JSON path to a variable in the data structure.

DropNullFields

data DropNullFields Source #

Specifies a transform that removes columns from the dataset if all values in the column are 'null'. By default, Glue Studio will recognize null objects, but some values such as empty strings, strings that are "null", -1 integers or other placeholders such as zeros, are not automatically recognized as nulls.

See: newDropNullFields smart constructor.

Constructors

DropNullFields' 

Fields

  • nullCheckBoxList :: Maybe NullCheckBoxList

    A structure that represents whether certain values are recognized as null values for removal.

  • nullTextList :: Maybe [NullValueField]

    A structure that specifies a list of NullValueField structures that represent a custom null value such as zero or other value being used as a null placeholder unique to the dataset.

    The DropNullFields transform removes custom null values only if both the value of the null placeholder and the datatype match the data.

  • name :: Text

    The name of the transform node.

  • inputs :: NonEmpty Text

    The data inputs identified by their node names.

Instances

Instances details
FromJSON DropNullFields Source # 
Instance details

Defined in Amazonka.Glue.Types.DropNullFields

ToJSON DropNullFields Source # 
Instance details

Defined in Amazonka.Glue.Types.DropNullFields

Generic DropNullFields Source # 
Instance details

Defined in Amazonka.Glue.Types.DropNullFields

Associated Types

type Rep DropNullFields :: Type -> Type #

Read DropNullFields Source # 
Instance details

Defined in Amazonka.Glue.Types.DropNullFields

Show DropNullFields Source # 
Instance details

Defined in Amazonka.Glue.Types.DropNullFields

NFData DropNullFields Source # 
Instance details

Defined in Amazonka.Glue.Types.DropNullFields

Methods

rnf :: DropNullFields -> () #

Eq DropNullFields Source # 
Instance details

Defined in Amazonka.Glue.Types.DropNullFields

Hashable DropNullFields Source # 
Instance details

Defined in Amazonka.Glue.Types.DropNullFields

type Rep DropNullFields Source # 
Instance details

Defined in Amazonka.Glue.Types.DropNullFields

type Rep DropNullFields = D1 ('MetaData "DropNullFields" "Amazonka.Glue.Types.DropNullFields" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "DropNullFields'" 'PrefixI 'True) ((S1 ('MetaSel ('Just "nullCheckBoxList") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe NullCheckBoxList)) :*: S1 ('MetaSel ('Just "nullTextList") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe [NullValueField]))) :*: (S1 ('MetaSel ('Just "name") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text) :*: S1 ('MetaSel ('Just "inputs") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (NonEmpty Text)))))

newDropNullFields Source #

Create a value of DropNullFields with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:nullCheckBoxList:DropNullFields', dropNullFields_nullCheckBoxList - A structure that represents whether certain values are recognized as null values for removal.

$sel:nullTextList:DropNullFields', dropNullFields_nullTextList - A structure that specifies a list of NullValueField structures that represent a custom null value such as zero or other value being used as a null placeholder unique to the dataset.

The DropNullFields transform removes custom null values only if both the value of the null placeholder and the datatype match the data.

$sel:name:DropNullFields', dropNullFields_name - The name of the transform node.

$sel:inputs:DropNullFields', dropNullFields_inputs - The data inputs identified by their node names.

dropNullFields_nullCheckBoxList :: Lens' DropNullFields (Maybe NullCheckBoxList) Source #

A structure that represents whether certain values are recognized as null values for removal.

dropNullFields_nullTextList :: Lens' DropNullFields (Maybe [NullValueField]) Source #

A structure that specifies a list of NullValueField structures that represent a custom null value such as zero or other value being used as a null placeholder unique to the dataset.

The DropNullFields transform removes custom null values only if both the value of the null placeholder and the datatype match the data.

dropNullFields_name :: Lens' DropNullFields Text Source #

The name of the transform node.

dropNullFields_inputs :: Lens' DropNullFields (NonEmpty Text) Source #

The data inputs identified by their node names.

DynamicTransform

data DynamicTransform Source #

Specifies the set of parameters needed to perform the dynamic transform.

See: newDynamicTransform smart constructor.

Constructors

DynamicTransform' 

Fields

Instances

Instances details
FromJSON DynamicTransform Source # 
Instance details

Defined in Amazonka.Glue.Types.DynamicTransform

ToJSON DynamicTransform Source # 
Instance details

Defined in Amazonka.Glue.Types.DynamicTransform

Generic DynamicTransform Source # 
Instance details

Defined in Amazonka.Glue.Types.DynamicTransform

Associated Types

type Rep DynamicTransform :: Type -> Type #

Read DynamicTransform Source # 
Instance details

Defined in Amazonka.Glue.Types.DynamicTransform

Show DynamicTransform Source # 
Instance details

Defined in Amazonka.Glue.Types.DynamicTransform

NFData DynamicTransform Source # 
Instance details

Defined in Amazonka.Glue.Types.DynamicTransform

Methods

rnf :: DynamicTransform -> () #

Eq DynamicTransform Source # 
Instance details

Defined in Amazonka.Glue.Types.DynamicTransform

Hashable DynamicTransform Source # 
Instance details

Defined in Amazonka.Glue.Types.DynamicTransform

type Rep DynamicTransform Source # 
Instance details

Defined in Amazonka.Glue.Types.DynamicTransform

newDynamicTransform Source #

Create a value of DynamicTransform with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:parameters:DynamicTransform', dynamicTransform_parameters - Specifies the parameters of the dynamic transform.

$sel:version:DynamicTransform', dynamicTransform_version - This field is not used and will be deprecated in future release.

DynamicTransform, dynamicTransform_name - Specifies the name of the dynamic transform.

$sel:transformName:DynamicTransform', dynamicTransform_transformName - Specifies the name of the dynamic transform as it appears in the Glue Studio visual editor.

$sel:inputs:DynamicTransform', dynamicTransform_inputs - Specifies the inputs for the dynamic transform that are required.

$sel:functionName:DynamicTransform', dynamicTransform_functionName - Specifies the name of the function of the dynamic transform.

$sel:path:DynamicTransform', dynamicTransform_path - Specifies the path of the dynamic transform source and config files.

dynamicTransform_parameters :: Lens' DynamicTransform (Maybe [TransformConfigParameter]) Source #

Specifies the parameters of the dynamic transform.

dynamicTransform_version :: Lens' DynamicTransform (Maybe Text) Source #

This field is not used and will be deprecated in future release.

dynamicTransform_name :: Lens' DynamicTransform Text Source #

Specifies the name of the dynamic transform.

dynamicTransform_transformName :: Lens' DynamicTransform Text Source #

Specifies the name of the dynamic transform as it appears in the Glue Studio visual editor.

dynamicTransform_inputs :: Lens' DynamicTransform (NonEmpty Text) Source #

Specifies the inputs for the dynamic transform that are required.

dynamicTransform_functionName :: Lens' DynamicTransform Text Source #

Specifies the name of the function of the dynamic transform.

dynamicTransform_path :: Lens' DynamicTransform Text Source #

Specifies the path of the dynamic transform source and config files.

DynamoDBCatalogSource

data DynamoDBCatalogSource Source #

Specifies a DynamoDB data source in the Glue Data Catalog.

See: newDynamoDBCatalogSource smart constructor.

Constructors

DynamoDBCatalogSource' 

Fields

  • name :: Text

    The name of the data source.

  • database :: Text

    The name of the database to read from.

  • table :: Text

    The name of the table in the database to read from.

Instances

Instances details
FromJSON DynamoDBCatalogSource Source # 
Instance details

Defined in Amazonka.Glue.Types.DynamoDBCatalogSource

ToJSON DynamoDBCatalogSource Source # 
Instance details

Defined in Amazonka.Glue.Types.DynamoDBCatalogSource

Generic DynamoDBCatalogSource Source # 
Instance details

Defined in Amazonka.Glue.Types.DynamoDBCatalogSource

Associated Types

type Rep DynamoDBCatalogSource :: Type -> Type #

Read DynamoDBCatalogSource Source # 
Instance details

Defined in Amazonka.Glue.Types.DynamoDBCatalogSource

Show DynamoDBCatalogSource Source # 
Instance details

Defined in Amazonka.Glue.Types.DynamoDBCatalogSource

NFData DynamoDBCatalogSource Source # 
Instance details

Defined in Amazonka.Glue.Types.DynamoDBCatalogSource

Methods

rnf :: DynamoDBCatalogSource -> () #

Eq DynamoDBCatalogSource Source # 
Instance details

Defined in Amazonka.Glue.Types.DynamoDBCatalogSource

Hashable DynamoDBCatalogSource Source # 
Instance details

Defined in Amazonka.Glue.Types.DynamoDBCatalogSource

type Rep DynamoDBCatalogSource Source # 
Instance details

Defined in Amazonka.Glue.Types.DynamoDBCatalogSource

type Rep DynamoDBCatalogSource = D1 ('MetaData "DynamoDBCatalogSource" "Amazonka.Glue.Types.DynamoDBCatalogSource" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "DynamoDBCatalogSource'" 'PrefixI 'True) (S1 ('MetaSel ('Just "name") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text) :*: (S1 ('MetaSel ('Just "database") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text) :*: S1 ('MetaSel ('Just "table") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text))))

newDynamoDBCatalogSource Source #

Create a value of DynamoDBCatalogSource with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:name:DynamoDBCatalogSource', dynamoDBCatalogSource_name - The name of the data source.

$sel:database:DynamoDBCatalogSource', dynamoDBCatalogSource_database - The name of the database to read from.

$sel:table:DynamoDBCatalogSource', dynamoDBCatalogSource_table - The name of the table in the database to read from.

dynamoDBCatalogSource_database :: Lens' DynamoDBCatalogSource Text Source #

The name of the database to read from.

dynamoDBCatalogSource_table :: Lens' DynamoDBCatalogSource Text Source #

The name of the table in the database to read from.

DynamoDBTarget

data DynamoDBTarget Source #

Specifies an Amazon DynamoDB table to crawl.

See: newDynamoDBTarget smart constructor.

Constructors

DynamoDBTarget' 

Fields

  • path :: Maybe Text

    The name of the DynamoDB table to crawl.

  • scanAll :: Maybe Bool

    Indicates whether to scan all the records, or to sample rows from the table. Scanning all the records can take a long time when the table is not a high throughput table.

    A value of true means to scan all records, while a value of false means to sample the records. If no value is specified, the value defaults to true.

  • scanRate :: Maybe Double

    The percentage of the configured read capacity units to use by the Glue crawler. Read capacity units is a term defined by DynamoDB, and is a numeric value that acts as rate limiter for the number of reads that can be performed on that table per second.

    The valid values are null or a value between 0.1 to 1.5. A null value is used when user does not provide a value, and defaults to 0.5 of the configured Read Capacity Unit (for provisioned tables), or 0.25 of the max configured Read Capacity Unit (for tables using on-demand mode).

Instances

Instances details
FromJSON DynamoDBTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.DynamoDBTarget

ToJSON DynamoDBTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.DynamoDBTarget

Generic DynamoDBTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.DynamoDBTarget

Associated Types

type Rep DynamoDBTarget :: Type -> Type #

Read DynamoDBTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.DynamoDBTarget

Show DynamoDBTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.DynamoDBTarget

NFData DynamoDBTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.DynamoDBTarget

Methods

rnf :: DynamoDBTarget -> () #

Eq DynamoDBTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.DynamoDBTarget

Hashable DynamoDBTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.DynamoDBTarget

type Rep DynamoDBTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.DynamoDBTarget

type Rep DynamoDBTarget = D1 ('MetaData "DynamoDBTarget" "Amazonka.Glue.Types.DynamoDBTarget" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "DynamoDBTarget'" 'PrefixI 'True) (S1 ('MetaSel ('Just "path") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: (S1 ('MetaSel ('Just "scanAll") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Bool)) :*: S1 ('MetaSel ('Just "scanRate") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Double)))))

newDynamoDBTarget :: DynamoDBTarget Source #

Create a value of DynamoDBTarget with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:path:DynamoDBTarget', dynamoDBTarget_path - The name of the DynamoDB table to crawl.

$sel:scanAll:DynamoDBTarget', dynamoDBTarget_scanAll - Indicates whether to scan all the records, or to sample rows from the table. Scanning all the records can take a long time when the table is not a high throughput table.

A value of true means to scan all records, while a value of false means to sample the records. If no value is specified, the value defaults to true.

$sel:scanRate:DynamoDBTarget', dynamoDBTarget_scanRate - The percentage of the configured read capacity units to use by the Glue crawler. Read capacity units is a term defined by DynamoDB, and is a numeric value that acts as rate limiter for the number of reads that can be performed on that table per second.

The valid values are null or a value between 0.1 to 1.5. A null value is used when user does not provide a value, and defaults to 0.5 of the configured Read Capacity Unit (for provisioned tables), or 0.25 of the max configured Read Capacity Unit (for tables using on-demand mode).

dynamoDBTarget_path :: Lens' DynamoDBTarget (Maybe Text) Source #

The name of the DynamoDB table to crawl.

dynamoDBTarget_scanAll :: Lens' DynamoDBTarget (Maybe Bool) Source #

Indicates whether to scan all the records, or to sample rows from the table. Scanning all the records can take a long time when the table is not a high throughput table.

A value of true means to scan all records, while a value of false means to sample the records. If no value is specified, the value defaults to true.

dynamoDBTarget_scanRate :: Lens' DynamoDBTarget (Maybe Double) Source #

The percentage of the configured read capacity units to use by the Glue crawler. Read capacity units is a term defined by DynamoDB, and is a numeric value that acts as rate limiter for the number of reads that can be performed on that table per second.

The valid values are null or a value between 0.1 to 1.5. A null value is used when user does not provide a value, and defaults to 0.5 of the configured Read Capacity Unit (for provisioned tables), or 0.25 of the max configured Read Capacity Unit (for tables using on-demand mode).

Edge

data Edge Source #

An edge represents a directed connection between two Glue components that are part of the workflow the edge belongs to.

See: newEdge smart constructor.

Constructors

Edge' 

Fields

Instances

Instances details
FromJSON Edge Source # 
Instance details

Defined in Amazonka.Glue.Types.Edge

Generic Edge Source # 
Instance details

Defined in Amazonka.Glue.Types.Edge

Associated Types

type Rep Edge :: Type -> Type #

Methods

from :: Edge -> Rep Edge x #

to :: Rep Edge x -> Edge #

Read Edge Source # 
Instance details

Defined in Amazonka.Glue.Types.Edge

Show Edge Source # 
Instance details

Defined in Amazonka.Glue.Types.Edge

Methods

showsPrec :: Int -> Edge -> ShowS #

show :: Edge -> String #

showList :: [Edge] -> ShowS #

NFData Edge Source # 
Instance details

Defined in Amazonka.Glue.Types.Edge

Methods

rnf :: Edge -> () #

Eq Edge Source # 
Instance details

Defined in Amazonka.Glue.Types.Edge

Methods

(==) :: Edge -> Edge -> Bool #

(/=) :: Edge -> Edge -> Bool #

Hashable Edge Source # 
Instance details

Defined in Amazonka.Glue.Types.Edge

Methods

hashWithSalt :: Int -> Edge -> Int #

hash :: Edge -> Int #

type Rep Edge Source # 
Instance details

Defined in Amazonka.Glue.Types.Edge

type Rep Edge = D1 ('MetaData "Edge" "Amazonka.Glue.Types.Edge" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "Edge'" 'PrefixI 'True) (S1 ('MetaSel ('Just "destinationId") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "sourceId") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text))))

newEdge :: Edge Source #

Create a value of Edge with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:destinationId:Edge', edge_destinationId - The unique of the node within the workflow where the edge ends.

$sel:sourceId:Edge', edge_sourceId - The unique of the node within the workflow where the edge starts.

edge_destinationId :: Lens' Edge (Maybe Text) Source #

The unique of the node within the workflow where the edge ends.

edge_sourceId :: Lens' Edge (Maybe Text) Source #

The unique of the node within the workflow where the edge starts.

EncryptionAtRest

data EncryptionAtRest Source #

Specifies the encryption-at-rest configuration for the Data Catalog.

See: newEncryptionAtRest smart constructor.

Constructors

EncryptionAtRest' 

Fields

Instances

Instances details
FromJSON EncryptionAtRest Source # 
Instance details

Defined in Amazonka.Glue.Types.EncryptionAtRest

ToJSON EncryptionAtRest Source # 
Instance details

Defined in Amazonka.Glue.Types.EncryptionAtRest

Generic EncryptionAtRest Source # 
Instance details

Defined in Amazonka.Glue.Types.EncryptionAtRest

Associated Types

type Rep EncryptionAtRest :: Type -> Type #

Read EncryptionAtRest Source # 
Instance details

Defined in Amazonka.Glue.Types.EncryptionAtRest

Show EncryptionAtRest Source # 
Instance details

Defined in Amazonka.Glue.Types.EncryptionAtRest

NFData EncryptionAtRest Source # 
Instance details

Defined in Amazonka.Glue.Types.EncryptionAtRest

Methods

rnf :: EncryptionAtRest -> () #

Eq EncryptionAtRest Source # 
Instance details

Defined in Amazonka.Glue.Types.EncryptionAtRest

Hashable EncryptionAtRest Source # 
Instance details

Defined in Amazonka.Glue.Types.EncryptionAtRest

type Rep EncryptionAtRest Source # 
Instance details

Defined in Amazonka.Glue.Types.EncryptionAtRest

type Rep EncryptionAtRest = D1 ('MetaData "EncryptionAtRest" "Amazonka.Glue.Types.EncryptionAtRest" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "EncryptionAtRest'" 'PrefixI 'True) (S1 ('MetaSel ('Just "sseAwsKmsKeyId") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "catalogEncryptionMode") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 CatalogEncryptionMode)))

newEncryptionAtRest Source #

Create a value of EncryptionAtRest with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:sseAwsKmsKeyId:EncryptionAtRest', encryptionAtRest_sseAwsKmsKeyId - The ID of the KMS key to use for encryption at rest.

$sel:catalogEncryptionMode:EncryptionAtRest', encryptionAtRest_catalogEncryptionMode - The encryption-at-rest mode for encrypting Data Catalog data.

encryptionAtRest_sseAwsKmsKeyId :: Lens' EncryptionAtRest (Maybe Text) Source #

The ID of the KMS key to use for encryption at rest.

encryptionAtRest_catalogEncryptionMode :: Lens' EncryptionAtRest CatalogEncryptionMode Source #

The encryption-at-rest mode for encrypting Data Catalog data.

EncryptionConfiguration

data EncryptionConfiguration Source #

Specifies an encryption configuration.

See: newEncryptionConfiguration smart constructor.

Constructors

EncryptionConfiguration' 

Fields

Instances

Instances details
FromJSON EncryptionConfiguration Source # 
Instance details

Defined in Amazonka.Glue.Types.EncryptionConfiguration

ToJSON EncryptionConfiguration Source # 
Instance details

Defined in Amazonka.Glue.Types.EncryptionConfiguration

Generic EncryptionConfiguration Source # 
Instance details

Defined in Amazonka.Glue.Types.EncryptionConfiguration

Associated Types

type Rep EncryptionConfiguration :: Type -> Type #

Read EncryptionConfiguration Source # 
Instance details

Defined in Amazonka.Glue.Types.EncryptionConfiguration

Show EncryptionConfiguration Source # 
Instance details

Defined in Amazonka.Glue.Types.EncryptionConfiguration

NFData EncryptionConfiguration Source # 
Instance details

Defined in Amazonka.Glue.Types.EncryptionConfiguration

Methods

rnf :: EncryptionConfiguration -> () #

Eq EncryptionConfiguration Source # 
Instance details

Defined in Amazonka.Glue.Types.EncryptionConfiguration

Hashable EncryptionConfiguration Source # 
Instance details

Defined in Amazonka.Glue.Types.EncryptionConfiguration

type Rep EncryptionConfiguration Source # 
Instance details

Defined in Amazonka.Glue.Types.EncryptionConfiguration

type Rep EncryptionConfiguration = D1 ('MetaData "EncryptionConfiguration" "Amazonka.Glue.Types.EncryptionConfiguration" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "EncryptionConfiguration'" 'PrefixI 'True) (S1 ('MetaSel ('Just "cloudWatchEncryption") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe CloudWatchEncryption)) :*: (S1 ('MetaSel ('Just "jobBookmarksEncryption") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe JobBookmarksEncryption)) :*: S1 ('MetaSel ('Just "s3Encryption") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe [S3Encryption])))))

newEncryptionConfiguration :: EncryptionConfiguration Source #

Create a value of EncryptionConfiguration with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:cloudWatchEncryption:EncryptionConfiguration', encryptionConfiguration_cloudWatchEncryption - The encryption configuration for Amazon CloudWatch.

$sel:jobBookmarksEncryption:EncryptionConfiguration', encryptionConfiguration_jobBookmarksEncryption - The encryption configuration for job bookmarks.

$sel:s3Encryption:EncryptionConfiguration', encryptionConfiguration_s3Encryption - The encryption configuration for Amazon Simple Storage Service (Amazon S3) data.

encryptionConfiguration_s3Encryption :: Lens' EncryptionConfiguration (Maybe [S3Encryption]) Source #

The encryption configuration for Amazon Simple Storage Service (Amazon S3) data.

ErrorDetail

data ErrorDetail Source #

Contains details about an error.

See: newErrorDetail smart constructor.

Constructors

ErrorDetail' 

Fields

Instances

Instances details
FromJSON ErrorDetail Source # 
Instance details

Defined in Amazonka.Glue.Types.ErrorDetail

Generic ErrorDetail Source # 
Instance details

Defined in Amazonka.Glue.Types.ErrorDetail

Associated Types

type Rep ErrorDetail :: Type -> Type #

Read ErrorDetail Source # 
Instance details

Defined in Amazonka.Glue.Types.ErrorDetail

Show ErrorDetail Source # 
Instance details

Defined in Amazonka.Glue.Types.ErrorDetail

NFData ErrorDetail Source # 
Instance details

Defined in Amazonka.Glue.Types.ErrorDetail

Methods

rnf :: ErrorDetail -> () #

Eq ErrorDetail Source # 
Instance details

Defined in Amazonka.Glue.Types.ErrorDetail

Hashable ErrorDetail Source # 
Instance details

Defined in Amazonka.Glue.Types.ErrorDetail

type Rep ErrorDetail Source # 
Instance details

Defined in Amazonka.Glue.Types.ErrorDetail

type Rep ErrorDetail = D1 ('MetaData "ErrorDetail" "Amazonka.Glue.Types.ErrorDetail" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "ErrorDetail'" 'PrefixI 'True) (S1 ('MetaSel ('Just "errorCode") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "errorMessage") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text))))

newErrorDetail :: ErrorDetail Source #

Create a value of ErrorDetail with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:errorCode:ErrorDetail', errorDetail_errorCode - The code associated with this error.

$sel:errorMessage:ErrorDetail', errorDetail_errorMessage - A message describing the error.

errorDetail_errorCode :: Lens' ErrorDetail (Maybe Text) Source #

The code associated with this error.

errorDetail_errorMessage :: Lens' ErrorDetail (Maybe Text) Source #

A message describing the error.

ErrorDetails

data ErrorDetails Source #

An object containing error details.

See: newErrorDetails smart constructor.

Constructors

ErrorDetails' 

Fields

Instances

Instances details
FromJSON ErrorDetails Source # 
Instance details

Defined in Amazonka.Glue.Types.ErrorDetails

Generic ErrorDetails Source # 
Instance details

Defined in Amazonka.Glue.Types.ErrorDetails

Associated Types

type Rep ErrorDetails :: Type -> Type #

Read ErrorDetails Source # 
Instance details

Defined in Amazonka.Glue.Types.ErrorDetails

Show ErrorDetails Source # 
Instance details

Defined in Amazonka.Glue.Types.ErrorDetails

NFData ErrorDetails Source # 
Instance details

Defined in Amazonka.Glue.Types.ErrorDetails

Methods

rnf :: ErrorDetails -> () #

Eq ErrorDetails Source # 
Instance details

Defined in Amazonka.Glue.Types.ErrorDetails

Hashable ErrorDetails Source # 
Instance details

Defined in Amazonka.Glue.Types.ErrorDetails

type Rep ErrorDetails Source # 
Instance details

Defined in Amazonka.Glue.Types.ErrorDetails

type Rep ErrorDetails = D1 ('MetaData "ErrorDetails" "Amazonka.Glue.Types.ErrorDetails" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "ErrorDetails'" 'PrefixI 'True) (S1 ('MetaSel ('Just "errorCode") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "errorMessage") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text))))

newErrorDetails :: ErrorDetails Source #

Create a value of ErrorDetails with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:errorCode:ErrorDetails', errorDetails_errorCode - The error code for an error.

$sel:errorMessage:ErrorDetails', errorDetails_errorMessage - The error message for an error.

errorDetails_errorCode :: Lens' ErrorDetails (Maybe Text) Source #

The error code for an error.

errorDetails_errorMessage :: Lens' ErrorDetails (Maybe Text) Source #

The error message for an error.

EvaluateDataQuality

data EvaluateDataQuality Source #

Specifies your data quality evaluation criteria.

See: newEvaluateDataQuality smart constructor.

Constructors

EvaluateDataQuality' 

Fields

Instances

Instances details
FromJSON EvaluateDataQuality Source # 
Instance details

Defined in Amazonka.Glue.Types.EvaluateDataQuality

ToJSON EvaluateDataQuality Source # 
Instance details

Defined in Amazonka.Glue.Types.EvaluateDataQuality

Generic EvaluateDataQuality Source # 
Instance details

Defined in Amazonka.Glue.Types.EvaluateDataQuality

Associated Types

type Rep EvaluateDataQuality :: Type -> Type #

Read EvaluateDataQuality Source # 
Instance details

Defined in Amazonka.Glue.Types.EvaluateDataQuality

Show EvaluateDataQuality Source # 
Instance details

Defined in Amazonka.Glue.Types.EvaluateDataQuality

NFData EvaluateDataQuality Source # 
Instance details

Defined in Amazonka.Glue.Types.EvaluateDataQuality

Methods

rnf :: EvaluateDataQuality -> () #

Eq EvaluateDataQuality Source # 
Instance details

Defined in Amazonka.Glue.Types.EvaluateDataQuality

Hashable EvaluateDataQuality Source # 
Instance details

Defined in Amazonka.Glue.Types.EvaluateDataQuality

type Rep EvaluateDataQuality Source # 
Instance details

Defined in Amazonka.Glue.Types.EvaluateDataQuality

newEvaluateDataQuality Source #

Create a value of EvaluateDataQuality with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:output:EvaluateDataQuality', evaluateDataQuality_output - The output of your data quality evaluation.

$sel:publishingOptions:EvaluateDataQuality', evaluateDataQuality_publishingOptions - Options to configure how your results are published.

$sel:stopJobOnFailureOptions:EvaluateDataQuality', evaluateDataQuality_stopJobOnFailureOptions - Options to configure how your job will stop if your data quality evaluation fails.

$sel:name:EvaluateDataQuality', evaluateDataQuality_name - The name of the data quality evaluation.

$sel:inputs:EvaluateDataQuality', evaluateDataQuality_inputs - The inputs of your data quality evaluation.

$sel:ruleset:EvaluateDataQuality', evaluateDataQuality_ruleset - The ruleset for your data quality evaluation.

evaluateDataQuality_output :: Lens' EvaluateDataQuality (Maybe DQTransformOutput) Source #

The output of your data quality evaluation.

evaluateDataQuality_stopJobOnFailureOptions :: Lens' EvaluateDataQuality (Maybe DQStopJobOnFailureOptions) Source #

Options to configure how your job will stop if your data quality evaluation fails.

evaluateDataQuality_name :: Lens' EvaluateDataQuality Text Source #

The name of the data quality evaluation.

evaluateDataQuality_inputs :: Lens' EvaluateDataQuality (NonEmpty Text) Source #

The inputs of your data quality evaluation.

evaluateDataQuality_ruleset :: Lens' EvaluateDataQuality Text Source #

The ruleset for your data quality evaluation.

EvaluationMetrics

data EvaluationMetrics Source #

Evaluation metrics provide an estimate of the quality of your machine learning transform.

See: newEvaluationMetrics smart constructor.

Constructors

EvaluationMetrics' 

Fields

Instances

Instances details
FromJSON EvaluationMetrics Source # 
Instance details

Defined in Amazonka.Glue.Types.EvaluationMetrics

Generic EvaluationMetrics Source # 
Instance details

Defined in Amazonka.Glue.Types.EvaluationMetrics

Associated Types

type Rep EvaluationMetrics :: Type -> Type #

Read EvaluationMetrics Source # 
Instance details

Defined in Amazonka.Glue.Types.EvaluationMetrics

Show EvaluationMetrics Source # 
Instance details

Defined in Amazonka.Glue.Types.EvaluationMetrics

NFData EvaluationMetrics Source # 
Instance details

Defined in Amazonka.Glue.Types.EvaluationMetrics

Methods

rnf :: EvaluationMetrics -> () #

Eq EvaluationMetrics Source # 
Instance details

Defined in Amazonka.Glue.Types.EvaluationMetrics

Hashable EvaluationMetrics Source # 
Instance details

Defined in Amazonka.Glue.Types.EvaluationMetrics

type Rep EvaluationMetrics Source # 
Instance details

Defined in Amazonka.Glue.Types.EvaluationMetrics

type Rep EvaluationMetrics = D1 ('MetaData "EvaluationMetrics" "Amazonka.Glue.Types.EvaluationMetrics" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "EvaluationMetrics'" 'PrefixI 'True) (S1 ('MetaSel ('Just "findMatchesMetrics") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe FindMatchesMetrics)) :*: S1 ('MetaSel ('Just "transformType") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 TransformType)))

newEvaluationMetrics Source #

Create a value of EvaluationMetrics with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:findMatchesMetrics:EvaluationMetrics', evaluationMetrics_findMatchesMetrics - The evaluation metrics for the find matches algorithm.

$sel:transformType:EvaluationMetrics', evaluationMetrics_transformType - The type of machine learning transform.

evaluationMetrics_findMatchesMetrics :: Lens' EvaluationMetrics (Maybe FindMatchesMetrics) Source #

The evaluation metrics for the find matches algorithm.

EventBatchingCondition

data EventBatchingCondition Source #

Batch condition that must be met (specified number of events received or batch time window expired) before EventBridge event trigger fires.

See: newEventBatchingCondition smart constructor.

Constructors

EventBatchingCondition' 

Fields

  • batchWindow :: Maybe Natural

    Window of time in seconds after which EventBridge event trigger fires. Window starts when first event is received.

  • batchSize :: Natural

    Number of events that must be received from Amazon EventBridge before EventBridge event trigger fires.

Instances

Instances details
FromJSON EventBatchingCondition Source # 
Instance details

Defined in Amazonka.Glue.Types.EventBatchingCondition

ToJSON EventBatchingCondition Source # 
Instance details

Defined in Amazonka.Glue.Types.EventBatchingCondition

Generic EventBatchingCondition Source # 
Instance details

Defined in Amazonka.Glue.Types.EventBatchingCondition

Associated Types

type Rep EventBatchingCondition :: Type -> Type #

Read EventBatchingCondition Source # 
Instance details

Defined in Amazonka.Glue.Types.EventBatchingCondition

Show EventBatchingCondition Source # 
Instance details

Defined in Amazonka.Glue.Types.EventBatchingCondition

NFData EventBatchingCondition Source # 
Instance details

Defined in Amazonka.Glue.Types.EventBatchingCondition

Methods

rnf :: EventBatchingCondition -> () #

Eq EventBatchingCondition Source # 
Instance details

Defined in Amazonka.Glue.Types.EventBatchingCondition

Hashable EventBatchingCondition Source # 
Instance details

Defined in Amazonka.Glue.Types.EventBatchingCondition

type Rep EventBatchingCondition Source # 
Instance details

Defined in Amazonka.Glue.Types.EventBatchingCondition

type Rep EventBatchingCondition = D1 ('MetaData "EventBatchingCondition" "Amazonka.Glue.Types.EventBatchingCondition" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "EventBatchingCondition'" 'PrefixI 'True) (S1 ('MetaSel ('Just "batchWindow") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Natural)) :*: S1 ('MetaSel ('Just "batchSize") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Natural)))

newEventBatchingCondition Source #

Create a value of EventBatchingCondition with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:batchWindow:EventBatchingCondition', eventBatchingCondition_batchWindow - Window of time in seconds after which EventBridge event trigger fires. Window starts when first event is received.

$sel:batchSize:EventBatchingCondition', eventBatchingCondition_batchSize - Number of events that must be received from Amazon EventBridge before EventBridge event trigger fires.

eventBatchingCondition_batchWindow :: Lens' EventBatchingCondition (Maybe Natural) Source #

Window of time in seconds after which EventBridge event trigger fires. Window starts when first event is received.

eventBatchingCondition_batchSize :: Lens' EventBatchingCondition Natural Source #

Number of events that must be received from Amazon EventBridge before EventBridge event trigger fires.

ExecutionProperty

data ExecutionProperty Source #

An execution property of a job.

See: newExecutionProperty smart constructor.

Constructors

ExecutionProperty' 

Fields

  • maxConcurrentRuns :: Maybe Int

    The maximum number of concurrent runs allowed for the job. The default is 1. An error is returned when this threshold is reached. The maximum value you can specify is controlled by a service limit.

Instances

Instances details
FromJSON ExecutionProperty Source # 
Instance details

Defined in Amazonka.Glue.Types.ExecutionProperty

ToJSON ExecutionProperty Source # 
Instance details

Defined in Amazonka.Glue.Types.ExecutionProperty

Generic ExecutionProperty Source # 
Instance details

Defined in Amazonka.Glue.Types.ExecutionProperty

Associated Types

type Rep ExecutionProperty :: Type -> Type #

Read ExecutionProperty Source # 
Instance details

Defined in Amazonka.Glue.Types.ExecutionProperty

Show ExecutionProperty Source # 
Instance details

Defined in Amazonka.Glue.Types.ExecutionProperty

NFData ExecutionProperty Source # 
Instance details

Defined in Amazonka.Glue.Types.ExecutionProperty

Methods

rnf :: ExecutionProperty -> () #

Eq ExecutionProperty Source # 
Instance details

Defined in Amazonka.Glue.Types.ExecutionProperty

Hashable ExecutionProperty Source # 
Instance details

Defined in Amazonka.Glue.Types.ExecutionProperty

type Rep ExecutionProperty Source # 
Instance details

Defined in Amazonka.Glue.Types.ExecutionProperty

type Rep ExecutionProperty = D1 ('MetaData "ExecutionProperty" "Amazonka.Glue.Types.ExecutionProperty" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "ExecutionProperty'" 'PrefixI 'True) (S1 ('MetaSel ('Just "maxConcurrentRuns") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Int))))

newExecutionProperty :: ExecutionProperty Source #

Create a value of ExecutionProperty with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:maxConcurrentRuns:ExecutionProperty', executionProperty_maxConcurrentRuns - The maximum number of concurrent runs allowed for the job. The default is 1. An error is returned when this threshold is reached. The maximum value you can specify is controlled by a service limit.

executionProperty_maxConcurrentRuns :: Lens' ExecutionProperty (Maybe Int) Source #

The maximum number of concurrent runs allowed for the job. The default is 1. An error is returned when this threshold is reached. The maximum value you can specify is controlled by a service limit.

ExportLabelsTaskRunProperties

data ExportLabelsTaskRunProperties Source #

Specifies configuration properties for an exporting labels task run.

See: newExportLabelsTaskRunProperties smart constructor.

Constructors

ExportLabelsTaskRunProperties' 

Fields

  • outputS3Path :: Maybe Text

    The Amazon Simple Storage Service (Amazon S3) path where you will export the labels.

Instances

Instances details
FromJSON ExportLabelsTaskRunProperties Source # 
Instance details

Defined in Amazonka.Glue.Types.ExportLabelsTaskRunProperties

Generic ExportLabelsTaskRunProperties Source # 
Instance details

Defined in Amazonka.Glue.Types.ExportLabelsTaskRunProperties

Associated Types

type Rep ExportLabelsTaskRunProperties :: Type -> Type #

Read ExportLabelsTaskRunProperties Source # 
Instance details

Defined in Amazonka.Glue.Types.ExportLabelsTaskRunProperties

Show ExportLabelsTaskRunProperties Source # 
Instance details

Defined in Amazonka.Glue.Types.ExportLabelsTaskRunProperties

NFData ExportLabelsTaskRunProperties Source # 
Instance details

Defined in Amazonka.Glue.Types.ExportLabelsTaskRunProperties

Eq ExportLabelsTaskRunProperties Source # 
Instance details

Defined in Amazonka.Glue.Types.ExportLabelsTaskRunProperties

Hashable ExportLabelsTaskRunProperties Source # 
Instance details

Defined in Amazonka.Glue.Types.ExportLabelsTaskRunProperties

type Rep ExportLabelsTaskRunProperties Source # 
Instance details

Defined in Amazonka.Glue.Types.ExportLabelsTaskRunProperties

type Rep ExportLabelsTaskRunProperties = D1 ('MetaData "ExportLabelsTaskRunProperties" "Amazonka.Glue.Types.ExportLabelsTaskRunProperties" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "ExportLabelsTaskRunProperties'" 'PrefixI 'True) (S1 ('MetaSel ('Just "outputS3Path") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text))))

newExportLabelsTaskRunProperties :: ExportLabelsTaskRunProperties Source #

Create a value of ExportLabelsTaskRunProperties with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:outputS3Path:ExportLabelsTaskRunProperties', exportLabelsTaskRunProperties_outputS3Path - The Amazon Simple Storage Service (Amazon S3) path where you will export the labels.

exportLabelsTaskRunProperties_outputS3Path :: Lens' ExportLabelsTaskRunProperties (Maybe Text) Source #

The Amazon Simple Storage Service (Amazon S3) path where you will export the labels.

FillMissingValues

data FillMissingValues Source #

Specifies a transform that locates records in the dataset that have missing values and adds a new field with a value determined by imputation. The input data set is used to train the machine learning model that determines what the missing value should be.

See: newFillMissingValues smart constructor.

Constructors

FillMissingValues' 

Fields

  • filledPath :: Maybe Text

    A JSON path to a variable in the data structure for the dataset that is filled.

  • name :: Text

    The name of the transform node.

  • inputs :: NonEmpty Text

    The data inputs identified by their node names.

  • imputedPath :: Text

    A JSON path to a variable in the data structure for the dataset that is imputed.

Instances

Instances details
FromJSON FillMissingValues Source # 
Instance details

Defined in Amazonka.Glue.Types.FillMissingValues

ToJSON FillMissingValues Source # 
Instance details

Defined in Amazonka.Glue.Types.FillMissingValues

Generic FillMissingValues Source # 
Instance details

Defined in Amazonka.Glue.Types.FillMissingValues

Associated Types

type Rep FillMissingValues :: Type -> Type #

Read FillMissingValues Source # 
Instance details

Defined in Amazonka.Glue.Types.FillMissingValues

Show FillMissingValues Source # 
Instance details

Defined in Amazonka.Glue.Types.FillMissingValues

NFData FillMissingValues Source # 
Instance details

Defined in Amazonka.Glue.Types.FillMissingValues

Methods

rnf :: FillMissingValues -> () #

Eq FillMissingValues Source # 
Instance details

Defined in Amazonka.Glue.Types.FillMissingValues

Hashable FillMissingValues Source # 
Instance details

Defined in Amazonka.Glue.Types.FillMissingValues

type Rep FillMissingValues Source # 
Instance details

Defined in Amazonka.Glue.Types.FillMissingValues

type Rep FillMissingValues = D1 ('MetaData "FillMissingValues" "Amazonka.Glue.Types.FillMissingValues" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "FillMissingValues'" 'PrefixI 'True) ((S1 ('MetaSel ('Just "filledPath") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "name") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text)) :*: (S1 ('MetaSel ('Just "inputs") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (NonEmpty Text)) :*: S1 ('MetaSel ('Just "imputedPath") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text))))

newFillMissingValues Source #

Create a value of FillMissingValues with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:filledPath:FillMissingValues', fillMissingValues_filledPath - A JSON path to a variable in the data structure for the dataset that is filled.

$sel:name:FillMissingValues', fillMissingValues_name - The name of the transform node.

$sel:inputs:FillMissingValues', fillMissingValues_inputs - The data inputs identified by their node names.

$sel:imputedPath:FillMissingValues', fillMissingValues_imputedPath - A JSON path to a variable in the data structure for the dataset that is imputed.

fillMissingValues_filledPath :: Lens' FillMissingValues (Maybe Text) Source #

A JSON path to a variable in the data structure for the dataset that is filled.

fillMissingValues_name :: Lens' FillMissingValues Text Source #

The name of the transform node.

fillMissingValues_inputs :: Lens' FillMissingValues (NonEmpty Text) Source #

The data inputs identified by their node names.

fillMissingValues_imputedPath :: Lens' FillMissingValues Text Source #

A JSON path to a variable in the data structure for the dataset that is imputed.

Filter

data Filter Source #

Specifies a transform that splits a dataset into two, based on a filter condition.

See: newFilter smart constructor.

Constructors

Filter' 

Fields

Instances

Instances details
FromJSON Filter Source # 
Instance details

Defined in Amazonka.Glue.Types.Filter

ToJSON Filter Source # 
Instance details

Defined in Amazonka.Glue.Types.Filter

Generic Filter Source # 
Instance details

Defined in Amazonka.Glue.Types.Filter

Associated Types

type Rep Filter :: Type -> Type #

Methods

from :: Filter -> Rep Filter x #

to :: Rep Filter x -> Filter #

Read Filter Source # 
Instance details

Defined in Amazonka.Glue.Types.Filter

Show Filter Source # 
Instance details

Defined in Amazonka.Glue.Types.Filter

NFData Filter Source # 
Instance details

Defined in Amazonka.Glue.Types.Filter

Methods

rnf :: Filter -> () #

Eq Filter Source # 
Instance details

Defined in Amazonka.Glue.Types.Filter

Methods

(==) :: Filter -> Filter -> Bool #

(/=) :: Filter -> Filter -> Bool #

Hashable Filter Source # 
Instance details

Defined in Amazonka.Glue.Types.Filter

Methods

hashWithSalt :: Int -> Filter -> Int #

hash :: Filter -> Int #

type Rep Filter Source # 
Instance details

Defined in Amazonka.Glue.Types.Filter

newFilter Source #

Create a value of Filter with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:name:Filter', filter_name - The name of the transform node.

$sel:inputs:Filter', filter_inputs - The data inputs identified by their node names.

$sel:logicalOperator:Filter', filter_logicalOperator - The operator used to filter rows by comparing the key value to a specified value.

$sel:filters:Filter', filter_filters - Specifies a filter expression.

filter_name :: Lens' Filter Text Source #

The name of the transform node.

filter_inputs :: Lens' Filter (NonEmpty Text) Source #

The data inputs identified by their node names.

filter_logicalOperator :: Lens' Filter FilterLogicalOperator Source #

The operator used to filter rows by comparing the key value to a specified value.

filter_filters :: Lens' Filter [FilterExpression] Source #

Specifies a filter expression.

FilterExpression

data FilterExpression Source #

Specifies a filter expression.

See: newFilterExpression smart constructor.

Constructors

FilterExpression' 

Fields

Instances

Instances details
FromJSON FilterExpression Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterExpression

ToJSON FilterExpression Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterExpression

Generic FilterExpression Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterExpression

Associated Types

type Rep FilterExpression :: Type -> Type #

Read FilterExpression Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterExpression

Show FilterExpression Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterExpression

NFData FilterExpression Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterExpression

Methods

rnf :: FilterExpression -> () #

Eq FilterExpression Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterExpression

Hashable FilterExpression Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterExpression

type Rep FilterExpression Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterExpression

type Rep FilterExpression = D1 ('MetaData "FilterExpression" "Amazonka.Glue.Types.FilterExpression" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "FilterExpression'" 'PrefixI 'True) (S1 ('MetaSel ('Just "negated") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Bool)) :*: (S1 ('MetaSel ('Just "operation") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 FilterOperation) :*: S1 ('MetaSel ('Just "values") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 [FilterValue]))))

newFilterExpression Source #

Create a value of FilterExpression with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:negated:FilterExpression', filterExpression_negated - Whether the expression is to be negated.

$sel:operation:FilterExpression', filterExpression_operation - The type of operation to perform in the expression.

$sel:values:FilterExpression', filterExpression_values - A list of filter values.

filterExpression_negated :: Lens' FilterExpression (Maybe Bool) Source #

Whether the expression is to be negated.

filterExpression_operation :: Lens' FilterExpression FilterOperation Source #

The type of operation to perform in the expression.

FilterValue

data FilterValue Source #

Represents a single entry in the list of values for a FilterExpression.

See: newFilterValue smart constructor.

Constructors

FilterValue' 

Fields

Instances

Instances details
FromJSON FilterValue Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterValue

ToJSON FilterValue Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterValue

Generic FilterValue Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterValue

Associated Types

type Rep FilterValue :: Type -> Type #

Read FilterValue Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterValue

Show FilterValue Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterValue

NFData FilterValue Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterValue

Methods

rnf :: FilterValue -> () #

Eq FilterValue Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterValue

Hashable FilterValue Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterValue

type Rep FilterValue Source # 
Instance details

Defined in Amazonka.Glue.Types.FilterValue

type Rep FilterValue = D1 ('MetaData "FilterValue" "Amazonka.Glue.Types.FilterValue" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "FilterValue'" 'PrefixI 'True) (S1 ('MetaSel ('Just "type'") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 FilterValueType) :*: S1 ('MetaSel ('Just "value") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 [Text])))

newFilterValue Source #

Create a value of FilterValue with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:type':FilterValue', filterValue_type - The type of filter value.

$sel:value:FilterValue', filterValue_value - The value to be associated.

filterValue_value :: Lens' FilterValue [Text] Source #

The value to be associated.

FindMatchesMetrics

data FindMatchesMetrics Source #

The evaluation metrics for the find matches algorithm. The quality of your machine learning transform is measured by getting your transform to predict some matches and comparing the results to known matches from the same dataset. The quality metrics are based on a subset of your data, so they are not precise.

See: newFindMatchesMetrics smart constructor.

Constructors

FindMatchesMetrics' 

Fields

  • areaUnderPRCurve :: Maybe Double

    The area under the precision/recall curve (AUPRC) is a single number measuring the overall quality of the transform, that is independent of the choice made for precision vs. recall. Higher values indicate that you have a more attractive precision vs. recall tradeoff.

    For more information, see Precision and recall in Wikipedia.

  • columnImportances :: Maybe [ColumnImportance]

    A list of ColumnImportance structures containing column importance metrics, sorted in order of descending importance.

  • confusionMatrix :: Maybe ConfusionMatrix

    The confusion matrix shows you what your transform is predicting accurately and what types of errors it is making.

    For more information, see Confusion matrix in Wikipedia.

  • f1 :: Maybe Double

    The maximum F1 metric indicates the transform's accuracy between 0 and 1, where 1 is the best accuracy.

    For more information, see F1 score in Wikipedia.

  • precision :: Maybe Double

    The precision metric indicates when often your transform is correct when it predicts a match. Specifically, it measures how well the transform finds true positives from the total true positives possible.

    For more information, see Precision and recall in Wikipedia.

  • recall :: Maybe Double

    The recall metric indicates that for an actual match, how often your transform predicts the match. Specifically, it measures how well the transform finds true positives from the total records in the source data.

    For more information, see Precision and recall in Wikipedia.

Instances

Instances details
FromJSON FindMatchesMetrics Source # 
Instance details

Defined in Amazonka.Glue.Types.FindMatchesMetrics

Generic FindMatchesMetrics Source # 
Instance details

Defined in Amazonka.Glue.Types.FindMatchesMetrics

Associated Types

type Rep FindMatchesMetrics :: Type -> Type #

Read FindMatchesMetrics Source # 
Instance details

Defined in Amazonka.Glue.Types.FindMatchesMetrics

Show FindMatchesMetrics Source # 
Instance details

Defined in Amazonka.Glue.Types.FindMatchesMetrics

NFData FindMatchesMetrics Source # 
Instance details

Defined in Amazonka.Glue.Types.FindMatchesMetrics

Methods

rnf :: FindMatchesMetrics -> () #

Eq FindMatchesMetrics Source # 
Instance details

Defined in Amazonka.Glue.Types.FindMatchesMetrics

Hashable FindMatchesMetrics Source # 
Instance details

Defined in Amazonka.Glue.Types.FindMatchesMetrics

type Rep FindMatchesMetrics Source # 
Instance details

Defined in Amazonka.Glue.Types.FindMatchesMetrics

type Rep FindMatchesMetrics = D1 ('MetaData "FindMatchesMetrics" "Amazonka.Glue.Types.FindMatchesMetrics" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "FindMatchesMetrics'" 'PrefixI 'True) ((S1 ('MetaSel ('Just "areaUnderPRCurve") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Double)) :*: (S1 ('MetaSel ('Just "columnImportances") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe [ColumnImportance])) :*: S1 ('MetaSel ('Just "confusionMatrix") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe ConfusionMatrix)))) :*: (S1 ('MetaSel ('Just "f1") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Double)) :*: (S1 ('MetaSel ('Just "precision") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Double)) :*: S1 ('MetaSel ('Just "recall") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Double))))))

newFindMatchesMetrics :: FindMatchesMetrics Source #

Create a value of FindMatchesMetrics with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:areaUnderPRCurve:FindMatchesMetrics', findMatchesMetrics_areaUnderPRCurve - The area under the precision/recall curve (AUPRC) is a single number measuring the overall quality of the transform, that is independent of the choice made for precision vs. recall. Higher values indicate that you have a more attractive precision vs. recall tradeoff.

For more information, see Precision and recall in Wikipedia.

$sel:columnImportances:FindMatchesMetrics', findMatchesMetrics_columnImportances - A list of ColumnImportance structures containing column importance metrics, sorted in order of descending importance.

$sel:confusionMatrix:FindMatchesMetrics', findMatchesMetrics_confusionMatrix - The confusion matrix shows you what your transform is predicting accurately and what types of errors it is making.

For more information, see Confusion matrix in Wikipedia.

$sel:f1:FindMatchesMetrics', findMatchesMetrics_f1 - The maximum F1 metric indicates the transform's accuracy between 0 and 1, where 1 is the best accuracy.

For more information, see F1 score in Wikipedia.

$sel:precision:FindMatchesMetrics', findMatchesMetrics_precision - The precision metric indicates when often your transform is correct when it predicts a match. Specifically, it measures how well the transform finds true positives from the total true positives possible.

For more information, see Precision and recall in Wikipedia.

$sel:recall:FindMatchesMetrics', findMatchesMetrics_recall - The recall metric indicates that for an actual match, how often your transform predicts the match. Specifically, it measures how well the transform finds true positives from the total records in the source data.

For more information, see Precision and recall in Wikipedia.

findMatchesMetrics_areaUnderPRCurve :: Lens' FindMatchesMetrics (Maybe Double) Source #

The area under the precision/recall curve (AUPRC) is a single number measuring the overall quality of the transform, that is independent of the choice made for precision vs. recall. Higher values indicate that you have a more attractive precision vs. recall tradeoff.

For more information, see Precision and recall in Wikipedia.

findMatchesMetrics_columnImportances :: Lens' FindMatchesMetrics (Maybe [ColumnImportance]) Source #

A list of ColumnImportance structures containing column importance metrics, sorted in order of descending importance.

findMatchesMetrics_confusionMatrix :: Lens' FindMatchesMetrics (Maybe ConfusionMatrix) Source #

The confusion matrix shows you what your transform is predicting accurately and what types of errors it is making.

For more information, see Confusion matrix in Wikipedia.

findMatchesMetrics_f1 :: Lens' FindMatchesMetrics (Maybe Double) Source #

The maximum F1 metric indicates the transform's accuracy between 0 and 1, where 1 is the best accuracy.

For more information, see F1 score in Wikipedia.

findMatchesMetrics_precision :: Lens' FindMatchesMetrics (Maybe Double) Source #

The precision metric indicates when often your transform is correct when it predicts a match. Specifically, it measures how well the transform finds true positives from the total true positives possible.

For more information, see Precision and recall in Wikipedia.

findMatchesMetrics_recall :: Lens' FindMatchesMetrics (Maybe Double) Source #

The recall metric indicates that for an actual match, how often your transform predicts the match. Specifically, it measures how well the transform finds true positives from the total records in the source data.

For more information, see Precision and recall in Wikipedia.

FindMatchesParameters

data FindMatchesParameters Source #

The parameters to configure the find matches transform.

See: newFindMatchesParameters smart constructor.

Constructors

FindMatchesParameters' 

Fields

  • accuracyCostTradeoff :: Maybe Double

    The value that is selected when tuning your transform for a balance between accuracy and cost. A value of 0.5 means that the system balances accuracy and cost concerns. A value of 1.0 means a bias purely for accuracy, which typically results in a higher cost, sometimes substantially higher. A value of 0.0 means a bias purely for cost, which results in a less accurate FindMatches transform, sometimes with unacceptable accuracy.

    Accuracy measures how well the transform finds true positives and true negatives. Increasing accuracy requires more machine resources and cost. But it also results in increased recall.

    Cost measures how many compute resources, and thus money, are consumed to run the transform.

  • enforceProvidedLabels :: Maybe Bool

    The value to switch on or off to force the output to match the provided labels from users. If the value is True, the find matches transform forces the output to match the provided labels. The results override the normal conflation results. If the value is False, the find matches transform does not ensure all the labels provided are respected, and the results rely on the trained model.

    Note that setting this value to true may increase the conflation execution time.

  • precisionRecallTradeoff :: Maybe Double

    The value selected when tuning your transform for a balance between precision and recall. A value of 0.5 means no preference; a value of 1.0 means a bias purely for precision, and a value of 0.0 means a bias for recall. Because this is a tradeoff, choosing values close to 1.0 means very low recall, and choosing values close to 0.0 results in very low precision.

    The precision metric indicates how often your model is correct when it predicts a match.

    The recall metric indicates that for an actual match, how often your model predicts the match.

  • primaryKeyColumnName :: Maybe Text

    The name of a column that uniquely identifies rows in the source table. Used to help identify matching records.

Instances

Instances details
FromJSON FindMatchesParameters Source # 
Instance details

Defined in Amazonka.Glue.Types.FindMatchesParameters

ToJSON FindMatchesParameters Source # 
Instance details

Defined in Amazonka.Glue.Types.FindMatchesParameters

Generic FindMatchesParameters Source # 
Instance details

Defined in Amazonka.Glue.Types.FindMatchesParameters

Associated Types

type Rep FindMatchesParameters :: Type -> Type #

Read FindMatchesParameters Source # 
Instance details

Defined in Amazonka.Glue.Types.FindMatchesParameters

Show FindMatchesParameters Source # 
Instance details

Defined in Amazonka.Glue.Types.FindMatchesParameters

NFData FindMatchesParameters Source # 
Instance details

Defined in Amazonka.Glue.Types.FindMatchesParameters

Methods

rnf :: FindMatchesParameters -> () #

Eq FindMatchesParameters Source # 
Instance details

Defined in Amazonka.Glue.Types.FindMatchesParameters

Hashable FindMatchesParameters Source # 
Instance details

Defined in Amazonka.Glue.Types.FindMatchesParameters

type Rep FindMatchesParameters Source # 
Instance details

Defined in Amazonka.Glue.Types.FindMatchesParameters

type Rep FindMatchesParameters = D1 ('MetaData "FindMatchesParameters" "Amazonka.Glue.Types.FindMatchesParameters" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "FindMatchesParameters'" 'PrefixI 'True) ((S1 ('MetaSel ('Just "accuracyCostTradeoff") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Double)) :*: S1 ('MetaSel ('Just "enforceProvidedLabels") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Bool))) :*: (S1 ('MetaSel ('Just "precisionRecallTradeoff") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Double)) :*: S1 ('MetaSel ('Just "primaryKeyColumnName") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)))))

newFindMatchesParameters :: FindMatchesParameters Source #

Create a value of FindMatchesParameters with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:accuracyCostTradeoff:FindMatchesParameters', findMatchesParameters_accuracyCostTradeoff - The value that is selected when tuning your transform for a balance between accuracy and cost. A value of 0.5 means that the system balances accuracy and cost concerns. A value of 1.0 means a bias purely for accuracy, which typically results in a higher cost, sometimes substantially higher. A value of 0.0 means a bias purely for cost, which results in a less accurate FindMatches transform, sometimes with unacceptable accuracy.

Accuracy measures how well the transform finds true positives and true negatives. Increasing accuracy requires more machine resources and cost. But it also results in increased recall.

Cost measures how many compute resources, and thus money, are consumed to run the transform.

$sel:enforceProvidedLabels:FindMatchesParameters', findMatchesParameters_enforceProvidedLabels - The value to switch on or off to force the output to match the provided labels from users. If the value is True, the find matches transform forces the output to match the provided labels. The results override the normal conflation results. If the value is False, the find matches transform does not ensure all the labels provided are respected, and the results rely on the trained model.

Note that setting this value to true may increase the conflation execution time.

$sel:precisionRecallTradeoff:FindMatchesParameters', findMatchesParameters_precisionRecallTradeoff - The value selected when tuning your transform for a balance between precision and recall. A value of 0.5 means no preference; a value of 1.0 means a bias purely for precision, and a value of 0.0 means a bias for recall. Because this is a tradeoff, choosing values close to 1.0 means very low recall, and choosing values close to 0.0 results in very low precision.

The precision metric indicates how often your model is correct when it predicts a match.

The recall metric indicates that for an actual match, how often your model predicts the match.

$sel:primaryKeyColumnName:FindMatchesParameters', findMatchesParameters_primaryKeyColumnName - The name of a column that uniquely identifies rows in the source table. Used to help identify matching records.

findMatchesParameters_accuracyCostTradeoff :: Lens' FindMatchesParameters (Maybe Double) Source #

The value that is selected when tuning your transform for a balance between accuracy and cost. A value of 0.5 means that the system balances accuracy and cost concerns. A value of 1.0 means a bias purely for accuracy, which typically results in a higher cost, sometimes substantially higher. A value of 0.0 means a bias purely for cost, which results in a less accurate FindMatches transform, sometimes with unacceptable accuracy.

Accuracy measures how well the transform finds true positives and true negatives. Increasing accuracy requires more machine resources and cost. But it also results in increased recall.

Cost measures how many compute resources, and thus money, are consumed to run the transform.

findMatchesParameters_enforceProvidedLabels :: Lens' FindMatchesParameters (Maybe Bool) Source #

The value to switch on or off to force the output to match the provided labels from users. If the value is True, the find matches transform forces the output to match the provided labels. The results override the normal conflation results. If the value is False, the find matches transform does not ensure all the labels provided are respected, and the results rely on the trained model.

Note that setting this value to true may increase the conflation execution time.

findMatchesParameters_precisionRecallTradeoff :: Lens' FindMatchesParameters (Maybe Double) Source #

The value selected when tuning your transform for a balance between precision and recall. A value of 0.5 means no preference; a value of 1.0 means a bias purely for precision, and a value of 0.0 means a bias for recall. Because this is a tradeoff, choosing values close to 1.0 means very low recall, and choosing values close to 0.0 results in very low precision.

The precision metric indicates how often your model is correct when it predicts a match.

The recall metric indicates that for an actual match, how often your model predicts the match.

findMatchesParameters_primaryKeyColumnName :: Lens' FindMatchesParameters (Maybe Text) Source #

The name of a column that uniquely identifies rows in the source table. Used to help identify matching records.

FindMatchesTaskRunProperties

data FindMatchesTaskRunProperties Source #

Specifies configuration properties for a Find Matches task run.

See: newFindMatchesTaskRunProperties smart constructor.

Constructors

FindMatchesTaskRunProperties' 

Fields

Instances

Instances details
FromJSON FindMatchesTaskRunProperties Source # 
Instance details

Defined in Amazonka.Glue.Types.FindMatchesTaskRunProperties

Generic FindMatchesTaskRunProperties Source # 
Instance details

Defined in Amazonka.Glue.Types.FindMatchesTaskRunProperties

Associated Types

type Rep FindMatchesTaskRunProperties :: Type -> Type #

Read FindMatchesTaskRunProperties Source # 
Instance details

Defined in Amazonka.Glue.Types.FindMatchesTaskRunProperties

Show FindMatchesTaskRunProperties Source # 
Instance details

Defined in Amazonka.Glue.Types.FindMatchesTaskRunProperties

NFData FindMatchesTaskRunProperties Source # 
Instance details

Defined in Amazonka.Glue.Types.FindMatchesTaskRunProperties

Eq FindMatchesTaskRunProperties Source # 
Instance details

Defined in Amazonka.Glue.Types.FindMatchesTaskRunProperties

Hashable FindMatchesTaskRunProperties Source # 
Instance details

Defined in Amazonka.Glue.Types.FindMatchesTaskRunProperties

type Rep FindMatchesTaskRunProperties Source # 
Instance details

Defined in Amazonka.Glue.Types.FindMatchesTaskRunProperties

type Rep FindMatchesTaskRunProperties = D1 ('MetaData "FindMatchesTaskRunProperties" "Amazonka.Glue.Types.FindMatchesTaskRunProperties" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "FindMatchesTaskRunProperties'" 'PrefixI 'True) (S1 ('MetaSel ('Just "jobId") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: (S1 ('MetaSel ('Just "jobName") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "jobRunId") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)))))

newFindMatchesTaskRunProperties :: FindMatchesTaskRunProperties Source #

Create a value of FindMatchesTaskRunProperties with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:jobId:FindMatchesTaskRunProperties', findMatchesTaskRunProperties_jobId - The job ID for the Find Matches task run.

$sel:jobName:FindMatchesTaskRunProperties', findMatchesTaskRunProperties_jobName - The name assigned to the job for the Find Matches task run.

$sel:jobRunId:FindMatchesTaskRunProperties', findMatchesTaskRunProperties_jobRunId - The job run ID for the Find Matches task run.

findMatchesTaskRunProperties_jobName :: Lens' FindMatchesTaskRunProperties (Maybe Text) Source #

The name assigned to the job for the Find Matches task run.

GetConnectionsFilter

data GetConnectionsFilter Source #

Filters the connection definitions that are returned by the GetConnections API operation.

See: newGetConnectionsFilter smart constructor.

Constructors

GetConnectionsFilter' 

Fields

Instances

Instances details
ToJSON GetConnectionsFilter Source # 
Instance details

Defined in Amazonka.Glue.Types.GetConnectionsFilter

Generic GetConnectionsFilter Source # 
Instance details

Defined in Amazonka.Glue.Types.GetConnectionsFilter

Associated Types

type Rep GetConnectionsFilter :: Type -> Type #

Read GetConnectionsFilter Source # 
Instance details

Defined in Amazonka.Glue.Types.GetConnectionsFilter

Show GetConnectionsFilter Source # 
Instance details

Defined in Amazonka.Glue.Types.GetConnectionsFilter

NFData GetConnectionsFilter Source # 
Instance details

Defined in Amazonka.Glue.Types.GetConnectionsFilter

Methods

rnf :: GetConnectionsFilter -> () #

Eq GetConnectionsFilter Source # 
Instance details

Defined in Amazonka.Glue.Types.GetConnectionsFilter

Hashable GetConnectionsFilter Source # 
Instance details

Defined in Amazonka.Glue.Types.GetConnectionsFilter

type Rep GetConnectionsFilter Source # 
Instance details

Defined in Amazonka.Glue.Types.GetConnectionsFilter

type Rep GetConnectionsFilter = D1 ('MetaData "GetConnectionsFilter" "Amazonka.Glue.Types.GetConnectionsFilter" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "GetConnectionsFilter'" 'PrefixI 'True) (S1 ('MetaSel ('Just "connectionType") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe ConnectionType)) :*: S1 ('MetaSel ('Just "matchCriteria") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe [Text]))))

newGetConnectionsFilter :: GetConnectionsFilter Source #

Create a value of GetConnectionsFilter with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:connectionType:GetConnectionsFilter', getConnectionsFilter_connectionType - The type of connections to return. Currently, SFTP is not supported.

$sel:matchCriteria:GetConnectionsFilter', getConnectionsFilter_matchCriteria - A criteria string that must match the criteria recorded in the connection definition for that connection definition to be returned.

getConnectionsFilter_connectionType :: Lens' GetConnectionsFilter (Maybe ConnectionType) Source #

The type of connections to return. Currently, SFTP is not supported.

getConnectionsFilter_matchCriteria :: Lens' GetConnectionsFilter (Maybe [Text]) Source #

A criteria string that must match the criteria recorded in the connection definition for that connection definition to be returned.

GluePolicy

data GluePolicy Source #

A structure for returning a resource policy.

See: newGluePolicy smart constructor.

Constructors

GluePolicy' 

Fields

Instances

Instances details
FromJSON GluePolicy Source # 
Instance details

Defined in Amazonka.Glue.Types.GluePolicy

Generic GluePolicy Source # 
Instance details

Defined in Amazonka.Glue.Types.GluePolicy

Associated Types

type Rep GluePolicy :: Type -> Type #

Read GluePolicy Source # 
Instance details

Defined in Amazonka.Glue.Types.GluePolicy

Show GluePolicy Source # 
Instance details

Defined in Amazonka.Glue.Types.GluePolicy

NFData GluePolicy Source # 
Instance details

Defined in Amazonka.Glue.Types.GluePolicy

Methods

rnf :: GluePolicy -> () #

Eq GluePolicy Source # 
Instance details

Defined in Amazonka.Glue.Types.GluePolicy

Hashable GluePolicy Source # 
Instance details

Defined in Amazonka.Glue.Types.GluePolicy

type Rep GluePolicy Source # 
Instance details

Defined in Amazonka.Glue.Types.GluePolicy

type Rep GluePolicy = D1 ('MetaData "GluePolicy" "Amazonka.Glue.Types.GluePolicy" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "GluePolicy'" 'PrefixI 'True) ((S1 ('MetaSel ('Just "createTime") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe POSIX)) :*: S1 ('MetaSel ('Just "policyHash") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text))) :*: (S1 ('MetaSel ('Just "policyInJson") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "updateTime") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe POSIX)))))

newGluePolicy :: GluePolicy Source #

Create a value of GluePolicy with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:createTime:GluePolicy', gluePolicy_createTime - The date and time at which the policy was created.

$sel:policyHash:GluePolicy', gluePolicy_policyHash - Contains the hash value associated with this policy.

$sel:policyInJson:GluePolicy', gluePolicy_policyInJson - Contains the requested policy document, in JSON format.

$sel:updateTime:GluePolicy', gluePolicy_updateTime - The date and time at which the policy was last updated.

gluePolicy_createTime :: Lens' GluePolicy (Maybe UTCTime) Source #

The date and time at which the policy was created.

gluePolicy_policyHash :: Lens' GluePolicy (Maybe Text) Source #

Contains the hash value associated with this policy.

gluePolicy_policyInJson :: Lens' GluePolicy (Maybe Text) Source #

Contains the requested policy document, in JSON format.

gluePolicy_updateTime :: Lens' GluePolicy (Maybe UTCTime) Source #

The date and time at which the policy was last updated.

GlueSchema

data GlueSchema Source #

Specifies a user-defined schema when a schema cannot be determined by Glue.

See: newGlueSchema smart constructor.

Constructors

GlueSchema' 

Fields

Instances

Instances details
FromJSON GlueSchema Source # 
Instance details

Defined in Amazonka.Glue.Types.GlueSchema

ToJSON GlueSchema Source # 
Instance details

Defined in Amazonka.Glue.Types.GlueSchema

Generic GlueSchema Source # 
Instance details

Defined in Amazonka.Glue.Types.GlueSchema

Associated Types

type Rep GlueSchema :: Type -> Type #

Read GlueSchema Source # 
Instance details

Defined in Amazonka.Glue.Types.GlueSchema

Show GlueSchema Source # 
Instance details

Defined in Amazonka.Glue.Types.GlueSchema

NFData GlueSchema Source # 
Instance details

Defined in Amazonka.Glue.Types.GlueSchema

Methods

rnf :: GlueSchema -> () #

Eq GlueSchema Source # 
Instance details

Defined in Amazonka.Glue.Types.GlueSchema

Hashable GlueSchema Source # 
Instance details

Defined in Amazonka.Glue.Types.GlueSchema

type Rep GlueSchema Source # 
Instance details

Defined in Amazonka.Glue.Types.GlueSchema

type Rep GlueSchema = D1 ('MetaData "GlueSchema" "Amazonka.Glue.Types.GlueSchema" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "GlueSchema'" 'PrefixI 'True) (S1 ('MetaSel ('Just "columns") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe [GlueStudioSchemaColumn]))))

newGlueSchema :: GlueSchema Source #

Create a value of GlueSchema with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:columns:GlueSchema', glueSchema_columns - Specifies the column definitions that make up a Glue schema.

glueSchema_columns :: Lens' GlueSchema (Maybe [GlueStudioSchemaColumn]) Source #

Specifies the column definitions that make up a Glue schema.

GlueStudioSchemaColumn

data GlueStudioSchemaColumn Source #

Specifies a single column in a Glue schema definition.

See: newGlueStudioSchemaColumn smart constructor.

Constructors

GlueStudioSchemaColumn' 

Fields

  • type' :: Maybe Text

    The hive type for this column in the Glue Studio schema.

  • name :: Text

    The name of the column in the Glue Studio schema.

Instances

Instances details
FromJSON GlueStudioSchemaColumn Source # 
Instance details

Defined in Amazonka.Glue.Types.GlueStudioSchemaColumn

ToJSON GlueStudioSchemaColumn Source # 
Instance details

Defined in Amazonka.Glue.Types.GlueStudioSchemaColumn

Generic GlueStudioSchemaColumn Source # 
Instance details

Defined in Amazonka.Glue.Types.GlueStudioSchemaColumn

Associated Types

type Rep GlueStudioSchemaColumn :: Type -> Type #

Read GlueStudioSchemaColumn Source # 
Instance details

Defined in Amazonka.Glue.Types.GlueStudioSchemaColumn

Show GlueStudioSchemaColumn Source # 
Instance details

Defined in Amazonka.Glue.Types.GlueStudioSchemaColumn

NFData GlueStudioSchemaColumn Source # 
Instance details

Defined in Amazonka.Glue.Types.GlueStudioSchemaColumn

Methods

rnf :: GlueStudioSchemaColumn -> () #

Eq GlueStudioSchemaColumn Source # 
Instance details

Defined in Amazonka.Glue.Types.GlueStudioSchemaColumn

Hashable GlueStudioSchemaColumn Source # 
Instance details

Defined in Amazonka.Glue.Types.GlueStudioSchemaColumn

type Rep GlueStudioSchemaColumn Source # 
Instance details

Defined in Amazonka.Glue.Types.GlueStudioSchemaColumn

type Rep GlueStudioSchemaColumn = D1 ('MetaData "GlueStudioSchemaColumn" "Amazonka.Glue.Types.GlueStudioSchemaColumn" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "GlueStudioSchemaColumn'" 'PrefixI 'True) (S1 ('MetaSel ('Just "type'") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "name") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text)))

newGlueStudioSchemaColumn Source #

Create a value of GlueStudioSchemaColumn with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:type':GlueStudioSchemaColumn', glueStudioSchemaColumn_type - The hive type for this column in the Glue Studio schema.

$sel:name:GlueStudioSchemaColumn', glueStudioSchemaColumn_name - The name of the column in the Glue Studio schema.

glueStudioSchemaColumn_type :: Lens' GlueStudioSchemaColumn (Maybe Text) Source #

The hive type for this column in the Glue Studio schema.

glueStudioSchemaColumn_name :: Lens' GlueStudioSchemaColumn Text Source #

The name of the column in the Glue Studio schema.

GlueTable

data GlueTable Source #

The database and table in the Glue Data Catalog that is used for input or output data.

See: newGlueTable smart constructor.

Constructors

GlueTable' 

Fields

  • additionalOptions :: Maybe (HashMap Text Text)

    Additional options for the table. Currently there are two keys supported:

    • pushDownPredicate: to filter on partitions without having to list and read all the files in your dataset.
    • catalogPartitionPredicate: to use server-side partition pruning using partition indexes in the Glue Data Catalog.
  • catalogId :: Maybe Text

    A unique identifier for the Glue Data Catalog.

  • connectionName :: Maybe Text

    The name of the connection to the Glue Data Catalog.

  • databaseName :: Text

    A database name in the Glue Data Catalog.

  • tableName :: Text

    A table name in the Glue Data Catalog.

Instances

Instances details
FromJSON GlueTable Source # 
Instance details

Defined in Amazonka.Glue.Types.GlueTable

ToJSON GlueTable Source # 
Instance details

Defined in Amazonka.Glue.Types.GlueTable

Generic GlueTable Source # 
Instance details

Defined in Amazonka.Glue.Types.GlueTable

Associated Types

type Rep GlueTable :: Type -> Type #

Read GlueTable Source # 
Instance details

Defined in Amazonka.Glue.Types.GlueTable

Show GlueTable Source # 
Instance details

Defined in Amazonka.Glue.Types.GlueTable

NFData GlueTable Source # 
Instance details

Defined in Amazonka.Glue.Types.GlueTable

Methods

rnf :: GlueTable -> () #

Eq GlueTable Source # 
Instance details

Defined in Amazonka.Glue.Types.GlueTable

Hashable GlueTable Source # 
Instance details

Defined in Amazonka.Glue.Types.GlueTable

type Rep GlueTable Source # 
Instance details

Defined in Amazonka.Glue.Types.GlueTable

type Rep GlueTable = D1 ('MetaData "GlueTable" "Amazonka.Glue.Types.GlueTable" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "GlueTable'" 'PrefixI 'True) ((S1 ('MetaSel ('Just "additionalOptions") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe (HashMap Text Text))) :*: S1 ('MetaSel ('Just "catalogId") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text))) :*: (S1 ('MetaSel ('Just "connectionName") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: (S1 ('MetaSel ('Just "databaseName") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text) :*: S1 ('MetaSel ('Just "tableName") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text)))))

newGlueTable Source #

Create a value of GlueTable with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:additionalOptions:GlueTable', glueTable_additionalOptions - Additional options for the table. Currently there are two keys supported:

  • pushDownPredicate: to filter on partitions without having to list and read all the files in your dataset.
  • catalogPartitionPredicate: to use server-side partition pruning using partition indexes in the Glue Data Catalog.

$sel:catalogId:GlueTable', glueTable_catalogId - A unique identifier for the Glue Data Catalog.

$sel:connectionName:GlueTable', glueTable_connectionName - The name of the connection to the Glue Data Catalog.

$sel:databaseName:GlueTable', glueTable_databaseName - A database name in the Glue Data Catalog.

$sel:tableName:GlueTable', glueTable_tableName - A table name in the Glue Data Catalog.

glueTable_additionalOptions :: Lens' GlueTable (Maybe (HashMap Text Text)) Source #

Additional options for the table. Currently there are two keys supported:

  • pushDownPredicate: to filter on partitions without having to list and read all the files in your dataset.
  • catalogPartitionPredicate: to use server-side partition pruning using partition indexes in the Glue Data Catalog.

glueTable_catalogId :: Lens' GlueTable (Maybe Text) Source #

A unique identifier for the Glue Data Catalog.

glueTable_connectionName :: Lens' GlueTable (Maybe Text) Source #

The name of the connection to the Glue Data Catalog.

glueTable_databaseName :: Lens' GlueTable Text Source #

A database name in the Glue Data Catalog.

glueTable_tableName :: Lens' GlueTable Text Source #

A table name in the Glue Data Catalog.

GovernedCatalogSource

data GovernedCatalogSource Source #

Specifies the data store in the governed Glue Data Catalog.

See: newGovernedCatalogSource smart constructor.

Constructors

GovernedCatalogSource' 

Fields

Instances

Instances details
FromJSON GovernedCatalogSource Source # 
Instance details

Defined in Amazonka.Glue.Types.GovernedCatalogSource

ToJSON GovernedCatalogSource Source # 
Instance details

Defined in Amazonka.Glue.Types.GovernedCatalogSource

Generic GovernedCatalogSource Source # 
Instance details

Defined in Amazonka.Glue.Types.GovernedCatalogSource

Associated Types

type Rep GovernedCatalogSource :: Type -> Type #

Read GovernedCatalogSource Source # 
Instance details

Defined in Amazonka.Glue.Types.GovernedCatalogSource

Show GovernedCatalogSource Source # 
Instance details

Defined in Amazonka.Glue.Types.GovernedCatalogSource

NFData GovernedCatalogSource Source # 
Instance details

Defined in Amazonka.Glue.Types.GovernedCatalogSource

Methods

rnf :: GovernedCatalogSource -> () #

Eq GovernedCatalogSource Source # 
Instance details

Defined in Amazonka.Glue.Types.GovernedCatalogSource

Hashable GovernedCatalogSource Source # 
Instance details

Defined in Amazonka.Glue.Types.GovernedCatalogSource

type Rep GovernedCatalogSource Source # 
Instance details

Defined in Amazonka.Glue.Types.GovernedCatalogSource

type Rep GovernedCatalogSource = D1 ('MetaData "GovernedCatalogSource" "Amazonka.Glue.Types.GovernedCatalogSource" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "GovernedCatalogSource'" 'PrefixI 'True) ((S1 ('MetaSel ('Just "additionalOptions") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe S3SourceAdditionalOptions)) :*: S1 ('MetaSel ('Just "partitionPredicate") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text))) :*: (S1 ('MetaSel ('Just "name") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text) :*: (S1 ('MetaSel ('Just "database") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text) :*: S1 ('MetaSel ('Just "table") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text)))))

newGovernedCatalogSource Source #

Create a value of GovernedCatalogSource with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:additionalOptions:GovernedCatalogSource', governedCatalogSource_additionalOptions - Specifies additional connection options.

$sel:partitionPredicate:GovernedCatalogSource', governedCatalogSource_partitionPredicate - Partitions satisfying this predicate are deleted. Files within the retention period in these partitions are not deleted. Set to "" – empty by default.

$sel:name:GovernedCatalogSource', governedCatalogSource_name - The name of the data store.

$sel:database:GovernedCatalogSource', governedCatalogSource_database - The database to read from.

$sel:table:GovernedCatalogSource', governedCatalogSource_table - The database table to read from.

governedCatalogSource_partitionPredicate :: Lens' GovernedCatalogSource (Maybe Text) Source #

Partitions satisfying this predicate are deleted. Files within the retention period in these partitions are not deleted. Set to "" – empty by default.

GovernedCatalogTarget

data GovernedCatalogTarget Source #

Specifies a data target that writes to Amazon S3 using the Glue Data Catalog.

See: newGovernedCatalogTarget smart constructor.

Constructors

GovernedCatalogTarget' 

Fields

Instances

Instances details
FromJSON GovernedCatalogTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.GovernedCatalogTarget

ToJSON GovernedCatalogTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.GovernedCatalogTarget

Generic GovernedCatalogTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.GovernedCatalogTarget

Associated Types

type Rep GovernedCatalogTarget :: Type -> Type #

Read GovernedCatalogTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.GovernedCatalogTarget

Show GovernedCatalogTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.GovernedCatalogTarget

NFData GovernedCatalogTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.GovernedCatalogTarget

Methods

rnf :: GovernedCatalogTarget -> () #

Eq GovernedCatalogTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.GovernedCatalogTarget

Hashable GovernedCatalogTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.GovernedCatalogTarget

type Rep GovernedCatalogTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.GovernedCatalogTarget

type Rep GovernedCatalogTarget = D1 ('MetaData "GovernedCatalogTarget" "Amazonka.Glue.Types.GovernedCatalogTarget" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "GovernedCatalogTarget'" 'PrefixI 'True) ((S1 ('MetaSel ('Just "partitionKeys") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe [[Text]])) :*: (S1 ('MetaSel ('Just "schemaChangePolicy") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe CatalogSchemaChangePolicy)) :*: S1 ('MetaSel ('Just "name") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text))) :*: (S1 ('MetaSel ('Just "inputs") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (NonEmpty Text)) :*: (S1 ('MetaSel ('Just "table") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text) :*: S1 ('MetaSel ('Just "database") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text)))))

newGovernedCatalogTarget Source #

Create a value of GovernedCatalogTarget with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:partitionKeys:GovernedCatalogTarget', governedCatalogTarget_partitionKeys - Specifies native partitioning using a sequence of keys.

$sel:schemaChangePolicy:GovernedCatalogTarget', governedCatalogTarget_schemaChangePolicy - A policy that specifies update behavior for the governed catalog.

$sel:name:GovernedCatalogTarget', governedCatalogTarget_name - The name of the data target.

$sel:inputs:GovernedCatalogTarget', governedCatalogTarget_inputs - The nodes that are inputs to the data target.

$sel:table:GovernedCatalogTarget', governedCatalogTarget_table - The name of the table in the database to write to.

$sel:database:GovernedCatalogTarget', governedCatalogTarget_database - The name of the database to write to.

governedCatalogTarget_partitionKeys :: Lens' GovernedCatalogTarget (Maybe [[Text]]) Source #

Specifies native partitioning using a sequence of keys.

governedCatalogTarget_schemaChangePolicy :: Lens' GovernedCatalogTarget (Maybe CatalogSchemaChangePolicy) Source #

A policy that specifies update behavior for the governed catalog.

governedCatalogTarget_inputs :: Lens' GovernedCatalogTarget (NonEmpty Text) Source #

The nodes that are inputs to the data target.

governedCatalogTarget_table :: Lens' GovernedCatalogTarget Text Source #

The name of the table in the database to write to.

governedCatalogTarget_database :: Lens' GovernedCatalogTarget Text Source #

The name of the database to write to.

GrokClassifier

data GrokClassifier Source #

A classifier that uses grok patterns.

See: newGrokClassifier smart constructor.

Constructors

GrokClassifier' 

Fields

Instances

Instances details
FromJSON GrokClassifier Source # 
Instance details

Defined in Amazonka.Glue.Types.GrokClassifier

Generic GrokClassifier Source # 
Instance details

Defined in Amazonka.Glue.Types.GrokClassifier

Associated Types

type Rep GrokClassifier :: Type -> Type #

Read GrokClassifier Source # 
Instance details

Defined in Amazonka.Glue.Types.GrokClassifier

Show GrokClassifier Source # 
Instance details

Defined in Amazonka.Glue.Types.GrokClassifier

NFData GrokClassifier Source # 
Instance details

Defined in Amazonka.Glue.Types.GrokClassifier

Methods

rnf :: GrokClassifier -> () #

Eq GrokClassifier Source # 
Instance details

Defined in Amazonka.Glue.Types.GrokClassifier

Hashable GrokClassifier Source # 
Instance details

Defined in Amazonka.Glue.Types.GrokClassifier

type Rep GrokClassifier Source # 
Instance details

Defined in Amazonka.Glue.Types.GrokClassifier

newGrokClassifier Source #

Create a value of GrokClassifier with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:creationTime:GrokClassifier', grokClassifier_creationTime - The time that this classifier was registered.

$sel:customPatterns:GrokClassifier', grokClassifier_customPatterns - Optional custom grok patterns defined by this classifier. For more information, see custom patterns in Writing Custom Classifiers.

$sel:lastUpdated:GrokClassifier', grokClassifier_lastUpdated - The time that this classifier was last updated.

$sel:version:GrokClassifier', grokClassifier_version - The version of this classifier.

$sel:name:GrokClassifier', grokClassifier_name - The name of the classifier.

$sel:classification:GrokClassifier', grokClassifier_classification - An identifier of the data format that the classifier matches, such as Twitter, JSON, Omniture logs, and so on.

$sel:grokPattern:GrokClassifier', grokClassifier_grokPattern - The grok pattern applied to a data store by this classifier. For more information, see built-in patterns in Writing Custom Classifiers.

grokClassifier_creationTime :: Lens' GrokClassifier (Maybe UTCTime) Source #

The time that this classifier was registered.

grokClassifier_customPatterns :: Lens' GrokClassifier (Maybe Text) Source #

Optional custom grok patterns defined by this classifier. For more information, see custom patterns in Writing Custom Classifiers.

grokClassifier_lastUpdated :: Lens' GrokClassifier (Maybe UTCTime) Source #

The time that this classifier was last updated.

grokClassifier_version :: Lens' GrokClassifier (Maybe Integer) Source #

The version of this classifier.

grokClassifier_name :: Lens' GrokClassifier Text Source #

The name of the classifier.

grokClassifier_classification :: Lens' GrokClassifier Text Source #

An identifier of the data format that the classifier matches, such as Twitter, JSON, Omniture logs, and so on.

grokClassifier_grokPattern :: Lens' GrokClassifier Text Source #

The grok pattern applied to a data store by this classifier. For more information, see built-in patterns in Writing Custom Classifiers.

ImportLabelsTaskRunProperties

data ImportLabelsTaskRunProperties Source #

Specifies configuration properties for an importing labels task run.

See: newImportLabelsTaskRunProperties smart constructor.

Constructors

ImportLabelsTaskRunProperties' 

Fields

  • inputS3Path :: Maybe Text

    The Amazon Simple Storage Service (Amazon S3) path from where you will import the labels.

  • replace :: Maybe Bool

    Indicates whether to overwrite your existing labels.

Instances

Instances details
FromJSON ImportLabelsTaskRunProperties Source # 
Instance details

Defined in Amazonka.Glue.Types.ImportLabelsTaskRunProperties

Generic ImportLabelsTaskRunProperties Source # 
Instance details

Defined in Amazonka.Glue.Types.ImportLabelsTaskRunProperties

Associated Types

type Rep ImportLabelsTaskRunProperties :: Type -> Type #

Read ImportLabelsTaskRunProperties Source # 
Instance details

Defined in Amazonka.Glue.Types.ImportLabelsTaskRunProperties

Show ImportLabelsTaskRunProperties Source # 
Instance details

Defined in Amazonka.Glue.Types.ImportLabelsTaskRunProperties

NFData ImportLabelsTaskRunProperties Source # 
Instance details

Defined in Amazonka.Glue.Types.ImportLabelsTaskRunProperties

Eq ImportLabelsTaskRunProperties Source # 
Instance details

Defined in Amazonka.Glue.Types.ImportLabelsTaskRunProperties

Hashable ImportLabelsTaskRunProperties Source # 
Instance details

Defined in Amazonka.Glue.Types.ImportLabelsTaskRunProperties

type Rep ImportLabelsTaskRunProperties Source # 
Instance details

Defined in Amazonka.Glue.Types.ImportLabelsTaskRunProperties

type Rep ImportLabelsTaskRunProperties = D1 ('MetaData "ImportLabelsTaskRunProperties" "Amazonka.Glue.Types.ImportLabelsTaskRunProperties" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "ImportLabelsTaskRunProperties'" 'PrefixI 'True) (S1 ('MetaSel ('Just "inputS3Path") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "replace") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Bool))))

newImportLabelsTaskRunProperties :: ImportLabelsTaskRunProperties Source #

Create a value of ImportLabelsTaskRunProperties with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:inputS3Path:ImportLabelsTaskRunProperties', importLabelsTaskRunProperties_inputS3Path - The Amazon Simple Storage Service (Amazon S3) path from where you will import the labels.

$sel:replace:ImportLabelsTaskRunProperties', importLabelsTaskRunProperties_replace - Indicates whether to overwrite your existing labels.

importLabelsTaskRunProperties_inputS3Path :: Lens' ImportLabelsTaskRunProperties (Maybe Text) Source #

The Amazon Simple Storage Service (Amazon S3) path from where you will import the labels.

importLabelsTaskRunProperties_replace :: Lens' ImportLabelsTaskRunProperties (Maybe Bool) Source #

Indicates whether to overwrite your existing labels.

JDBCConnectorOptions

data JDBCConnectorOptions Source #

Additional connection options for the connector.

See: newJDBCConnectorOptions smart constructor.

Constructors

JDBCConnectorOptions' 

Fields

  • dataTypeMapping :: Maybe (HashMap JDBCDataType GlueRecordType)

    Custom data type mapping that builds a mapping from a JDBC data type to an Glue data type. For example, the option "dataTypeMapping":{"FLOAT":"STRING"} maps data fields of JDBC type FLOAT into the Java String type by calling the ResultSet.getString() method of the driver, and uses it to build the Glue record. The ResultSet object is implemented by each driver, so the behavior is specific to the driver you use. Refer to the documentation for your JDBC driver to understand how the driver performs the conversions.

  • filterPredicate :: Maybe Text

    Extra condition clause to filter data from source. For example:

    BillingCity='Mountain View'

    When using a query instead of a table name, you should validate that the query works with the specified filterPredicate.

  • jobBookmarkKeys :: Maybe [Text]

    The name of the job bookmark keys on which to sort.

  • jobBookmarkKeysSortOrder :: Maybe Text

    Specifies an ascending or descending sort order.

  • lowerBound :: Maybe Natural

    The minimum value of partitionColumn that is used to decide partition stride.

  • numPartitions :: Maybe Natural

    The number of partitions. This value, along with lowerBound (inclusive) and upperBound (exclusive), form partition strides for generated WHERE clause expressions that are used to split the partitionColumn.

  • partitionColumn :: Maybe Text

    The name of an integer column that is used for partitioning. This option works only when it's included with lowerBound, upperBound, and numPartitions. This option works the same way as in the Spark SQL JDBC reader.

  • upperBound :: Maybe Natural

    The maximum value of partitionColumn that is used to decide partition stride.

Instances

Instances details
FromJSON JDBCConnectorOptions Source # 
Instance details

Defined in Amazonka.Glue.Types.JDBCConnectorOptions

ToJSON JDBCConnectorOptions Source # 
Instance details

Defined in Amazonka.Glue.Types.JDBCConnectorOptions

Generic JDBCConnectorOptions Source # 
Instance details

Defined in Amazonka.Glue.Types.JDBCConnectorOptions

Associated Types

type Rep JDBCConnectorOptions :: Type -> Type #

Read JDBCConnectorOptions Source # 
Instance details

Defined in Amazonka.Glue.Types.JDBCConnectorOptions

Show JDBCConnectorOptions Source # 
Instance details

Defined in Amazonka.Glue.Types.JDBCConnectorOptions

NFData JDBCConnectorOptions Source # 
Instance details

Defined in Amazonka.Glue.Types.JDBCConnectorOptions

Methods

rnf :: JDBCConnectorOptions -> () #

Eq JDBCConnectorOptions Source # 
Instance details

Defined in Amazonka.Glue.Types.JDBCConnectorOptions

Hashable JDBCConnectorOptions Source # 
Instance details

Defined in Amazonka.Glue.Types.JDBCConnectorOptions

type Rep JDBCConnectorOptions Source # 
Instance details

Defined in Amazonka.Glue.Types.JDBCConnectorOptions

type Rep JDBCConnectorOptions = D1 ('MetaData "JDBCConnectorOptions" "Amazonka.Glue.Types.JDBCConnectorOptions" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "JDBCConnectorOptions'" 'PrefixI 'True) (((S1 ('MetaSel ('Just "dataTypeMapping") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe (HashMap JDBCDataType GlueRecordType))) :*: S1 ('MetaSel ('Just "filterPredicate") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text))) :*: (S1 ('MetaSel ('Just "jobBookmarkKeys") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe [Text])) :*: S1 ('MetaSel ('Just "jobBookmarkKeysSortOrder") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)))) :*: ((S1 ('MetaSel ('Just "lowerBound") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Natural)) :*: S1 ('MetaSel ('Just "numPartitions") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Natural))) :*: (S1 ('MetaSel ('Just "partitionColumn") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "upperBound") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Natural))))))

newJDBCConnectorOptions :: JDBCConnectorOptions Source #

Create a value of JDBCConnectorOptions with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:dataTypeMapping:JDBCConnectorOptions', jDBCConnectorOptions_dataTypeMapping - Custom data type mapping that builds a mapping from a JDBC data type to an Glue data type. For example, the option "dataTypeMapping":{"FLOAT":"STRING"} maps data fields of JDBC type FLOAT into the Java String type by calling the ResultSet.getString() method of the driver, and uses it to build the Glue record. The ResultSet object is implemented by each driver, so the behavior is specific to the driver you use. Refer to the documentation for your JDBC driver to understand how the driver performs the conversions.

$sel:filterPredicate:JDBCConnectorOptions', jDBCConnectorOptions_filterPredicate - Extra condition clause to filter data from source. For example:

BillingCity='Mountain View'

When using a query instead of a table name, you should validate that the query works with the specified filterPredicate.

$sel:jobBookmarkKeys:JDBCConnectorOptions', jDBCConnectorOptions_jobBookmarkKeys - The name of the job bookmark keys on which to sort.

$sel:jobBookmarkKeysSortOrder:JDBCConnectorOptions', jDBCConnectorOptions_jobBookmarkKeysSortOrder - Specifies an ascending or descending sort order.

$sel:lowerBound:JDBCConnectorOptions', jDBCConnectorOptions_lowerBound - The minimum value of partitionColumn that is used to decide partition stride.

$sel:numPartitions:JDBCConnectorOptions', jDBCConnectorOptions_numPartitions - The number of partitions. This value, along with lowerBound (inclusive) and upperBound (exclusive), form partition strides for generated WHERE clause expressions that are used to split the partitionColumn.

$sel:partitionColumn:JDBCConnectorOptions', jDBCConnectorOptions_partitionColumn - The name of an integer column that is used for partitioning. This option works only when it's included with lowerBound, upperBound, and numPartitions. This option works the same way as in the Spark SQL JDBC reader.

$sel:upperBound:JDBCConnectorOptions', jDBCConnectorOptions_upperBound - The maximum value of partitionColumn that is used to decide partition stride.

jDBCConnectorOptions_dataTypeMapping :: Lens' JDBCConnectorOptions (Maybe (HashMap JDBCDataType GlueRecordType)) Source #

Custom data type mapping that builds a mapping from a JDBC data type to an Glue data type. For example, the option "dataTypeMapping":{"FLOAT":"STRING"} maps data fields of JDBC type FLOAT into the Java String type by calling the ResultSet.getString() method of the driver, and uses it to build the Glue record. The ResultSet object is implemented by each driver, so the behavior is specific to the driver you use. Refer to the documentation for your JDBC driver to understand how the driver performs the conversions.

jDBCConnectorOptions_filterPredicate :: Lens' JDBCConnectorOptions (Maybe Text) Source #

Extra condition clause to filter data from source. For example:

BillingCity='Mountain View'

When using a query instead of a table name, you should validate that the query works with the specified filterPredicate.

jDBCConnectorOptions_jobBookmarkKeys :: Lens' JDBCConnectorOptions (Maybe [Text]) Source #

The name of the job bookmark keys on which to sort.

jDBCConnectorOptions_jobBookmarkKeysSortOrder :: Lens' JDBCConnectorOptions (Maybe Text) Source #

Specifies an ascending or descending sort order.

jDBCConnectorOptions_lowerBound :: Lens' JDBCConnectorOptions (Maybe Natural) Source #

The minimum value of partitionColumn that is used to decide partition stride.

jDBCConnectorOptions_numPartitions :: Lens' JDBCConnectorOptions (Maybe Natural) Source #

The number of partitions. This value, along with lowerBound (inclusive) and upperBound (exclusive), form partition strides for generated WHERE clause expressions that are used to split the partitionColumn.

jDBCConnectorOptions_partitionColumn :: Lens' JDBCConnectorOptions (Maybe Text) Source #

The name of an integer column that is used for partitioning. This option works only when it's included with lowerBound, upperBound, and numPartitions. This option works the same way as in the Spark SQL JDBC reader.

jDBCConnectorOptions_upperBound :: Lens' JDBCConnectorOptions (Maybe Natural) Source #

The maximum value of partitionColumn that is used to decide partition stride.

JDBCConnectorSource

data JDBCConnectorSource Source #

Specifies a connector to a JDBC data source.

See: newJDBCConnectorSource smart constructor.

Constructors

JDBCConnectorSource' 

Fields

Instances

Instances details
FromJSON JDBCConnectorSource Source # 
Instance details

Defined in Amazonka.Glue.Types.JDBCConnectorSource

ToJSON JDBCConnectorSource Source # 
Instance details

Defined in Amazonka.Glue.Types.JDBCConnectorSource

Generic JDBCConnectorSource Source # 
Instance details

Defined in Amazonka.Glue.Types.JDBCConnectorSource

Associated Types

type Rep JDBCConnectorSource :: Type -> Type #

Read JDBCConnectorSource Source # 
Instance details

Defined in Amazonka.Glue.Types.JDBCConnectorSource

Show JDBCConnectorSource Source # 
Instance details

Defined in Amazonka.Glue.Types.JDBCConnectorSource

NFData JDBCConnectorSource Source # 
Instance details

Defined in Amazonka.Glue.Types.JDBCConnectorSource

Methods

rnf :: JDBCConnectorSource -> () #

Eq JDBCConnectorSource Source # 
Instance details

Defined in Amazonka.Glue.Types.JDBCConnectorSource

Hashable JDBCConnectorSource Source # 
Instance details

Defined in Amazonka.Glue.Types.JDBCConnectorSource

type Rep JDBCConnectorSource Source # 
Instance details

Defined in Amazonka.Glue.Types.JDBCConnectorSource

newJDBCConnectorSource Source #

Create a value of JDBCConnectorSource with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:additionalOptions:JDBCConnectorSource', jDBCConnectorSource_additionalOptions - Additional connection options for the connector.

$sel:connectionTable:JDBCConnectorSource', jDBCConnectorSource_connectionTable - The name of the table in the data source.

$sel:outputSchemas:JDBCConnectorSource', jDBCConnectorSource_outputSchemas - Specifies the data schema for the custom JDBC source.

$sel:query:JDBCConnectorSource', jDBCConnectorSource_query - The table or SQL query to get the data from. You can specify either ConnectionTable or query, but not both.

$sel:name:JDBCConnectorSource', jDBCConnectorSource_name - The name of the data source.

$sel:connectionName:JDBCConnectorSource', jDBCConnectorSource_connectionName - The name of the connection that is associated with the connector.

$sel:connectorName:JDBCConnectorSource', jDBCConnectorSource_connectorName - The name of a connector that assists with accessing the data store in Glue Studio.

$sel:connectionType:JDBCConnectorSource', jDBCConnectorSource_connectionType - The type of connection, such as marketplace.jdbc or custom.jdbc, designating a connection to a JDBC data store.

jDBCConnectorSource_connectionTable :: Lens' JDBCConnectorSource (Maybe Text) Source #

The name of the table in the data source.

jDBCConnectorSource_outputSchemas :: Lens' JDBCConnectorSource (Maybe [GlueSchema]) Source #

Specifies the data schema for the custom JDBC source.

jDBCConnectorSource_query :: Lens' JDBCConnectorSource (Maybe Text) Source #

The table or SQL query to get the data from. You can specify either ConnectionTable or query, but not both.

jDBCConnectorSource_connectionName :: Lens' JDBCConnectorSource Text Source #

The name of the connection that is associated with the connector.

jDBCConnectorSource_connectorName :: Lens' JDBCConnectorSource Text Source #

The name of a connector that assists with accessing the data store in Glue Studio.

jDBCConnectorSource_connectionType :: Lens' JDBCConnectorSource Text Source #

The type of connection, such as marketplace.jdbc or custom.jdbc, designating a connection to a JDBC data store.

JDBCConnectorTarget

data JDBCConnectorTarget Source #

Specifies a data target that writes to Amazon S3 in Apache Parquet columnar storage.

See: newJDBCConnectorTarget smart constructor.

Constructors

JDBCConnectorTarget' 

Fields

Instances

Instances details
FromJSON JDBCConnectorTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.JDBCConnectorTarget

ToJSON JDBCConnectorTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.JDBCConnectorTarget

Generic JDBCConnectorTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.JDBCConnectorTarget

Associated Types

type Rep JDBCConnectorTarget :: Type -> Type #

Read JDBCConnectorTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.JDBCConnectorTarget

Show JDBCConnectorTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.JDBCConnectorTarget

NFData JDBCConnectorTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.JDBCConnectorTarget

Methods

rnf :: JDBCConnectorTarget -> () #

Eq JDBCConnectorTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.JDBCConnectorTarget

Hashable JDBCConnectorTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.JDBCConnectorTarget

type Rep JDBCConnectorTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.JDBCConnectorTarget

type Rep JDBCConnectorTarget = D1 ('MetaData "JDBCConnectorTarget" "Amazonka.Glue.Types.JDBCConnectorTarget" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "JDBCConnectorTarget'" 'PrefixI 'True) (((S1 ('MetaSel ('Just "additionalOptions") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe (HashMap Text Text))) :*: S1 ('MetaSel ('Just "outputSchemas") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe [GlueSchema]))) :*: (S1 ('MetaSel ('Just "name") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text) :*: S1 ('MetaSel ('Just "inputs") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (NonEmpty Text)))) :*: ((S1 ('MetaSel ('Just "connectionName") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text) :*: S1 ('MetaSel ('Just "connectionTable") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text)) :*: (S1 ('MetaSel ('Just "connectorName") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text) :*: S1 ('MetaSel ('Just "connectionType") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text)))))

newJDBCConnectorTarget Source #

Create a value of JDBCConnectorTarget with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:additionalOptions:JDBCConnectorTarget', jDBCConnectorTarget_additionalOptions - Additional connection options for the connector.

$sel:outputSchemas:JDBCConnectorTarget', jDBCConnectorTarget_outputSchemas - Specifies the data schema for the JDBC target.

$sel:name:JDBCConnectorTarget', jDBCConnectorTarget_name - The name of the data target.

$sel:inputs:JDBCConnectorTarget', jDBCConnectorTarget_inputs - The nodes that are inputs to the data target.

$sel:connectionName:JDBCConnectorTarget', jDBCConnectorTarget_connectionName - The name of the connection that is associated with the connector.

$sel:connectionTable:JDBCConnectorTarget', jDBCConnectorTarget_connectionTable - The name of the table in the data target.

$sel:connectorName:JDBCConnectorTarget', jDBCConnectorTarget_connectorName - The name of a connector that will be used.

$sel:connectionType:JDBCConnectorTarget', jDBCConnectorTarget_connectionType - The type of connection, such as marketplace.jdbc or custom.jdbc, designating a connection to a JDBC data target.

jDBCConnectorTarget_additionalOptions :: Lens' JDBCConnectorTarget (Maybe (HashMap Text Text)) Source #

Additional connection options for the connector.

jDBCConnectorTarget_outputSchemas :: Lens' JDBCConnectorTarget (Maybe [GlueSchema]) Source #

Specifies the data schema for the JDBC target.

jDBCConnectorTarget_inputs :: Lens' JDBCConnectorTarget (NonEmpty Text) Source #

The nodes that are inputs to the data target.

jDBCConnectorTarget_connectionName :: Lens' JDBCConnectorTarget Text Source #

The name of the connection that is associated with the connector.

jDBCConnectorTarget_connectionTable :: Lens' JDBCConnectorTarget Text Source #

The name of the table in the data target.

jDBCConnectorTarget_connectorName :: Lens' JDBCConnectorTarget Text Source #

The name of a connector that will be used.

jDBCConnectorTarget_connectionType :: Lens' JDBCConnectorTarget Text Source #

The type of connection, such as marketplace.jdbc or custom.jdbc, designating a connection to a JDBC data target.

JdbcTarget

data JdbcTarget Source #

Specifies a JDBC data store to crawl.

See: newJdbcTarget smart constructor.

Constructors

JdbcTarget' 

Fields

Instances

Instances details
FromJSON JdbcTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.JdbcTarget

ToJSON JdbcTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.JdbcTarget

Generic JdbcTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.JdbcTarget

Associated Types

type Rep JdbcTarget :: Type -> Type #

Read JdbcTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.JdbcTarget

Show JdbcTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.JdbcTarget

NFData JdbcTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.JdbcTarget

Methods

rnf :: JdbcTarget -> () #

Eq JdbcTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.JdbcTarget

Hashable JdbcTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.JdbcTarget

type Rep JdbcTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.JdbcTarget

type Rep JdbcTarget = D1 ('MetaData "JdbcTarget" "Amazonka.Glue.Types.JdbcTarget" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "JdbcTarget'" 'PrefixI 'True) ((S1 ('MetaSel ('Just "connectionName") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "enableAdditionalMetadata") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe [JdbcMetadataEntry]))) :*: (S1 ('MetaSel ('Just "exclusions") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe [Text])) :*: S1 ('MetaSel ('Just "path") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)))))

newJdbcTarget :: JdbcTarget Source #

Create a value of JdbcTarget with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:connectionName:JdbcTarget', jdbcTarget_connectionName - The name of the connection to use to connect to the JDBC target.

$sel:enableAdditionalMetadata:JdbcTarget', jdbcTarget_enableAdditionalMetadata - Specify a value of RAWTYPES or COMMENTS to enable additional metadata in table responses. RAWTYPES provides the native-level datatype. COMMENTS provides comments associated with a column or table in the database.

If you do not need additional metadata, keep the field empty.

$sel:exclusions:JdbcTarget', jdbcTarget_exclusions - A list of glob patterns used to exclude from the crawl. For more information, see Catalog Tables with a Crawler.

$sel:path:JdbcTarget', jdbcTarget_path - The path of the JDBC target.

jdbcTarget_connectionName :: Lens' JdbcTarget (Maybe Text) Source #

The name of the connection to use to connect to the JDBC target.

jdbcTarget_enableAdditionalMetadata :: Lens' JdbcTarget (Maybe [JdbcMetadataEntry]) Source #

Specify a value of RAWTYPES or COMMENTS to enable additional metadata in table responses. RAWTYPES provides the native-level datatype. COMMENTS provides comments associated with a column or table in the database.

If you do not need additional metadata, keep the field empty.

jdbcTarget_exclusions :: Lens' JdbcTarget (Maybe [Text]) Source #

A list of glob patterns used to exclude from the crawl. For more information, see Catalog Tables with a Crawler.

jdbcTarget_path :: Lens' JdbcTarget (Maybe Text) Source #

The path of the JDBC target.

Job

data Job Source #

Specifies a job definition.

See: newJob smart constructor.

Constructors

Job' 

Fields

  • allocatedCapacity :: Maybe Int

    This field is deprecated. Use MaxCapacity instead.

    The number of Glue data processing units (DPUs) allocated to runs of this job. You can allocate a minimum of 2 DPUs; the default is 10. A DPU is a relative measure of processing power that consists of 4 vCPUs of compute capacity and 16 GB of memory. For more information, see the Glue pricing page.

  • codeGenConfigurationNodes :: Maybe (Sensitive (HashMap Text CodeGenConfigurationNode))

    The representation of a directed acyclic graph on which both the Glue Studio visual component and Glue Studio code generation is based.

  • command :: Maybe JobCommand

    The JobCommand that runs this job.

  • connections :: Maybe ConnectionsList

    The connections used for this job.

  • createdOn :: Maybe POSIX

    The time and date that this job definition was created.

  • defaultArguments :: Maybe (HashMap Text Text)

    The default arguments for this job, specified as name-value pairs.

    You can specify arguments here that your own job-execution script consumes, as well as arguments that Glue itself consumes.

    For information about how to specify and consume your own Job arguments, see the Calling Glue APIs in Python topic in the developer guide.

    For information about the key-value pairs that Glue consumes to set up your job, see the Special Parameters Used by Glue topic in the developer guide.

  • description :: Maybe Text

    A description of the job.

  • executionClass :: Maybe ExecutionClass

    Indicates whether the job is run with a standard or flexible execution class. The standard execution class is ideal for time-sensitive workloads that require fast job startup and dedicated resources.

    The flexible execution class is appropriate for time-insensitive jobs whose start and completion times may vary.

    Only jobs with Glue version 3.0 and above and command type glueetl will be allowed to set ExecutionClass to FLEX. The flexible execution class is available for Spark jobs.

  • executionProperty :: Maybe ExecutionProperty

    An ExecutionProperty specifying the maximum number of concurrent runs allowed for this job.

  • glueVersion :: Maybe Text

    Glue version determines the versions of Apache Spark and Python that Glue supports. The Python version indicates the version supported for jobs of type Spark.

    For more information about the available Glue versions and corresponding Spark and Python versions, see Glue version in the developer guide.

    Jobs that are created without specifying a Glue version default to Glue 0.9.

  • lastModifiedOn :: Maybe POSIX

    The last point in time when this job definition was modified.

  • logUri :: Maybe Text

    This field is reserved for future use.

  • maxCapacity :: Maybe Double

    For Glue version 1.0 or earlier jobs, using the standard worker type, the number of Glue data processing units (DPUs) that can be allocated when this job runs. A DPU is a relative measure of processing power that consists of 4 vCPUs of compute capacity and 16 GB of memory. For more information, see the Glue pricing page.

    Do not set Max Capacity if using WorkerType and NumberOfWorkers.

    The value that can be allocated for MaxCapacity depends on whether you are running a Python shell job, an Apache Spark ETL job, or an Apache Spark streaming ETL job:

    • When you specify a Python shell job (JobCommand.Name="pythonshell"), you can allocate either 0.0625 or 1 DPU. The default is 0.0625 DPU.
    • When you specify an Apache Spark ETL job (JobCommand.Name="glueetl") or Apache Spark streaming ETL job (JobCommand.Name="gluestreaming"), you can allocate a minimum of 2 DPUs. The default is 10 DPUs. This job type cannot have a fractional DPU allocation.

    For Glue version 2.0 jobs, you cannot instead specify a Maximum capacity. Instead, you should specify a Worker type and the Number of workers.

  • maxRetries :: Maybe Int

    The maximum number of times to retry this job after a JobRun fails.

  • name :: Maybe Text

    The name you assign to this job definition.

  • nonOverridableArguments :: Maybe (HashMap Text Text)

    Non-overridable arguments for this job, specified as name-value pairs.

  • notificationProperty :: Maybe NotificationProperty

    Specifies configuration properties of a job notification.

  • numberOfWorkers :: Maybe Int

    The number of workers of a defined workerType that are allocated when a job runs.

  • role' :: Maybe Text

    The name or Amazon Resource Name (ARN) of the IAM role associated with this job.

  • securityConfiguration :: Maybe Text

    The name of the SecurityConfiguration structure to be used with this job.

  • sourceControlDetails :: Maybe SourceControlDetails

    The details for a source control configuration for a job, allowing synchronization of job artifacts to or from a remote repository.

  • timeout :: Maybe Natural

    The job timeout in minutes. This is the maximum time that a job run can consume resources before it is terminated and enters TIMEOUT status. The default is 2,880 minutes (48 hours).

  • workerType :: Maybe WorkerType

    The type of predefined worker that is allocated when a job runs. Accepts a value of Standard, G.1X, G.2X, or G.025X.

    • For the Standard worker type, each worker provides 4 vCPU, 16 GB of memory and a 50GB disk, and 2 executors per worker.
    • For the G.1X worker type, each worker maps to 1 DPU (4 vCPU, 16 GB of memory, 64 GB disk), and provides 1 executor per worker. We recommend this worker type for memory-intensive jobs.
    • For the G.2X worker type, each worker maps to 2 DPU (8 vCPU, 32 GB of memory, 128 GB disk), and provides 1 executor per worker. We recommend this worker type for memory-intensive jobs.
    • For the G.025X worker type, each worker maps to 0.25 DPU (2 vCPU, 4 GB of memory, 64 GB disk), and provides 1 executor per worker. We recommend this worker type for low volume streaming jobs. This worker type is only available for Glue version 3.0 streaming jobs.

Instances

Instances details
FromJSON Job Source # 
Instance details

Defined in Amazonka.Glue.Types.Job

Generic Job Source # 
Instance details

Defined in Amazonka.Glue.Types.Job

Associated Types

type Rep Job :: Type -> Type #

Methods

from :: Job -> Rep Job x #

to :: Rep Job x -> Job #

Show Job Source # 
Instance details

Defined in Amazonka.Glue.Types.Job

Methods

showsPrec :: Int -> Job -> ShowS #

show :: Job -> String #

showList :: [Job] -> ShowS #

NFData Job Source # 
Instance details

Defined in Amazonka.Glue.Types.Job

Methods

rnf :: Job -> () #

Eq Job Source # 
Instance details

Defined in Amazonka.Glue.Types.Job

Methods

(==) :: Job -> Job -> Bool #

(/=) :: Job -> Job -> Bool #

Hashable Job Source # 
Instance details

Defined in Amazonka.Glue.Types.Job

Methods

hashWithSalt :: Int -> Job -> Int #

hash :: Job -> Int #

type Rep Job Source # 
Instance details

Defined in Amazonka.Glue.Types.Job

type Rep Job = D1 ('MetaData "Job" "Amazonka.Glue.Types.Job" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "Job'" 'PrefixI 'True) ((((S1 ('MetaSel ('Just "allocatedCapacity") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Int)) :*: S1 ('MetaSel ('Just "codeGenConfigurationNodes") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe (Sensitive (HashMap Text CodeGenConfigurationNode))))) :*: (S1 ('MetaSel ('Just "command") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe JobCommand)) :*: (S1 ('MetaSel ('Just "connections") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe ConnectionsList)) :*: S1 ('MetaSel ('Just "createdOn") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe POSIX))))) :*: ((S1 ('MetaSel ('Just "defaultArguments") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe (HashMap Text Text))) :*: (S1 ('MetaSel ('Just "description") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "executionClass") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe ExecutionClass)))) :*: (S1 ('MetaSel ('Just "executionProperty") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe ExecutionProperty)) :*: (S1 ('MetaSel ('Just "glueVersion") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "lastModifiedOn") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe POSIX)))))) :*: (((S1 ('MetaSel ('Just "logUri") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: (S1 ('MetaSel ('Just "maxCapacity") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Double)) :*: S1 ('MetaSel ('Just "maxRetries") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Int)))) :*: (S1 ('MetaSel ('Just "name") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: (S1 ('MetaSel ('Just "nonOverridableArguments") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe (HashMap Text Text))) :*: S1 ('MetaSel ('Just "notificationProperty") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe NotificationProperty))))) :*: ((S1 ('MetaSel ('Just "numberOfWorkers") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Int)) :*: (S1 ('MetaSel ('Just "role'") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "securityConfiguration") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)))) :*: (S1 ('MetaSel ('Just "sourceControlDetails") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe SourceControlDetails)) :*: (S1 ('MetaSel ('Just "timeout") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Natural)) :*: S1 ('MetaSel ('Just "workerType") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe WorkerType))))))))

newJob :: Job Source #

Create a value of Job with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:allocatedCapacity:Job', job_allocatedCapacity - This field is deprecated. Use MaxCapacity instead.

The number of Glue data processing units (DPUs) allocated to runs of this job. You can allocate a minimum of 2 DPUs; the default is 10. A DPU is a relative measure of processing power that consists of 4 vCPUs of compute capacity and 16 GB of memory. For more information, see the Glue pricing page.

$sel:codeGenConfigurationNodes:Job', job_codeGenConfigurationNodes - The representation of a directed acyclic graph on which both the Glue Studio visual component and Glue Studio code generation is based.

$sel:command:Job', job_command - The JobCommand that runs this job.

Job, job_connections - The connections used for this job.

$sel:createdOn:Job', job_createdOn - The time and date that this job definition was created.

$sel:defaultArguments:Job', job_defaultArguments - The default arguments for this job, specified as name-value pairs.

You can specify arguments here that your own job-execution script consumes, as well as arguments that Glue itself consumes.

For information about how to specify and consume your own Job arguments, see the Calling Glue APIs in Python topic in the developer guide.

For information about the key-value pairs that Glue consumes to set up your job, see the Special Parameters Used by Glue topic in the developer guide.

$sel:description:Job', job_description - A description of the job.

$sel:executionClass:Job', job_executionClass - Indicates whether the job is run with a standard or flexible execution class. The standard execution class is ideal for time-sensitive workloads that require fast job startup and dedicated resources.

The flexible execution class is appropriate for time-insensitive jobs whose start and completion times may vary.

Only jobs with Glue version 3.0 and above and command type glueetl will be allowed to set ExecutionClass to FLEX. The flexible execution class is available for Spark jobs.

$sel:executionProperty:Job', job_executionProperty - An ExecutionProperty specifying the maximum number of concurrent runs allowed for this job.

$sel:glueVersion:Job', job_glueVersion - Glue version determines the versions of Apache Spark and Python that Glue supports. The Python version indicates the version supported for jobs of type Spark.

For more information about the available Glue versions and corresponding Spark and Python versions, see Glue version in the developer guide.

Jobs that are created without specifying a Glue version default to Glue 0.9.

$sel:lastModifiedOn:Job', job_lastModifiedOn - The last point in time when this job definition was modified.

$sel:logUri:Job', job_logUri - This field is reserved for future use.

$sel:maxCapacity:Job', job_maxCapacity - For Glue version 1.0 or earlier jobs, using the standard worker type, the number of Glue data processing units (DPUs) that can be allocated when this job runs. A DPU is a relative measure of processing power that consists of 4 vCPUs of compute capacity and 16 GB of memory. For more information, see the Glue pricing page.

Do not set Max Capacity if using WorkerType and NumberOfWorkers.

The value that can be allocated for MaxCapacity depends on whether you are running a Python shell job, an Apache Spark ETL job, or an Apache Spark streaming ETL job:

  • When you specify a Python shell job (JobCommand.Name="pythonshell"), you can allocate either 0.0625 or 1 DPU. The default is 0.0625 DPU.
  • When you specify an Apache Spark ETL job (JobCommand.Name="glueetl") or Apache Spark streaming ETL job (JobCommand.Name="gluestreaming"), you can allocate a minimum of 2 DPUs. The default is 10 DPUs. This job type cannot have a fractional DPU allocation.

For Glue version 2.0 jobs, you cannot instead specify a Maximum capacity. Instead, you should specify a Worker type and the Number of workers.

$sel:maxRetries:Job', job_maxRetries - The maximum number of times to retry this job after a JobRun fails.

Job, job_name - The name you assign to this job definition.

$sel:nonOverridableArguments:Job', job_nonOverridableArguments - Non-overridable arguments for this job, specified as name-value pairs.

$sel:notificationProperty:Job', job_notificationProperty - Specifies configuration properties of a job notification.

$sel:numberOfWorkers:Job', job_numberOfWorkers - The number of workers of a defined workerType that are allocated when a job runs.

$sel:role':Job', job_role - The name or Amazon Resource Name (ARN) of the IAM role associated with this job.

$sel:securityConfiguration:Job', job_securityConfiguration - The name of the SecurityConfiguration structure to be used with this job.

$sel:sourceControlDetails:Job', job_sourceControlDetails - The details for a source control configuration for a job, allowing synchronization of job artifacts to or from a remote repository.

$sel:timeout:Job', job_timeout - The job timeout in minutes. This is the maximum time that a job run can consume resources before it is terminated and enters TIMEOUT status. The default is 2,880 minutes (48 hours).

$sel:workerType:Job', job_workerType - The type of predefined worker that is allocated when a job runs. Accepts a value of Standard, G.1X, G.2X, or G.025X.

  • For the Standard worker type, each worker provides 4 vCPU, 16 GB of memory and a 50GB disk, and 2 executors per worker.
  • For the G.1X worker type, each worker maps to 1 DPU (4 vCPU, 16 GB of memory, 64 GB disk), and provides 1 executor per worker. We recommend this worker type for memory-intensive jobs.
  • For the G.2X worker type, each worker maps to 2 DPU (8 vCPU, 32 GB of memory, 128 GB disk), and provides 1 executor per worker. We recommend this worker type for memory-intensive jobs.
  • For the G.025X worker type, each worker maps to 0.25 DPU (2 vCPU, 4 GB of memory, 64 GB disk), and provides 1 executor per worker. We recommend this worker type for low volume streaming jobs. This worker type is only available for Glue version 3.0 streaming jobs.

job_allocatedCapacity :: Lens' Job (Maybe Int) Source #

This field is deprecated. Use MaxCapacity instead.

The number of Glue data processing units (DPUs) allocated to runs of this job. You can allocate a minimum of 2 DPUs; the default is 10. A DPU is a relative measure of processing power that consists of 4 vCPUs of compute capacity and 16 GB of memory. For more information, see the Glue pricing page.

job_codeGenConfigurationNodes :: Lens' Job (Maybe (HashMap Text CodeGenConfigurationNode)) Source #

The representation of a directed acyclic graph on which both the Glue Studio visual component and Glue Studio code generation is based.

job_command :: Lens' Job (Maybe JobCommand) Source #

The JobCommand that runs this job.

job_connections :: Lens' Job (Maybe ConnectionsList) Source #

The connections used for this job.

job_createdOn :: Lens' Job (Maybe UTCTime) Source #

The time and date that this job definition was created.

job_defaultArguments :: Lens' Job (Maybe (HashMap Text Text)) Source #

The default arguments for this job, specified as name-value pairs.

You can specify arguments here that your own job-execution script consumes, as well as arguments that Glue itself consumes.

For information about how to specify and consume your own Job arguments, see the Calling Glue APIs in Python topic in the developer guide.

For information about the key-value pairs that Glue consumes to set up your job, see the Special Parameters Used by Glue topic in the developer guide.

job_description :: Lens' Job (Maybe Text) Source #

A description of the job.

job_executionClass :: Lens' Job (Maybe ExecutionClass) Source #

Indicates whether the job is run with a standard or flexible execution class. The standard execution class is ideal for time-sensitive workloads that require fast job startup and dedicated resources.

The flexible execution class is appropriate for time-insensitive jobs whose start and completion times may vary.

Only jobs with Glue version 3.0 and above and command type glueetl will be allowed to set ExecutionClass to FLEX. The flexible execution class is available for Spark jobs.

job_executionProperty :: Lens' Job (Maybe ExecutionProperty) Source #

An ExecutionProperty specifying the maximum number of concurrent runs allowed for this job.

job_glueVersion :: Lens' Job (Maybe Text) Source #

Glue version determines the versions of Apache Spark and Python that Glue supports. The Python version indicates the version supported for jobs of type Spark.

For more information about the available Glue versions and corresponding Spark and Python versions, see Glue version in the developer guide.

Jobs that are created without specifying a Glue version default to Glue 0.9.

job_lastModifiedOn :: Lens' Job (Maybe UTCTime) Source #

The last point in time when this job definition was modified.

job_logUri :: Lens' Job (Maybe Text) Source #

This field is reserved for future use.

job_maxCapacity :: Lens' Job (Maybe Double) Source #

For Glue version 1.0 or earlier jobs, using the standard worker type, the number of Glue data processing units (DPUs) that can be allocated when this job runs. A DPU is a relative measure of processing power that consists of 4 vCPUs of compute capacity and 16 GB of memory. For more information, see the Glue pricing page.

Do not set Max Capacity if using WorkerType and NumberOfWorkers.

The value that can be allocated for MaxCapacity depends on whether you are running a Python shell job, an Apache Spark ETL job, or an Apache Spark streaming ETL job:

  • When you specify a Python shell job (JobCommand.Name="pythonshell"), you can allocate either 0.0625 or 1 DPU. The default is 0.0625 DPU.
  • When you specify an Apache Spark ETL job (JobCommand.Name="glueetl") or Apache Spark streaming ETL job (JobCommand.Name="gluestreaming"), you can allocate a minimum of 2 DPUs. The default is 10 DPUs. This job type cannot have a fractional DPU allocation.

For Glue version 2.0 jobs, you cannot instead specify a Maximum capacity. Instead, you should specify a Worker type and the Number of workers.

job_maxRetries :: Lens' Job (Maybe Int) Source #

The maximum number of times to retry this job after a JobRun fails.

job_name :: Lens' Job (Maybe Text) Source #

The name you assign to this job definition.

job_nonOverridableArguments :: Lens' Job (Maybe (HashMap Text Text)) Source #

Non-overridable arguments for this job, specified as name-value pairs.

job_notificationProperty :: Lens' Job (Maybe NotificationProperty) Source #

Specifies configuration properties of a job notification.

job_numberOfWorkers :: Lens' Job (Maybe Int) Source #

The number of workers of a defined workerType that are allocated when a job runs.

job_role :: Lens' Job (Maybe Text) Source #

The name or Amazon Resource Name (ARN) of the IAM role associated with this job.

job_securityConfiguration :: Lens' Job (Maybe Text) Source #

The name of the SecurityConfiguration structure to be used with this job.

job_sourceControlDetails :: Lens' Job (Maybe SourceControlDetails) Source #

The details for a source control configuration for a job, allowing synchronization of job artifacts to or from a remote repository.

job_timeout :: Lens' Job (Maybe Natural) Source #

The job timeout in minutes. This is the maximum time that a job run can consume resources before it is terminated and enters TIMEOUT status. The default is 2,880 minutes (48 hours).

job_workerType :: Lens' Job (Maybe WorkerType) Source #

The type of predefined worker that is allocated when a job runs. Accepts a value of Standard, G.1X, G.2X, or G.025X.

  • For the Standard worker type, each worker provides 4 vCPU, 16 GB of memory and a 50GB disk, and 2 executors per worker.
  • For the G.1X worker type, each worker maps to 1 DPU (4 vCPU, 16 GB of memory, 64 GB disk), and provides 1 executor per worker. We recommend this worker type for memory-intensive jobs.
  • For the G.2X worker type, each worker maps to 2 DPU (8 vCPU, 32 GB of memory, 128 GB disk), and provides 1 executor per worker. We recommend this worker type for memory-intensive jobs.
  • For the G.025X worker type, each worker maps to 0.25 DPU (2 vCPU, 4 GB of memory, 64 GB disk), and provides 1 executor per worker. We recommend this worker type for low volume streaming jobs. This worker type is only available for Glue version 3.0 streaming jobs.

JobBookmarkEntry

data JobBookmarkEntry Source #

Defines a point that a job can resume processing.

See: newJobBookmarkEntry smart constructor.

Constructors

JobBookmarkEntry' 

Fields

Instances

Instances details
FromJSON JobBookmarkEntry Source # 
Instance details

Defined in Amazonka.Glue.Types.JobBookmarkEntry

Generic JobBookmarkEntry Source # 
Instance details

Defined in Amazonka.Glue.Types.JobBookmarkEntry

Associated Types

type Rep JobBookmarkEntry :: Type -> Type #

Read JobBookmarkEntry Source # 
Instance details

Defined in Amazonka.Glue.Types.JobBookmarkEntry

Show JobBookmarkEntry Source # 
Instance details

Defined in Amazonka.Glue.Types.JobBookmarkEntry

NFData JobBookmarkEntry Source # 
Instance details

Defined in Amazonka.Glue.Types.JobBookmarkEntry

Methods

rnf :: JobBookmarkEntry -> () #

Eq JobBookmarkEntry Source # 
Instance details

Defined in Amazonka.Glue.Types.JobBookmarkEntry

Hashable JobBookmarkEntry Source # 
Instance details

Defined in Amazonka.Glue.Types.JobBookmarkEntry

type Rep JobBookmarkEntry Source # 
Instance details

Defined in Amazonka.Glue.Types.JobBookmarkEntry

newJobBookmarkEntry :: JobBookmarkEntry Source #

Create a value of JobBookmarkEntry with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:attempt:JobBookmarkEntry', jobBookmarkEntry_attempt - The attempt ID number.

$sel:jobBookmark:JobBookmarkEntry', jobBookmarkEntry_jobBookmark - The bookmark itself.

$sel:jobName:JobBookmarkEntry', jobBookmarkEntry_jobName - The name of the job in question.

$sel:previousRunId:JobBookmarkEntry', jobBookmarkEntry_previousRunId - The unique run identifier associated with the previous job run.

$sel:run:JobBookmarkEntry', jobBookmarkEntry_run - The run ID number.

$sel:runId:JobBookmarkEntry', jobBookmarkEntry_runId - The run ID number.

$sel:version:JobBookmarkEntry', jobBookmarkEntry_version - The version of the job.

jobBookmarkEntry_jobName :: Lens' JobBookmarkEntry (Maybe Text) Source #

The name of the job in question.

jobBookmarkEntry_previousRunId :: Lens' JobBookmarkEntry (Maybe Text) Source #

The unique run identifier associated with the previous job run.

JobBookmarksEncryption

data JobBookmarksEncryption Source #

Specifies how job bookmark data should be encrypted.

See: newJobBookmarksEncryption smart constructor.

Constructors

JobBookmarksEncryption' 

Fields

Instances

Instances details
FromJSON JobBookmarksEncryption Source # 
Instance details

Defined in Amazonka.Glue.Types.JobBookmarksEncryption

ToJSON JobBookmarksEncryption Source # 
Instance details

Defined in Amazonka.Glue.Types.JobBookmarksEncryption

Generic JobBookmarksEncryption Source # 
Instance details

Defined in Amazonka.Glue.Types.JobBookmarksEncryption

Associated Types

type Rep JobBookmarksEncryption :: Type -> Type #

Read JobBookmarksEncryption Source # 
Instance details

Defined in Amazonka.Glue.Types.JobBookmarksEncryption

Show JobBookmarksEncryption Source # 
Instance details

Defined in Amazonka.Glue.Types.JobBookmarksEncryption

NFData JobBookmarksEncryption Source # 
Instance details

Defined in Amazonka.Glue.Types.JobBookmarksEncryption

Methods

rnf :: JobBookmarksEncryption -> () #

Eq JobBookmarksEncryption Source # 
Instance details

Defined in Amazonka.Glue.Types.JobBookmarksEncryption

Hashable JobBookmarksEncryption Source # 
Instance details

Defined in Amazonka.Glue.Types.JobBookmarksEncryption

type Rep JobBookmarksEncryption Source # 
Instance details

Defined in Amazonka.Glue.Types.JobBookmarksEncryption

type Rep JobBookmarksEncryption = D1 ('MetaData "JobBookmarksEncryption" "Amazonka.Glue.Types.JobBookmarksEncryption" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "JobBookmarksEncryption'" 'PrefixI 'True) (S1 ('MetaSel ('Just "jobBookmarksEncryptionMode") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe JobBookmarksEncryptionMode)) :*: S1 ('MetaSel ('Just "kmsKeyArn") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text))))

newJobBookmarksEncryption :: JobBookmarksEncryption Source #

Create a value of JobBookmarksEncryption with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:jobBookmarksEncryptionMode:JobBookmarksEncryption', jobBookmarksEncryption_jobBookmarksEncryptionMode - The encryption mode to use for job bookmarks data.

$sel:kmsKeyArn:JobBookmarksEncryption', jobBookmarksEncryption_kmsKeyArn - The Amazon Resource Name (ARN) of the KMS key to be used to encrypt the data.

jobBookmarksEncryption_kmsKeyArn :: Lens' JobBookmarksEncryption (Maybe Text) Source #

The Amazon Resource Name (ARN) of the KMS key to be used to encrypt the data.

JobCommand

data JobCommand Source #

Specifies code that runs when a job is run.

See: newJobCommand smart constructor.

Constructors

JobCommand' 

Fields

  • name :: Maybe Text

    The name of the job command. For an Apache Spark ETL job, this must be glueetl. For a Python shell job, it must be pythonshell. For an Apache Spark streaming ETL job, this must be gluestreaming.

  • pythonVersion :: Maybe Text

    The Python version being used to run a Python shell job. Allowed values are 2 or 3.

  • scriptLocation :: Maybe Text

    Specifies the Amazon Simple Storage Service (Amazon S3) path to a script that runs a job.

Instances

Instances details
FromJSON JobCommand Source # 
Instance details

Defined in Amazonka.Glue.Types.JobCommand

ToJSON JobCommand Source # 
Instance details

Defined in Amazonka.Glue.Types.JobCommand

Generic JobCommand Source # 
Instance details

Defined in Amazonka.Glue.Types.JobCommand

Associated Types

type Rep JobCommand :: Type -> Type #

Read JobCommand Source # 
Instance details

Defined in Amazonka.Glue.Types.JobCommand

Show JobCommand Source # 
Instance details

Defined in Amazonka.Glue.Types.JobCommand

NFData JobCommand Source # 
Instance details

Defined in Amazonka.Glue.Types.JobCommand

Methods

rnf :: JobCommand -> () #

Eq JobCommand Source # 
Instance details

Defined in Amazonka.Glue.Types.JobCommand

Hashable JobCommand Source # 
Instance details

Defined in Amazonka.Glue.Types.JobCommand

type Rep JobCommand Source # 
Instance details

Defined in Amazonka.Glue.Types.JobCommand

type Rep JobCommand = D1 ('MetaData "JobCommand" "Amazonka.Glue.Types.JobCommand" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "JobCommand'" 'PrefixI 'True) (S1 ('MetaSel ('Just "name") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: (S1 ('MetaSel ('Just "pythonVersion") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "scriptLocation") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)))))

newJobCommand :: JobCommand Source #

Create a value of JobCommand with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:name:JobCommand', jobCommand_name - The name of the job command. For an Apache Spark ETL job, this must be glueetl. For a Python shell job, it must be pythonshell. For an Apache Spark streaming ETL job, this must be gluestreaming.

$sel:pythonVersion:JobCommand', jobCommand_pythonVersion - The Python version being used to run a Python shell job. Allowed values are 2 or 3.

$sel:scriptLocation:JobCommand', jobCommand_scriptLocation - Specifies the Amazon Simple Storage Service (Amazon S3) path to a script that runs a job.

jobCommand_name :: Lens' JobCommand (Maybe Text) Source #

The name of the job command. For an Apache Spark ETL job, this must be glueetl. For a Python shell job, it must be pythonshell. For an Apache Spark streaming ETL job, this must be gluestreaming.

jobCommand_pythonVersion :: Lens' JobCommand (Maybe Text) Source #

The Python version being used to run a Python shell job. Allowed values are 2 or 3.

jobCommand_scriptLocation :: Lens' JobCommand (Maybe Text) Source #

Specifies the Amazon Simple Storage Service (Amazon S3) path to a script that runs a job.

JobNodeDetails

data JobNodeDetails Source #

The details of a Job node present in the workflow.

See: newJobNodeDetails smart constructor.

Constructors

JobNodeDetails' 

Fields

Instances

Instances details
FromJSON JobNodeDetails Source # 
Instance details

Defined in Amazonka.Glue.Types.JobNodeDetails

Generic JobNodeDetails Source # 
Instance details

Defined in Amazonka.Glue.Types.JobNodeDetails

Associated Types

type Rep JobNodeDetails :: Type -> Type #

Read JobNodeDetails Source # 
Instance details

Defined in Amazonka.Glue.Types.JobNodeDetails

Show JobNodeDetails Source # 
Instance details

Defined in Amazonka.Glue.Types.JobNodeDetails

NFData JobNodeDetails Source # 
Instance details

Defined in Amazonka.Glue.Types.JobNodeDetails

Methods

rnf :: JobNodeDetails -> () #

Eq JobNodeDetails Source # 
Instance details

Defined in Amazonka.Glue.Types.JobNodeDetails

Hashable JobNodeDetails Source # 
Instance details

Defined in Amazonka.Glue.Types.JobNodeDetails

type Rep JobNodeDetails Source # 
Instance details

Defined in Amazonka.Glue.Types.JobNodeDetails

type Rep JobNodeDetails = D1 ('MetaData "JobNodeDetails" "Amazonka.Glue.Types.JobNodeDetails" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "JobNodeDetails'" 'PrefixI 'True) (S1 ('MetaSel ('Just "jobRuns") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe [JobRun]))))

newJobNodeDetails :: JobNodeDetails Source #

Create a value of JobNodeDetails with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:jobRuns:JobNodeDetails', jobNodeDetails_jobRuns - The information for the job runs represented by the job node.

jobNodeDetails_jobRuns :: Lens' JobNodeDetails (Maybe [JobRun]) Source #

The information for the job runs represented by the job node.

JobRun

data JobRun Source #

Contains information about a job run.

See: newJobRun smart constructor.

Constructors

JobRun' 

Fields

  • allocatedCapacity :: Maybe Int

    This field is deprecated. Use MaxCapacity instead.

    The number of Glue data processing units (DPUs) allocated to this JobRun. From 2 to 100 DPUs can be allocated; the default is 10. A DPU is a relative measure of processing power that consists of 4 vCPUs of compute capacity and 16 GB of memory. For more information, see the Glue pricing page.

  • arguments :: Maybe (HashMap Text Text)

    The job arguments associated with this run. For this job run, they replace the default arguments set in the job definition itself.

    You can specify arguments here that your own job-execution script consumes, as well as arguments that Glue itself consumes.

    For information about how to specify and consume your own job arguments, see the Calling Glue APIs in Python topic in the developer guide.

    For information about the key-value pairs that Glue consumes to set up your job, see the Special Parameters Used by Glue topic in the developer guide.

  • attempt :: Maybe Int

    The number of the attempt to run this job.

  • completedOn :: Maybe POSIX

    The date and time that this job run completed.

  • dPUSeconds :: Maybe Double

    This field populates only for Auto Scaling job runs, and represents the total time each executor ran during the lifecycle of a job run in seconds, multiplied by a DPU factor (1 for G.1X, 2 for G.2X, or 0.25 for G.025X workers). This value may be different than the executionEngineRuntime * MaxCapacity as in the case of Auto Scaling jobs, as the number of executors running at a given time may be less than the MaxCapacity. Therefore, it is possible that the value of DPUSeconds is less than executionEngineRuntime * MaxCapacity.

  • errorMessage :: Maybe Text

    An error message associated with this job run.

  • executionClass :: Maybe ExecutionClass

    Indicates whether the job is run with a standard or flexible execution class. The standard execution-class is ideal for time-sensitive workloads that require fast job startup and dedicated resources.

    The flexible execution class is appropriate for time-insensitive jobs whose start and completion times may vary.

    Only jobs with Glue version 3.0 and above and command type glueetl will be allowed to set ExecutionClass to FLEX. The flexible execution class is available for Spark jobs.

  • executionTime :: Maybe Int

    The amount of time (in seconds) that the job run consumed resources.

  • glueVersion :: Maybe Text

    Glue version determines the versions of Apache Spark and Python that Glue supports. The Python version indicates the version supported for jobs of type Spark.

    For more information about the available Glue versions and corresponding Spark and Python versions, see Glue version in the developer guide.

    Jobs that are created without specifying a Glue version default to Glue 0.9.

  • id :: Maybe Text

    The ID of this job run.

  • jobName :: Maybe Text

    The name of the job definition being used in this run.

  • jobRunState :: Maybe JobRunState

    The current state of the job run. For more information about the statuses of jobs that have terminated abnormally, see Glue Job Run Statuses.

  • lastModifiedOn :: Maybe POSIX

    The last time that this job run was modified.

  • logGroupName :: Maybe Text

    The name of the log group for secure logging that can be server-side encrypted in Amazon CloudWatch using KMS. This name can be /aws-glue/jobs/, in which case the default encryption is NONE. If you add a role name and SecurityConfiguration name (in other words, /aws-glue/jobs-yourRoleName-yourSecurityConfigurationName/), then that security configuration is used to encrypt the log group.

  • maxCapacity :: Maybe Double

    The number of Glue data processing units (DPUs) that can be allocated when this job runs. A DPU is a relative measure of processing power that consists of 4 vCPUs of compute capacity and 16 GB of memory. For more information, see the Glue pricing page.

    Do not set Max Capacity if using WorkerType and NumberOfWorkers.

    The value that can be allocated for MaxCapacity depends on whether you are running a Python shell job or an Apache Spark ETL job:

    • When you specify a Python shell job (JobCommand.Name="pythonshell"), you can allocate either 0.0625 or 1 DPU. The default is 0.0625 DPU.
    • When you specify an Apache Spark ETL job (JobCommand.Name="glueetl"), you can allocate a minimum of 2 DPUs. The default is 10 DPUs. This job type cannot have a fractional DPU allocation.
  • notificationProperty :: Maybe NotificationProperty

    Specifies configuration properties of a job run notification.

  • numberOfWorkers :: Maybe Int

    The number of workers of a defined workerType that are allocated when a job runs.

  • predecessorRuns :: Maybe [Predecessor]

    A list of predecessors to this job run.

  • previousRunId :: Maybe Text

    The ID of the previous run of this job. For example, the JobRunId specified in the StartJobRun action.

  • securityConfiguration :: Maybe Text

    The name of the SecurityConfiguration structure to be used with this job run.

  • startedOn :: Maybe POSIX

    The date and time at which this job run was started.

  • timeout :: Maybe Natural

    The JobRun timeout in minutes. This is the maximum time that a job run can consume resources before it is terminated and enters TIMEOUT status. This value overrides the timeout value set in the parent job.

    Streaming jobs do not have a timeout. The default for non-streaming jobs is 2,880 minutes (48 hours).

  • triggerName :: Maybe Text

    The name of the trigger that started this job run.

  • workerType :: Maybe WorkerType

    The type of predefined worker that is allocated when a job runs. Accepts a value of Standard, G.1X, G.2X, or G.025X.

    • For the Standard worker type, each worker provides 4 vCPU, 16 GB of memory and a 50GB disk, and 2 executors per worker.
    • For the G.1X worker type, each worker provides 4 vCPU, 16 GB of memory and a 64GB disk, and 1 executor per worker.
    • For the G.2X worker type, each worker provides 8 vCPU, 32 GB of memory and a 128GB disk, and 1 executor per worker.
    • For the G.025X worker type, each worker maps to 0.25 DPU (2 vCPU, 4 GB of memory, 64 GB disk), and provides 1 executor per worker. We recommend this worker type for low volume streaming jobs. This worker type is only available for Glue version 3.0 streaming jobs.

Instances

Instances details
FromJSON JobRun Source # 
Instance details

Defined in Amazonka.Glue.Types.JobRun

Generic JobRun Source # 
Instance details

Defined in Amazonka.Glue.Types.JobRun

Associated Types

type Rep JobRun :: Type -> Type #

Methods

from :: JobRun -> Rep JobRun x #

to :: Rep JobRun x -> JobRun #

Read JobRun Source # 
Instance details

Defined in Amazonka.Glue.Types.JobRun

Show JobRun Source # 
Instance details

Defined in Amazonka.Glue.Types.JobRun

NFData JobRun Source # 
Instance details

Defined in Amazonka.Glue.Types.JobRun

Methods

rnf :: JobRun -> () #

Eq JobRun Source # 
Instance details

Defined in Amazonka.Glue.Types.JobRun

Methods

(==) :: JobRun -> JobRun -> Bool #

(/=) :: JobRun -> JobRun -> Bool #

Hashable JobRun Source # 
Instance details

Defined in Amazonka.Glue.Types.JobRun

Methods

hashWithSalt :: Int -> JobRun -> Int #

hash :: JobRun -> Int #

type Rep JobRun Source # 
Instance details

Defined in Amazonka.Glue.Types.JobRun

type Rep JobRun = D1 ('MetaData "JobRun" "Amazonka.Glue.Types.JobRun" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "JobRun'" 'PrefixI 'True) ((((S1 ('MetaSel ('Just "allocatedCapacity") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Int)) :*: (S1 ('MetaSel ('Just "arguments") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe (HashMap Text Text))) :*: S1 ('MetaSel ('Just "attempt") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Int)))) :*: (S1 ('MetaSel ('Just "completedOn") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe POSIX)) :*: (S1 ('MetaSel ('Just "dPUSeconds") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Double)) :*: S1 ('MetaSel ('Just "errorMessage") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text))))) :*: ((S1 ('MetaSel ('Just "executionClass") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe ExecutionClass)) :*: (S1 ('MetaSel ('Just "executionTime") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Int)) :*: S1 ('MetaSel ('Just "glueVersion") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)))) :*: (S1 ('MetaSel ('Just "id") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: (S1 ('MetaSel ('Just "jobName") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "jobRunState") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe JobRunState)))))) :*: (((S1 ('MetaSel ('Just "lastModifiedOn") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe POSIX)) :*: (S1 ('MetaSel ('Just "logGroupName") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "maxCapacity") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Double)))) :*: (S1 ('MetaSel ('Just "notificationProperty") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe NotificationProperty)) :*: (S1 ('MetaSel ('Just "numberOfWorkers") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Int)) :*: S1 ('MetaSel ('Just "predecessorRuns") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe [Predecessor]))))) :*: ((S1 ('MetaSel ('Just "previousRunId") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: (S1 ('MetaSel ('Just "securityConfiguration") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "startedOn") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe POSIX)))) :*: (S1 ('MetaSel ('Just "timeout") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Natural)) :*: (S1 ('MetaSel ('Just "triggerName") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "workerType") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe WorkerType))))))))

newJobRun :: JobRun Source #

Create a value of JobRun with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:allocatedCapacity:JobRun', jobRun_allocatedCapacity - This field is deprecated. Use MaxCapacity instead.

The number of Glue data processing units (DPUs) allocated to this JobRun. From 2 to 100 DPUs can be allocated; the default is 10. A DPU is a relative measure of processing power that consists of 4 vCPUs of compute capacity and 16 GB of memory. For more information, see the Glue pricing page.

$sel:arguments:JobRun', jobRun_arguments - The job arguments associated with this run. For this job run, they replace the default arguments set in the job definition itself.

You can specify arguments here that your own job-execution script consumes, as well as arguments that Glue itself consumes.

For information about how to specify and consume your own job arguments, see the Calling Glue APIs in Python topic in the developer guide.

For information about the key-value pairs that Glue consumes to set up your job, see the Special Parameters Used by Glue topic in the developer guide.

$sel:attempt:JobRun', jobRun_attempt - The number of the attempt to run this job.

$sel:completedOn:JobRun', jobRun_completedOn - The date and time that this job run completed.

$sel:dPUSeconds:JobRun', jobRun_dPUSeconds - This field populates only for Auto Scaling job runs, and represents the total time each executor ran during the lifecycle of a job run in seconds, multiplied by a DPU factor (1 for G.1X, 2 for G.2X, or 0.25 for G.025X workers). This value may be different than the executionEngineRuntime * MaxCapacity as in the case of Auto Scaling jobs, as the number of executors running at a given time may be less than the MaxCapacity. Therefore, it is possible that the value of DPUSeconds is less than executionEngineRuntime * MaxCapacity.

$sel:errorMessage:JobRun', jobRun_errorMessage - An error message associated with this job run.

$sel:executionClass:JobRun', jobRun_executionClass - Indicates whether the job is run with a standard or flexible execution class. The standard execution-class is ideal for time-sensitive workloads that require fast job startup and dedicated resources.

The flexible execution class is appropriate for time-insensitive jobs whose start and completion times may vary.

Only jobs with Glue version 3.0 and above and command type glueetl will be allowed to set ExecutionClass to FLEX. The flexible execution class is available for Spark jobs.

$sel:executionTime:JobRun', jobRun_executionTime - The amount of time (in seconds) that the job run consumed resources.

$sel:glueVersion:JobRun', jobRun_glueVersion - Glue version determines the versions of Apache Spark and Python that Glue supports. The Python version indicates the version supported for jobs of type Spark.

For more information about the available Glue versions and corresponding Spark and Python versions, see Glue version in the developer guide.

Jobs that are created without specifying a Glue version default to Glue 0.9.

$sel:id:JobRun', jobRun_id - The ID of this job run.

JobRun, jobRun_jobName - The name of the job definition being used in this run.

$sel:jobRunState:JobRun', jobRun_jobRunState - The current state of the job run. For more information about the statuses of jobs that have terminated abnormally, see Glue Job Run Statuses.

$sel:lastModifiedOn:JobRun', jobRun_lastModifiedOn - The last time that this job run was modified.

$sel:logGroupName:JobRun', jobRun_logGroupName - The name of the log group for secure logging that can be server-side encrypted in Amazon CloudWatch using KMS. This name can be /aws-glue/jobs/, in which case the default encryption is NONE. If you add a role name and SecurityConfiguration name (in other words, /aws-glue/jobs-yourRoleName-yourSecurityConfigurationName/), then that security configuration is used to encrypt the log group.

$sel:maxCapacity:JobRun', jobRun_maxCapacity - The number of Glue data processing units (DPUs) that can be allocated when this job runs. A DPU is a relative measure of processing power that consists of 4 vCPUs of compute capacity and 16 GB of memory. For more information, see the Glue pricing page.

Do not set Max Capacity if using WorkerType and NumberOfWorkers.

The value that can be allocated for MaxCapacity depends on whether you are running a Python shell job or an Apache Spark ETL job:

  • When you specify a Python shell job (JobCommand.Name="pythonshell"), you can allocate either 0.0625 or 1 DPU. The default is 0.0625 DPU.
  • When you specify an Apache Spark ETL job (JobCommand.Name="glueetl"), you can allocate a minimum of 2 DPUs. The default is 10 DPUs. This job type cannot have a fractional DPU allocation.

$sel:notificationProperty:JobRun', jobRun_notificationProperty - Specifies configuration properties of a job run notification.

$sel:numberOfWorkers:JobRun', jobRun_numberOfWorkers - The number of workers of a defined workerType that are allocated when a job runs.

$sel:predecessorRuns:JobRun', jobRun_predecessorRuns - A list of predecessors to this job run.

$sel:previousRunId:JobRun', jobRun_previousRunId - The ID of the previous run of this job. For example, the JobRunId specified in the StartJobRun action.

$sel:securityConfiguration:JobRun', jobRun_securityConfiguration - The name of the SecurityConfiguration structure to be used with this job run.

$sel:startedOn:JobRun', jobRun_startedOn - The date and time at which this job run was started.

$sel:timeout:JobRun', jobRun_timeout - The JobRun timeout in minutes. This is the maximum time that a job run can consume resources before it is terminated and enters TIMEOUT status. This value overrides the timeout value set in the parent job.

Streaming jobs do not have a timeout. The default for non-streaming jobs is 2,880 minutes (48 hours).

$sel:triggerName:JobRun', jobRun_triggerName - The name of the trigger that started this job run.

$sel:workerType:JobRun', jobRun_workerType - The type of predefined worker that is allocated when a job runs. Accepts a value of Standard, G.1X, G.2X, or G.025X.

  • For the Standard worker type, each worker provides 4 vCPU, 16 GB of memory and a 50GB disk, and 2 executors per worker.
  • For the G.1X worker type, each worker provides 4 vCPU, 16 GB of memory and a 64GB disk, and 1 executor per worker.
  • For the G.2X worker type, each worker provides 8 vCPU, 32 GB of memory and a 128GB disk, and 1 executor per worker.
  • For the G.025X worker type, each worker maps to 0.25 DPU (2 vCPU, 4 GB of memory, 64 GB disk), and provides 1 executor per worker. We recommend this worker type for low volume streaming jobs. This worker type is only available for Glue version 3.0 streaming jobs.

jobRun_allocatedCapacity :: Lens' JobRun (Maybe Int) Source #

This field is deprecated. Use MaxCapacity instead.

The number of Glue data processing units (DPUs) allocated to this JobRun. From 2 to 100 DPUs can be allocated; the default is 10. A DPU is a relative measure of processing power that consists of 4 vCPUs of compute capacity and 16 GB of memory. For more information, see the Glue pricing page.

jobRun_arguments :: Lens' JobRun (Maybe (HashMap Text Text)) Source #

The job arguments associated with this run. For this job run, they replace the default arguments set in the job definition itself.

You can specify arguments here that your own job-execution script consumes, as well as arguments that Glue itself consumes.

For information about how to specify and consume your own job arguments, see the Calling Glue APIs in Python topic in the developer guide.

For information about the key-value pairs that Glue consumes to set up your job, see the Special Parameters Used by Glue topic in the developer guide.

jobRun_attempt :: Lens' JobRun (Maybe Int) Source #

The number of the attempt to run this job.

jobRun_completedOn :: Lens' JobRun (Maybe UTCTime) Source #

The date and time that this job run completed.

jobRun_dPUSeconds :: Lens' JobRun (Maybe Double) Source #

This field populates only for Auto Scaling job runs, and represents the total time each executor ran during the lifecycle of a job run in seconds, multiplied by a DPU factor (1 for G.1X, 2 for G.2X, or 0.25 for G.025X workers). This value may be different than the executionEngineRuntime * MaxCapacity as in the case of Auto Scaling jobs, as the number of executors running at a given time may be less than the MaxCapacity. Therefore, it is possible that the value of DPUSeconds is less than executionEngineRuntime * MaxCapacity.

jobRun_errorMessage :: Lens' JobRun (Maybe Text) Source #

An error message associated with this job run.

jobRun_executionClass :: Lens' JobRun (Maybe ExecutionClass) Source #

Indicates whether the job is run with a standard or flexible execution class. The standard execution-class is ideal for time-sensitive workloads that require fast job startup and dedicated resources.

The flexible execution class is appropriate for time-insensitive jobs whose start and completion times may vary.

Only jobs with Glue version 3.0 and above and command type glueetl will be allowed to set ExecutionClass to FLEX. The flexible execution class is available for Spark jobs.

jobRun_executionTime :: Lens' JobRun (Maybe Int) Source #

The amount of time (in seconds) that the job run consumed resources.

jobRun_glueVersion :: Lens' JobRun (Maybe Text) Source #

Glue version determines the versions of Apache Spark and Python that Glue supports. The Python version indicates the version supported for jobs of type Spark.

For more information about the available Glue versions and corresponding Spark and Python versions, see Glue version in the developer guide.

Jobs that are created without specifying a Glue version default to Glue 0.9.

jobRun_id :: Lens' JobRun (Maybe Text) Source #

The ID of this job run.

jobRun_jobName :: Lens' JobRun (Maybe Text) Source #

The name of the job definition being used in this run.

jobRun_jobRunState :: Lens' JobRun (Maybe JobRunState) Source #

The current state of the job run. For more information about the statuses of jobs that have terminated abnormally, see Glue Job Run Statuses.

jobRun_lastModifiedOn :: Lens' JobRun (Maybe UTCTime) Source #

The last time that this job run was modified.

jobRun_logGroupName :: Lens' JobRun (Maybe Text) Source #

The name of the log group for secure logging that can be server-side encrypted in Amazon CloudWatch using KMS. This name can be /aws-glue/jobs/, in which case the default encryption is NONE. If you add a role name and SecurityConfiguration name (in other words, /aws-glue/jobs-yourRoleName-yourSecurityConfigurationName/), then that security configuration is used to encrypt the log group.

jobRun_maxCapacity :: Lens' JobRun (Maybe Double) Source #

The number of Glue data processing units (DPUs) that can be allocated when this job runs. A DPU is a relative measure of processing power that consists of 4 vCPUs of compute capacity and 16 GB of memory. For more information, see the Glue pricing page.

Do not set Max Capacity if using WorkerType and NumberOfWorkers.

The value that can be allocated for MaxCapacity depends on whether you are running a Python shell job or an Apache Spark ETL job:

  • When you specify a Python shell job (JobCommand.Name="pythonshell"), you can allocate either 0.0625 or 1 DPU. The default is 0.0625 DPU.
  • When you specify an Apache Spark ETL job (JobCommand.Name="glueetl"), you can allocate a minimum of 2 DPUs. The default is 10 DPUs. This job type cannot have a fractional DPU allocation.

jobRun_notificationProperty :: Lens' JobRun (Maybe NotificationProperty) Source #

Specifies configuration properties of a job run notification.

jobRun_numberOfWorkers :: Lens' JobRun (Maybe Int) Source #

The number of workers of a defined workerType that are allocated when a job runs.

jobRun_predecessorRuns :: Lens' JobRun (Maybe [Predecessor]) Source #

A list of predecessors to this job run.

jobRun_previousRunId :: Lens' JobRun (Maybe Text) Source #

The ID of the previous run of this job. For example, the JobRunId specified in the StartJobRun action.

jobRun_securityConfiguration :: Lens' JobRun (Maybe Text) Source #

The name of the SecurityConfiguration structure to be used with this job run.

jobRun_startedOn :: Lens' JobRun (Maybe UTCTime) Source #

The date and time at which this job run was started.

jobRun_timeout :: Lens' JobRun (Maybe Natural) Source #

The JobRun timeout in minutes. This is the maximum time that a job run can consume resources before it is terminated and enters TIMEOUT status. This value overrides the timeout value set in the parent job.

Streaming jobs do not have a timeout. The default for non-streaming jobs is 2,880 minutes (48 hours).

jobRun_triggerName :: Lens' JobRun (Maybe Text) Source #

The name of the trigger that started this job run.

jobRun_workerType :: Lens' JobRun (Maybe WorkerType) Source #

The type of predefined worker that is allocated when a job runs. Accepts a value of Standard, G.1X, G.2X, or G.025X.

  • For the Standard worker type, each worker provides 4 vCPU, 16 GB of memory and a 50GB disk, and 2 executors per worker.
  • For the G.1X worker type, each worker provides 4 vCPU, 16 GB of memory and a 64GB disk, and 1 executor per worker.
  • For the G.2X worker type, each worker provides 8 vCPU, 32 GB of memory and a 128GB disk, and 1 executor per worker.
  • For the G.025X worker type, each worker maps to 0.25 DPU (2 vCPU, 4 GB of memory, 64 GB disk), and provides 1 executor per worker. We recommend this worker type for low volume streaming jobs. This worker type is only available for Glue version 3.0 streaming jobs.

JobUpdate

data JobUpdate Source #

Specifies information used to update an existing job definition. The previous job definition is completely overwritten by this information.

See: newJobUpdate smart constructor.

Constructors

JobUpdate' 

Fields

  • allocatedCapacity :: Maybe Int

    This field is deprecated. Use MaxCapacity instead.

    The number of Glue data processing units (DPUs) to allocate to this job. You can allocate a minimum of 2 DPUs; the default is 10. A DPU is a relative measure of processing power that consists of 4 vCPUs of compute capacity and 16 GB of memory. For more information, see the Glue pricing page.

  • codeGenConfigurationNodes :: Maybe (Sensitive (HashMap Text CodeGenConfigurationNode))

    The representation of a directed acyclic graph on which both the Glue Studio visual component and Glue Studio code generation is based.

  • command :: Maybe JobCommand

    The JobCommand that runs this job (required).

  • connections :: Maybe ConnectionsList

    The connections used for this job.

  • defaultArguments :: Maybe (HashMap Text Text)

    The default arguments for this job.

    You can specify arguments here that your own job-execution script consumes, as well as arguments that Glue itself consumes.

    For information about how to specify and consume your own Job arguments, see the Calling Glue APIs in Python topic in the developer guide.

    For information about the key-value pairs that Glue consumes to set up your job, see the Special Parameters Used by Glue topic in the developer guide.

  • description :: Maybe Text

    Description of the job being defined.

  • executionClass :: Maybe ExecutionClass

    Indicates whether the job is run with a standard or flexible execution class. The standard execution-class is ideal for time-sensitive workloads that require fast job startup and dedicated resources.

    The flexible execution class is appropriate for time-insensitive jobs whose start and completion times may vary.

    Only jobs with Glue version 3.0 and above and command type glueetl will be allowed to set ExecutionClass to FLEX. The flexible execution class is available for Spark jobs.

  • executionProperty :: Maybe ExecutionProperty

    An ExecutionProperty specifying the maximum number of concurrent runs allowed for this job.

  • glueVersion :: Maybe Text

    Glue version determines the versions of Apache Spark and Python that Glue supports. The Python version indicates the version supported for jobs of type Spark.

    For more information about the available Glue versions and corresponding Spark and Python versions, see Glue version in the developer guide.

  • logUri :: Maybe Text

    This field is reserved for future use.

  • maxCapacity :: Maybe Double

    For Glue version 1.0 or earlier jobs, using the standard worker type, the number of Glue data processing units (DPUs) that can be allocated when this job runs. A DPU is a relative measure of processing power that consists of 4 vCPUs of compute capacity and 16 GB of memory. For more information, see the Glue pricing page.

    Do not set Max Capacity if using WorkerType and NumberOfWorkers.

    The value that can be allocated for MaxCapacity depends on whether you are running a Python shell job or an Apache Spark ETL job:

    • When you specify a Python shell job (JobCommand.Name="pythonshell"), you can allocate either 0.0625 or 1 DPU. The default is 0.0625 DPU.
    • When you specify an Apache Spark ETL job (JobCommand.Name="glueetl") or Apache Spark streaming ETL job (JobCommand.Name="gluestreaming"), you can allocate a minimum of 2 DPUs. The default is 10 DPUs. This job type cannot have a fractional DPU allocation.

    For Glue version 2.0 jobs, you cannot instead specify a Maximum capacity. Instead, you should specify a Worker type and the Number of workers.

  • maxRetries :: Maybe Int

    The maximum number of times to retry this job if it fails.

  • nonOverridableArguments :: Maybe (HashMap Text Text)

    Non-overridable arguments for this job, specified as name-value pairs.

  • notificationProperty :: Maybe NotificationProperty

    Specifies the configuration properties of a job notification.

  • numberOfWorkers :: Maybe Int

    The number of workers of a defined workerType that are allocated when a job runs.

  • role' :: Maybe Text

    The name or Amazon Resource Name (ARN) of the IAM role associated with this job (required).

  • securityConfiguration :: Maybe Text

    The name of the SecurityConfiguration structure to be used with this job.

  • sourceControlDetails :: Maybe SourceControlDetails

    The details for a source control configuration for a job, allowing synchronization of job artifacts to or from a remote repository.

  • timeout :: Maybe Natural

    The job timeout in minutes. This is the maximum time that a job run can consume resources before it is terminated and enters TIMEOUT status. The default is 2,880 minutes (48 hours).

  • workerType :: Maybe WorkerType

    The type of predefined worker that is allocated when a job runs. Accepts a value of Standard, G.1X, G.2X, or G.025X.

    • For the Standard worker type, each worker provides 4 vCPU, 16 GB of memory and a 50GB disk, and 2 executors per worker.
    • For the G.1X worker type, each worker maps to 1 DPU (4 vCPU, 16 GB of memory, 64 GB disk), and provides 1 executor per worker. We recommend this worker type for memory-intensive jobs.
    • For the G.2X worker type, each worker maps to 2 DPU (8 vCPU, 32 GB of memory, 128 GB disk), and provides 1 executor per worker. We recommend this worker type for memory-intensive jobs.
    • For the G.025X worker type, each worker maps to 0.25 DPU (2 vCPU, 4 GB of memory, 64 GB disk), and provides 1 executor per worker. We recommend this worker type for low volume streaming jobs. This worker type is only available for Glue version 3.0 streaming jobs.

Instances

Instances details
ToJSON JobUpdate Source # 
Instance details

Defined in Amazonka.Glue.Types.JobUpdate

Generic JobUpdate Source # 
Instance details

Defined in Amazonka.Glue.Types.JobUpdate

Associated Types

type Rep JobUpdate :: Type -> Type #

Show JobUpdate Source # 
Instance details

Defined in Amazonka.Glue.Types.JobUpdate

NFData JobUpdate Source # 
Instance details

Defined in Amazonka.Glue.Types.JobUpdate

Methods

rnf :: JobUpdate -> () #

Eq JobUpdate Source # 
Instance details

Defined in Amazonka.Glue.Types.JobUpdate

Hashable JobUpdate Source # 
Instance details

Defined in Amazonka.Glue.Types.JobUpdate

type Rep JobUpdate Source # 
Instance details

Defined in Amazonka.Glue.Types.JobUpdate

type Rep JobUpdate = D1 ('MetaData "JobUpdate" "Amazonka.Glue.Types.JobUpdate" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "JobUpdate'" 'PrefixI 'True) ((((S1 ('MetaSel ('Just "allocatedCapacity") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Int)) :*: S1 ('MetaSel ('Just "codeGenConfigurationNodes") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe (Sensitive (HashMap Text CodeGenConfigurationNode))))) :*: (S1 ('MetaSel ('Just "command") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe JobCommand)) :*: (S1 ('MetaSel ('Just "connections") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe ConnectionsList)) :*: S1 ('MetaSel ('Just "defaultArguments") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe (HashMap Text Text)))))) :*: ((S1 ('MetaSel ('Just "description") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "executionClass") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe ExecutionClass))) :*: (S1 ('MetaSel ('Just "executionProperty") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe ExecutionProperty)) :*: (S1 ('MetaSel ('Just "glueVersion") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "logUri") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)))))) :*: (((S1 ('MetaSel ('Just "maxCapacity") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Double)) :*: S1 ('MetaSel ('Just "maxRetries") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Int))) :*: (S1 ('MetaSel ('Just "nonOverridableArguments") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe (HashMap Text Text))) :*: (S1 ('MetaSel ('Just "notificationProperty") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe NotificationProperty)) :*: S1 ('MetaSel ('Just "numberOfWorkers") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Int))))) :*: ((S1 ('MetaSel ('Just "role'") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "securityConfiguration") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text))) :*: (S1 ('MetaSel ('Just "sourceControlDetails") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe SourceControlDetails)) :*: (S1 ('MetaSel ('Just "timeout") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Natural)) :*: S1 ('MetaSel ('Just "workerType") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe WorkerType))))))))

newJobUpdate :: JobUpdate Source #

Create a value of JobUpdate with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:allocatedCapacity:JobUpdate', jobUpdate_allocatedCapacity - This field is deprecated. Use MaxCapacity instead.

The number of Glue data processing units (DPUs) to allocate to this job. You can allocate a minimum of 2 DPUs; the default is 10. A DPU is a relative measure of processing power that consists of 4 vCPUs of compute capacity and 16 GB of memory. For more information, see the Glue pricing page.

$sel:codeGenConfigurationNodes:JobUpdate', jobUpdate_codeGenConfigurationNodes - The representation of a directed acyclic graph on which both the Glue Studio visual component and Glue Studio code generation is based.

$sel:command:JobUpdate', jobUpdate_command - The JobCommand that runs this job (required).

JobUpdate, jobUpdate_connections - The connections used for this job.

$sel:defaultArguments:JobUpdate', jobUpdate_defaultArguments - The default arguments for this job.

You can specify arguments here that your own job-execution script consumes, as well as arguments that Glue itself consumes.

For information about how to specify and consume your own Job arguments, see the Calling Glue APIs in Python topic in the developer guide.

For information about the key-value pairs that Glue consumes to set up your job, see the Special Parameters Used by Glue topic in the developer guide.

$sel:description:JobUpdate', jobUpdate_description - Description of the job being defined.

$sel:executionClass:JobUpdate', jobUpdate_executionClass - Indicates whether the job is run with a standard or flexible execution class. The standard execution-class is ideal for time-sensitive workloads that require fast job startup and dedicated resources.

The flexible execution class is appropriate for time-insensitive jobs whose start and completion times may vary.

Only jobs with Glue version 3.0 and above and command type glueetl will be allowed to set ExecutionClass to FLEX. The flexible execution class is available for Spark jobs.

$sel:executionProperty:JobUpdate', jobUpdate_executionProperty - An ExecutionProperty specifying the maximum number of concurrent runs allowed for this job.

$sel:glueVersion:JobUpdate', jobUpdate_glueVersion - Glue version determines the versions of Apache Spark and Python that Glue supports. The Python version indicates the version supported for jobs of type Spark.

For more information about the available Glue versions and corresponding Spark and Python versions, see Glue version in the developer guide.

$sel:logUri:JobUpdate', jobUpdate_logUri - This field is reserved for future use.

$sel:maxCapacity:JobUpdate', jobUpdate_maxCapacity - For Glue version 1.0 or earlier jobs, using the standard worker type, the number of Glue data processing units (DPUs) that can be allocated when this job runs. A DPU is a relative measure of processing power that consists of 4 vCPUs of compute capacity and 16 GB of memory. For more information, see the Glue pricing page.

Do not set Max Capacity if using WorkerType and NumberOfWorkers.

The value that can be allocated for MaxCapacity depends on whether you are running a Python shell job or an Apache Spark ETL job:

  • When you specify a Python shell job (JobCommand.Name="pythonshell"), you can allocate either 0.0625 or 1 DPU. The default is 0.0625 DPU.
  • When you specify an Apache Spark ETL job (JobCommand.Name="glueetl") or Apache Spark streaming ETL job (JobCommand.Name="gluestreaming"), you can allocate a minimum of 2 DPUs. The default is 10 DPUs. This job type cannot have a fractional DPU allocation.

For Glue version 2.0 jobs, you cannot instead specify a Maximum capacity. Instead, you should specify a Worker type and the Number of workers.

$sel:maxRetries:JobUpdate', jobUpdate_maxRetries - The maximum number of times to retry this job if it fails.

$sel:nonOverridableArguments:JobUpdate', jobUpdate_nonOverridableArguments - Non-overridable arguments for this job, specified as name-value pairs.

$sel:notificationProperty:JobUpdate', jobUpdate_notificationProperty - Specifies the configuration properties of a job notification.

$sel:numberOfWorkers:JobUpdate', jobUpdate_numberOfWorkers - The number of workers of a defined workerType that are allocated when a job runs.

$sel:role':JobUpdate', jobUpdate_role - The name or Amazon Resource Name (ARN) of the IAM role associated with this job (required).

$sel:securityConfiguration:JobUpdate', jobUpdate_securityConfiguration - The name of the SecurityConfiguration structure to be used with this job.

$sel:sourceControlDetails:JobUpdate', jobUpdate_sourceControlDetails - The details for a source control configuration for a job, allowing synchronization of job artifacts to or from a remote repository.

$sel:timeout:JobUpdate', jobUpdate_timeout - The job timeout in minutes. This is the maximum time that a job run can consume resources before it is terminated and enters TIMEOUT status. The default is 2,880 minutes (48 hours).

$sel:workerType:JobUpdate', jobUpdate_workerType - The type of predefined worker that is allocated when a job runs. Accepts a value of Standard, G.1X, G.2X, or G.025X.

  • For the Standard worker type, each worker provides 4 vCPU, 16 GB of memory and a 50GB disk, and 2 executors per worker.
  • For the G.1X worker type, each worker maps to 1 DPU (4 vCPU, 16 GB of memory, 64 GB disk), and provides 1 executor per worker. We recommend this worker type for memory-intensive jobs.
  • For the G.2X worker type, each worker maps to 2 DPU (8 vCPU, 32 GB of memory, 128 GB disk), and provides 1 executor per worker. We recommend this worker type for memory-intensive jobs.
  • For the G.025X worker type, each worker maps to 0.25 DPU (2 vCPU, 4 GB of memory, 64 GB disk), and provides 1 executor per worker. We recommend this worker type for low volume streaming jobs. This worker type is only available for Glue version 3.0 streaming jobs.

jobUpdate_allocatedCapacity :: Lens' JobUpdate (Maybe Int) Source #

This field is deprecated. Use MaxCapacity instead.

The number of Glue data processing units (DPUs) to allocate to this job. You can allocate a minimum of 2 DPUs; the default is 10. A DPU is a relative measure of processing power that consists of 4 vCPUs of compute capacity and 16 GB of memory. For more information, see the Glue pricing page.

jobUpdate_codeGenConfigurationNodes :: Lens' JobUpdate (Maybe (HashMap Text CodeGenConfigurationNode)) Source #

The representation of a directed acyclic graph on which both the Glue Studio visual component and Glue Studio code generation is based.

jobUpdate_command :: Lens' JobUpdate (Maybe JobCommand) Source #

The JobCommand that runs this job (required).

jobUpdate_connections :: Lens' JobUpdate (Maybe ConnectionsList) Source #

The connections used for this job.

jobUpdate_defaultArguments :: Lens' JobUpdate (Maybe (HashMap Text Text)) Source #

The default arguments for this job.

You can specify arguments here that your own job-execution script consumes, as well as arguments that Glue itself consumes.

For information about how to specify and consume your own Job arguments, see the Calling Glue APIs in Python topic in the developer guide.

For information about the key-value pairs that Glue consumes to set up your job, see the Special Parameters Used by Glue topic in the developer guide.

jobUpdate_description :: Lens' JobUpdate (Maybe Text) Source #

Description of the job being defined.

jobUpdate_executionClass :: Lens' JobUpdate (Maybe ExecutionClass) Source #

Indicates whether the job is run with a standard or flexible execution class. The standard execution-class is ideal for time-sensitive workloads that require fast job startup and dedicated resources.

The flexible execution class is appropriate for time-insensitive jobs whose start and completion times may vary.

Only jobs with Glue version 3.0 and above and command type glueetl will be allowed to set ExecutionClass to FLEX. The flexible execution class is available for Spark jobs.

jobUpdate_executionProperty :: Lens' JobUpdate (Maybe ExecutionProperty) Source #

An ExecutionProperty specifying the maximum number of concurrent runs allowed for this job.

jobUpdate_glueVersion :: Lens' JobUpdate (Maybe Text) Source #

Glue version determines the versions of Apache Spark and Python that Glue supports. The Python version indicates the version supported for jobs of type Spark.

For more information about the available Glue versions and corresponding Spark and Python versions, see Glue version in the developer guide.

jobUpdate_logUri :: Lens' JobUpdate (Maybe Text) Source #

This field is reserved for future use.

jobUpdate_maxCapacity :: Lens' JobUpdate (Maybe Double) Source #

For Glue version 1.0 or earlier jobs, using the standard worker type, the number of Glue data processing units (DPUs) that can be allocated when this job runs. A DPU is a relative measure of processing power that consists of 4 vCPUs of compute capacity and 16 GB of memory. For more information, see the Glue pricing page.

Do not set Max Capacity if using WorkerType and NumberOfWorkers.

The value that can be allocated for MaxCapacity depends on whether you are running a Python shell job or an Apache Spark ETL job:

  • When you specify a Python shell job (JobCommand.Name="pythonshell"), you can allocate either 0.0625 or 1 DPU. The default is 0.0625 DPU.
  • When you specify an Apache Spark ETL job (JobCommand.Name="glueetl") or Apache Spark streaming ETL job (JobCommand.Name="gluestreaming"), you can allocate a minimum of 2 DPUs. The default is 10 DPUs. This job type cannot have a fractional DPU allocation.

For Glue version 2.0 jobs, you cannot instead specify a Maximum capacity. Instead, you should specify a Worker type and the Number of workers.

jobUpdate_maxRetries :: Lens' JobUpdate (Maybe Int) Source #

The maximum number of times to retry this job if it fails.

jobUpdate_nonOverridableArguments :: Lens' JobUpdate (Maybe (HashMap Text Text)) Source #

Non-overridable arguments for this job, specified as name-value pairs.

jobUpdate_notificationProperty :: Lens' JobUpdate (Maybe NotificationProperty) Source #

Specifies the configuration properties of a job notification.

jobUpdate_numberOfWorkers :: Lens' JobUpdate (Maybe Int) Source #

The number of workers of a defined workerType that are allocated when a job runs.

jobUpdate_role :: Lens' JobUpdate (Maybe Text) Source #

The name or Amazon Resource Name (ARN) of the IAM role associated with this job (required).

jobUpdate_securityConfiguration :: Lens' JobUpdate (Maybe Text) Source #

The name of the SecurityConfiguration structure to be used with this job.

jobUpdate_sourceControlDetails :: Lens' JobUpdate (Maybe SourceControlDetails) Source #

The details for a source control configuration for a job, allowing synchronization of job artifacts to or from a remote repository.

jobUpdate_timeout :: Lens' JobUpdate (Maybe Natural) Source #

The job timeout in minutes. This is the maximum time that a job run can consume resources before it is terminated and enters TIMEOUT status. The default is 2,880 minutes (48 hours).

jobUpdate_workerType :: Lens' JobUpdate (Maybe WorkerType) Source #

The type of predefined worker that is allocated when a job runs. Accepts a value of Standard, G.1X, G.2X, or G.025X.

  • For the Standard worker type, each worker provides 4 vCPU, 16 GB of memory and a 50GB disk, and 2 executors per worker.
  • For the G.1X worker type, each worker maps to 1 DPU (4 vCPU, 16 GB of memory, 64 GB disk), and provides 1 executor per worker. We recommend this worker type for memory-intensive jobs.
  • For the G.2X worker type, each worker maps to 2 DPU (8 vCPU, 32 GB of memory, 128 GB disk), and provides 1 executor per worker. We recommend this worker type for memory-intensive jobs.
  • For the G.025X worker type, each worker maps to 0.25 DPU (2 vCPU, 4 GB of memory, 64 GB disk), and provides 1 executor per worker. We recommend this worker type for low volume streaming jobs. This worker type is only available for Glue version 3.0 streaming jobs.

Join

data Join Source #

Specifies a transform that joins two datasets into one dataset using a comparison phrase on the specified data property keys. You can use inner, outer, left, right, left semi, and left anti joins.

See: newJoin smart constructor.

Constructors

Join' 

Fields

Instances

Instances details
FromJSON Join Source # 
Instance details

Defined in Amazonka.Glue.Types.Join

ToJSON Join Source # 
Instance details

Defined in Amazonka.Glue.Types.Join

Generic Join Source # 
Instance details

Defined in Amazonka.Glue.Types.Join

Associated Types

type Rep Join :: Type -> Type #

Methods

from :: Join -> Rep Join x #

to :: Rep Join x -> Join #

Read Join Source # 
Instance details

Defined in Amazonka.Glue.Types.Join

Show Join Source # 
Instance details

Defined in Amazonka.Glue.Types.Join

Methods

showsPrec :: Int -> Join -> ShowS #

show :: Join -> String #

showList :: [Join] -> ShowS #

NFData Join Source # 
Instance details

Defined in Amazonka.Glue.Types.Join

Methods

rnf :: Join -> () #

Eq Join Source # 
Instance details

Defined in Amazonka.Glue.Types.Join

Methods

(==) :: Join -> Join -> Bool #

(/=) :: Join -> Join -> Bool #

Hashable Join Source # 
Instance details

Defined in Amazonka.Glue.Types.Join

Methods

hashWithSalt :: Int -> Join -> Int #

hash :: Join -> Int #

type Rep Join Source # 
Instance details

Defined in Amazonka.Glue.Types.Join

newJoin Source #

Create a value of Join with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:name:Join', join_name - The name of the transform node.

$sel:inputs:Join', join_inputs - The data inputs identified by their node names.

$sel:joinType:Join', join_joinType - Specifies the type of join to be performed on the datasets.

$sel:columns:Join', join_columns - A list of the two columns to be joined.

join_name :: Lens' Join Text Source #

The name of the transform node.

join_inputs :: Lens' Join (NonEmpty Text) Source #

The data inputs identified by their node names.

join_joinType :: Lens' Join JoinType Source #

Specifies the type of join to be performed on the datasets.

join_columns :: Lens' Join (NonEmpty JoinColumn) Source #

A list of the two columns to be joined.

JoinColumn

data JoinColumn Source #

Specifies a column to be joined.

See: newJoinColumn smart constructor.

Constructors

JoinColumn' 

Fields

  • from :: Text

    The column to be joined.

  • keys :: [[Text]]

    The key of the column to be joined.

Instances

Instances details
FromJSON JoinColumn Source # 
Instance details

Defined in Amazonka.Glue.Types.JoinColumn

ToJSON JoinColumn Source # 
Instance details

Defined in Amazonka.Glue.Types.JoinColumn

Generic JoinColumn Source # 
Instance details

Defined in Amazonka.Glue.Types.JoinColumn

Associated Types

type Rep JoinColumn :: Type -> Type #

Read JoinColumn Source # 
Instance details

Defined in Amazonka.Glue.Types.JoinColumn

Show JoinColumn Source # 
Instance details

Defined in Amazonka.Glue.Types.JoinColumn

NFData JoinColumn Source # 
Instance details

Defined in Amazonka.Glue.Types.JoinColumn

Methods

rnf :: JoinColumn -> () #

Eq JoinColumn Source # 
Instance details

Defined in Amazonka.Glue.Types.JoinColumn

Hashable JoinColumn Source # 
Instance details

Defined in Amazonka.Glue.Types.JoinColumn

type Rep JoinColumn Source # 
Instance details

Defined in Amazonka.Glue.Types.JoinColumn

type Rep JoinColumn = D1 ('MetaData "JoinColumn" "Amazonka.Glue.Types.JoinColumn" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "JoinColumn'" 'PrefixI 'True) (S1 ('MetaSel ('Just "from") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text) :*: S1 ('MetaSel ('Just "keys") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 [[Text]])))

newJoinColumn Source #

Create a value of JoinColumn with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:from:JoinColumn', joinColumn_from - The column to be joined.

$sel:keys:JoinColumn', joinColumn_keys - The key of the column to be joined.

joinColumn_from :: Lens' JoinColumn Text Source #

The column to be joined.

joinColumn_keys :: Lens' JoinColumn [[Text]] Source #

The key of the column to be joined.

JsonClassifier

data JsonClassifier Source #

A classifier for JSON content.

See: newJsonClassifier smart constructor.

Constructors

JsonClassifier' 

Fields

Instances

Instances details
FromJSON JsonClassifier Source # 
Instance details

Defined in Amazonka.Glue.Types.JsonClassifier

Generic JsonClassifier Source # 
Instance details

Defined in Amazonka.Glue.Types.JsonClassifier

Associated Types

type Rep JsonClassifier :: Type -> Type #

Read JsonClassifier Source # 
Instance details

Defined in Amazonka.Glue.Types.JsonClassifier

Show JsonClassifier Source # 
Instance details

Defined in Amazonka.Glue.Types.JsonClassifier

NFData JsonClassifier Source # 
Instance details

Defined in Amazonka.Glue.Types.JsonClassifier

Methods

rnf :: JsonClassifier -> () #

Eq JsonClassifier Source # 
Instance details

Defined in Amazonka.Glue.Types.JsonClassifier

Hashable JsonClassifier Source # 
Instance details

Defined in Amazonka.Glue.Types.JsonClassifier

type Rep JsonClassifier Source # 
Instance details

Defined in Amazonka.Glue.Types.JsonClassifier

type Rep JsonClassifier = D1 ('MetaData "JsonClassifier" "Amazonka.Glue.Types.JsonClassifier" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "JsonClassifier'" 'PrefixI 'True) ((S1 ('MetaSel ('Just "creationTime") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe POSIX)) :*: S1 ('MetaSel ('Just "lastUpdated") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe POSIX))) :*: (S1 ('MetaSel ('Just "version") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Integer)) :*: (S1 ('MetaSel ('Just "name") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text) :*: S1 ('MetaSel ('Just "jsonPath") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text)))))

newJsonClassifier Source #

Create a value of JsonClassifier with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:creationTime:JsonClassifier', jsonClassifier_creationTime - The time that this classifier was registered.

$sel:lastUpdated:JsonClassifier', jsonClassifier_lastUpdated - The time that this classifier was last updated.

$sel:version:JsonClassifier', jsonClassifier_version - The version of this classifier.

$sel:name:JsonClassifier', jsonClassifier_name - The name of the classifier.

$sel:jsonPath:JsonClassifier', jsonClassifier_jsonPath - A JsonPath string defining the JSON data for the classifier to classify. Glue supports a subset of JsonPath, as described in Writing JsonPath Custom Classifiers.

jsonClassifier_creationTime :: Lens' JsonClassifier (Maybe UTCTime) Source #

The time that this classifier was registered.

jsonClassifier_lastUpdated :: Lens' JsonClassifier (Maybe UTCTime) Source #

The time that this classifier was last updated.

jsonClassifier_version :: Lens' JsonClassifier (Maybe Integer) Source #

The version of this classifier.

jsonClassifier_name :: Lens' JsonClassifier Text Source #

The name of the classifier.

jsonClassifier_jsonPath :: Lens' JsonClassifier Text Source #

A JsonPath string defining the JSON data for the classifier to classify. Glue supports a subset of JsonPath, as described in Writing JsonPath Custom Classifiers.

KafkaStreamingSourceOptions

data KafkaStreamingSourceOptions Source #

Additional options for streaming.

See: newKafkaStreamingSourceOptions smart constructor.

Constructors

KafkaStreamingSourceOptions' 

Fields

  • assign :: Maybe Text

    The specific TopicPartitions to consume. You must specify at least one of "topicName", "assign" or "subscribePattern".

  • bootstrapServers :: Maybe Text

    A list of bootstrap server URLs, for example, as b-1.vpc-test-2.o4q88o.c6.kafka.us-east-1.amazonaws.com:9094. This option must be specified in the API call or defined in the table metadata in the Data Catalog.

  • classification :: Maybe Text

    An optional classification.

  • connectionName :: Maybe Text

    The name of the connection.

  • delimiter :: Maybe Text

    Specifies the delimiter character.

  • endingOffsets :: Maybe Text

    The end point when a batch query is ended. Possible values are either "latest" or a JSON string that specifies an ending offset for each TopicPartition.

  • maxOffsetsPerTrigger :: Maybe Natural

    The rate limit on the maximum number of offsets that are processed per trigger interval. The specified total number of offsets is proportionally split across topicPartitions of different volumes. The default value is null, which means that the consumer reads all offsets until the known latest offset.

  • minPartitions :: Maybe Natural

    The desired minimum number of partitions to read from Kafka. The default value is null, which means that the number of spark partitions is equal to the number of Kafka partitions.

  • numRetries :: Maybe Natural

    The number of times to retry before failing to fetch Kafka offsets. The default value is 3.

  • pollTimeoutMs :: Maybe Natural

    The timeout in milliseconds to poll data from Kafka in Spark job executors. The default value is 512.

  • retryIntervalMs :: Maybe Natural

    The time in milliseconds to wait before retrying to fetch Kafka offsets. The default value is 10.

  • securityProtocol :: Maybe Text

    The protocol used to communicate with brokers. The possible values are "SSL" or "PLAINTEXT".

  • startingOffsets :: Maybe Text

    The starting position in the Kafka topic to read data from. The possible values are "earliest" or "latest". The default value is "latest".

  • subscribePattern :: Maybe Text

    A Java regex string that identifies the topic list to subscribe to. You must specify at least one of "topicName", "assign" or "subscribePattern".

  • topicName :: Maybe Text

    The topic name as specified in Apache Kafka. You must specify at least one of "topicName", "assign" or "subscribePattern".

Instances

Instances details
FromJSON KafkaStreamingSourceOptions Source # 
Instance details

Defined in Amazonka.Glue.Types.KafkaStreamingSourceOptions

ToJSON KafkaStreamingSourceOptions Source # 
Instance details

Defined in Amazonka.Glue.Types.KafkaStreamingSourceOptions

Generic KafkaStreamingSourceOptions Source # 
Instance details

Defined in Amazonka.Glue.Types.KafkaStreamingSourceOptions

Associated Types

type Rep KafkaStreamingSourceOptions :: Type -> Type #

Read KafkaStreamingSourceOptions Source # 
Instance details

Defined in Amazonka.Glue.Types.KafkaStreamingSourceOptions

Show KafkaStreamingSourceOptions Source # 
Instance details

Defined in Amazonka.Glue.Types.KafkaStreamingSourceOptions

NFData KafkaStreamingSourceOptions Source # 
Instance details

Defined in Amazonka.Glue.Types.KafkaStreamingSourceOptions

Eq KafkaStreamingSourceOptions Source # 
Instance details

Defined in Amazonka.Glue.Types.KafkaStreamingSourceOptions

Hashable KafkaStreamingSourceOptions Source # 
Instance details

Defined in Amazonka.Glue.Types.KafkaStreamingSourceOptions

type Rep KafkaStreamingSourceOptions Source # 
Instance details

Defined in Amazonka.Glue.Types.KafkaStreamingSourceOptions

type Rep KafkaStreamingSourceOptions = D1 ('MetaData "KafkaStreamingSourceOptions" "Amazonka.Glue.Types.KafkaStreamingSourceOptions" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "KafkaStreamingSourceOptions'" 'PrefixI 'True) (((S1 ('MetaSel ('Just "assign") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: (S1 ('MetaSel ('Just "bootstrapServers") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "classification") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)))) :*: ((S1 ('MetaSel ('Just "connectionName") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "delimiter") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text))) :*: (S1 ('MetaSel ('Just "endingOffsets") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "maxOffsetsPerTrigger") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Natural))))) :*: (((S1 ('MetaSel ('Just "minPartitions") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Natural)) :*: S1 ('MetaSel ('Just "numRetries") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Natural))) :*: (S1 ('MetaSel ('Just "pollTimeoutMs") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Natural)) :*: S1 ('MetaSel ('Just "retryIntervalMs") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Natural)))) :*: ((S1 ('MetaSel ('Just "securityProtocol") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "startingOffsets") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text))) :*: (S1 ('MetaSel ('Just "subscribePattern") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "topicName") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)))))))

newKafkaStreamingSourceOptions :: KafkaStreamingSourceOptions Source #

Create a value of KafkaStreamingSourceOptions with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:assign:KafkaStreamingSourceOptions', kafkaStreamingSourceOptions_assign - The specific TopicPartitions to consume. You must specify at least one of "topicName", "assign" or "subscribePattern".

$sel:bootstrapServers:KafkaStreamingSourceOptions', kafkaStreamingSourceOptions_bootstrapServers - A list of bootstrap server URLs, for example, as b-1.vpc-test-2.o4q88o.c6.kafka.us-east-1.amazonaws.com:9094. This option must be specified in the API call or defined in the table metadata in the Data Catalog.

$sel:classification:KafkaStreamingSourceOptions', kafkaStreamingSourceOptions_classification - An optional classification.

$sel:connectionName:KafkaStreamingSourceOptions', kafkaStreamingSourceOptions_connectionName - The name of the connection.

$sel:delimiter:KafkaStreamingSourceOptions', kafkaStreamingSourceOptions_delimiter - Specifies the delimiter character.

$sel:endingOffsets:KafkaStreamingSourceOptions', kafkaStreamingSourceOptions_endingOffsets - The end point when a batch query is ended. Possible values are either "latest" or a JSON string that specifies an ending offset for each TopicPartition.

$sel:maxOffsetsPerTrigger:KafkaStreamingSourceOptions', kafkaStreamingSourceOptions_maxOffsetsPerTrigger - The rate limit on the maximum number of offsets that are processed per trigger interval. The specified total number of offsets is proportionally split across topicPartitions of different volumes. The default value is null, which means that the consumer reads all offsets until the known latest offset.

$sel:minPartitions:KafkaStreamingSourceOptions', kafkaStreamingSourceOptions_minPartitions - The desired minimum number of partitions to read from Kafka. The default value is null, which means that the number of spark partitions is equal to the number of Kafka partitions.

$sel:numRetries:KafkaStreamingSourceOptions', kafkaStreamingSourceOptions_numRetries - The number of times to retry before failing to fetch Kafka offsets. The default value is 3.

$sel:pollTimeoutMs:KafkaStreamingSourceOptions', kafkaStreamingSourceOptions_pollTimeoutMs - The timeout in milliseconds to poll data from Kafka in Spark job executors. The default value is 512.

$sel:retryIntervalMs:KafkaStreamingSourceOptions', kafkaStreamingSourceOptions_retryIntervalMs - The time in milliseconds to wait before retrying to fetch Kafka offsets. The default value is 10.

$sel:securityProtocol:KafkaStreamingSourceOptions', kafkaStreamingSourceOptions_securityProtocol - The protocol used to communicate with brokers. The possible values are "SSL" or "PLAINTEXT".

$sel:startingOffsets:KafkaStreamingSourceOptions', kafkaStreamingSourceOptions_startingOffsets - The starting position in the Kafka topic to read data from. The possible values are "earliest" or "latest". The default value is "latest".

$sel:subscribePattern:KafkaStreamingSourceOptions', kafkaStreamingSourceOptions_subscribePattern - A Java regex string that identifies the topic list to subscribe to. You must specify at least one of "topicName", "assign" or "subscribePattern".

$sel:topicName:KafkaStreamingSourceOptions', kafkaStreamingSourceOptions_topicName - The topic name as specified in Apache Kafka. You must specify at least one of "topicName", "assign" or "subscribePattern".

kafkaStreamingSourceOptions_assign :: Lens' KafkaStreamingSourceOptions (Maybe Text) Source #

The specific TopicPartitions to consume. You must specify at least one of "topicName", "assign" or "subscribePattern".

kafkaStreamingSourceOptions_bootstrapServers :: Lens' KafkaStreamingSourceOptions (Maybe Text) Source #

A list of bootstrap server URLs, for example, as b-1.vpc-test-2.o4q88o.c6.kafka.us-east-1.amazonaws.com:9094. This option must be specified in the API call or defined in the table metadata in the Data Catalog.

kafkaStreamingSourceOptions_endingOffsets :: Lens' KafkaStreamingSourceOptions (Maybe Text) Source #

The end point when a batch query is ended. Possible values are either "latest" or a JSON string that specifies an ending offset for each TopicPartition.

kafkaStreamingSourceOptions_maxOffsetsPerTrigger :: Lens' KafkaStreamingSourceOptions (Maybe Natural) Source #

The rate limit on the maximum number of offsets that are processed per trigger interval. The specified total number of offsets is proportionally split across topicPartitions of different volumes. The default value is null, which means that the consumer reads all offsets until the known latest offset.

kafkaStreamingSourceOptions_minPartitions :: Lens' KafkaStreamingSourceOptions (Maybe Natural) Source #

The desired minimum number of partitions to read from Kafka. The default value is null, which means that the number of spark partitions is equal to the number of Kafka partitions.

kafkaStreamingSourceOptions_numRetries :: Lens' KafkaStreamingSourceOptions (Maybe Natural) Source #

The number of times to retry before failing to fetch Kafka offsets. The default value is 3.

kafkaStreamingSourceOptions_pollTimeoutMs :: Lens' KafkaStreamingSourceOptions (Maybe Natural) Source #

The timeout in milliseconds to poll data from Kafka in Spark job executors. The default value is 512.

kafkaStreamingSourceOptions_retryIntervalMs :: Lens' KafkaStreamingSourceOptions (Maybe Natural) Source #

The time in milliseconds to wait before retrying to fetch Kafka offsets. The default value is 10.

kafkaStreamingSourceOptions_securityProtocol :: Lens' KafkaStreamingSourceOptions (Maybe Text) Source #

The protocol used to communicate with brokers. The possible values are "SSL" or "PLAINTEXT".

kafkaStreamingSourceOptions_startingOffsets :: Lens' KafkaStreamingSourceOptions (Maybe Text) Source #

The starting position in the Kafka topic to read data from. The possible values are "earliest" or "latest". The default value is "latest".

kafkaStreamingSourceOptions_subscribePattern :: Lens' KafkaStreamingSourceOptions (Maybe Text) Source #

A Java regex string that identifies the topic list to subscribe to. You must specify at least one of "topicName", "assign" or "subscribePattern".

kafkaStreamingSourceOptions_topicName :: Lens' KafkaStreamingSourceOptions (Maybe Text) Source #

The topic name as specified in Apache Kafka. You must specify at least one of "topicName", "assign" or "subscribePattern".

KeySchemaElement

data KeySchemaElement Source #

A partition key pair consisting of a name and a type.

See: newKeySchemaElement smart constructor.

Constructors

KeySchemaElement' 

Fields

Instances

Instances details
FromJSON KeySchemaElement Source # 
Instance details

Defined in Amazonka.Glue.Types.KeySchemaElement

Generic KeySchemaElement Source # 
Instance details

Defined in Amazonka.Glue.Types.KeySchemaElement

Associated Types

type Rep KeySchemaElement :: Type -> Type #

Read KeySchemaElement Source # 
Instance details

Defined in Amazonka.Glue.Types.KeySchemaElement

Show KeySchemaElement Source # 
Instance details

Defined in Amazonka.Glue.Types.KeySchemaElement

NFData KeySchemaElement Source # 
Instance details

Defined in Amazonka.Glue.Types.KeySchemaElement

Methods

rnf :: KeySchemaElement -> () #

Eq KeySchemaElement Source # 
Instance details

Defined in Amazonka.Glue.Types.KeySchemaElement

Hashable KeySchemaElement Source # 
Instance details

Defined in Amazonka.Glue.Types.KeySchemaElement

type Rep KeySchemaElement Source # 
Instance details

Defined in Amazonka.Glue.Types.KeySchemaElement

type Rep KeySchemaElement = D1 ('MetaData "KeySchemaElement" "Amazonka.Glue.Types.KeySchemaElement" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "KeySchemaElement'" 'PrefixI 'True) (S1 ('MetaSel ('Just "name") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text) :*: S1 ('MetaSel ('Just "type'") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text)))

newKeySchemaElement Source #

Create a value of KeySchemaElement with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:name:KeySchemaElement', keySchemaElement_name - The name of a partition key.

$sel:type':KeySchemaElement', keySchemaElement_type - The type of a partition key.

keySchemaElement_name :: Lens' KeySchemaElement Text Source #

The name of a partition key.

keySchemaElement_type :: Lens' KeySchemaElement Text Source #

The type of a partition key.

KinesisStreamingSourceOptions

data KinesisStreamingSourceOptions Source #

Additional options for the Amazon Kinesis streaming data source.

See: newKinesisStreamingSourceOptions smart constructor.

Constructors

KinesisStreamingSourceOptions' 

Fields

  • addIdleTimeBetweenReads :: Maybe Bool

    Adds a time delay between two consecutive getRecords operations. The default value is "False". This option is only configurable for Glue version 2.0 and above.

  • avoidEmptyBatches :: Maybe Bool

    Avoids creating an empty microbatch job by checking for unread data in the Kinesis data stream before the batch is started. The default value is "False".

  • classification :: Maybe Text

    An optional classification.

  • delimiter :: Maybe Text

    Specifies the delimiter character.

  • describeShardInterval :: Maybe Natural

    The minimum time interval between two ListShards API calls for your script to consider resharding. The default value is 1s.

  • endpointUrl :: Maybe Text

    The URL of the Kinesis endpoint.

  • idleTimeBetweenReadsInMs :: Maybe Natural

    The minimum time delay between two consecutive getRecords operations, specified in ms. The default value is 1000. This option is only configurable for Glue version 2.0 and above.

  • maxFetchRecordsPerShard :: Maybe Natural

    The maximum number of records to fetch per shard in the Kinesis data stream. The default value is 100000.

  • maxFetchTimeInMs :: Maybe Natural

    The maximum time spent in the job executor to fetch a record from the Kinesis data stream per shard, specified in milliseconds (ms). The default value is 1000.

  • maxRecordPerRead :: Maybe Natural

    The maximum number of records to fetch from the Kinesis data stream in each getRecords operation. The default value is 10000.

  • maxRetryIntervalMs :: Maybe Natural

    The maximum cool-off time period (specified in ms) between two retries of a Kinesis Data Streams API call. The default value is 10000.

  • numRetries :: Maybe Natural

    The maximum number of retries for Kinesis Data Streams API requests. The default value is 3.

  • retryIntervalMs :: Maybe Natural

    The cool-off time period (specified in ms) before retrying the Kinesis Data Streams API call. The default value is 1000.

  • roleArn :: Maybe Text

    The Amazon Resource Name (ARN) of the role to assume using AWS Security Token Service (AWS STS). This role must have permissions for describe or read record operations for the Kinesis data stream. You must use this parameter when accessing a data stream in a different account. Used in conjunction with "awsSTSSessionName".

  • roleSessionName :: Maybe Text

    An identifier for the session assuming the role using AWS STS. You must use this parameter when accessing a data stream in a different account. Used in conjunction with "awsSTSRoleARN".

  • startingPosition :: Maybe StartingPosition

    The starting position in the Kinesis data stream to read data from. The possible values are "latest", "trim_horizon", or "earliest". The default value is "latest".

  • streamArn :: Maybe Text

    The Amazon Resource Name (ARN) of the Kinesis data stream.

  • streamName :: Maybe Text

    The name of the Kinesis data stream.

Instances

Instances details
FromJSON KinesisStreamingSourceOptions Source # 
Instance details

Defined in Amazonka.Glue.Types.KinesisStreamingSourceOptions

ToJSON KinesisStreamingSourceOptions Source # 
Instance details

Defined in Amazonka.Glue.Types.KinesisStreamingSourceOptions

Generic KinesisStreamingSourceOptions Source # 
Instance details

Defined in Amazonka.Glue.Types.KinesisStreamingSourceOptions

Associated Types

type Rep KinesisStreamingSourceOptions :: Type -> Type #

Read KinesisStreamingSourceOptions Source # 
Instance details

Defined in Amazonka.Glue.Types.KinesisStreamingSourceOptions

Show KinesisStreamingSourceOptions Source # 
Instance details

Defined in Amazonka.Glue.Types.KinesisStreamingSourceOptions

NFData KinesisStreamingSourceOptions Source # 
Instance details

Defined in Amazonka.Glue.Types.KinesisStreamingSourceOptions

Eq KinesisStreamingSourceOptions Source # 
Instance details

Defined in Amazonka.Glue.Types.KinesisStreamingSourceOptions

Hashable KinesisStreamingSourceOptions Source # 
Instance details

Defined in Amazonka.Glue.Types.KinesisStreamingSourceOptions

type Rep KinesisStreamingSourceOptions Source # 
Instance details

Defined in Amazonka.Glue.Types.KinesisStreamingSourceOptions

type Rep KinesisStreamingSourceOptions = D1 ('MetaData "KinesisStreamingSourceOptions" "Amazonka.Glue.Types.KinesisStreamingSourceOptions" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "KinesisStreamingSourceOptions'" 'PrefixI 'True) ((((S1 ('MetaSel ('Just "addIdleTimeBetweenReads") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Bool)) :*: S1 ('MetaSel ('Just "avoidEmptyBatches") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Bool))) :*: (S1 ('MetaSel ('Just "classification") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "delimiter") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)))) :*: ((S1 ('MetaSel ('Just "describeShardInterval") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Natural)) :*: S1 ('MetaSel ('Just "endpointUrl") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text))) :*: (S1 ('MetaSel ('Just "idleTimeBetweenReadsInMs") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Natural)) :*: (S1 ('MetaSel ('Just "maxFetchRecordsPerShard") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Natural)) :*: S1 ('MetaSel ('Just "maxFetchTimeInMs") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Natural)))))) :*: (((S1 ('MetaSel ('Just "maxRecordPerRead") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Natural)) :*: S1 ('MetaSel ('Just "maxRetryIntervalMs") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Natural))) :*: (S1 ('MetaSel ('Just "numRetries") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Natural)) :*: S1 ('MetaSel ('Just "retryIntervalMs") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Natural)))) :*: ((S1 ('MetaSel ('Just "roleArn") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "roleSessionName") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text))) :*: (S1 ('MetaSel ('Just "startingPosition") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe StartingPosition)) :*: (S1 ('MetaSel ('Just "streamArn") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "streamName") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text))))))))

newKinesisStreamingSourceOptions :: KinesisStreamingSourceOptions Source #

Create a value of KinesisStreamingSourceOptions with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:addIdleTimeBetweenReads:KinesisStreamingSourceOptions', kinesisStreamingSourceOptions_addIdleTimeBetweenReads - Adds a time delay between two consecutive getRecords operations. The default value is "False". This option is only configurable for Glue version 2.0 and above.

$sel:avoidEmptyBatches:KinesisStreamingSourceOptions', kinesisStreamingSourceOptions_avoidEmptyBatches - Avoids creating an empty microbatch job by checking for unread data in the Kinesis data stream before the batch is started. The default value is "False".

$sel:classification:KinesisStreamingSourceOptions', kinesisStreamingSourceOptions_classification - An optional classification.

$sel:delimiter:KinesisStreamingSourceOptions', kinesisStreamingSourceOptions_delimiter - Specifies the delimiter character.

$sel:describeShardInterval:KinesisStreamingSourceOptions', kinesisStreamingSourceOptions_describeShardInterval - The minimum time interval between two ListShards API calls for your script to consider resharding. The default value is 1s.

$sel:endpointUrl:KinesisStreamingSourceOptions', kinesisStreamingSourceOptions_endpointUrl - The URL of the Kinesis endpoint.

$sel:idleTimeBetweenReadsInMs:KinesisStreamingSourceOptions', kinesisStreamingSourceOptions_idleTimeBetweenReadsInMs - The minimum time delay between two consecutive getRecords operations, specified in ms. The default value is 1000. This option is only configurable for Glue version 2.0 and above.

$sel:maxFetchRecordsPerShard:KinesisStreamingSourceOptions', kinesisStreamingSourceOptions_maxFetchRecordsPerShard - The maximum number of records to fetch per shard in the Kinesis data stream. The default value is 100000.

$sel:maxFetchTimeInMs:KinesisStreamingSourceOptions', kinesisStreamingSourceOptions_maxFetchTimeInMs - The maximum time spent in the job executor to fetch a record from the Kinesis data stream per shard, specified in milliseconds (ms). The default value is 1000.

$sel:maxRecordPerRead:KinesisStreamingSourceOptions', kinesisStreamingSourceOptions_maxRecordPerRead - The maximum number of records to fetch from the Kinesis data stream in each getRecords operation. The default value is 10000.

$sel:maxRetryIntervalMs:KinesisStreamingSourceOptions', kinesisStreamingSourceOptions_maxRetryIntervalMs - The maximum cool-off time period (specified in ms) between two retries of a Kinesis Data Streams API call. The default value is 10000.

$sel:numRetries:KinesisStreamingSourceOptions', kinesisStreamingSourceOptions_numRetries - The maximum number of retries for Kinesis Data Streams API requests. The default value is 3.

$sel:retryIntervalMs:KinesisStreamingSourceOptions', kinesisStreamingSourceOptions_retryIntervalMs - The cool-off time period (specified in ms) before retrying the Kinesis Data Streams API call. The default value is 1000.

$sel:roleArn:KinesisStreamingSourceOptions', kinesisStreamingSourceOptions_roleArn - The Amazon Resource Name (ARN) of the role to assume using AWS Security Token Service (AWS STS). This role must have permissions for describe or read record operations for the Kinesis data stream. You must use this parameter when accessing a data stream in a different account. Used in conjunction with "awsSTSSessionName".

$sel:roleSessionName:KinesisStreamingSourceOptions', kinesisStreamingSourceOptions_roleSessionName - An identifier for the session assuming the role using AWS STS. You must use this parameter when accessing a data stream in a different account. Used in conjunction with "awsSTSRoleARN".

$sel:startingPosition:KinesisStreamingSourceOptions', kinesisStreamingSourceOptions_startingPosition - The starting position in the Kinesis data stream to read data from. The possible values are "latest", "trim_horizon", or "earliest". The default value is "latest".

$sel:streamArn:KinesisStreamingSourceOptions', kinesisStreamingSourceOptions_streamArn - The Amazon Resource Name (ARN) of the Kinesis data stream.

$sel:streamName:KinesisStreamingSourceOptions', kinesisStreamingSourceOptions_streamName - The name of the Kinesis data stream.

kinesisStreamingSourceOptions_addIdleTimeBetweenReads :: Lens' KinesisStreamingSourceOptions (Maybe Bool) Source #

Adds a time delay between two consecutive getRecords operations. The default value is "False". This option is only configurable for Glue version 2.0 and above.

kinesisStreamingSourceOptions_avoidEmptyBatches :: Lens' KinesisStreamingSourceOptions (Maybe Bool) Source #

Avoids creating an empty microbatch job by checking for unread data in the Kinesis data stream before the batch is started. The default value is "False".

kinesisStreamingSourceOptions_describeShardInterval :: Lens' KinesisStreamingSourceOptions (Maybe Natural) Source #

The minimum time interval between two ListShards API calls for your script to consider resharding. The default value is 1s.

kinesisStreamingSourceOptions_idleTimeBetweenReadsInMs :: Lens' KinesisStreamingSourceOptions (Maybe Natural) Source #

The minimum time delay between two consecutive getRecords operations, specified in ms. The default value is 1000. This option is only configurable for Glue version 2.0 and above.

kinesisStreamingSourceOptions_maxFetchRecordsPerShard :: Lens' KinesisStreamingSourceOptions (Maybe Natural) Source #

The maximum number of records to fetch per shard in the Kinesis data stream. The default value is 100000.

kinesisStreamingSourceOptions_maxFetchTimeInMs :: Lens' KinesisStreamingSourceOptions (Maybe Natural) Source #

The maximum time spent in the job executor to fetch a record from the Kinesis data stream per shard, specified in milliseconds (ms). The default value is 1000.

kinesisStreamingSourceOptions_maxRecordPerRead :: Lens' KinesisStreamingSourceOptions (Maybe Natural) Source #

The maximum number of records to fetch from the Kinesis data stream in each getRecords operation. The default value is 10000.

kinesisStreamingSourceOptions_maxRetryIntervalMs :: Lens' KinesisStreamingSourceOptions (Maybe Natural) Source #

The maximum cool-off time period (specified in ms) between two retries of a Kinesis Data Streams API call. The default value is 10000.

kinesisStreamingSourceOptions_numRetries :: Lens' KinesisStreamingSourceOptions (Maybe Natural) Source #

The maximum number of retries for Kinesis Data Streams API requests. The default value is 3.

kinesisStreamingSourceOptions_retryIntervalMs :: Lens' KinesisStreamingSourceOptions (Maybe Natural) Source #

The cool-off time period (specified in ms) before retrying the Kinesis Data Streams API call. The default value is 1000.

kinesisStreamingSourceOptions_roleArn :: Lens' KinesisStreamingSourceOptions (Maybe Text) Source #

The Amazon Resource Name (ARN) of the role to assume using AWS Security Token Service (AWS STS). This role must have permissions for describe or read record operations for the Kinesis data stream. You must use this parameter when accessing a data stream in a different account. Used in conjunction with "awsSTSSessionName".

kinesisStreamingSourceOptions_roleSessionName :: Lens' KinesisStreamingSourceOptions (Maybe Text) Source #

An identifier for the session assuming the role using AWS STS. You must use this parameter when accessing a data stream in a different account. Used in conjunction with "awsSTSRoleARN".

kinesisStreamingSourceOptions_startingPosition :: Lens' KinesisStreamingSourceOptions (Maybe StartingPosition) Source #

The starting position in the Kinesis data stream to read data from. The possible values are "latest", "trim_horizon", or "earliest". The default value is "latest".

kinesisStreamingSourceOptions_streamArn :: Lens' KinesisStreamingSourceOptions (Maybe Text) Source #

The Amazon Resource Name (ARN) of the Kinesis data stream.

LabelingSetGenerationTaskRunProperties

data LabelingSetGenerationTaskRunProperties Source #

Specifies configuration properties for a labeling set generation task run.

See: newLabelingSetGenerationTaskRunProperties smart constructor.

Constructors

LabelingSetGenerationTaskRunProperties' 

Fields

  • outputS3Path :: Maybe Text

    The Amazon Simple Storage Service (Amazon S3) path where you will generate the labeling set.

Instances

Instances details
FromJSON LabelingSetGenerationTaskRunProperties Source # 
Instance details

Defined in Amazonka.Glue.Types.LabelingSetGenerationTaskRunProperties

Generic LabelingSetGenerationTaskRunProperties Source # 
Instance details

Defined in Amazonka.Glue.Types.LabelingSetGenerationTaskRunProperties

Read LabelingSetGenerationTaskRunProperties Source # 
Instance details

Defined in Amazonka.Glue.Types.LabelingSetGenerationTaskRunProperties

Show LabelingSetGenerationTaskRunProperties Source # 
Instance details

Defined in Amazonka.Glue.Types.LabelingSetGenerationTaskRunProperties

NFData LabelingSetGenerationTaskRunProperties Source # 
Instance details

Defined in Amazonka.Glue.Types.LabelingSetGenerationTaskRunProperties

Eq LabelingSetGenerationTaskRunProperties Source # 
Instance details

Defined in Amazonka.Glue.Types.LabelingSetGenerationTaskRunProperties

Hashable LabelingSetGenerationTaskRunProperties Source # 
Instance details

Defined in Amazonka.Glue.Types.LabelingSetGenerationTaskRunProperties

type Rep LabelingSetGenerationTaskRunProperties Source # 
Instance details

Defined in Amazonka.Glue.Types.LabelingSetGenerationTaskRunProperties

type Rep LabelingSetGenerationTaskRunProperties = D1 ('MetaData "LabelingSetGenerationTaskRunProperties" "Amazonka.Glue.Types.LabelingSetGenerationTaskRunProperties" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "LabelingSetGenerationTaskRunProperties'" 'PrefixI 'True) (S1 ('MetaSel ('Just "outputS3Path") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text))))

newLabelingSetGenerationTaskRunProperties :: LabelingSetGenerationTaskRunProperties Source #

Create a value of LabelingSetGenerationTaskRunProperties with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:outputS3Path:LabelingSetGenerationTaskRunProperties', labelingSetGenerationTaskRunProperties_outputS3Path - The Amazon Simple Storage Service (Amazon S3) path where you will generate the labeling set.

labelingSetGenerationTaskRunProperties_outputS3Path :: Lens' LabelingSetGenerationTaskRunProperties (Maybe Text) Source #

The Amazon Simple Storage Service (Amazon S3) path where you will generate the labeling set.

LakeFormationConfiguration

data LakeFormationConfiguration Source #

Specifies Lake Formation configuration settings for the crawler.

See: newLakeFormationConfiguration smart constructor.

Constructors

LakeFormationConfiguration' 

Fields

  • accountId :: Maybe Text

    Required for cross account crawls. For same account crawls as the target data, this can be left as null.

  • useLakeFormationCredentials :: Maybe Bool

    Specifies whether to use Lake Formation credentials for the crawler instead of the IAM role credentials.

Instances

Instances details
FromJSON LakeFormationConfiguration Source # 
Instance details

Defined in Amazonka.Glue.Types.LakeFormationConfiguration

ToJSON LakeFormationConfiguration Source # 
Instance details

Defined in Amazonka.Glue.Types.LakeFormationConfiguration

Generic LakeFormationConfiguration Source # 
Instance details

Defined in Amazonka.Glue.Types.LakeFormationConfiguration

Associated Types

type Rep LakeFormationConfiguration :: Type -> Type #

Read LakeFormationConfiguration Source # 
Instance details

Defined in Amazonka.Glue.Types.LakeFormationConfiguration

Show LakeFormationConfiguration Source # 
Instance details

Defined in Amazonka.Glue.Types.LakeFormationConfiguration

NFData LakeFormationConfiguration Source # 
Instance details

Defined in Amazonka.Glue.Types.LakeFormationConfiguration

Eq LakeFormationConfiguration Source # 
Instance details

Defined in Amazonka.Glue.Types.LakeFormationConfiguration

Hashable LakeFormationConfiguration Source # 
Instance details

Defined in Amazonka.Glue.Types.LakeFormationConfiguration

type Rep LakeFormationConfiguration Source # 
Instance details

Defined in Amazonka.Glue.Types.LakeFormationConfiguration

type Rep LakeFormationConfiguration = D1 ('MetaData "LakeFormationConfiguration" "Amazonka.Glue.Types.LakeFormationConfiguration" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "LakeFormationConfiguration'" 'PrefixI 'True) (S1 ('MetaSel ('Just "accountId") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "useLakeFormationCredentials") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Bool))))

newLakeFormationConfiguration :: LakeFormationConfiguration Source #

Create a value of LakeFormationConfiguration with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:accountId:LakeFormationConfiguration', lakeFormationConfiguration_accountId - Required for cross account crawls. For same account crawls as the target data, this can be left as null.

$sel:useLakeFormationCredentials:LakeFormationConfiguration', lakeFormationConfiguration_useLakeFormationCredentials - Specifies whether to use Lake Formation credentials for the crawler instead of the IAM role credentials.

lakeFormationConfiguration_accountId :: Lens' LakeFormationConfiguration (Maybe Text) Source #

Required for cross account crawls. For same account crawls as the target data, this can be left as null.

lakeFormationConfiguration_useLakeFormationCredentials :: Lens' LakeFormationConfiguration (Maybe Bool) Source #

Specifies whether to use Lake Formation credentials for the crawler instead of the IAM role credentials.

LastActiveDefinition

data LastActiveDefinition Source #

When there are multiple versions of a blueprint and the latest version has some errors, this attribute indicates the last successful blueprint definition that is available with the service.

See: newLastActiveDefinition smart constructor.

Constructors

LastActiveDefinition' 

Fields

Instances

Instances details
FromJSON LastActiveDefinition Source # 
Instance details

Defined in Amazonka.Glue.Types.LastActiveDefinition

Generic LastActiveDefinition Source # 
Instance details

Defined in Amazonka.Glue.Types.LastActiveDefinition

Associated Types

type Rep LastActiveDefinition :: Type -> Type #

Read LastActiveDefinition Source # 
Instance details

Defined in Amazonka.Glue.Types.LastActiveDefinition

Show LastActiveDefinition Source # 
Instance details

Defined in Amazonka.Glue.Types.LastActiveDefinition

NFData LastActiveDefinition Source # 
Instance details

Defined in Amazonka.Glue.Types.LastActiveDefinition

Methods

rnf :: LastActiveDefinition -> () #

Eq LastActiveDefinition Source # 
Instance details

Defined in Amazonka.Glue.Types.LastActiveDefinition

Hashable LastActiveDefinition Source # 
Instance details

Defined in Amazonka.Glue.Types.LastActiveDefinition

type Rep LastActiveDefinition Source # 
Instance details

Defined in Amazonka.Glue.Types.LastActiveDefinition

type Rep LastActiveDefinition = D1 ('MetaData "LastActiveDefinition" "Amazonka.Glue.Types.LastActiveDefinition" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "LastActiveDefinition'" 'PrefixI 'True) ((S1 ('MetaSel ('Just "blueprintLocation") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "blueprintServiceLocation") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text))) :*: (S1 ('MetaSel ('Just "description") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: (S1 ('MetaSel ('Just "lastModifiedOn") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe POSIX)) :*: S1 ('MetaSel ('Just "parameterSpec") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text))))))

newLastActiveDefinition :: LastActiveDefinition Source #

Create a value of LastActiveDefinition with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:blueprintLocation:LastActiveDefinition', lastActiveDefinition_blueprintLocation - Specifies a path in Amazon S3 where the blueprint is published by the Glue developer.

$sel:blueprintServiceLocation:LastActiveDefinition', lastActiveDefinition_blueprintServiceLocation - Specifies a path in Amazon S3 where the blueprint is copied when you create or update the blueprint.

$sel:description:LastActiveDefinition', lastActiveDefinition_description - The description of the blueprint.

$sel:lastModifiedOn:LastActiveDefinition', lastActiveDefinition_lastModifiedOn - The date and time the blueprint was last modified.

$sel:parameterSpec:LastActiveDefinition', lastActiveDefinition_parameterSpec - A JSON string specifying the parameters for the blueprint.

lastActiveDefinition_blueprintLocation :: Lens' LastActiveDefinition (Maybe Text) Source #

Specifies a path in Amazon S3 where the blueprint is published by the Glue developer.

lastActiveDefinition_blueprintServiceLocation :: Lens' LastActiveDefinition (Maybe Text) Source #

Specifies a path in Amazon S3 where the blueprint is copied when you create or update the blueprint.

lastActiveDefinition_lastModifiedOn :: Lens' LastActiveDefinition (Maybe UTCTime) Source #

The date and time the blueprint was last modified.

lastActiveDefinition_parameterSpec :: Lens' LastActiveDefinition (Maybe Text) Source #

A JSON string specifying the parameters for the blueprint.

LastCrawlInfo

data LastCrawlInfo Source #

Status and error information about the most recent crawl.

See: newLastCrawlInfo smart constructor.

Constructors

LastCrawlInfo' 

Fields

Instances

Instances details
FromJSON LastCrawlInfo Source # 
Instance details

Defined in Amazonka.Glue.Types.LastCrawlInfo

Generic LastCrawlInfo Source # 
Instance details

Defined in Amazonka.Glue.Types.LastCrawlInfo

Associated Types

type Rep LastCrawlInfo :: Type -> Type #

Read LastCrawlInfo Source # 
Instance details

Defined in Amazonka.Glue.Types.LastCrawlInfo

Show LastCrawlInfo Source # 
Instance details

Defined in Amazonka.Glue.Types.LastCrawlInfo

NFData LastCrawlInfo Source # 
Instance details

Defined in Amazonka.Glue.Types.LastCrawlInfo

Methods

rnf :: LastCrawlInfo -> () #

Eq LastCrawlInfo Source # 
Instance details

Defined in Amazonka.Glue.Types.LastCrawlInfo

Hashable LastCrawlInfo Source # 
Instance details

Defined in Amazonka.Glue.Types.LastCrawlInfo

type Rep LastCrawlInfo Source # 
Instance details

Defined in Amazonka.Glue.Types.LastCrawlInfo

newLastCrawlInfo :: LastCrawlInfo Source #

Create a value of LastCrawlInfo with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:errorMessage:LastCrawlInfo', lastCrawlInfo_errorMessage - If an error occurred, the error information about the last crawl.

$sel:logGroup:LastCrawlInfo', lastCrawlInfo_logGroup - The log group for the last crawl.

$sel:logStream:LastCrawlInfo', lastCrawlInfo_logStream - The log stream for the last crawl.

$sel:messagePrefix:LastCrawlInfo', lastCrawlInfo_messagePrefix - The prefix for a message about this crawl.

$sel:startTime:LastCrawlInfo', lastCrawlInfo_startTime - The time at which the crawl started.

$sel:status:LastCrawlInfo', lastCrawlInfo_status - Status of the last crawl.

lastCrawlInfo_errorMessage :: Lens' LastCrawlInfo (Maybe Text) Source #

If an error occurred, the error information about the last crawl.

lastCrawlInfo_logGroup :: Lens' LastCrawlInfo (Maybe Text) Source #

The log group for the last crawl.

lastCrawlInfo_logStream :: Lens' LastCrawlInfo (Maybe Text) Source #

The log stream for the last crawl.

lastCrawlInfo_messagePrefix :: Lens' LastCrawlInfo (Maybe Text) Source #

The prefix for a message about this crawl.

lastCrawlInfo_startTime :: Lens' LastCrawlInfo (Maybe UTCTime) Source #

The time at which the crawl started.

LineageConfiguration

data LineageConfiguration Source #

Specifies data lineage configuration settings for the crawler.

See: newLineageConfiguration smart constructor.

Constructors

LineageConfiguration' 

Fields

Instances

Instances details
FromJSON LineageConfiguration Source # 
Instance details

Defined in Amazonka.Glue.Types.LineageConfiguration

ToJSON LineageConfiguration Source # 
Instance details

Defined in Amazonka.Glue.Types.LineageConfiguration

Generic LineageConfiguration Source # 
Instance details

Defined in Amazonka.Glue.Types.LineageConfiguration

Associated Types

type Rep LineageConfiguration :: Type -> Type #

Read LineageConfiguration Source # 
Instance details

Defined in Amazonka.Glue.Types.LineageConfiguration

Show LineageConfiguration Source # 
Instance details

Defined in Amazonka.Glue.Types.LineageConfiguration

NFData LineageConfiguration Source # 
Instance details

Defined in Amazonka.Glue.Types.LineageConfiguration

Methods

rnf :: LineageConfiguration -> () #

Eq LineageConfiguration Source # 
Instance details

Defined in Amazonka.Glue.Types.LineageConfiguration

Hashable LineageConfiguration Source # 
Instance details

Defined in Amazonka.Glue.Types.LineageConfiguration

type Rep LineageConfiguration Source # 
Instance details

Defined in Amazonka.Glue.Types.LineageConfiguration

type Rep LineageConfiguration = D1 ('MetaData "LineageConfiguration" "Amazonka.Glue.Types.LineageConfiguration" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "LineageConfiguration'" 'PrefixI 'True) (S1 ('MetaSel ('Just "crawlerLineageSettings") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe CrawlerLineageSettings))))

newLineageConfiguration :: LineageConfiguration Source #

Create a value of LineageConfiguration with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:crawlerLineageSettings:LineageConfiguration', lineageConfiguration_crawlerLineageSettings - Specifies whether data lineage is enabled for the crawler. Valid values are:

  • ENABLE: enables data lineage for the crawler
  • DISABLE: disables data lineage for the crawler

lineageConfiguration_crawlerLineageSettings :: Lens' LineageConfiguration (Maybe CrawlerLineageSettings) Source #

Specifies whether data lineage is enabled for the crawler. Valid values are:

  • ENABLE: enables data lineage for the crawler
  • DISABLE: disables data lineage for the crawler

Location

data Location Source #

The location of resources.

See: newLocation smart constructor.

Constructors

Location' 

Fields

Instances

Instances details
ToJSON Location Source # 
Instance details

Defined in Amazonka.Glue.Types.Location

Generic Location Source # 
Instance details

Defined in Amazonka.Glue.Types.Location

Associated Types

type Rep Location :: Type -> Type #

Methods

from :: Location -> Rep Location x #

to :: Rep Location x -> Location #

Read Location Source # 
Instance details

Defined in Amazonka.Glue.Types.Location

Show Location Source # 
Instance details

Defined in Amazonka.Glue.Types.Location

NFData Location Source # 
Instance details

Defined in Amazonka.Glue.Types.Location

Methods

rnf :: Location -> () #

Eq Location Source # 
Instance details

Defined in Amazonka.Glue.Types.Location

Hashable Location Source # 
Instance details

Defined in Amazonka.Glue.Types.Location

Methods

hashWithSalt :: Int -> Location -> Int #

hash :: Location -> Int #

type Rep Location Source # 
Instance details

Defined in Amazonka.Glue.Types.Location

type Rep Location = D1 ('MetaData "Location" "Amazonka.Glue.Types.Location" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "Location'" 'PrefixI 'True) (S1 ('MetaSel ('Just "dynamoDB") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe [CodeGenNodeArg])) :*: (S1 ('MetaSel ('Just "jdbc") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe [CodeGenNodeArg])) :*: S1 ('MetaSel ('Just "s3") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe [CodeGenNodeArg])))))

newLocation :: Location Source #

Create a value of Location with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:dynamoDB:Location', location_dynamoDB - An Amazon DynamoDB table location.

$sel:jdbc:Location', location_jdbc - A JDBC location.

$sel:s3:Location', location_s3 - An Amazon Simple Storage Service (Amazon S3) location.

location_dynamoDB :: Lens' Location (Maybe [CodeGenNodeArg]) Source #

An Amazon DynamoDB table location.

location_s3 :: Lens' Location (Maybe [CodeGenNodeArg]) Source #

An Amazon Simple Storage Service (Amazon S3) location.

LongColumnStatisticsData

data LongColumnStatisticsData Source #

Defines column statistics supported for integer data columns.

See: newLongColumnStatisticsData smart constructor.

Constructors

LongColumnStatisticsData' 

Fields

Instances

Instances details
FromJSON LongColumnStatisticsData Source # 
Instance details

Defined in Amazonka.Glue.Types.LongColumnStatisticsData

ToJSON LongColumnStatisticsData Source # 
Instance details

Defined in Amazonka.Glue.Types.LongColumnStatisticsData

Generic LongColumnStatisticsData Source # 
Instance details

Defined in Amazonka.Glue.Types.LongColumnStatisticsData

Associated Types

type Rep LongColumnStatisticsData :: Type -> Type #

Read LongColumnStatisticsData Source # 
Instance details

Defined in Amazonka.Glue.Types.LongColumnStatisticsData

Show LongColumnStatisticsData Source # 
Instance details

Defined in Amazonka.Glue.Types.LongColumnStatisticsData

NFData LongColumnStatisticsData Source # 
Instance details

Defined in Amazonka.Glue.Types.LongColumnStatisticsData

Eq LongColumnStatisticsData Source # 
Instance details

Defined in Amazonka.Glue.Types.LongColumnStatisticsData

Hashable LongColumnStatisticsData Source # 
Instance details

Defined in Amazonka.Glue.Types.LongColumnStatisticsData

type Rep LongColumnStatisticsData Source # 
Instance details

Defined in Amazonka.Glue.Types.LongColumnStatisticsData

type Rep LongColumnStatisticsData = D1 ('MetaData "LongColumnStatisticsData" "Amazonka.Glue.Types.LongColumnStatisticsData" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "LongColumnStatisticsData'" 'PrefixI 'True) ((S1 ('MetaSel ('Just "maximumValue") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Integer)) :*: S1 ('MetaSel ('Just "minimumValue") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Integer))) :*: (S1 ('MetaSel ('Just "numberOfNulls") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Natural) :*: S1 ('MetaSel ('Just "numberOfDistinctValues") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Natural))))

newLongColumnStatisticsData Source #

Create a value of LongColumnStatisticsData with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:maximumValue:LongColumnStatisticsData', longColumnStatisticsData_maximumValue - The highest value in the column.

$sel:minimumValue:LongColumnStatisticsData', longColumnStatisticsData_minimumValue - The lowest value in the column.

$sel:numberOfNulls:LongColumnStatisticsData', longColumnStatisticsData_numberOfNulls - The number of null values in the column.

$sel:numberOfDistinctValues:LongColumnStatisticsData', longColumnStatisticsData_numberOfDistinctValues - The number of distinct values in a column.

MLTransform

data MLTransform Source #

A structure for a machine learning transform.

See: newMLTransform smart constructor.

Constructors

MLTransform' 

Fields

  • createdOn :: Maybe POSIX

    A timestamp. The time and date that this machine learning transform was created.

  • description :: Maybe Text

    A user-defined, long-form description text for the machine learning transform. Descriptions are not guaranteed to be unique and can be changed at any time.

  • evaluationMetrics :: Maybe EvaluationMetrics

    An EvaluationMetrics object. Evaluation metrics provide an estimate of the quality of your machine learning transform.

  • glueVersion :: Maybe Text

    This value determines which version of Glue this machine learning transform is compatible with. Glue 1.0 is recommended for most customers. If the value is not set, the Glue compatibility defaults to Glue 0.9. For more information, see Glue Versions in the developer guide.

  • inputRecordTables :: Maybe [GlueTable]

    A list of Glue table definitions used by the transform.

  • labelCount :: Maybe Int

    A count identifier for the labeling files generated by Glue for this transform. As you create a better transform, you can iteratively download, label, and upload the labeling file.

  • lastModifiedOn :: Maybe POSIX

    A timestamp. The last point in time when this machine learning transform was modified.

  • maxCapacity :: Maybe Double

    The number of Glue data processing units (DPUs) that are allocated to task runs for this transform. You can allocate from 2 to 100 DPUs; the default is 10. A DPU is a relative measure of processing power that consists of 4 vCPUs of compute capacity and 16 GB of memory. For more information, see the Glue pricing page.

    MaxCapacity is a mutually exclusive option with NumberOfWorkers and WorkerType.

    • If either NumberOfWorkers or WorkerType is set, then MaxCapacity cannot be set.
    • If MaxCapacity is set then neither NumberOfWorkers or WorkerType can be set.
    • If WorkerType is set, then NumberOfWorkers is required (and vice versa).
    • MaxCapacity and NumberOfWorkers must both be at least 1.

    When the WorkerType field is set to a value other than Standard, the MaxCapacity field is set automatically and becomes read-only.

  • maxRetries :: Maybe Int

    The maximum number of times to retry after an MLTaskRun of the machine learning transform fails.

  • name :: Maybe Text

    A user-defined name for the machine learning transform. Names are not guaranteed unique and can be changed at any time.

  • numberOfWorkers :: Maybe Int

    The number of workers of a defined workerType that are allocated when a task of the transform runs.

    If WorkerType is set, then NumberOfWorkers is required (and vice versa).

  • parameters :: Maybe TransformParameters

    A TransformParameters object. You can use parameters to tune (customize) the behavior of the machine learning transform by specifying what data it learns from and your preference on various tradeoffs (such as precious vs. recall, or accuracy vs. cost).

  • role' :: Maybe Text

    The name or Amazon Resource Name (ARN) of the IAM role with the required permissions. The required permissions include both Glue service role permissions to Glue resources, and Amazon S3 permissions required by the transform.

    • This role needs Glue service role permissions to allow access to resources in Glue. See Attach a Policy to IAM Users That Access Glue.
    • This role needs permission to your Amazon Simple Storage Service (Amazon S3) sources, targets, temporary directory, scripts, and any libraries used by the task run for this transform.
  • schema :: Maybe [SchemaColumn]

    A map of key-value pairs representing the columns and data types that this transform can run against. Has an upper bound of 100 columns.

  • status :: Maybe TransformStatusType

    The current status of the machine learning transform.

  • timeout :: Maybe Natural

    The timeout in minutes of the machine learning transform.

  • transformEncryption :: Maybe TransformEncryption

    The encryption-at-rest settings of the transform that apply to accessing user data. Machine learning transforms can access user data encrypted in Amazon S3 using KMS.

  • transformId :: Maybe Text

    The unique transform ID that is generated for the machine learning transform. The ID is guaranteed to be unique and does not change.

  • workerType :: Maybe WorkerType

    The type of predefined worker that is allocated when a task of this transform runs. Accepts a value of Standard, G.1X, or G.2X.

    • For the Standard worker type, each worker provides 4 vCPU, 16 GB of memory and a 50GB disk, and 2 executors per worker.
    • For the G.1X worker type, each worker provides 4 vCPU, 16 GB of memory and a 64GB disk, and 1 executor per worker.
    • For the G.2X worker type, each worker provides 8 vCPU, 32 GB of memory and a 128GB disk, and 1 executor per worker.

    MaxCapacity is a mutually exclusive option with NumberOfWorkers and WorkerType.

    • If either NumberOfWorkers or WorkerType is set, then MaxCapacity cannot be set.
    • If MaxCapacity is set then neither NumberOfWorkers or WorkerType can be set.
    • If WorkerType is set, then NumberOfWorkers is required (and vice versa).
    • MaxCapacity and NumberOfWorkers must both be at least 1.

Instances

Instances details
FromJSON MLTransform Source # 
Instance details

Defined in Amazonka.Glue.Types.MLTransform

Generic MLTransform Source # 
Instance details

Defined in Amazonka.Glue.Types.MLTransform

Associated Types

type Rep MLTransform :: Type -> Type #

Read MLTransform Source # 
Instance details

Defined in Amazonka.Glue.Types.MLTransform

Show MLTransform Source # 
Instance details

Defined in Amazonka.Glue.Types.MLTransform

NFData MLTransform Source # 
Instance details

Defined in Amazonka.Glue.Types.MLTransform

Methods

rnf :: MLTransform -> () #

Eq MLTransform Source # 
Instance details

Defined in Amazonka.Glue.Types.MLTransform

Hashable MLTransform Source # 
Instance details

Defined in Amazonka.Glue.Types.MLTransform

type Rep MLTransform Source # 
Instance details

Defined in Amazonka.Glue.Types.MLTransform

type Rep MLTransform = D1 ('MetaData "MLTransform" "Amazonka.Glue.Types.MLTransform" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "MLTransform'" 'PrefixI 'True) ((((S1 ('MetaSel ('Just "createdOn") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe POSIX)) :*: S1 ('MetaSel ('Just "description") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text))) :*: (S1 ('MetaSel ('Just "evaluationMetrics") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe EvaluationMetrics)) :*: S1 ('MetaSel ('Just "glueVersion") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)))) :*: ((S1 ('MetaSel ('Just "inputRecordTables") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe [GlueTable])) :*: S1 ('MetaSel ('Just "labelCount") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Int))) :*: (S1 ('MetaSel ('Just "lastModifiedOn") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe POSIX)) :*: (S1 ('MetaSel ('Just "maxCapacity") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Double)) :*: S1 ('MetaSel ('Just "maxRetries") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Int)))))) :*: (((S1 ('MetaSel ('Just "name") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "numberOfWorkers") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Int))) :*: (S1 ('MetaSel ('Just "parameters") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe TransformParameters)) :*: (S1 ('MetaSel ('Just "role'") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "schema") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe [SchemaColumn]))))) :*: ((S1 ('MetaSel ('Just "status") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe TransformStatusType)) :*: S1 ('MetaSel ('Just "timeout") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Natural))) :*: (S1 ('MetaSel ('Just "transformEncryption") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe TransformEncryption)) :*: (S1 ('MetaSel ('Just "transformId") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "workerType") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe WorkerType))))))))

newMLTransform :: MLTransform Source #

Create a value of MLTransform with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:createdOn:MLTransform', mLTransform_createdOn - A timestamp. The time and date that this machine learning transform was created.

$sel:description:MLTransform', mLTransform_description - A user-defined, long-form description text for the machine learning transform. Descriptions are not guaranteed to be unique and can be changed at any time.

$sel:evaluationMetrics:MLTransform', mLTransform_evaluationMetrics - An EvaluationMetrics object. Evaluation metrics provide an estimate of the quality of your machine learning transform.

$sel:glueVersion:MLTransform', mLTransform_glueVersion - This value determines which version of Glue this machine learning transform is compatible with. Glue 1.0 is recommended for most customers. If the value is not set, the Glue compatibility defaults to Glue 0.9. For more information, see Glue Versions in the developer guide.

$sel:inputRecordTables:MLTransform', mLTransform_inputRecordTables - A list of Glue table definitions used by the transform.

$sel:labelCount:MLTransform', mLTransform_labelCount - A count identifier for the labeling files generated by Glue for this transform. As you create a better transform, you can iteratively download, label, and upload the labeling file.

$sel:lastModifiedOn:MLTransform', mLTransform_lastModifiedOn - A timestamp. The last point in time when this machine learning transform was modified.

$sel:maxCapacity:MLTransform', mLTransform_maxCapacity - The number of Glue data processing units (DPUs) that are allocated to task runs for this transform. You can allocate from 2 to 100 DPUs; the default is 10. A DPU is a relative measure of processing power that consists of 4 vCPUs of compute capacity and 16 GB of memory. For more information, see the Glue pricing page.

MaxCapacity is a mutually exclusive option with NumberOfWorkers and WorkerType.

  • If either NumberOfWorkers or WorkerType is set, then MaxCapacity cannot be set.
  • If MaxCapacity is set then neither NumberOfWorkers or WorkerType can be set.
  • If WorkerType is set, then NumberOfWorkers is required (and vice versa).
  • MaxCapacity and NumberOfWorkers must both be at least 1.

When the WorkerType field is set to a value other than Standard, the MaxCapacity field is set automatically and becomes read-only.

$sel:maxRetries:MLTransform', mLTransform_maxRetries - The maximum number of times to retry after an MLTaskRun of the machine learning transform fails.

MLTransform, mLTransform_name - A user-defined name for the machine learning transform. Names are not guaranteed unique and can be changed at any time.

$sel:numberOfWorkers:MLTransform', mLTransform_numberOfWorkers - The number of workers of a defined workerType that are allocated when a task of the transform runs.

If WorkerType is set, then NumberOfWorkers is required (and vice versa).

$sel:parameters:MLTransform', mLTransform_parameters - A TransformParameters object. You can use parameters to tune (customize) the behavior of the machine learning transform by specifying what data it learns from and your preference on various tradeoffs (such as precious vs. recall, or accuracy vs. cost).

$sel:role':MLTransform', mLTransform_role - The name or Amazon Resource Name (ARN) of the IAM role with the required permissions. The required permissions include both Glue service role permissions to Glue resources, and Amazon S3 permissions required by the transform.

  • This role needs Glue service role permissions to allow access to resources in Glue. See Attach a Policy to IAM Users That Access Glue.
  • This role needs permission to your Amazon Simple Storage Service (Amazon S3) sources, targets, temporary directory, scripts, and any libraries used by the task run for this transform.

$sel:schema:MLTransform', mLTransform_schema - A map of key-value pairs representing the columns and data types that this transform can run against. Has an upper bound of 100 columns.

$sel:status:MLTransform', mLTransform_status - The current status of the machine learning transform.

$sel:timeout:MLTransform', mLTransform_timeout - The timeout in minutes of the machine learning transform.

$sel:transformEncryption:MLTransform', mLTransform_transformEncryption - The encryption-at-rest settings of the transform that apply to accessing user data. Machine learning transforms can access user data encrypted in Amazon S3 using KMS.

$sel:transformId:MLTransform', mLTransform_transformId - The unique transform ID that is generated for the machine learning transform. The ID is guaranteed to be unique and does not change.

$sel:workerType:MLTransform', mLTransform_workerType - The type of predefined worker that is allocated when a task of this transform runs. Accepts a value of Standard, G.1X, or G.2X.

  • For the Standard worker type, each worker provides 4 vCPU, 16 GB of memory and a 50GB disk, and 2 executors per worker.
  • For the G.1X worker type, each worker provides 4 vCPU, 16 GB of memory and a 64GB disk, and 1 executor per worker.
  • For the G.2X worker type, each worker provides 8 vCPU, 32 GB of memory and a 128GB disk, and 1 executor per worker.

MaxCapacity is a mutually exclusive option with NumberOfWorkers and WorkerType.

  • If either NumberOfWorkers or WorkerType is set, then MaxCapacity cannot be set.
  • If MaxCapacity is set then neither NumberOfWorkers or WorkerType can be set.
  • If WorkerType is set, then NumberOfWorkers is required (and vice versa).
  • MaxCapacity and NumberOfWorkers must both be at least 1.

mLTransform_createdOn :: Lens' MLTransform (Maybe UTCTime) Source #

A timestamp. The time and date that this machine learning transform was created.

mLTransform_description :: Lens' MLTransform (Maybe Text) Source #

A user-defined, long-form description text for the machine learning transform. Descriptions are not guaranteed to be unique and can be changed at any time.

mLTransform_evaluationMetrics :: Lens' MLTransform (Maybe EvaluationMetrics) Source #

An EvaluationMetrics object. Evaluation metrics provide an estimate of the quality of your machine learning transform.

mLTransform_glueVersion :: Lens' MLTransform (Maybe Text) Source #

This value determines which version of Glue this machine learning transform is compatible with. Glue 1.0 is recommended for most customers. If the value is not set, the Glue compatibility defaults to Glue 0.9. For more information, see Glue Versions in the developer guide.

mLTransform_inputRecordTables :: Lens' MLTransform (Maybe [GlueTable]) Source #

A list of Glue table definitions used by the transform.

mLTransform_labelCount :: Lens' MLTransform (Maybe Int) Source #

A count identifier for the labeling files generated by Glue for this transform. As you create a better transform, you can iteratively download, label, and upload the labeling file.

mLTransform_lastModifiedOn :: Lens' MLTransform (Maybe UTCTime) Source #

A timestamp. The last point in time when this machine learning transform was modified.

mLTransform_maxCapacity :: Lens' MLTransform (Maybe Double) Source #

The number of Glue data processing units (DPUs) that are allocated to task runs for this transform. You can allocate from 2 to 100 DPUs; the default is 10. A DPU is a relative measure of processing power that consists of 4 vCPUs of compute capacity and 16 GB of memory. For more information, see the Glue pricing page.

MaxCapacity is a mutually exclusive option with NumberOfWorkers and WorkerType.

  • If either NumberOfWorkers or WorkerType is set, then MaxCapacity cannot be set.
  • If MaxCapacity is set then neither NumberOfWorkers or WorkerType can be set.
  • If WorkerType is set, then NumberOfWorkers is required (and vice versa).
  • MaxCapacity and NumberOfWorkers must both be at least 1.

When the WorkerType field is set to a value other than Standard, the MaxCapacity field is set automatically and becomes read-only.

mLTransform_maxRetries :: Lens' MLTransform (Maybe Int) Source #

The maximum number of times to retry after an MLTaskRun of the machine learning transform fails.

mLTransform_name :: Lens' MLTransform (Maybe Text) Source #

A user-defined name for the machine learning transform. Names are not guaranteed unique and can be changed at any time.

mLTransform_numberOfWorkers :: Lens' MLTransform (Maybe Int) Source #

The number of workers of a defined workerType that are allocated when a task of the transform runs.

If WorkerType is set, then NumberOfWorkers is required (and vice versa).

mLTransform_parameters :: Lens' MLTransform (Maybe TransformParameters) Source #

A TransformParameters object. You can use parameters to tune (customize) the behavior of the machine learning transform by specifying what data it learns from and your preference on various tradeoffs (such as precious vs. recall, or accuracy vs. cost).

mLTransform_role :: Lens' MLTransform (Maybe Text) Source #

The name or Amazon Resource Name (ARN) of the IAM role with the required permissions. The required permissions include both Glue service role permissions to Glue resources, and Amazon S3 permissions required by the transform.

  • This role needs Glue service role permissions to allow access to resources in Glue. See Attach a Policy to IAM Users That Access Glue.
  • This role needs permission to your Amazon Simple Storage Service (Amazon S3) sources, targets, temporary directory, scripts, and any libraries used by the task run for this transform.

mLTransform_schema :: Lens' MLTransform (Maybe [SchemaColumn]) Source #

A map of key-value pairs representing the columns and data types that this transform can run against. Has an upper bound of 100 columns.

mLTransform_status :: Lens' MLTransform (Maybe TransformStatusType) Source #

The current status of the machine learning transform.

mLTransform_timeout :: Lens' MLTransform (Maybe Natural) Source #

The timeout in minutes of the machine learning transform.

mLTransform_transformEncryption :: Lens' MLTransform (Maybe TransformEncryption) Source #

The encryption-at-rest settings of the transform that apply to accessing user data. Machine learning transforms can access user data encrypted in Amazon S3 using KMS.

mLTransform_transformId :: Lens' MLTransform (Maybe Text) Source #

The unique transform ID that is generated for the machine learning transform. The ID is guaranteed to be unique and does not change.

mLTransform_workerType :: Lens' MLTransform (Maybe WorkerType) Source #

The type of predefined worker that is allocated when a task of this transform runs. Accepts a value of Standard, G.1X, or G.2X.

  • For the Standard worker type, each worker provides 4 vCPU, 16 GB of memory and a 50GB disk, and 2 executors per worker.
  • For the G.1X worker type, each worker provides 4 vCPU, 16 GB of memory and a 64GB disk, and 1 executor per worker.
  • For the G.2X worker type, each worker provides 8 vCPU, 32 GB of memory and a 128GB disk, and 1 executor per worker.

MaxCapacity is a mutually exclusive option with NumberOfWorkers and WorkerType.

  • If either NumberOfWorkers or WorkerType is set, then MaxCapacity cannot be set.
  • If MaxCapacity is set then neither NumberOfWorkers or WorkerType can be set.
  • If WorkerType is set, then NumberOfWorkers is required (and vice versa).
  • MaxCapacity and NumberOfWorkers must both be at least 1.

MLUserDataEncryption

data MLUserDataEncryption Source #

The encryption-at-rest settings of the transform that apply to accessing user data.

See: newMLUserDataEncryption smart constructor.

Constructors

MLUserDataEncryption' 

Fields

Instances

Instances details
FromJSON MLUserDataEncryption Source # 
Instance details

Defined in Amazonka.Glue.Types.MLUserDataEncryption

ToJSON MLUserDataEncryption Source # 
Instance details

Defined in Amazonka.Glue.Types.MLUserDataEncryption

Generic MLUserDataEncryption Source # 
Instance details

Defined in Amazonka.Glue.Types.MLUserDataEncryption

Associated Types

type Rep MLUserDataEncryption :: Type -> Type #

Read MLUserDataEncryption Source # 
Instance details

Defined in Amazonka.Glue.Types.MLUserDataEncryption

Show MLUserDataEncryption Source # 
Instance details

Defined in Amazonka.Glue.Types.MLUserDataEncryption

NFData MLUserDataEncryption Source # 
Instance details

Defined in Amazonka.Glue.Types.MLUserDataEncryption

Methods

rnf :: MLUserDataEncryption -> () #

Eq MLUserDataEncryption Source # 
Instance details

Defined in Amazonka.Glue.Types.MLUserDataEncryption

Hashable MLUserDataEncryption Source # 
Instance details

Defined in Amazonka.Glue.Types.MLUserDataEncryption

type Rep MLUserDataEncryption Source # 
Instance details

Defined in Amazonka.Glue.Types.MLUserDataEncryption

type Rep MLUserDataEncryption = D1 ('MetaData "MLUserDataEncryption" "Amazonka.Glue.Types.MLUserDataEncryption" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "MLUserDataEncryption'" 'PrefixI 'True) (S1 ('MetaSel ('Just "kmsKeyId") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "mlUserDataEncryptionMode") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 MLUserDataEncryptionModeString)))

newMLUserDataEncryption Source #

Create a value of MLUserDataEncryption with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:kmsKeyId:MLUserDataEncryption', mLUserDataEncryption_kmsKeyId - The ID for the customer-provided KMS key.

$sel:mlUserDataEncryptionMode:MLUserDataEncryption', mLUserDataEncryption_mlUserDataEncryptionMode - The encryption mode applied to user data. Valid values are:

  • DISABLED: encryption is disabled
  • SSEKMS: use of server-side encryption with Key Management Service (SSE-KMS) for user data stored in Amazon S3.

mLUserDataEncryption_kmsKeyId :: Lens' MLUserDataEncryption (Maybe Text) Source #

The ID for the customer-provided KMS key.

mLUserDataEncryption_mlUserDataEncryptionMode :: Lens' MLUserDataEncryption MLUserDataEncryptionModeString Source #

The encryption mode applied to user data. Valid values are:

  • DISABLED: encryption is disabled
  • SSEKMS: use of server-side encryption with Key Management Service (SSE-KMS) for user data stored in Amazon S3.

Mapping

data Mapping Source #

Specifies the mapping of data property keys.

See: newMapping smart constructor.

Constructors

Mapping' 

Fields

  • children :: Maybe [Mapping]

    Only applicable to nested data structures. If you want to change the parent structure, but also one of its children, you can fill out this data strucutre. It is also Mapping, but its FromPath will be the parent's FromPath plus the FromPath from this structure.

    For the children part, suppose you have the structure:

    { "FromPath": "OuterStructure", "ToKey": "OuterStructure", "ToType": "Struct", "Dropped": false, "Chidlren": [{ "FromPath": "inner", "ToKey": "inner", "ToType": "Double", "Dropped": false, }] }

    You can specify a Mapping that looks like:

    { "FromPath": "OuterStructure", "ToKey": "OuterStructure", "ToType": "Struct", "Dropped": false, "Chidlren": [{ "FromPath": "inner", "ToKey": "inner", "ToType": "Double", "Dropped": false, }] }
  • dropped :: Maybe Bool

    If true, then the column is removed.

  • fromPath :: Maybe [Text]

    The table or column to be modified.

  • fromType :: Maybe Text

    The type of the data to be modified.

  • toKey :: Maybe Text

    After the apply mapping, what the name of the column should be. Can be the same as FromPath.

  • toType :: Maybe Text

    The data type that the data is to be modified to.

Instances

Instances details
FromJSON Mapping Source # 
Instance details

Defined in Amazonka.Glue.Types.Mapping

ToJSON Mapping Source # 
Instance details

Defined in Amazonka.Glue.Types.Mapping

Generic Mapping Source # 
Instance details

Defined in Amazonka.Glue.Types.Mapping

Associated Types

type Rep Mapping :: Type -> Type #

Methods

from :: Mapping -> Rep Mapping x #

to :: Rep Mapping x -> Mapping #

Read Mapping Source # 
Instance details

Defined in Amazonka.Glue.Types.Mapping

Show Mapping Source # 
Instance details

Defined in Amazonka.Glue.Types.Mapping

NFData Mapping Source # 
Instance details

Defined in Amazonka.Glue.Types.Mapping

Methods

rnf :: Mapping -> () #

Eq Mapping Source # 
Instance details

Defined in Amazonka.Glue.Types.Mapping

Methods

(==) :: Mapping -> Mapping -> Bool #

(/=) :: Mapping -> Mapping -> Bool #

Hashable Mapping Source # 
Instance details

Defined in Amazonka.Glue.Types.Mapping

Methods

hashWithSalt :: Int -> Mapping -> Int #

hash :: Mapping -> Int #

type Rep Mapping Source # 
Instance details

Defined in Amazonka.Glue.Types.Mapping

newMapping :: Mapping Source #

Create a value of Mapping with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:children:Mapping', mapping_children - Only applicable to nested data structures. If you want to change the parent structure, but also one of its children, you can fill out this data strucutre. It is also Mapping, but its FromPath will be the parent's FromPath plus the FromPath from this structure.

For the children part, suppose you have the structure:

{ "FromPath": "OuterStructure", "ToKey": "OuterStructure", "ToType": "Struct", "Dropped": false, "Chidlren": [{ "FromPath": "inner", "ToKey": "inner", "ToType": "Double", "Dropped": false, }] }

You can specify a Mapping that looks like:

{ "FromPath": "OuterStructure", "ToKey": "OuterStructure", "ToType": "Struct", "Dropped": false, "Chidlren": [{ "FromPath": "inner", "ToKey": "inner", "ToType": "Double", "Dropped": false, }] }

$sel:dropped:Mapping', mapping_dropped - If true, then the column is removed.

$sel:fromPath:Mapping', mapping_fromPath - The table or column to be modified.

$sel:fromType:Mapping', mapping_fromType - The type of the data to be modified.

$sel:toKey:Mapping', mapping_toKey - After the apply mapping, what the name of the column should be. Can be the same as FromPath.

$sel:toType:Mapping', mapping_toType - The data type that the data is to be modified to.

mapping_children :: Lens' Mapping (Maybe [Mapping]) Source #

Only applicable to nested data structures. If you want to change the parent structure, but also one of its children, you can fill out this data strucutre. It is also Mapping, but its FromPath will be the parent's FromPath plus the FromPath from this structure.

For the children part, suppose you have the structure:

{ "FromPath": "OuterStructure", "ToKey": "OuterStructure", "ToType": "Struct", "Dropped": false, "Chidlren": [{ "FromPath": "inner", "ToKey": "inner", "ToType": "Double", "Dropped": false, }] }

You can specify a Mapping that looks like:

{ "FromPath": "OuterStructure", "ToKey": "OuterStructure", "ToType": "Struct", "Dropped": false, "Chidlren": [{ "FromPath": "inner", "ToKey": "inner", "ToType": "Double", "Dropped": false, }] }

mapping_dropped :: Lens' Mapping (Maybe Bool) Source #

If true, then the column is removed.

mapping_fromPath :: Lens' Mapping (Maybe [Text]) Source #

The table or column to be modified.

mapping_fromType :: Lens' Mapping (Maybe Text) Source #

The type of the data to be modified.

mapping_toKey :: Lens' Mapping (Maybe Text) Source #

After the apply mapping, what the name of the column should be. Can be the same as FromPath.

mapping_toType :: Lens' Mapping (Maybe Text) Source #

The data type that the data is to be modified to.

MappingEntry

data MappingEntry Source #

Defines a mapping.

See: newMappingEntry smart constructor.

Constructors

MappingEntry' 

Fields

Instances

Instances details
FromJSON MappingEntry Source # 
Instance details

Defined in Amazonka.Glue.Types.MappingEntry

ToJSON MappingEntry Source # 
Instance details

Defined in Amazonka.Glue.Types.MappingEntry

Generic MappingEntry Source # 
Instance details

Defined in Amazonka.Glue.Types.MappingEntry

Associated Types

type Rep MappingEntry :: Type -> Type #

Read MappingEntry Source # 
Instance details

Defined in Amazonka.Glue.Types.MappingEntry

Show MappingEntry Source # 
Instance details

Defined in Amazonka.Glue.Types.MappingEntry

NFData MappingEntry Source # 
Instance details

Defined in Amazonka.Glue.Types.MappingEntry

Methods

rnf :: MappingEntry -> () #

Eq MappingEntry Source # 
Instance details

Defined in Amazonka.Glue.Types.MappingEntry

Hashable MappingEntry Source # 
Instance details

Defined in Amazonka.Glue.Types.MappingEntry

type Rep MappingEntry Source # 
Instance details

Defined in Amazonka.Glue.Types.MappingEntry

type Rep MappingEntry = D1 ('MetaData "MappingEntry" "Amazonka.Glue.Types.MappingEntry" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "MappingEntry'" 'PrefixI 'True) ((S1 ('MetaSel ('Just "sourcePath") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: (S1 ('MetaSel ('Just "sourceTable") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "sourceType") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)))) :*: (S1 ('MetaSel ('Just "targetPath") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: (S1 ('MetaSel ('Just "targetTable") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "targetType") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text))))))

newMappingEntry :: MappingEntry Source #

Create a value of MappingEntry with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:sourcePath:MappingEntry', mappingEntry_sourcePath - The source path.

$sel:sourceTable:MappingEntry', mappingEntry_sourceTable - The name of the source table.

$sel:sourceType:MappingEntry', mappingEntry_sourceType - The source type.

$sel:targetPath:MappingEntry', mappingEntry_targetPath - The target path.

$sel:targetTable:MappingEntry', mappingEntry_targetTable - The target table.

$sel:targetType:MappingEntry', mappingEntry_targetType - The target type.

mappingEntry_sourceTable :: Lens' MappingEntry (Maybe Text) Source #

The name of the source table.

Merge

data Merge Source #

Specifies a transform that merges a DynamicFrame with a staging DynamicFrame based on the specified primary keys to identify records. Duplicate records (records with the same primary keys) are not de-duplicated.

See: newMerge smart constructor.

Constructors

Merge' 

Fields

  • name :: Text

    The name of the transform node.

  • inputs :: NonEmpty Text

    The data inputs identified by their node names.

  • source :: Text

    The source DynamicFrame that will be merged with a staging DynamicFrame.

  • primaryKeys :: [[Text]]

    The list of primary key fields to match records from the source and staging dynamic frames.

Instances

Instances details
FromJSON Merge Source # 
Instance details

Defined in Amazonka.Glue.Types.Merge

ToJSON Merge Source # 
Instance details

Defined in Amazonka.Glue.Types.Merge

Generic Merge Source # 
Instance details

Defined in Amazonka.Glue.Types.Merge

Associated Types

type Rep Merge :: Type -> Type #

Methods

from :: Merge -> Rep Merge x #

to :: Rep Merge x -> Merge #

Read Merge Source # 
Instance details

Defined in Amazonka.Glue.Types.Merge

Show Merge Source # 
Instance details

Defined in Amazonka.Glue.Types.Merge

Methods

showsPrec :: Int -> Merge -> ShowS #

show :: Merge -> String #

showList :: [Merge] -> ShowS #

NFData Merge Source # 
Instance details

Defined in Amazonka.Glue.Types.Merge

Methods

rnf :: Merge -> () #

Eq Merge Source # 
Instance details

Defined in Amazonka.Glue.Types.Merge

Methods

(==) :: Merge -> Merge -> Bool #

(/=) :: Merge -> Merge -> Bool #

Hashable Merge Source # 
Instance details

Defined in Amazonka.Glue.Types.Merge

Methods

hashWithSalt :: Int -> Merge -> Int #

hash :: Merge -> Int #

type Rep Merge Source # 
Instance details

Defined in Amazonka.Glue.Types.Merge

type Rep Merge = D1 ('MetaData "Merge" "Amazonka.Glue.Types.Merge" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "Merge'" 'PrefixI 'True) ((S1 ('MetaSel ('Just "name") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text) :*: S1 ('MetaSel ('Just "inputs") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (NonEmpty Text))) :*: (S1 ('MetaSel ('Just "source") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text) :*: S1 ('MetaSel ('Just "primaryKeys") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 [[Text]]))))

newMerge Source #

Create a value of Merge with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:name:Merge', merge_name - The name of the transform node.

$sel:inputs:Merge', merge_inputs - The data inputs identified by their node names.

$sel:source:Merge', merge_source - The source DynamicFrame that will be merged with a staging DynamicFrame.

$sel:primaryKeys:Merge', merge_primaryKeys - The list of primary key fields to match records from the source and staging dynamic frames.

merge_name :: Lens' Merge Text Source #

The name of the transform node.

merge_inputs :: Lens' Merge (NonEmpty Text) Source #

The data inputs identified by their node names.

merge_source :: Lens' Merge Text Source #

The source DynamicFrame that will be merged with a staging DynamicFrame.

merge_primaryKeys :: Lens' Merge [[Text]] Source #

The list of primary key fields to match records from the source and staging dynamic frames.

MetadataInfo

data MetadataInfo Source #

A structure containing metadata information for a schema version.

See: newMetadataInfo smart constructor.

Constructors

MetadataInfo' 

Fields

Instances

Instances details
FromJSON MetadataInfo Source # 
Instance details

Defined in Amazonka.Glue.Types.MetadataInfo

Generic MetadataInfo Source # 
Instance details

Defined in Amazonka.Glue.Types.MetadataInfo

Associated Types

type Rep MetadataInfo :: Type -> Type #

Read MetadataInfo Source # 
Instance details

Defined in Amazonka.Glue.Types.MetadataInfo

Show MetadataInfo Source # 
Instance details

Defined in Amazonka.Glue.Types.MetadataInfo

NFData MetadataInfo Source # 
Instance details

Defined in Amazonka.Glue.Types.MetadataInfo

Methods

rnf :: MetadataInfo -> () #

Eq MetadataInfo Source # 
Instance details

Defined in Amazonka.Glue.Types.MetadataInfo

Hashable MetadataInfo Source # 
Instance details

Defined in Amazonka.Glue.Types.MetadataInfo

type Rep MetadataInfo Source # 
Instance details

Defined in Amazonka.Glue.Types.MetadataInfo

type Rep MetadataInfo = D1 ('MetaData "MetadataInfo" "Amazonka.Glue.Types.MetadataInfo" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "MetadataInfo'" 'PrefixI 'True) (S1 ('MetaSel ('Just "createdTime") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: (S1 ('MetaSel ('Just "metadataValue") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "otherMetadataValueList") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe [OtherMetadataValueListItem])))))

newMetadataInfo :: MetadataInfo Source #

Create a value of MetadataInfo with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

MetadataInfo, metadataInfo_createdTime - The time at which the entry was created.

MetadataInfo, metadataInfo_metadataValue - The metadata key’s corresponding value.

$sel:otherMetadataValueList:MetadataInfo', metadataInfo_otherMetadataValueList - Other metadata belonging to the same metadata key.

metadataInfo_createdTime :: Lens' MetadataInfo (Maybe Text) Source #

The time at which the entry was created.

metadataInfo_metadataValue :: Lens' MetadataInfo (Maybe Text) Source #

The metadata key’s corresponding value.

metadataInfo_otherMetadataValueList :: Lens' MetadataInfo (Maybe [OtherMetadataValueListItem]) Source #

Other metadata belonging to the same metadata key.

MetadataKeyValuePair

data MetadataKeyValuePair Source #

A structure containing a key value pair for metadata.

See: newMetadataKeyValuePair smart constructor.

Constructors

MetadataKeyValuePair' 

Fields

Instances

Instances details
ToJSON MetadataKeyValuePair Source # 
Instance details

Defined in Amazonka.Glue.Types.MetadataKeyValuePair

Generic MetadataKeyValuePair Source # 
Instance details

Defined in Amazonka.Glue.Types.MetadataKeyValuePair

Associated Types

type Rep MetadataKeyValuePair :: Type -> Type #

Read MetadataKeyValuePair Source # 
Instance details

Defined in Amazonka.Glue.Types.MetadataKeyValuePair

Show MetadataKeyValuePair Source # 
Instance details

Defined in Amazonka.Glue.Types.MetadataKeyValuePair

NFData MetadataKeyValuePair Source # 
Instance details

Defined in Amazonka.Glue.Types.MetadataKeyValuePair

Methods

rnf :: MetadataKeyValuePair -> () #

Eq MetadataKeyValuePair Source # 
Instance details

Defined in Amazonka.Glue.Types.MetadataKeyValuePair

Hashable MetadataKeyValuePair Source # 
Instance details

Defined in Amazonka.Glue.Types.MetadataKeyValuePair

type Rep MetadataKeyValuePair Source # 
Instance details

Defined in Amazonka.Glue.Types.MetadataKeyValuePair

type Rep MetadataKeyValuePair = D1 ('MetaData "MetadataKeyValuePair" "Amazonka.Glue.Types.MetadataKeyValuePair" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "MetadataKeyValuePair'" 'PrefixI 'True) (S1 ('MetaSel ('Just "metadataKey") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "metadataValue") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text))))

newMetadataKeyValuePair :: MetadataKeyValuePair Source #

Create a value of MetadataKeyValuePair with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:metadataKey:MetadataKeyValuePair', metadataKeyValuePair_metadataKey - A metadata key.

$sel:metadataValue:MetadataKeyValuePair', metadataKeyValuePair_metadataValue - A metadata key’s corresponding value.

metadataKeyValuePair_metadataValue :: Lens' MetadataKeyValuePair (Maybe Text) Source #

A metadata key’s corresponding value.

MicrosoftSQLServerCatalogSource

data MicrosoftSQLServerCatalogSource Source #

Specifies a Microsoft SQL server data source in the Glue Data Catalog.

See: newMicrosoftSQLServerCatalogSource smart constructor.

Constructors

MicrosoftSQLServerCatalogSource' 

Fields

  • name :: Text

    The name of the data source.

  • database :: Text

    The name of the database to read from.

  • table :: Text

    The name of the table in the database to read from.

Instances

Instances details
FromJSON MicrosoftSQLServerCatalogSource Source # 
Instance details

Defined in Amazonka.Glue.Types.MicrosoftSQLServerCatalogSource

ToJSON MicrosoftSQLServerCatalogSource Source # 
Instance details

Defined in Amazonka.Glue.Types.MicrosoftSQLServerCatalogSource

Generic MicrosoftSQLServerCatalogSource Source # 
Instance details

Defined in Amazonka.Glue.Types.MicrosoftSQLServerCatalogSource

Associated Types

type Rep MicrosoftSQLServerCatalogSource :: Type -> Type #

Read MicrosoftSQLServerCatalogSource Source # 
Instance details

Defined in Amazonka.Glue.Types.MicrosoftSQLServerCatalogSource

Show MicrosoftSQLServerCatalogSource Source # 
Instance details

Defined in Amazonka.Glue.Types.MicrosoftSQLServerCatalogSource

NFData MicrosoftSQLServerCatalogSource Source # 
Instance details

Defined in Amazonka.Glue.Types.MicrosoftSQLServerCatalogSource

Eq MicrosoftSQLServerCatalogSource Source # 
Instance details

Defined in Amazonka.Glue.Types.MicrosoftSQLServerCatalogSource

Hashable MicrosoftSQLServerCatalogSource Source # 
Instance details

Defined in Amazonka.Glue.Types.MicrosoftSQLServerCatalogSource

type Rep MicrosoftSQLServerCatalogSource Source # 
Instance details

Defined in Amazonka.Glue.Types.MicrosoftSQLServerCatalogSource

type Rep MicrosoftSQLServerCatalogSource = D1 ('MetaData "MicrosoftSQLServerCatalogSource" "Amazonka.Glue.Types.MicrosoftSQLServerCatalogSource" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "MicrosoftSQLServerCatalogSource'" 'PrefixI 'True) (S1 ('MetaSel ('Just "name") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text) :*: (S1 ('MetaSel ('Just "database") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text) :*: S1 ('MetaSel ('Just "table") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text))))

newMicrosoftSQLServerCatalogSource Source #

Create a value of MicrosoftSQLServerCatalogSource with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:name:MicrosoftSQLServerCatalogSource', microsoftSQLServerCatalogSource_name - The name of the data source.

$sel:database:MicrosoftSQLServerCatalogSource', microsoftSQLServerCatalogSource_database - The name of the database to read from.

$sel:table:MicrosoftSQLServerCatalogSource', microsoftSQLServerCatalogSource_table - The name of the table in the database to read from.

microsoftSQLServerCatalogSource_table :: Lens' MicrosoftSQLServerCatalogSource Text Source #

The name of the table in the database to read from.

MicrosoftSQLServerCatalogTarget

data MicrosoftSQLServerCatalogTarget Source #

Specifies a target that uses Microsoft SQL.

See: newMicrosoftSQLServerCatalogTarget smart constructor.

Constructors

MicrosoftSQLServerCatalogTarget' 

Fields

Instances

Instances details
FromJSON MicrosoftSQLServerCatalogTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.MicrosoftSQLServerCatalogTarget

ToJSON MicrosoftSQLServerCatalogTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.MicrosoftSQLServerCatalogTarget

Generic MicrosoftSQLServerCatalogTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.MicrosoftSQLServerCatalogTarget

Associated Types

type Rep MicrosoftSQLServerCatalogTarget :: Type -> Type #

Read MicrosoftSQLServerCatalogTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.MicrosoftSQLServerCatalogTarget

Show MicrosoftSQLServerCatalogTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.MicrosoftSQLServerCatalogTarget

NFData MicrosoftSQLServerCatalogTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.MicrosoftSQLServerCatalogTarget

Eq MicrosoftSQLServerCatalogTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.MicrosoftSQLServerCatalogTarget

Hashable MicrosoftSQLServerCatalogTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.MicrosoftSQLServerCatalogTarget

type Rep MicrosoftSQLServerCatalogTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.MicrosoftSQLServerCatalogTarget

type Rep MicrosoftSQLServerCatalogTarget = D1 ('MetaData "MicrosoftSQLServerCatalogTarget" "Amazonka.Glue.Types.MicrosoftSQLServerCatalogTarget" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "MicrosoftSQLServerCatalogTarget'" 'PrefixI 'True) ((S1 ('MetaSel ('Just "name") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text) :*: S1 ('MetaSel ('Just "inputs") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (NonEmpty Text))) :*: (S1 ('MetaSel ('Just "database") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text) :*: S1 ('MetaSel ('Just "table") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text))))

microsoftSQLServerCatalogTarget_table :: Lens' MicrosoftSQLServerCatalogTarget Text Source #

The name of the table in the database to write to.

MongoDBTarget

data MongoDBTarget Source #

Specifies an Amazon DocumentDB or MongoDB data store to crawl.

See: newMongoDBTarget smart constructor.

Constructors

MongoDBTarget' 

Fields

  • connectionName :: Maybe Text

    The name of the connection to use to connect to the Amazon DocumentDB or MongoDB target.

  • path :: Maybe Text

    The path of the Amazon DocumentDB or MongoDB target (database/collection).

  • scanAll :: Maybe Bool

    Indicates whether to scan all the records, or to sample rows from the table. Scanning all the records can take a long time when the table is not a high throughput table.

    A value of true means to scan all records, while a value of false means to sample the records. If no value is specified, the value defaults to true.

Instances

Instances details
FromJSON MongoDBTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.MongoDBTarget

ToJSON MongoDBTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.MongoDBTarget

Generic MongoDBTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.MongoDBTarget

Associated Types

type Rep MongoDBTarget :: Type -> Type #

Read MongoDBTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.MongoDBTarget

Show MongoDBTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.MongoDBTarget

NFData MongoDBTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.MongoDBTarget

Methods

rnf :: MongoDBTarget -> () #

Eq MongoDBTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.MongoDBTarget

Hashable MongoDBTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.MongoDBTarget

type Rep MongoDBTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.MongoDBTarget

type Rep MongoDBTarget = D1 ('MetaData "MongoDBTarget" "Amazonka.Glue.Types.MongoDBTarget" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "MongoDBTarget'" 'PrefixI 'True) (S1 ('MetaSel ('Just "connectionName") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: (S1 ('MetaSel ('Just "path") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "scanAll") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Bool)))))

newMongoDBTarget :: MongoDBTarget Source #

Create a value of MongoDBTarget with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:connectionName:MongoDBTarget', mongoDBTarget_connectionName - The name of the connection to use to connect to the Amazon DocumentDB or MongoDB target.

$sel:path:MongoDBTarget', mongoDBTarget_path - The path of the Amazon DocumentDB or MongoDB target (database/collection).

$sel:scanAll:MongoDBTarget', mongoDBTarget_scanAll - Indicates whether to scan all the records, or to sample rows from the table. Scanning all the records can take a long time when the table is not a high throughput table.

A value of true means to scan all records, while a value of false means to sample the records. If no value is specified, the value defaults to true.

mongoDBTarget_connectionName :: Lens' MongoDBTarget (Maybe Text) Source #

The name of the connection to use to connect to the Amazon DocumentDB or MongoDB target.

mongoDBTarget_path :: Lens' MongoDBTarget (Maybe Text) Source #

The path of the Amazon DocumentDB or MongoDB target (database/collection).

mongoDBTarget_scanAll :: Lens' MongoDBTarget (Maybe Bool) Source #

Indicates whether to scan all the records, or to sample rows from the table. Scanning all the records can take a long time when the table is not a high throughput table.

A value of true means to scan all records, while a value of false means to sample the records. If no value is specified, the value defaults to true.

MySQLCatalogSource

data MySQLCatalogSource Source #

Specifies a MySQL data source in the Glue Data Catalog.

See: newMySQLCatalogSource smart constructor.

Constructors

MySQLCatalogSource' 

Fields

  • name :: Text

    The name of the data source.

  • database :: Text

    The name of the database to read from.

  • table :: Text

    The name of the table in the database to read from.

Instances

Instances details
FromJSON MySQLCatalogSource Source # 
Instance details

Defined in Amazonka.Glue.Types.MySQLCatalogSource

ToJSON MySQLCatalogSource Source # 
Instance details

Defined in Amazonka.Glue.Types.MySQLCatalogSource

Generic MySQLCatalogSource Source # 
Instance details

Defined in Amazonka.Glue.Types.MySQLCatalogSource

Associated Types

type Rep MySQLCatalogSource :: Type -> Type #

Read MySQLCatalogSource Source # 
Instance details

Defined in Amazonka.Glue.Types.MySQLCatalogSource

Show MySQLCatalogSource Source # 
Instance details

Defined in Amazonka.Glue.Types.MySQLCatalogSource

NFData MySQLCatalogSource Source # 
Instance details

Defined in Amazonka.Glue.Types.MySQLCatalogSource

Methods

rnf :: MySQLCatalogSource -> () #

Eq MySQLCatalogSource Source # 
Instance details

Defined in Amazonka.Glue.Types.MySQLCatalogSource

Hashable MySQLCatalogSource Source # 
Instance details

Defined in Amazonka.Glue.Types.MySQLCatalogSource

type Rep MySQLCatalogSource Source # 
Instance details

Defined in Amazonka.Glue.Types.MySQLCatalogSource

type Rep MySQLCatalogSource = D1 ('MetaData "MySQLCatalogSource" "Amazonka.Glue.Types.MySQLCatalogSource" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "MySQLCatalogSource'" 'PrefixI 'True) (S1 ('MetaSel ('Just "name") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text) :*: (S1 ('MetaSel ('Just "database") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text) :*: S1 ('MetaSel ('Just "table") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text))))

newMySQLCatalogSource Source #

Create a value of MySQLCatalogSource with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:name:MySQLCatalogSource', mySQLCatalogSource_name - The name of the data source.

$sel:database:MySQLCatalogSource', mySQLCatalogSource_database - The name of the database to read from.

$sel:table:MySQLCatalogSource', mySQLCatalogSource_table - The name of the table in the database to read from.

mySQLCatalogSource_database :: Lens' MySQLCatalogSource Text Source #

The name of the database to read from.

mySQLCatalogSource_table :: Lens' MySQLCatalogSource Text Source #

The name of the table in the database to read from.

MySQLCatalogTarget

data MySQLCatalogTarget Source #

Specifies a target that uses MySQL.

See: newMySQLCatalogTarget smart constructor.

Constructors

MySQLCatalogTarget' 

Fields

Instances

Instances details
FromJSON MySQLCatalogTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.MySQLCatalogTarget

ToJSON MySQLCatalogTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.MySQLCatalogTarget

Generic MySQLCatalogTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.MySQLCatalogTarget

Associated Types

type Rep MySQLCatalogTarget :: Type -> Type #

Read MySQLCatalogTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.MySQLCatalogTarget

Show MySQLCatalogTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.MySQLCatalogTarget

NFData MySQLCatalogTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.MySQLCatalogTarget

Methods

rnf :: MySQLCatalogTarget -> () #

Eq MySQLCatalogTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.MySQLCatalogTarget

Hashable MySQLCatalogTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.MySQLCatalogTarget

type Rep MySQLCatalogTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.MySQLCatalogTarget

type Rep MySQLCatalogTarget = D1 ('MetaData "MySQLCatalogTarget" "Amazonka.Glue.Types.MySQLCatalogTarget" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "MySQLCatalogTarget'" 'PrefixI 'True) ((S1 ('MetaSel ('Just "name") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text) :*: S1 ('MetaSel ('Just "inputs") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (NonEmpty Text))) :*: (S1 ('MetaSel ('Just "database") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text) :*: S1 ('MetaSel ('Just "table") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text))))

newMySQLCatalogTarget Source #

Create a value of MySQLCatalogTarget with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:name:MySQLCatalogTarget', mySQLCatalogTarget_name - The name of the data target.

$sel:inputs:MySQLCatalogTarget', mySQLCatalogTarget_inputs - The nodes that are inputs to the data target.

$sel:database:MySQLCatalogTarget', mySQLCatalogTarget_database - The name of the database to write to.

$sel:table:MySQLCatalogTarget', mySQLCatalogTarget_table - The name of the table in the database to write to.

mySQLCatalogTarget_inputs :: Lens' MySQLCatalogTarget (NonEmpty Text) Source #

The nodes that are inputs to the data target.

mySQLCatalogTarget_database :: Lens' MySQLCatalogTarget Text Source #

The name of the database to write to.

mySQLCatalogTarget_table :: Lens' MySQLCatalogTarget Text Source #

The name of the table in the database to write to.

Node

data Node Source #

A node represents an Glue component (trigger, crawler, or job) on a workflow graph.

See: newNode smart constructor.

Constructors

Node' 

Fields

Instances

Instances details
FromJSON Node Source # 
Instance details

Defined in Amazonka.Glue.Types.Node

Generic Node Source # 
Instance details

Defined in Amazonka.Glue.Types.Node

Associated Types

type Rep Node :: Type -> Type #

Methods

from :: Node -> Rep Node x #

to :: Rep Node x -> Node #

Read Node Source # 
Instance details

Defined in Amazonka.Glue.Types.Node

Show Node Source # 
Instance details

Defined in Amazonka.Glue.Types.Node

Methods

showsPrec :: Int -> Node -> ShowS #

show :: Node -> String #

showList :: [Node] -> ShowS #

NFData Node Source # 
Instance details

Defined in Amazonka.Glue.Types.Node

Methods

rnf :: Node -> () #

Eq Node Source # 
Instance details

Defined in Amazonka.Glue.Types.Node

Methods

(==) :: Node -> Node -> Bool #

(/=) :: Node -> Node -> Bool #

Hashable Node Source # 
Instance details

Defined in Amazonka.Glue.Types.Node

Methods

hashWithSalt :: Int -> Node -> Int #

hash :: Node -> Int #

type Rep Node Source # 
Instance details

Defined in Amazonka.Glue.Types.Node

newNode :: Node Source #

Create a value of Node with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:crawlerDetails:Node', node_crawlerDetails - Details of the crawler when the node represents a crawler.

$sel:jobDetails:Node', node_jobDetails - Details of the Job when the node represents a Job.

$sel:name:Node', node_name - The name of the Glue component represented by the node.

$sel:triggerDetails:Node', node_triggerDetails - Details of the Trigger when the node represents a Trigger.

$sel:type':Node', node_type - The type of Glue component represented by the node.

$sel:uniqueId:Node', node_uniqueId - The unique Id assigned to the node within the workflow.

node_crawlerDetails :: Lens' Node (Maybe CrawlerNodeDetails) Source #

Details of the crawler when the node represents a crawler.

node_jobDetails :: Lens' Node (Maybe JobNodeDetails) Source #

Details of the Job when the node represents a Job.

node_name :: Lens' Node (Maybe Text) Source #

The name of the Glue component represented by the node.

node_triggerDetails :: Lens' Node (Maybe TriggerNodeDetails) Source #

Details of the Trigger when the node represents a Trigger.

node_type :: Lens' Node (Maybe NodeType) Source #

The type of Glue component represented by the node.

node_uniqueId :: Lens' Node (Maybe Text) Source #

The unique Id assigned to the node within the workflow.

NotificationProperty

data NotificationProperty Source #

Specifies configuration properties of a notification.

See: newNotificationProperty smart constructor.

Constructors

NotificationProperty' 

Fields

Instances

Instances details
FromJSON NotificationProperty Source # 
Instance details

Defined in Amazonka.Glue.Types.NotificationProperty

ToJSON NotificationProperty Source # 
Instance details

Defined in Amazonka.Glue.Types.NotificationProperty

Generic NotificationProperty Source # 
Instance details

Defined in Amazonka.Glue.Types.NotificationProperty

Associated Types

type Rep NotificationProperty :: Type -> Type #

Read NotificationProperty Source # 
Instance details

Defined in Amazonka.Glue.Types.NotificationProperty

Show NotificationProperty Source # 
Instance details

Defined in Amazonka.Glue.Types.NotificationProperty

NFData NotificationProperty Source # 
Instance details

Defined in Amazonka.Glue.Types.NotificationProperty

Methods

rnf :: NotificationProperty -> () #

Eq NotificationProperty Source # 
Instance details

Defined in Amazonka.Glue.Types.NotificationProperty

Hashable NotificationProperty Source # 
Instance details

Defined in Amazonka.Glue.Types.NotificationProperty

type Rep NotificationProperty Source # 
Instance details

Defined in Amazonka.Glue.Types.NotificationProperty

type Rep NotificationProperty = D1 ('MetaData "NotificationProperty" "Amazonka.Glue.Types.NotificationProperty" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "NotificationProperty'" 'PrefixI 'True) (S1 ('MetaSel ('Just "notifyDelayAfter") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Natural))))

newNotificationProperty :: NotificationProperty Source #

Create a value of NotificationProperty with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:notifyDelayAfter:NotificationProperty', notificationProperty_notifyDelayAfter - After a job run starts, the number of minutes to wait before sending a job run delay notification.

notificationProperty_notifyDelayAfter :: Lens' NotificationProperty (Maybe Natural) Source #

After a job run starts, the number of minutes to wait before sending a job run delay notification.

NullCheckBoxList

data NullCheckBoxList Source #

Represents whether certain values are recognized as null values for removal.

See: newNullCheckBoxList smart constructor.

Constructors

NullCheckBoxList' 

Fields

  • isEmpty :: Maybe Bool

    Specifies that an empty string is considered as a null value.

  • isNegOne :: Maybe Bool

    Specifies that an integer value of -1 is considered as a null value.

  • isNullString :: Maybe Bool

    Specifies that a value spelling out the word 'null' is considered as a null value.

Instances

Instances details
FromJSON NullCheckBoxList Source # 
Instance details

Defined in Amazonka.Glue.Types.NullCheckBoxList

ToJSON NullCheckBoxList Source # 
Instance details

Defined in Amazonka.Glue.Types.NullCheckBoxList

Generic NullCheckBoxList Source # 
Instance details

Defined in Amazonka.Glue.Types.NullCheckBoxList

Associated Types

type Rep NullCheckBoxList :: Type -> Type #

Read NullCheckBoxList Source # 
Instance details

Defined in Amazonka.Glue.Types.NullCheckBoxList

Show NullCheckBoxList Source # 
Instance details

Defined in Amazonka.Glue.Types.NullCheckBoxList

NFData NullCheckBoxList Source # 
Instance details

Defined in Amazonka.Glue.Types.NullCheckBoxList

Methods

rnf :: NullCheckBoxList -> () #

Eq NullCheckBoxList Source # 
Instance details

Defined in Amazonka.Glue.Types.NullCheckBoxList

Hashable NullCheckBoxList Source # 
Instance details

Defined in Amazonka.Glue.Types.NullCheckBoxList

type Rep NullCheckBoxList Source # 
Instance details

Defined in Amazonka.Glue.Types.NullCheckBoxList

type Rep NullCheckBoxList = D1 ('MetaData "NullCheckBoxList" "Amazonka.Glue.Types.NullCheckBoxList" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "NullCheckBoxList'" 'PrefixI 'True) (S1 ('MetaSel ('Just "isEmpty") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Bool)) :*: (S1 ('MetaSel ('Just "isNegOne") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Bool)) :*: S1 ('MetaSel ('Just "isNullString") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Bool)))))

newNullCheckBoxList :: NullCheckBoxList Source #

Create a value of NullCheckBoxList with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:isEmpty:NullCheckBoxList', nullCheckBoxList_isEmpty - Specifies that an empty string is considered as a null value.

$sel:isNegOne:NullCheckBoxList', nullCheckBoxList_isNegOne - Specifies that an integer value of -1 is considered as a null value.

$sel:isNullString:NullCheckBoxList', nullCheckBoxList_isNullString - Specifies that a value spelling out the word 'null' is considered as a null value.

nullCheckBoxList_isEmpty :: Lens' NullCheckBoxList (Maybe Bool) Source #

Specifies that an empty string is considered as a null value.

nullCheckBoxList_isNegOne :: Lens' NullCheckBoxList (Maybe Bool) Source #

Specifies that an integer value of -1 is considered as a null value.

nullCheckBoxList_isNullString :: Lens' NullCheckBoxList (Maybe Bool) Source #

Specifies that a value spelling out the word 'null' is considered as a null value.

NullValueField

data NullValueField Source #

Represents a custom null value such as a zeros or other value being used as a null placeholder unique to the dataset.

See: newNullValueField smart constructor.

Constructors

NullValueField' 

Fields

Instances

Instances details
FromJSON NullValueField Source # 
Instance details

Defined in Amazonka.Glue.Types.NullValueField

ToJSON NullValueField Source # 
Instance details

Defined in Amazonka.Glue.Types.NullValueField

Generic NullValueField Source # 
Instance details

Defined in Amazonka.Glue.Types.NullValueField

Associated Types

type Rep NullValueField :: Type -> Type #

Read NullValueField Source # 
Instance details

Defined in Amazonka.Glue.Types.NullValueField

Show NullValueField Source # 
Instance details

Defined in Amazonka.Glue.Types.NullValueField

NFData NullValueField Source # 
Instance details

Defined in Amazonka.Glue.Types.NullValueField

Methods

rnf :: NullValueField -> () #

Eq NullValueField Source # 
Instance details

Defined in Amazonka.Glue.Types.NullValueField

Hashable NullValueField Source # 
Instance details

Defined in Amazonka.Glue.Types.NullValueField

type Rep NullValueField Source # 
Instance details

Defined in Amazonka.Glue.Types.NullValueField

type Rep NullValueField = D1 ('MetaData "NullValueField" "Amazonka.Glue.Types.NullValueField" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "NullValueField'" 'PrefixI 'True) (S1 ('MetaSel ('Just "value") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text) :*: S1 ('MetaSel ('Just "datatype") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Datatype)))

newNullValueField Source #

Create a value of NullValueField with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:value:NullValueField', nullValueField_value - The value of the null placeholder.

$sel:datatype:NullValueField', nullValueField_datatype - The datatype of the value.

nullValueField_value :: Lens' NullValueField Text Source #

The value of the null placeholder.

OracleSQLCatalogSource

data OracleSQLCatalogSource Source #

Specifies an Oracle data source in the Glue Data Catalog.

See: newOracleSQLCatalogSource smart constructor.

Constructors

OracleSQLCatalogSource' 

Fields

  • name :: Text

    The name of the data source.

  • database :: Text

    The name of the database to read from.

  • table :: Text

    The name of the table in the database to read from.

Instances

Instances details
FromJSON OracleSQLCatalogSource Source # 
Instance details

Defined in Amazonka.Glue.Types.OracleSQLCatalogSource

ToJSON OracleSQLCatalogSource Source # 
Instance details

Defined in Amazonka.Glue.Types.OracleSQLCatalogSource

Generic OracleSQLCatalogSource Source # 
Instance details

Defined in Amazonka.Glue.Types.OracleSQLCatalogSource

Associated Types

type Rep OracleSQLCatalogSource :: Type -> Type #

Read OracleSQLCatalogSource Source # 
Instance details

Defined in Amazonka.Glue.Types.OracleSQLCatalogSource

Show OracleSQLCatalogSource Source # 
Instance details

Defined in Amazonka.Glue.Types.OracleSQLCatalogSource

NFData OracleSQLCatalogSource Source # 
Instance details

Defined in Amazonka.Glue.Types.OracleSQLCatalogSource

Methods

rnf :: OracleSQLCatalogSource -> () #

Eq OracleSQLCatalogSource Source # 
Instance details

Defined in Amazonka.Glue.Types.OracleSQLCatalogSource

Hashable OracleSQLCatalogSource Source # 
Instance details

Defined in Amazonka.Glue.Types.OracleSQLCatalogSource

type Rep OracleSQLCatalogSource Source # 
Instance details

Defined in Amazonka.Glue.Types.OracleSQLCatalogSource

type Rep OracleSQLCatalogSource = D1 ('MetaData "OracleSQLCatalogSource" "Amazonka.Glue.Types.OracleSQLCatalogSource" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "OracleSQLCatalogSource'" 'PrefixI 'True) (S1 ('MetaSel ('Just "name") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text) :*: (S1 ('MetaSel ('Just "database") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text) :*: S1 ('MetaSel ('Just "table") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text))))

newOracleSQLCatalogSource Source #

Create a value of OracleSQLCatalogSource with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:name:OracleSQLCatalogSource', oracleSQLCatalogSource_name - The name of the data source.

$sel:database:OracleSQLCatalogSource', oracleSQLCatalogSource_database - The name of the database to read from.

$sel:table:OracleSQLCatalogSource', oracleSQLCatalogSource_table - The name of the table in the database to read from.

oracleSQLCatalogSource_database :: Lens' OracleSQLCatalogSource Text Source #

The name of the database to read from.

oracleSQLCatalogSource_table :: Lens' OracleSQLCatalogSource Text Source #

The name of the table in the database to read from.

OracleSQLCatalogTarget

data OracleSQLCatalogTarget Source #

Specifies a target that uses Oracle SQL.

See: newOracleSQLCatalogTarget smart constructor.

Constructors

OracleSQLCatalogTarget' 

Fields

Instances

Instances details
FromJSON OracleSQLCatalogTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.OracleSQLCatalogTarget

ToJSON OracleSQLCatalogTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.OracleSQLCatalogTarget

Generic OracleSQLCatalogTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.OracleSQLCatalogTarget

Associated Types

type Rep OracleSQLCatalogTarget :: Type -> Type #

Read OracleSQLCatalogTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.OracleSQLCatalogTarget

Show OracleSQLCatalogTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.OracleSQLCatalogTarget

NFData OracleSQLCatalogTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.OracleSQLCatalogTarget

Methods

rnf :: OracleSQLCatalogTarget -> () #

Eq OracleSQLCatalogTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.OracleSQLCatalogTarget

Hashable OracleSQLCatalogTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.OracleSQLCatalogTarget

type Rep OracleSQLCatalogTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.OracleSQLCatalogTarget

type Rep OracleSQLCatalogTarget = D1 ('MetaData "OracleSQLCatalogTarget" "Amazonka.Glue.Types.OracleSQLCatalogTarget" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "OracleSQLCatalogTarget'" 'PrefixI 'True) ((S1 ('MetaSel ('Just "name") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text) :*: S1 ('MetaSel ('Just "inputs") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (NonEmpty Text))) :*: (S1 ('MetaSel ('Just "database") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text) :*: S1 ('MetaSel ('Just "table") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text))))

newOracleSQLCatalogTarget Source #

Create a value of OracleSQLCatalogTarget with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:name:OracleSQLCatalogTarget', oracleSQLCatalogTarget_name - The name of the data target.

$sel:inputs:OracleSQLCatalogTarget', oracleSQLCatalogTarget_inputs - The nodes that are inputs to the data target.

$sel:database:OracleSQLCatalogTarget', oracleSQLCatalogTarget_database - The name of the database to write to.

$sel:table:OracleSQLCatalogTarget', oracleSQLCatalogTarget_table - The name of the table in the database to write to.

oracleSQLCatalogTarget_inputs :: Lens' OracleSQLCatalogTarget (NonEmpty Text) Source #

The nodes that are inputs to the data target.

oracleSQLCatalogTarget_table :: Lens' OracleSQLCatalogTarget Text Source #

The name of the table in the database to write to.

Order

data Order Source #

Specifies the sort order of a sorted column.

See: newOrder smart constructor.

Constructors

Order' 

Fields

  • column :: Text

    The name of the column.

  • sortOrder :: Natural

    Indicates that the column is sorted in ascending order (== 1), or in descending order (==0).

Instances

Instances details
FromJSON Order Source # 
Instance details

Defined in Amazonka.Glue.Types.Order

ToJSON Order Source # 
Instance details

Defined in Amazonka.Glue.Types.Order

Generic Order Source # 
Instance details

Defined in Amazonka.Glue.Types.Order

Associated Types

type Rep Order :: Type -> Type #

Methods

from :: Order -> Rep Order x #

to :: Rep Order x -> Order #

Read Order Source # 
Instance details

Defined in Amazonka.Glue.Types.Order

Show Order Source # 
Instance details

Defined in Amazonka.Glue.Types.Order

Methods

showsPrec :: Int -> Order -> ShowS #

show :: Order -> String #

showList :: [Order] -> ShowS #

NFData Order Source # 
Instance details

Defined in Amazonka.Glue.Types.Order

Methods

rnf :: Order -> () #

Eq Order Source # 
Instance details

Defined in Amazonka.Glue.Types.Order

Methods

(==) :: Order -> Order -> Bool #

(/=) :: Order -> Order -> Bool #

Hashable Order Source # 
Instance details

Defined in Amazonka.Glue.Types.Order

Methods

hashWithSalt :: Int -> Order -> Int #

hash :: Order -> Int #

type Rep Order Source # 
Instance details

Defined in Amazonka.Glue.Types.Order

type Rep Order = D1 ('MetaData "Order" "Amazonka.Glue.Types.Order" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "Order'" 'PrefixI 'True) (S1 ('MetaSel ('Just "column") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text) :*: S1 ('MetaSel ('Just "sortOrder") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Natural)))

newOrder Source #

Create a value of Order with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:column:Order', order_column - The name of the column.

$sel:sortOrder:Order', order_sortOrder - Indicates that the column is sorted in ascending order (== 1), or in descending order (==0).

order_column :: Lens' Order Text Source #

The name of the column.

order_sortOrder :: Lens' Order Natural Source #

Indicates that the column is sorted in ascending order (== 1), or in descending order (==0).

OtherMetadataValueListItem

data OtherMetadataValueListItem Source #

A structure containing other metadata for a schema version belonging to the same metadata key.

See: newOtherMetadataValueListItem smart constructor.

Constructors

OtherMetadataValueListItem' 

Fields

Instances

Instances details
FromJSON OtherMetadataValueListItem Source # 
Instance details

Defined in Amazonka.Glue.Types.OtherMetadataValueListItem

Generic OtherMetadataValueListItem Source # 
Instance details

Defined in Amazonka.Glue.Types.OtherMetadataValueListItem

Associated Types

type Rep OtherMetadataValueListItem :: Type -> Type #

Read OtherMetadataValueListItem Source # 
Instance details

Defined in Amazonka.Glue.Types.OtherMetadataValueListItem

Show OtherMetadataValueListItem Source # 
Instance details

Defined in Amazonka.Glue.Types.OtherMetadataValueListItem

NFData OtherMetadataValueListItem Source # 
Instance details

Defined in Amazonka.Glue.Types.OtherMetadataValueListItem

Eq OtherMetadataValueListItem Source # 
Instance details

Defined in Amazonka.Glue.Types.OtherMetadataValueListItem

Hashable OtherMetadataValueListItem Source # 
Instance details

Defined in Amazonka.Glue.Types.OtherMetadataValueListItem

type Rep OtherMetadataValueListItem Source # 
Instance details

Defined in Amazonka.Glue.Types.OtherMetadataValueListItem

type Rep OtherMetadataValueListItem = D1 ('MetaData "OtherMetadataValueListItem" "Amazonka.Glue.Types.OtherMetadataValueListItem" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "OtherMetadataValueListItem'" 'PrefixI 'True) (S1 ('MetaSel ('Just "createdTime") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "metadataValue") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text))))

newOtherMetadataValueListItem :: OtherMetadataValueListItem Source #

Create a value of OtherMetadataValueListItem with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:createdTime:OtherMetadataValueListItem', otherMetadataValueListItem_createdTime - The time at which the entry was created.

$sel:metadataValue:OtherMetadataValueListItem', otherMetadataValueListItem_metadataValue - The metadata key’s corresponding value for the other metadata belonging to the same metadata key.

otherMetadataValueListItem_metadataValue :: Lens' OtherMetadataValueListItem (Maybe Text) Source #

The metadata key’s corresponding value for the other metadata belonging to the same metadata key.

PIIDetection

data PIIDetection Source #

Specifies a transform that identifies, removes or masks PII data.

See: newPIIDetection smart constructor.

Constructors

PIIDetection' 

Fields

  • maskValue :: Maybe Text

    Indicates the value that will replace the detected entity.

  • outputColumnName :: Maybe Text

    Indicates the output column name that will contain any entity type detected in that row.

  • sampleFraction :: Maybe Double

    Indicates the fraction of the data to sample when scanning for PII entities.

  • thresholdFraction :: Maybe Double

    Indicates the fraction of the data that must be met in order for a column to be identified as PII data.

  • name :: Text

    The name of the transform node.

  • inputs :: NonEmpty Text

    The node ID inputs to the transform.

  • piiType :: PiiType

    Indicates the type of PIIDetection transform.

  • entityTypesToDetect :: [Text]

    Indicates the types of entities the PIIDetection transform will identify as PII data.

    PII type entities include: PERSON_NAME, DATE, USA_SNN, EMAIL, USA_ITIN, USA_PASSPORT_NUMBER, PHONE_NUMBER, BANK_ACCOUNT, IP_ADDRESS, MAC_ADDRESS, USA_CPT_CODE, USA_HCPCS_CODE, USA_NATIONAL_DRUG_CODE, USA_MEDICARE_BENEFICIARY_IDENTIFIER, USA_HEALTH_INSURANCE_CLAIM_NUMBER,CREDIT_CARD,USA_NATIONAL_PROVIDER_IDENTIFIER,USA_DEA_NUMBER,USA_DRIVING_LICENSE

Instances

Instances details
FromJSON PIIDetection Source # 
Instance details

Defined in Amazonka.Glue.Types.PIIDetection

ToJSON PIIDetection Source # 
Instance details

Defined in Amazonka.Glue.Types.PIIDetection

Generic PIIDetection Source # 
Instance details

Defined in Amazonka.Glue.Types.PIIDetection

Associated Types

type Rep PIIDetection :: Type -> Type #

Read PIIDetection Source # 
Instance details

Defined in Amazonka.Glue.Types.PIIDetection

Show PIIDetection Source # 
Instance details

Defined in Amazonka.Glue.Types.PIIDetection

NFData PIIDetection Source # 
Instance details

Defined in Amazonka.Glue.Types.PIIDetection

Methods

rnf :: PIIDetection -> () #

Eq PIIDetection Source # 
Instance details

Defined in Amazonka.Glue.Types.PIIDetection

Hashable PIIDetection Source # 
Instance details

Defined in Amazonka.Glue.Types.PIIDetection

type Rep PIIDetection Source # 
Instance details

Defined in Amazonka.Glue.Types.PIIDetection

newPIIDetection Source #

Create a value of PIIDetection with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:maskValue:PIIDetection', pIIDetection_maskValue - Indicates the value that will replace the detected entity.

$sel:outputColumnName:PIIDetection', pIIDetection_outputColumnName - Indicates the output column name that will contain any entity type detected in that row.

$sel:sampleFraction:PIIDetection', pIIDetection_sampleFraction - Indicates the fraction of the data to sample when scanning for PII entities.

$sel:thresholdFraction:PIIDetection', pIIDetection_thresholdFraction - Indicates the fraction of the data that must be met in order for a column to be identified as PII data.

$sel:name:PIIDetection', pIIDetection_name - The name of the transform node.

$sel:inputs:PIIDetection', pIIDetection_inputs - The node ID inputs to the transform.

$sel:piiType:PIIDetection', pIIDetection_piiType - Indicates the type of PIIDetection transform.

$sel:entityTypesToDetect:PIIDetection', pIIDetection_entityTypesToDetect - Indicates the types of entities the PIIDetection transform will identify as PII data.

PII type entities include: PERSON_NAME, DATE, USA_SNN, EMAIL, USA_ITIN, USA_PASSPORT_NUMBER, PHONE_NUMBER, BANK_ACCOUNT, IP_ADDRESS, MAC_ADDRESS, USA_CPT_CODE, USA_HCPCS_CODE, USA_NATIONAL_DRUG_CODE, USA_MEDICARE_BENEFICIARY_IDENTIFIER, USA_HEALTH_INSURANCE_CLAIM_NUMBER,CREDIT_CARD,USA_NATIONAL_PROVIDER_IDENTIFIER,USA_DEA_NUMBER,USA_DRIVING_LICENSE

pIIDetection_maskValue :: Lens' PIIDetection (Maybe Text) Source #

Indicates the value that will replace the detected entity.

pIIDetection_outputColumnName :: Lens' PIIDetection (Maybe Text) Source #

Indicates the output column name that will contain any entity type detected in that row.

pIIDetection_sampleFraction :: Lens' PIIDetection (Maybe Double) Source #

Indicates the fraction of the data to sample when scanning for PII entities.

pIIDetection_thresholdFraction :: Lens' PIIDetection (Maybe Double) Source #

Indicates the fraction of the data that must be met in order for a column to be identified as PII data.

pIIDetection_name :: Lens' PIIDetection Text Source #

The name of the transform node.

pIIDetection_inputs :: Lens' PIIDetection (NonEmpty Text) Source #

The node ID inputs to the transform.

pIIDetection_piiType :: Lens' PIIDetection PiiType Source #

Indicates the type of PIIDetection transform.

pIIDetection_entityTypesToDetect :: Lens' PIIDetection [Text] Source #

Indicates the types of entities the PIIDetection transform will identify as PII data.

PII type entities include: PERSON_NAME, DATE, USA_SNN, EMAIL, USA_ITIN, USA_PASSPORT_NUMBER, PHONE_NUMBER, BANK_ACCOUNT, IP_ADDRESS, MAC_ADDRESS, USA_CPT_CODE, USA_HCPCS_CODE, USA_NATIONAL_DRUG_CODE, USA_MEDICARE_BENEFICIARY_IDENTIFIER, USA_HEALTH_INSURANCE_CLAIM_NUMBER,CREDIT_CARD,USA_NATIONAL_PROVIDER_IDENTIFIER,USA_DEA_NUMBER,USA_DRIVING_LICENSE

Partition

data Partition Source #

Represents a slice of table data.

See: newPartition smart constructor.

Constructors

Partition' 

Fields

Instances

Instances details
FromJSON Partition Source # 
Instance details

Defined in Amazonka.Glue.Types.Partition

Generic Partition Source # 
Instance details

Defined in Amazonka.Glue.Types.Partition

Associated Types

type Rep Partition :: Type -> Type #

Read Partition Source # 
Instance details

Defined in Amazonka.Glue.Types.Partition

Show Partition Source # 
Instance details

Defined in Amazonka.Glue.Types.Partition

NFData Partition Source # 
Instance details

Defined in Amazonka.Glue.Types.Partition

Methods

rnf :: Partition -> () #

Eq Partition Source # 
Instance details

Defined in Amazonka.Glue.Types.Partition

Hashable Partition Source # 
Instance details

Defined in Amazonka.Glue.Types.Partition

type Rep Partition Source # 
Instance details

Defined in Amazonka.Glue.Types.Partition

newPartition :: Partition Source #

Create a value of Partition with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:catalogId:Partition', partition_catalogId - The ID of the Data Catalog in which the partition resides.

$sel:creationTime:Partition', partition_creationTime - The time at which the partition was created.

$sel:databaseName:Partition', partition_databaseName - The name of the catalog database in which to create the partition.

$sel:lastAccessTime:Partition', partition_lastAccessTime - The last time at which the partition was accessed.

$sel:lastAnalyzedTime:Partition', partition_lastAnalyzedTime - The last time at which column statistics were computed for this partition.

Partition, partition_parameters - These key-value pairs define partition parameters.

$sel:storageDescriptor:Partition', partition_storageDescriptor - Provides information about the physical location where the partition is stored.

$sel:tableName:Partition', partition_tableName - The name of the database table in which to create the partition.

$sel:values:Partition', partition_values - The values of the partition.

partition_catalogId :: Lens' Partition (Maybe Text) Source #

The ID of the Data Catalog in which the partition resides.

partition_creationTime :: Lens' Partition (Maybe UTCTime) Source #

The time at which the partition was created.

partition_databaseName :: Lens' Partition (Maybe Text) Source #

The name of the catalog database in which to create the partition.

partition_lastAccessTime :: Lens' Partition (Maybe UTCTime) Source #

The last time at which the partition was accessed.

partition_lastAnalyzedTime :: Lens' Partition (Maybe UTCTime) Source #

The last time at which column statistics were computed for this partition.

partition_parameters :: Lens' Partition (Maybe (HashMap Text Text)) Source #

These key-value pairs define partition parameters.

partition_storageDescriptor :: Lens' Partition (Maybe StorageDescriptor) Source #

Provides information about the physical location where the partition is stored.

partition_tableName :: Lens' Partition (Maybe Text) Source #

The name of the database table in which to create the partition.

partition_values :: Lens' Partition (Maybe [Text]) Source #

The values of the partition.

PartitionError

data PartitionError Source #

Contains information about a partition error.

See: newPartitionError smart constructor.

Constructors

PartitionError' 

Fields

Instances

Instances details
FromJSON PartitionError Source # 
Instance details

Defined in Amazonka.Glue.Types.PartitionError

Generic PartitionError Source # 
Instance details

Defined in Amazonka.Glue.Types.PartitionError

Associated Types

type Rep PartitionError :: Type -> Type #

Read PartitionError Source # 
Instance details

Defined in Amazonka.Glue.Types.PartitionError

Show PartitionError Source # 
Instance details

Defined in Amazonka.Glue.Types.PartitionError

NFData PartitionError Source # 
Instance details

Defined in Amazonka.Glue.Types.PartitionError

Methods

rnf :: PartitionError -> () #

Eq PartitionError Source # 
Instance details

Defined in Amazonka.Glue.Types.PartitionError

Hashable PartitionError Source # 
Instance details

Defined in Amazonka.Glue.Types.PartitionError

type Rep PartitionError Source # 
Instance details

Defined in Amazonka.Glue.Types.PartitionError

type Rep PartitionError = D1 ('MetaData "PartitionError" "Amazonka.Glue.Types.PartitionError" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "PartitionError'" 'PrefixI 'True) (S1 ('MetaSel ('Just "errorDetail") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe ErrorDetail)) :*: S1 ('MetaSel ('Just "partitionValues") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe [Text]))))

newPartitionError :: PartitionError Source #

Create a value of PartitionError with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:errorDetail:PartitionError', partitionError_errorDetail - The details about the partition error.

$sel:partitionValues:PartitionError', partitionError_partitionValues - The values that define the partition.

partitionError_errorDetail :: Lens' PartitionError (Maybe ErrorDetail) Source #

The details about the partition error.

partitionError_partitionValues :: Lens' PartitionError (Maybe [Text]) Source #

The values that define the partition.

PartitionIndex

data PartitionIndex Source #

A structure for a partition index.

See: newPartitionIndex smart constructor.

Constructors

PartitionIndex' 

Fields

Instances

Instances details
ToJSON PartitionIndex Source # 
Instance details

Defined in Amazonka.Glue.Types.PartitionIndex

Generic PartitionIndex Source # 
Instance details

Defined in Amazonka.Glue.Types.PartitionIndex

Associated Types

type Rep PartitionIndex :: Type -> Type #

Read PartitionIndex Source # 
Instance details

Defined in Amazonka.Glue.Types.PartitionIndex

Show PartitionIndex Source # 
Instance details

Defined in Amazonka.Glue.Types.PartitionIndex

NFData PartitionIndex Source # 
Instance details

Defined in Amazonka.Glue.Types.PartitionIndex

Methods

rnf :: PartitionIndex -> () #

Eq PartitionIndex Source # 
Instance details

Defined in Amazonka.Glue.Types.PartitionIndex

Hashable PartitionIndex Source # 
Instance details

Defined in Amazonka.Glue.Types.PartitionIndex

type Rep PartitionIndex Source # 
Instance details

Defined in Amazonka.Glue.Types.PartitionIndex

type Rep PartitionIndex = D1 ('MetaData "PartitionIndex" "Amazonka.Glue.Types.PartitionIndex" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "PartitionIndex'" 'PrefixI 'True) (S1 ('MetaSel ('Just "keys") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (NonEmpty Text)) :*: S1 ('MetaSel ('Just "indexName") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text)))

newPartitionIndex Source #

Create a value of PartitionIndex with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:keys:PartitionIndex', partitionIndex_keys - The keys for the partition index.

$sel:indexName:PartitionIndex', partitionIndex_indexName - The name of the partition index.

partitionIndex_keys :: Lens' PartitionIndex (NonEmpty Text) Source #

The keys for the partition index.

partitionIndex_indexName :: Lens' PartitionIndex Text Source #

The name of the partition index.

PartitionIndexDescriptor

data PartitionIndexDescriptor Source #

A descriptor for a partition index in a table.

See: newPartitionIndexDescriptor smart constructor.

Constructors

PartitionIndexDescriptor' 

Fields

  • backfillErrors :: Maybe [BackfillError]

    A list of errors that can occur when registering partition indexes for an existing table.

  • indexName :: Text

    The name of the partition index.

  • keys :: NonEmpty KeySchemaElement

    A list of one or more keys, as KeySchemaElement structures, for the partition index.

  • indexStatus :: PartitionIndexStatus

    The status of the partition index.

    The possible statuses are:

    • CREATING: The index is being created. When an index is in a CREATING state, the index or its table cannot be deleted.
    • ACTIVE: The index creation succeeds.
    • FAILED: The index creation fails.
    • DELETING: The index is deleted from the list of indexes.

Instances

Instances details
FromJSON PartitionIndexDescriptor Source # 
Instance details

Defined in Amazonka.Glue.Types.PartitionIndexDescriptor

Generic PartitionIndexDescriptor Source # 
Instance details

Defined in Amazonka.Glue.Types.PartitionIndexDescriptor

Associated Types

type Rep PartitionIndexDescriptor :: Type -> Type #

Read PartitionIndexDescriptor Source # 
Instance details

Defined in Amazonka.Glue.Types.PartitionIndexDescriptor

Show PartitionIndexDescriptor Source # 
Instance details

Defined in Amazonka.Glue.Types.PartitionIndexDescriptor

NFData PartitionIndexDescriptor Source # 
Instance details

Defined in Amazonka.Glue.Types.PartitionIndexDescriptor

Eq PartitionIndexDescriptor Source # 
Instance details

Defined in Amazonka.Glue.Types.PartitionIndexDescriptor

Hashable PartitionIndexDescriptor Source # 
Instance details

Defined in Amazonka.Glue.Types.PartitionIndexDescriptor

type Rep PartitionIndexDescriptor Source # 
Instance details

Defined in Amazonka.Glue.Types.PartitionIndexDescriptor

type Rep PartitionIndexDescriptor = D1 ('MetaData "PartitionIndexDescriptor" "Amazonka.Glue.Types.PartitionIndexDescriptor" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "PartitionIndexDescriptor'" 'PrefixI 'True) ((S1 ('MetaSel ('Just "backfillErrors") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe [BackfillError])) :*: S1 ('MetaSel ('Just "indexName") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text)) :*: (S1 ('MetaSel ('Just "keys") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (NonEmpty KeySchemaElement)) :*: S1 ('MetaSel ('Just "indexStatus") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 PartitionIndexStatus))))

newPartitionIndexDescriptor Source #

Create a value of PartitionIndexDescriptor with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:backfillErrors:PartitionIndexDescriptor', partitionIndexDescriptor_backfillErrors - A list of errors that can occur when registering partition indexes for an existing table.

$sel:indexName:PartitionIndexDescriptor', partitionIndexDescriptor_indexName - The name of the partition index.

$sel:keys:PartitionIndexDescriptor', partitionIndexDescriptor_keys - A list of one or more keys, as KeySchemaElement structures, for the partition index.

$sel:indexStatus:PartitionIndexDescriptor', partitionIndexDescriptor_indexStatus - The status of the partition index.

The possible statuses are:

  • CREATING: The index is being created. When an index is in a CREATING state, the index or its table cannot be deleted.
  • ACTIVE: The index creation succeeds.
  • FAILED: The index creation fails.
  • DELETING: The index is deleted from the list of indexes.

partitionIndexDescriptor_backfillErrors :: Lens' PartitionIndexDescriptor (Maybe [BackfillError]) Source #

A list of errors that can occur when registering partition indexes for an existing table.

partitionIndexDescriptor_keys :: Lens' PartitionIndexDescriptor (NonEmpty KeySchemaElement) Source #

A list of one or more keys, as KeySchemaElement structures, for the partition index.

partitionIndexDescriptor_indexStatus :: Lens' PartitionIndexDescriptor PartitionIndexStatus Source #

The status of the partition index.

The possible statuses are:

  • CREATING: The index is being created. When an index is in a CREATING state, the index or its table cannot be deleted.
  • ACTIVE: The index creation succeeds.
  • FAILED: The index creation fails.
  • DELETING: The index is deleted from the list of indexes.

PartitionInput

data PartitionInput Source #

The structure used to create and update a partition.

See: newPartitionInput smart constructor.

Constructors

PartitionInput' 

Fields

  • lastAccessTime :: Maybe POSIX

    The last time at which the partition was accessed.

  • lastAnalyzedTime :: Maybe POSIX

    The last time at which column statistics were computed for this partition.

  • parameters :: Maybe (HashMap Text Text)

    These key-value pairs define partition parameters.

  • storageDescriptor :: Maybe StorageDescriptor

    Provides information about the physical location where the partition is stored.

  • values :: Maybe [Text]

    The values of the partition. Although this parameter is not required by the SDK, you must specify this parameter for a valid input.

    The values for the keys for the new partition must be passed as an array of String objects that must be ordered in the same order as the partition keys appearing in the Amazon S3 prefix. Otherwise Glue will add the values to the wrong keys.

Instances

Instances details
ToJSON PartitionInput Source # 
Instance details

Defined in Amazonka.Glue.Types.PartitionInput

Generic PartitionInput Source # 
Instance details

Defined in Amazonka.Glue.Types.PartitionInput

Associated Types

type Rep PartitionInput :: Type -> Type #

Read PartitionInput Source # 
Instance details

Defined in Amazonka.Glue.Types.PartitionInput

Show PartitionInput Source # 
Instance details

Defined in Amazonka.Glue.Types.PartitionInput

NFData PartitionInput Source # 
Instance details

Defined in Amazonka.Glue.Types.PartitionInput

Methods

rnf :: PartitionInput -> () #

Eq PartitionInput Source # 
Instance details

Defined in Amazonka.Glue.Types.PartitionInput

Hashable PartitionInput Source # 
Instance details

Defined in Amazonka.Glue.Types.PartitionInput

type Rep PartitionInput Source # 
Instance details

Defined in Amazonka.Glue.Types.PartitionInput

type Rep PartitionInput = D1 ('MetaData "PartitionInput" "Amazonka.Glue.Types.PartitionInput" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "PartitionInput'" 'PrefixI 'True) ((S1 ('MetaSel ('Just "lastAccessTime") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe POSIX)) :*: S1 ('MetaSel ('Just "lastAnalyzedTime") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe POSIX))) :*: (S1 ('MetaSel ('Just "parameters") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe (HashMap Text Text))) :*: (S1 ('MetaSel ('Just "storageDescriptor") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe StorageDescriptor)) :*: S1 ('MetaSel ('Just "values") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe [Text]))))))

newPartitionInput :: PartitionInput Source #

Create a value of PartitionInput with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:lastAccessTime:PartitionInput', partitionInput_lastAccessTime - The last time at which the partition was accessed.

$sel:lastAnalyzedTime:PartitionInput', partitionInput_lastAnalyzedTime - The last time at which column statistics were computed for this partition.

PartitionInput, partitionInput_parameters - These key-value pairs define partition parameters.

$sel:storageDescriptor:PartitionInput', partitionInput_storageDescriptor - Provides information about the physical location where the partition is stored.

$sel:values:PartitionInput', partitionInput_values - The values of the partition. Although this parameter is not required by the SDK, you must specify this parameter for a valid input.

The values for the keys for the new partition must be passed as an array of String objects that must be ordered in the same order as the partition keys appearing in the Amazon S3 prefix. Otherwise Glue will add the values to the wrong keys.

partitionInput_lastAccessTime :: Lens' PartitionInput (Maybe UTCTime) Source #

The last time at which the partition was accessed.

partitionInput_lastAnalyzedTime :: Lens' PartitionInput (Maybe UTCTime) Source #

The last time at which column statistics were computed for this partition.

partitionInput_parameters :: Lens' PartitionInput (Maybe (HashMap Text Text)) Source #

These key-value pairs define partition parameters.

partitionInput_storageDescriptor :: Lens' PartitionInput (Maybe StorageDescriptor) Source #

Provides information about the physical location where the partition is stored.

partitionInput_values :: Lens' PartitionInput (Maybe [Text]) Source #

The values of the partition. Although this parameter is not required by the SDK, you must specify this parameter for a valid input.

The values for the keys for the new partition must be passed as an array of String objects that must be ordered in the same order as the partition keys appearing in the Amazon S3 prefix. Otherwise Glue will add the values to the wrong keys.

PartitionValueList

data PartitionValueList Source #

Contains a list of values defining partitions.

See: newPartitionValueList smart constructor.

Constructors

PartitionValueList' 

Fields

Instances

Instances details
FromJSON PartitionValueList Source # 
Instance details

Defined in Amazonka.Glue.Types.PartitionValueList

ToJSON PartitionValueList Source # 
Instance details

Defined in Amazonka.Glue.Types.PartitionValueList

Generic PartitionValueList Source # 
Instance details

Defined in Amazonka.Glue.Types.PartitionValueList

Associated Types

type Rep PartitionValueList :: Type -> Type #

Read PartitionValueList Source # 
Instance details

Defined in Amazonka.Glue.Types.PartitionValueList

Show PartitionValueList Source # 
Instance details

Defined in Amazonka.Glue.Types.PartitionValueList

NFData PartitionValueList Source # 
Instance details

Defined in Amazonka.Glue.Types.PartitionValueList

Methods

rnf :: PartitionValueList -> () #

Eq PartitionValueList Source # 
Instance details

Defined in Amazonka.Glue.Types.PartitionValueList

Hashable PartitionValueList Source # 
Instance details

Defined in Amazonka.Glue.Types.PartitionValueList

type Rep PartitionValueList Source # 
Instance details

Defined in Amazonka.Glue.Types.PartitionValueList

type Rep PartitionValueList = D1 ('MetaData "PartitionValueList" "Amazonka.Glue.Types.PartitionValueList" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "PartitionValueList'" 'PrefixI 'True) (S1 ('MetaSel ('Just "values") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 [Text])))

newPartitionValueList :: PartitionValueList Source #

Create a value of PartitionValueList with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:values:PartitionValueList', partitionValueList_values - The list of values.

PhysicalConnectionRequirements

data PhysicalConnectionRequirements Source #

Specifies the physical requirements for a connection.

See: newPhysicalConnectionRequirements smart constructor.

Constructors

PhysicalConnectionRequirements' 

Fields

  • availabilityZone :: Maybe Text

    The connection's Availability Zone. This field is redundant because the specified subnet implies the Availability Zone to be used. Currently the field must be populated, but it will be deprecated in the future.

  • securityGroupIdList :: Maybe [Text]

    The security group ID list used by the connection.

  • subnetId :: Maybe Text

    The subnet ID used by the connection.

Instances

Instances details
FromJSON PhysicalConnectionRequirements Source # 
Instance details

Defined in Amazonka.Glue.Types.PhysicalConnectionRequirements

ToJSON PhysicalConnectionRequirements Source # 
Instance details

Defined in Amazonka.Glue.Types.PhysicalConnectionRequirements

Generic PhysicalConnectionRequirements Source # 
Instance details

Defined in Amazonka.Glue.Types.PhysicalConnectionRequirements

Associated Types

type Rep PhysicalConnectionRequirements :: Type -> Type #

Read PhysicalConnectionRequirements Source # 
Instance details

Defined in Amazonka.Glue.Types.PhysicalConnectionRequirements

Show PhysicalConnectionRequirements Source # 
Instance details

Defined in Amazonka.Glue.Types.PhysicalConnectionRequirements

NFData PhysicalConnectionRequirements Source # 
Instance details

Defined in Amazonka.Glue.Types.PhysicalConnectionRequirements

Eq PhysicalConnectionRequirements Source # 
Instance details

Defined in Amazonka.Glue.Types.PhysicalConnectionRequirements

Hashable PhysicalConnectionRequirements Source # 
Instance details

Defined in Amazonka.Glue.Types.PhysicalConnectionRequirements

type Rep PhysicalConnectionRequirements Source # 
Instance details

Defined in Amazonka.Glue.Types.PhysicalConnectionRequirements

type Rep PhysicalConnectionRequirements = D1 ('MetaData "PhysicalConnectionRequirements" "Amazonka.Glue.Types.PhysicalConnectionRequirements" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "PhysicalConnectionRequirements'" 'PrefixI 'True) (S1 ('MetaSel ('Just "availabilityZone") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: (S1 ('MetaSel ('Just "securityGroupIdList") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe [Text])) :*: S1 ('MetaSel ('Just "subnetId") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)))))

newPhysicalConnectionRequirements :: PhysicalConnectionRequirements Source #

Create a value of PhysicalConnectionRequirements with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:availabilityZone:PhysicalConnectionRequirements', physicalConnectionRequirements_availabilityZone - The connection's Availability Zone. This field is redundant because the specified subnet implies the Availability Zone to be used. Currently the field must be populated, but it will be deprecated in the future.

$sel:securityGroupIdList:PhysicalConnectionRequirements', physicalConnectionRequirements_securityGroupIdList - The security group ID list used by the connection.

$sel:subnetId:PhysicalConnectionRequirements', physicalConnectionRequirements_subnetId - The subnet ID used by the connection.

physicalConnectionRequirements_availabilityZone :: Lens' PhysicalConnectionRequirements (Maybe Text) Source #

The connection's Availability Zone. This field is redundant because the specified subnet implies the Availability Zone to be used. Currently the field must be populated, but it will be deprecated in the future.

PostgreSQLCatalogSource

data PostgreSQLCatalogSource Source #

Specifies a PostgresSQL data source in the Glue Data Catalog.

See: newPostgreSQLCatalogSource smart constructor.

Constructors

PostgreSQLCatalogSource' 

Fields

  • name :: Text

    The name of the data source.

  • database :: Text

    The name of the database to read from.

  • table :: Text

    The name of the table in the database to read from.

Instances

Instances details
FromJSON PostgreSQLCatalogSource Source # 
Instance details

Defined in Amazonka.Glue.Types.PostgreSQLCatalogSource

ToJSON PostgreSQLCatalogSource Source # 
Instance details

Defined in Amazonka.Glue.Types.PostgreSQLCatalogSource

Generic PostgreSQLCatalogSource Source # 
Instance details

Defined in Amazonka.Glue.Types.PostgreSQLCatalogSource

Associated Types

type Rep PostgreSQLCatalogSource :: Type -> Type #

Read PostgreSQLCatalogSource Source # 
Instance details

Defined in Amazonka.Glue.Types.PostgreSQLCatalogSource

Show PostgreSQLCatalogSource Source # 
Instance details

Defined in Amazonka.Glue.Types.PostgreSQLCatalogSource

NFData PostgreSQLCatalogSource Source # 
Instance details

Defined in Amazonka.Glue.Types.PostgreSQLCatalogSource

Methods

rnf :: PostgreSQLCatalogSource -> () #

Eq PostgreSQLCatalogSource Source # 
Instance details

Defined in Amazonka.Glue.Types.PostgreSQLCatalogSource

Hashable PostgreSQLCatalogSource Source # 
Instance details

Defined in Amazonka.Glue.Types.PostgreSQLCatalogSource

type Rep PostgreSQLCatalogSource Source # 
Instance details

Defined in Amazonka.Glue.Types.PostgreSQLCatalogSource

type Rep PostgreSQLCatalogSource = D1 ('MetaData "PostgreSQLCatalogSource" "Amazonka.Glue.Types.PostgreSQLCatalogSource" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "PostgreSQLCatalogSource'" 'PrefixI 'True) (S1 ('MetaSel ('Just "name") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text) :*: (S1 ('MetaSel ('Just "database") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text) :*: S1 ('MetaSel ('Just "table") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text))))

newPostgreSQLCatalogSource Source #

Create a value of PostgreSQLCatalogSource with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:name:PostgreSQLCatalogSource', postgreSQLCatalogSource_name - The name of the data source.

$sel:database:PostgreSQLCatalogSource', postgreSQLCatalogSource_database - The name of the database to read from.

$sel:table:PostgreSQLCatalogSource', postgreSQLCatalogSource_table - The name of the table in the database to read from.

postgreSQLCatalogSource_table :: Lens' PostgreSQLCatalogSource Text Source #

The name of the table in the database to read from.

PostgreSQLCatalogTarget

data PostgreSQLCatalogTarget Source #

Specifies a target that uses Postgres SQL.

See: newPostgreSQLCatalogTarget smart constructor.

Constructors

PostgreSQLCatalogTarget' 

Fields

Instances

Instances details
FromJSON PostgreSQLCatalogTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.PostgreSQLCatalogTarget

ToJSON PostgreSQLCatalogTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.PostgreSQLCatalogTarget

Generic PostgreSQLCatalogTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.PostgreSQLCatalogTarget

Associated Types

type Rep PostgreSQLCatalogTarget :: Type -> Type #

Read PostgreSQLCatalogTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.PostgreSQLCatalogTarget

Show PostgreSQLCatalogTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.PostgreSQLCatalogTarget

NFData PostgreSQLCatalogTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.PostgreSQLCatalogTarget

Methods

rnf :: PostgreSQLCatalogTarget -> () #

Eq PostgreSQLCatalogTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.PostgreSQLCatalogTarget

Hashable PostgreSQLCatalogTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.PostgreSQLCatalogTarget

type Rep PostgreSQLCatalogTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.PostgreSQLCatalogTarget

type Rep PostgreSQLCatalogTarget = D1 ('MetaData "PostgreSQLCatalogTarget" "Amazonka.Glue.Types.PostgreSQLCatalogTarget" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "PostgreSQLCatalogTarget'" 'PrefixI 'True) ((S1 ('MetaSel ('Just "name") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text) :*: S1 ('MetaSel ('Just "inputs") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (NonEmpty Text))) :*: (S1 ('MetaSel ('Just "database") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text) :*: S1 ('MetaSel ('Just "table") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text))))

newPostgreSQLCatalogTarget Source #

Create a value of PostgreSQLCatalogTarget with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:name:PostgreSQLCatalogTarget', postgreSQLCatalogTarget_name - The name of the data target.

$sel:inputs:PostgreSQLCatalogTarget', postgreSQLCatalogTarget_inputs - The nodes that are inputs to the data target.

$sel:database:PostgreSQLCatalogTarget', postgreSQLCatalogTarget_database - The name of the database to write to.

$sel:table:PostgreSQLCatalogTarget', postgreSQLCatalogTarget_table - The name of the table in the database to write to.

postgreSQLCatalogTarget_inputs :: Lens' PostgreSQLCatalogTarget (NonEmpty Text) Source #

The nodes that are inputs to the data target.

postgreSQLCatalogTarget_table :: Lens' PostgreSQLCatalogTarget Text Source #

The name of the table in the database to write to.

Predecessor

data Predecessor Source #

A job run that was used in the predicate of a conditional trigger that triggered this job run.

See: newPredecessor smart constructor.

Constructors

Predecessor' 

Fields

Instances

Instances details
FromJSON Predecessor Source # 
Instance details

Defined in Amazonka.Glue.Types.Predecessor

Generic Predecessor Source # 
Instance details

Defined in Amazonka.Glue.Types.Predecessor

Associated Types

type Rep Predecessor :: Type -> Type #

Read Predecessor Source # 
Instance details

Defined in Amazonka.Glue.Types.Predecessor

Show Predecessor Source # 
Instance details

Defined in Amazonka.Glue.Types.Predecessor

NFData Predecessor Source # 
Instance details

Defined in Amazonka.Glue.Types.Predecessor

Methods

rnf :: Predecessor -> () #

Eq Predecessor Source # 
Instance details

Defined in Amazonka.Glue.Types.Predecessor

Hashable Predecessor Source # 
Instance details

Defined in Amazonka.Glue.Types.Predecessor

type Rep Predecessor Source # 
Instance details

Defined in Amazonka.Glue.Types.Predecessor

type Rep Predecessor = D1 ('MetaData "Predecessor" "Amazonka.Glue.Types.Predecessor" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "Predecessor'" 'PrefixI 'True) (S1 ('MetaSel ('Just "jobName") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "runId") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text))))

newPredecessor :: Predecessor Source #

Create a value of Predecessor with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:jobName:Predecessor', predecessor_jobName - The name of the job definition used by the predecessor job run.

$sel:runId:Predecessor', predecessor_runId - The job-run ID of the predecessor job run.

predecessor_jobName :: Lens' Predecessor (Maybe Text) Source #

The name of the job definition used by the predecessor job run.

predecessor_runId :: Lens' Predecessor (Maybe Text) Source #

The job-run ID of the predecessor job run.

Predicate

data Predicate Source #

Defines the predicate of the trigger, which determines when it fires.

See: newPredicate smart constructor.

Constructors

Predicate' 

Fields

  • conditions :: Maybe [Condition]

    A list of the conditions that determine when the trigger will fire.

  • logical :: Maybe Logical

    An optional field if only one condition is listed. If multiple conditions are listed, then this field is required.

Instances

Instances details
FromJSON Predicate Source # 
Instance details

Defined in Amazonka.Glue.Types.Predicate

ToJSON Predicate Source # 
Instance details

Defined in Amazonka.Glue.Types.Predicate

Generic Predicate Source # 
Instance details

Defined in Amazonka.Glue.Types.Predicate

Associated Types

type Rep Predicate :: Type -> Type #

Read Predicate Source # 
Instance details

Defined in Amazonka.Glue.Types.Predicate

Show Predicate Source # 
Instance details

Defined in Amazonka.Glue.Types.Predicate

NFData Predicate Source # 
Instance details

Defined in Amazonka.Glue.Types.Predicate

Methods

rnf :: Predicate -> () #

Eq Predicate Source # 
Instance details

Defined in Amazonka.Glue.Types.Predicate

Hashable Predicate Source # 
Instance details

Defined in Amazonka.Glue.Types.Predicate

type Rep Predicate Source # 
Instance details

Defined in Amazonka.Glue.Types.Predicate

type Rep Predicate = D1 ('MetaData "Predicate" "Amazonka.Glue.Types.Predicate" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "Predicate'" 'PrefixI 'True) (S1 ('MetaSel ('Just "conditions") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe [Condition])) :*: S1 ('MetaSel ('Just "logical") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Logical))))

newPredicate :: Predicate Source #

Create a value of Predicate with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:conditions:Predicate', predicate_conditions - A list of the conditions that determine when the trigger will fire.

$sel:logical:Predicate', predicate_logical - An optional field if only one condition is listed. If multiple conditions are listed, then this field is required.

predicate_conditions :: Lens' Predicate (Maybe [Condition]) Source #

A list of the conditions that determine when the trigger will fire.

predicate_logical :: Lens' Predicate (Maybe Logical) Source #

An optional field if only one condition is listed. If multiple conditions are listed, then this field is required.

PrincipalPermissions

data PrincipalPermissions Source #

Permissions granted to a principal.

See: newPrincipalPermissions smart constructor.

Constructors

PrincipalPermissions' 

Fields

Instances

Instances details
FromJSON PrincipalPermissions Source # 
Instance details

Defined in Amazonka.Glue.Types.PrincipalPermissions

ToJSON PrincipalPermissions Source # 
Instance details

Defined in Amazonka.Glue.Types.PrincipalPermissions

Generic PrincipalPermissions Source # 
Instance details

Defined in Amazonka.Glue.Types.PrincipalPermissions

Associated Types

type Rep PrincipalPermissions :: Type -> Type #

Read PrincipalPermissions Source # 
Instance details

Defined in Amazonka.Glue.Types.PrincipalPermissions

Show PrincipalPermissions Source # 
Instance details

Defined in Amazonka.Glue.Types.PrincipalPermissions

NFData PrincipalPermissions Source # 
Instance details

Defined in Amazonka.Glue.Types.PrincipalPermissions

Methods

rnf :: PrincipalPermissions -> () #

Eq PrincipalPermissions Source # 
Instance details

Defined in Amazonka.Glue.Types.PrincipalPermissions

Hashable PrincipalPermissions Source # 
Instance details

Defined in Amazonka.Glue.Types.PrincipalPermissions

type Rep PrincipalPermissions Source # 
Instance details

Defined in Amazonka.Glue.Types.PrincipalPermissions

type Rep PrincipalPermissions = D1 ('MetaData "PrincipalPermissions" "Amazonka.Glue.Types.PrincipalPermissions" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "PrincipalPermissions'" 'PrefixI 'True) (S1 ('MetaSel ('Just "permissions") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe [Permission])) :*: S1 ('MetaSel ('Just "principal") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe DataLakePrincipal))))

newPrincipalPermissions :: PrincipalPermissions Source #

Create a value of PrincipalPermissions with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:permissions:PrincipalPermissions', principalPermissions_permissions - The permissions that are granted to the principal.

$sel:principal:PrincipalPermissions', principalPermissions_principal - The principal who is granted permissions.

principalPermissions_permissions :: Lens' PrincipalPermissions (Maybe [Permission]) Source #

The permissions that are granted to the principal.

PropertyPredicate

data PropertyPredicate Source #

Defines a property predicate.

See: newPropertyPredicate smart constructor.

Constructors

PropertyPredicate' 

Fields

Instances

Instances details
ToJSON PropertyPredicate Source # 
Instance details

Defined in Amazonka.Glue.Types.PropertyPredicate

Generic PropertyPredicate Source # 
Instance details

Defined in Amazonka.Glue.Types.PropertyPredicate

Associated Types

type Rep PropertyPredicate :: Type -> Type #

Read PropertyPredicate Source # 
Instance details

Defined in Amazonka.Glue.Types.PropertyPredicate

Show PropertyPredicate Source # 
Instance details

Defined in Amazonka.Glue.Types.PropertyPredicate

NFData PropertyPredicate Source # 
Instance details

Defined in Amazonka.Glue.Types.PropertyPredicate

Methods

rnf :: PropertyPredicate -> () #

Eq PropertyPredicate Source # 
Instance details

Defined in Amazonka.Glue.Types.PropertyPredicate

Hashable PropertyPredicate Source # 
Instance details

Defined in Amazonka.Glue.Types.PropertyPredicate

type Rep PropertyPredicate Source # 
Instance details

Defined in Amazonka.Glue.Types.PropertyPredicate

type Rep PropertyPredicate = D1 ('MetaData "PropertyPredicate" "Amazonka.Glue.Types.PropertyPredicate" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "PropertyPredicate'" 'PrefixI 'True) (S1 ('MetaSel ('Just "comparator") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Comparator)) :*: (S1 ('MetaSel ('Just "key") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "value") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)))))

newPropertyPredicate :: PropertyPredicate Source #

Create a value of PropertyPredicate with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:comparator:PropertyPredicate', propertyPredicate_comparator - The comparator used to compare this property to others.

$sel:key:PropertyPredicate', propertyPredicate_key - The key of the property.

$sel:value:PropertyPredicate', propertyPredicate_value - The value of the property.

propertyPredicate_comparator :: Lens' PropertyPredicate (Maybe Comparator) Source #

The comparator used to compare this property to others.

RecrawlPolicy

data RecrawlPolicy Source #

When crawling an Amazon S3 data source after the first crawl is complete, specifies whether to crawl the entire dataset again or to crawl only folders that were added since the last crawler run. For more information, see Incremental Crawls in Glue in the developer guide.

See: newRecrawlPolicy smart constructor.

Constructors

RecrawlPolicy' 

Fields

  • recrawlBehavior :: Maybe RecrawlBehavior

    Specifies whether to crawl the entire dataset again or to crawl only folders that were added since the last crawler run.

    A value of CRAWL_EVERYTHING specifies crawling the entire dataset again.

    A value of CRAWL_NEW_FOLDERS_ONLY specifies crawling only folders that were added since the last crawler run.

    A value of CRAWL_EVENT_MODE specifies crawling only the changes identified by Amazon S3 events.

Instances

Instances details
FromJSON RecrawlPolicy Source # 
Instance details

Defined in Amazonka.Glue.Types.RecrawlPolicy

ToJSON RecrawlPolicy Source # 
Instance details

Defined in Amazonka.Glue.Types.RecrawlPolicy

Generic RecrawlPolicy Source # 
Instance details

Defined in Amazonka.Glue.Types.RecrawlPolicy

Associated Types

type Rep RecrawlPolicy :: Type -> Type #

Read RecrawlPolicy Source # 
Instance details

Defined in Amazonka.Glue.Types.RecrawlPolicy

Show RecrawlPolicy Source # 
Instance details

Defined in Amazonka.Glue.Types.RecrawlPolicy

NFData RecrawlPolicy Source # 
Instance details

Defined in Amazonka.Glue.Types.RecrawlPolicy

Methods

rnf :: RecrawlPolicy -> () #

Eq RecrawlPolicy Source # 
Instance details

Defined in Amazonka.Glue.Types.RecrawlPolicy

Hashable RecrawlPolicy Source # 
Instance details

Defined in Amazonka.Glue.Types.RecrawlPolicy

type Rep RecrawlPolicy Source # 
Instance details

Defined in Amazonka.Glue.Types.RecrawlPolicy

type Rep RecrawlPolicy = D1 ('MetaData "RecrawlPolicy" "Amazonka.Glue.Types.RecrawlPolicy" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "RecrawlPolicy'" 'PrefixI 'True) (S1 ('MetaSel ('Just "recrawlBehavior") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe RecrawlBehavior))))

newRecrawlPolicy :: RecrawlPolicy Source #

Create a value of RecrawlPolicy with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:recrawlBehavior:RecrawlPolicy', recrawlPolicy_recrawlBehavior - Specifies whether to crawl the entire dataset again or to crawl only folders that were added since the last crawler run.

A value of CRAWL_EVERYTHING specifies crawling the entire dataset again.

A value of CRAWL_NEW_FOLDERS_ONLY specifies crawling only folders that were added since the last crawler run.

A value of CRAWL_EVENT_MODE specifies crawling only the changes identified by Amazon S3 events.

recrawlPolicy_recrawlBehavior :: Lens' RecrawlPolicy (Maybe RecrawlBehavior) Source #

Specifies whether to crawl the entire dataset again or to crawl only folders that were added since the last crawler run.

A value of CRAWL_EVERYTHING specifies crawling the entire dataset again.

A value of CRAWL_NEW_FOLDERS_ONLY specifies crawling only folders that were added since the last crawler run.

A value of CRAWL_EVENT_MODE specifies crawling only the changes identified by Amazon S3 events.

RedshiftSource

data RedshiftSource Source #

Specifies an Amazon Redshift data store.

See: newRedshiftSource smart constructor.

Constructors

RedshiftSource' 

Fields

Instances

Instances details
FromJSON RedshiftSource Source # 
Instance details

Defined in Amazonka.Glue.Types.RedshiftSource

ToJSON RedshiftSource Source # 
Instance details

Defined in Amazonka.Glue.Types.RedshiftSource

Generic RedshiftSource Source # 
Instance details

Defined in Amazonka.Glue.Types.RedshiftSource

Associated Types

type Rep RedshiftSource :: Type -> Type #

Read RedshiftSource Source # 
Instance details

Defined in Amazonka.Glue.Types.RedshiftSource

Show RedshiftSource Source # 
Instance details

Defined in Amazonka.Glue.Types.RedshiftSource

NFData RedshiftSource Source # 
Instance details

Defined in Amazonka.Glue.Types.RedshiftSource

Methods

rnf :: RedshiftSource -> () #

Eq RedshiftSource Source # 
Instance details

Defined in Amazonka.Glue.Types.RedshiftSource

Hashable RedshiftSource Source # 
Instance details

Defined in Amazonka.Glue.Types.RedshiftSource

type Rep RedshiftSource Source # 
Instance details

Defined in Amazonka.Glue.Types.RedshiftSource

type Rep RedshiftSource = D1 ('MetaData "RedshiftSource" "Amazonka.Glue.Types.RedshiftSource" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "RedshiftSource'" 'PrefixI 'True) ((S1 ('MetaSel ('Just "redshiftTmpDir") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "tmpDirIAMRole") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text))) :*: (S1 ('MetaSel ('Just "name") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text) :*: (S1 ('MetaSel ('Just "database") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text) :*: S1 ('MetaSel ('Just "table") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text)))))

newRedshiftSource Source #

Create a value of RedshiftSource with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:redshiftTmpDir:RedshiftSource', redshiftSource_redshiftTmpDir - The Amazon S3 path where temporary data can be staged when copying out of the database.

$sel:tmpDirIAMRole:RedshiftSource', redshiftSource_tmpDirIAMRole - The IAM role with permissions.

$sel:name:RedshiftSource', redshiftSource_name - The name of the Amazon Redshift data store.

$sel:database:RedshiftSource', redshiftSource_database - The database to read from.

$sel:table:RedshiftSource', redshiftSource_table - The database table to read from.

redshiftSource_redshiftTmpDir :: Lens' RedshiftSource (Maybe Text) Source #

The Amazon S3 path where temporary data can be staged when copying out of the database.

redshiftSource_name :: Lens' RedshiftSource Text Source #

The name of the Amazon Redshift data store.

redshiftSource_table :: Lens' RedshiftSource Text Source #

The database table to read from.

RedshiftTarget

data RedshiftTarget Source #

Specifies a target that uses Amazon Redshift.

See: newRedshiftTarget smart constructor.

Constructors

RedshiftTarget' 

Fields

Instances

Instances details
FromJSON RedshiftTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.RedshiftTarget

ToJSON RedshiftTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.RedshiftTarget

Generic RedshiftTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.RedshiftTarget

Associated Types

type Rep RedshiftTarget :: Type -> Type #

Read RedshiftTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.RedshiftTarget

Show RedshiftTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.RedshiftTarget

NFData RedshiftTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.RedshiftTarget

Methods

rnf :: RedshiftTarget -> () #

Eq RedshiftTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.RedshiftTarget

Hashable RedshiftTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.RedshiftTarget

type Rep RedshiftTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.RedshiftTarget

newRedshiftTarget Source #

Create a value of RedshiftTarget with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:redshiftTmpDir:RedshiftTarget', redshiftTarget_redshiftTmpDir - The Amazon S3 path where temporary data can be staged when copying out of the database.

$sel:tmpDirIAMRole:RedshiftTarget', redshiftTarget_tmpDirIAMRole - The IAM role with permissions.

$sel:upsertRedshiftOptions:RedshiftTarget', redshiftTarget_upsertRedshiftOptions - The set of options to configure an upsert operation when writing to a Redshift target.

$sel:name:RedshiftTarget', redshiftTarget_name - The name of the data target.

$sel:inputs:RedshiftTarget', redshiftTarget_inputs - The nodes that are inputs to the data target.

$sel:database:RedshiftTarget', redshiftTarget_database - The name of the database to write to.

$sel:table:RedshiftTarget', redshiftTarget_table - The name of the table in the database to write to.

redshiftTarget_redshiftTmpDir :: Lens' RedshiftTarget (Maybe Text) Source #

The Amazon S3 path where temporary data can be staged when copying out of the database.

redshiftTarget_upsertRedshiftOptions :: Lens' RedshiftTarget (Maybe UpsertRedshiftTargetOptions) Source #

The set of options to configure an upsert operation when writing to a Redshift target.

redshiftTarget_name :: Lens' RedshiftTarget Text Source #

The name of the data target.

redshiftTarget_inputs :: Lens' RedshiftTarget (NonEmpty Text) Source #

The nodes that are inputs to the data target.

redshiftTarget_database :: Lens' RedshiftTarget Text Source #

The name of the database to write to.

redshiftTarget_table :: Lens' RedshiftTarget Text Source #

The name of the table in the database to write to.

RegistryId

data RegistryId Source #

A wrapper structure that may contain the registry name and Amazon Resource Name (ARN).

See: newRegistryId smart constructor.

Constructors

RegistryId' 

Fields

  • registryArn :: Maybe Text

    Arn of the registry to be updated. One of RegistryArn or RegistryName has to be provided.

  • registryName :: Maybe Text

    Name of the registry. Used only for lookup. One of RegistryArn or RegistryName has to be provided.

Instances

Instances details
ToJSON RegistryId Source # 
Instance details

Defined in Amazonka.Glue.Types.RegistryId

Generic RegistryId Source # 
Instance details

Defined in Amazonka.Glue.Types.RegistryId

Associated Types

type Rep RegistryId :: Type -> Type #

Read RegistryId Source # 
Instance details

Defined in Amazonka.Glue.Types.RegistryId

Show RegistryId Source # 
Instance details

Defined in Amazonka.Glue.Types.RegistryId

NFData RegistryId Source # 
Instance details

Defined in Amazonka.Glue.Types.RegistryId

Methods

rnf :: RegistryId -> () #

Eq RegistryId Source # 
Instance details

Defined in Amazonka.Glue.Types.RegistryId

Hashable RegistryId Source # 
Instance details

Defined in Amazonka.Glue.Types.RegistryId

type Rep RegistryId Source # 
Instance details

Defined in Amazonka.Glue.Types.RegistryId

type Rep RegistryId = D1 ('MetaData "RegistryId" "Amazonka.Glue.Types.RegistryId" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "RegistryId'" 'PrefixI 'True) (S1 ('MetaSel ('Just "registryArn") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "registryName") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text))))

newRegistryId :: RegistryId Source #

Create a value of RegistryId with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:registryArn:RegistryId', registryId_registryArn - Arn of the registry to be updated. One of RegistryArn or RegistryName has to be provided.

$sel:registryName:RegistryId', registryId_registryName - Name of the registry. Used only for lookup. One of RegistryArn or RegistryName has to be provided.

registryId_registryArn :: Lens' RegistryId (Maybe Text) Source #

Arn of the registry to be updated. One of RegistryArn or RegistryName has to be provided.

registryId_registryName :: Lens' RegistryId (Maybe Text) Source #

Name of the registry. Used only for lookup. One of RegistryArn or RegistryName has to be provided.

RegistryListItem

data RegistryListItem Source #

A structure containing the details for a registry.

See: newRegistryListItem smart constructor.

Constructors

RegistryListItem' 

Fields

Instances

Instances details
FromJSON RegistryListItem Source # 
Instance details

Defined in Amazonka.Glue.Types.RegistryListItem

Generic RegistryListItem Source # 
Instance details

Defined in Amazonka.Glue.Types.RegistryListItem

Associated Types

type Rep RegistryListItem :: Type -> Type #

Read RegistryListItem Source # 
Instance details

Defined in Amazonka.Glue.Types.RegistryListItem

Show RegistryListItem Source # 
Instance details

Defined in Amazonka.Glue.Types.RegistryListItem

NFData RegistryListItem Source # 
Instance details

Defined in Amazonka.Glue.Types.RegistryListItem

Methods

rnf :: RegistryListItem -> () #

Eq RegistryListItem Source # 
Instance details

Defined in Amazonka.Glue.Types.RegistryListItem

Hashable RegistryListItem Source # 
Instance details

Defined in Amazonka.Glue.Types.RegistryListItem

type Rep RegistryListItem Source # 
Instance details

Defined in Amazonka.Glue.Types.RegistryListItem

type Rep RegistryListItem = D1 ('MetaData "RegistryListItem" "Amazonka.Glue.Types.RegistryListItem" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "RegistryListItem'" 'PrefixI 'True) ((S1 ('MetaSel ('Just "createdTime") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: (S1 ('MetaSel ('Just "description") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "registryArn") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)))) :*: (S1 ('MetaSel ('Just "registryName") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: (S1 ('MetaSel ('Just "status") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe RegistryStatus)) :*: S1 ('MetaSel ('Just "updatedTime") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text))))))

newRegistryListItem :: RegistryListItem Source #

Create a value of RegistryListItem with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:createdTime:RegistryListItem', registryListItem_createdTime - The data the registry was created.

$sel:description:RegistryListItem', registryListItem_description - A description of the registry.

$sel:registryArn:RegistryListItem', registryListItem_registryArn - The Amazon Resource Name (ARN) of the registry.

$sel:registryName:RegistryListItem', registryListItem_registryName - The name of the registry.

$sel:status:RegistryListItem', registryListItem_status - The status of the registry.

$sel:updatedTime:RegistryListItem', registryListItem_updatedTime - The date the registry was updated.

registryListItem_createdTime :: Lens' RegistryListItem (Maybe Text) Source #

The data the registry was created.

registryListItem_registryArn :: Lens' RegistryListItem (Maybe Text) Source #

The Amazon Resource Name (ARN) of the registry.

registryListItem_updatedTime :: Lens' RegistryListItem (Maybe Text) Source #

The date the registry was updated.

RelationalCatalogSource

data RelationalCatalogSource Source #

Specifies a Relational database data source in the Glue Data Catalog.

See: newRelationalCatalogSource smart constructor.

Constructors

RelationalCatalogSource' 

Fields

  • name :: Text

    The name of the data source.

  • database :: Text

    The name of the database to read from.

  • table :: Text

    The name of the table in the database to read from.

Instances

Instances details
FromJSON RelationalCatalogSource Source # 
Instance details

Defined in Amazonka.Glue.Types.RelationalCatalogSource

ToJSON RelationalCatalogSource Source # 
Instance details

Defined in Amazonka.Glue.Types.RelationalCatalogSource

Generic RelationalCatalogSource Source # 
Instance details

Defined in Amazonka.Glue.Types.RelationalCatalogSource

Associated Types

type Rep RelationalCatalogSource :: Type -> Type #

Read RelationalCatalogSource Source # 
Instance details

Defined in Amazonka.Glue.Types.RelationalCatalogSource

Show RelationalCatalogSource Source # 
Instance details

Defined in Amazonka.Glue.Types.RelationalCatalogSource

NFData RelationalCatalogSource Source # 
Instance details

Defined in Amazonka.Glue.Types.RelationalCatalogSource

Methods

rnf :: RelationalCatalogSource -> () #

Eq RelationalCatalogSource Source # 
Instance details

Defined in Amazonka.Glue.Types.RelationalCatalogSource

Hashable RelationalCatalogSource Source # 
Instance details

Defined in Amazonka.Glue.Types.RelationalCatalogSource

type Rep RelationalCatalogSource Source # 
Instance details

Defined in Amazonka.Glue.Types.RelationalCatalogSource

type Rep RelationalCatalogSource = D1 ('MetaData "RelationalCatalogSource" "Amazonka.Glue.Types.RelationalCatalogSource" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "RelationalCatalogSource'" 'PrefixI 'True) (S1 ('MetaSel ('Just "name") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text) :*: (S1 ('MetaSel ('Just "database") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text) :*: S1 ('MetaSel ('Just "table") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text))))

newRelationalCatalogSource Source #

Create a value of RelationalCatalogSource with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:name:RelationalCatalogSource', relationalCatalogSource_name - The name of the data source.

$sel:database:RelationalCatalogSource', relationalCatalogSource_database - The name of the database to read from.

$sel:table:RelationalCatalogSource', relationalCatalogSource_table - The name of the table in the database to read from.

relationalCatalogSource_table :: Lens' RelationalCatalogSource Text Source #

The name of the table in the database to read from.

RenameField

data RenameField Source #

Specifies a transform that renames a single data property key.

See: newRenameField smart constructor.

Constructors

RenameField' 

Fields

  • name :: Text

    The name of the transform node.

  • inputs :: NonEmpty Text

    The data inputs identified by their node names.

  • sourcePath :: [Text]

    A JSON path to a variable in the data structure for the source data.

  • targetPath :: [Text]

    A JSON path to a variable in the data structure for the target data.

Instances

Instances details
FromJSON RenameField Source # 
Instance details

Defined in Amazonka.Glue.Types.RenameField

ToJSON RenameField Source # 
Instance details

Defined in Amazonka.Glue.Types.RenameField

Generic RenameField Source # 
Instance details

Defined in Amazonka.Glue.Types.RenameField

Associated Types

type Rep RenameField :: Type -> Type #

Read RenameField Source # 
Instance details

Defined in Amazonka.Glue.Types.RenameField

Show RenameField Source # 
Instance details

Defined in Amazonka.Glue.Types.RenameField

NFData RenameField Source # 
Instance details

Defined in Amazonka.Glue.Types.RenameField

Methods

rnf :: RenameField -> () #

Eq RenameField Source # 
Instance details

Defined in Amazonka.Glue.Types.RenameField

Hashable RenameField Source # 
Instance details

Defined in Amazonka.Glue.Types.RenameField

type Rep RenameField Source # 
Instance details

Defined in Amazonka.Glue.Types.RenameField

type Rep RenameField = D1 ('MetaData "RenameField" "Amazonka.Glue.Types.RenameField" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "RenameField'" 'PrefixI 'True) ((S1 ('MetaSel ('Just "name") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text) :*: S1 ('MetaSel ('Just "inputs") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (NonEmpty Text))) :*: (S1 ('MetaSel ('Just "sourcePath") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 [Text]) :*: S1 ('MetaSel ('Just "targetPath") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 [Text]))))

newRenameField Source #

Create a value of RenameField with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:name:RenameField', renameField_name - The name of the transform node.

$sel:inputs:RenameField', renameField_inputs - The data inputs identified by their node names.

$sel:sourcePath:RenameField', renameField_sourcePath - A JSON path to a variable in the data structure for the source data.

$sel:targetPath:RenameField', renameField_targetPath - A JSON path to a variable in the data structure for the target data.

renameField_name :: Lens' RenameField Text Source #

The name of the transform node.

renameField_inputs :: Lens' RenameField (NonEmpty Text) Source #

The data inputs identified by their node names.

renameField_sourcePath :: Lens' RenameField [Text] Source #

A JSON path to a variable in the data structure for the source data.

renameField_targetPath :: Lens' RenameField [Text] Source #

A JSON path to a variable in the data structure for the target data.

ResourceUri

data ResourceUri Source #

The URIs for function resources.

See: newResourceUri smart constructor.

Constructors

ResourceUri' 

Fields

Instances

Instances details
FromJSON ResourceUri Source # 
Instance details

Defined in Amazonka.Glue.Types.ResourceUri

ToJSON ResourceUri Source # 
Instance details

Defined in Amazonka.Glue.Types.ResourceUri

Generic ResourceUri Source # 
Instance details

Defined in Amazonka.Glue.Types.ResourceUri

Associated Types

type Rep ResourceUri :: Type -> Type #

Read ResourceUri Source # 
Instance details

Defined in Amazonka.Glue.Types.ResourceUri

Show ResourceUri Source # 
Instance details

Defined in Amazonka.Glue.Types.ResourceUri

NFData ResourceUri Source # 
Instance details

Defined in Amazonka.Glue.Types.ResourceUri

Methods

rnf :: ResourceUri -> () #

Eq ResourceUri Source # 
Instance details

Defined in Amazonka.Glue.Types.ResourceUri

Hashable ResourceUri Source # 
Instance details

Defined in Amazonka.Glue.Types.ResourceUri

type Rep ResourceUri Source # 
Instance details

Defined in Amazonka.Glue.Types.ResourceUri

type Rep ResourceUri = D1 ('MetaData "ResourceUri" "Amazonka.Glue.Types.ResourceUri" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "ResourceUri'" 'PrefixI 'True) (S1 ('MetaSel ('Just "resourceType") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe ResourceType)) :*: S1 ('MetaSel ('Just "uri") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text))))

newResourceUri :: ResourceUri Source #

Create a value of ResourceUri with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:resourceType:ResourceUri', resourceUri_resourceType - The type of the resource.

$sel:uri:ResourceUri', resourceUri_uri - The URI for accessing the resource.

resourceUri_uri :: Lens' ResourceUri (Maybe Text) Source #

The URI for accessing the resource.

S3CatalogSource

data S3CatalogSource Source #

Specifies an Amazon S3 data store in the Glue Data Catalog.

See: newS3CatalogSource smart constructor.

Constructors

S3CatalogSource' 

Fields

Instances

Instances details
FromJSON S3CatalogSource Source # 
Instance details

Defined in Amazonka.Glue.Types.S3CatalogSource

ToJSON S3CatalogSource Source # 
Instance details

Defined in Amazonka.Glue.Types.S3CatalogSource

Generic S3CatalogSource Source # 
Instance details

Defined in Amazonka.Glue.Types.S3CatalogSource

Associated Types

type Rep S3CatalogSource :: Type -> Type #

Read S3CatalogSource Source # 
Instance details

Defined in Amazonka.Glue.Types.S3CatalogSource

Show S3CatalogSource Source # 
Instance details

Defined in Amazonka.Glue.Types.S3CatalogSource

NFData S3CatalogSource Source # 
Instance details

Defined in Amazonka.Glue.Types.S3CatalogSource

Methods

rnf :: S3CatalogSource -> () #

Eq S3CatalogSource Source # 
Instance details

Defined in Amazonka.Glue.Types.S3CatalogSource

Hashable S3CatalogSource Source # 
Instance details

Defined in Amazonka.Glue.Types.S3CatalogSource

type Rep S3CatalogSource Source # 
Instance details

Defined in Amazonka.Glue.Types.S3CatalogSource

type Rep S3CatalogSource = D1 ('MetaData "S3CatalogSource" "Amazonka.Glue.Types.S3CatalogSource" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "S3CatalogSource'" 'PrefixI 'True) ((S1 ('MetaSel ('Just "additionalOptions") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe S3SourceAdditionalOptions)) :*: S1 ('MetaSel ('Just "partitionPredicate") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text))) :*: (S1 ('MetaSel ('Just "name") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text) :*: (S1 ('MetaSel ('Just "database") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text) :*: S1 ('MetaSel ('Just "table") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text)))))

newS3CatalogSource Source #

Create a value of S3CatalogSource with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:additionalOptions:S3CatalogSource', s3CatalogSource_additionalOptions - Specifies additional connection options.

$sel:partitionPredicate:S3CatalogSource', s3CatalogSource_partitionPredicate - Partitions satisfying this predicate are deleted. Files within the retention period in these partitions are not deleted. Set to "" – empty by default.

$sel:name:S3CatalogSource', s3CatalogSource_name - The name of the data store.

$sel:database:S3CatalogSource', s3CatalogSource_database - The database to read from.

$sel:table:S3CatalogSource', s3CatalogSource_table - The database table to read from.

s3CatalogSource_partitionPredicate :: Lens' S3CatalogSource (Maybe Text) Source #

Partitions satisfying this predicate are deleted. Files within the retention period in these partitions are not deleted. Set to "" – empty by default.

s3CatalogSource_name :: Lens' S3CatalogSource Text Source #

The name of the data store.

s3CatalogSource_table :: Lens' S3CatalogSource Text Source #

The database table to read from.

S3CatalogTarget

data S3CatalogTarget Source #

Specifies a data target that writes to Amazon S3 using the Glue Data Catalog.

See: newS3CatalogTarget smart constructor.

Constructors

S3CatalogTarget' 

Fields

Instances

Instances details
FromJSON S3CatalogTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.S3CatalogTarget

ToJSON S3CatalogTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.S3CatalogTarget

Generic S3CatalogTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.S3CatalogTarget

Associated Types

type Rep S3CatalogTarget :: Type -> Type #

Read S3CatalogTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.S3CatalogTarget

Show S3CatalogTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.S3CatalogTarget

NFData S3CatalogTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.S3CatalogTarget

Methods

rnf :: S3CatalogTarget -> () #

Eq S3CatalogTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.S3CatalogTarget

Hashable S3CatalogTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.S3CatalogTarget

type Rep S3CatalogTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.S3CatalogTarget

newS3CatalogTarget Source #

Create a value of S3CatalogTarget with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:partitionKeys:S3CatalogTarget', s3CatalogTarget_partitionKeys - Specifies native partitioning using a sequence of keys.

$sel:schemaChangePolicy:S3CatalogTarget', s3CatalogTarget_schemaChangePolicy - A policy that specifies update behavior for the crawler.

$sel:name:S3CatalogTarget', s3CatalogTarget_name - The name of the data target.

$sel:inputs:S3CatalogTarget', s3CatalogTarget_inputs - The nodes that are inputs to the data target.

$sel:table:S3CatalogTarget', s3CatalogTarget_table - The name of the table in the database to write to.

$sel:database:S3CatalogTarget', s3CatalogTarget_database - The name of the database to write to.

s3CatalogTarget_partitionKeys :: Lens' S3CatalogTarget (Maybe [[Text]]) Source #

Specifies native partitioning using a sequence of keys.

s3CatalogTarget_schemaChangePolicy :: Lens' S3CatalogTarget (Maybe CatalogSchemaChangePolicy) Source #

A policy that specifies update behavior for the crawler.

s3CatalogTarget_name :: Lens' S3CatalogTarget Text Source #

The name of the data target.

s3CatalogTarget_inputs :: Lens' S3CatalogTarget (NonEmpty Text) Source #

The nodes that are inputs to the data target.

s3CatalogTarget_table :: Lens' S3CatalogTarget Text Source #

The name of the table in the database to write to.

s3CatalogTarget_database :: Lens' S3CatalogTarget Text Source #

The name of the database to write to.

S3CsvSource

data S3CsvSource Source #

Specifies a command-separated value (CSV) data store stored in Amazon S3.

See: newS3CsvSource smart constructor.

Constructors

S3CsvSource' 

Fields

  • additionalOptions :: Maybe S3DirectSourceAdditionalOptions

    Specifies additional connection options.

  • compressionType :: Maybe CompressionType

    Specifies how the data is compressed. This is generally not necessary if the data has a standard file extension. Possible values are "gzip" and "bzip").

  • escaper :: Maybe Text

    Specifies a character to use for escaping. This option is used only when reading CSV files. The default value is none. If enabled, the character which immediately follows is used as-is, except for a small set of well-known escapes (\n, \r, \t, and \0).

  • exclusions :: Maybe [Text]

    A string containing a JSON list of Unix-style glob patterns to exclude. For example, "[\"**.pdf\"]" excludes all PDF files.

  • groupFiles :: Maybe Text

    Grouping files is turned on by default when the input contains more than 50,000 files. To turn on grouping with fewer than 50,000 files, set this parameter to "inPartition". To disable grouping when there are more than 50,000 files, set this parameter to "none".

  • groupSize :: Maybe Text

    The target group size in bytes. The default is computed based on the input data size and the size of your cluster. When there are fewer than 50,000 input files, "groupFiles" must be set to "inPartition" for this to take effect.

  • maxBand :: Maybe Natural

    This option controls the duration in milliseconds after which the s3 listing is likely to be consistent. Files with modification timestamps falling within the last maxBand milliseconds are tracked specially when using JobBookmarks to account for Amazon S3 eventual consistency. Most users don't need to set this option. The default is 900000 milliseconds, or 15 minutes.

  • maxFilesInBand :: Maybe Natural

    This option specifies the maximum number of files to save from the last maxBand seconds. If this number is exceeded, extra files are skipped and only processed in the next job run.

  • multiline :: Maybe Bool

    A Boolean value that specifies whether a single record can span multiple lines. This can occur when a field contains a quoted new-line character. You must set this option to True if any record spans multiple lines. The default value is False, which allows for more aggressive file-splitting during parsing.

  • optimizePerformance :: Maybe Bool

    A Boolean value that specifies whether to use the advanced SIMD CSV reader along with Apache Arrow based columnar memory formats. Only available in Glue version 3.0.

  • outputSchemas :: Maybe [GlueSchema]

    Specifies the data schema for the S3 CSV source.

  • recurse :: Maybe Bool

    If set to true, recursively reads files in all subdirectories under the specified paths.

  • skipFirst :: Maybe Bool

    A Boolean value that specifies whether to skip the first data line. The default value is False.

  • withHeader :: Maybe Bool

    A Boolean value that specifies whether to treat the first line as a header. The default value is False.

  • writeHeader :: Maybe Bool

    A Boolean value that specifies whether to write the header to output. The default value is True.

  • name :: Text

    The name of the data store.

  • paths :: [Text]

    A list of the Amazon S3 paths to read from.

  • separator :: Separator

    Specifies the delimiter character. The default is a comma: ",", but any other character can be specified.

  • quoteChar :: QuoteChar

    Specifies the character to use for quoting. The default is a double quote: '"'. Set this to -1 to turn off quoting entirely.

Instances

Instances details
FromJSON S3CsvSource Source # 
Instance details

Defined in Amazonka.Glue.Types.S3CsvSource

ToJSON S3CsvSource Source # 
Instance details

Defined in Amazonka.Glue.Types.S3CsvSource

Generic S3CsvSource Source # 
Instance details

Defined in Amazonka.Glue.Types.S3CsvSource

Associated Types

type Rep S3CsvSource :: Type -> Type #

Read S3CsvSource Source # 
Instance details

Defined in Amazonka.Glue.Types.S3CsvSource

Show S3CsvSource Source # 
Instance details

Defined in Amazonka.Glue.Types.S3CsvSource

NFData S3CsvSource Source # 
Instance details

Defined in Amazonka.Glue.Types.S3CsvSource

Methods

rnf :: S3CsvSource -> () #

Eq S3CsvSource Source # 
Instance details

Defined in Amazonka.Glue.Types.S3CsvSource

Hashable S3CsvSource Source # 
Instance details

Defined in Amazonka.Glue.Types.S3CsvSource

type Rep S3CsvSource Source # 
Instance details

Defined in Amazonka.Glue.Types.S3CsvSource

type Rep S3CsvSource = D1 ('MetaData "S3CsvSource" "Amazonka.Glue.Types.S3CsvSource" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "S3CsvSource'" 'PrefixI 'True) ((((S1 ('MetaSel ('Just "additionalOptions") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe S3DirectSourceAdditionalOptions)) :*: S1 ('MetaSel ('Just "compressionType") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe CompressionType))) :*: (S1 ('MetaSel ('Just "escaper") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "exclusions") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe [Text])))) :*: ((S1 ('MetaSel ('Just "groupFiles") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "groupSize") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text))) :*: (S1 ('MetaSel ('Just "maxBand") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Natural)) :*: (S1 ('MetaSel ('Just "maxFilesInBand") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Natural)) :*: S1 ('MetaSel ('Just "multiline") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Bool)))))) :*: (((S1 ('MetaSel ('Just "optimizePerformance") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Bool)) :*: S1 ('MetaSel ('Just "outputSchemas") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe [GlueSchema]))) :*: (S1 ('MetaSel ('Just "recurse") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Bool)) :*: (S1 ('MetaSel ('Just "skipFirst") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Bool)) :*: S1 ('MetaSel ('Just "withHeader") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Bool))))) :*: ((S1 ('MetaSel ('Just "writeHeader") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Bool)) :*: S1 ('MetaSel ('Just "name") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text)) :*: (S1 ('MetaSel ('Just "paths") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 [Text]) :*: (S1 ('MetaSel ('Just "separator") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Separator) :*: S1 ('MetaSel ('Just "quoteChar") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 QuoteChar)))))))

newS3CsvSource Source #

Create a value of S3CsvSource with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:additionalOptions:S3CsvSource', s3CsvSource_additionalOptions - Specifies additional connection options.

$sel:compressionType:S3CsvSource', s3CsvSource_compressionType - Specifies how the data is compressed. This is generally not necessary if the data has a standard file extension. Possible values are "gzip" and "bzip").

$sel:escaper:S3CsvSource', s3CsvSource_escaper - Specifies a character to use for escaping. This option is used only when reading CSV files. The default value is none. If enabled, the character which immediately follows is used as-is, except for a small set of well-known escapes (\n, \r, \t, and \0).

$sel:exclusions:S3CsvSource', s3CsvSource_exclusions - A string containing a JSON list of Unix-style glob patterns to exclude. For example, "[\"**.pdf\"]" excludes all PDF files.

$sel:groupFiles:S3CsvSource', s3CsvSource_groupFiles - Grouping files is turned on by default when the input contains more than 50,000 files. To turn on grouping with fewer than 50,000 files, set this parameter to "inPartition". To disable grouping when there are more than 50,000 files, set this parameter to "none".

$sel:groupSize:S3CsvSource', s3CsvSource_groupSize - The target group size in bytes. The default is computed based on the input data size and the size of your cluster. When there are fewer than 50,000 input files, "groupFiles" must be set to "inPartition" for this to take effect.

$sel:maxBand:S3CsvSource', s3CsvSource_maxBand - This option controls the duration in milliseconds after which the s3 listing is likely to be consistent. Files with modification timestamps falling within the last maxBand milliseconds are tracked specially when using JobBookmarks to account for Amazon S3 eventual consistency. Most users don't need to set this option. The default is 900000 milliseconds, or 15 minutes.

$sel:maxFilesInBand:S3CsvSource', s3CsvSource_maxFilesInBand - This option specifies the maximum number of files to save from the last maxBand seconds. If this number is exceeded, extra files are skipped and only processed in the next job run.

$sel:multiline:S3CsvSource', s3CsvSource_multiline - A Boolean value that specifies whether a single record can span multiple lines. This can occur when a field contains a quoted new-line character. You must set this option to True if any record spans multiple lines. The default value is False, which allows for more aggressive file-splitting during parsing.

$sel:optimizePerformance:S3CsvSource', s3CsvSource_optimizePerformance - A Boolean value that specifies whether to use the advanced SIMD CSV reader along with Apache Arrow based columnar memory formats. Only available in Glue version 3.0.

$sel:outputSchemas:S3CsvSource', s3CsvSource_outputSchemas - Specifies the data schema for the S3 CSV source.

$sel:recurse:S3CsvSource', s3CsvSource_recurse - If set to true, recursively reads files in all subdirectories under the specified paths.

$sel:skipFirst:S3CsvSource', s3CsvSource_skipFirst - A Boolean value that specifies whether to skip the first data line. The default value is False.

$sel:withHeader:S3CsvSource', s3CsvSource_withHeader - A Boolean value that specifies whether to treat the first line as a header. The default value is False.

$sel:writeHeader:S3CsvSource', s3CsvSource_writeHeader - A Boolean value that specifies whether to write the header to output. The default value is True.

$sel:name:S3CsvSource', s3CsvSource_name - The name of the data store.

$sel:paths:S3CsvSource', s3CsvSource_paths - A list of the Amazon S3 paths to read from.

$sel:separator:S3CsvSource', s3CsvSource_separator - Specifies the delimiter character. The default is a comma: ",", but any other character can be specified.

$sel:quoteChar:S3CsvSource', s3CsvSource_quoteChar - Specifies the character to use for quoting. The default is a double quote: '"'. Set this to -1 to turn off quoting entirely.

s3CsvSource_compressionType :: Lens' S3CsvSource (Maybe CompressionType) Source #

Specifies how the data is compressed. This is generally not necessary if the data has a standard file extension. Possible values are "gzip" and "bzip").

s3CsvSource_escaper :: Lens' S3CsvSource (Maybe Text) Source #

Specifies a character to use for escaping. This option is used only when reading CSV files. The default value is none. If enabled, the character which immediately follows is used as-is, except for a small set of well-known escapes (\n, \r, \t, and \0).

s3CsvSource_exclusions :: Lens' S3CsvSource (Maybe [Text]) Source #

A string containing a JSON list of Unix-style glob patterns to exclude. For example, "[\"**.pdf\"]" excludes all PDF files.

s3CsvSource_groupFiles :: Lens' S3CsvSource (Maybe Text) Source #

Grouping files is turned on by default when the input contains more than 50,000 files. To turn on grouping with fewer than 50,000 files, set this parameter to "inPartition". To disable grouping when there are more than 50,000 files, set this parameter to "none".

s3CsvSource_groupSize :: Lens' S3CsvSource (Maybe Text) Source #

The target group size in bytes. The default is computed based on the input data size and the size of your cluster. When there are fewer than 50,000 input files, "groupFiles" must be set to "inPartition" for this to take effect.

s3CsvSource_maxBand :: Lens' S3CsvSource (Maybe Natural) Source #

This option controls the duration in milliseconds after which the s3 listing is likely to be consistent. Files with modification timestamps falling within the last maxBand milliseconds are tracked specially when using JobBookmarks to account for Amazon S3 eventual consistency. Most users don't need to set this option. The default is 900000 milliseconds, or 15 minutes.

s3CsvSource_maxFilesInBand :: Lens' S3CsvSource (Maybe Natural) Source #

This option specifies the maximum number of files to save from the last maxBand seconds. If this number is exceeded, extra files are skipped and only processed in the next job run.

s3CsvSource_multiline :: Lens' S3CsvSource (Maybe Bool) Source #

A Boolean value that specifies whether a single record can span multiple lines. This can occur when a field contains a quoted new-line character. You must set this option to True if any record spans multiple lines. The default value is False, which allows for more aggressive file-splitting during parsing.

s3CsvSource_optimizePerformance :: Lens' S3CsvSource (Maybe Bool) Source #

A Boolean value that specifies whether to use the advanced SIMD CSV reader along with Apache Arrow based columnar memory formats. Only available in Glue version 3.0.

s3CsvSource_outputSchemas :: Lens' S3CsvSource (Maybe [GlueSchema]) Source #

Specifies the data schema for the S3 CSV source.

s3CsvSource_recurse :: Lens' S3CsvSource (Maybe Bool) Source #

If set to true, recursively reads files in all subdirectories under the specified paths.

s3CsvSource_skipFirst :: Lens' S3CsvSource (Maybe Bool) Source #

A Boolean value that specifies whether to skip the first data line. The default value is False.

s3CsvSource_withHeader :: Lens' S3CsvSource (Maybe Bool) Source #

A Boolean value that specifies whether to treat the first line as a header. The default value is False.

s3CsvSource_writeHeader :: Lens' S3CsvSource (Maybe Bool) Source #

A Boolean value that specifies whether to write the header to output. The default value is True.

s3CsvSource_name :: Lens' S3CsvSource Text Source #

The name of the data store.

s3CsvSource_paths :: Lens' S3CsvSource [Text] Source #

A list of the Amazon S3 paths to read from.

s3CsvSource_separator :: Lens' S3CsvSource Separator Source #

Specifies the delimiter character. The default is a comma: ",", but any other character can be specified.

s3CsvSource_quoteChar :: Lens' S3CsvSource QuoteChar Source #

Specifies the character to use for quoting. The default is a double quote: '"'. Set this to -1 to turn off quoting entirely.

S3DirectSourceAdditionalOptions

data S3DirectSourceAdditionalOptions Source #

Specifies additional connection options for the Amazon S3 data store.

See: newS3DirectSourceAdditionalOptions smart constructor.

Constructors

S3DirectSourceAdditionalOptions' 

Fields

Instances

Instances details
FromJSON S3DirectSourceAdditionalOptions Source # 
Instance details

Defined in Amazonka.Glue.Types.S3DirectSourceAdditionalOptions

ToJSON S3DirectSourceAdditionalOptions Source # 
Instance details

Defined in Amazonka.Glue.Types.S3DirectSourceAdditionalOptions

Generic S3DirectSourceAdditionalOptions Source # 
Instance details

Defined in Amazonka.Glue.Types.S3DirectSourceAdditionalOptions

Associated Types

type Rep S3DirectSourceAdditionalOptions :: Type -> Type #

Read S3DirectSourceAdditionalOptions Source # 
Instance details

Defined in Amazonka.Glue.Types.S3DirectSourceAdditionalOptions

Show S3DirectSourceAdditionalOptions Source # 
Instance details

Defined in Amazonka.Glue.Types.S3DirectSourceAdditionalOptions

NFData S3DirectSourceAdditionalOptions Source # 
Instance details

Defined in Amazonka.Glue.Types.S3DirectSourceAdditionalOptions

Eq S3DirectSourceAdditionalOptions Source # 
Instance details

Defined in Amazonka.Glue.Types.S3DirectSourceAdditionalOptions

Hashable S3DirectSourceAdditionalOptions Source # 
Instance details

Defined in Amazonka.Glue.Types.S3DirectSourceAdditionalOptions

type Rep S3DirectSourceAdditionalOptions Source # 
Instance details

Defined in Amazonka.Glue.Types.S3DirectSourceAdditionalOptions

type Rep S3DirectSourceAdditionalOptions = D1 ('MetaData "S3DirectSourceAdditionalOptions" "Amazonka.Glue.Types.S3DirectSourceAdditionalOptions" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "S3DirectSourceAdditionalOptions'" 'PrefixI 'True) ((S1 ('MetaSel ('Just "boundedFiles") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Integer)) :*: S1 ('MetaSel ('Just "boundedSize") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Integer))) :*: (S1 ('MetaSel ('Just "enableSamplePath") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Bool)) :*: S1 ('MetaSel ('Just "samplePath") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)))))

newS3DirectSourceAdditionalOptions :: S3DirectSourceAdditionalOptions Source #

Create a value of S3DirectSourceAdditionalOptions with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:boundedFiles:S3DirectSourceAdditionalOptions', s3DirectSourceAdditionalOptions_boundedFiles - Sets the upper limit for the target number of files that will be processed.

$sel:boundedSize:S3DirectSourceAdditionalOptions', s3DirectSourceAdditionalOptions_boundedSize - Sets the upper limit for the target size of the dataset in bytes that will be processed.

$sel:enableSamplePath:S3DirectSourceAdditionalOptions', s3DirectSourceAdditionalOptions_enableSamplePath - Sets option to enable a sample path.

$sel:samplePath:S3DirectSourceAdditionalOptions', s3DirectSourceAdditionalOptions_samplePath - If enabled, specifies the sample path.

s3DirectSourceAdditionalOptions_boundedFiles :: Lens' S3DirectSourceAdditionalOptions (Maybe Integer) Source #

Sets the upper limit for the target number of files that will be processed.

s3DirectSourceAdditionalOptions_boundedSize :: Lens' S3DirectSourceAdditionalOptions (Maybe Integer) Source #

Sets the upper limit for the target size of the dataset in bytes that will be processed.

S3DirectTarget

data S3DirectTarget Source #

Specifies a data target that writes to Amazon S3.

See: newS3DirectTarget smart constructor.

Constructors

S3DirectTarget' 

Fields

Instances

Instances details
FromJSON S3DirectTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.S3DirectTarget

ToJSON S3DirectTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.S3DirectTarget

Generic S3DirectTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.S3DirectTarget

Associated Types

type Rep S3DirectTarget :: Type -> Type #

Read S3DirectTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.S3DirectTarget

Show S3DirectTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.S3DirectTarget

NFData S3DirectTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.S3DirectTarget

Methods

rnf :: S3DirectTarget -> () #

Eq S3DirectTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.S3DirectTarget

Hashable S3DirectTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.S3DirectTarget

type Rep S3DirectTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.S3DirectTarget

newS3DirectTarget Source #

Create a value of S3DirectTarget with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:compression:S3DirectTarget', s3DirectTarget_compression - Specifies how the data is compressed. This is generally not necessary if the data has a standard file extension. Possible values are "gzip" and "bzip").

$sel:partitionKeys:S3DirectTarget', s3DirectTarget_partitionKeys - Specifies native partitioning using a sequence of keys.

$sel:schemaChangePolicy:S3DirectTarget', s3DirectTarget_schemaChangePolicy - A policy that specifies update behavior for the crawler.

$sel:name:S3DirectTarget', s3DirectTarget_name - The name of the data target.

$sel:inputs:S3DirectTarget', s3DirectTarget_inputs - The nodes that are inputs to the data target.

$sel:path:S3DirectTarget', s3DirectTarget_path - A single Amazon S3 path to write to.

$sel:format:S3DirectTarget', s3DirectTarget_format - Specifies the data output format for the target.

s3DirectTarget_compression :: Lens' S3DirectTarget (Maybe Text) Source #

Specifies how the data is compressed. This is generally not necessary if the data has a standard file extension. Possible values are "gzip" and "bzip").

s3DirectTarget_partitionKeys :: Lens' S3DirectTarget (Maybe [[Text]]) Source #

Specifies native partitioning using a sequence of keys.

s3DirectTarget_schemaChangePolicy :: Lens' S3DirectTarget (Maybe DirectSchemaChangePolicy) Source #

A policy that specifies update behavior for the crawler.

s3DirectTarget_name :: Lens' S3DirectTarget Text Source #

The name of the data target.

s3DirectTarget_inputs :: Lens' S3DirectTarget (NonEmpty Text) Source #

The nodes that are inputs to the data target.

s3DirectTarget_path :: Lens' S3DirectTarget Text Source #

A single Amazon S3 path to write to.

s3DirectTarget_format :: Lens' S3DirectTarget TargetFormat Source #

Specifies the data output format for the target.

S3Encryption

data S3Encryption Source #

Specifies how Amazon Simple Storage Service (Amazon S3) data should be encrypted.

See: newS3Encryption smart constructor.

Constructors

S3Encryption' 

Fields

Instances

Instances details
FromJSON S3Encryption Source # 
Instance details

Defined in Amazonka.Glue.Types.S3Encryption

ToJSON S3Encryption Source # 
Instance details

Defined in Amazonka.Glue.Types.S3Encryption

Generic S3Encryption Source # 
Instance details

Defined in Amazonka.Glue.Types.S3Encryption

Associated Types

type Rep S3Encryption :: Type -> Type #

Read S3Encryption Source # 
Instance details

Defined in Amazonka.Glue.Types.S3Encryption

Show S3Encryption Source # 
Instance details

Defined in Amazonka.Glue.Types.S3Encryption

NFData S3Encryption Source # 
Instance details

Defined in Amazonka.Glue.Types.S3Encryption

Methods

rnf :: S3Encryption -> () #

Eq S3Encryption Source # 
Instance details

Defined in Amazonka.Glue.Types.S3Encryption

Hashable S3Encryption Source # 
Instance details

Defined in Amazonka.Glue.Types.S3Encryption

type Rep S3Encryption Source # 
Instance details

Defined in Amazonka.Glue.Types.S3Encryption

type Rep S3Encryption = D1 ('MetaData "S3Encryption" "Amazonka.Glue.Types.S3Encryption" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "S3Encryption'" 'PrefixI 'True) (S1 ('MetaSel ('Just "kmsKeyArn") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "s3EncryptionMode") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe S3EncryptionMode))))

newS3Encryption :: S3Encryption Source #

Create a value of S3Encryption with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:kmsKeyArn:S3Encryption', s3Encryption_kmsKeyArn - The Amazon Resource Name (ARN) of the KMS key to be used to encrypt the data.

$sel:s3EncryptionMode:S3Encryption', s3Encryption_s3EncryptionMode - The encryption mode to use for Amazon S3 data.

s3Encryption_kmsKeyArn :: Lens' S3Encryption (Maybe Text) Source #

The Amazon Resource Name (ARN) of the KMS key to be used to encrypt the data.

s3Encryption_s3EncryptionMode :: Lens' S3Encryption (Maybe S3EncryptionMode) Source #

The encryption mode to use for Amazon S3 data.

S3GlueParquetTarget

data S3GlueParquetTarget Source #

Specifies a data target that writes to Amazon S3 in Apache Parquet columnar storage.

See: newS3GlueParquetTarget smart constructor.

Constructors

S3GlueParquetTarget' 

Fields

Instances

Instances details
FromJSON S3GlueParquetTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.S3GlueParquetTarget

ToJSON S3GlueParquetTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.S3GlueParquetTarget

Generic S3GlueParquetTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.S3GlueParquetTarget

Associated Types

type Rep S3GlueParquetTarget :: Type -> Type #

Read S3GlueParquetTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.S3GlueParquetTarget

Show S3GlueParquetTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.S3GlueParquetTarget

NFData S3GlueParquetTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.S3GlueParquetTarget

Methods

rnf :: S3GlueParquetTarget -> () #

Eq S3GlueParquetTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.S3GlueParquetTarget

Hashable S3GlueParquetTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.S3GlueParquetTarget

type Rep S3GlueParquetTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.S3GlueParquetTarget

newS3GlueParquetTarget Source #

Create a value of S3GlueParquetTarget with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:compression:S3GlueParquetTarget', s3GlueParquetTarget_compression - Specifies how the data is compressed. This is generally not necessary if the data has a standard file extension. Possible values are "gzip" and "bzip").

$sel:partitionKeys:S3GlueParquetTarget', s3GlueParquetTarget_partitionKeys - Specifies native partitioning using a sequence of keys.

$sel:schemaChangePolicy:S3GlueParquetTarget', s3GlueParquetTarget_schemaChangePolicy - A policy that specifies update behavior for the crawler.

$sel:name:S3GlueParquetTarget', s3GlueParquetTarget_name - The name of the data target.

$sel:inputs:S3GlueParquetTarget', s3GlueParquetTarget_inputs - The nodes that are inputs to the data target.

$sel:path:S3GlueParquetTarget', s3GlueParquetTarget_path - A single Amazon S3 path to write to.

s3GlueParquetTarget_compression :: Lens' S3GlueParquetTarget (Maybe ParquetCompressionType) Source #

Specifies how the data is compressed. This is generally not necessary if the data has a standard file extension. Possible values are "gzip" and "bzip").

s3GlueParquetTarget_partitionKeys :: Lens' S3GlueParquetTarget (Maybe [[Text]]) Source #

Specifies native partitioning using a sequence of keys.

s3GlueParquetTarget_schemaChangePolicy :: Lens' S3GlueParquetTarget (Maybe DirectSchemaChangePolicy) Source #

A policy that specifies update behavior for the crawler.

s3GlueParquetTarget_inputs :: Lens' S3GlueParquetTarget (NonEmpty Text) Source #

The nodes that are inputs to the data target.

s3GlueParquetTarget_path :: Lens' S3GlueParquetTarget Text Source #

A single Amazon S3 path to write to.

S3JsonSource

data S3JsonSource Source #

Specifies a JSON data store stored in Amazon S3.

See: newS3JsonSource smart constructor.

Constructors

S3JsonSource' 

Fields

  • additionalOptions :: Maybe S3DirectSourceAdditionalOptions

    Specifies additional connection options.

  • compressionType :: Maybe CompressionType

    Specifies how the data is compressed. This is generally not necessary if the data has a standard file extension. Possible values are "gzip" and "bzip").

  • exclusions :: Maybe [Text]

    A string containing a JSON list of Unix-style glob patterns to exclude. For example, "[\"**.pdf\"]" excludes all PDF files.

  • groupFiles :: Maybe Text

    Grouping files is turned on by default when the input contains more than 50,000 files. To turn on grouping with fewer than 50,000 files, set this parameter to "inPartition". To disable grouping when there are more than 50,000 files, set this parameter to "none".

  • groupSize :: Maybe Text

    The target group size in bytes. The default is computed based on the input data size and the size of your cluster. When there are fewer than 50,000 input files, "groupFiles" must be set to "inPartition" for this to take effect.

  • jsonPath :: Maybe Text

    A JsonPath string defining the JSON data.

  • maxBand :: Maybe Natural

    This option controls the duration in milliseconds after which the s3 listing is likely to be consistent. Files with modification timestamps falling within the last maxBand milliseconds are tracked specially when using JobBookmarks to account for Amazon S3 eventual consistency. Most users don't need to set this option. The default is 900000 milliseconds, or 15 minutes.

  • maxFilesInBand :: Maybe Natural

    This option specifies the maximum number of files to save from the last maxBand seconds. If this number is exceeded, extra files are skipped and only processed in the next job run.

  • multiline :: Maybe Bool

    A Boolean value that specifies whether a single record can span multiple lines. This can occur when a field contains a quoted new-line character. You must set this option to True if any record spans multiple lines. The default value is False, which allows for more aggressive file-splitting during parsing.

  • outputSchemas :: Maybe [GlueSchema]

    Specifies the data schema for the S3 JSON source.

  • recurse :: Maybe Bool

    If set to true, recursively reads files in all subdirectories under the specified paths.

  • name :: Text

    The name of the data store.

  • paths :: [Text]

    A list of the Amazon S3 paths to read from.

Instances

Instances details
FromJSON S3JsonSource Source # 
Instance details

Defined in Amazonka.Glue.Types.S3JsonSource

ToJSON S3JsonSource Source # 
Instance details

Defined in Amazonka.Glue.Types.S3JsonSource

Generic S3JsonSource Source # 
Instance details

Defined in Amazonka.Glue.Types.S3JsonSource

Associated Types

type Rep S3JsonSource :: Type -> Type #

Read S3JsonSource Source # 
Instance details

Defined in Amazonka.Glue.Types.S3JsonSource

Show S3JsonSource Source # 
Instance details

Defined in Amazonka.Glue.Types.S3JsonSource

NFData S3JsonSource Source # 
Instance details

Defined in Amazonka.Glue.Types.S3JsonSource

Methods

rnf :: S3JsonSource -> () #

Eq S3JsonSource Source # 
Instance details

Defined in Amazonka.Glue.Types.S3JsonSource

Hashable S3JsonSource Source # 
Instance details

Defined in Amazonka.Glue.Types.S3JsonSource

type Rep S3JsonSource Source # 
Instance details

Defined in Amazonka.Glue.Types.S3JsonSource

type Rep S3JsonSource = D1 ('MetaData "S3JsonSource" "Amazonka.Glue.Types.S3JsonSource" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "S3JsonSource'" 'PrefixI 'True) (((S1 ('MetaSel ('Just "additionalOptions") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe S3DirectSourceAdditionalOptions)) :*: (S1 ('MetaSel ('Just "compressionType") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe CompressionType)) :*: S1 ('MetaSel ('Just "exclusions") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe [Text])))) :*: (S1 ('MetaSel ('Just "groupFiles") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: (S1 ('MetaSel ('Just "groupSize") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "jsonPath") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text))))) :*: ((S1 ('MetaSel ('Just "maxBand") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Natural)) :*: (S1 ('MetaSel ('Just "maxFilesInBand") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Natural)) :*: S1 ('MetaSel ('Just "multiline") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Bool)))) :*: ((S1 ('MetaSel ('Just "outputSchemas") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe [GlueSchema])) :*: S1 ('MetaSel ('Just "recurse") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Bool))) :*: (S1 ('MetaSel ('Just "name") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text) :*: S1 ('MetaSel ('Just "paths") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 [Text]))))))

newS3JsonSource Source #

Create a value of S3JsonSource with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:additionalOptions:S3JsonSource', s3JsonSource_additionalOptions - Specifies additional connection options.

$sel:compressionType:S3JsonSource', s3JsonSource_compressionType - Specifies how the data is compressed. This is generally not necessary if the data has a standard file extension. Possible values are "gzip" and "bzip").

$sel:exclusions:S3JsonSource', s3JsonSource_exclusions - A string containing a JSON list of Unix-style glob patterns to exclude. For example, "[\"**.pdf\"]" excludes all PDF files.

$sel:groupFiles:S3JsonSource', s3JsonSource_groupFiles - Grouping files is turned on by default when the input contains more than 50,000 files. To turn on grouping with fewer than 50,000 files, set this parameter to "inPartition". To disable grouping when there are more than 50,000 files, set this parameter to "none".

$sel:groupSize:S3JsonSource', s3JsonSource_groupSize - The target group size in bytes. The default is computed based on the input data size and the size of your cluster. When there are fewer than 50,000 input files, "groupFiles" must be set to "inPartition" for this to take effect.

$sel:jsonPath:S3JsonSource', s3JsonSource_jsonPath - A JsonPath string defining the JSON data.

$sel:maxBand:S3JsonSource', s3JsonSource_maxBand - This option controls the duration in milliseconds after which the s3 listing is likely to be consistent. Files with modification timestamps falling within the last maxBand milliseconds are tracked specially when using JobBookmarks to account for Amazon S3 eventual consistency. Most users don't need to set this option. The default is 900000 milliseconds, or 15 minutes.

$sel:maxFilesInBand:S3JsonSource', s3JsonSource_maxFilesInBand - This option specifies the maximum number of files to save from the last maxBand seconds. If this number is exceeded, extra files are skipped and only processed in the next job run.

$sel:multiline:S3JsonSource', s3JsonSource_multiline - A Boolean value that specifies whether a single record can span multiple lines. This can occur when a field contains a quoted new-line character. You must set this option to True if any record spans multiple lines. The default value is False, which allows for more aggressive file-splitting during parsing.

$sel:outputSchemas:S3JsonSource', s3JsonSource_outputSchemas - Specifies the data schema for the S3 JSON source.

$sel:recurse:S3JsonSource', s3JsonSource_recurse - If set to true, recursively reads files in all subdirectories under the specified paths.

$sel:name:S3JsonSource', s3JsonSource_name - The name of the data store.

$sel:paths:S3JsonSource', s3JsonSource_paths - A list of the Amazon S3 paths to read from.

s3JsonSource_compressionType :: Lens' S3JsonSource (Maybe CompressionType) Source #

Specifies how the data is compressed. This is generally not necessary if the data has a standard file extension. Possible values are "gzip" and "bzip").

s3JsonSource_exclusions :: Lens' S3JsonSource (Maybe [Text]) Source #

A string containing a JSON list of Unix-style glob patterns to exclude. For example, "[\"**.pdf\"]" excludes all PDF files.

s3JsonSource_groupFiles :: Lens' S3JsonSource (Maybe Text) Source #

Grouping files is turned on by default when the input contains more than 50,000 files. To turn on grouping with fewer than 50,000 files, set this parameter to "inPartition". To disable grouping when there are more than 50,000 files, set this parameter to "none".

s3JsonSource_groupSize :: Lens' S3JsonSource (Maybe Text) Source #

The target group size in bytes. The default is computed based on the input data size and the size of your cluster. When there are fewer than 50,000 input files, "groupFiles" must be set to "inPartition" for this to take effect.

s3JsonSource_jsonPath :: Lens' S3JsonSource (Maybe Text) Source #

A JsonPath string defining the JSON data.

s3JsonSource_maxBand :: Lens' S3JsonSource (Maybe Natural) Source #

This option controls the duration in milliseconds after which the s3 listing is likely to be consistent. Files with modification timestamps falling within the last maxBand milliseconds are tracked specially when using JobBookmarks to account for Amazon S3 eventual consistency. Most users don't need to set this option. The default is 900000 milliseconds, or 15 minutes.

s3JsonSource_maxFilesInBand :: Lens' S3JsonSource (Maybe Natural) Source #

This option specifies the maximum number of files to save from the last maxBand seconds. If this number is exceeded, extra files are skipped and only processed in the next job run.

s3JsonSource_multiline :: Lens' S3JsonSource (Maybe Bool) Source #

A Boolean value that specifies whether a single record can span multiple lines. This can occur when a field contains a quoted new-line character. You must set this option to True if any record spans multiple lines. The default value is False, which allows for more aggressive file-splitting during parsing.

s3JsonSource_outputSchemas :: Lens' S3JsonSource (Maybe [GlueSchema]) Source #

Specifies the data schema for the S3 JSON source.

s3JsonSource_recurse :: Lens' S3JsonSource (Maybe Bool) Source #

If set to true, recursively reads files in all subdirectories under the specified paths.

s3JsonSource_name :: Lens' S3JsonSource Text Source #

The name of the data store.

s3JsonSource_paths :: Lens' S3JsonSource [Text] Source #

A list of the Amazon S3 paths to read from.

S3ParquetSource

data S3ParquetSource Source #

Specifies an Apache Parquet data store stored in Amazon S3.

See: newS3ParquetSource smart constructor.

Constructors

S3ParquetSource' 

Fields

  • additionalOptions :: Maybe S3DirectSourceAdditionalOptions

    Specifies additional connection options.

  • compressionType :: Maybe ParquetCompressionType

    Specifies how the data is compressed. This is generally not necessary if the data has a standard file extension. Possible values are "gzip" and "bzip").

  • exclusions :: Maybe [Text]

    A string containing a JSON list of Unix-style glob patterns to exclude. For example, "[\"**.pdf\"]" excludes all PDF files.

  • groupFiles :: Maybe Text

    Grouping files is turned on by default when the input contains more than 50,000 files. To turn on grouping with fewer than 50,000 files, set this parameter to "inPartition". To disable grouping when there are more than 50,000 files, set this parameter to "none".

  • groupSize :: Maybe Text

    The target group size in bytes. The default is computed based on the input data size and the size of your cluster. When there are fewer than 50,000 input files, "groupFiles" must be set to "inPartition" for this to take effect.

  • maxBand :: Maybe Natural

    This option controls the duration in milliseconds after which the s3 listing is likely to be consistent. Files with modification timestamps falling within the last maxBand milliseconds are tracked specially when using JobBookmarks to account for Amazon S3 eventual consistency. Most users don't need to set this option. The default is 900000 milliseconds, or 15 minutes.

  • maxFilesInBand :: Maybe Natural

    This option specifies the maximum number of files to save from the last maxBand seconds. If this number is exceeded, extra files are skipped and only processed in the next job run.

  • outputSchemas :: Maybe [GlueSchema]

    Specifies the data schema for the S3 Parquet source.

  • recurse :: Maybe Bool

    If set to true, recursively reads files in all subdirectories under the specified paths.

  • name :: Text

    The name of the data store.

  • paths :: [Text]

    A list of the Amazon S3 paths to read from.

Instances

Instances details
FromJSON S3ParquetSource Source # 
Instance details

Defined in Amazonka.Glue.Types.S3ParquetSource

ToJSON S3ParquetSource Source # 
Instance details

Defined in Amazonka.Glue.Types.S3ParquetSource

Generic S3ParquetSource Source # 
Instance details

Defined in Amazonka.Glue.Types.S3ParquetSource

Associated Types

type Rep S3ParquetSource :: Type -> Type #

Read S3ParquetSource Source # 
Instance details

Defined in Amazonka.Glue.Types.S3ParquetSource

Show S3ParquetSource Source # 
Instance details

Defined in Amazonka.Glue.Types.S3ParquetSource

NFData S3ParquetSource Source # 
Instance details

Defined in Amazonka.Glue.Types.S3ParquetSource

Methods

rnf :: S3ParquetSource -> () #

Eq S3ParquetSource Source # 
Instance details

Defined in Amazonka.Glue.Types.S3ParquetSource

Hashable S3ParquetSource Source # 
Instance details

Defined in Amazonka.Glue.Types.S3ParquetSource

type Rep S3ParquetSource Source # 
Instance details

Defined in Amazonka.Glue.Types.S3ParquetSource

type Rep S3ParquetSource = D1 ('MetaData "S3ParquetSource" "Amazonka.Glue.Types.S3ParquetSource" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "S3ParquetSource'" 'PrefixI 'True) (((S1 ('MetaSel ('Just "additionalOptions") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe S3DirectSourceAdditionalOptions)) :*: S1 ('MetaSel ('Just "compressionType") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe ParquetCompressionType))) :*: (S1 ('MetaSel ('Just "exclusions") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe [Text])) :*: (S1 ('MetaSel ('Just "groupFiles") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "groupSize") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text))))) :*: ((S1 ('MetaSel ('Just "maxBand") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Natural)) :*: (S1 ('MetaSel ('Just "maxFilesInBand") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Natural)) :*: S1 ('MetaSel ('Just "outputSchemas") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe [GlueSchema])))) :*: (S1 ('MetaSel ('Just "recurse") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Bool)) :*: (S1 ('MetaSel ('Just "name") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text) :*: S1 ('MetaSel ('Just "paths") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 [Text]))))))

newS3ParquetSource Source #

Create a value of S3ParquetSource with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:additionalOptions:S3ParquetSource', s3ParquetSource_additionalOptions - Specifies additional connection options.

$sel:compressionType:S3ParquetSource', s3ParquetSource_compressionType - Specifies how the data is compressed. This is generally not necessary if the data has a standard file extension. Possible values are "gzip" and "bzip").

$sel:exclusions:S3ParquetSource', s3ParquetSource_exclusions - A string containing a JSON list of Unix-style glob patterns to exclude. For example, "[\"**.pdf\"]" excludes all PDF files.

$sel:groupFiles:S3ParquetSource', s3ParquetSource_groupFiles - Grouping files is turned on by default when the input contains more than 50,000 files. To turn on grouping with fewer than 50,000 files, set this parameter to "inPartition". To disable grouping when there are more than 50,000 files, set this parameter to "none".

$sel:groupSize:S3ParquetSource', s3ParquetSource_groupSize - The target group size in bytes. The default is computed based on the input data size and the size of your cluster. When there are fewer than 50,000 input files, "groupFiles" must be set to "inPartition" for this to take effect.

$sel:maxBand:S3ParquetSource', s3ParquetSource_maxBand - This option controls the duration in milliseconds after which the s3 listing is likely to be consistent. Files with modification timestamps falling within the last maxBand milliseconds are tracked specially when using JobBookmarks to account for Amazon S3 eventual consistency. Most users don't need to set this option. The default is 900000 milliseconds, or 15 minutes.

$sel:maxFilesInBand:S3ParquetSource', s3ParquetSource_maxFilesInBand - This option specifies the maximum number of files to save from the last maxBand seconds. If this number is exceeded, extra files are skipped and only processed in the next job run.

$sel:outputSchemas:S3ParquetSource', s3ParquetSource_outputSchemas - Specifies the data schema for the S3 Parquet source.

$sel:recurse:S3ParquetSource', s3ParquetSource_recurse - If set to true, recursively reads files in all subdirectories under the specified paths.

$sel:name:S3ParquetSource', s3ParquetSource_name - The name of the data store.

$sel:paths:S3ParquetSource', s3ParquetSource_paths - A list of the Amazon S3 paths to read from.

s3ParquetSource_compressionType :: Lens' S3ParquetSource (Maybe ParquetCompressionType) Source #

Specifies how the data is compressed. This is generally not necessary if the data has a standard file extension. Possible values are "gzip" and "bzip").

s3ParquetSource_exclusions :: Lens' S3ParquetSource (Maybe [Text]) Source #

A string containing a JSON list of Unix-style glob patterns to exclude. For example, "[\"**.pdf\"]" excludes all PDF files.

s3ParquetSource_groupFiles :: Lens' S3ParquetSource (Maybe Text) Source #

Grouping files is turned on by default when the input contains more than 50,000 files. To turn on grouping with fewer than 50,000 files, set this parameter to "inPartition". To disable grouping when there are more than 50,000 files, set this parameter to "none".

s3ParquetSource_groupSize :: Lens' S3ParquetSource (Maybe Text) Source #

The target group size in bytes. The default is computed based on the input data size and the size of your cluster. When there are fewer than 50,000 input files, "groupFiles" must be set to "inPartition" for this to take effect.

s3ParquetSource_maxBand :: Lens' S3ParquetSource (Maybe Natural) Source #

This option controls the duration in milliseconds after which the s3 listing is likely to be consistent. Files with modification timestamps falling within the last maxBand milliseconds are tracked specially when using JobBookmarks to account for Amazon S3 eventual consistency. Most users don't need to set this option. The default is 900000 milliseconds, or 15 minutes.

s3ParquetSource_maxFilesInBand :: Lens' S3ParquetSource (Maybe Natural) Source #

This option specifies the maximum number of files to save from the last maxBand seconds. If this number is exceeded, extra files are skipped and only processed in the next job run.

s3ParquetSource_outputSchemas :: Lens' S3ParquetSource (Maybe [GlueSchema]) Source #

Specifies the data schema for the S3 Parquet source.

s3ParquetSource_recurse :: Lens' S3ParquetSource (Maybe Bool) Source #

If set to true, recursively reads files in all subdirectories under the specified paths.

s3ParquetSource_name :: Lens' S3ParquetSource Text Source #

The name of the data store.

s3ParquetSource_paths :: Lens' S3ParquetSource [Text] Source #

A list of the Amazon S3 paths to read from.

S3SourceAdditionalOptions

data S3SourceAdditionalOptions Source #

Specifies additional connection options for the Amazon S3 data store.

See: newS3SourceAdditionalOptions smart constructor.

Constructors

S3SourceAdditionalOptions' 

Fields

Instances

Instances details
FromJSON S3SourceAdditionalOptions Source # 
Instance details

Defined in Amazonka.Glue.Types.S3SourceAdditionalOptions

ToJSON S3SourceAdditionalOptions Source # 
Instance details

Defined in Amazonka.Glue.Types.S3SourceAdditionalOptions

Generic S3SourceAdditionalOptions Source # 
Instance details

Defined in Amazonka.Glue.Types.S3SourceAdditionalOptions

Associated Types

type Rep S3SourceAdditionalOptions :: Type -> Type #

Read S3SourceAdditionalOptions Source # 
Instance details

Defined in Amazonka.Glue.Types.S3SourceAdditionalOptions

Show S3SourceAdditionalOptions Source # 
Instance details

Defined in Amazonka.Glue.Types.S3SourceAdditionalOptions

NFData S3SourceAdditionalOptions Source # 
Instance details

Defined in Amazonka.Glue.Types.S3SourceAdditionalOptions

Eq S3SourceAdditionalOptions Source # 
Instance details

Defined in Amazonka.Glue.Types.S3SourceAdditionalOptions

Hashable S3SourceAdditionalOptions Source # 
Instance details

Defined in Amazonka.Glue.Types.S3SourceAdditionalOptions

type Rep S3SourceAdditionalOptions Source # 
Instance details

Defined in Amazonka.Glue.Types.S3SourceAdditionalOptions

type Rep S3SourceAdditionalOptions = D1 ('MetaData "S3SourceAdditionalOptions" "Amazonka.Glue.Types.S3SourceAdditionalOptions" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "S3SourceAdditionalOptions'" 'PrefixI 'True) (S1 ('MetaSel ('Just "boundedFiles") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Integer)) :*: S1 ('MetaSel ('Just "boundedSize") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Integer))))

newS3SourceAdditionalOptions :: S3SourceAdditionalOptions Source #

Create a value of S3SourceAdditionalOptions with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:boundedFiles:S3SourceAdditionalOptions', s3SourceAdditionalOptions_boundedFiles - Sets the upper limit for the target number of files that will be processed.

$sel:boundedSize:S3SourceAdditionalOptions', s3SourceAdditionalOptions_boundedSize - Sets the upper limit for the target size of the dataset in bytes that will be processed.

s3SourceAdditionalOptions_boundedFiles :: Lens' S3SourceAdditionalOptions (Maybe Integer) Source #

Sets the upper limit for the target number of files that will be processed.

s3SourceAdditionalOptions_boundedSize :: Lens' S3SourceAdditionalOptions (Maybe Integer) Source #

Sets the upper limit for the target size of the dataset in bytes that will be processed.

S3Target

data S3Target Source #

Specifies a data store in Amazon Simple Storage Service (Amazon S3).

See: newS3Target smart constructor.

Constructors

S3Target' 

Fields

  • connectionName :: Maybe Text

    The name of a connection which allows a job or crawler to access data in Amazon S3 within an Amazon Virtual Private Cloud environment (Amazon VPC).

  • dlqEventQueueArn :: Maybe Text

    A valid Amazon dead-letter SQS ARN. For example, arn:aws:sqs:region:account:deadLetterQueue.

  • eventQueueArn :: Maybe Text

    A valid Amazon SQS ARN. For example, arn:aws:sqs:region:account:sqs.

  • exclusions :: Maybe [Text]

    A list of glob patterns used to exclude from the crawl. For more information, see Catalog Tables with a Crawler.

  • path :: Maybe Text

    The path to the Amazon S3 target.

  • sampleSize :: Maybe Int

    Sets the number of files in each leaf folder to be crawled when crawling sample files in a dataset. If not set, all the files are crawled. A valid value is an integer between 1 and 249.

Instances

Instances details
FromJSON S3Target Source # 
Instance details

Defined in Amazonka.Glue.Types.S3Target

ToJSON S3Target Source # 
Instance details

Defined in Amazonka.Glue.Types.S3Target

Generic S3Target Source # 
Instance details

Defined in Amazonka.Glue.Types.S3Target

Associated Types

type Rep S3Target :: Type -> Type #

Methods

from :: S3Target -> Rep S3Target x #

to :: Rep S3Target x -> S3Target #

Read S3Target Source # 
Instance details

Defined in Amazonka.Glue.Types.S3Target

Show S3Target Source # 
Instance details

Defined in Amazonka.Glue.Types.S3Target

NFData S3Target Source # 
Instance details

Defined in Amazonka.Glue.Types.S3Target

Methods

rnf :: S3Target -> () #

Eq S3Target Source # 
Instance details

Defined in Amazonka.Glue.Types.S3Target

Hashable S3Target Source # 
Instance details

Defined in Amazonka.Glue.Types.S3Target

Methods

hashWithSalt :: Int -> S3Target -> Int #

hash :: S3Target -> Int #

type Rep S3Target Source # 
Instance details

Defined in Amazonka.Glue.Types.S3Target

type Rep S3Target = D1 ('MetaData "S3Target" "Amazonka.Glue.Types.S3Target" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "S3Target'" 'PrefixI 'True) ((S1 ('MetaSel ('Just "connectionName") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: (S1 ('MetaSel ('Just "dlqEventQueueArn") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "eventQueueArn") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)))) :*: (S1 ('MetaSel ('Just "exclusions") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe [Text])) :*: (S1 ('MetaSel ('Just "path") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "sampleSize") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Int))))))

newS3Target :: S3Target Source #

Create a value of S3Target with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:connectionName:S3Target', s3Target_connectionName - The name of a connection which allows a job or crawler to access data in Amazon S3 within an Amazon Virtual Private Cloud environment (Amazon VPC).

$sel:dlqEventQueueArn:S3Target', s3Target_dlqEventQueueArn - A valid Amazon dead-letter SQS ARN. For example, arn:aws:sqs:region:account:deadLetterQueue.

$sel:eventQueueArn:S3Target', s3Target_eventQueueArn - A valid Amazon SQS ARN. For example, arn:aws:sqs:region:account:sqs.

$sel:exclusions:S3Target', s3Target_exclusions - A list of glob patterns used to exclude from the crawl. For more information, see Catalog Tables with a Crawler.

$sel:path:S3Target', s3Target_path - The path to the Amazon S3 target.

$sel:sampleSize:S3Target', s3Target_sampleSize - Sets the number of files in each leaf folder to be crawled when crawling sample files in a dataset. If not set, all the files are crawled. A valid value is an integer between 1 and 249.

s3Target_connectionName :: Lens' S3Target (Maybe Text) Source #

The name of a connection which allows a job or crawler to access data in Amazon S3 within an Amazon Virtual Private Cloud environment (Amazon VPC).

s3Target_dlqEventQueueArn :: Lens' S3Target (Maybe Text) Source #

A valid Amazon dead-letter SQS ARN. For example, arn:aws:sqs:region:account:deadLetterQueue.

s3Target_eventQueueArn :: Lens' S3Target (Maybe Text) Source #

A valid Amazon SQS ARN. For example, arn:aws:sqs:region:account:sqs.

s3Target_exclusions :: Lens' S3Target (Maybe [Text]) Source #

A list of glob patterns used to exclude from the crawl. For more information, see Catalog Tables with a Crawler.

s3Target_path :: Lens' S3Target (Maybe Text) Source #

The path to the Amazon S3 target.

s3Target_sampleSize :: Lens' S3Target (Maybe Int) Source #

Sets the number of files in each leaf folder to be crawled when crawling sample files in a dataset. If not set, all the files are crawled. A valid value is an integer between 1 and 249.

Schedule

data Schedule Source #

A scheduling object using a cron statement to schedule an event.

See: newSchedule smart constructor.

Constructors

Schedule' 

Fields

Instances

Instances details
FromJSON Schedule Source # 
Instance details

Defined in Amazonka.Glue.Types.Schedule

Generic Schedule Source # 
Instance details

Defined in Amazonka.Glue.Types.Schedule

Associated Types

type Rep Schedule :: Type -> Type #

Methods

from :: Schedule -> Rep Schedule x #

to :: Rep Schedule x -> Schedule #

Read Schedule Source # 
Instance details

Defined in Amazonka.Glue.Types.Schedule

Show Schedule Source # 
Instance details

Defined in Amazonka.Glue.Types.Schedule

NFData Schedule Source # 
Instance details

Defined in Amazonka.Glue.Types.Schedule

Methods

rnf :: Schedule -> () #

Eq Schedule Source # 
Instance details

Defined in Amazonka.Glue.Types.Schedule

Hashable Schedule Source # 
Instance details

Defined in Amazonka.Glue.Types.Schedule

Methods

hashWithSalt :: Int -> Schedule -> Int #

hash :: Schedule -> Int #

type Rep Schedule Source # 
Instance details

Defined in Amazonka.Glue.Types.Schedule

type Rep Schedule = D1 ('MetaData "Schedule" "Amazonka.Glue.Types.Schedule" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "Schedule'" 'PrefixI 'True) (S1 ('MetaSel ('Just "scheduleExpression") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "state") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe ScheduleState))))

newSchedule :: Schedule Source #

Create a value of Schedule with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:scheduleExpression:Schedule', schedule_scheduleExpression - A cron expression used to specify the schedule (see Time-Based Schedules for Jobs and Crawlers. For example, to run something every day at 12:15 UTC, you would specify: cron(15 12 * * ? *).

$sel:state:Schedule', schedule_state - The state of the schedule.

schedule_scheduleExpression :: Lens' Schedule (Maybe Text) Source #

A cron expression used to specify the schedule (see Time-Based Schedules for Jobs and Crawlers. For example, to run something every day at 12:15 UTC, you would specify: cron(15 12 * * ? *).

schedule_state :: Lens' Schedule (Maybe ScheduleState) Source #

The state of the schedule.

SchemaChangePolicy

data SchemaChangePolicy Source #

A policy that specifies update and deletion behaviors for the crawler.

See: newSchemaChangePolicy smart constructor.

Constructors

SchemaChangePolicy' 

Fields

Instances

Instances details
FromJSON SchemaChangePolicy Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaChangePolicy

ToJSON SchemaChangePolicy Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaChangePolicy

Generic SchemaChangePolicy Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaChangePolicy

Associated Types

type Rep SchemaChangePolicy :: Type -> Type #

Read SchemaChangePolicy Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaChangePolicy

Show SchemaChangePolicy Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaChangePolicy

NFData SchemaChangePolicy Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaChangePolicy

Methods

rnf :: SchemaChangePolicy -> () #

Eq SchemaChangePolicy Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaChangePolicy

Hashable SchemaChangePolicy Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaChangePolicy

type Rep SchemaChangePolicy Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaChangePolicy

type Rep SchemaChangePolicy = D1 ('MetaData "SchemaChangePolicy" "Amazonka.Glue.Types.SchemaChangePolicy" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "SchemaChangePolicy'" 'PrefixI 'True) (S1 ('MetaSel ('Just "deleteBehavior") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe DeleteBehavior)) :*: S1 ('MetaSel ('Just "updateBehavior") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe UpdateBehavior))))

newSchemaChangePolicy :: SchemaChangePolicy Source #

Create a value of SchemaChangePolicy with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:deleteBehavior:SchemaChangePolicy', schemaChangePolicy_deleteBehavior - The deletion behavior when the crawler finds a deleted object.

$sel:updateBehavior:SchemaChangePolicy', schemaChangePolicy_updateBehavior - The update behavior when the crawler finds a changed schema.

schemaChangePolicy_deleteBehavior :: Lens' SchemaChangePolicy (Maybe DeleteBehavior) Source #

The deletion behavior when the crawler finds a deleted object.

schemaChangePolicy_updateBehavior :: Lens' SchemaChangePolicy (Maybe UpdateBehavior) Source #

The update behavior when the crawler finds a changed schema.

SchemaColumn

data SchemaColumn Source #

A key-value pair representing a column and data type that this transform can run against. The Schema parameter of the MLTransform may contain up to 100 of these structures.

See: newSchemaColumn smart constructor.

Constructors

SchemaColumn' 

Fields

Instances

Instances details
FromJSON SchemaColumn Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaColumn

ToJSON SchemaColumn Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaColumn

Generic SchemaColumn Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaColumn

Associated Types

type Rep SchemaColumn :: Type -> Type #

Read SchemaColumn Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaColumn

Show SchemaColumn Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaColumn

NFData SchemaColumn Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaColumn

Methods

rnf :: SchemaColumn -> () #

Eq SchemaColumn Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaColumn

Hashable SchemaColumn Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaColumn

type Rep SchemaColumn Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaColumn

type Rep SchemaColumn = D1 ('MetaData "SchemaColumn" "Amazonka.Glue.Types.SchemaColumn" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "SchemaColumn'" 'PrefixI 'True) (S1 ('MetaSel ('Just "dataType") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "name") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text))))

newSchemaColumn :: SchemaColumn Source #

Create a value of SchemaColumn with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:dataType:SchemaColumn', schemaColumn_dataType - The type of data in the column.

$sel:name:SchemaColumn', schemaColumn_name - The name of the column.

schemaColumn_dataType :: Lens' SchemaColumn (Maybe Text) Source #

The type of data in the column.

schemaColumn_name :: Lens' SchemaColumn (Maybe Text) Source #

The name of the column.

SchemaId

data SchemaId Source #

The unique ID of the schema in the Glue schema registry.

See: newSchemaId smart constructor.

Constructors

SchemaId' 

Fields

  • registryName :: Maybe Text

    The name of the schema registry that contains the schema.

  • schemaArn :: Maybe Text

    The Amazon Resource Name (ARN) of the schema. One of SchemaArn or SchemaName has to be provided.

  • schemaName :: Maybe Text

    The name of the schema. One of SchemaArn or SchemaName has to be provided.

Instances

Instances details
FromJSON SchemaId Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaId

ToJSON SchemaId Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaId

Generic SchemaId Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaId

Associated Types

type Rep SchemaId :: Type -> Type #

Methods

from :: SchemaId -> Rep SchemaId x #

to :: Rep SchemaId x -> SchemaId #

Read SchemaId Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaId

Show SchemaId Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaId

NFData SchemaId Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaId

Methods

rnf :: SchemaId -> () #

Eq SchemaId Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaId

Hashable SchemaId Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaId

Methods

hashWithSalt :: Int -> SchemaId -> Int #

hash :: SchemaId -> Int #

type Rep SchemaId Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaId

type Rep SchemaId = D1 ('MetaData "SchemaId" "Amazonka.Glue.Types.SchemaId" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "SchemaId'" 'PrefixI 'True) (S1 ('MetaSel ('Just "registryName") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: (S1 ('MetaSel ('Just "schemaArn") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "schemaName") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)))))

newSchemaId :: SchemaId Source #

Create a value of SchemaId with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:registryName:SchemaId', schemaId_registryName - The name of the schema registry that contains the schema.

$sel:schemaArn:SchemaId', schemaId_schemaArn - The Amazon Resource Name (ARN) of the schema. One of SchemaArn or SchemaName has to be provided.

$sel:schemaName:SchemaId', schemaId_schemaName - The name of the schema. One of SchemaArn or SchemaName has to be provided.

schemaId_registryName :: Lens' SchemaId (Maybe Text) Source #

The name of the schema registry that contains the schema.

schemaId_schemaArn :: Lens' SchemaId (Maybe Text) Source #

The Amazon Resource Name (ARN) of the schema. One of SchemaArn or SchemaName has to be provided.

schemaId_schemaName :: Lens' SchemaId (Maybe Text) Source #

The name of the schema. One of SchemaArn or SchemaName has to be provided.

SchemaListItem

data SchemaListItem Source #

An object that contains minimal details for a schema.

See: newSchemaListItem smart constructor.

Constructors

SchemaListItem' 

Fields

Instances

Instances details
FromJSON SchemaListItem Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaListItem

Generic SchemaListItem Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaListItem

Associated Types

type Rep SchemaListItem :: Type -> Type #

Read SchemaListItem Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaListItem

Show SchemaListItem Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaListItem

NFData SchemaListItem Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaListItem

Methods

rnf :: SchemaListItem -> () #

Eq SchemaListItem Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaListItem

Hashable SchemaListItem Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaListItem

type Rep SchemaListItem Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaListItem

newSchemaListItem :: SchemaListItem Source #

Create a value of SchemaListItem with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:createdTime:SchemaListItem', schemaListItem_createdTime - The date and time that a schema was created.

$sel:description:SchemaListItem', schemaListItem_description - A description for the schema.

$sel:registryName:SchemaListItem', schemaListItem_registryName - the name of the registry where the schema resides.

$sel:schemaArn:SchemaListItem', schemaListItem_schemaArn - The Amazon Resource Name (ARN) for the schema.

$sel:schemaName:SchemaListItem', schemaListItem_schemaName - The name of the schema.

$sel:schemaStatus:SchemaListItem', schemaListItem_schemaStatus - The status of the schema.

$sel:updatedTime:SchemaListItem', schemaListItem_updatedTime - The date and time that a schema was updated.

schemaListItem_createdTime :: Lens' SchemaListItem (Maybe Text) Source #

The date and time that a schema was created.

schemaListItem_registryName :: Lens' SchemaListItem (Maybe Text) Source #

the name of the registry where the schema resides.

schemaListItem_schemaArn :: Lens' SchemaListItem (Maybe Text) Source #

The Amazon Resource Name (ARN) for the schema.

schemaListItem_updatedTime :: Lens' SchemaListItem (Maybe Text) Source #

The date and time that a schema was updated.

SchemaReference

data SchemaReference Source #

An object that references a schema stored in the Glue Schema Registry.

See: newSchemaReference smart constructor.

Constructors

SchemaReference' 

Fields

Instances

Instances details
FromJSON SchemaReference Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaReference

ToJSON SchemaReference Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaReference

Generic SchemaReference Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaReference

Associated Types

type Rep SchemaReference :: Type -> Type #

Read SchemaReference Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaReference

Show SchemaReference Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaReference

NFData SchemaReference Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaReference

Methods

rnf :: SchemaReference -> () #

Eq SchemaReference Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaReference

Hashable SchemaReference Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaReference

type Rep SchemaReference Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaReference

type Rep SchemaReference = D1 ('MetaData "SchemaReference" "Amazonka.Glue.Types.SchemaReference" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "SchemaReference'" 'PrefixI 'True) (S1 ('MetaSel ('Just "schemaId") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe SchemaId)) :*: (S1 ('MetaSel ('Just "schemaVersionId") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "schemaVersionNumber") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Natural)))))

newSchemaReference :: SchemaReference Source #

Create a value of SchemaReference with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:schemaId:SchemaReference', schemaReference_schemaId - A structure that contains schema identity fields. Either this or the SchemaVersionId has to be provided.

$sel:schemaVersionId:SchemaReference', schemaReference_schemaVersionId - The unique ID assigned to a version of the schema. Either this or the SchemaId has to be provided.

$sel:schemaVersionNumber:SchemaReference', schemaReference_schemaVersionNumber - The version number of the schema.

schemaReference_schemaId :: Lens' SchemaReference (Maybe SchemaId) Source #

A structure that contains schema identity fields. Either this or the SchemaVersionId has to be provided.

schemaReference_schemaVersionId :: Lens' SchemaReference (Maybe Text) Source #

The unique ID assigned to a version of the schema. Either this or the SchemaId has to be provided.

SchemaVersionErrorItem

data SchemaVersionErrorItem Source #

An object that contains the error details for an operation on a schema version.

See: newSchemaVersionErrorItem smart constructor.

Constructors

SchemaVersionErrorItem' 

Fields

Instances

Instances details
FromJSON SchemaVersionErrorItem Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaVersionErrorItem

Generic SchemaVersionErrorItem Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaVersionErrorItem

Associated Types

type Rep SchemaVersionErrorItem :: Type -> Type #

Read SchemaVersionErrorItem Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaVersionErrorItem

Show SchemaVersionErrorItem Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaVersionErrorItem

NFData SchemaVersionErrorItem Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaVersionErrorItem

Methods

rnf :: SchemaVersionErrorItem -> () #

Eq SchemaVersionErrorItem Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaVersionErrorItem

Hashable SchemaVersionErrorItem Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaVersionErrorItem

type Rep SchemaVersionErrorItem Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaVersionErrorItem

type Rep SchemaVersionErrorItem = D1 ('MetaData "SchemaVersionErrorItem" "Amazonka.Glue.Types.SchemaVersionErrorItem" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "SchemaVersionErrorItem'" 'PrefixI 'True) (S1 ('MetaSel ('Just "errorDetails") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe ErrorDetails)) :*: S1 ('MetaSel ('Just "versionNumber") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Natural))))

newSchemaVersionErrorItem :: SchemaVersionErrorItem Source #

Create a value of SchemaVersionErrorItem with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:errorDetails:SchemaVersionErrorItem', schemaVersionErrorItem_errorDetails - The details of the error for the schema version.

$sel:versionNumber:SchemaVersionErrorItem', schemaVersionErrorItem_versionNumber - The version number of the schema.

schemaVersionErrorItem_errorDetails :: Lens' SchemaVersionErrorItem (Maybe ErrorDetails) Source #

The details of the error for the schema version.

SchemaVersionListItem

data SchemaVersionListItem Source #

An object containing the details about a schema version.

See: newSchemaVersionListItem smart constructor.

Constructors

SchemaVersionListItem' 

Fields

Instances

Instances details
FromJSON SchemaVersionListItem Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaVersionListItem

Generic SchemaVersionListItem Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaVersionListItem

Associated Types

type Rep SchemaVersionListItem :: Type -> Type #

Read SchemaVersionListItem Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaVersionListItem

Show SchemaVersionListItem Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaVersionListItem

NFData SchemaVersionListItem Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaVersionListItem

Methods

rnf :: SchemaVersionListItem -> () #

Eq SchemaVersionListItem Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaVersionListItem

Hashable SchemaVersionListItem Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaVersionListItem

type Rep SchemaVersionListItem Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaVersionListItem

type Rep SchemaVersionListItem = D1 ('MetaData "SchemaVersionListItem" "Amazonka.Glue.Types.SchemaVersionListItem" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "SchemaVersionListItem'" 'PrefixI 'True) ((S1 ('MetaSel ('Just "createdTime") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "schemaArn") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text))) :*: (S1 ('MetaSel ('Just "schemaVersionId") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: (S1 ('MetaSel ('Just "status") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe SchemaVersionStatus)) :*: S1 ('MetaSel ('Just "versionNumber") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Natural))))))

newSchemaVersionListItem :: SchemaVersionListItem Source #

Create a value of SchemaVersionListItem with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:createdTime:SchemaVersionListItem', schemaVersionListItem_createdTime - The date and time the schema version was created.

$sel:schemaArn:SchemaVersionListItem', schemaVersionListItem_schemaArn - The Amazon Resource Name (ARN) of the schema.

$sel:schemaVersionId:SchemaVersionListItem', schemaVersionListItem_schemaVersionId - The unique identifier of the schema version.

$sel:status:SchemaVersionListItem', schemaVersionListItem_status - The status of the schema version.

$sel:versionNumber:SchemaVersionListItem', schemaVersionListItem_versionNumber - The version number of the schema.

schemaVersionListItem_createdTime :: Lens' SchemaVersionListItem (Maybe Text) Source #

The date and time the schema version was created.

schemaVersionListItem_schemaArn :: Lens' SchemaVersionListItem (Maybe Text) Source #

The Amazon Resource Name (ARN) of the schema.

schemaVersionListItem_schemaVersionId :: Lens' SchemaVersionListItem (Maybe Text) Source #

The unique identifier of the schema version.

SchemaVersionNumber

data SchemaVersionNumber Source #

A structure containing the schema version information.

See: newSchemaVersionNumber smart constructor.

Constructors

SchemaVersionNumber' 

Fields

Instances

Instances details
ToJSON SchemaVersionNumber Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaVersionNumber

Generic SchemaVersionNumber Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaVersionNumber

Associated Types

type Rep SchemaVersionNumber :: Type -> Type #

Read SchemaVersionNumber Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaVersionNumber

Show SchemaVersionNumber Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaVersionNumber

NFData SchemaVersionNumber Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaVersionNumber

Methods

rnf :: SchemaVersionNumber -> () #

Eq SchemaVersionNumber Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaVersionNumber

Hashable SchemaVersionNumber Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaVersionNumber

type Rep SchemaVersionNumber Source # 
Instance details

Defined in Amazonka.Glue.Types.SchemaVersionNumber

type Rep SchemaVersionNumber = D1 ('MetaData "SchemaVersionNumber" "Amazonka.Glue.Types.SchemaVersionNumber" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "SchemaVersionNumber'" 'PrefixI 'True) (S1 ('MetaSel ('Just "latestVersion") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Bool)) :*: S1 ('MetaSel ('Just "versionNumber") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Natural))))

newSchemaVersionNumber :: SchemaVersionNumber Source #

Create a value of SchemaVersionNumber with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:latestVersion:SchemaVersionNumber', schemaVersionNumber_latestVersion - The latest version available for the schema.

$sel:versionNumber:SchemaVersionNumber', schemaVersionNumber_versionNumber - The version number of the schema.

schemaVersionNumber_latestVersion :: Lens' SchemaVersionNumber (Maybe Bool) Source #

The latest version available for the schema.

SecurityConfiguration

data SecurityConfiguration Source #

Specifies a security configuration.

See: newSecurityConfiguration smart constructor.

Constructors

SecurityConfiguration' 

Fields

Instances

Instances details
FromJSON SecurityConfiguration Source # 
Instance details

Defined in Amazonka.Glue.Types.SecurityConfiguration

Generic SecurityConfiguration Source # 
Instance details

Defined in Amazonka.Glue.Types.SecurityConfiguration

Associated Types

type Rep SecurityConfiguration :: Type -> Type #

Read SecurityConfiguration Source # 
Instance details

Defined in Amazonka.Glue.Types.SecurityConfiguration

Show SecurityConfiguration Source # 
Instance details

Defined in Amazonka.Glue.Types.SecurityConfiguration

NFData SecurityConfiguration Source # 
Instance details

Defined in Amazonka.Glue.Types.SecurityConfiguration

Methods

rnf :: SecurityConfiguration -> () #

Eq SecurityConfiguration Source # 
Instance details

Defined in Amazonka.Glue.Types.SecurityConfiguration

Hashable SecurityConfiguration Source # 
Instance details

Defined in Amazonka.Glue.Types.SecurityConfiguration

type Rep SecurityConfiguration Source # 
Instance details

Defined in Amazonka.Glue.Types.SecurityConfiguration

type Rep SecurityConfiguration = D1 ('MetaData "SecurityConfiguration" "Amazonka.Glue.Types.SecurityConfiguration" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "SecurityConfiguration'" 'PrefixI 'True) (S1 ('MetaSel ('Just "createdTimeStamp") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe POSIX)) :*: (S1 ('MetaSel ('Just "encryptionConfiguration") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe EncryptionConfiguration)) :*: S1 ('MetaSel ('Just "name") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)))))

newSecurityConfiguration :: SecurityConfiguration Source #

Create a value of SecurityConfiguration with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:createdTimeStamp:SecurityConfiguration', securityConfiguration_createdTimeStamp - The time at which this security configuration was created.

$sel:encryptionConfiguration:SecurityConfiguration', securityConfiguration_encryptionConfiguration - The encryption configuration associated with this security configuration.

$sel:name:SecurityConfiguration', securityConfiguration_name - The name of the security configuration.

securityConfiguration_createdTimeStamp :: Lens' SecurityConfiguration (Maybe UTCTime) Source #

The time at which this security configuration was created.

securityConfiguration_encryptionConfiguration :: Lens' SecurityConfiguration (Maybe EncryptionConfiguration) Source #

The encryption configuration associated with this security configuration.

securityConfiguration_name :: Lens' SecurityConfiguration (Maybe Text) Source #

The name of the security configuration.

Segment

data Segment Source #

Defines a non-overlapping region of a table's partitions, allowing multiple requests to be run in parallel.

See: newSegment smart constructor.

Constructors

Segment' 

Fields

  • segmentNumber :: Natural

    The zero-based index number of the segment. For example, if the total number of segments is 4, SegmentNumber values range from 0 through 3.

  • totalSegments :: Natural

    The total number of segments.

Instances

Instances details
ToJSON Segment Source # 
Instance details

Defined in Amazonka.Glue.Types.Segment

Generic Segment Source # 
Instance details

Defined in Amazonka.Glue.Types.Segment

Associated Types

type Rep Segment :: Type -> Type #

Methods

from :: Segment -> Rep Segment x #

to :: Rep Segment x -> Segment #

Read Segment Source # 
Instance details

Defined in Amazonka.Glue.Types.Segment

Show Segment Source # 
Instance details

Defined in Amazonka.Glue.Types.Segment

NFData Segment Source # 
Instance details

Defined in Amazonka.Glue.Types.Segment

Methods

rnf :: Segment -> () #

Eq Segment Source # 
Instance details

Defined in Amazonka.Glue.Types.Segment

Methods

(==) :: Segment -> Segment -> Bool #

(/=) :: Segment -> Segment -> Bool #

Hashable Segment Source # 
Instance details

Defined in Amazonka.Glue.Types.Segment

Methods

hashWithSalt :: Int -> Segment -> Int #

hash :: Segment -> Int #

type Rep Segment Source # 
Instance details

Defined in Amazonka.Glue.Types.Segment

type Rep Segment = D1 ('MetaData "Segment" "Amazonka.Glue.Types.Segment" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "Segment'" 'PrefixI 'True) (S1 ('MetaSel ('Just "segmentNumber") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Natural) :*: S1 ('MetaSel ('Just "totalSegments") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Natural)))

newSegment Source #

Create a value of Segment with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:segmentNumber:Segment', segment_segmentNumber - The zero-based index number of the segment. For example, if the total number of segments is 4, SegmentNumber values range from 0 through 3.

$sel:totalSegments:Segment', segment_totalSegments - The total number of segments.

segment_segmentNumber :: Lens' Segment Natural Source #

The zero-based index number of the segment. For example, if the total number of segments is 4, SegmentNumber values range from 0 through 3.

segment_totalSegments :: Lens' Segment Natural Source #

The total number of segments.

SelectFields

data SelectFields Source #

Specifies a transform that chooses the data property keys that you want to keep.

See: newSelectFields smart constructor.

Constructors

SelectFields' 

Fields

  • name :: Text

    The name of the transform node.

  • inputs :: NonEmpty Text

    The data inputs identified by their node names.

  • paths :: [[Text]]

    A JSON path to a variable in the data structure.

Instances

Instances details
FromJSON SelectFields Source # 
Instance details

Defined in Amazonka.Glue.Types.SelectFields

ToJSON SelectFields Source # 
Instance details

Defined in Amazonka.Glue.Types.SelectFields

Generic SelectFields Source # 
Instance details

Defined in Amazonka.Glue.Types.SelectFields

Associated Types

type Rep SelectFields :: Type -> Type #

Read SelectFields Source # 
Instance details

Defined in Amazonka.Glue.Types.SelectFields

Show SelectFields Source # 
Instance details

Defined in Amazonka.Glue.Types.SelectFields

NFData SelectFields Source # 
Instance details

Defined in Amazonka.Glue.Types.SelectFields

Methods

rnf :: SelectFields -> () #

Eq SelectFields Source # 
Instance details

Defined in Amazonka.Glue.Types.SelectFields

Hashable SelectFields Source # 
Instance details

Defined in Amazonka.Glue.Types.SelectFields

type Rep SelectFields Source # 
Instance details

Defined in Amazonka.Glue.Types.SelectFields

type Rep SelectFields = D1 ('MetaData "SelectFields" "Amazonka.Glue.Types.SelectFields" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "SelectFields'" 'PrefixI 'True) (S1 ('MetaSel ('Just "name") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text) :*: (S1 ('MetaSel ('Just "inputs") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (NonEmpty Text)) :*: S1 ('MetaSel ('Just "paths") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 [[Text]]))))

newSelectFields Source #

Create a value of SelectFields with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:name:SelectFields', selectFields_name - The name of the transform node.

$sel:inputs:SelectFields', selectFields_inputs - The data inputs identified by their node names.

$sel:paths:SelectFields', selectFields_paths - A JSON path to a variable in the data structure.

selectFields_name :: Lens' SelectFields Text Source #

The name of the transform node.

selectFields_inputs :: Lens' SelectFields (NonEmpty Text) Source #

The data inputs identified by their node names.

selectFields_paths :: Lens' SelectFields [[Text]] Source #

A JSON path to a variable in the data structure.

SelectFromCollection

data SelectFromCollection Source #

Specifies a transform that chooses one DynamicFrame from a collection of DynamicFrames. The output is the selected DynamicFrame

See: newSelectFromCollection smart constructor.

Constructors

SelectFromCollection' 

Fields

Instances

Instances details
FromJSON SelectFromCollection Source # 
Instance details

Defined in Amazonka.Glue.Types.SelectFromCollection

ToJSON SelectFromCollection Source # 
Instance details

Defined in Amazonka.Glue.Types.SelectFromCollection

Generic SelectFromCollection Source # 
Instance details

Defined in Amazonka.Glue.Types.SelectFromCollection

Associated Types

type Rep SelectFromCollection :: Type -> Type #

Read SelectFromCollection Source # 
Instance details

Defined in Amazonka.Glue.Types.SelectFromCollection

Show SelectFromCollection Source # 
Instance details

Defined in Amazonka.Glue.Types.SelectFromCollection

NFData SelectFromCollection Source # 
Instance details

Defined in Amazonka.Glue.Types.SelectFromCollection

Methods

rnf :: SelectFromCollection -> () #

Eq SelectFromCollection Source # 
Instance details

Defined in Amazonka.Glue.Types.SelectFromCollection

Hashable SelectFromCollection Source # 
Instance details

Defined in Amazonka.Glue.Types.SelectFromCollection

type Rep SelectFromCollection Source # 
Instance details

Defined in Amazonka.Glue.Types.SelectFromCollection

type Rep SelectFromCollection = D1 ('MetaData "SelectFromCollection" "Amazonka.Glue.Types.SelectFromCollection" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "SelectFromCollection'" 'PrefixI 'True) (S1 ('MetaSel ('Just "name") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text) :*: (S1 ('MetaSel ('Just "inputs") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (NonEmpty Text)) :*: S1 ('MetaSel ('Just "index") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Natural))))

newSelectFromCollection Source #

Create a value of SelectFromCollection with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:name:SelectFromCollection', selectFromCollection_name - The name of the transform node.

$sel:inputs:SelectFromCollection', selectFromCollection_inputs - The data inputs identified by their node names.

$sel:index:SelectFromCollection', selectFromCollection_index - The index for the DynamicFrame to be selected.

selectFromCollection_inputs :: Lens' SelectFromCollection (NonEmpty Text) Source #

The data inputs identified by their node names.

selectFromCollection_index :: Lens' SelectFromCollection Natural Source #

The index for the DynamicFrame to be selected.

SerDeInfo

data SerDeInfo Source #

Information about a serialization/deserialization program (SerDe) that serves as an extractor and loader.

See: newSerDeInfo smart constructor.

Constructors

SerDeInfo' 

Fields

Instances

Instances details
FromJSON SerDeInfo Source # 
Instance details

Defined in Amazonka.Glue.Types.SerDeInfo

ToJSON SerDeInfo Source # 
Instance details

Defined in Amazonka.Glue.Types.SerDeInfo

Generic SerDeInfo Source # 
Instance details

Defined in Amazonka.Glue.Types.SerDeInfo

Associated Types

type Rep SerDeInfo :: Type -> Type #

Read SerDeInfo Source # 
Instance details

Defined in Amazonka.Glue.Types.SerDeInfo

Show SerDeInfo Source # 
Instance details

Defined in Amazonka.Glue.Types.SerDeInfo

NFData SerDeInfo Source # 
Instance details

Defined in Amazonka.Glue.Types.SerDeInfo

Methods

rnf :: SerDeInfo -> () #

Eq SerDeInfo Source # 
Instance details

Defined in Amazonka.Glue.Types.SerDeInfo

Hashable SerDeInfo Source # 
Instance details

Defined in Amazonka.Glue.Types.SerDeInfo

type Rep SerDeInfo Source # 
Instance details

Defined in Amazonka.Glue.Types.SerDeInfo

type Rep SerDeInfo = D1 ('MetaData "SerDeInfo" "Amazonka.Glue.Types.SerDeInfo" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "SerDeInfo'" 'PrefixI 'True) (S1 ('MetaSel ('Just "name") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: (S1 ('MetaSel ('Just "parameters") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe (HashMap Text Text))) :*: S1 ('MetaSel ('Just "serializationLibrary") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)))))

newSerDeInfo :: SerDeInfo Source #

Create a value of SerDeInfo with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:name:SerDeInfo', serDeInfo_name - Name of the SerDe.

$sel:parameters:SerDeInfo', serDeInfo_parameters - These key-value pairs define initialization parameters for the SerDe.

$sel:serializationLibrary:SerDeInfo', serDeInfo_serializationLibrary - Usually the class that implements the SerDe. An example is org.apache.hadoop.hive.serde2.columnar.ColumnarSerDe.

serDeInfo_parameters :: Lens' SerDeInfo (Maybe (HashMap Text Text)) Source #

These key-value pairs define initialization parameters for the SerDe.

serDeInfo_serializationLibrary :: Lens' SerDeInfo (Maybe Text) Source #

Usually the class that implements the SerDe. An example is org.apache.hadoop.hive.serde2.columnar.ColumnarSerDe.

Session

data Session Source #

The period in which a remote Spark runtime environment is running.

See: newSession smart constructor.

Constructors

Session' 

Fields

Instances

Instances details
FromJSON Session Source # 
Instance details

Defined in Amazonka.Glue.Types.Session

Generic Session Source # 
Instance details

Defined in Amazonka.Glue.Types.Session

Associated Types

type Rep Session :: Type -> Type #

Methods

from :: Session -> Rep Session x #

to :: Rep Session x -> Session #

Read Session Source # 
Instance details

Defined in Amazonka.Glue.Types.Session

Show Session Source # 
Instance details

Defined in Amazonka.Glue.Types.Session

NFData Session Source # 
Instance details

Defined in Amazonka.Glue.Types.Session

Methods

rnf :: Session -> () #

Eq Session Source # 
Instance details

Defined in Amazonka.Glue.Types.Session

Methods

(==) :: Session -> Session -> Bool #

(/=) :: Session -> Session -> Bool #

Hashable Session Source # 
Instance details

Defined in Amazonka.Glue.Types.Session

Methods

hashWithSalt :: Int -> Session -> Int #

hash :: Session -> Int #

type Rep Session Source # 
Instance details

Defined in Amazonka.Glue.Types.Session

type Rep Session = D1 ('MetaData "Session" "Amazonka.Glue.Types.Session" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "Session'" 'PrefixI 'True) (((S1 ('MetaSel ('Just "command") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe SessionCommand)) :*: (S1 ('MetaSel ('Just "connections") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe ConnectionsList)) :*: S1 ('MetaSel ('Just "createdOn") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe POSIX)))) :*: (S1 ('MetaSel ('Just "defaultArguments") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe (HashMap Text Text))) :*: (S1 ('MetaSel ('Just "description") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "errorMessage") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text))))) :*: ((S1 ('MetaSel ('Just "glueVersion") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: (S1 ('MetaSel ('Just "id") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "maxCapacity") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Double)))) :*: ((S1 ('MetaSel ('Just "progress") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Double)) :*: S1 ('MetaSel ('Just "role'") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text))) :*: (S1 ('MetaSel ('Just "securityConfiguration") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "status") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe SessionStatus)))))))

newSession :: Session Source #

Create a value of Session with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:command:Session', session_command - The command object.See SessionCommand.

Session, session_connections - The number of connections used for the session.

$sel:createdOn:Session', session_createdOn - The time and date when the session was created.

$sel:defaultArguments:Session', session_defaultArguments - A map array of key-value pairs. Max is 75 pairs.

$sel:description:Session', session_description - The description of the session.

$sel:errorMessage:Session', session_errorMessage - The error message displayed during the session.

$sel:glueVersion:Session', session_glueVersion - The Glue version determines the versions of Apache Spark and Python that Glue supports. The GlueVersion must be greater than 2.0.

$sel:id:Session', session_id - The ID of the session.

$sel:maxCapacity:Session', session_maxCapacity - The number of Glue data processing units (DPUs) that can be allocated when the job runs. A DPU is a relative measure of processing power that consists of 4 vCPUs of compute capacity and 16 GB memory.

$sel:progress:Session', session_progress - The code execution progress of the session.

$sel:role':Session', session_role - The name or Amazon Resource Name (ARN) of the IAM role associated with the Session.

$sel:securityConfiguration:Session', session_securityConfiguration - The name of the SecurityConfiguration structure to be used with the session.

$sel:status:Session', session_status - The session status.

session_command :: Lens' Session (Maybe SessionCommand) Source #

The command object.See SessionCommand.

session_connections :: Lens' Session (Maybe ConnectionsList) Source #

The number of connections used for the session.

session_createdOn :: Lens' Session (Maybe UTCTime) Source #

The time and date when the session was created.

session_defaultArguments :: Lens' Session (Maybe (HashMap Text Text)) Source #

A map array of key-value pairs. Max is 75 pairs.

session_description :: Lens' Session (Maybe Text) Source #

The description of the session.

session_errorMessage :: Lens' Session (Maybe Text) Source #

The error message displayed during the session.

session_glueVersion :: Lens' Session (Maybe Text) Source #

The Glue version determines the versions of Apache Spark and Python that Glue supports. The GlueVersion must be greater than 2.0.

session_id :: Lens' Session (Maybe Text) Source #

The ID of the session.

session_maxCapacity :: Lens' Session (Maybe Double) Source #

The number of Glue data processing units (DPUs) that can be allocated when the job runs. A DPU is a relative measure of processing power that consists of 4 vCPUs of compute capacity and 16 GB memory.

session_progress :: Lens' Session (Maybe Double) Source #

The code execution progress of the session.

session_role :: Lens' Session (Maybe Text) Source #

The name or Amazon Resource Name (ARN) of the IAM role associated with the Session.

session_securityConfiguration :: Lens' Session (Maybe Text) Source #

The name of the SecurityConfiguration structure to be used with the session.

SessionCommand

data SessionCommand Source #

The SessionCommand that runs the job.

See: newSessionCommand smart constructor.

Constructors

SessionCommand' 

Fields

  • name :: Maybe Text

    Specifies the name of the SessionCommand. Can be 'glueetl' or 'gluestreaming'.

  • pythonVersion :: Maybe Text

    Specifies the Python version. The Python version indicates the version supported for jobs of type Spark.

Instances

Instances details
FromJSON SessionCommand Source # 
Instance details

Defined in Amazonka.Glue.Types.SessionCommand

ToJSON SessionCommand Source # 
Instance details

Defined in Amazonka.Glue.Types.SessionCommand

Generic SessionCommand Source # 
Instance details

Defined in Amazonka.Glue.Types.SessionCommand

Associated Types

type Rep SessionCommand :: Type -> Type #

Read SessionCommand Source # 
Instance details

Defined in Amazonka.Glue.Types.SessionCommand

Show SessionCommand Source # 
Instance details

Defined in Amazonka.Glue.Types.SessionCommand

NFData SessionCommand Source # 
Instance details

Defined in Amazonka.Glue.Types.SessionCommand

Methods

rnf :: SessionCommand -> () #

Eq SessionCommand Source # 
Instance details

Defined in Amazonka.Glue.Types.SessionCommand

Hashable SessionCommand Source # 
Instance details

Defined in Amazonka.Glue.Types.SessionCommand

type Rep SessionCommand Source # 
Instance details

Defined in Amazonka.Glue.Types.SessionCommand

type Rep SessionCommand = D1 ('MetaData "SessionCommand" "Amazonka.Glue.Types.SessionCommand" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "SessionCommand'" 'PrefixI 'True) (S1 ('MetaSel ('Just "name") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "pythonVersion") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text))))

newSessionCommand :: SessionCommand Source #

Create a value of SessionCommand with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:name:SessionCommand', sessionCommand_name - Specifies the name of the SessionCommand. Can be 'glueetl' or 'gluestreaming'.

$sel:pythonVersion:SessionCommand', sessionCommand_pythonVersion - Specifies the Python version. The Python version indicates the version supported for jobs of type Spark.

sessionCommand_name :: Lens' SessionCommand (Maybe Text) Source #

Specifies the name of the SessionCommand. Can be 'glueetl' or 'gluestreaming'.

sessionCommand_pythonVersion :: Lens' SessionCommand (Maybe Text) Source #

Specifies the Python version. The Python version indicates the version supported for jobs of type Spark.

SkewedInfo

data SkewedInfo Source #

Specifies skewed values in a table. Skewed values are those that occur with very high frequency.

See: newSkewedInfo smart constructor.

Constructors

SkewedInfo' 

Fields

Instances

Instances details
FromJSON SkewedInfo Source # 
Instance details

Defined in Amazonka.Glue.Types.SkewedInfo

ToJSON SkewedInfo Source # 
Instance details

Defined in Amazonka.Glue.Types.SkewedInfo

Generic SkewedInfo Source # 
Instance details

Defined in Amazonka.Glue.Types.SkewedInfo

Associated Types

type Rep SkewedInfo :: Type -> Type #

Read SkewedInfo Source # 
Instance details

Defined in Amazonka.Glue.Types.SkewedInfo

Show SkewedInfo Source # 
Instance details

Defined in Amazonka.Glue.Types.SkewedInfo

NFData SkewedInfo Source # 
Instance details

Defined in Amazonka.Glue.Types.SkewedInfo

Methods

rnf :: SkewedInfo -> () #

Eq SkewedInfo Source # 
Instance details

Defined in Amazonka.Glue.Types.SkewedInfo

Hashable SkewedInfo Source # 
Instance details

Defined in Amazonka.Glue.Types.SkewedInfo

type Rep SkewedInfo Source # 
Instance details

Defined in Amazonka.Glue.Types.SkewedInfo

type Rep SkewedInfo = D1 ('MetaData "SkewedInfo" "Amazonka.Glue.Types.SkewedInfo" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "SkewedInfo'" 'PrefixI 'True) (S1 ('MetaSel ('Just "skewedColumnNames") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe [Text])) :*: (S1 ('MetaSel ('Just "skewedColumnValueLocationMaps") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe (HashMap Text Text))) :*: S1 ('MetaSel ('Just "skewedColumnValues") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe [Text])))))

newSkewedInfo :: SkewedInfo Source #

Create a value of SkewedInfo with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:skewedColumnNames:SkewedInfo', skewedInfo_skewedColumnNames - A list of names of columns that contain skewed values.

$sel:skewedColumnValueLocationMaps:SkewedInfo', skewedInfo_skewedColumnValueLocationMaps - A mapping of skewed values to the columns that contain them.

$sel:skewedColumnValues:SkewedInfo', skewedInfo_skewedColumnValues - A list of values that appear so frequently as to be considered skewed.

skewedInfo_skewedColumnNames :: Lens' SkewedInfo (Maybe [Text]) Source #

A list of names of columns that contain skewed values.

skewedInfo_skewedColumnValueLocationMaps :: Lens' SkewedInfo (Maybe (HashMap Text Text)) Source #

A mapping of skewed values to the columns that contain them.

skewedInfo_skewedColumnValues :: Lens' SkewedInfo (Maybe [Text]) Source #

A list of values that appear so frequently as to be considered skewed.

SortCriterion

data SortCriterion Source #

Specifies a field to sort by and a sort order.

See: newSortCriterion smart constructor.

Constructors

SortCriterion' 

Fields

Instances

Instances details
ToJSON SortCriterion Source # 
Instance details

Defined in Amazonka.Glue.Types.SortCriterion

Generic SortCriterion Source # 
Instance details

Defined in Amazonka.Glue.Types.SortCriterion

Associated Types

type Rep SortCriterion :: Type -> Type #

Read SortCriterion Source # 
Instance details

Defined in Amazonka.Glue.Types.SortCriterion

Show SortCriterion Source # 
Instance details

Defined in Amazonka.Glue.Types.SortCriterion

NFData SortCriterion Source # 
Instance details

Defined in Amazonka.Glue.Types.SortCriterion

Methods

rnf :: SortCriterion -> () #

Eq SortCriterion Source # 
Instance details

Defined in Amazonka.Glue.Types.SortCriterion

Hashable SortCriterion Source # 
Instance details

Defined in Amazonka.Glue.Types.SortCriterion

type Rep SortCriterion Source # 
Instance details

Defined in Amazonka.Glue.Types.SortCriterion

type Rep SortCriterion = D1 ('MetaData "SortCriterion" "Amazonka.Glue.Types.SortCriterion" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "SortCriterion'" 'PrefixI 'True) (S1 ('MetaSel ('Just "fieldName") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "sort") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Sort))))

newSortCriterion :: SortCriterion Source #

Create a value of SortCriterion with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:fieldName:SortCriterion', sortCriterion_fieldName - The name of the field on which to sort.

$sel:sort:SortCriterion', sortCriterion_sort - An ascending or descending sort.

sortCriterion_fieldName :: Lens' SortCriterion (Maybe Text) Source #

The name of the field on which to sort.

sortCriterion_sort :: Lens' SortCriterion (Maybe Sort) Source #

An ascending or descending sort.

SourceControlDetails

data SourceControlDetails Source #

The details for a source control configuration for a job, allowing synchronization of job artifacts to or from a remote repository.

See: newSourceControlDetails smart constructor.

Constructors

SourceControlDetails' 

Fields

Instances

Instances details
FromJSON SourceControlDetails Source # 
Instance details

Defined in Amazonka.Glue.Types.SourceControlDetails

ToJSON SourceControlDetails Source # 
Instance details

Defined in Amazonka.Glue.Types.SourceControlDetails

Generic SourceControlDetails Source # 
Instance details

Defined in Amazonka.Glue.Types.SourceControlDetails

Associated Types

type Rep SourceControlDetails :: Type -> Type #

Read SourceControlDetails Source # 
Instance details

Defined in Amazonka.Glue.Types.SourceControlDetails

Show SourceControlDetails Source # 
Instance details

Defined in Amazonka.Glue.Types.SourceControlDetails

NFData SourceControlDetails Source # 
Instance details

Defined in Amazonka.Glue.Types.SourceControlDetails

Methods

rnf :: SourceControlDetails -> () #

Eq SourceControlDetails Source # 
Instance details

Defined in Amazonka.Glue.Types.SourceControlDetails

Hashable SourceControlDetails Source # 
Instance details

Defined in Amazonka.Glue.Types.SourceControlDetails

type Rep SourceControlDetails Source # 
Instance details

Defined in Amazonka.Glue.Types.SourceControlDetails

newSourceControlDetails :: SourceControlDetails Source #

Create a value of SourceControlDetails with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:authStrategy:SourceControlDetails', sourceControlDetails_authStrategy - The type of authentication, which can be an authentication token stored in Amazon Web Services Secrets Manager, or a personal access token.

$sel:authToken:SourceControlDetails', sourceControlDetails_authToken - The value of an authorization token.

$sel:branch:SourceControlDetails', sourceControlDetails_branch - An optional branch in the remote repository.

$sel:folder:SourceControlDetails', sourceControlDetails_folder - An optional folder in the remote repository.

$sel:lastCommitId:SourceControlDetails', sourceControlDetails_lastCommitId - The last commit ID for a commit in the remote repository.

$sel:owner:SourceControlDetails', sourceControlDetails_owner - The owner of the remote repository that contains the job artifacts.

$sel:provider:SourceControlDetails', sourceControlDetails_provider - The provider for the remote repository.

$sel:repository:SourceControlDetails', sourceControlDetails_repository - The name of the remote repository that contains the job artifacts.

sourceControlDetails_authStrategy :: Lens' SourceControlDetails (Maybe SourceControlAuthStrategy) Source #

The type of authentication, which can be an authentication token stored in Amazon Web Services Secrets Manager, or a personal access token.

sourceControlDetails_branch :: Lens' SourceControlDetails (Maybe Text) Source #

An optional branch in the remote repository.

sourceControlDetails_folder :: Lens' SourceControlDetails (Maybe Text) Source #

An optional folder in the remote repository.

sourceControlDetails_lastCommitId :: Lens' SourceControlDetails (Maybe Text) Source #

The last commit ID for a commit in the remote repository.

sourceControlDetails_owner :: Lens' SourceControlDetails (Maybe Text) Source #

The owner of the remote repository that contains the job artifacts.

sourceControlDetails_repository :: Lens' SourceControlDetails (Maybe Text) Source #

The name of the remote repository that contains the job artifacts.

SparkConnectorSource

data SparkConnectorSource Source #

Specifies a connector to an Apache Spark data source.

See: newSparkConnectorSource smart constructor.

Constructors

SparkConnectorSource' 

Fields

Instances

Instances details
FromJSON SparkConnectorSource Source # 
Instance details

Defined in Amazonka.Glue.Types.SparkConnectorSource

ToJSON SparkConnectorSource Source # 
Instance details

Defined in Amazonka.Glue.Types.SparkConnectorSource

Generic SparkConnectorSource Source # 
Instance details

Defined in Amazonka.Glue.Types.SparkConnectorSource

Associated Types

type Rep SparkConnectorSource :: Type -> Type #

Read SparkConnectorSource Source # 
Instance details

Defined in Amazonka.Glue.Types.SparkConnectorSource

Show SparkConnectorSource Source # 
Instance details

Defined in Amazonka.Glue.Types.SparkConnectorSource

NFData SparkConnectorSource Source # 
Instance details

Defined in Amazonka.Glue.Types.SparkConnectorSource

Methods

rnf :: SparkConnectorSource -> () #

Eq SparkConnectorSource Source # 
Instance details

Defined in Amazonka.Glue.Types.SparkConnectorSource

Hashable SparkConnectorSource Source # 
Instance details

Defined in Amazonka.Glue.Types.SparkConnectorSource

type Rep SparkConnectorSource Source # 
Instance details

Defined in Amazonka.Glue.Types.SparkConnectorSource

type Rep SparkConnectorSource = D1 ('MetaData "SparkConnectorSource" "Amazonka.Glue.Types.SparkConnectorSource" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "SparkConnectorSource'" 'PrefixI 'True) ((S1 ('MetaSel ('Just "additionalOptions") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe (HashMap Text Text))) :*: (S1 ('MetaSel ('Just "outputSchemas") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe [GlueSchema])) :*: S1 ('MetaSel ('Just "name") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text))) :*: (S1 ('MetaSel ('Just "connectionName") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text) :*: (S1 ('MetaSel ('Just "connectorName") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text) :*: S1 ('MetaSel ('Just "connectionType") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text)))))

newSparkConnectorSource Source #

Create a value of SparkConnectorSource with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:additionalOptions:SparkConnectorSource', sparkConnectorSource_additionalOptions - Additional connection options for the connector.

$sel:outputSchemas:SparkConnectorSource', sparkConnectorSource_outputSchemas - Specifies data schema for the custom spark source.

$sel:name:SparkConnectorSource', sparkConnectorSource_name - The name of the data source.

$sel:connectionName:SparkConnectorSource', sparkConnectorSource_connectionName - The name of the connection that is associated with the connector.

$sel:connectorName:SparkConnectorSource', sparkConnectorSource_connectorName - The name of a connector that assists with accessing the data store in Glue Studio.

$sel:connectionType:SparkConnectorSource', sparkConnectorSource_connectionType - The type of connection, such as marketplace.spark or custom.spark, designating a connection to an Apache Spark data store.

sparkConnectorSource_additionalOptions :: Lens' SparkConnectorSource (Maybe (HashMap Text Text)) Source #

Additional connection options for the connector.

sparkConnectorSource_outputSchemas :: Lens' SparkConnectorSource (Maybe [GlueSchema]) Source #

Specifies data schema for the custom spark source.

sparkConnectorSource_connectionName :: Lens' SparkConnectorSource Text Source #

The name of the connection that is associated with the connector.

sparkConnectorSource_connectorName :: Lens' SparkConnectorSource Text Source #

The name of a connector that assists with accessing the data store in Glue Studio.

sparkConnectorSource_connectionType :: Lens' SparkConnectorSource Text Source #

The type of connection, such as marketplace.spark or custom.spark, designating a connection to an Apache Spark data store.

SparkConnectorTarget

data SparkConnectorTarget Source #

Specifies a target that uses an Apache Spark connector.

See: newSparkConnectorTarget smart constructor.

Constructors

SparkConnectorTarget' 

Fields

Instances

Instances details
FromJSON SparkConnectorTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.SparkConnectorTarget

ToJSON SparkConnectorTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.SparkConnectorTarget

Generic SparkConnectorTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.SparkConnectorTarget

Associated Types

type Rep SparkConnectorTarget :: Type -> Type #

Read SparkConnectorTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.SparkConnectorTarget

Show SparkConnectorTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.SparkConnectorTarget

NFData SparkConnectorTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.SparkConnectorTarget

Methods

rnf :: SparkConnectorTarget -> () #

Eq SparkConnectorTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.SparkConnectorTarget

Hashable SparkConnectorTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.SparkConnectorTarget

type Rep SparkConnectorTarget Source # 
Instance details

Defined in Amazonka.Glue.Types.SparkConnectorTarget

type Rep SparkConnectorTarget = D1 ('MetaData "SparkConnectorTarget" "Amazonka.Glue.Types.SparkConnectorTarget" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "SparkConnectorTarget'" 'PrefixI 'True) ((S1 ('MetaSel ('Just "additionalOptions") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe (HashMap Text Text))) :*: (S1 ('MetaSel ('Just "outputSchemas") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe [GlueSchema])) :*: S1 ('MetaSel ('Just "name") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text))) :*: ((S1 ('MetaSel ('Just "inputs") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (NonEmpty Text)) :*: S1 ('MetaSel ('Just "connectionName") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text)) :*: (S1 ('MetaSel ('Just "connectorName") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text) :*: S1 ('MetaSel ('Just "connectionType") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text)))))

newSparkConnectorTarget Source #

Create a value of SparkConnectorTarget with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:additionalOptions:SparkConnectorTarget', sparkConnectorTarget_additionalOptions - Additional connection options for the connector.

$sel:outputSchemas:SparkConnectorTarget', sparkConnectorTarget_outputSchemas - Specifies the data schema for the custom spark target.

$sel:name:SparkConnectorTarget', sparkConnectorTarget_name - The name of the data target.

$sel:inputs:SparkConnectorTarget', sparkConnectorTarget_inputs - The nodes that are inputs to the data target.

$sel:connectionName:SparkConnectorTarget', sparkConnectorTarget_connectionName - The name of a connection for an Apache Spark connector.

$sel:connectorName:SparkConnectorTarget', sparkConnectorTarget_connectorName - The name of an Apache Spark connector.

$sel:connectionType:SparkConnectorTarget', sparkConnectorTarget_connectionType - The type of connection, such as marketplace.spark or custom.spark, designating a connection to an Apache Spark data store.

sparkConnectorTarget_additionalOptions :: Lens' SparkConnectorTarget (Maybe (HashMap Text Text)) Source #

Additional connection options for the connector.

sparkConnectorTarget_outputSchemas :: Lens' SparkConnectorTarget (Maybe [GlueSchema]) Source #

Specifies the data schema for the custom spark target.

sparkConnectorTarget_inputs :: Lens' SparkConnectorTarget (NonEmpty Text) Source #

The nodes that are inputs to the data target.

sparkConnectorTarget_connectionName :: Lens' SparkConnectorTarget Text Source #

The name of a connection for an Apache Spark connector.

sparkConnectorTarget_connectionType :: Lens' SparkConnectorTarget Text Source #

The type of connection, such as marketplace.spark or custom.spark, designating a connection to an Apache Spark data store.

SparkSQL

data SparkSQL Source #

Specifies a transform where you enter a SQL query using Spark SQL syntax to transform the data. The output is a single DynamicFrame.

See: newSparkSQL smart constructor.

Constructors

SparkSQL' 

Fields

  • outputSchemas :: Maybe [GlueSchema]

    Specifies the data schema for the SparkSQL transform.

  • name :: Text

    The name of the transform node.

  • inputs :: NonEmpty Text

    The data inputs identified by their node names. You can associate a table name with each input node to use in the SQL query. The name you choose must meet the Spark SQL naming restrictions.

  • sqlQuery :: Text

    A SQL query that must use Spark SQL syntax and return a single data set.

  • sqlAliases :: [SqlAlias]

    A list of aliases. An alias allows you to specify what name to use in the SQL for a given input. For example, you have a datasource named "MyDataSource". If you specify From as MyDataSource, and Alias as SqlName, then in your SQL you can do:

    select * from SqlName

    and that gets data from MyDataSource.

Instances

Instances details
FromJSON SparkSQL Source # 
Instance details

Defined in Amazonka.Glue.Types.SparkSQL

ToJSON SparkSQL Source # 
Instance details

Defined in Amazonka.Glue.Types.SparkSQL

Generic SparkSQL Source # 
Instance details

Defined in Amazonka.Glue.Types.SparkSQL

Associated Types

type Rep SparkSQL :: Type -> Type #

Methods

from :: SparkSQL -> Rep SparkSQL x #

to :: Rep SparkSQL x -> SparkSQL #

Read SparkSQL Source # 
Instance details

Defined in Amazonka.Glue.Types.SparkSQL

Show SparkSQL Source # 
Instance details

Defined in Amazonka.Glue.Types.SparkSQL

NFData SparkSQL Source # 
Instance details

Defined in Amazonka.Glue.Types.SparkSQL

Methods

rnf :: SparkSQL -> () #

Eq SparkSQL Source # 
Instance details

Defined in Amazonka.Glue.Types.SparkSQL

Hashable SparkSQL Source # 
Instance details

Defined in Amazonka.Glue.Types.SparkSQL

Methods

hashWithSalt :: Int -> SparkSQL -> Int #

hash :: SparkSQL -> Int #

type Rep SparkSQL Source # 
Instance details

Defined in Amazonka.Glue.Types.SparkSQL

type Rep SparkSQL = D1 ('MetaData "SparkSQL" "Amazonka.Glue.Types.SparkSQL" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "SparkSQL'" 'PrefixI 'True) ((S1 ('MetaSel ('Just "outputSchemas") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe [GlueSchema])) :*: S1 ('MetaSel ('Just "name") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text)) :*: (S1 ('MetaSel ('Just "inputs") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (NonEmpty Text)) :*: (S1 ('MetaSel ('Just "sqlQuery") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text) :*: S1 ('MetaSel ('Just "sqlAliases") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 [SqlAlias])))))

newSparkSQL Source #

Create a value of SparkSQL with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:outputSchemas:SparkSQL', sparkSQL_outputSchemas - Specifies the data schema for the SparkSQL transform.

$sel:name:SparkSQL', sparkSQL_name - The name of the transform node.

$sel:inputs:SparkSQL', sparkSQL_inputs - The data inputs identified by their node names. You can associate a table name with each input node to use in the SQL query. The name you choose must meet the Spark SQL naming restrictions.

$sel:sqlQuery:SparkSQL', sparkSQL_sqlQuery - A SQL query that must use Spark SQL syntax and return a single data set.

$sel:sqlAliases:SparkSQL', sparkSQL_sqlAliases - A list of aliases. An alias allows you to specify what name to use in the SQL for a given input. For example, you have a datasource named "MyDataSource". If you specify From as MyDataSource, and Alias as SqlName, then in your SQL you can do:

select * from SqlName

and that gets data from MyDataSource.

sparkSQL_outputSchemas :: Lens' SparkSQL (Maybe [GlueSchema]) Source #

Specifies the data schema for the SparkSQL transform.

sparkSQL_name :: Lens' SparkSQL Text Source #

The name of the transform node.

sparkSQL_inputs :: Lens' SparkSQL (NonEmpty Text) Source #

The data inputs identified by their node names. You can associate a table name with each input node to use in the SQL query. The name you choose must meet the Spark SQL naming restrictions.

sparkSQL_sqlQuery :: Lens' SparkSQL Text Source #

A SQL query that must use Spark SQL syntax and return a single data set.

sparkSQL_sqlAliases :: Lens' SparkSQL [SqlAlias] Source #

A list of aliases. An alias allows you to specify what name to use in the SQL for a given input. For example, you have a datasource named "MyDataSource". If you specify From as MyDataSource, and Alias as SqlName, then in your SQL you can do:

select * from SqlName

and that gets data from MyDataSource.

Spigot

data Spigot Source #

Specifies a transform that writes samples of the data to an Amazon S3 bucket.

See: newSpigot smart constructor.

Constructors

Spigot' 

Fields

  • prob :: Maybe Double

    The probability (a decimal value with a maximum value of 1) of picking any given record. A value of 1 indicates that each row read from the dataset should be included in the sample output.

  • topk :: Maybe Natural

    Specifies a number of records to write starting from the beginning of the dataset.

  • name :: Text

    The name of the transform node.

  • inputs :: NonEmpty Text

    The data inputs identified by their node names.

  • path :: Text

    A path in Amazon S3 where the transform will write a subset of records from the dataset to a JSON file in an Amazon S3 bucket.

Instances

Instances details
FromJSON Spigot Source # 
Instance details

Defined in Amazonka.Glue.Types.Spigot

ToJSON Spigot Source # 
Instance details

Defined in Amazonka.Glue.Types.Spigot

Generic Spigot Source # 
Instance details

Defined in Amazonka.Glue.Types.Spigot

Associated Types

type Rep Spigot :: Type -> Type #

Methods

from :: Spigot -> Rep Spigot x #

to :: Rep Spigot x -> Spigot #

Read Spigot Source # 
Instance details

Defined in Amazonka.Glue.Types.Spigot

Show Spigot Source # 
Instance details

Defined in Amazonka.Glue.Types.Spigot

NFData Spigot Source # 
Instance details

Defined in Amazonka.Glue.Types.Spigot

Methods

rnf :: Spigot -> () #

Eq Spigot Source # 
Instance details

Defined in Amazonka.Glue.Types.Spigot

Methods

(==) :: Spigot -> Spigot -> Bool #

(/=) :: Spigot -> Spigot -> Bool #

Hashable Spigot Source # 
Instance details

Defined in Amazonka.Glue.Types.Spigot

Methods

hashWithSalt :: Int -> Spigot -> Int #

hash :: Spigot -> Int #

type Rep Spigot Source # 
Instance details

Defined in Amazonka.Glue.Types.Spigot

newSpigot Source #

Create a value of Spigot with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:prob:Spigot', spigot_prob - The probability (a decimal value with a maximum value of 1) of picking any given record. A value of 1 indicates that each row read from the dataset should be included in the sample output.

$sel:topk:Spigot', spigot_topk - Specifies a number of records to write starting from the beginning of the dataset.

$sel:name:Spigot', spigot_name - The name of the transform node.

$sel:inputs:Spigot', spigot_inputs - The data inputs identified by their node names.

$sel:path:Spigot', spigot_path - A path in Amazon S3 where the transform will write a subset of records from the dataset to a JSON file in an Amazon S3 bucket.

spigot_prob :: Lens' Spigot (Maybe Double) Source #

The probability (a decimal value with a maximum value of 1) of picking any given record. A value of 1 indicates that each row read from the dataset should be included in the sample output.

spigot_topk :: Lens' Spigot (Maybe Natural) Source #

Specifies a number of records to write starting from the beginning of the dataset.

spigot_name :: Lens' Spigot Text Source #

The name of the transform node.

spigot_inputs :: Lens' Spigot (NonEmpty Text) Source #

The data inputs identified by their node names.

spigot_path :: Lens' Spigot Text Source #

A path in Amazon S3 where the transform will write a subset of records from the dataset to a JSON file in an Amazon S3 bucket.

SplitFields

data SplitFields Source #

Specifies a transform that splits data property keys into two DynamicFrames. The output is a collection of DynamicFrames: one with selected data property keys, and one with the remaining data property keys.

See: newSplitFields smart constructor.

Constructors

SplitFields' 

Fields

  • name :: Text

    The name of the transform node.

  • inputs :: NonEmpty Text

    The data inputs identified by their node names.

  • paths :: [[Text]]

    A JSON path to a variable in the data structure.

Instances

Instances details
FromJSON SplitFields Source # 
Instance details

Defined in Amazonka.Glue.Types.SplitFields

ToJSON SplitFields Source # 
Instance details

Defined in Amazonka.Glue.Types.SplitFields

Generic SplitFields Source # 
Instance details

Defined in Amazonka.Glue.Types.SplitFields

Associated Types

type Rep SplitFields :: Type -> Type #

Read SplitFields Source # 
Instance details

Defined in Amazonka.Glue.Types.SplitFields

Show SplitFields Source # 
Instance details

Defined in Amazonka.Glue.Types.SplitFields

NFData SplitFields Source # 
Instance details

Defined in Amazonka.Glue.Types.SplitFields

Methods

rnf :: SplitFields -> () #

Eq SplitFields Source # 
Instance details

Defined in Amazonka.Glue.Types.SplitFields

Hashable SplitFields Source # 
Instance details

Defined in Amazonka.Glue.Types.SplitFields

type Rep SplitFields Source # 
Instance details

Defined in Amazonka.Glue.Types.SplitFields

type Rep SplitFields = D1 ('MetaData "SplitFields" "Amazonka.Glue.Types.SplitFields" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "SplitFields'" 'PrefixI 'True) (S1 ('MetaSel ('Just "name") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text) :*: (S1 ('MetaSel ('Just "inputs") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (NonEmpty Text)) :*: S1 ('MetaSel ('Just "paths") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 [[Text]]))))

newSplitFields Source #

Create a value of SplitFields with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:name:SplitFields', splitFields_name - The name of the transform node.

$sel:inputs:SplitFields', splitFields_inputs - The data inputs identified by their node names.

$sel:paths:SplitFields', splitFields_paths - A JSON path to a variable in the data structure.

splitFields_name :: Lens' SplitFields Text Source #

The name of the transform node.

splitFields_inputs :: Lens' SplitFields (NonEmpty Text) Source #

The data inputs identified by their node names.

splitFields_paths :: Lens' SplitFields [[Text]] Source #

A JSON path to a variable in the data structure.

SqlAlias

data SqlAlias Source #

Represents a single entry in the list of values for SqlAliases.

See: newSqlAlias smart constructor.

Constructors

SqlAlias' 

Fields

  • from :: Text

    A table, or a column in a table.

  • alias :: Text

    A temporary name given to a table, or a column in a table.

Instances

Instances details
FromJSON SqlAlias Source # 
Instance details

Defined in Amazonka.Glue.Types.SqlAlias

ToJSON SqlAlias Source # 
Instance details

Defined in Amazonka.Glue.Types.SqlAlias

Generic SqlAlias Source # 
Instance details

Defined in Amazonka.Glue.Types.SqlAlias

Associated Types

type Rep SqlAlias :: Type -> Type #

Methods

from :: SqlAlias -> Rep SqlAlias x #

to :: Rep SqlAlias x -> SqlAlias #

Read SqlAlias Source # 
Instance details

Defined in Amazonka.Glue.Types.SqlAlias

Show SqlAlias Source # 
Instance details

Defined in Amazonka.Glue.Types.SqlAlias

NFData SqlAlias Source # 
Instance details

Defined in Amazonka.Glue.Types.SqlAlias

Methods

rnf :: SqlAlias -> () #

Eq SqlAlias Source # 
Instance details

Defined in Amazonka.Glue.Types.SqlAlias

Hashable SqlAlias Source # 
Instance details

Defined in Amazonka.Glue.Types.SqlAlias

Methods

hashWithSalt :: Int -> SqlAlias -> Int #

hash :: SqlAlias -> Int #

type Rep SqlAlias Source # 
Instance details

Defined in Amazonka.Glue.Types.SqlAlias

type Rep SqlAlias = D1 ('MetaData "SqlAlias" "Amazonka.Glue.Types.SqlAlias" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "SqlAlias'" 'PrefixI 'True) (S1 ('MetaSel ('Just "from") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text) :*: S1 ('MetaSel ('Just "alias") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text)))

newSqlAlias Source #

Create a value of SqlAlias with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:from:SqlAlias', sqlAlias_from - A table, or a column in a table.

$sel:alias:SqlAlias', sqlAlias_alias - A temporary name given to a table, or a column in a table.

sqlAlias_from :: Lens' SqlAlias Text Source #

A table, or a column in a table.

sqlAlias_alias :: Lens' SqlAlias Text Source #

A temporary name given to a table, or a column in a table.

StartingEventBatchCondition

data StartingEventBatchCondition Source #

The batch condition that started the workflow run. Either the number of events in the batch size arrived, in which case the BatchSize member is non-zero, or the batch window expired, in which case the BatchWindow member is non-zero.

See: newStartingEventBatchCondition smart constructor.

Constructors

StartingEventBatchCondition' 

Fields

Instances

Instances details
FromJSON StartingEventBatchCondition Source # 
Instance details

Defined in Amazonka.Glue.Types.StartingEventBatchCondition

Generic StartingEventBatchCondition Source # 
Instance details

Defined in Amazonka.Glue.Types.StartingEventBatchCondition

Associated Types

type Rep StartingEventBatchCondition :: Type -> Type #

Read StartingEventBatchCondition Source # 
Instance details

Defined in Amazonka.Glue.Types.StartingEventBatchCondition

Show StartingEventBatchCondition Source # 
Instance details

Defined in Amazonka.Glue.Types.StartingEventBatchCondition

NFData StartingEventBatchCondition Source # 
Instance details

Defined in Amazonka.Glue.Types.StartingEventBatchCondition

Eq StartingEventBatchCondition Source # 
Instance details

Defined in Amazonka.Glue.Types.StartingEventBatchCondition

Hashable StartingEventBatchCondition Source # 
Instance details

Defined in Amazonka.Glue.Types.StartingEventBatchCondition

type Rep StartingEventBatchCondition Source # 
Instance details

Defined in Amazonka.Glue.Types.StartingEventBatchCondition

type Rep StartingEventBatchCondition = D1 ('MetaData "StartingEventBatchCondition" "Amazonka.Glue.Types.StartingEventBatchCondition" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "StartingEventBatchCondition'" 'PrefixI 'True) (S1 ('MetaSel ('Just "batchSize") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Int)) :*: S1 ('MetaSel ('Just "batchWindow") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Int))))

newStartingEventBatchCondition :: StartingEventBatchCondition Source #

Create a value of StartingEventBatchCondition with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:batchSize:StartingEventBatchCondition', startingEventBatchCondition_batchSize - Number of events in the batch.

$sel:batchWindow:StartingEventBatchCondition', startingEventBatchCondition_batchWindow - Duration of the batch window in seconds.

Statement

data Statement Source #

The statement or request for a particular action to occur in a session.

See: newStatement smart constructor.

Constructors

Statement' 

Fields

Instances

Instances details
FromJSON Statement Source # 
Instance details

Defined in Amazonka.Glue.Types.Statement

Generic Statement Source # 
Instance details

Defined in Amazonka.Glue.Types.Statement

Associated Types

type Rep Statement :: Type -> Type #

Read Statement Source # 
Instance details

Defined in Amazonka.Glue.Types.Statement

Show Statement Source # 
Instance details

Defined in Amazonka.Glue.Types.Statement

NFData Statement Source # 
Instance details

Defined in Amazonka.Glue.Types.Statement

Methods

rnf :: Statement -> () #

Eq Statement Source # 
Instance details

Defined in Amazonka.Glue.Types.Statement

Hashable Statement Source # 
Instance details

Defined in Amazonka.Glue.Types.Statement

type Rep Statement Source # 
Instance details

Defined in Amazonka.Glue.Types.Statement

newStatement :: Statement Source #

Create a value of Statement with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:code:Statement', statement_code - The execution code of the statement.

$sel:completedOn:Statement', statement_completedOn - The unix time and date that the job definition was completed.

$sel:id:Statement', statement_id - The ID of the statement.

$sel:output:Statement', statement_output - The output in JSON.

$sel:progress:Statement', statement_progress - The code execution progress.

$sel:startedOn:Statement', statement_startedOn - The unix time and date that the job definition was started.

$sel:state:Statement', statement_state - The state while request is actioned.

statement_code :: Lens' Statement (Maybe Text) Source #

The execution code of the statement.

statement_completedOn :: Lens' Statement (Maybe Integer) Source #

The unix time and date that the job definition was completed.

statement_id :: Lens' Statement (Maybe Int) Source #

The ID of the statement.

statement_progress :: Lens' Statement (Maybe Double) Source #

The code execution progress.

statement_startedOn :: Lens' Statement (Maybe Integer) Source #

The unix time and date that the job definition was started.

statement_state :: Lens' Statement (Maybe StatementState) Source #

The state while request is actioned.

StatementOutput

data StatementOutput Source #

The code execution output in JSON format.

See: newStatementOutput smart constructor.

Constructors

StatementOutput' 

Fields

Instances

Instances details
FromJSON StatementOutput Source # 
Instance details

Defined in Amazonka.Glue.Types.StatementOutput

Generic StatementOutput Source # 
Instance details

Defined in Amazonka.Glue.Types.StatementOutput

Associated Types

type Rep StatementOutput :: Type -> Type #

Read StatementOutput Source # 
Instance details

Defined in Amazonka.Glue.Types.StatementOutput

Show StatementOutput Source # 
Instance details

Defined in Amazonka.Glue.Types.StatementOutput

NFData StatementOutput Source # 
Instance details

Defined in Amazonka.Glue.Types.StatementOutput

Methods

rnf :: StatementOutput -> () #

Eq StatementOutput Source # 
Instance details

Defined in Amazonka.Glue.Types.StatementOutput

Hashable StatementOutput Source # 
Instance details

Defined in Amazonka.Glue.Types.StatementOutput

type Rep StatementOutput Source # 
Instance details

Defined in Amazonka.Glue.Types.StatementOutput

newStatementOutput :: StatementOutput Source #

Create a value of StatementOutput with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:data':StatementOutput', statementOutput_data - The code execution output.

$sel:errorName:StatementOutput', statementOutput_errorName - The name of the error in the output.

$sel:errorValue:StatementOutput', statementOutput_errorValue - The error value of the output.

$sel:executionCount:StatementOutput', statementOutput_executionCount - The execution count of the output.

$sel:status:StatementOutput', statementOutput_status - The status of the code execution output.

$sel:traceback:StatementOutput', statementOutput_traceback - The traceback of the output.

statementOutput_errorName :: Lens' StatementOutput (Maybe Text) Source #

The name of the error in the output.

statementOutput_executionCount :: Lens' StatementOutput (Maybe Int) Source #

The execution count of the output.

statementOutput_status :: Lens' StatementOutput (Maybe StatementState) Source #

The status of the code execution output.

statementOutput_traceback :: Lens' StatementOutput (Maybe [Text]) Source #

The traceback of the output.

StatementOutputData

data StatementOutputData Source #

The code execution output in JSON format.

See: newStatementOutputData smart constructor.

Constructors

StatementOutputData' 

Fields

Instances

Instances details
FromJSON StatementOutputData Source # 
Instance details

Defined in Amazonka.Glue.Types.StatementOutputData

Generic StatementOutputData Source # 
Instance details

Defined in Amazonka.Glue.Types.StatementOutputData

Associated Types

type Rep StatementOutputData :: Type -> Type #

Read StatementOutputData Source # 
Instance details

Defined in Amazonka.Glue.Types.StatementOutputData

Show StatementOutputData Source # 
Instance details

Defined in Amazonka.Glue.Types.StatementOutputData

NFData StatementOutputData Source # 
Instance details

Defined in Amazonka.Glue.Types.StatementOutputData

Methods

rnf :: StatementOutputData -> () #

Eq StatementOutputData Source # 
Instance details

Defined in Amazonka.Glue.Types.StatementOutputData

Hashable StatementOutputData Source # 
Instance details

Defined in Amazonka.Glue.Types.StatementOutputData

type Rep StatementOutputData Source # 
Instance details

Defined in Amazonka.Glue.Types.StatementOutputData

type Rep StatementOutputData = D1 ('MetaData "StatementOutputData" "Amazonka.Glue.Types.StatementOutputData" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "StatementOutputData'" 'PrefixI 'True) (S1 ('MetaSel ('Just "textPlain") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text))))

newStatementOutputData :: StatementOutputData Source #

Create a value of StatementOutputData with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:textPlain:StatementOutputData', statementOutputData_textPlain - The code execution output in text format.

statementOutputData_textPlain :: Lens' StatementOutputData (Maybe Text) Source #

The code execution output in text format.

StorageDescriptor

data StorageDescriptor Source #

Describes the physical storage of table data.

See: newStorageDescriptor smart constructor.

Constructors

StorageDescriptor' 

Fields

Instances

Instances details
FromJSON StorageDescriptor Source # 
Instance details

Defined in Amazonka.Glue.Types.StorageDescriptor

ToJSON StorageDescriptor Source # 
Instance details

Defined in Amazonka.Glue.Types.StorageDescriptor

Generic StorageDescriptor Source # 
Instance details

Defined in Amazonka.Glue.Types.StorageDescriptor

Associated Types

type Rep StorageDescriptor :: Type -> Type #

Read StorageDescriptor Source # 
Instance details

Defined in Amazonka.Glue.Types.StorageDescriptor

Show StorageDescriptor Source # 
Instance details

Defined in Amazonka.Glue.Types.StorageDescriptor

NFData StorageDescriptor Source # 
Instance details

Defined in Amazonka.Glue.Types.StorageDescriptor

Methods

rnf :: StorageDescriptor -> () #

Eq StorageDescriptor Source # 
Instance details

Defined in Amazonka.Glue.Types.StorageDescriptor

Hashable StorageDescriptor Source # 
Instance details

Defined in Amazonka.Glue.Types.StorageDescriptor

type Rep StorageDescriptor Source # 
Instance details

Defined in Amazonka.Glue.Types.StorageDescriptor

type Rep StorageDescriptor = D1 ('MetaData "StorageDescriptor" "Amazonka.Glue.Types.StorageDescriptor" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "StorageDescriptor'" 'PrefixI 'True) (((S1 ('MetaSel ('Just "additionalLocations") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe [Text])) :*: (S1 ('MetaSel ('Just "bucketColumns") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe [Text])) :*: S1 ('MetaSel ('Just "columns") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe [Column])))) :*: ((S1 ('MetaSel ('Just "compressed") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Bool)) :*: S1 ('MetaSel ('Just "inputFormat") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text))) :*: (S1 ('MetaSel ('Just "location") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "numberOfBuckets") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Int))))) :*: ((S1 ('MetaSel ('Just "outputFormat") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: (S1 ('MetaSel ('Just "parameters") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe (HashMap Text Text))) :*: S1 ('MetaSel ('Just "schemaReference") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe SchemaReference)))) :*: ((S1 ('MetaSel ('Just "serdeInfo") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe SerDeInfo)) :*: S1 ('MetaSel ('Just "skewedInfo") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe SkewedInfo))) :*: (S1 ('MetaSel ('Just "sortColumns") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe [Order])) :*: S1 ('MetaSel ('Just "storedAsSubDirectories") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Bool)))))))

newStorageDescriptor :: StorageDescriptor Source #

Create a value of StorageDescriptor with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:additionalLocations:StorageDescriptor', storageDescriptor_additionalLocations - A list of locations that point to the path where a Delta table is located.

$sel:bucketColumns:StorageDescriptor', storageDescriptor_bucketColumns - A list of reducer grouping columns, clustering columns, and bucketing columns in the table.

$sel:columns:StorageDescriptor', storageDescriptor_columns - A list of the Columns in the table.

$sel:compressed:StorageDescriptor', storageDescriptor_compressed - True if the data in the table is compressed, or False if not.

$sel:inputFormat:StorageDescriptor', storageDescriptor_inputFormat - The input format: SequenceFileInputFormat (binary), or TextInputFormat, or a custom format.

$sel:location:StorageDescriptor', storageDescriptor_location - The physical location of the table. By default, this takes the form of the warehouse location, followed by the database location in the warehouse, followed by the table name.

$sel:numberOfBuckets:StorageDescriptor', storageDescriptor_numberOfBuckets - Must be specified if the table contains any dimension columns.

$sel:outputFormat:StorageDescriptor', storageDescriptor_outputFormat - The output format: SequenceFileOutputFormat (binary), or IgnoreKeyTextOutputFormat, or a custom format.

StorageDescriptor, storageDescriptor_parameters - The user-supplied properties in key-value form.

$sel:schemaReference:StorageDescriptor', storageDescriptor_schemaReference - An object that references a schema stored in the Glue Schema Registry.

When creating a table, you can pass an empty list of columns for the schema, and instead use a schema reference.

$sel:serdeInfo:StorageDescriptor', storageDescriptor_serdeInfo - The serialization/deserialization (SerDe) information.

$sel:skewedInfo:StorageDescriptor', storageDescriptor_skewedInfo - The information about values that appear frequently in a column (skewed values).

$sel:sortColumns:StorageDescriptor', storageDescriptor_sortColumns - A list specifying the sort order of each bucket in the table.

$sel:storedAsSubDirectories:StorageDescriptor', storageDescriptor_storedAsSubDirectories - True if the table data is stored in subdirectories, or False if not.

storageDescriptor_additionalLocations :: Lens' StorageDescriptor (Maybe [Text]) Source #

A list of locations that point to the path where a Delta table is located.

storageDescriptor_bucketColumns :: Lens' StorageDescriptor (Maybe [Text]) Source #

A list of reducer grouping columns, clustering columns, and bucketing columns in the table.

storageDescriptor_columns :: Lens' StorageDescriptor (Maybe [Column]) Source #

A list of the Columns in the table.

storageDescriptor_compressed :: Lens' StorageDescriptor (Maybe Bool) Source #

True if the data in the table is compressed, or False if not.

storageDescriptor_inputFormat :: Lens' StorageDescriptor (Maybe Text) Source #

The input format: SequenceFileInputFormat (binary), or TextInputFormat, or a custom format.

storageDescriptor_location :: Lens' StorageDescriptor (Maybe Text) Source #

The physical location of the table. By default, this takes the form of the warehouse location, followed by the database location in the warehouse, followed by the table name.

storageDescriptor_numberOfBuckets :: Lens' StorageDescriptor (Maybe Int) Source #

Must be specified if the table contains any dimension columns.

storageDescriptor_outputFormat :: Lens' StorageDescriptor (Maybe Text) Source #

The output format: SequenceFileOutputFormat (binary), or IgnoreKeyTextOutputFormat, or a custom format.

storageDescriptor_parameters :: Lens' StorageDescriptor (Maybe (HashMap Text Text)) Source #

The user-supplied properties in key-value form.

storageDescriptor_schemaReference :: Lens' StorageDescriptor (Maybe SchemaReference) Source #

An object that references a schema stored in the Glue Schema Registry.

When creating a table, you can pass an empty list of columns for the schema, and instead use a schema reference.

storageDescriptor_serdeInfo :: Lens' StorageDescriptor (Maybe SerDeInfo) Source #

The serialization/deserialization (SerDe) information.

storageDescriptor_skewedInfo :: Lens' StorageDescriptor (Maybe SkewedInfo) Source #

The information about values that appear frequently in a column (skewed values).

storageDescriptor_sortColumns :: Lens' StorageDescriptor (Maybe [Order]) Source #

A list specifying the sort order of each bucket in the table.

storageDescriptor_storedAsSubDirectories :: Lens' StorageDescriptor (Maybe Bool) Source #

True if the table data is stored in subdirectories, or False if not.

StreamingDataPreviewOptions

data StreamingDataPreviewOptions Source #

Specifies options related to data preview for viewing a sample of your data.

See: newStreamingDataPreviewOptions smart constructor.

Constructors

StreamingDataPreviewOptions' 

Fields

Instances

Instances details
FromJSON StreamingDataPreviewOptions Source # 
Instance details

Defined in Amazonka.Glue.Types.StreamingDataPreviewOptions

ToJSON StreamingDataPreviewOptions Source # 
Instance details

Defined in Amazonka.Glue.Types.StreamingDataPreviewOptions

Generic StreamingDataPreviewOptions Source # 
Instance details

Defined in Amazonka.Glue.Types.StreamingDataPreviewOptions

Associated Types

type Rep StreamingDataPreviewOptions :: Type -> Type #

Read StreamingDataPreviewOptions Source # 
Instance details

Defined in Amazonka.Glue.Types.StreamingDataPreviewOptions

Show StreamingDataPreviewOptions Source # 
Instance details

Defined in Amazonka.Glue.Types.StreamingDataPreviewOptions

NFData StreamingDataPreviewOptions Source # 
Instance details

Defined in Amazonka.Glue.Types.StreamingDataPreviewOptions

Eq StreamingDataPreviewOptions Source # 
Instance details

Defined in Amazonka.Glue.Types.StreamingDataPreviewOptions

Hashable StreamingDataPreviewOptions Source # 
Instance details

Defined in Amazonka.Glue.Types.StreamingDataPreviewOptions

type Rep StreamingDataPreviewOptions Source # 
Instance details

Defined in Amazonka.Glue.Types.StreamingDataPreviewOptions

type Rep StreamingDataPreviewOptions = D1 ('MetaData "StreamingDataPreviewOptions" "Amazonka.Glue.Types.StreamingDataPreviewOptions" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "StreamingDataPreviewOptions'" 'PrefixI 'True) (S1 ('MetaSel ('Just "pollingTime") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Natural)) :*: S1 ('MetaSel ('Just "recordPollingLimit") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Natural))))

newStreamingDataPreviewOptions :: StreamingDataPreviewOptions Source #

Create a value of StreamingDataPreviewOptions with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:pollingTime:StreamingDataPreviewOptions', streamingDataPreviewOptions_pollingTime - The polling time in milliseconds.

$sel:recordPollingLimit:StreamingDataPreviewOptions', streamingDataPreviewOptions_recordPollingLimit - The limit to the number of records polled.

StringColumnStatisticsData

data StringColumnStatisticsData Source #

Defines column statistics supported for character sequence data values.

See: newStringColumnStatisticsData smart constructor.

Constructors

StringColumnStatisticsData' 

Fields

Instances

Instances details
FromJSON StringColumnStatisticsData Source # 
Instance details

Defined in Amazonka.Glue.Types.StringColumnStatisticsData

ToJSON StringColumnStatisticsData Source # 
Instance details

Defined in Amazonka.Glue.Types.StringColumnStatisticsData

Generic StringColumnStatisticsData Source # 
Instance details

Defined in Amazonka.Glue.Types.StringColumnStatisticsData

Associated Types

type Rep StringColumnStatisticsData :: Type -> Type #

Read StringColumnStatisticsData Source # 
Instance details

Defined in Amazonka.Glue.Types.StringColumnStatisticsData

Show StringColumnStatisticsData Source # 
Instance details

Defined in Amazonka.Glue.Types.StringColumnStatisticsData

NFData StringColumnStatisticsData Source # 
Instance details

Defined in Amazonka.Glue.Types.StringColumnStatisticsData

Eq StringColumnStatisticsData Source # 
Instance details

Defined in Amazonka.Glue.Types.StringColumnStatisticsData

Hashable StringColumnStatisticsData Source # 
Instance details

Defined in Amazonka.Glue.Types.StringColumnStatisticsData

type Rep StringColumnStatisticsData Source # 
Instance details

Defined in Amazonka.Glue.Types.StringColumnStatisticsData

type Rep StringColumnStatisticsData = D1 ('MetaData "StringColumnStatisticsData" "Amazonka.Glue.Types.StringColumnStatisticsData" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "StringColumnStatisticsData'" 'PrefixI 'True) ((S1 ('MetaSel ('Just "maximumLength") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Natural) :*: S1 ('MetaSel ('Just "averageLength") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Double)) :*: (S1 ('MetaSel ('Just "numberOfNulls") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Natural) :*: S1 ('MetaSel ('Just "numberOfDistinctValues") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Natural))))

Table

data Table Source #

Represents a collection of related data organized in columns and rows.

See: newTable smart constructor.

Constructors

Table' 

Fields

Instances

Instances details
FromJSON Table Source # 
Instance details

Defined in Amazonka.Glue.Types.Table

Generic Table Source # 
Instance details

Defined in Amazonka.Glue.Types.Table

Associated Types

type Rep Table :: Type -> Type #

Methods

from :: Table -> Rep Table x #

to :: Rep Table x -> Table #

Read Table Source # 
Instance details

Defined in Amazonka.Glue.Types.Table

Show Table Source # 
Instance details

Defined in Amazonka.Glue.Types.Table

Methods

showsPrec :: Int -> Table -> ShowS #

show :: Table -> String #

showList :: [Table] -> ShowS #

NFData Table Source # 
Instance details

Defined in Amazonka.Glue.Types.Table

Methods

rnf :: Table -> () #

Eq Table Source # 
Instance details

Defined in Amazonka.Glue.Types.Table

Methods

(==) :: Table -> Table -> Bool #

(/=) :: Table -> Table -> Bool #

Hashable Table Source # 
Instance details

Defined in Amazonka.Glue.Types.Table

Methods

hashWithSalt :: Int -> Table -> Int #

hash :: Table -> Int #

type Rep Table Source # 
Instance details

Defined in Amazonka.Glue.Types.Table

type Rep Table = D1 ('MetaData "Table" "Amazonka.Glue.Types.Table" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "Table'" 'PrefixI 'True) ((((S1 ('MetaSel ('Just "catalogId") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "createTime") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe POSIX))) :*: (S1 ('MetaSel ('Just "createdBy") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: (S1 ('MetaSel ('Just "databaseName") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "description") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text))))) :*: ((S1 ('MetaSel ('Just "isRegisteredWithLakeFormation") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Bool)) :*: S1 ('MetaSel ('Just "lastAccessTime") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe POSIX))) :*: (S1 ('MetaSel ('Just "lastAnalyzedTime") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe POSIX)) :*: (S1 ('MetaSel ('Just "owner") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "parameters") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe (HashMap Text Text))))))) :*: (((S1 ('MetaSel ('Just "partitionKeys") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe [Column])) :*: S1 ('MetaSel ('Just "retention") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Natural))) :*: (S1 ('MetaSel ('Just "storageDescriptor") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe StorageDescriptor)) :*: (S1 ('MetaSel ('Just "tableType") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "targetTable") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe TableIdentifier))))) :*: ((S1 ('MetaSel ('Just "updateTime") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe POSIX)) :*: S1 ('MetaSel ('Just "versionId") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text))) :*: (S1 ('MetaSel ('Just "viewExpandedText") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: (S1 ('MetaSel ('Just "viewOriginalText") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "name") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text)))))))

newTable Source #

Arguments

:: Text

Table

-> Table 

Create a value of Table with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

Table, table_catalogId - The ID of the Data Catalog in which the table resides.

$sel:createTime:Table', table_createTime - The time when the table definition was created in the Data Catalog.

$sel:createdBy:Table', table_createdBy - The person or entity who created the table.

Table, table_databaseName - The name of the database where the table metadata resides. For Hive compatibility, this must be all lowercase.

$sel:description:Table', table_description - A description of the table.

$sel:isRegisteredWithLakeFormation:Table', table_isRegisteredWithLakeFormation - Indicates whether the table has been registered with Lake Formation.

$sel:lastAccessTime:Table', table_lastAccessTime - The last time that the table was accessed. This is usually taken from HDFS, and might not be reliable.

$sel:lastAnalyzedTime:Table', table_lastAnalyzedTime - The last time that column statistics were computed for this table.

$sel:owner:Table', table_owner - The owner of the table.

Table, table_parameters - These key-value pairs define properties associated with the table.

$sel:partitionKeys:Table', table_partitionKeys - A list of columns by which the table is partitioned. Only primitive types are supported as partition keys.

When you create a table used by Amazon Athena, and you do not specify any partitionKeys, you must at least set the value of partitionKeys to an empty list. For example:

"PartitionKeys": []

$sel:retention:Table', table_retention - The retention time for this table.

$sel:storageDescriptor:Table', table_storageDescriptor - A storage descriptor containing information about the physical storage of this table.

$sel:tableType:Table', table_tableType - The type of this table (EXTERNAL_TABLE, VIRTUAL_VIEW, etc.).

$sel:targetTable:Table', table_targetTable - A TableIdentifier structure that describes a target table for resource linking.

$sel:updateTime:Table', table_updateTime - The last time that the table was updated.

$sel:versionId:Table', table_versionId - The ID of the table version.

$sel:viewExpandedText:Table', table_viewExpandedText - If the table is a view, the expanded text of the view; otherwise null.

$sel:viewOriginalText:Table', table_viewOriginalText - If the table is a view, the original text of the view; otherwise null.

Table, table_name - The table name. For Hive compatibility, this must be entirely lowercase.

table_catalogId :: Lens' Table (Maybe Text) Source #

The ID of the Data Catalog in which the table resides.

table_createTime :: Lens' Table (Maybe UTCTime) Source #

The time when the table definition was created in the Data Catalog.

table_createdBy :: Lens' Table (Maybe Text) Source #

The person or entity who created the table.

table_databaseName :: Lens' Table (Maybe Text) Source #

The name of the database where the table metadata resides. For Hive compatibility, this must be all lowercase.

table_description :: Lens' Table (Maybe Text) Source #

A description of the table.

table_isRegisteredWithLakeFormation :: Lens' Table (Maybe Bool) Source #

Indicates whether the table has been registered with Lake Formation.

table_lastAccessTime :: Lens' Table (Maybe UTCTime) Source #

The last time that the table was accessed. This is usually taken from HDFS, and might not be reliable.

table_lastAnalyzedTime :: Lens' Table (Maybe UTCTime) Source #

The last time that column statistics were computed for this table.

table_owner :: Lens' Table (Maybe Text) Source #

The owner of the table.

table_parameters :: Lens' Table (Maybe (HashMap Text Text)) Source #

These key-value pairs define properties associated with the table.

table_partitionKeys :: Lens' Table (Maybe [Column]) Source #

A list of columns by which the table is partitioned. Only primitive types are supported as partition keys.

When you create a table used by Amazon Athena, and you do not specify any partitionKeys, you must at least set the value of partitionKeys to an empty list. For example:

"PartitionKeys": []

table_retention :: Lens' Table (Maybe Natural) Source #

The retention time for this table.

table_storageDescriptor :: Lens' Table (Maybe StorageDescriptor) Source #

A storage descriptor containing information about the physical storage of this table.

table_tableType :: Lens' Table (Maybe Text) Source #

The type of this table (EXTERNAL_TABLE, VIRTUAL_VIEW, etc.).

table_targetTable :: Lens' Table (Maybe TableIdentifier) Source #

A TableIdentifier structure that describes a target table for resource linking.

table_updateTime :: Lens' Table (Maybe UTCTime) Source #

The last time that the table was updated.

table_versionId :: Lens' Table (Maybe Text) Source #

The ID of the table version.

table_viewExpandedText :: Lens' Table (Maybe Text) Source #

If the table is a view, the expanded text of the view; otherwise null.

table_viewOriginalText :: Lens' Table (Maybe Text) Source #

If the table is a view, the original text of the view; otherwise null.

table_name :: Lens' Table Text Source #

The table name. For Hive compatibility, this must be entirely lowercase.

TableError

data TableError Source #

An error record for table operations.

See: newTableError smart constructor.

Constructors

TableError' 

Fields

Instances

Instances details
FromJSON TableError Source # 
Instance details

Defined in Amazonka.Glue.Types.TableError

Generic TableError Source # 
Instance details

Defined in Amazonka.Glue.Types.TableError

Associated Types

type Rep TableError :: Type -> Type #

Read TableError Source # 
Instance details

Defined in Amazonka.Glue.Types.TableError

Show TableError Source # 
Instance details

Defined in Amazonka.Glue.Types.TableError

NFData TableError Source # 
Instance details

Defined in Amazonka.Glue.Types.TableError

Methods

rnf :: TableError -> () #

Eq TableError Source # 
Instance details

Defined in Amazonka.Glue.Types.TableError

Hashable TableError Source # 
Instance details

Defined in Amazonka.Glue.Types.TableError

type Rep TableError Source # 
Instance details

Defined in Amazonka.Glue.Types.TableError

type Rep TableError = D1 ('MetaData "TableError" "Amazonka.Glue.Types.TableError" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "TableError'" 'PrefixI 'True) (S1 ('MetaSel ('Just "errorDetail") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe ErrorDetail)) :*: S1 ('MetaSel ('Just "tableName") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text))))

newTableError :: TableError Source #

Create a value of TableError with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:errorDetail:TableError', tableError_errorDetail - The details about the error.

$sel:tableName:TableError', tableError_tableName - The name of the table. For Hive compatibility, this must be entirely lowercase.

tableError_tableName :: Lens' TableError (Maybe Text) Source #

The name of the table. For Hive compatibility, this must be entirely lowercase.

TableIdentifier

data TableIdentifier Source #

A structure that describes a target table for resource linking.

See: newTableIdentifier smart constructor.

Constructors

TableIdentifier' 

Fields

Instances

Instances details
FromJSON TableIdentifier Source # 
Instance details

Defined in Amazonka.Glue.Types.TableIdentifier

ToJSON TableIdentifier Source # 
Instance details

Defined in Amazonka.Glue.Types.TableIdentifier

Generic TableIdentifier Source # 
Instance details

Defined in Amazonka.Glue.Types.TableIdentifier

Associated Types

type Rep TableIdentifier :: Type -> Type #

Read TableIdentifier Source # 
Instance details

Defined in Amazonka.Glue.Types.TableIdentifier

Show TableIdentifier Source # 
Instance details

Defined in Amazonka.Glue.Types.TableIdentifier

NFData TableIdentifier Source # 
Instance details

Defined in Amazonka.Glue.Types.TableIdentifier

Methods

rnf :: TableIdentifier -> () #

Eq TableIdentifier Source # 
Instance details

Defined in Amazonka.Glue.Types.TableIdentifier

Hashable TableIdentifier Source # 
Instance details

Defined in Amazonka.Glue.Types.TableIdentifier

type Rep TableIdentifier Source # 
Instance details

Defined in Amazonka.Glue.Types.TableIdentifier

type Rep TableIdentifier = D1 ('MetaData "TableIdentifier" "Amazonka.Glue.Types.TableIdentifier" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "TableIdentifier'" 'PrefixI 'True) (S1 ('MetaSel ('Just "catalogId") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: (S1 ('MetaSel ('Just "databaseName") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "name") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)))))

newTableIdentifier :: TableIdentifier Source #

Create a value of TableIdentifier with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:catalogId:TableIdentifier', tableIdentifier_catalogId - The ID of the Data Catalog in which the table resides.

$sel:databaseName:TableIdentifier', tableIdentifier_databaseName - The name of the catalog database that contains the target table.

$sel:name:TableIdentifier', tableIdentifier_name - The name of the target table.

tableIdentifier_catalogId :: Lens' TableIdentifier (Maybe Text) Source #

The ID of the Data Catalog in which the table resides.

tableIdentifier_databaseName :: Lens' TableIdentifier (Maybe Text) Source #

The name of the catalog database that contains the target table.

tableIdentifier_name :: Lens' TableIdentifier (Maybe Text) Source #

The name of the target table.

TableInput

data TableInput Source #

A structure used to define a table.

See: newTableInput smart constructor.

Constructors

TableInput' 

Fields

Instances

Instances details
ToJSON TableInput Source # 
Instance details

Defined in Amazonka.Glue.Types.TableInput

Generic TableInput Source # 
Instance details

Defined in Amazonka.Glue.Types.TableInput

Associated Types

type Rep TableInput :: Type -> Type #

Read TableInput Source # 
Instance details

Defined in Amazonka.Glue.Types.TableInput

Show TableInput Source # 
Instance details

Defined in Amazonka.Glue.Types.TableInput

NFData TableInput Source # 
Instance details

Defined in Amazonka.Glue.Types.TableInput

Methods

rnf :: TableInput -> () #

Eq TableInput Source # 
Instance details

Defined in Amazonka.Glue.Types.TableInput

Hashable TableInput Source # 
Instance details

Defined in Amazonka.Glue.Types.TableInput

type Rep TableInput Source # 
Instance details

Defined in Amazonka.Glue.Types.TableInput

type Rep TableInput = D1 ('MetaData "TableInput" "Amazonka.Glue.Types.TableInput" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "TableInput'" 'PrefixI 'True) (((S1 ('MetaSel ('Just "description") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: (S1 ('MetaSel ('Just "lastAccessTime") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe POSIX)) :*: S1 ('MetaSel ('Just "lastAnalyzedTime") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe POSIX)))) :*: (S1 ('MetaSel ('Just "owner") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: (S1 ('MetaSel ('Just "parameters") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe (HashMap Text Text))) :*: S1 ('MetaSel ('Just "partitionKeys") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe [Column]))))) :*: ((S1 ('MetaSel ('Just "retention") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Natural)) :*: (S1 ('MetaSel ('Just "storageDescriptor") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe StorageDescriptor)) :*: S1 ('MetaSel ('Just "tableType") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)))) :*: ((S1 ('MetaSel ('Just "targetTable") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe TableIdentifier)) :*: S1 ('MetaSel ('Just "viewExpandedText") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text))) :*: (S1 ('MetaSel ('Just "viewOriginalText") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "name") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text))))))

newTableInput Source #

Arguments

:: Text

TableInput

-> TableInput 

Create a value of TableInput with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:description:TableInput', tableInput_description - A description of the table.

$sel:lastAccessTime:TableInput', tableInput_lastAccessTime - The last time that the table was accessed.

$sel:lastAnalyzedTime:TableInput', tableInput_lastAnalyzedTime - The last time that column statistics were computed for this table.

$sel:owner:TableInput', tableInput_owner - The table owner.

TableInput, tableInput_parameters - These key-value pairs define properties associated with the table.

$sel:partitionKeys:TableInput', tableInput_partitionKeys - A list of columns by which the table is partitioned. Only primitive types are supported as partition keys.

When you create a table used by Amazon Athena, and you do not specify any partitionKeys, you must at least set the value of partitionKeys to an empty list. For example:

"PartitionKeys": []

$sel:retention:TableInput', tableInput_retention - The retention time for this table.

$sel:storageDescriptor:TableInput', tableInput_storageDescriptor - A storage descriptor containing information about the physical storage of this table.

$sel:tableType:TableInput', tableInput_tableType - The type of this table (EXTERNAL_TABLE, VIRTUAL_VIEW, etc.).

$sel:targetTable:TableInput', tableInput_targetTable - A TableIdentifier structure that describes a target table for resource linking.

$sel:viewExpandedText:TableInput', tableInput_viewExpandedText - If the table is a view, the expanded text of the view; otherwise null.

$sel:viewOriginalText:TableInput', tableInput_viewOriginalText - If the table is a view, the original text of the view; otherwise null.

TableInput, tableInput_name - The table name. For Hive compatibility, this is folded to lowercase when it is stored.

tableInput_description :: Lens' TableInput (Maybe Text) Source #

A description of the table.

tableInput_lastAccessTime :: Lens' TableInput (Maybe UTCTime) Source #

The last time that the table was accessed.

tableInput_lastAnalyzedTime :: Lens' TableInput (Maybe UTCTime) Source #

The last time that column statistics were computed for this table.

tableInput_parameters :: Lens' TableInput (Maybe (HashMap Text Text)) Source #

These key-value pairs define properties associated with the table.

tableInput_partitionKeys :: Lens' TableInput (Maybe [Column]) Source #

A list of columns by which the table is partitioned. Only primitive types are supported as partition keys.

When you create a table used by Amazon Athena, and you do not specify any partitionKeys, you must at least set the value of partitionKeys to an empty list. For example:

"PartitionKeys": []

tableInput_retention :: Lens' TableInput (Maybe Natural) Source #

The retention time for this table.

tableInput_storageDescriptor :: Lens' TableInput (Maybe StorageDescriptor) Source #

A storage descriptor containing information about the physical storage of this table.

tableInput_tableType :: Lens' TableInput (Maybe Text) Source #

The type of this table (EXTERNAL_TABLE, VIRTUAL_VIEW, etc.).

tableInput_targetTable :: Lens' TableInput (Maybe TableIdentifier) Source #

A TableIdentifier structure that describes a target table for resource linking.

tableInput_viewExpandedText :: Lens' TableInput (Maybe Text) Source #

If the table is a view, the expanded text of the view; otherwise null.

tableInput_viewOriginalText :: Lens' TableInput (Maybe Text) Source #

If the table is a view, the original text of the view; otherwise null.

tableInput_name :: Lens' TableInput Text Source #

The table name. For Hive compatibility, this is folded to lowercase when it is stored.

TableVersion

data TableVersion Source #

Specifies a version of a table.

See: newTableVersion smart constructor.

Constructors

TableVersion' 

Fields

  • table :: Maybe Table

    The table in question.

  • versionId :: Maybe Text

    The ID value that identifies this table version. A VersionId is a string representation of an integer. Each version is incremented by 1.

Instances

Instances details
FromJSON TableVersion Source # 
Instance details

Defined in Amazonka.Glue.Types.TableVersion

Generic TableVersion Source # 
Instance details

Defined in Amazonka.Glue.Types.TableVersion

Associated Types

type Rep TableVersion :: Type -> Type #

Read TableVersion Source # 
Instance details

Defined in Amazonka.Glue.Types.TableVersion

Show TableVersion Source # 
Instance details

Defined in Amazonka.Glue.Types.TableVersion

NFData TableVersion Source # 
Instance details

Defined in Amazonka.Glue.Types.TableVersion

Methods

rnf :: TableVersion -> () #

Eq TableVersion Source # 
Instance details

Defined in Amazonka.Glue.Types.TableVersion

Hashable TableVersion Source # 
Instance details

Defined in Amazonka.Glue.Types.TableVersion

type Rep TableVersion Source # 
Instance details

Defined in Amazonka.Glue.Types.TableVersion

type Rep TableVersion = D1 ('MetaData "TableVersion" "Amazonka.Glue.Types.TableVersion" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "TableVersion'" 'PrefixI 'True) (S1 ('MetaSel ('Just "table") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Table)) :*: S1 ('MetaSel ('Just "versionId") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text))))

newTableVersion :: TableVersion Source #

Create a value of TableVersion with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:table:TableVersion', tableVersion_table - The table in question.

TableVersion, tableVersion_versionId - The ID value that identifies this table version. A VersionId is a string representation of an integer. Each version is incremented by 1.

tableVersion_versionId :: Lens' TableVersion (Maybe Text) Source #

The ID value that identifies this table version. A VersionId is a string representation of an integer. Each version is incremented by 1.

TableVersionError

data TableVersionError Source #

An error record for table-version operations.

See: newTableVersionError smart constructor.

Constructors

TableVersionError' 

Fields

Instances

Instances details
FromJSON TableVersionError Source # 
Instance details

Defined in Amazonka.Glue.Types.TableVersionError

Generic TableVersionError Source # 
Instance details

Defined in Amazonka.Glue.Types.TableVersionError

Associated Types

type Rep TableVersionError :: Type -> Type #

Read TableVersionError Source # 
Instance details

Defined in Amazonka.Glue.Types.TableVersionError

Show TableVersionError Source # 
Instance details

Defined in Amazonka.Glue.Types.TableVersionError

NFData TableVersionError Source # 
Instance details

Defined in Amazonka.Glue.Types.TableVersionError

Methods

rnf :: TableVersionError -> () #

Eq TableVersionError Source # 
Instance details

Defined in Amazonka.Glue.Types.TableVersionError

Hashable TableVersionError Source # 
Instance details

Defined in Amazonka.Glue.Types.TableVersionError

type Rep TableVersionError Source # 
Instance details

Defined in Amazonka.Glue.Types.TableVersionError

type Rep TableVersionError = D1 ('MetaData "TableVersionError" "Amazonka.Glue.Types.TableVersionError" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "TableVersionError'" 'PrefixI 'True) (S1 ('MetaSel ('Just "errorDetail") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe ErrorDetail)) :*: (S1 ('MetaSel ('Just "tableName") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "versionId") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)))))

newTableVersionError :: TableVersionError Source #

Create a value of TableVersionError with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:errorDetail:TableVersionError', tableVersionError_errorDetail - The details about the error.

$sel:tableName:TableVersionError', tableVersionError_tableName - The name of the table in question.

$sel:versionId:TableVersionError', tableVersionError_versionId - The ID value of the version in question. A VersionID is a string representation of an integer. Each version is incremented by 1.

tableVersionError_tableName :: Lens' TableVersionError (Maybe Text) Source #

The name of the table in question.

tableVersionError_versionId :: Lens' TableVersionError (Maybe Text) Source #

The ID value of the version in question. A VersionID is a string representation of an integer. Each version is incremented by 1.

TaskRun

data TaskRun Source #

The sampling parameters that are associated with the machine learning transform.

See: newTaskRun smart constructor.

Constructors

TaskRun' 

Fields

Instances

Instances details
FromJSON TaskRun Source # 
Instance details

Defined in Amazonka.Glue.Types.TaskRun

Generic TaskRun Source # 
Instance details

Defined in Amazonka.Glue.Types.TaskRun

Associated Types

type Rep TaskRun :: Type -> Type #

Methods

from :: TaskRun -> Rep TaskRun x #

to :: Rep TaskRun x -> TaskRun #

Read TaskRun Source # 
Instance details

Defined in Amazonka.Glue.Types.TaskRun

Show TaskRun Source # 
Instance details

Defined in Amazonka.Glue.Types.TaskRun

NFData TaskRun Source # 
Instance details

Defined in Amazonka.Glue.Types.TaskRun

Methods

rnf :: TaskRun -> () #

Eq TaskRun Source # 
Instance details

Defined in Amazonka.Glue.Types.TaskRun

Methods

(==) :: TaskRun -> TaskRun -> Bool #

(/=) :: TaskRun -> TaskRun -> Bool #

Hashable TaskRun Source # 
Instance details

Defined in Amazonka.Glue.Types.TaskRun

Methods

hashWithSalt :: Int -> TaskRun -> Int #

hash :: TaskRun -> Int #

type Rep TaskRun Source # 
Instance details

Defined in Amazonka.Glue.Types.TaskRun

newTaskRun :: TaskRun Source #

Create a value of TaskRun with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:completedOn:TaskRun', taskRun_completedOn - The last point in time that the requested task run was completed.

$sel:errorString:TaskRun', taskRun_errorString - The list of error strings associated with this task run.

$sel:executionTime:TaskRun', taskRun_executionTime - The amount of time (in seconds) that the task run consumed resources.

$sel:lastModifiedOn:TaskRun', taskRun_lastModifiedOn - The last point in time that the requested task run was updated.

$sel:logGroupName:TaskRun', taskRun_logGroupName - The names of the log group for secure logging, associated with this task run.

$sel:properties:TaskRun', taskRun_properties - Specifies configuration properties associated with this task run.

$sel:startedOn:TaskRun', taskRun_startedOn - The date and time that this task run started.

$sel:status:TaskRun', taskRun_status - The current status of the requested task run.

$sel:taskRunId:TaskRun', taskRun_taskRunId - The unique identifier for this task run.

$sel:transformId:TaskRun', taskRun_transformId - The unique identifier for the transform.

taskRun_completedOn :: Lens' TaskRun (Maybe UTCTime) Source #

The last point in time that the requested task run was completed.

taskRun_errorString :: Lens' TaskRun (Maybe Text) Source #

The list of error strings associated with this task run.

taskRun_executionTime :: Lens' TaskRun (Maybe Int) Source #

The amount of time (in seconds) that the task run consumed resources.

taskRun_lastModifiedOn :: Lens' TaskRun (Maybe UTCTime) Source #

The last point in time that the requested task run was updated.

taskRun_logGroupName :: Lens' TaskRun (Maybe Text) Source #

The names of the log group for secure logging, associated with this task run.

taskRun_properties :: Lens' TaskRun (Maybe TaskRunProperties) Source #

Specifies configuration properties associated with this task run.

taskRun_startedOn :: Lens' TaskRun (Maybe UTCTime) Source #

The date and time that this task run started.

taskRun_status :: Lens' TaskRun (Maybe TaskStatusType) Source #

The current status of the requested task run.

taskRun_taskRunId :: Lens' TaskRun (Maybe Text) Source #

The unique identifier for this task run.

taskRun_transformId :: Lens' TaskRun (Maybe Text) Source #

The unique identifier for the transform.

TaskRunFilterCriteria

data TaskRunFilterCriteria Source #

The criteria that are used to filter the task runs for the machine learning transform.

See: newTaskRunFilterCriteria smart constructor.

Constructors

TaskRunFilterCriteria' 

Fields

Instances

Instances details
ToJSON TaskRunFilterCriteria Source # 
Instance details

Defined in Amazonka.Glue.Types.TaskRunFilterCriteria

Generic TaskRunFilterCriteria Source # 
Instance details

Defined in Amazonka.Glue.Types.TaskRunFilterCriteria

Associated Types

type Rep TaskRunFilterCriteria :: Type -> Type #

Read TaskRunFilterCriteria Source # 
Instance details

Defined in Amazonka.Glue.Types.TaskRunFilterCriteria

Show TaskRunFilterCriteria Source # 
Instance details

Defined in Amazonka.Glue.Types.TaskRunFilterCriteria

NFData TaskRunFilterCriteria Source # 
Instance details

Defined in Amazonka.Glue.Types.TaskRunFilterCriteria

Methods

rnf :: TaskRunFilterCriteria -> () #

Eq TaskRunFilterCriteria Source # 
Instance details

Defined in Amazonka.Glue.Types.TaskRunFilterCriteria

Hashable TaskRunFilterCriteria Source # 
Instance details

Defined in Amazonka.Glue.Types.TaskRunFilterCriteria

type Rep TaskRunFilterCriteria Source # 
Instance details

Defined in Amazonka.Glue.Types.TaskRunFilterCriteria

type Rep TaskRunFilterCriteria = D1 ('MetaData "TaskRunFilterCriteria" "Amazonka.Glue.Types.TaskRunFilterCriteria" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "TaskRunFilterCriteria'" 'PrefixI 'True) ((S1 ('MetaSel ('Just "startedAfter") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe POSIX)) :*: S1 ('MetaSel ('Just "startedBefore") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe POSIX))) :*: (S1 ('MetaSel ('Just "status") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe TaskStatusType)) :*: S1 ('MetaSel ('Just "taskRunType") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe TaskType)))))

newTaskRunFilterCriteria :: TaskRunFilterCriteria Source #

Create a value of TaskRunFilterCriteria with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:startedAfter:TaskRunFilterCriteria', taskRunFilterCriteria_startedAfter - Filter on task runs started after this date.

$sel:startedBefore:TaskRunFilterCriteria', taskRunFilterCriteria_startedBefore - Filter on task runs started before this date.

$sel:status:TaskRunFilterCriteria', taskRunFilterCriteria_status - The current status of the task run.

$sel:taskRunType:TaskRunFilterCriteria', taskRunFilterCriteria_taskRunType - The type of task run.

taskRunFilterCriteria_startedAfter :: Lens' TaskRunFilterCriteria (Maybe UTCTime) Source #

Filter on task runs started after this date.

taskRunFilterCriteria_startedBefore :: Lens' TaskRunFilterCriteria (Maybe UTCTime) Source #

Filter on task runs started before this date.

TaskRunProperties

data TaskRunProperties Source #

The configuration properties for the task run.

See: newTaskRunProperties smart constructor.

Constructors

TaskRunProperties' 

Fields

Instances

Instances details
FromJSON TaskRunProperties Source # 
Instance details

Defined in Amazonka.Glue.Types.TaskRunProperties

Generic TaskRunProperties Source # 
Instance details

Defined in Amazonka.Glue.Types.TaskRunProperties

Associated Types

type Rep TaskRunProperties :: Type -> Type #

Read TaskRunProperties Source # 
Instance details

Defined in Amazonka.Glue.Types.TaskRunProperties

Show TaskRunProperties Source # 
Instance details

Defined in Amazonka.Glue.Types.TaskRunProperties

NFData TaskRunProperties Source # 
Instance details

Defined in Amazonka.Glue.Types.TaskRunProperties

Methods

rnf :: TaskRunProperties -> () #

Eq TaskRunProperties Source # 
Instance details

Defined in Amazonka.Glue.Types.TaskRunProperties

Hashable TaskRunProperties Source # 
Instance details

Defined in Amazonka.Glue.Types.TaskRunProperties

type Rep TaskRunProperties Source # 
Instance details

Defined in Amazonka.Glue.Types.TaskRunProperties

type Rep TaskRunProperties = D1 ('MetaData "TaskRunProperties" "Amazonka.Glue.Types.TaskRunProperties" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "TaskRunProperties'" 'PrefixI 'True) ((S1 ('MetaSel ('Just "exportLabelsTaskRunProperties") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe ExportLabelsTaskRunProperties)) :*: S1 ('MetaSel ('Just "findMatchesTaskRunProperties") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe FindMatchesTaskRunProperties))) :*: (S1 ('MetaSel ('Just "importLabelsTaskRunProperties") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe ImportLabelsTaskRunProperties)) :*: (S1 ('MetaSel ('Just "labelingSetGenerationTaskRunProperties") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe LabelingSetGenerationTaskRunProperties)) :*: S1 ('MetaSel ('Just "taskType") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe TaskType))))))

newTaskRunProperties :: TaskRunProperties Source #

Create a value of TaskRunProperties with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:exportLabelsTaskRunProperties:TaskRunProperties', taskRunProperties_exportLabelsTaskRunProperties - The configuration properties for an exporting labels task run.

$sel:findMatchesTaskRunProperties:TaskRunProperties', taskRunProperties_findMatchesTaskRunProperties - The configuration properties for a find matches task run.

$sel:importLabelsTaskRunProperties:TaskRunProperties', taskRunProperties_importLabelsTaskRunProperties - The configuration properties for an importing labels task run.

$sel:labelingSetGenerationTaskRunProperties:TaskRunProperties', taskRunProperties_labelingSetGenerationTaskRunProperties - The configuration properties for a labeling set generation task run.

$sel:taskType:TaskRunProperties', taskRunProperties_taskType - The type of task run.

TaskRunSortCriteria

data TaskRunSortCriteria Source #

The sorting criteria that are used to sort the list of task runs for the machine learning transform.

See: newTaskRunSortCriteria smart constructor.

Constructors

TaskRunSortCriteria' 

Fields

Instances

Instances details
ToJSON TaskRunSortCriteria Source # 
Instance details

Defined in Amazonka.Glue.Types.TaskRunSortCriteria

Generic TaskRunSortCriteria Source # 
Instance details

Defined in Amazonka.Glue.Types.TaskRunSortCriteria

Associated Types

type Rep TaskRunSortCriteria :: Type -> Type #

Read TaskRunSortCriteria Source # 
Instance details

Defined in Amazonka.Glue.Types.TaskRunSortCriteria

Show TaskRunSortCriteria Source # 
Instance details

Defined in Amazonka.Glue.Types.TaskRunSortCriteria

NFData TaskRunSortCriteria Source # 
Instance details

Defined in Amazonka.Glue.Types.TaskRunSortCriteria

Methods

rnf :: TaskRunSortCriteria -> () #

Eq TaskRunSortCriteria Source # 
Instance details

Defined in Amazonka.Glue.Types.TaskRunSortCriteria

Hashable TaskRunSortCriteria Source # 
Instance details

Defined in Amazonka.Glue.Types.TaskRunSortCriteria

type Rep TaskRunSortCriteria Source # 
Instance details

Defined in Amazonka.Glue.Types.TaskRunSortCriteria

type Rep TaskRunSortCriteria = D1 ('MetaData "TaskRunSortCriteria" "Amazonka.Glue.Types.TaskRunSortCriteria" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "TaskRunSortCriteria'" 'PrefixI 'True) (S1 ('MetaSel ('Just "column") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 TaskRunSortColumnType) :*: S1 ('MetaSel ('Just "sortDirection") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 SortDirectionType)))

newTaskRunSortCriteria Source #

Create a value of TaskRunSortCriteria with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:column:TaskRunSortCriteria', taskRunSortCriteria_column - The column to be used to sort the list of task runs for the machine learning transform.

$sel:sortDirection:TaskRunSortCriteria', taskRunSortCriteria_sortDirection - The sort direction to be used to sort the list of task runs for the machine learning transform.

taskRunSortCriteria_column :: Lens' TaskRunSortCriteria TaskRunSortColumnType Source #

The column to be used to sort the list of task runs for the machine learning transform.

taskRunSortCriteria_sortDirection :: Lens' TaskRunSortCriteria SortDirectionType Source #

The sort direction to be used to sort the list of task runs for the machine learning transform.

TransformConfigParameter

data TransformConfigParameter Source #

Specifies the parameters in the config file of the dynamic transform.

See: newTransformConfigParameter smart constructor.

Constructors

TransformConfigParameter' 

Fields

  • isOptional :: Maybe Bool

    Specifies whether the parameter is optional or not in the config file of the dynamic transform.

  • listType :: Maybe ParamType

    Specifies the list type of the parameter in the config file of the dynamic transform.

  • validationMessage :: Maybe Text

    Specifies the validation message in the config file of the dynamic transform.

  • validationRule :: Maybe Text

    Specifies the validation rule in the config file of the dynamic transform.

  • value :: Maybe [Text]

    Specifies the value of the parameter in the config file of the dynamic transform.

  • name :: Text

    Specifies the name of the parameter in the config file of the dynamic transform.

  • type' :: ParamType

    Specifies the parameter type in the config file of the dynamic transform.

Instances

Instances details
FromJSON TransformConfigParameter Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformConfigParameter

ToJSON TransformConfigParameter Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformConfigParameter

Generic TransformConfigParameter Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformConfigParameter

Associated Types

type Rep TransformConfigParameter :: Type -> Type #

Read TransformConfigParameter Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformConfigParameter

Show TransformConfigParameter Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformConfigParameter

NFData TransformConfigParameter Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformConfigParameter

Eq TransformConfigParameter Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformConfigParameter

Hashable TransformConfigParameter Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformConfigParameter

type Rep TransformConfigParameter Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformConfigParameter

type Rep TransformConfigParameter = D1 ('MetaData "TransformConfigParameter" "Amazonka.Glue.Types.TransformConfigParameter" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "TransformConfigParameter'" 'PrefixI 'True) ((S1 ('MetaSel ('Just "isOptional") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Bool)) :*: (S1 ('MetaSel ('Just "listType") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe ParamType)) :*: S1 ('MetaSel ('Just "validationMessage") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)))) :*: ((S1 ('MetaSel ('Just "validationRule") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "value") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe [Text]))) :*: (S1 ('MetaSel ('Just "name") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text) :*: S1 ('MetaSel ('Just "type'") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 ParamType)))))

newTransformConfigParameter Source #

Create a value of TransformConfigParameter with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:isOptional:TransformConfigParameter', transformConfigParameter_isOptional - Specifies whether the parameter is optional or not in the config file of the dynamic transform.

$sel:listType:TransformConfigParameter', transformConfigParameter_listType - Specifies the list type of the parameter in the config file of the dynamic transform.

$sel:validationMessage:TransformConfigParameter', transformConfigParameter_validationMessage - Specifies the validation message in the config file of the dynamic transform.

$sel:validationRule:TransformConfigParameter', transformConfigParameter_validationRule - Specifies the validation rule in the config file of the dynamic transform.

$sel:value:TransformConfigParameter', transformConfigParameter_value - Specifies the value of the parameter in the config file of the dynamic transform.

$sel:name:TransformConfigParameter', transformConfigParameter_name - Specifies the name of the parameter in the config file of the dynamic transform.

$sel:type':TransformConfigParameter', transformConfigParameter_type - Specifies the parameter type in the config file of the dynamic transform.

transformConfigParameter_isOptional :: Lens' TransformConfigParameter (Maybe Bool) Source #

Specifies whether the parameter is optional or not in the config file of the dynamic transform.

transformConfigParameter_listType :: Lens' TransformConfigParameter (Maybe ParamType) Source #

Specifies the list type of the parameter in the config file of the dynamic transform.

transformConfigParameter_validationMessage :: Lens' TransformConfigParameter (Maybe Text) Source #

Specifies the validation message in the config file of the dynamic transform.

transformConfigParameter_validationRule :: Lens' TransformConfigParameter (Maybe Text) Source #

Specifies the validation rule in the config file of the dynamic transform.

transformConfigParameter_value :: Lens' TransformConfigParameter (Maybe [Text]) Source #

Specifies the value of the parameter in the config file of the dynamic transform.

transformConfigParameter_name :: Lens' TransformConfigParameter Text Source #

Specifies the name of the parameter in the config file of the dynamic transform.

transformConfigParameter_type :: Lens' TransformConfigParameter ParamType Source #

Specifies the parameter type in the config file of the dynamic transform.

TransformEncryption

data TransformEncryption Source #

The encryption-at-rest settings of the transform that apply to accessing user data. Machine learning transforms can access user data encrypted in Amazon S3 using KMS.

Additionally, imported labels and trained transforms can now be encrypted using a customer provided KMS key.

See: newTransformEncryption smart constructor.

Constructors

TransformEncryption' 

Fields

Instances

Instances details
FromJSON TransformEncryption Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformEncryption

ToJSON TransformEncryption Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformEncryption

Generic TransformEncryption Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformEncryption

Associated Types

type Rep TransformEncryption :: Type -> Type #

Read TransformEncryption Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformEncryption

Show TransformEncryption Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformEncryption

NFData TransformEncryption Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformEncryption

Methods

rnf :: TransformEncryption -> () #

Eq TransformEncryption Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformEncryption

Hashable TransformEncryption Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformEncryption

type Rep TransformEncryption Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformEncryption

type Rep TransformEncryption = D1 ('MetaData "TransformEncryption" "Amazonka.Glue.Types.TransformEncryption" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "TransformEncryption'" 'PrefixI 'True) (S1 ('MetaSel ('Just "mlUserDataEncryption") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe MLUserDataEncryption)) :*: S1 ('MetaSel ('Just "taskRunSecurityConfigurationName") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text))))

newTransformEncryption :: TransformEncryption Source #

Create a value of TransformEncryption with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:mlUserDataEncryption:TransformEncryption', transformEncryption_mlUserDataEncryption - An MLUserDataEncryption object containing the encryption mode and customer-provided KMS key ID.

$sel:taskRunSecurityConfigurationName:TransformEncryption', transformEncryption_taskRunSecurityConfigurationName - The name of the security configuration.

transformEncryption_mlUserDataEncryption :: Lens' TransformEncryption (Maybe MLUserDataEncryption) Source #

An MLUserDataEncryption object containing the encryption mode and customer-provided KMS key ID.

TransformFilterCriteria

data TransformFilterCriteria Source #

The criteria used to filter the machine learning transforms.

See: newTransformFilterCriteria smart constructor.

Constructors

TransformFilterCriteria' 

Fields

  • createdAfter :: Maybe POSIX

    The time and date after which the transforms were created.

  • createdBefore :: Maybe POSIX

    The time and date before which the transforms were created.

  • glueVersion :: Maybe Text

    This value determines which version of Glue this machine learning transform is compatible with. Glue 1.0 is recommended for most customers. If the value is not set, the Glue compatibility defaults to Glue 0.9. For more information, see Glue Versions in the developer guide.

  • lastModifiedAfter :: Maybe POSIX

    Filter on transforms last modified after this date.

  • lastModifiedBefore :: Maybe POSIX

    Filter on transforms last modified before this date.

  • name :: Maybe Text

    A unique transform name that is used to filter the machine learning transforms.

  • schema :: Maybe [SchemaColumn]

    Filters on datasets with a specific schema. The Map<Column, Type> object is an array of key-value pairs representing the schema this transform accepts, where Column is the name of a column, and Type is the type of the data such as an integer or string. Has an upper bound of 100 columns.

  • status :: Maybe TransformStatusType

    Filters the list of machine learning transforms by the last known status of the transforms (to indicate whether a transform can be used or not). One of "NOT_READY", "READY", or "DELETING".

  • transformType :: Maybe TransformType

    The type of machine learning transform that is used to filter the machine learning transforms.

Instances

Instances details
ToJSON TransformFilterCriteria Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformFilterCriteria

Generic TransformFilterCriteria Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformFilterCriteria

Associated Types

type Rep TransformFilterCriteria :: Type -> Type #

Read TransformFilterCriteria Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformFilterCriteria

Show TransformFilterCriteria Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformFilterCriteria

NFData TransformFilterCriteria Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformFilterCriteria

Methods

rnf :: TransformFilterCriteria -> () #

Eq TransformFilterCriteria Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformFilterCriteria

Hashable TransformFilterCriteria Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformFilterCriteria

type Rep TransformFilterCriteria Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformFilterCriteria

newTransformFilterCriteria :: TransformFilterCriteria Source #

Create a value of TransformFilterCriteria with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:createdAfter:TransformFilterCriteria', transformFilterCriteria_createdAfter - The time and date after which the transforms were created.

$sel:createdBefore:TransformFilterCriteria', transformFilterCriteria_createdBefore - The time and date before which the transforms were created.

$sel:glueVersion:TransformFilterCriteria', transformFilterCriteria_glueVersion - This value determines which version of Glue this machine learning transform is compatible with. Glue 1.0 is recommended for most customers. If the value is not set, the Glue compatibility defaults to Glue 0.9. For more information, see Glue Versions in the developer guide.

$sel:lastModifiedAfter:TransformFilterCriteria', transformFilterCriteria_lastModifiedAfter - Filter on transforms last modified after this date.

$sel:lastModifiedBefore:TransformFilterCriteria', transformFilterCriteria_lastModifiedBefore - Filter on transforms last modified before this date.

TransformFilterCriteria, transformFilterCriteria_name - A unique transform name that is used to filter the machine learning transforms.

$sel:schema:TransformFilterCriteria', transformFilterCriteria_schema - Filters on datasets with a specific schema. The Map<Column, Type> object is an array of key-value pairs representing the schema this transform accepts, where Column is the name of a column, and Type is the type of the data such as an integer or string. Has an upper bound of 100 columns.

$sel:status:TransformFilterCriteria', transformFilterCriteria_status - Filters the list of machine learning transforms by the last known status of the transforms (to indicate whether a transform can be used or not). One of "NOT_READY", "READY", or "DELETING".

$sel:transformType:TransformFilterCriteria', transformFilterCriteria_transformType - The type of machine learning transform that is used to filter the machine learning transforms.

transformFilterCriteria_createdAfter :: Lens' TransformFilterCriteria (Maybe UTCTime) Source #

The time and date after which the transforms were created.

transformFilterCriteria_createdBefore :: Lens' TransformFilterCriteria (Maybe UTCTime) Source #

The time and date before which the transforms were created.

transformFilterCriteria_glueVersion :: Lens' TransformFilterCriteria (Maybe Text) Source #

This value determines which version of Glue this machine learning transform is compatible with. Glue 1.0 is recommended for most customers. If the value is not set, the Glue compatibility defaults to Glue 0.9. For more information, see Glue Versions in the developer guide.

transformFilterCriteria_lastModifiedAfter :: Lens' TransformFilterCriteria (Maybe UTCTime) Source #

Filter on transforms last modified after this date.

transformFilterCriteria_lastModifiedBefore :: Lens' TransformFilterCriteria (Maybe UTCTime) Source #

Filter on transforms last modified before this date.

transformFilterCriteria_name :: Lens' TransformFilterCriteria (Maybe Text) Source #

A unique transform name that is used to filter the machine learning transforms.

transformFilterCriteria_schema :: Lens' TransformFilterCriteria (Maybe [SchemaColumn]) Source #

Filters on datasets with a specific schema. The Map<Column, Type> object is an array of key-value pairs representing the schema this transform accepts, where Column is the name of a column, and Type is the type of the data such as an integer or string. Has an upper bound of 100 columns.

transformFilterCriteria_status :: Lens' TransformFilterCriteria (Maybe TransformStatusType) Source #

Filters the list of machine learning transforms by the last known status of the transforms (to indicate whether a transform can be used or not). One of "NOT_READY", "READY", or "DELETING".

transformFilterCriteria_transformType :: Lens' TransformFilterCriteria (Maybe TransformType) Source #

The type of machine learning transform that is used to filter the machine learning transforms.

TransformParameters

data TransformParameters Source #

The algorithm-specific parameters that are associated with the machine learning transform.

See: newTransformParameters smart constructor.

Constructors

TransformParameters' 

Fields

Instances

Instances details
FromJSON TransformParameters Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformParameters

ToJSON TransformParameters Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformParameters

Generic TransformParameters Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformParameters

Associated Types

type Rep TransformParameters :: Type -> Type #

Read TransformParameters Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformParameters

Show TransformParameters Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformParameters

NFData TransformParameters Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformParameters

Methods

rnf :: TransformParameters -> () #

Eq TransformParameters Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformParameters

Hashable TransformParameters Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformParameters

type Rep TransformParameters Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformParameters

type Rep TransformParameters = D1 ('MetaData "TransformParameters" "Amazonka.Glue.Types.TransformParameters" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "TransformParameters'" 'PrefixI 'True) (S1 ('MetaSel ('Just "findMatchesParameters") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe FindMatchesParameters)) :*: S1 ('MetaSel ('Just "transformType") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 TransformType)))

newTransformParameters Source #

Create a value of TransformParameters with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:findMatchesParameters:TransformParameters', transformParameters_findMatchesParameters - The parameters for the find matches algorithm.

$sel:transformType:TransformParameters', transformParameters_transformType - The type of machine learning transform.

For information about the types of machine learning transforms, see Creating Machine Learning Transforms.

transformParameters_transformType :: Lens' TransformParameters TransformType Source #

The type of machine learning transform.

For information about the types of machine learning transforms, see Creating Machine Learning Transforms.

TransformSortCriteria

data TransformSortCriteria Source #

The sorting criteria that are associated with the machine learning transform.

See: newTransformSortCriteria smart constructor.

Constructors

TransformSortCriteria' 

Fields

Instances

Instances details
ToJSON TransformSortCriteria Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformSortCriteria

Generic TransformSortCriteria Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformSortCriteria

Associated Types

type Rep TransformSortCriteria :: Type -> Type #

Read TransformSortCriteria Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformSortCriteria

Show TransformSortCriteria Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformSortCriteria

NFData TransformSortCriteria Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformSortCriteria

Methods

rnf :: TransformSortCriteria -> () #

Eq TransformSortCriteria Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformSortCriteria

Hashable TransformSortCriteria Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformSortCriteria

type Rep TransformSortCriteria Source # 
Instance details

Defined in Amazonka.Glue.Types.TransformSortCriteria

type Rep TransformSortCriteria = D1 ('MetaData "TransformSortCriteria" "Amazonka.Glue.Types.TransformSortCriteria" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "TransformSortCriteria'" 'PrefixI 'True) (S1 ('MetaSel ('Just "column") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 TransformSortColumnType) :*: S1 ('MetaSel ('Just "sortDirection") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 SortDirectionType)))

newTransformSortCriteria Source #

Create a value of TransformSortCriteria with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:column:TransformSortCriteria', transformSortCriteria_column - The column to be used in the sorting criteria that are associated with the machine learning transform.

$sel:sortDirection:TransformSortCriteria', transformSortCriteria_sortDirection - The sort direction to be used in the sorting criteria that are associated with the machine learning transform.

transformSortCriteria_column :: Lens' TransformSortCriteria TransformSortColumnType Source #

The column to be used in the sorting criteria that are associated with the machine learning transform.

transformSortCriteria_sortDirection :: Lens' TransformSortCriteria SortDirectionType Source #

The sort direction to be used in the sorting criteria that are associated with the machine learning transform.

Trigger

data Trigger Source #

Information about a specific trigger.

See: newTrigger smart constructor.

Constructors

Trigger' 

Fields

Instances

Instances details
FromJSON Trigger Source # 
Instance details

Defined in Amazonka.Glue.Types.Trigger

Generic Trigger Source # 
Instance details

Defined in Amazonka.Glue.Types.Trigger

Associated Types

type Rep Trigger :: Type -> Type #

Methods

from :: Trigger -> Rep Trigger x #

to :: Rep Trigger x -> Trigger #

Read Trigger Source # 
Instance details

Defined in Amazonka.Glue.Types.Trigger

Show Trigger Source # 
Instance details

Defined in Amazonka.Glue.Types.Trigger

NFData Trigger Source # 
Instance details

Defined in Amazonka.Glue.Types.Trigger

Methods

rnf :: Trigger -> () #

Eq Trigger Source # 
Instance details

Defined in Amazonka.Glue.Types.Trigger

Methods

(==) :: Trigger -> Trigger -> Bool #

(/=) :: Trigger -> Trigger -> Bool #

Hashable Trigger Source # 
Instance details

Defined in Amazonka.Glue.Types.Trigger

Methods

hashWithSalt :: Int -> Trigger -> Int #

hash :: Trigger -> Int #

type Rep Trigger Source # 
Instance details

Defined in Amazonka.Glue.Types.Trigger

newTrigger :: Trigger Source #

Create a value of Trigger with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:actions:Trigger', trigger_actions - The actions initiated by this trigger.

$sel:description:Trigger', trigger_description - A description of this trigger.

$sel:eventBatchingCondition:Trigger', trigger_eventBatchingCondition - Batch condition that must be met (specified number of events received or batch time window expired) before EventBridge event trigger fires.

$sel:id:Trigger', trigger_id - Reserved for future use.

$sel:name:Trigger', trigger_name - The name of the trigger.

$sel:predicate:Trigger', trigger_predicate - The predicate of this trigger, which defines when it will fire.

$sel:schedule:Trigger', trigger_schedule - A cron expression used to specify the schedule (see Time-Based Schedules for Jobs and Crawlers. For example, to run something every day at 12:15 UTC, you would specify: cron(15 12 * * ? *).

$sel:state:Trigger', trigger_state - The current state of the trigger.

$sel:type':Trigger', trigger_type - The type of trigger that this is.

$sel:workflowName:Trigger', trigger_workflowName - The name of the workflow associated with the trigger.

trigger_actions :: Lens' Trigger (Maybe [Action]) Source #

The actions initiated by this trigger.

trigger_description :: Lens' Trigger (Maybe Text) Source #

A description of this trigger.

trigger_eventBatchingCondition :: Lens' Trigger (Maybe EventBatchingCondition) Source #

Batch condition that must be met (specified number of events received or batch time window expired) before EventBridge event trigger fires.

trigger_id :: Lens' Trigger (Maybe Text) Source #

Reserved for future use.

trigger_name :: Lens' Trigger (Maybe Text) Source #

The name of the trigger.

trigger_predicate :: Lens' Trigger (Maybe Predicate) Source #

The predicate of this trigger, which defines when it will fire.

trigger_schedule :: Lens' Trigger (Maybe Text) Source #

A cron expression used to specify the schedule (see Time-Based Schedules for Jobs and Crawlers. For example, to run something every day at 12:15 UTC, you would specify: cron(15 12 * * ? *).

trigger_state :: Lens' Trigger (Maybe TriggerState) Source #

The current state of the trigger.

trigger_type :: Lens' Trigger (Maybe TriggerType) Source #

The type of trigger that this is.

trigger_workflowName :: Lens' Trigger (Maybe Text) Source #

The name of the workflow associated with the trigger.

TriggerNodeDetails

data TriggerNodeDetails Source #

The details of a Trigger node present in the workflow.

See: newTriggerNodeDetails smart constructor.

Constructors

TriggerNodeDetails' 

Fields

Instances

Instances details
FromJSON TriggerNodeDetails Source # 
Instance details

Defined in Amazonka.Glue.Types.TriggerNodeDetails

Generic TriggerNodeDetails Source # 
Instance details

Defined in Amazonka.Glue.Types.TriggerNodeDetails

Associated Types

type Rep TriggerNodeDetails :: Type -> Type #

Read TriggerNodeDetails Source # 
Instance details

Defined in Amazonka.Glue.Types.TriggerNodeDetails

Show TriggerNodeDetails Source # 
Instance details

Defined in Amazonka.Glue.Types.TriggerNodeDetails

NFData TriggerNodeDetails Source # 
Instance details

Defined in Amazonka.Glue.Types.TriggerNodeDetails

Methods

rnf :: TriggerNodeDetails -> () #

Eq TriggerNodeDetails Source # 
Instance details

Defined in Amazonka.Glue.Types.TriggerNodeDetails

Hashable TriggerNodeDetails Source # 
Instance details

Defined in Amazonka.Glue.Types.TriggerNodeDetails

type Rep TriggerNodeDetails Source # 
Instance details

Defined in Amazonka.Glue.Types.TriggerNodeDetails

type Rep TriggerNodeDetails = D1 ('MetaData "TriggerNodeDetails" "Amazonka.Glue.Types.TriggerNodeDetails" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "TriggerNodeDetails'" 'PrefixI 'True) (S1 ('MetaSel ('Just "trigger") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Trigger))))

newTriggerNodeDetails :: TriggerNodeDetails Source #

Create a value of TriggerNodeDetails with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:trigger:TriggerNodeDetails', triggerNodeDetails_trigger - The information of the trigger represented by the trigger node.

triggerNodeDetails_trigger :: Lens' TriggerNodeDetails (Maybe Trigger) Source #

The information of the trigger represented by the trigger node.

TriggerUpdate

data TriggerUpdate Source #

A structure used to provide information used to update a trigger. This object updates the previous trigger definition by overwriting it completely.

See: newTriggerUpdate smart constructor.

Constructors

TriggerUpdate' 

Fields

Instances

Instances details
ToJSON TriggerUpdate Source # 
Instance details

Defined in Amazonka.Glue.Types.TriggerUpdate

Generic TriggerUpdate Source # 
Instance details

Defined in Amazonka.Glue.Types.TriggerUpdate

Associated Types

type Rep TriggerUpdate :: Type -> Type #

Read TriggerUpdate Source # 
Instance details

Defined in Amazonka.Glue.Types.TriggerUpdate

Show TriggerUpdate Source # 
Instance details

Defined in Amazonka.Glue.Types.TriggerUpdate

NFData TriggerUpdate Source # 
Instance details

Defined in Amazonka.Glue.Types.TriggerUpdate

Methods

rnf :: TriggerUpdate -> () #

Eq TriggerUpdate Source # 
Instance details

Defined in Amazonka.Glue.Types.TriggerUpdate

Hashable TriggerUpdate Source # 
Instance details

Defined in Amazonka.Glue.Types.TriggerUpdate

type Rep TriggerUpdate Source # 
Instance details

Defined in Amazonka.Glue.Types.TriggerUpdate

newTriggerUpdate :: TriggerUpdate Source #

Create a value of TriggerUpdate with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:actions:TriggerUpdate', triggerUpdate_actions - The actions initiated by this trigger.

$sel:description:TriggerUpdate', triggerUpdate_description - A description of this trigger.

$sel:eventBatchingCondition:TriggerUpdate', triggerUpdate_eventBatchingCondition - Batch condition that must be met (specified number of events received or batch time window expired) before EventBridge event trigger fires.

$sel:name:TriggerUpdate', triggerUpdate_name - Reserved for future use.

$sel:predicate:TriggerUpdate', triggerUpdate_predicate - The predicate of this trigger, which defines when it will fire.

$sel:schedule:TriggerUpdate', triggerUpdate_schedule - A cron expression used to specify the schedule (see Time-Based Schedules for Jobs and Crawlers. For example, to run something every day at 12:15 UTC, you would specify: cron(15 12 * * ? *).

triggerUpdate_actions :: Lens' TriggerUpdate (Maybe [Action]) Source #

The actions initiated by this trigger.

triggerUpdate_description :: Lens' TriggerUpdate (Maybe Text) Source #

A description of this trigger.

triggerUpdate_eventBatchingCondition :: Lens' TriggerUpdate (Maybe EventBatchingCondition) Source #

Batch condition that must be met (specified number of events received or batch time window expired) before EventBridge event trigger fires.

triggerUpdate_name :: Lens' TriggerUpdate (Maybe Text) Source #

Reserved for future use.

triggerUpdate_predicate :: Lens' TriggerUpdate (Maybe Predicate) Source #

The predicate of this trigger, which defines when it will fire.

triggerUpdate_schedule :: Lens' TriggerUpdate (Maybe Text) Source #

A cron expression used to specify the schedule (see Time-Based Schedules for Jobs and Crawlers. For example, to run something every day at 12:15 UTC, you would specify: cron(15 12 * * ? *).

UnfilteredPartition

data UnfilteredPartition Source #

See: newUnfilteredPartition smart constructor.

Instances

Instances details
FromJSON UnfilteredPartition Source # 
Instance details

Defined in Amazonka.Glue.Types.UnfilteredPartition

Generic UnfilteredPartition Source # 
Instance details

Defined in Amazonka.Glue.Types.UnfilteredPartition

Associated Types

type Rep UnfilteredPartition :: Type -> Type #

Read UnfilteredPartition Source # 
Instance details

Defined in Amazonka.Glue.Types.UnfilteredPartition

Show UnfilteredPartition Source # 
Instance details

Defined in Amazonka.Glue.Types.UnfilteredPartition

NFData UnfilteredPartition Source # 
Instance details

Defined in Amazonka.Glue.Types.UnfilteredPartition

Methods

rnf :: UnfilteredPartition -> () #

Eq UnfilteredPartition Source # 
Instance details

Defined in Amazonka.Glue.Types.UnfilteredPartition

Hashable UnfilteredPartition Source # 
Instance details

Defined in Amazonka.Glue.Types.UnfilteredPartition

type Rep UnfilteredPartition Source # 
Instance details

Defined in Amazonka.Glue.Types.UnfilteredPartition

type Rep UnfilteredPartition = D1 ('MetaData "UnfilteredPartition" "Amazonka.Glue.Types.UnfilteredPartition" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "UnfilteredPartition'" 'PrefixI 'True) (S1 ('MetaSel ('Just "authorizedColumns") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe [Text])) :*: (S1 ('MetaSel ('Just "isRegisteredWithLakeFormation") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Bool)) :*: S1 ('MetaSel ('Just "partition") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Partition)))))

newUnfilteredPartition :: UnfilteredPartition Source #

Create a value of UnfilteredPartition with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:authorizedColumns:UnfilteredPartition', unfilteredPartition_authorizedColumns - Undocumented member.

$sel:isRegisteredWithLakeFormation:UnfilteredPartition', unfilteredPartition_isRegisteredWithLakeFormation - Undocumented member.

$sel:partition:UnfilteredPartition', unfilteredPartition_partition - Undocumented member.

Union

data Union Source #

Specifies a transform that combines the rows from two or more datasets into a single result.

See: newUnion smart constructor.

Constructors

Union' 

Fields

  • name :: Text

    The name of the transform node.

  • inputs :: NonEmpty Text

    The node ID inputs to the transform.

  • unionType :: UnionType

    Indicates the type of Union transform.

    Specify ALL to join all rows from data sources to the resulting DynamicFrame. The resulting union does not remove duplicate rows.

    Specify DISTINCT to remove duplicate rows in the resulting DynamicFrame.

Instances

Instances details
FromJSON Union Source # 
Instance details

Defined in Amazonka.Glue.Types.Union

ToJSON Union Source # 
Instance details

Defined in Amazonka.Glue.Types.Union

Generic Union Source # 
Instance details

Defined in Amazonka.Glue.Types.Union

Associated Types

type Rep Union :: Type -> Type #

Methods

from :: Union -> Rep Union x #

to :: Rep Union x -> Union #

Read Union Source # 
Instance details

Defined in Amazonka.Glue.Types.Union

Show Union Source # 
Instance details

Defined in Amazonka.Glue.Types.Union

Methods

showsPrec :: Int -> Union -> ShowS #

show :: Union -> String #

showList :: [Union] -> ShowS #

NFData Union Source # 
Instance details

Defined in Amazonka.Glue.Types.Union

Methods

rnf :: Union -> () #

Eq Union Source # 
Instance details

Defined in Amazonka.Glue.Types.Union

Methods

(==) :: Union -> Union -> Bool #

(/=) :: Union -> Union -> Bool #

Hashable Union Source # 
Instance details

Defined in Amazonka.Glue.Types.Union

Methods

hashWithSalt :: Int -> Union -> Int #

hash :: Union -> Int #

type Rep Union Source # 
Instance details

Defined in Amazonka.Glue.Types.Union

type Rep Union = D1 ('MetaData "Union" "Amazonka.Glue.Types.Union" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "Union'" 'PrefixI 'True) (S1 ('MetaSel ('Just "name") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text) :*: (S1 ('MetaSel ('Just "inputs") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (NonEmpty Text)) :*: S1 ('MetaSel ('Just "unionType") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 UnionType))))

newUnion Source #

Create a value of Union with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:name:Union', union_name - The name of the transform node.

$sel:inputs:Union', union_inputs - The node ID inputs to the transform.

$sel:unionType:Union', union_unionType - Indicates the type of Union transform.

Specify ALL to join all rows from data sources to the resulting DynamicFrame. The resulting union does not remove duplicate rows.

Specify DISTINCT to remove duplicate rows in the resulting DynamicFrame.

union_name :: Lens' Union Text Source #

The name of the transform node.

union_inputs :: Lens' Union (NonEmpty Text) Source #

The node ID inputs to the transform.

union_unionType :: Lens' Union UnionType Source #

Indicates the type of Union transform.

Specify ALL to join all rows from data sources to the resulting DynamicFrame. The resulting union does not remove duplicate rows.

Specify DISTINCT to remove duplicate rows in the resulting DynamicFrame.

UpdateCsvClassifierRequest

data UpdateCsvClassifierRequest Source #

Specifies a custom CSV classifier to be updated.

See: newUpdateCsvClassifierRequest smart constructor.

Constructors

UpdateCsvClassifierRequest' 

Fields

Instances

Instances details
ToJSON UpdateCsvClassifierRequest Source # 
Instance details

Defined in Amazonka.Glue.Types.UpdateCsvClassifierRequest

Generic UpdateCsvClassifierRequest Source # 
Instance details

Defined in Amazonka.Glue.Types.UpdateCsvClassifierRequest

Associated Types

type Rep UpdateCsvClassifierRequest :: Type -> Type #

Read UpdateCsvClassifierRequest Source # 
Instance details

Defined in Amazonka.Glue.Types.UpdateCsvClassifierRequest

Show UpdateCsvClassifierRequest Source # 
Instance details

Defined in Amazonka.Glue.Types.UpdateCsvClassifierRequest

NFData UpdateCsvClassifierRequest Source # 
Instance details

Defined in Amazonka.Glue.Types.UpdateCsvClassifierRequest

Eq UpdateCsvClassifierRequest Source # 
Instance details

Defined in Amazonka.Glue.Types.UpdateCsvClassifierRequest

Hashable UpdateCsvClassifierRequest Source # 
Instance details

Defined in Amazonka.Glue.Types.UpdateCsvClassifierRequest

type Rep UpdateCsvClassifierRequest Source # 
Instance details

Defined in Amazonka.Glue.Types.UpdateCsvClassifierRequest

type Rep UpdateCsvClassifierRequest = D1 ('MetaData "UpdateCsvClassifierRequest" "Amazonka.Glue.Types.UpdateCsvClassifierRequest" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "UpdateCsvClassifierRequest'" 'PrefixI 'True) (((S1 ('MetaSel ('Just "allowSingleColumn") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Bool)) :*: S1 ('MetaSel ('Just "containsHeader") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe CsvHeaderOption))) :*: (S1 ('MetaSel ('Just "customDatatypeConfigured") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Bool)) :*: S1 ('MetaSel ('Just "customDatatypes") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe [Text])))) :*: ((S1 ('MetaSel ('Just "delimiter") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "disableValueTrimming") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Bool))) :*: (S1 ('MetaSel ('Just "header") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe [Text])) :*: (S1 ('MetaSel ('Just "quoteSymbol") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "name") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text))))))

newUpdateCsvClassifierRequest Source #

Create a value of UpdateCsvClassifierRequest with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:allowSingleColumn:UpdateCsvClassifierRequest', updateCsvClassifierRequest_allowSingleColumn - Enables the processing of files that contain only one column.

$sel:containsHeader:UpdateCsvClassifierRequest', updateCsvClassifierRequest_containsHeader - Indicates whether the CSV file contains a header.

$sel:customDatatypeConfigured:UpdateCsvClassifierRequest', updateCsvClassifierRequest_customDatatypeConfigured - Specifies the configuration of custom datatypes.

$sel:customDatatypes:UpdateCsvClassifierRequest', updateCsvClassifierRequest_customDatatypes - Specifies a list of supported custom datatypes.

$sel:delimiter:UpdateCsvClassifierRequest', updateCsvClassifierRequest_delimiter - A custom symbol to denote what separates each column entry in the row.

$sel:disableValueTrimming:UpdateCsvClassifierRequest', updateCsvClassifierRequest_disableValueTrimming - Specifies not to trim values before identifying the type of column values. The default value is true.

$sel:header:UpdateCsvClassifierRequest', updateCsvClassifierRequest_header - A list of strings representing column names.

$sel:quoteSymbol:UpdateCsvClassifierRequest', updateCsvClassifierRequest_quoteSymbol - A custom symbol to denote what combines content into a single column value. It must be different from the column delimiter.

$sel:name:UpdateCsvClassifierRequest', updateCsvClassifierRequest_name - The name of the classifier.

updateCsvClassifierRequest_allowSingleColumn :: Lens' UpdateCsvClassifierRequest (Maybe Bool) Source #

Enables the processing of files that contain only one column.

updateCsvClassifierRequest_customDatatypes :: Lens' UpdateCsvClassifierRequest (Maybe [Text]) Source #

Specifies a list of supported custom datatypes.

updateCsvClassifierRequest_delimiter :: Lens' UpdateCsvClassifierRequest (Maybe Text) Source #

A custom symbol to denote what separates each column entry in the row.

updateCsvClassifierRequest_disableValueTrimming :: Lens' UpdateCsvClassifierRequest (Maybe Bool) Source #

Specifies not to trim values before identifying the type of column values. The default value is true.

updateCsvClassifierRequest_header :: Lens' UpdateCsvClassifierRequest (Maybe [Text]) Source #

A list of strings representing column names.

updateCsvClassifierRequest_quoteSymbol :: Lens' UpdateCsvClassifierRequest (Maybe Text) Source #

A custom symbol to denote what combines content into a single column value. It must be different from the column delimiter.

UpdateGrokClassifierRequest

data UpdateGrokClassifierRequest Source #

Specifies a grok classifier to update when passed to UpdateClassifier.

See: newUpdateGrokClassifierRequest smart constructor.

Constructors

UpdateGrokClassifierRequest' 

Fields

Instances

Instances details
ToJSON UpdateGrokClassifierRequest Source # 
Instance details

Defined in Amazonka.Glue.Types.UpdateGrokClassifierRequest

Generic UpdateGrokClassifierRequest Source # 
Instance details

Defined in Amazonka.Glue.Types.UpdateGrokClassifierRequest

Associated Types

type Rep UpdateGrokClassifierRequest :: Type -> Type #

Read UpdateGrokClassifierRequest Source # 
Instance details

Defined in Amazonka.Glue.Types.UpdateGrokClassifierRequest

Show UpdateGrokClassifierRequest Source # 
Instance details

Defined in Amazonka.Glue.Types.UpdateGrokClassifierRequest

NFData UpdateGrokClassifierRequest Source # 
Instance details

Defined in Amazonka.Glue.Types.UpdateGrokClassifierRequest

Eq UpdateGrokClassifierRequest Source # 
Instance details

Defined in Amazonka.Glue.Types.UpdateGrokClassifierRequest

Hashable UpdateGrokClassifierRequest Source # 
Instance details

Defined in Amazonka.Glue.Types.UpdateGrokClassifierRequest

type Rep UpdateGrokClassifierRequest Source # 
Instance details

Defined in Amazonka.Glue.Types.UpdateGrokClassifierRequest

type Rep UpdateGrokClassifierRequest = D1 ('MetaData "UpdateGrokClassifierRequest" "Amazonka.Glue.Types.UpdateGrokClassifierRequest" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "UpdateGrokClassifierRequest'" 'PrefixI 'True) ((S1 ('MetaSel ('Just "classification") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "customPatterns") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text))) :*: (S1 ('MetaSel ('Just "grokPattern") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "name") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text))))

newUpdateGrokClassifierRequest Source #

Create a value of UpdateGrokClassifierRequest with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:classification:UpdateGrokClassifierRequest', updateGrokClassifierRequest_classification - An identifier of the data format that the classifier matches, such as Twitter, JSON, Omniture logs, Amazon CloudWatch Logs, and so on.

$sel:customPatterns:UpdateGrokClassifierRequest', updateGrokClassifierRequest_customPatterns - Optional custom grok patterns used by this classifier.

$sel:grokPattern:UpdateGrokClassifierRequest', updateGrokClassifierRequest_grokPattern - The grok pattern used by this classifier.

$sel:name:UpdateGrokClassifierRequest', updateGrokClassifierRequest_name - The name of the GrokClassifier.

updateGrokClassifierRequest_classification :: Lens' UpdateGrokClassifierRequest (Maybe Text) Source #

An identifier of the data format that the classifier matches, such as Twitter, JSON, Omniture logs, Amazon CloudWatch Logs, and so on.

updateGrokClassifierRequest_customPatterns :: Lens' UpdateGrokClassifierRequest (Maybe Text) Source #

Optional custom grok patterns used by this classifier.

UpdateJsonClassifierRequest

data UpdateJsonClassifierRequest Source #

Specifies a JSON classifier to be updated.

See: newUpdateJsonClassifierRequest smart constructor.

Constructors

UpdateJsonClassifierRequest' 

Fields

Instances

Instances details
ToJSON UpdateJsonClassifierRequest Source # 
Instance details

Defined in Amazonka.Glue.Types.UpdateJsonClassifierRequest

Generic UpdateJsonClassifierRequest Source # 
Instance details

Defined in Amazonka.Glue.Types.UpdateJsonClassifierRequest

Associated Types

type Rep UpdateJsonClassifierRequest :: Type -> Type #

Read UpdateJsonClassifierRequest Source # 
Instance details

Defined in Amazonka.Glue.Types.UpdateJsonClassifierRequest

Show UpdateJsonClassifierRequest Source # 
Instance details

Defined in Amazonka.Glue.Types.UpdateJsonClassifierRequest

NFData UpdateJsonClassifierRequest Source # 
Instance details

Defined in Amazonka.Glue.Types.UpdateJsonClassifierRequest

Eq UpdateJsonClassifierRequest Source # 
Instance details

Defined in Amazonka.Glue.Types.UpdateJsonClassifierRequest

Hashable UpdateJsonClassifierRequest Source # 
Instance details

Defined in Amazonka.Glue.Types.UpdateJsonClassifierRequest

type Rep UpdateJsonClassifierRequest Source # 
Instance details

Defined in Amazonka.Glue.Types.UpdateJsonClassifierRequest

type Rep UpdateJsonClassifierRequest = D1 ('MetaData "UpdateJsonClassifierRequest" "Amazonka.Glue.Types.UpdateJsonClassifierRequest" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "UpdateJsonClassifierRequest'" 'PrefixI 'True) (S1 ('MetaSel ('Just "jsonPath") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "name") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text)))

newUpdateJsonClassifierRequest Source #

Create a value of UpdateJsonClassifierRequest with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:jsonPath:UpdateJsonClassifierRequest', updateJsonClassifierRequest_jsonPath - A JsonPath string defining the JSON data for the classifier to classify. Glue supports a subset of JsonPath, as described in Writing JsonPath Custom Classifiers.

$sel:name:UpdateJsonClassifierRequest', updateJsonClassifierRequest_name - The name of the classifier.

updateJsonClassifierRequest_jsonPath :: Lens' UpdateJsonClassifierRequest (Maybe Text) Source #

A JsonPath string defining the JSON data for the classifier to classify. Glue supports a subset of JsonPath, as described in Writing JsonPath Custom Classifiers.

UpdateXMLClassifierRequest

data UpdateXMLClassifierRequest Source #

Specifies an XML classifier to be updated.

See: newUpdateXMLClassifierRequest smart constructor.

Constructors

UpdateXMLClassifierRequest' 

Fields

  • classification :: Maybe Text

    An identifier of the data format that the classifier matches.

  • rowTag :: Maybe Text

    The XML tag designating the element that contains each record in an XML document being parsed. This cannot identify a self-closing element (closed by />). An empty row element that contains only attributes can be parsed as long as it ends with a closing tag (for example, <row item_a="A" item_b="B"></row> is okay, but <row item_a="A" item_b="B" /> is not).

  • name :: Text

    The name of the classifier.

Instances

Instances details
ToJSON UpdateXMLClassifierRequest Source # 
Instance details

Defined in Amazonka.Glue.Types.UpdateXMLClassifierRequest

Generic UpdateXMLClassifierRequest Source # 
Instance details

Defined in Amazonka.Glue.Types.UpdateXMLClassifierRequest

Associated Types

type Rep UpdateXMLClassifierRequest :: Type -> Type #

Read UpdateXMLClassifierRequest Source # 
Instance details

Defined in Amazonka.Glue.Types.UpdateXMLClassifierRequest

Show UpdateXMLClassifierRequest Source # 
Instance details

Defined in Amazonka.Glue.Types.UpdateXMLClassifierRequest

NFData UpdateXMLClassifierRequest Source # 
Instance details

Defined in Amazonka.Glue.Types.UpdateXMLClassifierRequest

Eq UpdateXMLClassifierRequest Source # 
Instance details

Defined in Amazonka.Glue.Types.UpdateXMLClassifierRequest

Hashable UpdateXMLClassifierRequest Source # 
Instance details

Defined in Amazonka.Glue.Types.UpdateXMLClassifierRequest

type Rep UpdateXMLClassifierRequest Source # 
Instance details

Defined in Amazonka.Glue.Types.UpdateXMLClassifierRequest

type Rep UpdateXMLClassifierRequest = D1 ('MetaData "UpdateXMLClassifierRequest" "Amazonka.Glue.Types.UpdateXMLClassifierRequest" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "UpdateXMLClassifierRequest'" 'PrefixI 'True) (S1 ('MetaSel ('Just "classification") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: (S1 ('MetaSel ('Just "rowTag") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "name") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text))))

newUpdateXMLClassifierRequest Source #

Create a value of UpdateXMLClassifierRequest with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:classification:UpdateXMLClassifierRequest', updateXMLClassifierRequest_classification - An identifier of the data format that the classifier matches.

$sel:rowTag:UpdateXMLClassifierRequest', updateXMLClassifierRequest_rowTag - The XML tag designating the element that contains each record in an XML document being parsed. This cannot identify a self-closing element (closed by />). An empty row element that contains only attributes can be parsed as long as it ends with a closing tag (for example, <row item_a="A" item_b="B"></row> is okay, but <row item_a="A" item_b="B" /> is not).

$sel:name:UpdateXMLClassifierRequest', updateXMLClassifierRequest_name - The name of the classifier.

updateXMLClassifierRequest_classification :: Lens' UpdateXMLClassifierRequest (Maybe Text) Source #

An identifier of the data format that the classifier matches.

updateXMLClassifierRequest_rowTag :: Lens' UpdateXMLClassifierRequest (Maybe Text) Source #

The XML tag designating the element that contains each record in an XML document being parsed. This cannot identify a self-closing element (closed by />). An empty row element that contains only attributes can be parsed as long as it ends with a closing tag (for example, <row item_a="A" item_b="B"></row> is okay, but <row item_a="A" item_b="B" /> is not).

UpsertRedshiftTargetOptions

data UpsertRedshiftTargetOptions Source #

The options to configure an upsert operation when writing to a Redshift target .

See: newUpsertRedshiftTargetOptions smart constructor.

Constructors

UpsertRedshiftTargetOptions' 

Fields

Instances

Instances details
FromJSON UpsertRedshiftTargetOptions Source # 
Instance details

Defined in Amazonka.Glue.Types.UpsertRedshiftTargetOptions

ToJSON UpsertRedshiftTargetOptions Source # 
Instance details

Defined in Amazonka.Glue.Types.UpsertRedshiftTargetOptions

Generic UpsertRedshiftTargetOptions Source # 
Instance details

Defined in Amazonka.Glue.Types.UpsertRedshiftTargetOptions

Associated Types

type Rep UpsertRedshiftTargetOptions :: Type -> Type #

Read UpsertRedshiftTargetOptions Source # 
Instance details

Defined in Amazonka.Glue.Types.UpsertRedshiftTargetOptions

Show UpsertRedshiftTargetOptions Source # 
Instance details

Defined in Amazonka.Glue.Types.UpsertRedshiftTargetOptions

NFData UpsertRedshiftTargetOptions Source # 
Instance details

Defined in Amazonka.Glue.Types.UpsertRedshiftTargetOptions

Eq UpsertRedshiftTargetOptions Source # 
Instance details

Defined in Amazonka.Glue.Types.UpsertRedshiftTargetOptions

Hashable UpsertRedshiftTargetOptions Source # 
Instance details

Defined in Amazonka.Glue.Types.UpsertRedshiftTargetOptions

type Rep UpsertRedshiftTargetOptions Source # 
Instance details

Defined in Amazonka.Glue.Types.UpsertRedshiftTargetOptions

type Rep UpsertRedshiftTargetOptions = D1 ('MetaData "UpsertRedshiftTargetOptions" "Amazonka.Glue.Types.UpsertRedshiftTargetOptions" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "UpsertRedshiftTargetOptions'" 'PrefixI 'True) (S1 ('MetaSel ('Just "connectionName") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: (S1 ('MetaSel ('Just "tableLocation") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "upsertKeys") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe [Text])))))

newUpsertRedshiftTargetOptions :: UpsertRedshiftTargetOptions Source #

Create a value of UpsertRedshiftTargetOptions with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:connectionName:UpsertRedshiftTargetOptions', upsertRedshiftTargetOptions_connectionName - The name of the connection to use to write to Redshift.

$sel:tableLocation:UpsertRedshiftTargetOptions', upsertRedshiftTargetOptions_tableLocation - The physical location of the Redshift table.

$sel:upsertKeys:UpsertRedshiftTargetOptions', upsertRedshiftTargetOptions_upsertKeys - The keys used to determine whether to perform an update or insert.

upsertRedshiftTargetOptions_connectionName :: Lens' UpsertRedshiftTargetOptions (Maybe Text) Source #

The name of the connection to use to write to Redshift.

upsertRedshiftTargetOptions_upsertKeys :: Lens' UpsertRedshiftTargetOptions (Maybe [Text]) Source #

The keys used to determine whether to perform an update or insert.

UserDefinedFunction

data UserDefinedFunction Source #

Represents the equivalent of a Hive user-defined function (UDF) definition.

See: newUserDefinedFunction smart constructor.

Constructors

UserDefinedFunction' 

Fields

Instances

Instances details
FromJSON UserDefinedFunction Source # 
Instance details

Defined in Amazonka.Glue.Types.UserDefinedFunction

Generic UserDefinedFunction Source # 
Instance details

Defined in Amazonka.Glue.Types.UserDefinedFunction

Associated Types

type Rep UserDefinedFunction :: Type -> Type #

Read UserDefinedFunction Source # 
Instance details

Defined in Amazonka.Glue.Types.UserDefinedFunction

Show UserDefinedFunction Source # 
Instance details

Defined in Amazonka.Glue.Types.UserDefinedFunction

NFData UserDefinedFunction Source # 
Instance details

Defined in Amazonka.Glue.Types.UserDefinedFunction

Methods

rnf :: UserDefinedFunction -> () #

Eq UserDefinedFunction Source # 
Instance details

Defined in Amazonka.Glue.Types.UserDefinedFunction

Hashable UserDefinedFunction Source # 
Instance details

Defined in Amazonka.Glue.Types.UserDefinedFunction

type Rep UserDefinedFunction Source # 
Instance details

Defined in Amazonka.Glue.Types.UserDefinedFunction

newUserDefinedFunction :: UserDefinedFunction Source #

Create a value of UserDefinedFunction with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:catalogId:UserDefinedFunction', userDefinedFunction_catalogId - The ID of the Data Catalog in which the function resides.

$sel:className:UserDefinedFunction', userDefinedFunction_className - The Java class that contains the function code.

$sel:createTime:UserDefinedFunction', userDefinedFunction_createTime - The time at which the function was created.

$sel:databaseName:UserDefinedFunction', userDefinedFunction_databaseName - The name of the catalog database that contains the function.

$sel:functionName:UserDefinedFunction', userDefinedFunction_functionName - The name of the function.

$sel:ownerName:UserDefinedFunction', userDefinedFunction_ownerName - The owner of the function.

$sel:ownerType:UserDefinedFunction', userDefinedFunction_ownerType - The owner type.

$sel:resourceUris:UserDefinedFunction', userDefinedFunction_resourceUris - The resource URIs for the function.

userDefinedFunction_catalogId :: Lens' UserDefinedFunction (Maybe Text) Source #

The ID of the Data Catalog in which the function resides.

userDefinedFunction_className :: Lens' UserDefinedFunction (Maybe Text) Source #

The Java class that contains the function code.

userDefinedFunction_createTime :: Lens' UserDefinedFunction (Maybe UTCTime) Source #

The time at which the function was created.

userDefinedFunction_databaseName :: Lens' UserDefinedFunction (Maybe Text) Source #

The name of the catalog database that contains the function.

UserDefinedFunctionInput

data UserDefinedFunctionInput Source #

A structure used to create or update a user-defined function.

See: newUserDefinedFunctionInput smart constructor.

Constructors

UserDefinedFunctionInput' 

Fields

Instances

Instances details
ToJSON UserDefinedFunctionInput Source # 
Instance details

Defined in Amazonka.Glue.Types.UserDefinedFunctionInput

Generic UserDefinedFunctionInput Source # 
Instance details

Defined in Amazonka.Glue.Types.UserDefinedFunctionInput

Associated Types

type Rep UserDefinedFunctionInput :: Type -> Type #

Read UserDefinedFunctionInput Source # 
Instance details

Defined in Amazonka.Glue.Types.UserDefinedFunctionInput

Show UserDefinedFunctionInput Source # 
Instance details

Defined in Amazonka.Glue.Types.UserDefinedFunctionInput

NFData UserDefinedFunctionInput Source # 
Instance details

Defined in Amazonka.Glue.Types.UserDefinedFunctionInput

Eq UserDefinedFunctionInput Source # 
Instance details

Defined in Amazonka.Glue.Types.UserDefinedFunctionInput

Hashable UserDefinedFunctionInput Source # 
Instance details

Defined in Amazonka.Glue.Types.UserDefinedFunctionInput

type Rep UserDefinedFunctionInput Source # 
Instance details

Defined in Amazonka.Glue.Types.UserDefinedFunctionInput

type Rep UserDefinedFunctionInput = D1 ('MetaData "UserDefinedFunctionInput" "Amazonka.Glue.Types.UserDefinedFunctionInput" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "UserDefinedFunctionInput'" 'PrefixI 'True) ((S1 ('MetaSel ('Just "className") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "functionName") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text))) :*: (S1 ('MetaSel ('Just "ownerName") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: (S1 ('MetaSel ('Just "ownerType") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe PrincipalType)) :*: S1 ('MetaSel ('Just "resourceUris") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe [ResourceUri]))))))

newUserDefinedFunctionInput :: UserDefinedFunctionInput Source #

Create a value of UserDefinedFunctionInput with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:className:UserDefinedFunctionInput', userDefinedFunctionInput_className - The Java class that contains the function code.

$sel:functionName:UserDefinedFunctionInput', userDefinedFunctionInput_functionName - The name of the function.

$sel:ownerName:UserDefinedFunctionInput', userDefinedFunctionInput_ownerName - The owner of the function.

$sel:ownerType:UserDefinedFunctionInput', userDefinedFunctionInput_ownerType - The owner type.

$sel:resourceUris:UserDefinedFunctionInput', userDefinedFunctionInput_resourceUris - The resource URIs for the function.

userDefinedFunctionInput_className :: Lens' UserDefinedFunctionInput (Maybe Text) Source #

The Java class that contains the function code.

Workflow

data Workflow Source #

A workflow is a collection of multiple dependent Glue jobs and crawlers that are run to complete a complex ETL task. A workflow manages the execution and monitoring of all its jobs and crawlers.

See: newWorkflow smart constructor.

Constructors

Workflow' 

Fields

  • blueprintDetails :: Maybe BlueprintDetails

    This structure indicates the details of the blueprint that this particular workflow is created from.

  • createdOn :: Maybe POSIX

    The date and time when the workflow was created.

  • defaultRunProperties :: Maybe (HashMap Text Text)

    A collection of properties to be used as part of each execution of the workflow. The run properties are made available to each job in the workflow. A job can modify the properties for the next jobs in the flow.

  • description :: Maybe Text

    A description of the workflow.

  • graph :: Maybe WorkflowGraph

    The graph representing all the Glue components that belong to the workflow as nodes and directed connections between them as edges.

  • lastModifiedOn :: Maybe POSIX

    The date and time when the workflow was last modified.

  • lastRun :: Maybe WorkflowRun

    The information about the last execution of the workflow.

  • maxConcurrentRuns :: Maybe Int

    You can use this parameter to prevent unwanted multiple updates to data, to control costs, or in some cases, to prevent exceeding the maximum number of concurrent runs of any of the component jobs. If you leave this parameter blank, there is no limit to the number of concurrent workflow runs.

  • name :: Maybe Text

    The name of the workflow.

Instances

Instances details
FromJSON Workflow Source # 
Instance details

Defined in Amazonka.Glue.Types.Workflow

Generic Workflow Source # 
Instance details

Defined in Amazonka.Glue.Types.Workflow

Associated Types

type Rep Workflow :: Type -> Type #

Methods

from :: Workflow -> Rep Workflow x #

to :: Rep Workflow x -> Workflow #

Read Workflow Source # 
Instance details

Defined in Amazonka.Glue.Types.Workflow

Show Workflow Source # 
Instance details

Defined in Amazonka.Glue.Types.Workflow

NFData Workflow Source # 
Instance details

Defined in Amazonka.Glue.Types.Workflow

Methods

rnf :: Workflow -> () #

Eq Workflow Source # 
Instance details

Defined in Amazonka.Glue.Types.Workflow

Hashable Workflow Source # 
Instance details

Defined in Amazonka.Glue.Types.Workflow

Methods

hashWithSalt :: Int -> Workflow -> Int #

hash :: Workflow -> Int #

type Rep Workflow Source # 
Instance details

Defined in Amazonka.Glue.Types.Workflow

newWorkflow :: Workflow Source #

Create a value of Workflow with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:blueprintDetails:Workflow', workflow_blueprintDetails - This structure indicates the details of the blueprint that this particular workflow is created from.

$sel:createdOn:Workflow', workflow_createdOn - The date and time when the workflow was created.

$sel:defaultRunProperties:Workflow', workflow_defaultRunProperties - A collection of properties to be used as part of each execution of the workflow. The run properties are made available to each job in the workflow. A job can modify the properties for the next jobs in the flow.

$sel:description:Workflow', workflow_description - A description of the workflow.

Workflow, workflow_graph - The graph representing all the Glue components that belong to the workflow as nodes and directed connections between them as edges.

$sel:lastModifiedOn:Workflow', workflow_lastModifiedOn - The date and time when the workflow was last modified.

$sel:lastRun:Workflow', workflow_lastRun - The information about the last execution of the workflow.

$sel:maxConcurrentRuns:Workflow', workflow_maxConcurrentRuns - You can use this parameter to prevent unwanted multiple updates to data, to control costs, or in some cases, to prevent exceeding the maximum number of concurrent runs of any of the component jobs. If you leave this parameter blank, there is no limit to the number of concurrent workflow runs.

Workflow, workflow_name - The name of the workflow.

workflow_blueprintDetails :: Lens' Workflow (Maybe BlueprintDetails) Source #

This structure indicates the details of the blueprint that this particular workflow is created from.

workflow_createdOn :: Lens' Workflow (Maybe UTCTime) Source #

The date and time when the workflow was created.

workflow_defaultRunProperties :: Lens' Workflow (Maybe (HashMap Text Text)) Source #

A collection of properties to be used as part of each execution of the workflow. The run properties are made available to each job in the workflow. A job can modify the properties for the next jobs in the flow.

workflow_description :: Lens' Workflow (Maybe Text) Source #

A description of the workflow.

workflow_graph :: Lens' Workflow (Maybe WorkflowGraph) Source #

The graph representing all the Glue components that belong to the workflow as nodes and directed connections between them as edges.

workflow_lastModifiedOn :: Lens' Workflow (Maybe UTCTime) Source #

The date and time when the workflow was last modified.

workflow_lastRun :: Lens' Workflow (Maybe WorkflowRun) Source #

The information about the last execution of the workflow.

workflow_maxConcurrentRuns :: Lens' Workflow (Maybe Int) Source #

You can use this parameter to prevent unwanted multiple updates to data, to control costs, or in some cases, to prevent exceeding the maximum number of concurrent runs of any of the component jobs. If you leave this parameter blank, there is no limit to the number of concurrent workflow runs.

workflow_name :: Lens' Workflow (Maybe Text) Source #

The name of the workflow.

WorkflowGraph

data WorkflowGraph Source #

A workflow graph represents the complete workflow containing all the Glue components present in the workflow and all the directed connections between them.

See: newWorkflowGraph smart constructor.

Constructors

WorkflowGraph' 

Fields

  • edges :: Maybe [Edge]

    A list of all the directed connections between the nodes belonging to the workflow.

  • nodes :: Maybe [Node]

    A list of the the Glue components belong to the workflow represented as nodes.

Instances

Instances details
FromJSON WorkflowGraph Source # 
Instance details

Defined in Amazonka.Glue.Types.WorkflowGraph

Generic WorkflowGraph Source # 
Instance details

Defined in Amazonka.Glue.Types.WorkflowGraph

Associated Types

type Rep WorkflowGraph :: Type -> Type #

Read WorkflowGraph Source # 
Instance details

Defined in Amazonka.Glue.Types.WorkflowGraph

Show WorkflowGraph Source # 
Instance details

Defined in Amazonka.Glue.Types.WorkflowGraph

NFData WorkflowGraph Source # 
Instance details

Defined in Amazonka.Glue.Types.WorkflowGraph

Methods

rnf :: WorkflowGraph -> () #

Eq WorkflowGraph Source # 
Instance details

Defined in Amazonka.Glue.Types.WorkflowGraph

Hashable WorkflowGraph Source # 
Instance details

Defined in Amazonka.Glue.Types.WorkflowGraph

type Rep WorkflowGraph Source # 
Instance details

Defined in Amazonka.Glue.Types.WorkflowGraph

type Rep WorkflowGraph = D1 ('MetaData "WorkflowGraph" "Amazonka.Glue.Types.WorkflowGraph" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "WorkflowGraph'" 'PrefixI 'True) (S1 ('MetaSel ('Just "edges") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe [Edge])) :*: S1 ('MetaSel ('Just "nodes") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe [Node]))))

newWorkflowGraph :: WorkflowGraph Source #

Create a value of WorkflowGraph with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:edges:WorkflowGraph', workflowGraph_edges - A list of all the directed connections between the nodes belonging to the workflow.

$sel:nodes:WorkflowGraph', workflowGraph_nodes - A list of the the Glue components belong to the workflow represented as nodes.

workflowGraph_edges :: Lens' WorkflowGraph (Maybe [Edge]) Source #

A list of all the directed connections between the nodes belonging to the workflow.

workflowGraph_nodes :: Lens' WorkflowGraph (Maybe [Node]) Source #

A list of the the Glue components belong to the workflow represented as nodes.

WorkflowRun

data WorkflowRun Source #

A workflow run is an execution of a workflow providing all the runtime information.

See: newWorkflowRun smart constructor.

Constructors

WorkflowRun' 

Fields

Instances

Instances details
FromJSON WorkflowRun Source # 
Instance details

Defined in Amazonka.Glue.Types.WorkflowRun

Generic WorkflowRun Source # 
Instance details

Defined in Amazonka.Glue.Types.WorkflowRun

Associated Types

type Rep WorkflowRun :: Type -> Type #

Read WorkflowRun Source # 
Instance details

Defined in Amazonka.Glue.Types.WorkflowRun

Show WorkflowRun Source # 
Instance details

Defined in Amazonka.Glue.Types.WorkflowRun

NFData WorkflowRun Source # 
Instance details

Defined in Amazonka.Glue.Types.WorkflowRun

Methods

rnf :: WorkflowRun -> () #

Eq WorkflowRun Source # 
Instance details

Defined in Amazonka.Glue.Types.WorkflowRun

Hashable WorkflowRun Source # 
Instance details

Defined in Amazonka.Glue.Types.WorkflowRun

type Rep WorkflowRun Source # 
Instance details

Defined in Amazonka.Glue.Types.WorkflowRun

type Rep WorkflowRun = D1 ('MetaData "WorkflowRun" "Amazonka.Glue.Types.WorkflowRun" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "WorkflowRun'" 'PrefixI 'True) (((S1 ('MetaSel ('Just "completedOn") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe POSIX)) :*: S1 ('MetaSel ('Just "errorMessage") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text))) :*: (S1 ('MetaSel ('Just "graph") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe WorkflowGraph)) :*: (S1 ('MetaSel ('Just "name") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "previousRunId") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text))))) :*: ((S1 ('MetaSel ('Just "startedOn") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe POSIX)) :*: (S1 ('MetaSel ('Just "startingEventBatchCondition") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe StartingEventBatchCondition)) :*: S1 ('MetaSel ('Just "statistics") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe WorkflowRunStatistics)))) :*: (S1 ('MetaSel ('Just "status") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe WorkflowRunStatus)) :*: (S1 ('MetaSel ('Just "workflowRunId") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "workflowRunProperties") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe (HashMap Text Text))))))))

newWorkflowRun :: WorkflowRun Source #

Create a value of WorkflowRun with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:completedOn:WorkflowRun', workflowRun_completedOn - The date and time when the workflow run completed.

$sel:errorMessage:WorkflowRun', workflowRun_errorMessage - This error message describes any error that may have occurred in starting the workflow run. Currently the only error message is "Concurrent runs exceeded for workflow: foo."

$sel:graph:WorkflowRun', workflowRun_graph - The graph representing all the Glue components that belong to the workflow as nodes and directed connections between them as edges.

$sel:name:WorkflowRun', workflowRun_name - Name of the workflow that was run.

$sel:previousRunId:WorkflowRun', workflowRun_previousRunId - The ID of the previous workflow run.

$sel:startedOn:WorkflowRun', workflowRun_startedOn - The date and time when the workflow run was started.

$sel:startingEventBatchCondition:WorkflowRun', workflowRun_startingEventBatchCondition - The batch condition that started the workflow run.

$sel:statistics:WorkflowRun', workflowRun_statistics - The statistics of the run.

$sel:status:WorkflowRun', workflowRun_status - The status of the workflow run.

$sel:workflowRunId:WorkflowRun', workflowRun_workflowRunId - The ID of this workflow run.

$sel:workflowRunProperties:WorkflowRun', workflowRun_workflowRunProperties - The workflow run properties which were set during the run.

workflowRun_completedOn :: Lens' WorkflowRun (Maybe UTCTime) Source #

The date and time when the workflow run completed.

workflowRun_errorMessage :: Lens' WorkflowRun (Maybe Text) Source #

This error message describes any error that may have occurred in starting the workflow run. Currently the only error message is "Concurrent runs exceeded for workflow: foo."

workflowRun_graph :: Lens' WorkflowRun (Maybe WorkflowGraph) Source #

The graph representing all the Glue components that belong to the workflow as nodes and directed connections between them as edges.

workflowRun_name :: Lens' WorkflowRun (Maybe Text) Source #

Name of the workflow that was run.

workflowRun_previousRunId :: Lens' WorkflowRun (Maybe Text) Source #

The ID of the previous workflow run.

workflowRun_startedOn :: Lens' WorkflowRun (Maybe UTCTime) Source #

The date and time when the workflow run was started.

workflowRun_status :: Lens' WorkflowRun (Maybe WorkflowRunStatus) Source #

The status of the workflow run.

workflowRun_workflowRunId :: Lens' WorkflowRun (Maybe Text) Source #

The ID of this workflow run.

workflowRun_workflowRunProperties :: Lens' WorkflowRun (Maybe (HashMap Text Text)) Source #

The workflow run properties which were set during the run.

WorkflowRunStatistics

data WorkflowRunStatistics Source #

Workflow run statistics provides statistics about the workflow run.

See: newWorkflowRunStatistics smart constructor.

Constructors

WorkflowRunStatistics' 

Fields

Instances

Instances details
FromJSON WorkflowRunStatistics Source # 
Instance details

Defined in Amazonka.Glue.Types.WorkflowRunStatistics

Generic WorkflowRunStatistics Source # 
Instance details

Defined in Amazonka.Glue.Types.WorkflowRunStatistics

Associated Types

type Rep WorkflowRunStatistics :: Type -> Type #

Read WorkflowRunStatistics Source # 
Instance details

Defined in Amazonka.Glue.Types.WorkflowRunStatistics

Show WorkflowRunStatistics Source # 
Instance details

Defined in Amazonka.Glue.Types.WorkflowRunStatistics

NFData WorkflowRunStatistics Source # 
Instance details

Defined in Amazonka.Glue.Types.WorkflowRunStatistics

Methods

rnf :: WorkflowRunStatistics -> () #

Eq WorkflowRunStatistics Source # 
Instance details

Defined in Amazonka.Glue.Types.WorkflowRunStatistics

Hashable WorkflowRunStatistics Source # 
Instance details

Defined in Amazonka.Glue.Types.WorkflowRunStatistics

type Rep WorkflowRunStatistics Source # 
Instance details

Defined in Amazonka.Glue.Types.WorkflowRunStatistics

type Rep WorkflowRunStatistics = D1 ('MetaData "WorkflowRunStatistics" "Amazonka.Glue.Types.WorkflowRunStatistics" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "WorkflowRunStatistics'" 'PrefixI 'True) (((S1 ('MetaSel ('Just "erroredActions") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Int)) :*: S1 ('MetaSel ('Just "failedActions") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Int))) :*: (S1 ('MetaSel ('Just "runningActions") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Int)) :*: S1 ('MetaSel ('Just "stoppedActions") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Int)))) :*: ((S1 ('MetaSel ('Just "succeededActions") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Int)) :*: S1 ('MetaSel ('Just "timeoutActions") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Int))) :*: (S1 ('MetaSel ('Just "totalActions") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Int)) :*: S1 ('MetaSel ('Just "waitingActions") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Int))))))

newWorkflowRunStatistics :: WorkflowRunStatistics Source #

Create a value of WorkflowRunStatistics with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:erroredActions:WorkflowRunStatistics', workflowRunStatistics_erroredActions - Indicates the count of job runs in the ERROR state in the workflow run.

$sel:failedActions:WorkflowRunStatistics', workflowRunStatistics_failedActions - Total number of Actions that have failed.

$sel:runningActions:WorkflowRunStatistics', workflowRunStatistics_runningActions - Total number Actions in running state.

$sel:stoppedActions:WorkflowRunStatistics', workflowRunStatistics_stoppedActions - Total number of Actions that have stopped.

$sel:succeededActions:WorkflowRunStatistics', workflowRunStatistics_succeededActions - Total number of Actions that have succeeded.

$sel:timeoutActions:WorkflowRunStatistics', workflowRunStatistics_timeoutActions - Total number of Actions that timed out.

$sel:totalActions:WorkflowRunStatistics', workflowRunStatistics_totalActions - Total number of Actions in the workflow run.

$sel:waitingActions:WorkflowRunStatistics', workflowRunStatistics_waitingActions - Indicates the count of job runs in WAITING state in the workflow run.

workflowRunStatistics_erroredActions :: Lens' WorkflowRunStatistics (Maybe Int) Source #

Indicates the count of job runs in the ERROR state in the workflow run.

workflowRunStatistics_failedActions :: Lens' WorkflowRunStatistics (Maybe Int) Source #

Total number of Actions that have failed.

workflowRunStatistics_stoppedActions :: Lens' WorkflowRunStatistics (Maybe Int) Source #

Total number of Actions that have stopped.

workflowRunStatistics_succeededActions :: Lens' WorkflowRunStatistics (Maybe Int) Source #

Total number of Actions that have succeeded.

workflowRunStatistics_totalActions :: Lens' WorkflowRunStatistics (Maybe Int) Source #

Total number of Actions in the workflow run.

workflowRunStatistics_waitingActions :: Lens' WorkflowRunStatistics (Maybe Int) Source #

Indicates the count of job runs in WAITING state in the workflow run.

XMLClassifier

data XMLClassifier Source #

A classifier for XML content.

See: newXMLClassifier smart constructor.

Constructors

XMLClassifier' 

Fields

  • creationTime :: Maybe POSIX

    The time that this classifier was registered.

  • lastUpdated :: Maybe POSIX

    The time that this classifier was last updated.

  • rowTag :: Maybe Text

    The XML tag designating the element that contains each record in an XML document being parsed. This can't identify a self-closing element (closed by />). An empty row element that contains only attributes can be parsed as long as it ends with a closing tag (for example, <row item_a="A" item_b="B"></row> is okay, but <row item_a="A" item_b="B" /> is not).

  • version :: Maybe Integer

    The version of this classifier.

  • name :: Text

    The name of the classifier.

  • classification :: Text

    An identifier of the data format that the classifier matches.

Instances

Instances details
FromJSON XMLClassifier Source # 
Instance details

Defined in Amazonka.Glue.Types.XMLClassifier

Generic XMLClassifier Source # 
Instance details

Defined in Amazonka.Glue.Types.XMLClassifier

Associated Types

type Rep XMLClassifier :: Type -> Type #

Read XMLClassifier Source # 
Instance details

Defined in Amazonka.Glue.Types.XMLClassifier

Show XMLClassifier Source # 
Instance details

Defined in Amazonka.Glue.Types.XMLClassifier

NFData XMLClassifier Source # 
Instance details

Defined in Amazonka.Glue.Types.XMLClassifier

Methods

rnf :: XMLClassifier -> () #

Eq XMLClassifier Source # 
Instance details

Defined in Amazonka.Glue.Types.XMLClassifier

Hashable XMLClassifier Source # 
Instance details

Defined in Amazonka.Glue.Types.XMLClassifier

type Rep XMLClassifier Source # 
Instance details

Defined in Amazonka.Glue.Types.XMLClassifier

type Rep XMLClassifier = D1 ('MetaData "XMLClassifier" "Amazonka.Glue.Types.XMLClassifier" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "XMLClassifier'" 'PrefixI 'True) ((S1 ('MetaSel ('Just "creationTime") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe POSIX)) :*: (S1 ('MetaSel ('Just "lastUpdated") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe POSIX)) :*: S1 ('MetaSel ('Just "rowTag") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)))) :*: (S1 ('MetaSel ('Just "version") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Integer)) :*: (S1 ('MetaSel ('Just "name") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text) :*: S1 ('MetaSel ('Just "classification") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text)))))

newXMLClassifier Source #

Create a value of XMLClassifier with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:creationTime:XMLClassifier', xMLClassifier_creationTime - The time that this classifier was registered.

$sel:lastUpdated:XMLClassifier', xMLClassifier_lastUpdated - The time that this classifier was last updated.

$sel:rowTag:XMLClassifier', xMLClassifier_rowTag - The XML tag designating the element that contains each record in an XML document being parsed. This can't identify a self-closing element (closed by />). An empty row element that contains only attributes can be parsed as long as it ends with a closing tag (for example, <row item_a="A" item_b="B"></row> is okay, but <row item_a="A" item_b="B" /> is not).

$sel:version:XMLClassifier', xMLClassifier_version - The version of this classifier.

$sel:name:XMLClassifier', xMLClassifier_name - The name of the classifier.

$sel:classification:XMLClassifier', xMLClassifier_classification - An identifier of the data format that the classifier matches.

xMLClassifier_creationTime :: Lens' XMLClassifier (Maybe UTCTime) Source #

The time that this classifier was registered.

xMLClassifier_lastUpdated :: Lens' XMLClassifier (Maybe UTCTime) Source #

The time that this classifier was last updated.

xMLClassifier_rowTag :: Lens' XMLClassifier (Maybe Text) Source #

The XML tag designating the element that contains each record in an XML document being parsed. This can't identify a self-closing element (closed by />). An empty row element that contains only attributes can be parsed as long as it ends with a closing tag (for example, <row item_a="A" item_b="B"></row> is okay, but <row item_a="A" item_b="B" /> is not).

xMLClassifier_version :: Lens' XMLClassifier (Maybe Integer) Source #

The version of this classifier.

xMLClassifier_name :: Lens' XMLClassifier Text Source #

The name of the classifier.

xMLClassifier_classification :: Lens' XMLClassifier Text Source #

An identifier of the data format that the classifier matches.