Documentation

A list of continuous export descriptions.

See: newContinuousExportDescription smart constructor.

Create a value of ContinuousExportDescription with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:dataSource:ContinuousExportDescription', continuousExportDescription_dataSource - The type of data collector used to gather this data (currently only offered for AGENT).

$sel:exportId:ContinuousExportDescription', continuousExportDescription_exportId - The unique ID assigned to this export.

$sel:s3Bucket:ContinuousExportDescription', continuousExportDescription_s3Bucket - The name of the s3 bucket where the export data parquet files are stored.

$sel:schemaStorageConfig:ContinuousExportDescription', continuousExportDescription_schemaStorageConfig - An object which describes how the data is stored.

• databaseName - the name of the Glue database used to store the schema.

$sel:startTime:ContinuousExportDescription', continuousExportDescription_startTime - The timestamp representing when the continuous export was started.

$sel:status:ContinuousExportDescription', continuousExportDescription_status - Describes the status of the export. Can be one of the following values:

• START_IN_PROGRESS - setting up resources to start continuous export.
• START_FAILED - an error occurred setting up continuous export. To recover, call start-continuous-export again.
• ACTIVE - data is being exported to the customer bucket.
• ERROR - an error occurred during export. To fix the issue, call stop-continuous-export and start-continuous-export.
• STOP_IN_PROGRESS - stopping the export.
• STOP_FAILED - an error occurred stopping the export. To recover, call stop-continuous-export again.
• INACTIVE - the continuous export has been stopped. Data is no longer being exported to the customer bucket.

$sel:statusDetail:ContinuousExportDescription', continuousExportDescription_statusDetail - Contains information about any errors that have occurred. This data type can have the following values:

• ACCESS_DENIED - You don’t have permission to start Data Exploration in Amazon Athena. Contact your Amazon Web Services administrator for help. For more information, see Setting Up Amazon Web Services Application Discovery Service in the Application Discovery Service User Guide.
• DELIVERY_STREAM_LIMIT_FAILURE - You reached the limit for Amazon Kinesis Data Firehose delivery streams. Reduce the number of streams or request a limit increase and try again. For more information, see Kinesis Data Streams Limits in the Amazon Kinesis Data Streams Developer Guide.
• FIREHOSE_ROLE_MISSING - The Data Exploration feature is in an error state because your IAM User is missing the AWSApplicationDiscoveryServiceFirehose role. Turn on Data Exploration in Amazon Athena and try again. For more information, see Step 3: Provide Application Discovery Service Access to Non-Administrator Users by Attaching Policies in the Application Discovery Service User Guide.
• FIREHOSE_STREAM_DOES_NOT_EXIST - The Data Exploration feature is in an error state because your IAM User is missing one or more of the Kinesis data delivery streams.
• INTERNAL_FAILURE - The Data Exploration feature is in an error state because of an internal failure. Try again later. If this problem persists, contact Amazon Web Services Support.

• LAKE_FORMATION_ACCESS_DENIED - You don't have sufficient lake formation permissions to start continuous export. For more information, see Upgrading Amazon Web Services Glue Data Permissions to the Amazon Web Services Lake Formation Model in the Amazon Web Services Lake Formation Developer Guide.

  You can use one of the following two ways to resolve this issue.

  1. If you don’t want to use the Lake Formation permission model, you can change the default Data Catalog settings to use only Amazon Web Services Identity and Access Management (IAM) access control for new databases. For more information, see Change Data Catalog Settings in the Lake Formation Developer Guide.

  2. You can give the service-linked IAM roles AWSServiceRoleForApplicationDiscoveryServiceContinuousExport and AWSApplicationDiscoveryServiceFirehose the required Lake Formation permissions. For more information, see Granting Database Permissions in the Lake Formation Developer Guide.

     1. AWSServiceRoleForApplicationDiscoveryServiceContinuousExport - Grant database creator permissions, which gives the role database creation ability and implicit permissions for any created tables. For more information, see Implicit Lake Formation Permissions in the Lake Formation Developer Guide.
     2. AWSApplicationDiscoveryServiceFirehose - Grant describe permissions for all tables in the database.
• S3_BUCKET_LIMIT_FAILURE - You reached the limit for Amazon S3 buckets. Reduce the number of S3 buckets or request a limit increase and try again. For more information, see Bucket Restrictions and Limitations in the Amazon Simple Storage Service Developer Guide.
• S3_NOT_SIGNED_UP - Your account is not signed up for the Amazon S3 service. You must sign up before you can use Amazon S3. You can sign up at the following URL: https://aws.amazon.com/s3.

$sel:stopTime:ContinuousExportDescription', continuousExportDescription_stopTime - The timestamp that represents when this continuous export was stopped.

The type of data collector used to gather this data (currently only offered for AGENT).

The unique ID assigned to this export.

The name of the s3 bucket where the export data parquet files are stored.

An object which describes how the data is stored.

• databaseName - the name of the Glue database used to store the schema.

The timestamp representing when the continuous export was started.

Describes the status of the export. Can be one of the following values:

• START_IN_PROGRESS - setting up resources to start continuous export.
• START_FAILED - an error occurred setting up continuous export. To recover, call start-continuous-export again.
• ACTIVE - data is being exported to the customer bucket.
• ERROR - an error occurred during export. To fix the issue, call stop-continuous-export and start-continuous-export.
• STOP_IN_PROGRESS - stopping the export.
• STOP_FAILED - an error occurred stopping the export. To recover, call stop-continuous-export again.
• INACTIVE - the continuous export has been stopped. Data is no longer being exported to the customer bucket.

Contains information about any errors that have occurred. This data type can have the following values:

• ACCESS_DENIED - You don’t have permission to start Data Exploration in Amazon Athena. Contact your Amazon Web Services administrator for help. For more information, see Setting Up Amazon Web Services Application Discovery Service in the Application Discovery Service User Guide.
• DELIVERY_STREAM_LIMIT_FAILURE - You reached the limit for Amazon Kinesis Data Firehose delivery streams. Reduce the number of streams or request a limit increase and try again. For more information, see Kinesis Data Streams Limits in the Amazon Kinesis Data Streams Developer Guide.
• FIREHOSE_ROLE_MISSING - The Data Exploration feature is in an error state because your IAM User is missing the AWSApplicationDiscoveryServiceFirehose role. Turn on Data Exploration in Amazon Athena and try again. For more information, see Step 3: Provide Application Discovery Service Access to Non-Administrator Users by Attaching Policies in the Application Discovery Service User Guide.
• FIREHOSE_STREAM_DOES_NOT_EXIST - The Data Exploration feature is in an error state because your IAM User is missing one or more of the Kinesis data delivery streams.
• INTERNAL_FAILURE - The Data Exploration feature is in an error state because of an internal failure. Try again later. If this problem persists, contact Amazon Web Services Support.

• LAKE_FORMATION_ACCESS_DENIED - You don't have sufficient lake formation permissions to start continuous export. For more information, see Upgrading Amazon Web Services Glue Data Permissions to the Amazon Web Services Lake Formation Model in the Amazon Web Services Lake Formation Developer Guide.

  You can use one of the following two ways to resolve this issue.

  1. If you don’t want to use the Lake Formation permission model, you can change the default Data Catalog settings to use only Amazon Web Services Identity and Access Management (IAM) access control for new databases. For more information, see Change Data Catalog Settings in the Lake Formation Developer Guide.

  2. You can give the service-linked IAM roles AWSServiceRoleForApplicationDiscoveryServiceContinuousExport and AWSApplicationDiscoveryServiceFirehose the required Lake Formation permissions. For more information, see Granting Database Permissions in the Lake Formation Developer Guide.

     1. AWSServiceRoleForApplicationDiscoveryServiceContinuousExport - Grant database creator permissions, which gives the role database creation ability and implicit permissions for any created tables. For more information, see Implicit Lake Formation Permissions in the Lake Formation Developer Guide.
     2. AWSApplicationDiscoveryServiceFirehose - Grant describe permissions for all tables in the database.
• S3_BUCKET_LIMIT_FAILURE - You reached the limit for Amazon S3 buckets. Reduce the number of S3 buckets or request a limit increase and try again. For more information, see Bucket Restrictions and Limitations in the Amazon Simple Storage Service Developer Guide.
• S3_NOT_SIGNED_UP - Your account is not signed up for the Amazon S3 service. You must sign up before you can use Amazon S3. You can sign up at the following URL: https://aws.amazon.com/s3.

The timestamp that represents when this continuous export was stopped.