Copyright | (c) 2013-2023 Brendan Hay |
---|---|
License | Mozilla Public License, v. 2.0. |
Maintainer | Brendan Hay |
Stability | auto-generated |
Portability | non-portable (GHC extensions) |
Safe Haskell | Safe-Inferred |
Language | Haskell2010 |
Synopsis
- data DataCatalog = DataCatalog' {
- description :: Maybe Text
- parameters :: Maybe (HashMap Text Text)
- name :: Text
- type' :: DataCatalogType
- newDataCatalog :: Text -> DataCatalogType -> DataCatalog
- dataCatalog_description :: Lens' DataCatalog (Maybe Text)
- dataCatalog_parameters :: Lens' DataCatalog (Maybe (HashMap Text Text))
- dataCatalog_name :: Lens' DataCatalog Text
- dataCatalog_type :: Lens' DataCatalog DataCatalogType
Documentation
data DataCatalog Source #
Contains information about a data catalog in an Amazon Web Services account.
See: newDataCatalog
smart constructor.
DataCatalog' | |
|
Instances
Create a value of DataCatalog
with all optional fields omitted.
Use generic-lens or optics to modify other optional fields.
The following record fields are available, with the corresponding lenses provided for backwards compatibility:
$sel:description:DataCatalog'
, dataCatalog_description
- An optional description of the data catalog.
$sel:parameters:DataCatalog'
, dataCatalog_parameters
- Specifies the Lambda function or functions to use for the data catalog.
This is a mapping whose values depend on the catalog type.
For the
HIVE
data catalog type, use the following syntax. Themetadata-function
parameter is required.The sdk-version
parameter is optional and defaults to the currently supported version.metadata-function=
lambda_arn
, sdk-version=
version_number
For the
LAMBDA
data catalog type, use one of the following sets of required parameters, but not both.If you have one Lambda function that processes metadata and another for reading the actual data, use the following syntax. Both parameters are required.
metadata-function=
lambda_arn
, record-function=
lambda_arn
If you have a composite Lambda function that processes both metadata and data, use the following syntax to specify your Lambda function.
function=
lambda_arn
The
GLUE
type takes a catalog ID parameter and is required. Thecatalog_id
catalog-id=
catalog_id
- The
GLUE
data catalog type also applies to the defaultAwsDataCatalog
that already exists in your account, of which you can have only one and cannot modify. - Queries that specify a Glue Data Catalog other than the default
AwsDataCatalog
must be run on Athena engine version 2.
- The
$sel:name:DataCatalog'
, dataCatalog_name
- The name of the data catalog. The catalog name must be unique for the
Amazon Web Services account and can use a maximum of 127 alphanumeric,
underscore, at sign, or hyphen characters. The remainder of the length
constraint of 256 is reserved for use by Athena.
$sel:type':DataCatalog'
, dataCatalog_type
- The type of data catalog to create: LAMBDA
for a federated catalog,
HIVE
for an external hive metastore, or GLUE
for an Glue Data
Catalog.
dataCatalog_description :: Lens' DataCatalog (Maybe Text) Source #
An optional description of the data catalog.
dataCatalog_parameters :: Lens' DataCatalog (Maybe (HashMap Text Text)) Source #
Specifies the Lambda function or functions to use for the data catalog. This is a mapping whose values depend on the catalog type.
For the
HIVE
data catalog type, use the following syntax. Themetadata-function
parameter is required.The sdk-version
parameter is optional and defaults to the currently supported version.metadata-function=
lambda_arn
, sdk-version=
version_number
For the
LAMBDA
data catalog type, use one of the following sets of required parameters, but not both.If you have one Lambda function that processes metadata and another for reading the actual data, use the following syntax. Both parameters are required.
metadata-function=
lambda_arn
, record-function=
lambda_arn
If you have a composite Lambda function that processes both metadata and data, use the following syntax to specify your Lambda function.
function=
lambda_arn
The
GLUE
type takes a catalog ID parameter and is required. Thecatalog_id
catalog-id=
catalog_id
- The
GLUE
data catalog type also applies to the defaultAwsDataCatalog
that already exists in your account, of which you can have only one and cannot modify. - Queries that specify a Glue Data Catalog other than the default
AwsDataCatalog
must be run on Athena engine version 2.
- The
dataCatalog_name :: Lens' DataCatalog Text Source #
The name of the data catalog. The catalog name must be unique for the Amazon Web Services account and can use a maximum of 127 alphanumeric, underscore, at sign, or hyphen characters. The remainder of the length constraint of 256 is reserved for use by Athena.
dataCatalog_type :: Lens' DataCatalog DataCatalogType Source #
The type of data catalog to create: LAMBDA
for a federated catalog,
HIVE
for an external hive metastore, or GLUE
for an Glue Data
Catalog.