Documentation

Classifiers are triggered during a crawl task. A classifier checks whether a given file is in a format it can handle. If it is, the classifier creates a schema in the form of a StructType object that matches that data format.

You can use the standard classifiers that Glue provides, or you can write your own classifiers to best categorize your data sources and specify the appropriate schemas to use for them. A classifier can be a grok classifier, an XML classifier, a JSON classifier, or a custom CSV classifier, as specified in one of the fields in the Classifier object.

See: newClassifier smart constructor.

Create a value of Classifier with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:csvClassifier:Classifier', classifier_csvClassifier - A classifier for comma-separated values (CSV).

$sel:grokClassifier:Classifier', classifier_grokClassifier - A classifier that uses grok.

$sel:jsonClassifier:Classifier', classifier_jsonClassifier - A classifier for JSON content.

$sel:xMLClassifier:Classifier', classifier_xMLClassifier - A classifier for XML content.

A classifier for comma-separated values (CSV).

A classifier that uses grok.

A classifier for JSON content.

A classifier for XML content.