Expanding and customizing options for the PII redaction pipeline in Elasticsearch
Ingest processors in Elasticsearch provide a powerful and flexible way to customize data processing and manipulation, which can be tailored to fit a company’s individual PII data redaction needs. In this section, we will discuss several options for expanding and enhancing the default PII redaction pipeline to better serve specific use cases and requirements.
Customizing the default PII example
The default PII redaction pipeline provided in the example can easily be customized to better suit your organization’s data and requirements. Some possible customizations include the following:
- Replacing the example NER model with any other Elastic-compatible NER model: The default pipeline uses the
dslim
/bert-base-NER
model from Hugging Face, but you can replace it with any other Elastic-compatible NER model that better fits your specific needs. - Removing the NER model if this form...