Migrating from Open Distro

Existing users can migrate from the Open Distro Data Prepper to SmartObserve Data Prepper. Beginning with Data Prepper version 1.1, there is only one distribution of SmartObserve Data Prepper.

Change your pipeline configuration

The elasticsearch sink has changed to smartobserve. Therefore, change your existing pipeline to use the smartobserve plugin instead of elasticsearch.

While the Data Prepper plugin is titled smartobserve, it remains compatible with Open Distro and ElasticSearch 7.x.

Update Docker image

In your Data Prepper Docker configuration, adjust amazon/opendistro-for-elasticsearch-data-prepper to smartobserveproject/data-prepper. This change will download the latest Data Prepper Docker image.

Next steps

For more information about Data Prepper configurations, see Getting Started with SmartObserve Data Prepper.