EUMETSAT Data Tailor Flavour
This Ansible Playbook configures an existing virtual machine running within the European Weather Cloud (EWC), to equip it with the Data Tailor Standalone and EUMETSAT Data Access Client (EUMDAC).
Functionality
💡 Unlike the Data Tailor Web Services (DTWS), which can be used with EUMDAC or via https://tailor.eumetsat.int, the standalone version is generally faster and does not have limitations such as maximum concurrent jobs or workspace size.
The Data Tailor is a product customization toolbox designed to:
- Enable users to tailor satellite data to their specific needs.
- Offers the ability to subset and aggregate data products across space and time, filter layers, generate quick looks, reproject data onto new coordinate reference systems, and reformat data into widely used Geographic Information System (GIS) formats such as netCDF and GeoTIFF, as well as image formats like JPEG and PNG.
- Customize data from various satellite collections, including METOP, MFG ,MSG, MTG (Meteosat Third Generation) and Sentinel-3.
For more information on capabilities of the Data Tailor, please refer to Data Tailor Standalone Guide on User Portal and for more information about the available products and customizations inside the Data Tailor, please go to Products and Customizations Available in the Data Tailor page.
Prerequisites
- Install git (version 2.0 or higher )
- Install python (version 3.9 or higher)
- Install ansible (version 2.15 or higher)
- If you plan to configure an existing VM, jump to the Usage section below
- If you have not yet provisioned a VM, it is required to do so. You may choose one of the following approaches:
-
A) Provision a new VM via UI:
- Create an SSH keypair (see Creating the keys section of the EWC documentation)
- Import the SSH public key into Morpheus (see Adding the keys in Morpheus section of the EWC documentation)
- Provision a new VM through the web portal (see Provision a new Instance - Web section of the EWC) documentation
OR
-
B) Provision a new VM via CLI:
- Create an SSH keypair (see Creating the keys section of the EWC documentation)
- Add you SSH public key to OpenStack (see Import SSH Key section of the EWC documentation).
- Provision a new VM via the OpenStack CLI (see How to create a VM using the OpenStack CLI section of the EWC documentation)
OR
-
C) Deploy this template, together with a new VM, via the EWCCLI
-
Usage
1. Clone the repository
git clone https://github.com/ewcloud/ewc-ansible-playbook-flavours-and-provisioning.git
1.1. Change to the specific Item's subdirectory
cd ewc-ansible-playbook-flavours-and-provisioning/playbooks/eumetsat-data-tailor-flavour
1.2. (Optional) Checkout an specific Item's version
⚠️ Make sure to replace
x.y.zin the command below, with your version of preference.
git checkout x.y.z
2. Download Ansible dependencies
💡 By default, Ansible Roles are installed under the
~/.ansible/rolesdirectory within your working environment.
Download the correct version of the Ansible dependencies, if you haven't done so already:
ansible-galaxy role install -r requirements.yml
3. Specify the target host and SSH credentials
Create an inventory file to specify address/credentials that Ansible should use to reach the virtual machine you wish to configure:
# inventory.yml
---
ewcloud:
hosts:
data_tailor:
ansible_python_interpreter: /usr/bin/python3
ansible_host: <add the IPV4 address of the target host>
ansible_ssh_private_key_file: <add the path to local SSH private key file>
ansible_user: <add the default user according to your chosen VM image>
ansible_ssh_common_args: -o StrictHostKeyChecking=accept-new
4. Configure and apply the template
4.1. Interactive Mode
By running the following command, you can trigger an interactive session that prompts you for the necessary user inputs, and then applies changes to your target EWC environment:
ansible-playbook -i inventory.yml eumetsat-data-tailor-flavour.yml
4.2. Non-Interactive Mode
💡 To learn more about defining variables at runtime, checkout the official Ansible documentation.
You can also run in non-interactive mode by passing the
--extra-vars or -e flag, followed by a map of key-value pairs; one for
each and every available input (see inputs section below). For
example:
ansible-playbook \
-i inventory.yml \
-e '{
"data_tailor_env_wipe": "no",
"data_tailor_env_name": "epct-desktop",
"conda_installer": "https://github.com/conda-forge/miniforge/releases/latest/download/Miniforge3-Linux-x86_64.sh",
"conda_update_base": "false",
"conda_prefix": "/opt/conda",
"conda_user": "root"
}' \
eumetsat-data-tailor-flavour.yml
Inputs
| Name | Description | Type | Default | Required |
|---|---|---|---|---|
| data_tailor_env_wipe | flag to delete existing conda environment where data tailor was previously installed. Only yes will be accepted to approve |
string |
no |
yes |
| data_tailor_env_name | name of conda environment where data tailor will be installed | string |
epct-desktop |
yes |
| conda_installer | URI of the installer to use | string |
https://github.com/conda-forge/miniforge/releases/latest/download/Miniforge3-Linux-x86_64.sh |
yes |
| conda_update_base | boolean to decide wether base environment needs updating | bool |
false |
yes |
| conda_prefix | prefix where conda will be installed | string |
/opt/conda |
yes |
| conda_user | user that will own the conda installation | string |
root |
yes |
Dependencies
💡 A VM plan with at least 16GB of RAM is recommended for successful setup and stable operation.
| Name | Version | License | Home URL |
|---|---|---|---|
| ewc-ansible-role-conda | 1.1 | Apache-2.0 | https://github.com/ewcloud/ewc-ansible-role-conda |
| ewc-ansible-role-data-tailor | 1.0 | MIT | https://github.com/ewcloud/ewc-ansible-role-data-tailor |