Eratos Sync

Eratos Sync is a core Eratos product that brings together and connects large, siloed & disparate
data in one platform, ready for analysis. It can be used to better connect teams within a single
organization, to assist cross-organizational collaboration, or to enhance the delivery of products to
clients or into a marketplace. The unique offering of Eratos Sync is that it can synchronize data
across your organization without the need for the transfer (moving) or replication (duplication) of
data, reducing costs and maintaining data custodianship for the data owner. This is powered by
the Eratos Data Map.

Eratos Sync is made possible through the Eratos Gateway node. The deployment of an Eratos
Gateway node network into an organization is the first key step to the Eratos Sync process.

This document will describe the core steps to setting up Eratos Sync within your organization to
maximize the value, impact, and potential revenue of your organization's data, models and
products.

1. Install and configure Eratos Gateway Node technology
2. Create Eratos Data Map of underlying data (Mapped and then Automated)
3. Allocate roles & permissions through Eratos Permissions Manager
4. Access your synchronized data and build solutions on top with the Eratos Data Toolkit

The Federated Climate Data Initiative (FCDI) was the first project to utilize the Eratos Sync
product to connect and federate 12+ Petabytes of disparate data stored across Australia into
Eratos. The FCDI will be used as the use-case throughout the Eratos Sync guide.

Eratos Gateway Nodes

Eratos gateway nodes manage access, distribution, and translation of datasets on a given
system.
Gateway Nodes can be placed anywhere in the world, on any system, to synchronize the data
and create a single point of access that can be shared to any endpoint.
The image below shows all the gateway nodes set up for the FCDI and where they are currently
located.

Eratos Data Map

In tandem with the Eratos Gateway Node, Eratos Data Map enables the standardization and
synchronization of data across your organization without the need for the transfer (moving) or
replication (duplication) of data, reducing costs whilst maintaining data custodianship for the
data owner. Eratos is the only platform in the world that has the data infrastructure to enable the
connection of data at such low friction and cost.

The Eratos Data Map uses Eratos’ contextual engine, which at its core is a semantic web of
JSON-LD Objects with rich metadata capability, known as Eratos Resources. With these, users
can enter and add to a deep and rich network of information describing all datasets, models,
solutions, and their relationships to each other.

In the instance of FCDI, there are two key examples. 1) Target variables for analysis were
actually 30 linked data files, but for a user seemed like a single resource, as all 30 files were
mapped to 1 dataset within the Eratos platform. This process standardized and simplified the
data experience for the user, lowering the expertise threshold needed for a data professional to
begin to build models and solutions with this crucial climate data. 2) Any FCDI archive can be
linked to input sources, publications, related data files, or methods thus allowing data owners or
users to track the providence of datasets or solutions, or how these have been used by downstream
processes.

Eratos Permissions Manager

Eratos Permissions Manager enables the data custodian of the organization to have complete
control over how their data is accessed through the platform, and who has access to which parts
of the synced data collection. Permissions and metadata management can be controlled at the
archive, dataset, file level, or even subsets within a file.

The first level of separation is whether to make data synced public (Community) or private
(Spaces). The Eratos Community helps create an efficient way to access and provide the
solutions that the world needs. It includes a marketplace for data, tools, and expertise required to
understand our physical world. A Space is how you use Eratos privately, only people invited to
join the space by the admin (see below) can access and use resources (data, models,
solutions) within the space.

The second level is the roles given to members of a given space.

Owner - The owner of a space within the Eratos Platform.

Admin - The administrator of a space. Able to invite other users, manage user access
permissions, and invite additional users.

Contributor - The contributor is able to access and run workflows & run operators. They are
also able to publish their results onto the workspace.

Reader - The reader has read access to the space but is unable to create, administrate other
users, run workflows, or run operators.

The below figure shows how the initial Data Custodian of FCDI, Dr Tomas Remenyi, has utilized
the Eratos Permissions Manager to configure access within the platform. Firstly, the FCDI space
created by Dr Remenyi is the core space of the project where Australia's leading climate
scientists were given permission to access the data available through the project. From there,
Dr Remenyi created a separate space for a Hydrology Consultancy to only access a subset of
24 application-ready climate datasets that he permissioned. Due to the sensitivity of climate
data and its potential misuse, Dr Remenyi has made only summarized Climate Data Layers
available to all Eratos users, through the public community.

Note: Access within the platform can be updated, removed, or added at any time