📄Messages

Persisting metadata about datasets, algorithms and permissions

All state, besides the actual datasets, is being stored as messages on Aleph.

They are being posted by authorized entities (see Programs), contain crucial information about datasets, their owners' given permissions and can be amended. They can be found in the Message Explorer as POST messages of different types.

Types of Messages

The currently deployed Fishnet Data Model can be found here.

Timeseries

Smallest targetable unit of a dataset. Has a name, owner, description and can be toggled to be available or not.

Dataset

Consists of one or multiple Timeseries items and also has a name, owner and description, but the owner of the dataset is not necessarily the owner of all Timeseries! This way, you can build your own Dataset from Timeseries items of other users.

Algorithm

Contains a piece of Python code that can be executed on Fishnet Executor Nodes. Has a name, owner and description, and a list of Executions that utilize this Algorithm.

Execution

Refers to a Dataset and an Algorithm, which should be executed together, as requested by a user. May also contain additional parameters to influence the Algorithm's behavior. It has a state that may be:

• REQUESTED - Awaits Permission(s) from some of the Timeseries' owners.

• PENDING - All Permissions are granted and is awaiting execution.

• DENIED - At least one data owner refused permission.

• RUNNING - At least one executor node is currently running its algorithm.

• SUCCESS - All executors successfully finished running the algorithm and posted Results.

• FAILED - Fishnet failed to get valid results from every executor.

Permission

Each user attempting to use another user's Timeseries data needs to have Permission for it first. This permission can be bound to a specific Algorithm to be executed with this Timeseries and may also be limited in the number of times it may execute. There are the following states:

• REQUESTED - Permission has been requested by the requestor

• GRANTED - Permission has been granted by the owner

• DENIED - Permission has been denied

Each Permission item tracks how often it has been used to grant access to a Timeseries during Execution.