Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

The replication mechanism is part of the Peer-Feature and can increase the reliability of a distributed query processing in a Peer-to-Peer network of Odysseus instances. Figure 1 shows a simplified operator graph. All operators between sources and sinks are replicated several times. Each replica gets the complete data stream from its sources for processing. Without failures, each replica produce the same result stream. To merge the different result streams, a ReplicationMerge-Operator is inserted to eliminate duplicates.

A simplified operator graph for replication.Image Modified

Typically, replicas are to be executed on different peers. If one replica (peer) fails, there is at least one other replica processing the same data stream and the query still provides output streams. A normal, not simplified operator graph for the same query as in figure 1  is shown in figure 2. Here, special  JxtaSender and JxtaReceiver operators handle the transport of data stream elements from one peer to another.

A normal, not simplified operator graph for replication.Image Modified

 

A query partitioning provides the basis for the replication mechanism. The partitioning of a query means the creation of disjunctive partial queries with the objective to determine those operators, which shall be executed on the same peer. In figure 1 and figure 2 a partition strategy was used, which creates one single partial query with all operators. If the user decides to choose another partition strategy resulting in more than one partial query, the operator graph for the replication changes. This is shown in figure 3. Here, each operator builds its own partial query. The replication mechanism merges after each of those partial queries. The result is that the query will produce results as long as at least one replica of each partial query remains.

A normal, not simplified operator graph with multiple mergers for replication.Image Modified

 

The activation of replication via Odysseus Script

...