#2107
  • Created on
    2012-05-23 05:13
  • Reported by
    Jonas Bonér
  • Status
    New
  • Priority
    Normal (3)
  • Assigned to
    -
  • Milestone
    Rollins
  • Plan Level
    Subtask
  • Due Date
    -

Related Tickets

Change cluster protocol to use a Push-Pull mechanism

Instead of only current Push.
To minimize data sent across the wire.
See the cluster spec.

Split up in two groups:
1. membership set, unreachable set and seen table
2. meta-data

1) has a single digest for everything, should not change often so it should be fine

2) can change much more frequent (probably all the time) - here we should have one digest per meta-data entry.
Here we should consider using Scuttlebutt reconciliation. See attached paper: "Efficient Reconciliation and Flow Control
for Anti-Entropy Protocols"
User picture
  on 2012-06-16 05:11 *
By Jonas Bonér
Description changed from Instead of only current Pus... to Instead of only current Pus...
User picture
  on 2012-06-16 05:12 *
By Jonas Bonér
Attachment EfficientReconciliationandFlowControlforAnti-EntropyProtocols.pdf added
file:c6RPEQT5Sr4yVQacwqjQXA
Efficient Reconciliation and Flow Control for Anti-Entropy Protocols
User picture
  on 2012-06-16 05:39 *
By Jonas Bonér
Milestone changed from Rollins to Coltrane
User picture
  on 2012-09-10 02:33 *
By Patrik Nordwall
Priority changed from Normal (3) to Low (4)
User picture
  on 2012-11-01 06:50 *
By viktorklang
Priority changed from Low (4) to Normal (3)
User picture
  on 2012-12-05 09:30 *
By rkuhn
Estimate changed from Small to Medium
Sum of child estimates changed from 1.0 to 3.0
User picture
  on 2012-12-05 09:33 *
By rkuhn
Estimate changed from Medium to Small
Sum of child estimates changed from 3.0 to 1.0
User picture
  on 2012-12-06 09:02 *
By Patrik Nordwall
These changes would benefit from a long time of testing, hardening and therefore I suggest that we get started with this right away, if it's something we aim for doing in Coltrane. WDYT?
User picture
  on 2012-12-07 03:09 *
By rkuhn
Milestone changed from Coltrane to Current
User picture
  on 2012-12-07 03:21 *
By Jonas Bonér
I think that before we start with opts like this we need a solid bench, running on EC2 with 100-1000 nodes monitored by Boundary to see where we are and if it is even needed.
This is a nice to have but users wants features more I think. We can see this an an ace in our sleeve if we feel we need it.
WDYT?
User picture
  on 2012-12-10 04:06 *
By rkuhn
Milestone changed from Current to Coltrane
User picture
  on 2013-01-22 06:17 *
By rkuhn
Milestone changed from Coltrane to Rollins
User picture
  on 2013-01-22 06:17 *
By rkuhn
Estimate changed from Small to Large
Sum of child estimates changed from 1.0 to 7.0