Re: A proposal for a General Clustering Framework

[Peter Badovinatz <tabmowzo@yahoo.com>]

--- Alan Robertson <alanr@unix.sh> wrote:
> Bill Todd wrote:
> > 
> > An aspect that I haven't yet seen covered (though I might have missed it)
> is
> > the efficient processing of large chunks of data - e.g., file/database
> pages
> > (which these days can easily reach 128 KB in size and in the future might
> > reasonably get even larger - in many cases, any size where the seek
> > time/rotational latency eclipses the transfer time can be 'reasonable') and
> > even larger chunks of streaming data.
<snip> 
> The short answer to this is that this protocol is for control messages, not
> bulk data transfers.  The needs of the two are somewhat different, in some
> ways, radically different.  My belief is that no single mechanism can meet
> the needs of the two parts well.
> 
> 	-- Alan Robertson
> 	   alanr@unix.sh
>
Our experience with the RSCT clustering on IBM MPP systems was that our control
level protocols (David Brower's message a few back in this thread had all of
the relevant references to this work!) were NOT useful to the data transfer
layers.  We support both failover (HACMP, RVSD) and cluster file systems (GPFS)
with the RSCT clustering.  Our 'clients' do their own bulk data transfer.

Our protocols are oriented to multi-cast, small size, reliable, minimal
overhead, etc., kinds of things we're talking about here.  The bulk data was
mostly point-to-point, high performance, streaming type data.  We provided
consistent membership, failover, events; they moved their data and used our
notifications to do recovery.

Peter

=====
These have been the opinions of:
Peter R. Badovinatz -- (503)578-5530 (TL 775)
wombat@us.ibm.com/tabmowzo@yahoo.com
and in no way should be construed as official opinion of 
IBM, Corp.

__________________________________________________
Do You Yahoo!?
Get personalized email addresses from Yahoo! Mail - only $35 
a year!  http://personal.mail.yahoo.com/

Linux-cluster: generic cluster infrastructure for Linux
Archive:       http://mail.nl.linux.org/linux-cluster/