Distributed Computing with Data

Recent Work and Information

More recent information is available here including our talk at Interface98.

A long term project that we are working on in Bell Labs involve communication between different statistical tools to share capabilities and allow concurrent processing. These two goals are achieved with a single mechanism but are quite distinct. The first allows simple reuse of (existing) software. Essentially, we are providing a piping mechanism between applications that extends the UNIX pipe idea by allowing multi-directional and dynamic connections. The second goal allows us to harness multiple processors to improve performance of simulations and analysis of large datasets, etc.

Two different approaches we are investigating for the communication mechanism are

  1. Corba
  2. PVM

PVM

Essentially, PVM is a lower level communication mechanism that removes the primitive socket and shared memory details of Inter-process communication (IPC) from us but does not constrain us in any way since it offers few other mechanisms. Corba on the other hand is more structured interface to communication that offers many more services at the potential expense of added complexity and some minimal constraints on how we approach matters. Our choice of system to employ will be strongly influenced by the facility for other developers to interface to our work, adding clients to the distributed environment.
Duncan Temple Lang<duncan@research.bell-labs.com>
Last modified: Thu May 21 18:24:10 EDT 1998