A High Level Multi-Threaded Extension to a Statistical Computing Environment
-
Abstract
-
Introduction
- What are threads and their history?
Contrast with multi-tasking operating systems.
Java
- Why are we studying threads and how can they be used?
- Higher level language making multi-threading more accessible
- motivation from GUIs and logically separate tasks within
an application,
- remote debugging mechanism and monitoring capabilities.
- multi-processor and performance in the era of intensive
computation for statistical problem solving
(e.g. bootstrapping, cross-validation, hierarchical
models, Markov process simulations)
and increased volume of data.
- modular software development.
- single user action, but many system (S) actions, such as
updating graphics displays (no backing store), etc.
- The challenges associated with
using threads - synchronization, portability.
- General Examples and Examples in S (assignment of entire
object x[i] <- 1).
- Atomic actions
- Purpose of the work.
- provide low level primitives in
a high level language which can be employed to provide higher
level interfaces. Tools for programmers/developers.
- Allow large scale software to be written on top of a
statistical language rather than interfacing to it.
- Still complicated to use threads but greatly simplified.
- Special problems and benefits associated with threading
a functional (absence of pointers)
mathematical/statistical and interactive
programming language that supports object persistence.
-
S User level Thread Application Programming Interface
(API)
Modifications to the S Evaluation and Session model
- The S Evaluation Model, Tasks, Frames and Databases
- Thread specific inter-task frames.
- Session specific inter-thread frame.
- Interface (single or multiple prompt(s)), history mechanism
(.Audit file).
S Level Functions
- Creating and destroying threads and Thread Attributes.
- Inter and Intra thread control.
Suspending, canceling tasks.
- Synchronization across threads
- Locking objects and commands, and locking based on values of objects.
- Reader-writer locks, barriers implemented in terms of
the S level primitives in the API.
- Changes and simplifications to S functions and classes -
readers and timers.
- Extended Examples - Data server, Help daemon via a GUI,
image matching via maximal correlations computed in parallel.
-
Internal Design and Implementation
- Evaluator Manager
- Control
- Messages
- Monitoring tools.
- Thread Locking Databases.
- Different Levels of threading and extensibility -
- single processor - Pthreads,
- multi-processors - Kernel Level Threads (LinuxThreads),
- distributed processors
- Implementation details of the different
levels of threading above.
- Other requirements - re-entrant library routines.
- Portability.
- Other approaches - S engine level scheduling and complications.
-
Partial Automatic Synchronization via S
- Idea of recursively parsing expressions as objects
to identify the shared values as input and output variable
sets. Then
- Contrast with Compiler based parallelization.
- Reference to GUI material and callback parsing.
Automatic help facility.
- Useful prototyping environment for developing parallel
algorithms that can be translated to lower-level languages
after verification of the correctness of the approach.
-
Comments and Conclusions
- Why can this be considered a statistical thesis?
- Only high level interactive statistical/mathematical
language of which I am aware that offers threads.
- Makes parallel and distributed processing available to
statisticians in an accessible way. Helps to make
parallel computing a more viable avenue for more
statistical problems.
- Statistics is becoming increasingly more computer oriented,
both in solving the problems and providing software
for others to use statistical procedures.
This work provides tools for both.
- Generalizability to other languages, thread interfaces, etc.
- State of the work.
- Databases and class mechanism controlled by "servers"
-
Bibliography
-
Appendix
Duncan Temple Lang<duncan@stat.Berkeley.EDU>
Last modified: Fri May 30 14:38:34 PDT 1997