Re: distributed processing ad multiThreading
Re: distributed processing ad multiThreading
- Subject: Re: distributed processing ad multiThreading
- From: Georg Tuparev <email@hidden>
- Date: Tue, 25 Sep 2001 13:28:18 +0200
Robert, Miguel, and others,
Sorry for the late replay ... but I was out of the town.
I fully agree with the statement below. In the past I have implemented
several systems with somehow similar functionality, and PVM was of no
help for me. What worked best for me was a system of lightweight
calculation clients distributed over the network and a "fitness"
evaluation & control server and scheduler. It is very important to
design this server vary carefully in order to limit the communication
traffic. In many cases the evaluation function could be implemented as a
reverse gridy method in order to avoid renewed calculations. I used this
trick in a wide range of applications, including finding of similar
protein structures, filtering of multidimensional NMR spectra, and
molecular dynamics.
If you need some more help, please contact me offline
gt
On Monday, September 17, 2001, at 06:04 PM, Miguel Morales wrote:
I've been doing something vaguely similar (real time
distributed/multi-threaded searches for Gamma Ray Bursts on linux
machines), and I beg to differ from some of the opinions previously
expressed. I think your instinct is correct that Objective-C and DO is
the way to go. MPI and PVM are very well suited to a particular class
of problems. In specific, they are usually used for programs where
there is an enormous array of information, but the pieces of the array
are dependent only on local information. The classic example is
weather modelling where there is an enormous number of weather grid
points, but each point only depends on its neighbors. It sounds like
you have a different style of problem, where you have lots of
independent pieces that don't fit into a large array, you are just
limited by processing power. In my experience, DO works beautifully
for this kind of problem.
Georg Tuparev
Tuparev Technologies
Klipper 13
1186 VR Amstelveen
The Netherlands
Mobile: +31-6-55798196