git-svn-id: http://root.cern.ch/svn/root/trunk@37493 27541ba8-7e3a-0410-8455-c3a389f83636

git-svn-id: http://root.cern.ch/svn/root/trunk@37432 27541ba8-7e3a-0410-8455-c3a389f83636

- Fix a problem with the registration of missing files in the 'MissingFiles'
  list. The files that could not be open during processing were not properly
  registered in the list (only those found missing during validation or
  giving problmes durign reading were correctly added).
- Add method TProof::ShowMissingFiles() to facilitate the display of the
  list of missing files.
- Add method TProof::GetMissingFiles() to get a TFileCollection (dataset)
  with the missing files for further processing.


git-svn-id: http://root.cern.ch/svn/root/trunk@37396 27541ba8-7e3a-0410-8455-c3a389f83636

git-svn-id: http://root.cern.ch/svn/root/trunk@37341 27541ba8-7e3a-0410-8455-c3a389f83636

remove unused library dependency.


git-svn-id: http://root.cern.ch/svn/root/trunk@37225 27541ba8-7e3a-0410-8455-c3a389f83636

git-svn-id: http://root.cern.ch/svn/root/trunk@36944 27541ba8-7e3a-0410-8455-c3a389f83636

git-svn-id: http://root.cern.ch/svn/root/trunk@36943 27541ba8-7e3a-0410-8455-c3a389f83636

git-svn-id: http://root.cern.ch/svn/root/trunk@36942 27541ba8-7e3a-0410-8455-c3a389f83636

git-svn-id: http://root.cern.ch/svn/root/trunk@36941 27541ba8-7e3a-0410-8455-c3a389f83636

git-svn-id: http://root.cern.ch/svn/root/trunk@36940 27541ba8-7e3a-0410-8455-c3a389f83636

Patch to add support for worker autodiscovery in PROOF using the Avahi/Bonjour
technology. The new functionality is supported on Mac (MacOsX >= 10.4; no need
of additional installs) and linux (requires the Avahi framework, available
by default on most of the distributions).
To use this functionality (instead-of or in-addition-to the the static worker
configuration via proof.conf or xpd.worker) the new directive 'xpd.bonjour'
must be used (see description at 
http://root.cern.ch/drupal/content/configuration-reference-guide#bonjour):
- masters should use it in 'discover' mode

       xpd.bonjour discover

- workers in 'register' mode, specifying how many cores or processes they
  accept for a session (default is the number of processors on the machine)

       xpd.bonjour register cores=4


git-svn-id: http://root.cern.ch/svn/root/trunk@36936 27541ba8-7e3a-0410-8455-c3a389f83636

git-svn-id: http://root.cern.ch/svn/root/trunk@36933 27541ba8-7e3a-0410-8455-c3a389f83636

  In TPacketizerFile:
  - Extend flexibility of the input map content by adding support for lists of TFileInfo, maps of
    TFileCollections and urls as key valus; this allows to run directly on the output of
    TFileCollection::GetFilesPerServer.
  - Add option to not process the files not assigned to any worker; this allows to write selectors
    to perform a given action only on files local to workers.


git-svn-id: http://root.cern.ch/svn/root/trunk@36876 27541ba8-7e3a-0410-8455-c3a389f83636

git-svn-id: http://root.cern.ch/svn/root/trunk@36835 27541ba8-7e3a-0410-8455-c3a389f83636

fix windows build that was broken by recent out of source patch:
- Add logic to rootcint and new wrapper cl.sh to translate from
  /cygdrive/?/ to ?:/
- Fix a few targets.


git-svn-id: http://root.cern.ch/svn/root/trunk@36720 27541ba8-7e3a-0410-8455-c3a389f83636

  - Consistently check both Proof.Sandbox and ProofLite.Sandbox for sandbox non-default
    location as done in TProofLite
  - Add missing protection on a pointer which could possibly be null after a search.


git-svn-id: http://root.cern.ch/svn/root/trunk@36681 27541ba8-7e3a-0410-8455-c3a389f83636

To make an out of source build do, assuming the source is in ~/root:
   mkdir ~/root-x8664
   cd ~/root-x8664
   ~/root/configure
   make
This is convenient to build e.g. 32 and 64-bit version from one source, but
also needed for cross-compilation, where it is now possible to build in
a special directory only the compile time tools, like rootcint for the
host architecture while the binary is build for the remote architecture
(like iOS).


git-svn-id: http://root.cern.ch/svn/root/trunk@36659 27541ba8-7e3a-0410-8455-c3a389f83636

   - Terminate a proofserv after it has been stopped for large memory footprint and it has
     sent the results back
   - Notify information about which object was being merged if a memory exception happens
     during merging on the master
   - Allow to set the HWM and stop-process fractions via the environment


git-svn-id: http://root.cern.ch/svn/root/trunk@36592 27541ba8-7e3a-0410-8455-c3a389f83636

git-svn-id: http://root.cern.ch/svn/root/trunk@36577 27541ba8-7e3a-0410-8455-c3a389f83636

git-svn-id: http://root.cern.ch/svn/root/trunk@36576 27541ba8-7e3a-0410-8455-c3a389f83636

  - Save exception info also in the log file (it was just sent to the client)
  - Fix an old issue with DeactivateWorker("*") (the session is was terminated because
    no worker was active; this call coudl not be used as intermediate step to select a
    small number of workers).


git-svn-id: http://root.cern.ch/svn/root/trunk@36553 27541ba8-7e3a-0410-8455-c3a389f83636

git-svn-id: http://root.cern.ch/svn/root/trunk@36541 27541ba8-7e3a-0410-8455-c3a389f83636

  Make sure that the TProof instance on the client is invalidated after an idle timeout.


git-svn-id: http://root.cern.ch/svn/root/trunk@36540 27541ba8-7e3a-0410-8455-c3a389f83636

  Patch to improve the diagnostic in case of exceptions. Information about the event and file being
  processed at the moment the exception was raised is sent to the client, e.g.

0.5: caught exception triggered by signal '1' while processing dset:'EventTree',
   file:'http://root.cern.ch/files/data/event_3.root', event:1 - check logs for possible stacktrace

  The patch also fixes a problem with submergers observed when a worker was stopped because above
  the memory limits: this worker was established as merger but could not do the work, for obvious
  reasons, freezing the session.


git-svn-id: http://root.cern.ch/svn/root/trunk@36537 27541ba8-7e3a-0410-8455-c3a389f83636

  Add possibility for the to disable the use of submergers when set by default by the
  administrator. This is now achieved by setting the parameter PROOF_UseMergers to -1.


git-svn-id: http://root.cern.ch/svn/root/trunk@36526 27541ba8-7e3a-0410-8455-c3a389f83636

  - Add support for reconfiguring the group manager and the {env,rootrc} settings. The related
    configuration files are checked for changes during the regular checks done by the XrdProofdManager.
  - Add support for selective definition of env and rootrc variables. Different values can be set for
    different users, groups, SVN versions or ROOT versions


git-svn-id: http://root.cern.ch/svn/root/trunk@36520 27541ba8-7e3a-0410-8455-c3a389f83636

  In TProofServ, TXProofServ:
  Move the creation and start of the idle timeout from the end of SetupCommon to
  the end of CreateServer, so that the timeout is not active during worker setup.
  Fix a problem reported by ALICE.


git-svn-id: http://root.cern.ch/svn/root/trunk@36512 27541ba8-7e3a-0410-8455-c3a389f83636

   In TProof::HandleSubmerger, use the number of Active workers (instead of the number of
   workers) to calculate the number of workers to merge. Also, in TProof::MarkBad, make
   sure that the all worker lists and the active monitor lists are updated after a worker
   turns bad.
   Should fix the issue with submergers reported by ALICE in Savannah.


git-svn-id: http://root.cern.ch/svn/root/trunk@36504 27541ba8-7e3a-0410-8455-c3a389f83636

git-svn-id: http://root.cern.ch/svn/root/trunk@36497 27541ba8-7e3a-0410-8455-c3a389f83636

  In TPacketizerAdaptive::Reset, fix an issue preventing correct worker-to-filenode matching.
  The problem was introduced with the patch making the the packetizer disk partition-aware 
  and prevented the 'ForceLocal' option to work properly.
  Also, make sure that the FQDN is used consistently, and that 'localhost' or '127.0.0.1' are
  correctly matched to the local machine host name.


git-svn-id: http://root.cern.ch/svn/root/trunk@36491 27541ba8-7e3a-0410-8455-c3a389f83636

  Add possibility to deactivate a worker (i.e. remove it from the active list) during Collect
  in the case a failure status (!= 0) is received. This cannot be the default because an action
  can have failure among its possible return states. The new feature is used by EnablePackage
  to deactivate a worker where the requested packages could not be enabled properly.
  Should fix an issue reported by ALICE.


git-svn-id: http://root.cern.ch/svn/root/trunk@36480 27541ba8-7e3a-0410-8455-c3a389f83636

add the possibility to control the resident and virtual memory of a proofserv
using 'ulimit', which has less limitations and more flexibility than setrlimit.


git-svn-id: http://root.cern.ch/svn/root/trunk@36475 27541ba8-7e3a-0410-8455-c3a389f83636

contained TProofOutputFile objects (see forum).



git-svn-id: http://root.cern.ch/svn/root/trunk@36440 27541ba8-7e3a-0410-8455-c3a389f83636

  In the PrintProgress function used to display a text progress bar, show also the average
  reading rate in [k,M,G}bytes/s in addition to the event processing rate.
  This is useful to have a feeling of the rate when running of a remote machine in batch mode.


git-svn-id: http://root.cern.ch/svn/root/trunk@36437 27541ba8-7e3a-0410-8455-c3a389f83636

git-svn-id: http://root.cern.ch/svn/root/trunk@36312 27541ba8-7e3a-0410-8455-c3a389f83636

git-svn-id: http://root.cern.ch/svn/root/trunk@36305 27541ba8-7e3a-0410-8455-c3a389f83636

git-svn-id: http://root.cern.ch/svn/root/trunk@36300 27541ba8-7e3a-0410-8455-c3a389f83636

git-svn-id: http://root.cern.ch/svn/root/trunk@36191 27541ba8-7e3a-0410-8455-c3a389f83636

git-svn-id: http://root.cern.ch/svn/root/trunk@36182 27541ba8-7e3a-0410-8455-c3a389f83636

git-svn-id: http://root.cern.ch/svn/root/trunk@36177 27541ba8-7e3a-0410-8455-c3a389f83636