this patch should filter G__* from the sources.


git-svn-id: http://root.cern.ch/svn/root/trunk@43662 27541ba8-7e3a-0410-8455-c3a389f83636

  In TDataSetManger::ScanFile :
  - Open the file twice (the first time as 'raw') only if it is an archive (to get
    the total size); this was tuned on the ALICE case, where with an xrootd back-end
    the double opening was not critical; for other backends the penalty may be significant,
    so it should be done only when strictly needed.
  - Do not hardcode 'TIMEOUT=5' option by default when opening files; this appears to
    create some problem on some back-ends, so it needs to be configurable.

  In TProofServ
  - In RegistersDataSets, remove the temporary dataset tags from the output list after
    processing: they are not needed and generate warnings about duplicated names.
  - In ProcessNext, add missing protection in the case of query abort.


git-svn-id: http://root.cern.ch/svn/root/trunk@43567 27541ba8-7e3a-0410-8455-c3a389f83636

  In ReadBuffer, do not set the username is already set.
  Fixes a problem when retrieving files from workers where the username is different,
  e.g. PoD on gLite.


git-svn-id: http://root.cern.ch/svn/root/trunk@43440 27541ba8-7e3a-0410-8455-c3a389f83636

git-svn-id: http://root.cern.ch/svn/root/trunk@43426 27541ba8-7e3a-0410-8455-c3a389f83636

  - Re-arrage usage of xrootd-related entities in such a way that internal headers are
    not needed by 'netx' headers
  - Remove external support for very old xrootd versions (older than 4 years)


git-svn-id: http://root.cern.ch/svn/root/trunk@43295 27541ba8-7e3a-0410-8455-c3a389f83636

git-svn-id: http://root.cern.ch/svn/root/trunk@43251 27541ba8-7e3a-0410-8455-c3a389f83636

git-svn-id: http://root.cern.ch/svn/root/trunk@43245 27541ba8-7e3a-0410-8455-c3a389f83636

git-svn-id: http://root.cern.ch/svn/root/trunk@43159 27541ba8-7e3a-0410-8455-c3a389f83636

git-svn-id: http://root.cern.ch/svn/root/trunk@43157 27541ba8-7e3a-0410-8455-c3a389f83636

git-svn-id: http://root.cern.ch/svn/root/trunk@43110 27541ba8-7e3a-0410-8455-c3a389f83636

git-svn-id: http://root.cern.ch/svn/root/trunk@43109 27541ba8-7e3a-0410-8455-c3a389f83636

git-svn-id: http://root.cern.ch/svn/root/trunk@43108 27541ba8-7e3a-0410-8455-c3a389f83636

   From B. Butler:
   Add the possibility to force submerging at node level, i.e. one submerger per physical machine.
   In this way the network traffic can be minimized, for example when merging large output files.
   The new feature is enabled by setting the Int_t parameter 'PROOF_MergersByHost' (or the directive
   'Proof.MergersByHost') to a non-null value.


git-svn-id: http://root.cern.ch/svn/root/trunk@43107 27541ba8-7e3a-0410-8455-c3a389f83636

  - Add possibility to change the location of the generated files via the third
    argument of TProofBench::MakeDataSet
  - Add a few missing protections


git-svn-id: http://root.cern.ch/svn/root/trunk@43101 27541ba8-7e3a-0410-8455-c3a389f83636

git-svn-id: http://root.cern.ch/svn/root/trunk@43081 27541ba8-7e3a-0410-8455-c3a389f83636

  - Properly handle the error status code in TProof::SendFile.
  - Make sure that errors from TProofServ::ReceiveFile are properly transmitted back.


git-svn-id: http://root.cern.ch/svn/root/trunk@43074 27541ba8-7e3a-0410-8455-c3a389f83636

git-svn-id: http://root.cern.ch/svn/root/trunk@43069 27541ba8-7e3a-0410-8455-c3a389f83636

git-svn-id: http://root.cern.ch/svn/root/trunk@43055 27541ba8-7e3a-0410-8455-c3a389f83636

    From Taesoo Kim and me.

    Add support for selector-by-object processing in PROOF.
    The selector object, created and configured locally by the user, is added to the input
    list and recuperated from there on the worker machines for processing. Any input list
    setting in the selector itself is not streamed but temporarly moved to then standard
    input list, so that user can use the selector input list as container of processing
    information if they find convenient to do so.
    Process(...) methods with the file name argument replaced by 'TSelector *' have 
    introduced where relevant (TProof, TProofPlayer and their derivatives, TDSet). 
    Two tests for the new functionality have been added to test/stressProof.cxx (tests 25
    and 26).


git-svn-id: http://root.cern.ch/svn/root/trunk@43044 27541ba8-7e3a-0410-8455-c3a389f83636

git-svn-id: http://root.cern.ch/svn/root/trunk@42921 27541ba8-7e3a-0410-8455-c3a389f83636

   In TProofOutputFile, add switch to control the way histograms are merged by TFileMerger,
   i.e. one-by-one or all-in-one-go. The default is one-by-one which requires much less memory.
   Merging in one-go (the previous default) can be activated by passing 'H' in the constructor
   options.


git-svn-id: http://root.cern.ch/svn/root/trunk@42904 27541ba8-7e3a-0410-8455-c3a389f83636

git-svn-id: http://root.cern.ch/svn/root/trunk@42883 27541ba8-7e3a-0410-8455-c3a389f83636

    From Sangsu Ryu and me.
    Add support for paralell dataset verification. This is implemented via a dedicated
    TSelector (TSelVerifyDataSet) which is run over the list of files in the dataset via
    TPacketizerFile. The file order is preserved using the recently introduced index in
    TFileInfo.
    Parallel verification is the now the default. For test and comparison purposes it is
    still possible to verify datasets serially by specifying 'S' in the option field of
    VerifyDataSet and RegisterDataSet .

    To avoid/reduce code duplication some of the static functions in TDataSetManager have
    refactorized. The overall behavior should be unchanged.


git-svn-id: http://root.cern.ch/svn/root/trunk@42882 27541ba8-7e3a-0410-8455-c3a389f83636

Make sure that kOutputFileNameSet is always set when the user sets the output filename (bug #90884). Thanks to C.H.Christensen


git-svn-id: http://root.cern.ch/svn/root/trunk@42860 27541ba8-7e3a-0410-8455-c3a389f83636

git-svn-id: http://root.cern.ch/svn/root/trunk@42859 27541ba8-7e3a-0410-8455-c3a389f83636

   This patch adds in TProofMgr two static functions to upload files.
   These functionare called UploadFiles and differ in the first argument, which is used
   to pass the files to be uploaded. These can be given as a list (of TFileInfo or TObjString),
   a directory or specified in a text file.
   The functions are documented at
              http://root.cern.ch/drupal/content/uploading-data-files-proof-cluster

   The patch also adds TProofMgr::GetMssUrl() and TProofMgr::SetMssUrl(...) to manage the mass
   storage URL attached to a given cluster. By the default the information is retrieved by the
   server daemon, but can be modified by the user. The functions TProof::GetDataPoolUrl() and
   TProof::SetDataPoolUrl(...) now redirect to TProofMgr::GetMssUrl() and TProofMgr::SetMssUrl(...).

   The obsolete functions TProof::UploadDataset have now been removed.

   This patch addresses some issues raised on Savannah.


git-svn-id: http://root.cern.ch/svn/root/trunk@42858 27541ba8-7e3a-0410-8455-c3a389f83636

In TTreeCache remove the (mostly unused) location notion of owner (fOwner) as the ownership is now shared explicitly between a TTree and its TFile. In TTreeCache::UpdateBranches, also migrate the ownership from one file to the other


git-svn-id: http://root.cern.ch/svn/root/trunk@42856 27541ba8-7e3a-0410-8455-c3a389f83636

git-svn-id: http://root.cern.ch/svn/root/trunk@42798 27541ba8-7e3a-0410-8455-c3a389f83636

git-svn-id: http://root.cern.ch/svn/root/trunk@42762 27541ba8-7e3a-0410-8455-c3a389f83636

  - Fix problem with TProof::Load reported by Gordon Watts in the PROOF forum.
    The additional files were not copied in the master sandbox but left in the
    cache. A workaround for backward compatibility has also been implemented.


git-svn-id: http://root.cern.ch/svn/root/trunk@42761 27541ba8-7e3a-0410-8455-c3a389f83636

Allow multiple read caches per file by adding a fCacheReadMap member and owner arguments to GetCacheRead() and SetCacheRead()
to TFile.

Index: io/io/inc/TFileCacheRead.h
Index: io/io/src/TFileCacheRead.cxx
* Adding new argument for constructor to specify TTree owner
* whitespace indents

Index: tree/tree/inc/TBasket.h
Index: tree/tree/src/TBasket.cxx
* Add optional tree owner argument to LoadBasketBuffers() to retrieve cache.
* In LoadBasketBuffers() and ReadBuffers() check the cache first than call TFile::ReadBuffer only if needed.

Index: tree/tree/inc/TChain.h
Index: tree/tree/src/TChain.cxx
* Override SetCacheSize() function to update TTree owner on the current cache.
* whitespace indents

Index: tree/tree/src/TTree.cxx
* Get TTreeCache for current TTree, by specifying owner in GetCacheRead() calls
* Always delete owned cache

Index: tree/tree/src/TTreeCache.cxx
* Adding new argument for constructor for TFileCacheRead to specify TTree owner

Index: tree/treeplayer/src/TTreePlayer.cxx
* Get TTreeCache for current TTree, by specifying owner in GetCacheRead() calls

Index: tree/tree/src/TTreeCloner.cxx
* Call TBasket::LoadBasketBuffers() with current TTree as owner of cache

Index: proof/proofplayer/src/TEventIter.cxx
* Get TTreeCache for current TTree, by specifying owner in GetCacheRead() and SetCacheRead() calls


git-svn-id: http://root.cern.ch/svn/root/trunk@42754 27541ba8-7e3a-0410-8455-c3a389f83636

    Rename TProofPerfTree to TProofPerfAnalysis to better reflect its content.
    The title of the web page is also changed to
                     http://root.cern.ch/drupal/content/analysing-performance-tree


git-svn-id: http://root.cern.ch/svn/root/trunk@42718 27541ba8-7e3a-0410-8455-c3a389f83636

git-svn-id: http://root.cern.ch/svn/root/trunk@42713 27541ba8-7e3a-0410-8455-c3a389f83636

    First version of the TProofPerfTree class collecting a set of tools to analyse
    the performance tree.
    Current status is described at
                               http://root.cern.ch/drupal/content/performance-tree


git-svn-id: http://root.cern.ch/svn/root/trunk@42711 27541ba8-7e3a-0410-8455-c3a389f83636

git-svn-id: http://root.cern.ch/svn/root/trunk@42703 27541ba8-7e3a-0410-8455-c3a389f83636

cleanup some undesired library dependencies.


git-svn-id: http://root.cern.ch/svn/root/trunk@42549 27541ba8-7e3a-0410-8455-c3a389f83636

   In TProofBench::DrawCPU, add possibility to extract of a couple of numbers supposed
   to give an idea of the computing specs of the cluster being benchmarked. These are
   the maximum rate for the standard CPU intensive task and the normalized, per worker,
   rate. Both are expressed in RNGPS (RaNdom Generation Per Second).

   A new static method TProofBench::GetPerfSpecs provides a simpler interface to this
   new options, optionally scanning a directory for proofbench outputs and giving the
   possibility to choose which file to use to extarct the numbers:

 root [0] TProofBench::GetPerfSpecs()
Several possible files found:
  0     std:    2011-12-07 15:03:10     <no decription> (file: ./proofbench-plitehp24.cern.ch-24w-20111207-1559.root)
  1     std:    2011-12-07 15:09:26     <no decription> (file: ./proofbench-lite-24w-20111207-1605.root)
  2     std:    2011-12-07 17:08:34     PROOF-Lite on pcphsft64, 4 workers (file: ./proofbench-pcphsft64-lite-4w-20111207-1806.root)
  3     std:    2011-12-07 17:57:26     PROOF at skaf.saske.sk, 60 workers (file: ./proofbench-prf000-iep-grid.saske.sk-60w-20111207-1851.root)
  4     std:    2011-12-08 11:17:15     PROOF at kiaf.sdfarm.kr, 96 workers (file: ./proofbench-kiaf.sdfarm.kr-96w-20111208-1133.root)
  5     std:    2011-12-13 18:22:48     PROOF at cernvm24, 24 workers (file: ./proofbench-cernvm24.cern.ch-24w-20111213-1621.root)
Make your choice [5] 3
 FCN=1610.99 FROM MIGRAD    STATUS=CONVERGED      37 CALLS          38 TOTAL
                     EDM=5.60469e-11    STRATEGY= 1      ERROR MATRIX ACCURATE 
  EXT PARAMETER                                   STEP         FIRST   
  NO.   NAME      VALUE            ERROR          SIZE      DERIVATIVE 
   1  offset       2.50025e+05   8.07163e+03   8.71576e+01  -1.26091e-09
   2  slope        3.85933e+05   4.17679e+02   7.02211e+00   1.82330e-09
* ************************************************************ *
* Cluster: PROOF at kiaf.sdfarm.kr, 96 workers                 *
* Performance measurement from scalability plot:               *
*    rate max:         37.680   megaRNGPS (@ 95 workers)       *
*    per-worker rate:  0.386    megaRNGPS                      *
* ************************************************************ *
root [1] 

   The patch also adds a TNamed in the proofbench output file with a string describing
   the setup used for the test (in the example above: 'PROOF at kiaf.sdfarm.kr, 96 workers').
   The name of the TNamed is 'PB_description'.

   A web page is being created with the specs from some clusters where the bench has been run.


git-svn-id: http://root.cern.ch/svn/root/trunk@42496 27541ba8-7e3a-0410-8455-c3a389f83636

git-svn-id: http://root.cern.ch/svn/root/trunk@42495 27541ba8-7e3a-0410-8455-c3a389f83636

Add support for a command line test run of 'proofserv'. This is useful
to test that the environment is setup correctly.


git-svn-id: http://root.cern.ch/svn/root/trunk@42458 27541ba8-7e3a-0410-8455-c3a389f83636

   In TProofServ::SendStatistics:
   For masters, do not overwrite the realtime with the sum of real times
   on the workers, as correctly done for the CPU time. Solves a timing
   problem observed in stressProof when using TProof::GetRealTime().


git-svn-id: http://root.cern.ch/svn/root/trunk@42415 27541ba8-7e3a-0410-8455-c3a389f83636