git-svn-id: http://root.cern.ch/svn/root/trunk@36521 27541ba8-7e3a-0410-8455-c3a389f83636

   Do not contact the DNS when not needed: allows to skip possible long timeouts in PROOF-Lite.


git-svn-id: http://root.cern.ch/svn/root/trunk@34937 27541ba8-7e3a-0410-8455-c3a389f83636

   For 'eventproc' add the possibility to define the inoput dataset via a text file.
   The option name is again 'datasrc'; if the value is an existing and readable local
   file the TChain is initialized from there. This is useful to test, for example, the
   dependence on the order of the files.
   Example:
                runProof("eventproc(datasrc=local_event.txt)")


git-svn-id: http://root.cern.ch/svn/root/trunk@34638 27541ba8-7e3a-0410-8455-c3a389f83636

   Make the setting of the parameter 'PROOF_RateEstimation' to 'average' optional (option 'rateest=average'
   on the command line): it was screwing up the progress bar in some cases.


git-svn-id: http://root.cern.ch/svn/root/trunk@34623 27541ba8-7e3a-0410-8455-c3a389f83636

   - Add switch to control the verbosity level (interface to TProof::SetLogLevel); examples
      a. runProof("simple(debug=1)")
         runs 'simple' with debug level 1
      b. runProof("eventproc(debug=kPacketizer:2)")
         runs 'eventproc' with debug level 2 but only for the printouts matching
         TProofDebug::kPacketizer (see TProofDebug.h).
   - For 'eventproc':
      - add possibility to specify multiple data sources, e.g.
         runProof("eventproc(datasrc=/data1/event|/data2/event"))
      - add possibility to specify the disk partitions, e.g.
         runProof("eventproc(partitions=/data1/event|/data2/event"))
      These additions are needed to test a new undergoing development in the packetizer allowing
      to include disk partition information in the server node classification.


git-svn-id: http://root.cern.ch/svn/root/trunk@34596 27541ba8-7e3a-0410-8455-c3a389f83636

   TPacketizerAdaptive
    - Better to use TDSetElement::GetNum() instead of TDSetElement::GetEntries() for the
      recent packetizer optimization (includes cases where fractions of files are processed)
   runProof
    - Add option 'uneven' to tutorial 'eventproc' to simulate some uneveness in the entries
      per file
    - Solve a few issues with formats


git-svn-id: http://root.cern.ch/svn/root/trunk@34533 27541ba8-7e3a-0410-8455-c3a389f83636

  - Fix problem with transmission of EnablePackage arguments to workers
  - Add test in stressProof for package argument setting (two new test packages
    added under tutorials/proof)

  Should fix problem reported in Savannah #70041 .


git-svn-id: http://root.cern.ch/svn/root/trunk@34427 27541ba8-7e3a-0410-8455-c3a389f83636

git-svn-id: http://root.cern.ch/svn/root/trunk@34303 27541ba8-7e3a-0410-8455-c3a389f83636

   - Optimize the validation step in the case not all the entries are required.
     The validation step is stopped as soon as the requested number of events is reached.
     If the parameter "PROOF_ValidateByFile" is set to 1, the number of files is exactly what
     needed; otherwise the number of files may exceed the number of fles needed by #workers-1
     (this is the default because additional, serial, checks are needed to ensure that only
      the files really required are open).
     This feature was requested in the context of ALICE reconstruction.
     This new feature is used as an example in the "eventproc" tutorial in runProof.C .
   - The patch also fixes a subtle bug affecting the (possibly rare) case when not all entries
     are required and # entries does not correspond to an complete subset of files (e.g.
     # entries = 1001000 with files of 100000 entries each). The effect was uncomplete
     processing (skipped events, magenta bar) or a session freeze.


git-svn-id: http://root.cern.ch/svn/root/trunk@33781 27541ba8-7e3a-0410-8455-c3a389f83636

git-svn-id: http://root.cern.ch/svn/root/trunk@33748 27541ba8-7e3a-0410-8455-c3a389f83636

git-svn-id: http://root.cern.ch/svn/root/trunk@33655 27541ba8-7e3a-0410-8455-c3a389f83636

   Add new tutorial 'friends' to illustrate the usage of friends in PROOF (and also the usage
   of the new packetizer TPacketizerFile to generate files). To try it out, just do

         root [] .L tutorials/proof/runProof.C+
         root [] runProof("friends")

   The number of events can be controlled as usual with 'nevt=<nevts>' (default 10000).


git-svn-id: http://root.cern.ch/svn/root/trunk@33650 27541ba8-7e3a-0410-8455-c3a389f83636

git-svn-id: http://root.cern.ch/svn/root/trunk@33611 27541ba8-7e3a-0410-8455-c3a389f83636

git-svn-id: http://root.cern.ch/svn/root/trunk@33607 27541ba8-7e3a-0410-8455-c3a389f83636

   In tutorials/proof/getProof.C
     - Use default port 40000 (80000 is above the max allowed on some machines)
     - Use "xpdtut" instead of "xpd-tutorial" to shorten the paths
     - On MacOsX, create unix sockets under /tmp/xpd-sock
   In test/stressProof.cxx
     - Use "xpdtut" instead of "xpd-tutorial" to adapt to the change in getProof.C
     - On MacOsX do not add the username in the tep sub-directory
     - Add missing protection when printing the run statistics (gProof must be defined)


git-svn-id: http://root.cern.ch/svn/root/trunk@32954 27541ba8-7e3a-0410-8455-c3a389f83636

   - In tutorial/proof/getProof.C
      - Change default port to 80000 (11093 is often used for a second daemon)
      - Add function killXrootdAt to stop a running daemon
      - Wait 5 secs after a daemon stop request to free all ports
      - Fix some typos in notification statements and comments
   - In test/stressProof.C
      - Refer external code to ROOTSYS instead of "../" so that it can be run from
        anywhere (e.g. inside roottest)
      - Add rough estimation of ROOTMARKS (to be fine-tuned and probably elaborated)
      - Use 80000 as default port
      - Stop the daemon after the test to avoid/reduce problems with port occupancy
        when running next test
   - Make the output of TProof::GetStatistics more compact


git-svn-id: http://root.cern.ch/svn/root/trunk@32713 27541ba8-7e3a-0410-8455-c3a389f83636

   - Add possibility to fill/use an entry list in the 'h1' example following the example
     under tutorial/tree:
      - to fill the list and save it into elist.root run
          runProof("h1,fillList")
      - to use the list from elist.root run
          runProof("h1,useList")
   - Add the possiblity to change the directory or URL from where the H1 files are read, e.g.
          runProof("h1,h1src=/data/files/h1")
     default is always the ROOT http server (http://root.cern.ch/files/h1).


git-svn-id: http://root.cern.ch/svn/root/trunk@32216 27541ba8-7e3a-0410-8455-c3a389f83636

be picked-up also when running on a non-local PROOF setup.


git-svn-id: http://root.cern.ch/svn/root/trunk@32193 27541ba8-7e3a-0410-8455-c3a389f83636

  - Remove wrong documentation statemenets at the top of selectors
  - Add doc links to the steering macro 'runProof.C'
  - Add the name of the selector corresponding to each option at
    in the documentation at the top of 'runProof.C'



git-svn-id: http://root.cern.ch/svn/root/trunk@32034 27541ba8-7e3a-0410-8455-c3a389f83636

   A few fixes/protections in the PROOF tutorial steering macros:
     - Make sure that the dir paths for selectors and PARs are always correct
     - Add possibility to force '++' mode as a workaround to the usual problem of fake dependencies
     - Add a check on the running mode and refuse to run if not compiled (the checks for running daemons
       require compilation)


git-svn-id: http://root.cern.ch/svn/root/trunk@31832 27541ba8-7e3a-0410-8455-c3a389f83636

git-svn-id: http://root.cern.ch/svn/root/trunk@31831 27541ba8-7e3a-0410-8455-c3a389f83636

   test/stressProof
    - Add test for the submergers functionality
   tutorials/proof/runProof
    - Add argument to enable submergers
   tutorials/proof/getProof
    - Add hook to start a valgrind session; this is controlled by the env GETPROOF_VALGRIND (see top of
      the macro for details).


git-svn-id: http://root.cern.ch/svn/root/trunk@31684 27541ba8-7e3a-0410-8455-c3a389f83636

git-svn-id: http://root.cern.ch/svn/root/trunk@31474 27541ba8-7e3a-0410-8455-c3a389f83636

git-svn-id: http://root.cern.ch/svn/root/trunk@31440 27541ba8-7e3a-0410-8455-c3a389f83636

git-svn-id: http://root.cern.ch/svn/root/trunk@31439 27541ba8-7e3a-0410-8455-c3a389f83636

git-svn-id: http://root.cern.ch/svn/root/trunk@31257 27541ba8-7e3a-0410-8455-c3a389f83636

git-svn-id: http://root.cern.ch/svn/root/trunk@31244 27541ba8-7e3a-0410-8455-c3a389f83636

git-svn-id: http://root.cern.ch/svn/root/trunk@31243 27541ba8-7e3a-0410-8455-c3a389f83636

   Add argument 'cache=sz' to control the usage of the cache, e.g.

          runProof("eventproc(cache=0)")

   disables the cache.


git-svn-id: http://root.cern.ch/svn/root/trunk@30861 27541ba8-7e3a-0410-8455-c3a389f83636

  For PROOF tutorials:
  - add argument 'nwrk=N' to change the number of workers also on the fly, e.g.
         runProof("simple(nwrk=2)") 
  - add argument 'punzip' to enable parallel unzipping, e.g.
         runProof("eventproc(punzip)") 
  In the new PROOF tutorial "evenproc":
  - remove the need for the external file event-http.txt for the dataset creation
    (file names are generated on the fly)
  - read by default only the needed brabches; add option 'readall' to switch to full
    reading, e.g. runProof("eventproc(readall)")
  - add the possibility to change data source, e.g.
         runProof("eventproc(datasrc=root://lxfsrd0706.cern.ch//pool/event/http)")


git-svn-id: http://root.cern.ch/svn/root/trunk@30857 27541ba8-7e3a-0410-8455-c3a389f83636

   Add tutorial "eventproc" reading "event" like events from the ROOT HTTP server
   This is useful to test the new perfomance information being added to the PROOF
   dialog box.


git-svn-id: http://root.cern.ch/svn/root/trunk@30845 27541ba8-7e3a-0410-8455-c3a389f83636

   Do not set anymore the ForceLocal option in the packetizer when drawing
   from the created dataset. This was needed as a workaround for the problem
   in XrdClient fixed recently.


git-svn-id: http://root.cern.ch/svn/root/trunk@30218 27541ba8-7e3a-0410-8455-c3a389f83636

  Whenever possible, force creation of temporary directories under /tmp/<user> instead
  of gSystem->TempDirectory().
  This allows to circumvent problems in creating UNIX sockets happening, for example, on
  on MacOsX.


git-svn-id: http://root.cern.ch/svn/root/trunk@30217 27541ba8-7e3a-0410-8455-c3a389f83636

   Add tutorial for the new functionality of dataset automatic creation from files
   created on the workers, using TProofOutputFile. 
   The tutorial is referred to as "dataset" in runProof.C and uses the selector
   ProofNtuple as the "ntuple" tutorial, with a slightly different configuration.
   The created dataset is called 'testNtuple' and it is automatically registered
   and verified. The dataset is then used to produce the same plot as in "ntuple"
   but using the DrawSelect methods of PROOF, showing how to set style, color and
   other drawing attributes in PROOF.

   To try it out, do

          root [0] .L tutorials/proof/runProof.C+
          root [1] runProof("dataset")


git-svn-id: http://root.cern.ch/svn/root/trunk@30183 27541ba8-7e3a-0410-8455-c3a389f83636

git-svn-id: http://root.cern.ch/svn/root/trunk@29611 27541ba8-7e3a-0410-8455-c3a389f83636

git-svn-id: http://root.cern.ch/svn/root/trunk@29578 27541ba8-7e3a-0410-8455-c3a389f83636

   Improvements in the PROOF tutorials:
     - New tutorial "ntuple", using the selector ProofNtuple.h,.C to the usage of
       TProofOutputFile to merge via temporary files. To run it locally, do

              root[] .L tutorials/proof/runProof.C+
              root[] runProof("ntuple")

       This fills a simple ntuple which saved in the local working directory in the
       file ProofNtuple.root .
       If you run the tutorial using a remote cluster the script will automatically
       start a local xrootd on port 9000 to receive the file.
     - Add methods to ping 'xrootd' or 'xproofd' services at given host:port in getProof.C
       this allows to make consolidate the checks done to setup the tutorial.
     - Explicitely include TDatabasePDG.h in ProofPythia.C to solev a compilation issue
       with recent ROOT versions.


git-svn-id: http://root.cern.ch/svn/root/trunk@29492 27541ba8-7e3a-0410-8455-c3a389f83636

git-svn-id: http://root.cern.ch/svn/root/trunk@29062 27541ba8-7e3a-0410-8455-c3a389f83636

   Avoid interferences between the settings used for the PROOF tutorial
   and possible local settings (daemon, dataset manager).


git-svn-id: http://root.cern.ch/svn/root/trunk@28982 27541ba8-7e3a-0410-8455-c3a389f83636

git-svn-id: http://root.cern.ch/svn/root/trunk@27056 27541ba8-7e3a-0410-8455-c3a389f83636