LQCD Homepage

LQCD Home

QDCOC Computing

QBATCH Information

Introduction

Current Status

Quick Start

File Management

Job Description

Interactive Jobs

Queues on ACC Mbds

Power Cycling

qhdwcheck wrapper
qhdwcheck errors database web front

Deleting jobs

Basic PBS commands

PBS accounting

Machine Status

Web Display (Under Construction)
(Allocation status of all available partitions)

QCDOC Status (USDOE only)
(Partitions, Jobs DB, etc.)

Batch System: Current Status
(Available Queues, Running Jobs, etc.)

Errors Database
(DB of ASIC and Wire errors.)

Accounting and Usage Statistics

QCDOC Usage (USDOE only)(Under Construction)
USDOE QCDOC Machine Usage

New Users

Computer Accounts

Accessing QCDOC

CTS accounts

CyberSecurity Training

RBRC Users Mailing List

USDOE Users Mailing List

Internal Links
(Available to QCDOC Admins Only)

QBATCH: File Management

QIO utilities are now available via PBS scrips that will help split and scatter files to PFS directories, and also gather files and unsplit (merge) part files. The same utilities are available as command line scripts. For more details see the CRE File Management utilities.
The spitting and unsplitting of files is available in version 5 of PBS scripts. The QBATCH_HOME variable must be set to: /qcdoc/local/batch/v5

Splitting Files

PBS splits files and scatters the part files into the PFS directories before starting the execution of the user qcsh script. The user does not need to provide a Layout File (mapping between nodes and directories) as PBS will create the layout file if needed.
The following variables should be uncommented in your qbatch.pbs file: 
export QSPLIT="qsplit"
export QSPLITFILES="qio_file_1.out qio_file_2.out"
export PFSDESTDIR="./"
QSPLIT
the name (not the actual PATH) of the command that will be used to split files. There are currently two possiblilities: qsplit or qsplitDWF.
QSPLITFILES
the names of the files (separated by space) to be split.
PFSDESTDIR
the directory where the part files will be placed on the PFS systems.
QSPLITDIMS
provide the size in each dimension. Only used with qsplitDWF.

Unsplitting Files

PBS first gathers the part files from the PFS directories and then merges them into a single file. Again, a layout file will be generated by PBS if needed.
The following variables should be uncommented in your qbatch.pbs file: 
export QUNSPLIT="qunsplitSCIDAC"
export PFSSOURCEDIR="./"
export QUNSPLITFILES="qio_file_1.out"
QUNSPLIT
the name (not the actual PATH) of the command that will be used to unsplit (merge) files. There are currently three possiblilities: qunsplitDWF, qunsplitILGD, and qunsplitSCIDAC. qunsplit simply calls qunsplitSCIDAC.
PFSSOURCEDIR
The directory on PFS from where the part files will be gathered from
QUNSPLITFILES
the names of the files (separated by space) to be unplitted.
QUNSPITDIMS
provide the size in each dimension. Only used with qunsplitDWF.

One of ten national laboratories overseen and primarily funded by the Office of Science of the U.S. Department of Energy (DOE), Brookhaven National Laboratory conducts research in the physical, biomedical, and environmental sciences, as well as in energy technologies and national security. Brookhaven Lab also builds and operates major scientific facilities available to university, industry and government researchers. Brookhaven is operated and managed for DOE's Office of Science by Brookhaven Science Associates, a limited-liability company founded by Stony Brook University, the largest academic user of Laboratory facilities, and Battelle, a nonprofit, applied science and technology organization.
Privacy and Security Notice