LQCD Homepage

LQCD Home

QDCOC Computing

Lattice Archives at BNL

Contacts

User Information

Accessing QCDOC

Command Line Allocator
(replaces the Web Allocator)

Call Tracking System (CTS)
(Account is required)

User Guide

Batch System

File Transfers to/from BNL

Transfering Files between US LQCD Sites
(FNAL Link)

Software

Columbia Physics System (CPS)
(COLUMBIA UNIVERSITY Link)

US LQCD Common Runtime Environment

CRE: Setup
(CRE_HOME, setup scripts etc. )

CRE: Filesystems
(QDATA, QCACHE, QSCRATCH etc.)

CRE: Interactive System
(Compilers, Libraries, devel. tools, etc.)

CRE: File Management
(qsplit, qunsplit etc.)

CRE Definition (pdf)
(as of June 14th, 2006)

Machine Status

Web Display (Under Construction)
(Allocation status of all available partitions)

QCDOC Status (USDOE only)
(Partitions, Jobs DB, etc.)

Batch System: Current Status
(Available Queues, Running Jobs, etc.)

Errors Database
(DB of ASIC and Wire errors.)

New Users

Computer Accounts

Accessing QCDOC

CTS accounts

CyberSecurity Training

RBRC Users Mailing List

USDOE Users Mailing List

Internal Links
(Available to QCDOC Admins Only)

Common Runtime Environment: Interactive System

The front-end node

The CRE Interactive System is a standard Unix-like system. On QCDOC the front-end node (qcdochostb.qcdoc.bnl.gov) is an AIX machine that serves both as the Interactive Node (IN) and the Batch System Execution Node (BSEN).

The front-end node can be accessed remotely via ssh though the QCDOC ssh gateways. Outside the BNL campus the gateways are known as ssh.qcdoc.bnl.gov, while within BNL they can be accessed as ssh.qcdoc.bnl.local.

For a detailed description on how to access the front-end node, see Accessing QCDOC .

Top of Page

Standard Packages

Versions of standard unix shells and packages that are currently (Sept. 2006) installed (as required by the CRE) are listed in the following table:
Package Version
bash2.05b.0
tcsh6.11
GNU make3.80
cvs1.11.5
GNU autoconf2.58
GNU automake1.7.9
GNU m41.4
perl5.8.0
python2.3.4
java1.4.1
apache maven2.0.4
emacs21.1.1
gnuplot3.7.1-1
It is importatnt to note that the main function of the QCDOC front-end node is to handle the network communications and IO with the various machine partitions and NOT to be used as an analysis node.

In addition to the above standard packages that are expected to be available on every site, the following packages are available on the QCDOC front-end node:
Package Version
powerpc-gnu-elf-gcc/g++ cross compiler3.4.1
xlc native front-end6
RiscWATCH debugger

Top of Page

Libraries

Two types of libraries are required by the CRE: Third Party Libraries and SciDAC Libraries. Each library may have four associated environment variables pointing to the production version:
  • XXX_HOME (the installation directory, aka XXX_DIR)
  • XXX_CFLAGS (the flags required to compile with this library using -I or -D)
  • XXX_LDFLAGS (the flags required to be passed to the linker using -L)
  • XXX_LIBS (the lists of external libraries needed for linking).

SciDAC libraries come into versions: the parallel (or cross-compiled) version that is required by the CRE and the single processor (or host) version. Environment variables for the host version of the libraries are prefixed by HOST_

Third Libraries
Env. Variable Library Version
GMP_DIRCross compiled GNU Multiple Precision Library (libgmp)4.2.1
GMP_HOMECross compiled GNU Multiple Precision Library (libgmp)4.2.1
HOST_GMP_DIRHost version GNU Multiple Precision Library (libgmp)4.2.1
HOST_GMP_HOMEHost version GNU Multiple Precision Library (libgmp)4.2.1
XML2_DIRCross compiled XML Parser (libxml2)2.6.6
XML2_HOMECross compiled XML Parser (libxml2)2.6.6
HOST_XML2_DIRHost version XML Parser (libxml2)2.6.6
HOST_XML2_HOMEHost version XML Parser (libxml2)2.6.6
HOST_BAGEL_DIRBagel assembler generator1.3.2
HOST_BAGEL_HOMEBagel assembler generator1.3.2

SciDAC Libraries (cross compiled)
XXX_HOME Value
QMP/qcdoc/sfw/qos/devel/v2.6.0-CJ/aix5.2f/quser
QLA/qcdoc/sfw/SciDAC/QLibs/current_qcdoc/qla
QIO/qcdoc/sfw/SciDAC/QLibs/current_qcdoc/qio
QDPC/qcdoc/sfw/SciDAC/QLibs/current_qcdoc/qdp
QDPXXqcdoc/sfw/SciDAC/QLibs/current_qcdoc/qdp++
QDPXX_SINGLEqcdoc/sfw/SciDAC/QLibs/current_qcdoc/qdp++
QDPXX_NOBAGELqcdoc/sfw/SciDAC/QLibs/current_qcdoc/qdp++_nobagel
QDPXX_DOUBLE/qcdoc/sfw/SciDAC/QLibs/current_qcdoc/qdp++_dbPrec_noBagel
QDPXX_DOUBLE_NOBAGEL/qcdoc/sfw/SciDAC/QLibs/current_qcdoc/qdp++_dbPrec_noBagel

SciDAC Libraries (host version)
HOST_XXX_HOME Value
QMP/qcdoc/sfw/SciDAC/QLibs/current_host/qmp
QLA/qcdoc/sfw/SciDAC/QLibs/current_host/qla
QIO/qcdoc/sfw/SciDAC/QLibs/current_host/qio
QDPC/qcdoc/sfw/SciDAC/QLibs/current_host/qdp
QDPXX/qcdoc/sfw/SciDAC/QLibs/current_host/qdp++
QDPXX_SINGLE/qcdoc/sfw/SciDAC/QLibs/current_host/qdp++
QDPXX_DOUBLE/qcdoc/sfw/SciDAC/QLibs/current_host/qdp++_dbPrec
BAGEL/qcdoc/sfw/SciDAC/QLibs/current_host/bagel

Top of Page

Other Environment Variables

Other Env. variables that are required to be set by the CRE. They are set when the CRE setup scripts are invoked and for QCDOC they all refer to cross complilers, cross linkers, etc.
Env. Variable Value
QCCpowerpc-gnu-elf-gcc
QCXXpowerpc-gnu-elf-g++
QASpowerpc-gnu-elf-as
QLDpowerpc-gnu-elf-ld
QARpowerpc-gnu-elf-ar
QRANLIB (a.k.a QRN)powerpc-gnu-elf-ranlib
All the above named executables are located under $QCDOC_PACKAGES/local/bin/ which should be in the user's PATH after executing the QOS setup scripts.

Top of Page

One of ten national laboratories overseen and primarily funded by the Office of Science of the U.S. Department of Energy (DOE), Brookhaven National Laboratory conducts research in the physical, biomedical, and environmental sciences, as well as in energy technologies and national security. Brookhaven Lab also builds and operates major scientific facilities available to university, industry and government researchers. Brookhaven is operated and managed for DOE’s Office of Science by Brookhaven Science Associates, a limited-liability company founded by Stony Brook University, the largest academic user of Laboratory facilities, and Battelle, a nonprofit, applied science and technology organization.
Privacy and Security Notice