Processing TOVS Polar Pathfinder data using the distributed batch controller

James Duff; Kenneth M. Salem; Axel Schweiger; Miron Livny

doi:10.1117/12.278920

18 September 1997 Processing TOVS Polar Pathfinder data using the distributed batch controller

James Duff, Kenneth M. Salem, Axel Schweiger, Miron Livny

Proceedings Volume 3117, Earth Observing Systems II; (1997) https://doi.org/10.1117/12.278920
Event: Optical Science, Engineering and Instrumentation '97, 1997, San Diego, CA, United States

Abstract

The distributed batch controller (DBC) supports scientific batch data processing. Batch jobs are distributed by the DBC over a collection of computing resources. Since these resources may be widely scattered the DBC is well suited for collaborative research efforts whose resources may not be centrally located. The DBC provides its users with centralized monitoring and control of distributed batch jobs. Version 1 of the DBC is currently being used by the TOVS Polar Pathfinder project to generate Arctic atmospheric temperature and humidity profiles. Profile generating jobs are distributed and executed by the DBC on workstation clusters located at several sites across the US. This paper describes the data processing requirements of the TOVS Polar Pathfinder project, and how the DBC is being used to meet them. It also describes Version 2 of the DBC. DBC V2 is implemented in Java, and utilizes a number of advanced Java features such as threads and remote method invocation. It incorporates a number of functional enhancements. These include a flexible mechanism supporting interoperation of the DBC with a wider variety of execution resources and an improved user interface.

Citation Download Citation

James Duff, Kenneth M. Salem, Axel Schweiger, and Miron Livny "Processing TOVS Polar Pathfinder data using the distributed batch controller", Proc. SPIE 3117, Earth Observing Systems II, (18 September 1997); https://doi.org/10.1117/12.278920

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
11 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Java

Data processing

Humidity

Human-machine interfaces

Control systems

Systems modeling

Computer science

Show All Keywords

Keywords/Phrases

Search In:

Publication Years