[ ESO ]
FORS2 Data Management:
General Information

QUALITY CONTROL
  HOME
FORS2 QC
Trending & QC1
Pipeline
Service Mode
Data Management
general info
QC links:
[best viewing with style sheets and javascript enabled]

File ownership

All raw files carry the FITS keyword 'HIERARCH ESO OBS PROG ID'. Depending on the content of this keyword, several cases are distinguished concerning the distribution of files in the Service Mode package:

  • SCIENCE files: here a strict check on the PROG_ID is made. You will receive all files which carry your PROG_ID, and only these. Included are also all associated slit acquisition images (called TEST).
  • CALIB files: you receive all the files which carry your PROG_ID, but in most cases your set is dominated by shared files, i.e. those ones which were produced by the Observatory as part of the daily calibration plan. So in general the selection of calibration files is not driven by the PROG_ID, but by the instrument settings.

File naming schemes

The following naming schemes are relevant for files in the Service Mode package:

  • archive file name (FITS keyword: ARCFILE): this is the unique name of a rawfile which consists of the parent instrument name and the timestamp of its generation. Raw files always have extension '.fits'.
  • original file name (FITS keyword: ORIGFILE): this is the name of a raw file generated by the instrument workstation. In case of FORS2, it consists of the name of the parent instrument, the arm, the category, the day number and a sequence number. Original file names are not necessarily unique.
  • data product file name (FITS keyword: PIPEFILE): this is the name of any pipeline product. It is composed by the prefix 'r,', the ARCFILE of the parent raw file stripped off by the extension, and a sequence number '_0000' etc (since there may an arbitrary number of pipeline products per raw file). Product files may have the extension '.fits' if they are frames, or '.tfits' if they are tables. In case that more than one raw file have been used to generate the product, the ARCFILE of the first one is used.
  • calibration file name: this is a name of calibration data products which has been chosen to have explicit information about the type of file, the date of creation, its version and the instrument parameters in the file name. It is generated after the pipeline product has been created. The FITS keyword PIPEFILE is preserved and can be used to map the two naming conventions. Find here more information about the naming scheme of FORS2 products.

File association

The association of raw files of different types (CALIB and SCIENCE), as well as of raw files and data products, is a non-trivial task given the amount and complexity of data types in many SM packages. To support in this task, we have created the list files which you find in each data directory.

In general, the logical link between raw files and product files (both SCIENCE and CALIB) is the Reduction Block (RB). You find the RBs which generated the reduced science data in the logs directory. Here is the scheme:

The RB carries all the information needed for the pipeline to process a raw frame:

  • the name of the raw file,
  • the name of the recipe to apply,
  • the name(s) of associated calibration files,
  • path and names of procuts in case of successful execution.

RBs in your log directories carry the name of the raw file (with extension .rX). The associated master calibration files can be found in the calib directories, while the products are in the reduced directories.

ReductionBlock

FAQs

General policy of data distribution

Check out here.

Do I have to submit a request to receive my Service Mode data package?

No. Service Mode programmes are declared completed by the Users Support Department. This signal is sent to the Data Flow Operations Group which then prepares the FORS2 package. The data are copied onto CDs/DVDs and sent to the PI as soon as possible.

When can I expect to receive my FORS2 data package?

You can check the status of FORS2 Service Mode runs:

Once you find your FORS2 SM run being finished, the following series of steps can be expected:

  • FORS2 data are shipped from Paranal to Garching headquartes twice a week.
  • They are processed by QC Garching as quickly as possible. Processed means: calibration products are created and quality-checked, science data are reduced.
  • Once all data for a specific programme have been processed, a signal is sent to the archive group to copy these data on DVDs.
  • The complete set of DVDs is mailed to the PI.

In total this chain of events is finished on average about four weeks after the last frames have been measured. Usually this time span is dominated by the shipping time.

Individual information about the status of a ServiceMode run can be found here.

General information about ServiceMode Observing can be found here.

Under which conditions will my data be reduced?

All FORS2 Service Mode science data taken in the supported modes can be expected to be pipeline-reduced. If a certain frame did not successfully reduce, there will be a note.


 
[FORS2 QC][Observing Facilities and Operations][ESO][Index][Search][Help][News]