SINFONI:
Association Rules

Association Rules

1. Introduction

Prior to processing any SINFONI data, the frames need to be matched in terms of setup and in terms of dependencies. The organization, classification, and association (OCA) of frames (raw calibrations and science, as well as pipeline processed products) occurs at several places within the VLT Data Flow.

Based on information available in the headers, raw frames are matched to the files (i.e. product frames) that they require in order to be processed, and in terms of assciation rules based on the keywords:
INS.SETUP.ID (i.e. the filter/grism used: S1_J, S2_H, S3_K, or S4_H+K)
INS.OPTI1.NAME (i.e. the pixels scale as given by the pre-optics: 25, 100, or 250 mas)
DET.DIT (i.e. frames matched to products having the same detector integration time)
OBS.PROG.ID (i.e. science data and specific calibrations matched to a given scientific program)

For example, a matching rules could be as follows:

- match to the closest (in time) stack of raw FLAT frames that have INS.SETUP.ID=S1_J and INS.OPT1.NAME=0.025
- match to all telluric standard stars for the program OBS.PROG.ID=090.A-0987(B), that have INS.SETUP.ID=S3_K and INS.OPT1.NAME=0.1, within the same night, and with an airmass difference to the science data of no more than delta_airmass = +/- 0.2.

2. Basic and Static Calibrations

For the static calibrations, the SINFONI data reduction scheme requires a) an arc reference table b) a reference bad pixel map, c) the position of the first column and d) a setup table.

Raw frames generated by the dark, linearity, and distortion templates can be reduced by the pipeline without the need for any other calibration products. Raw dark frames are grouped according to the discrete integration time (DET.DIT), linearity products are grouped by the pre-optics (INS.OPTI1.NAME), and distortion products are grouped by the pre-optics (INS.OPTI1.NAME) and by the filter/grism (INS.SETUP.ID).

3. Dependent Calibrations

The flat recipe requires, apart from the raw flat frames, the linearity bad pixel map with the same filter/grism (INS.SETUP.ID).

The wave recipe requires, apart from the raw wave frames, the following calibration products: a master flat frame with the identical filter/grism (INS.SETUP.ID) and pre-optics (INS.OPTI1.NAME), the static arc reference table, as well as a slit pos table matching in INS.SETUP.ID and a distortion table matching in INS.OPTI1.NAME, both of which are products of the distortion recipe.

4. Science Products

Science raw frame stacks, as well as telluric standard stars and PSF stars, are grouped by matching filter/grism (INS.SETUP.ID) and pre-optics (INS.OPTI1.NAME). The science, STD, and PSF frames all require the same set of master calibrations. These are:

a static (first column) calibration

a master bad pixel map matched with INS.SETUP.ID and INS.OPTI1.NAME

a master flat lamp matched with INS.SETUP.ID and INS.OPTI1.NAME

a distortion table, matched with INS.SETUP.ID only

a slitlet distances table, matched with INS.SETUP.ID only

a wave map matched with INS.SETUP.ID and INS.OPTI1.NAME

a slit_pos matched with INS.SETUP.ID and INS.OPTI1.NAME

Although the pipeline does not explicitly use standard stars (telluric and PSF stars), these must be associated to calibrate science products beyond the pipeline processing. The match rule for PSF stars is OBS.ID and the match rule for telluric standard stars is : take all tellurics standard stars products within the same night matched with INS.SETUP.ID and INS.OPTI1.NAME.