[ ESO ]

SINFONI pipeline:
Calibration files and recipes


CAL | HC | refs | QC
QUALITY CONTROL
    HOME
SINFONI QC
Trending & QC1
Pipeline
calibration recipes
Data Packages
Data Management
QC links:
SINFONI calibration files and recipes

This page is a description of how SINFONI calibration data is processed.

Contents (click on the links to jump to the specific calibrations):

Day-time calibration

More information is given in the following pages

This page describes the individual recipe calls, the required raw input data, and products as they are used by the pipeline in Garching. The example products have been generated with pipeline version 2.0.8 (2009-09-15).


DARK

Purpose. Dark frames are obtained to monitor the technical performance of the detector, and to correct subsequent data for pixel-to-pixel dark current variations and pixels with very high dark currents (i.e. hot pixels). Darks generally come in stacks of 3 raw frames and are routinely measured during each night when SINFONI is operational. All raw darks of a given DIT are processed into master dark frames and hot pixel maps and are quality-checked on the mountain and by QC Garching. Since SINFONI darks are generally not stable, all master dark frames are stored in the calibration archive and individually delivered in the service mode packages recieved by the PI.

Input

TPL.ID SINFONI_ifs_cal_Darks
DPR.TYPE DARK
TAG DARK RAW
grouping DET.DIT
recipe/call esorex sinfo_rec_mdark sof
recipe configuration file sinfo_rec_mdark.rc

Products.

PRO.CATG contents
MASTER_DARK average of three raw frames (used in cascade)
BP_MAP_HP hot (high dark current) pixel map

QC parameters derived by the pipeline

QC.DARKMED.AVE average of the median dark current measured in each of 3 raw darks
QC.DARKMED.STDEV standard deviation of dark current in 3 raw dark frame medians
QC.DARK.FPN windowed and non-robust scatter in a area on the chip
QC.RON.RMS scatter in Fixed-Pattern-Noise
QC.RON1 RON of first consecutive pair of raw frames (raw2-raw1)
QC.RON2 RON of second consecutive pair of raw frames (raw3-raw2)
QC.BP_MAP.BADPIX number of bad (hot) pixel
QC.DARK.FPN windowed and non-robust scatter in a area on the chip

 


DISTORTION

Purpose. Distortion frames are obtained to monitor the optical distortion and the distances between the slitlets. They come in stacks of 79 raw frames consisting of:
75 north/south fibre images
2 flat lamp images (one each of lamp-on, lamp-off)
2 wavelength lamp calibrations (one each of lamp-on, lamp-off)

Distortions are made for all wavebands (J, H, K, and H+K) at the 25 mas pixel scale. They are routinely measured once per month and after each instrument intervention. They are all processed into DISTORTION and SLITLETS_DISTANCES product tables that are quality-checked on the mountain and by QC Garching. All master master distortion and slitlet tables are stored in the calibration archive and individually delivered in the service mode packages recieved by the PI.

Input

TPL.ID SINFONI_ifs_tec_NorthSouth
DPR.TYPE (75 frames) DISTORTION,FIBRE,NS
DPR.TYPE (2 frames) DISTORTION,FLAT,LAMP
DPR.TYPE (2 frames) DISTORTION,FLAT,WAVE
TAG DISTORTION_FIBRE_NS
TAG DISTORTION_FLAT_LAMP
TAG DISTORTION_FLAT_WAVE
grouping INS.SETUP.ID : S1_J, S2_H, S3_K, S4_H+K
recipe/call esorex sinfo_rec_distortion sof
recipe configuration file sinfo_rec_distortion.rc

Products.

PRO.CATG contents cascade
DISTORTION table with polynomial distortion coefficients (used for cascade) YES
SLITLETS_DISTANCE table with slitlet positions (used for cascade) YES
WAVE_LAMP_STACKED arc lamp used to located edges of slitlets NO
MASTER_FLAT_LAMP master flat (only used to flat-field distortions) NO
BP_MAP_DI bad pixel map from raw flats YES
FIBRE_NS_STACKED stacked fibre lamp-on minus stacked fibre lamp-off frames NO
FIBRE_NS_STACKED_ON stacked fibre lamp-on frames NO
FIBRE_NS_STACKED_OFF stacked fibre lamp-off frames NO
FIBRE_NS_STACKED_DIST undistorted stack of fibre lamp-on minus fibre lamp-off frames NO

QC parameters

QC.COEFF00 ... Polynomial distortion coefficients
... QC.COEFF12 Polynomial distortion coefficients
QC.XSHIFT.UL x-shift of the upper left quadrant center (512,1536)
QC.XSHIFT.UR x-shift of the upper right quadrant center (1536,1536)
QC.XSHIFT.LL x-shift of the lower left quadrant center (512,512)
QC.XSHIFT.LR x-shift of the lower right quadrant center (1536,512)
QC.XSHIFT.CC x-shift of the chip center (1024,1024)
QC.SL.DISTAVE average of slitlet distances
QC.SL.DISTRMS scatter in slitlet distances

 


LINEARITY

Purpose. Linearity frames are created in order to monitor the response properties of the detector. They come in stacks of several pairs of lamp-on and lamp-off frames, spanning a range of detector DITs (usually 1 to 45 seconds). Linearities are made for all wavebands (J, H, K, and H+K) at the 25 mas pixel scale and are routinely measured approximately every 20 days and after every intervention. They are all processed into several coeffient frames and are quality-checked on the mountain and by QC Garching. All master master linearity cubes are stored in the calibration archive and individually delivered in the service mode packages recieved by the PI.

Input

TPL.ID SINFONI_ifs_tec_LinDet
DPR.TYPE (24 frames) LINEARITY,LAMP
TAG LINEARITY_LAMP RAW
grouping INS.SETUP.ID : S1_J, S2_H, S3_K, S4_H+K
recipe/call esorex sinfo_rec_detlin sof
recipe configuration file sinfo_rec detlin.rc

Products.

PRO.CATG contents
BP_COEFFS

a cube with each plane a different linearity coefficient:
plane[0], plane[1], plane[2]

LIN_DET_INFO table with flux vs. DIT information
GAIN_INFO table with ADU level vs. gain information
BP_MAP_NL non-linearity bad pixel map (used for cascade)

QC parameters

QC.BPM.LIN0.MEAN mean linearity polynomial coefficient
QC.BPM.LIN1.MEAN mean linearity polynomial coefficient
QC.BPM.LIN2.MEAN mean linearity polynomial coefficient
QC.BPM.LIN3.MEAN mean linearity polynomial coefficient
QC.BPM.LIN4.MEAN mean linearity polynomial coefficientmean
QC.BPM.NBADPIX total number of non-linear pixels
QC.GAIN computed gain

 


FLAT

Purpose. Flat frames are created to correct and monitor the pixel-to-pixel response properties of the detector. They come in stacks of several pairs of lamp-on and lamp-off frames. They are routinely measured and are processed into a master bad pixel map and a master flat. They are quality-checked on the mountain and by QC Garching. All master master linearity cubes are stored in the calibration archive and individually delivered in the service mode packages recieved by the PI.

Input

TPL.ID SINFONI_ifs_cal_LampFlats
DPR.TYPE (5 on/off pairs) FLAT,LAMP
TAG FLAT RAW
grouping INS.SETUP.ID : S1_J, S2_H, S3_K, S4_H+K
grouping INS.OPTI1.NAME : 0.025, 0.1, 0.25
required master calibrations BP_MAP_NL (from linearity)
  REF_BP_MAP (static calibration)
recipe/call esorex sinfo_rec_mflats sof
recipe configuration file sinfo_rec_mflats.rc

Products

PRO.CATG contents
MASTER_LAMP_FLAT average of three on /off pairs (used for cascade)
BP_MAP_NO bad pixel map (from raw flat frames)
MASTER_BP_MAP bad pixel map (combined NL and NO) (used for cascade)

QC parameters

QC.LFLAT.FPN1 standard deviation of a certain region in the product frame
(central quarter: [512, 512: 1536, 1536]
QC.LFLAT.FPN2 standard deviation of another region in the product frame
(single slitlet: [1350, 1000: 1390, 1200]
QC.SPECFLAT.NCNTSAVG median counts of each ON-OFF frame; then an average of the N=5 median values and the standard deviation of the 5 median values
QC.SPECFLAT.NCNTSSTD
QC.SPECFLAT.OFFFLUX the median counts of the off-lamp frames
QC.BP-MAP.NBADPIX number of bad pixels

 


WAVE

Purpose. Arc frames are created to derive the wavelength solution and calibrate the observations. They come in stacks of several pairs of lamp-on and lamp-off frames. They are routinely measured every morning. They are all processed into a several product frames. They are quality-checked on the mountain and by QC Garching. All master wavelength calibration products are stored in the calibration archive and individually delivered in the service mode packages recieved by the PI.

Input

TPL.ID SINFONI_ifs_cal_Arcs
DPR.TYPE (3 on/off pairs) FLAT,WAVE
TAG WAVE_LAMP RAW
grouping INS.SETUP.ID : S1_J, S2_H, S3_K, S4_H+K
grouping INS.OPTI1.NAME : 0.025, 0.1, 0.25
required master calibrations SLITLETS_DISTANCE (from distortion)
required master calibrations DISTORTION (from distortion)
required master calibrations REF_TABLE (static calibration)
required master calibrations MASTER_FLAT_LAMP (from mflats)
required master calibrations MASTER_BP_MAP (from mflats)
required master calibrations SLIT_POS (will maybe disappear)
recipe/call esorex sinfo_rec_wavecal sof
recipe configuration file

sinfo_rec_wavecal.rc

Products.

PRO.CATG contents
WAVE_MAP wavelength solution per column (used for cascade)
SLIT_POS table with 32 slit-begin slit-end numbers (used for cascade)
WAVE_LAMP_STACKED the stacked raw wave frames
WAVE_COEF_SLIT table with dispersion coefficients per column
WAVE_FIT_PARAMS table with arc line fit results

QC parameters

QC.WAVE.ALL number of found lines
QC.WAVE.NPIXSAT number of saturated pixels
QC.WAVE.MAXFLUX maximum of off-lamp subtracted frame
QC.COEF0.AVG Average wavecal coefficient (central wavelength)
QC.COEF1.AVG Average wavecal coefficient (linear dispersion)
QC.COEF2.AVG Average wavecal coefficient (quadratic term)
QC.COEF0.MED Median wavecal coefficient (central wavelength)
QC.COEF1.MED Median wavecal coefficient (linear dispersion)
QC.COEF2.MED Median wavecal coefficient (quadratic term)
QC.FWHM.MED Median FullWidth@HalfMaxium of all arc lines
QC.FWHM.AVG Average FullWidth@HalfMaxium of all arc lines

 


STD

Purpose. Telluric Standard stars are taken to provide a telluric absorption template on top of a bright spectrum of a star with negligible stellar features. Science spectra are not corrected for telluric absorption features

Input

TPL.ID SINFONI_ifs_cal_StandardStar
DPR.TYPE (usually 1) STD and SKY,STD
TAG STD
TAG SKY_STD
grouping INS.SETUP.ID : S1_J, S2_H, S3_K, S4_H+K
grouping INS.OPTI1.NAME : 0.025, 0.1, 0.25
required master calibrations SLITLETS_DISTANCE (from distortion)
required master calibrations DISTORTION (from distortion)
required master calibrations MASTER_FLAT_LAMP (from mflats)
required master calibrations MASTER_BP_MAP (from mflats)
required master calibrations SLIT_POS (from wavecal)
required master calibrations FIRST_COL (static calibration)
required master calibrations WAVE_MAP (from wavecal)
required master calibrations ATM_REF_CORR (static calibration)
recipe/call esorex sinfo_rec_jitter sof
recipe configuration file

sinfo_rec_jitter.rc

Products.

PRO.CATG contents
COADD_STD cube, coadded from jittered cubes, plane50, plane512, plane1024, plane1536, plane2120
MASK_COADD_STD cube with weight factors
OBS_STD N object cubes before being co-added
STD_NODDING_STACKED N stacked object frames before being 'cubed'
MED_COADD_STD median collapsed COADD_STD
STD_STAR_SPECTRA table with extracted spectrum and response function
STD_STAR_SPECTRUM extracted spectrum in fits format

The columns of the PRO.CATG=STD_STAR_SPECTRA products are:
wavelength : in micron

  • counts_tot: the sum of all counts in a given area of each plane of the COADD_STD cube. The area over which all counts are summed is given by the central position of the source plus minus a factor times the FWHM of the Gaussian fit. The default factor is 5, but can be modified in the sinfo_rec_jitter.rc file (generated via esorex --create-config sinfo_rec_jitter). The corresponding command line paramter is --std_star-fwhm_fct). The resulting number of counts are per DIT (not per sec).
  • bkg_tot: the background in counts as derived by a 2D-Gaussian fit to the expected single object in the FOV in the given plane. When the FWHM of the standard star is very large and becomes comparable with the small size of the FOV (dependent on the used camera 0.025, 0.1 or 0.250) the sky estimation might become false. The pipeline checks this case and returns extra information in the recipe log (see pipeline manual for details).
  • counts_bkg: = counts_tot minus bkg_tot, hence this column gives the total counts per DIT of the source. No assumptions on the PSF of the objects are applied. No special extraction algorithm is applied.
  • bb_flux_norm: Using the filter (lambda_c) and the MK type (Teff) of the standard star, get the ratio flux ratio between a black body at lambda and Teff and a reference black body at lambda_c and 10000K.
  • efficiency: a) convert the flux on the detector in erg/s/cm/cm/A units; b) scale the bb_flux_norm to the flux of a 0th magnitude star in the given band; c) devide result of a) by result of b).

The PRO.CATG=CONVFACTOR is contains only the Mag per counts/sec

the function determines an intensity conversion factor for the instrument
by fitting a 2D-Gaussian to an collapsed image of a standard star
with known brightness (only for non-AO observations).
Then the resulting Gaussian is integrated and the counts
are divided by the exposure time (Fits header information)

factor = mag / (float)sum * exptime ;

QC parameters

QC CONVFCT conversion factor
QC CHECK1 check evaluation box
QC CHECK2 check evaluation box
QC CHECK3 check evaluation box
QC FWHMX standard star FWHM in X
QC FWHMY standard star FWHM in Y

 


PSF

Purpose. Arc frames are to monitor the wavelength solution and calibrate the observations. They come in stacks of several pairs of lamp-on and lamp-off frames. They are routinely measured every morning. They are all processed into a several product frames. They are quality-checked on the mountain and by QC Garching. All master wavelength calibration products are stored in the calibration archive and individually delivered.

Input

TPL.ID SINFONI_ifs_cal_StandardStar
DPR.TYPE (usually 1) PSF-CALIBRATOR and SKY,PSF-CALIBRATOR
TAG PSF
TAG SKY_PSF
grouping INS.SETUP.ID : S1_J, S2_H, S3_K, S4_H+K
grouping INS.OPTI1.NAME : 0.025, 0.1, 0.25
required master calibrations SLITLETS_DISTANCE (from distortion)
required master calibrations DISTORTION (from distortion)
required master calibrations MASTER_FLAT_LAMP (from mflats)
required master calibrations MASTER_BP_MAP (from mflats)
required master calibrations SLIT_POS (from wavecal)
required master calibrations FIRST_COL (static calibration)
required master calibrations WAVE_MAP (from wavecal)
required master calibrations ATM_REF_CORR (static calibration)
recipe/call esorex sinfo_rec_jitter sof
recipe configuration file

sinfo_rec_jitter.rc

Products.

PRO.CATG contents
COADD_PSF cube, coadded from jittered cubes
MASK_COADD_PSF cube with weight factors
OBS_PSF N object cubes before being co-added
PSF_NODDING_STACKED N stacked object frames before being 'cubed'
MED_COADD_PSF median collapsed COADD_PSF
AO_PERFORMANCE table with extracted Strehl ratios
ENC_ENERGY table with extracted encircled energy

 


Static calibrations

 

PRO.CATG description downloads
REF_ARC_TAB tables with the arc line positions and scaled arc line intensity J, H, K, H +K
FIRST_COL table containing the initial guess for the pixel position of the first slitlet f0
REF_BP_MAP bad pixel map ( a 2 pixel wide rim is flagged) cor
DRS_SETUP_WAVE wavelength calibration, grating dependent parameters drs_setup_wave.tfits
ATM_REF_CORR atmospheric dispersion correction for data cubes (tables) J_025, J_100
H_025, H_100
K_025, K_100
H+K_025, H+K_100

 


 
[ESO][Index][Search][Help][News]