[ ESO ]

FLAMES/GIRAFFE pipeline:
CALIB recipes


CAL | HC | refs | QC
QUALITY CONTROL
    HOME
GIRAFFE QC
Trending & QC1
Pipeline
calib recipes
Data Management
GIRAFFE ...
QC links:
gimasterbias | gimasterdark | gimasterflat | giwavecalibration | gistandard
top BIAS frames: gimasterbias

DPR.CATG = CALIB, DPR.TYPE = BIAS

Raw BIAS frame

Purpose. Bias frames are measured to monitor the status of the CCD. They come in stacks of 5 raw frames. They are routinely measured every night when GIRAFFE is operational, in both read modes ("Normal" and "Fast"). They are processed by the pipeline into a master_BIAS. They are scored and quality-checked by QC Garching.

Recipe. The pipeline recipe gimasterbias processes GIRAFFE BIAS frames. These are combined and median-stacked. The pipeline also delivers a bad pixel map which owever is not archived.

QC checks. The pipeline measures median values, read noise and global structure in the master BIAS and in the first raw frame.

Trending. Click here for results of the BIAS trending.

Products:

product category* (PRO CATG) product index** product code*** delivered? format comments
MASTER_BIAS 0000 MBIA yes 2D as raw frame, with pre and overscan truncated  

* coded as HIERARCH.ESO.PRO.CATG in the fits header
** index of the PIPEFILE name, coded as PIPEFILE in the fits header
*** used in the delivered name

top DARK frames: gimasterdark

DPR.CATG = CALIB, DPR.TYPE = DARK

Purpose. Dark frames are measured to monitor the status of the CCD. They come in stacks of 3 raw frames, each with 3600 sec integration time. They are taken about monthly. They are processed into master_DARK frames and quality-checked by QC Garching.

For data taken with the old CCD (until 2008-03), the master_dark is also a useful for subtracting the amplifier glow in the upper right edge of the CCD, if this becomes an issue for the data reduction. There is no amplifier glow with the new CCD (used after 2008-03).

Recipe. The pipeline recipe gimasterdark processes GIRAFFE DARK frames. These are combined and median-stacked.

QC checks. The pipeline measures median values and dark current in the master DARK frame.

Trending. Click here for results of the DARK trending.

Products:

product category* (PRO CATG) product index** product code*** delivered? format comments
MASTER_DARK 0000 MDRK yes 2D, with pre and overscan truncated useful for background subtraction in science files until 2008-03 (old CCD ). The new CCD does not require master dark subtraction, but these files are still measured for monitoring.

* coded as HIERARCH.ESO.PRO.CATG in the fits header
** index of the PIPEFILE name, coded as PIPEFILE in the fits header
*** used in the delivered name

 

top FLAT frames: gimasterflat

DPR.CATG = CALIB, DPR.TYPE = LAMP,FLAT or LAMP,FLAT,NASMYTH

Raw FLAT frame

Purpose. Flat frames are normally illuminated by the calibration unit on OzPoz, with the lamp moved across the fibres which are arranged in a spiral pattern ('robotic flats'). While this is a good approach for the Medusa and IFU fibres, the Argus fibres are not well illuminated by this procedure. Therefore, there are also Argus flats taken on the illuminated Nasmyth screen ('nasmyth flats').

The flats measure fixed-pattern noise (pixel-to-pixel sensitivity variations), fibre signal localization and width, relative transmission (fibre-to-fibre), fringing (in the red), and the approximate response function. Normally 3 flats are measured and stacked by the pipeline to suppress cosmic ray hits.

Recipe. The pipeline recipe gimasterflat processes GIRAFFE FLAT frames. The input raw frames (typically three) are debiased, combined, median-stacked and normalized to 1 sec. Next all fibres are localized by a profile fit in the course of the extraction procedure and extracted. Finally they are normalized such that the signal from the fibre with the highest transmission is set to one, and all other fibres are normalized relative to that fibre. In the normalization procedure, all SIMCAL fibres are neglected, as well as the SKY fibres for the IFU and Argus slits. The product files have one column per extracted fibre, plus a binary table as extension, the fibre_setup table which is described here. Only localized and extracted fibres get a column in the products, not any "missing" fibres (both non-allocatable and non-allocated ones).

QC checks. The pipeline measures median/mean and rms of the following parameters: relative fibre transmission; fibre signal curvature; signal width, and the flat-field lamp efficiency.

Trending. Click here for the FLAT trending. The lamp efficiency and the average flat level is trended.

Products:

product category* (PRO CATG) product index** product code*** delivered in SM package? format comments
MASTER_FIBER_FLAT 0007 MFLT no 2D (pixel space), pre and overscan truncated stacked and debiased
FF_EXTSPECTRA 0002 PFEX yes 2D, pixels vs fibre index extracted and normalized spectra
FF_EXTERRORS 0000 PFEE yes same as PFEX corresponding extraction errors
FF_LOCCENTROID 0004 PLOC yes same as PFEX centre (X px) of extracted signal per fibre
FF_LOCWIDTH 0006 PLOW yes same as PFEX width (px) of extracted signal per fibre

* coded as HIERARCH.ESO.PRO.CATG in the fits header
** index of the PIPEFILE name, coded as PIPEFILE in the fits header
*** used in the delivered name

The error file (PRO.CATG = FF_EXTERRORS) contains the calculated standard deviation per pixel of the FF_EXTSPECTRA file (containing: photon noise, read noise).

Products of the Nasmyth flats have similar pro.catg values (with FF replaced by NF), and somewhat different product codes which are listed here.

Telluric lines. The red nasmyth flats occasionally show telluric line absorption, due to the lightpath between the calibration lamp, the nasmyth screen and the detector. Note that these features propagate further in the course of the science file reduction and partially cancel out stellar telluric features. See the following plot:

Comparison of the spectrum of an early-type star as acquired with UVES (blue, bottom), and the signal of an IFU1 L887.1 nasmyth flat (black; collapsed across all fibres, thereby removing the residual fringing and enhancing the telluric absorption). In this example the flat has been rebinned to prepare it for collapsing and comparison with a UVES science spectrum (normally flats come in pixel space) but this does not affect the statement about the telluric lines.
The telluric lines in the extreme red part of the nasmyth flats are also visible in 2D view e.g. on the FF_EXTSPECTRA products, this time with the original (unbinned) extracted fibres in pixel space. Here the telluric features show up as U-shaped darker features.

CCD signature. On the extracted fibre signal (FF_EXTSPECTRA) of the new (e2v) CCD you can sometimes identify regular, low-amplitude features aligned with CCD rows. These are due to the manufacturing process, have a vertical period of 512 pixels and sometimes extend across the whole frame, sometimes across the half. They are caused by small gain variations and correctly recorded in the flats. They are much better visible on well-exposed image flats taken for detector monitoring (see below). In the example below, you can also identify vertical patterns at even lower amplitude, due to the same effect.

CCD horizontal gain pattern visible on an extracted fibre flat (FF_EXTSPECTRA).
CCD gain pattern on a well-exposed image flat (taken for detector monitoring).

Relative fibre transmission. An important property of the Giraffe fibres is the stability of their relative transmission, since the SKY signal can only be recorded in dedicated (IFU and Argus) or user-selected (Medusa) fibres. The level of precision of sky subtraction is therefore limited by the accuracy of the relative fibre transmission as recorded by the flats. The following figure demonstrates that the sky signal can be measured with a precision of much better than 1% for most of the fibres.

Stability of relative fibre transmission: transmission values (normalized to a mean value of 1) from 94 days of Medusa1 flats are plotted on top. The residual scatter is plotted below, with the two broken lines marking 1% and 3% rms, respectively. Most fibres have a transmission stable at the 0.3 % level over about 100 days.

Illumination. While Medusa and IFU flats are sufficiently uniform when obtained with the robotic lamp, the Argus fibres are not completely illuminated by the robotic calibration lamp. The differences between a 'robotic' Argus flat and a Nasmyth flat are shown below.

An Argus Nasmyth flat (below) and a robotic flat (top). The extracted spectrum has been collapsed in dispersion direction, to display the fibre-to-fibre efficiency variation and the illumination differences. The spikes are due to SKY fibres (15 in total), and SIMCAL fibres (5 in total). The robotic flat has strong ilumination artefacts (the deep vertical triangles) which would propagate into the science data if used for flat-fielding. The Nasmyth flat has a much more uniform illumination which makes it a much better choice for science flat-fielding.

The next figure compares a Nasmyth flat and a sky flat. The sky flat has been taken in twilight conditions on the sky and avoids all residual illumination artefacts which could degrade the Nasmyth flat.

Comparison of a sky flat (red) and a Nasmyth flat (black). No residual illumination effects are visible. In particular, the spikes of width 2-3 fibres, and the degraded transmission at the end, are a real effect and not caused by the Nasmyth illumination.

This figure demonstrates that Argus data can be reliably flattened with the Nasmyth flats.

This is also evident from the following figure which compares the non-flattened skyflat (below) and the skyflat after flattening with the nasmyth flat (top). The bumps and wiggles have disappeared, and the residual transmission differences are about 2.4% rms.

Comparison of extracted but not flat-fielded sky_flat (below), and the sky_flat flattened with the Nasmyth flat (top).

top WAVE frames: giwavecalibration

DPR.CATG = CALIB, DPR.TYPE = LAMP,WAVE

Raw WAVE frame (right: closeup to display single emission lines from single fibres)

Purpose. WAVE frames are illuminated by the arclamp calibration unit on OzPoz, with the lamp moved across the fibres which are arranged in a spiral pattern.

The arclamp frames are used to derive the global dispersion solution for science (and STD) frames.

Recipe. The pipeline recipe giwavecalibration processes GIRAFFE WAVE frames. The input raw frame is debiased. The corresponding localization (PLOC) and width (PWID) solutions from the gimasterflat recipe are used to localize and extract the fibre signals. The line catalog is searched for matching emission lines which are then identified in the fibre signals. Blended, saturated and too faint lines are rejected, as well as lines with a non-Gaussian PSF. The Giraffe optical model is globally fitted. The residuals between that solution and the positions of the identified emission lines are fitted by a 2D Chebychev polynomial to obtain the complete dispersion solution. Small fibre-to-fibre differences are taken into account by the static slit geometry setup table and the grating table. The extracted arclamp frame is finally wavelength calibrated and rebinned, to deliver a product suitable for quality control checks.

Extracted arclamp frame (left) and rebinned arclamp frame (right); each extracted fibre contributes to the global pattern which should give a straight line for each emission line. The straightness of the emission lines is a sensitive check on the precision of the dispersion solution. These files are therefore delivered to the SM user although they are not required for reduction of SCIENCE frames.

QC checks. The pipeline measures the mean flux level of the raw input frame, the number of saturated pixels, the calibration lamp efficiency, the rms of the dispersion solution, the number of lines found, accepted, and used for the fit.

Trending. Click here for the trending of the wavelength solution, and here for the calibration lamp trending.

Products:

product category* (PRO CATG) product index** product code*** delivered in the SM package? format comments
ARC_EXTSPECTRA 0002 PAES yes 2D, pixels vs fibre index extracted spectra
ARC_EXTERRORS 0000 PAEE no same as PAES corresponding extraction errors
ARC_RBNSPECTRA 0005 PRBS yes 2D, nm vs. fibre index wavelength calibrated and exptracted arclamp spectrum
ARC_RBNERRORS 0004 PRBE no same as PRBS corresponding errors
Main product: DISPERSION_SOLUTION 0006 PDIS yes table dispersion solution coefficients
LINE_DATA 0007 PLIN no table detailed list of line parameters

* coded as HIERARCH.ESO.PRO.CATG in the fits header
** index of the PIPEFILE name, coded as PIPEFILE in the fits header
*** used in the delivered name

The error file (PRO.CATG = ARC_EXTERRORS and ARC_RBNERRORS) contains the calculated standard deviation per pixel of the ARC_EXTSPECTRA file (containing: photon noise, read noise).

top STD frames: gistandard

DPR.CATG = CALIB, DPR.TYPE = STD,OzPoz (or SimCal), DPR.TECH=IFU

Purpose. Flux STD frames are regularly taken only for ARGUS and IFU observations. They can be used for response correction and flux calibration. They are usually followed by three Nasmyth flat exposures. For efficiency monitoring, there is also a dedicated set of Argus settings taken about once a month.

Recipe. The gistandard recipe processes the flux STD data just like the science data, with two important differences: no fibre-to-fibre transmission correction is applied, and (for Argus data only) a response curve and an efficiency curve are calculated as the final step.

The products are delivered in the data packages. Their PRO.CATG keywords are listed below. The user may want to use the response curve and perform a flux calibration of the science data.

QC checks. Checks are done for over and underexposure (some of the STD targets have high proper motions and may have escaped from proper acqusition in the past).

Trending. The results from the standard set of STD data taking about monthly (system efficiency) are available here.

Products.

product category (PRO CATG)* product index** product code*** delivered? format comments
STD_RBNSPECTRA 0005 PSRS yes 2D, wavelength bins vs. fibre index rebinned extracted spectra, one column per fibre
STD_RBNERRORS 0004 PSRE yes same as PSRS corresponding extraction error
STD_RCSPECTRA 0008 PIMG yes 2D, spatial coordinates reconstructed image (IFU and ARGUS)
STD_RCERRORS 0007 PIME yes same as PIMG corresponding error (IFU and Argus)
EFFICIENCY_CURVE   PEFF yes table  
RESPONSE_CURVE   PRSP yes table  

* coded as HIERARCH.ESO.PRO.CATG in the fits header
** index of the PIPEFILE name, coded as PIPEFILE in the fits header
*** used in the delivered name

The error file (PRO.CATG = ARC_RBNERRORS) contains the calculated standard deviation per pixel of the ARC_RBNSPECTRA file (containing: photon noise, read noise). This error is propagated to the error file of the recombined spectro-image, STD_RCERRORS.


 
[ESO][Index][Search][Help][News]