[ ESO ]
GIRAFFE Quality Control:
Detector monitoring

CAL | HC | refs | QC
QUALITY CONTROL
    HOME
GIRAFFE QC
Trending & QC1
   detector monitoring
Pipeline
Data Packages
Data Management
GIRAFFE ...
QC links:
noise parameters | linearity | gain | contamination
 
QC PLOTS
  CURRENT HISTORY
noise parameters
linearity & gain
same, correlations
contamination
QC1 database (advanced users): browse | plot
   Click on CURRENT to see the current trending (Health Check).
   Click on HISTORY to see the historical evolution of the trending.

2008-05-24: new GIRAFFE CCD "Carreras" operational (replacing "Bruce"), find documentation for the old and the new CCD here.
Both CCDs are identical in format and size; unless otherwise specified, the content below applies to both CCDs.


2009-01-12: linearity and gain parameters implemented with detector monitoring data

2010-01-05: noise parameters implemented with detector monitoring data

Image flats (also called detector flats) are measured as technical calibrations every 4 weeks or so, as part of the GIRAFFE calibration plan. While the ordinary, daily fibre flats mainly measure fibre characteristics, the image flats are exposures of the CCD by the flat field lamp without the fibre system. Hence, they are used to monitor detector characteristics like

  • CONAD (1/gain),
  • gain variations (px-to-px scale, 'fixed-pattern' noise),
  • linearity,
  • contamination.

Master image flats are created from a stack of typically 2 input raw frames to

  • remove cosmic ray hits
  • obtain a high-S/N gain map.

Since May 2008, a new template and a new recipe ("detector monitoring") is in use and has a different acquisition and processing strategy. This is applied to the new CCD.

Find other detector parameters documented here:

dark parameters dark
bias parameters bias

top Noise parameters

Two kinds of small-scale fluctuations exist in any raw frame: photon noise, and fixed-pattern (gain) noise (the third noise source, read noise, is negligible here). While the photon noise can only be reduced but not removed totally, the gain noise is constant with time and can be entirely removed from science frames using gain maps derived from image flats.

Both sources of noise are monitored. They are measured in small subwindows of 100x100 pixels size. They are always checked to be random (Gaussian shape of histogram curve).

QC1 parameters

parameter QC1 database: table, name procedure
sph = photon noise giraffe_ccd..sigma_ph - subtract two raw input frames, measure sigma in difference frame, correct by sqrt(2)
- scales with
square root of signal 
sfp = gain fluctuations (fixed-pattern noise) giraffe_ccd..sigma_fp - take derivative of master frame (shifted by 1 px in both X and Y); measure sigma = sDeriv ; have sfp = sqrt(sDeriv2 - sph2)
- scales with signal

Trending

The measured fixed-pattern noise of the old CCD is about 0.5% (Fig. 1 of the historical trending plots from 2008 and earlier). It nicely follows a linear slope (Fig. 2 of the trending plot, and also the figure below). The measured photon noise follows a square-root law as expected.

The new CCD has a stronger fixed-pattern noise, at the level of about 1.6% (see plots for 2009 and beyond).

The noise characteristics are not only relevant for Quality Control, but also interesting for data reduction purpose. Whenever a good S/N is critical, well-exposed gain maps should be used to remove the fixed pattern noise.

The penalty to pay is added photon noise, inherent in the image flats. For a single raw flat file obtained with a typical integration time of 220 sec, the turnover from the photon-noise into the gain noise regime is at exposure level 22,000 ADU for the old CCD, see the figure below. For a masterflat stacked from 2 raw frames, photon noise can be reduced by a factor of sqrt(2), and the turnover value is at 11,000 ADU. For a stack made of 3 frames, the critical exposure level is at 7,000 ADU. This means: if high S/N is an issue, one should take care to use gain maps having sufficiently high exposure levels everywhere. In principle it makes sense to attempt a gain noise correction only if the photon noise in the map is lower than the gain noise in the science data.

For the new CCD, with its higher fixed-pattern noise, the corresponding values are: 3500 ADU (single frame); 1500 ADU (stack of 2); 1200 ADU (stack of 3).

These issues are neglected by the Giraffe pipeline which accepts whatever input master flat is specified. Often this is a reasonable approach since usually master flats are created from 3 input raw frames and well exposed. But some of the GIRAFFE setups have flat fields with rather high dynamics. E.g., a single LR 427.2 flat, being exposed at 110 sec, has parts with just 4,000 ADU and other parts being almost saturated.

Noise properties of the old GIRAFFE CCD, as measured in a series of image flats. Data have been bias subtracted. Flats have been taken in a series of exposure times between 1 and 220 seconds.

Fixed pattern noise follows a linear slope (red dots: measurements, broken line: fit).

Photon noise follows a square root law (blue dots: measurements in a single raw file; black broken line: fit).

The intersection between the linear and the square-root curve marks the regime useful for data reduction: data with higher exposure level are useful for gain noise removal, while data with lower exposure level are photon noise dominated.

The example plot here applies to a single raw file. Usually flats are combined from at least three raw files. Stacking reduces the photon noise by a factor sqrt(3), while the fixed-pattern noise is not affected by stacking. By co-adding, the intersection line between the two noise curves can be shifted towards lower values.

This plot contains data from the old CCD (before 2008-05). The new CCD has a qualitatively similar behaviour but a higher fixed-pattern noise.


top Linearity

QC1 parameters

parameter QC1 database: table, name procedure
qc_lin_eff: effective non-linearity corretcion giraffe_ccd..qc_lin_eff

- calculate mean_signal per raw frame
- fit a third-order polynomial
- determine the residuals

"linearity": mean_signal [ADU] vs. exptime giraffe_ccd..mean_signal
exptime [sec] giraffe_ccd..exptime
"normalized_residuals": the linearity plot with the linear fit subtracted    

Trending

Detector linearity is trended here.

Trending. A sequence of image flats is exposed between 0.5 and 220 secs. A third-order polynomial is fitted to the mean exposure level as a function of exposure time. An effective non-linearity correction is derived from this and plotted in box 1. This coefficient is derived by the common detector monitoring recipe and is available since 2008-07 only.

Linearity 1 : Box 1 shows the non-linearity correction (qc_lin_eff).

Correlations. More detailed trending of linearity is available under "correlations" (here, boxes 1 and 3). The mean exposure level of all image flats is plotted against the exposure time (box 1). In the example below, data are shown for both the old and the new CCD. A fitted function (broken line) is used to derive residuals which are normalized to the mean and plotted vs. exposure time (box 3). The normalized residuals are below one percent. The shifts of the curves are due to a drifting mean flux level of the calibration lamp.

Linearity 2 : Box 1 shows the measured flux levels for the sequence of image flats, and a linear fit. Box 3 shows the residuals after subtracting the fit, normalized to the averages.

top Gain (CONAD)

QC1 parameters

parameter QC1 database: table, name procedure
"CONAD": conversion factor ADU->gain = 1/gain giraffe_ccd..conad - find a pair of image flats having the same exposure level (EXPTIME)
- calculate difference, measure signal in a central 100x100 px window, calculate square root
- measure rms in the window
- divide both numbers
- old CCD: use only pairs above 50 sec EXPTIME
- new CCD: find asymptotical value for exptime -> 0

Trending

The conversion factor electrons to ADU (CONAD) is the inverse gain and is also monitored in the linearity trending plot, box 2. It is measured from the difference between two identical raw frames, by comparing the square root of the signal to its measured rms. The mean gain value is given in the plot. Multiple values exist since usually several pairs are available with EXPTIME > 50 sec (e.g. 60 sec, 120 sec, 220 sec).

Gain 1 : Box 2 shows the gain value as derived from image flat pairs with identical exposure times (and exptime <10 sec for the new CCD).

Correlations. More detailed trending of the gain is available under "correlations" (here, box 4).

Gain 2 : Box 4 (for the new CCD only) shows all gain values plotted over the median of the fluxes. The asymptotic value for texp -> 0 is the true gain (as trended above). The value stored in the file headers is indicated as "nominal". The strong increase towards high median values is due to saturation in the flats.

 

top Contamination

QC1 parameters

parameter QC1 database: table, name procedure
"contamination": mean signal in contamination window, divided by mean signal across whole frame giraffe_ccd..conta1 ... conta4 - define 4 windows in the corners plus one in the centre
- measure mean signal in all five windows, divide by mean signal
- the five windows are displayed in plot 2

Trending

Monitoring contamination. Left: Intensity in 4 subwindows relative to central window. Right: Sketch of subwindows, same color coding as the data points.

A potential issue is contamination which is monitored in box 4. A set of four 400x200 pixels subwindows in the corners of the CCD is used to register the intensity there relative to a central reference subwindow. The fraction is trended over time here.

History

Find a trending plot covering the full history of contamination here.

Typically, contamination builds up very slowly and then more strongly. Once the contamination parameter in one of the windows is below 0.9, an intervention is scheduled (heating of the CCD) to bring the CCD efficicency back to its nominal values.

date event
2004-07 removal of contamination
2005-05 removal of contamination
2005-12 removal of contamination
2006-08 removal of contamination
2007-09-14 cleaning of camera window
2008-03...05 old CCD "Bruce" replaced by "Carreras"
since then no contamination visible, no intervention

Below find a comparison between the image flats from 2003-04-28 (left) and 2004-06-06 (right, just before an intervention). A contamination of about 7% has built up in window 4.

Monitoring contamination: Image flats from 2003-04-28 (left) and 2004-06-06 (right).

 
[ESO][Index][Search][Help][News]