This documentation is intended both for QC scientists and SciOps astronomers (who may want to ignore the technical information displayed in grey).





bottom
plots

contact


NAME 
QCsinfo_line.py


VERSION 
1.0  20060621 fill template by handbook
1.1  20060707 certified
2.0  20090101 completely rewritten (from scratch) in Python
3.0  20100413 overhauled with added QC functions and images (for e.g. images of linearity coefficients cube, gain vs. ADU, and linearity fit)


SYNTAX 
Python


CALL 
measureQuality from $DFS_PRODUCT/LINE/$DATE:
QCsinfo_line.py a $AB i 1


INSTRUMENT 
SINFONI


RAWTYPE 
LINE


PURPOSE 
a) generates QC report
b) writes QC1 parameters into local database


PROCINPUT 
No input is required:
a) $DATE is now read from AB
b) primary file is set in QCsinfo_line.py and is the PRO.CATG=BP_COEFF product with the _0000.fits extension.
c) The remaining required raw frames are implicitly read from the AB.
d) They include products such as BP_COEFF, BP_MAP_NL, LIN_DET_INFO, and GAIN_INFO used and implicitly read.
e) Reference BP_COEFF and BP_MAP_NL are read from $DFO_QC_DIR/references/LINE/.


QC1TABLE 
trending  table(s) in QC1 database:
sinfoni_line


TRENDPLOT 
trending  HealthCheck plot(s) associated to this procedure:
trend_report_LINE_gain_HC.html


QC1PAGE 
trending  associated documentation:
line_QC1.html


QC1PLOTS
top 
line1.png
BP_COEFF is a 2048x2048x3 pixel cube in which each of the three planes is a nonlinear polymomial coefficient per pixel.
display plane 0 of BP_COEFF (the 3 linearity coefficients) in ds9. The LIN0 coefficient is essentially a DARK.
line2.png
display plane 1 of BP_COEFF (the 3 linearity coefficients) in ds9. The LIN1 coefficient is essentially a FLAT.
line3.png
display plane 2 of BP_COEFF (the 3 linearity coefficients) in ds9. The LIN2 coefficient maps the nonlinear pixels.
line4.png
QC Report 1:
UL : the current linearity coefficient C0 (BP_COEFF plane 1).
UC : the current linearity coefficient C1 (BP_COEFF plane 2).
UR : the current linearity coefficient C2 (BP_COEFF plane 3).
LL : the difference between the reference and the current coefficient C0 images. The statistics of the difference image
(minimum, maximum, median, and standard deviation) are listed to the right of the image.
LC : the difference between the reference and the current coefficient C1 images. The statistics of the difference image
are listed to the right of the image.
LR : the difference between the reference and the current coefficient C2 images. The statistics of the difference image
are listed to the right of the image.
line5.png
QC Report 2:
left : a map of the nonlinear pixels. Normal pixels are set to 1, while 0 denotes nonlinear pixels.
right : the difference between the reference and current nonlinear pixel maps.
line6.png
QC Report 3:
UL: the gain (e/ADU) as a function of linearity lamp flux level (ADU). The nominal gain (SINFONI User's manual pg. 44)
is shown as a green line. The median gain and its standard deviation is shown as a dotted blue line and a shaded blue area, respectively.
UR: the median flux per DIT (ADU/sec) is shown as a function of linearity lamp flux level (ADU). Each point is labelled with
its DIT value. The median flux/DIT is shown as a dotted blue line. A linear fit to this relation is shown as a green dotted line.
LL: the lampon flux vs. the linearity fit. The fit using median value terms (LIN0.MED, LIN1.MED, and LIN2.MED) is shown in
blue. The fit using mean value terms (LIN0.MEAN, LIN1.MEAN, and LIN2.MEAN) is shown in red. A linear fit using the median values is
plotted using a dotted green line.
LR: fit residuals as a function of DIT (seconds). The full linearity fit (with the median coefficients) is subtracted
from the median lampon flux.


QC1PARAM 
QC1 parameters written into QC1 table (sinfoni_line):
SOURCE(header or script) DBNAME value description
QC.BPMAP.LIN0.MEAN qc_bpm_lin0_mean 4.8345 average linearity coefficient C0
QC.BPMAP.LIN1.MEAN qc_bpm_lin0_mean 1.0003456 average linearity coefficient C1
QC.BPMAP.LIN2.MEAN qc_bpm_lin0_mean 1.5395e8 average linearity coefficient C2
QC.BPMAP.LIN3.MEAN qc_bpm_lin0_mean 0.0 average linearity coefficient C3 (not computed by the pipeline)
QC.BPMAP.LIN4.MEAN qc_bpm_lin0_mean 0.0 average linearity coefficient C4 (not computed by the pipeline)
QC.BPMAP.NBADPIX qc_bpm_nbadpix 4599 number of nonlinear pixels
QC.BPMAP.LIN0.MED qc_bpm_lin0_mean 5.385 median linearity coefficient C0
QC.BPMAP.LIN1.MED qc_bpm_lin0_mean 1.0002967 median linearity coefficient C1
QC.BPMAP.LIN2.MED qc_bpm_lin0_mean 4.675e7 median linearity coefficient C2
QC.BPMAP.LIN3.MED qc_bpm_lin0_mean 0.0 median linearity coefficient C3 (not computed by the pipeline)
QC.BPMAP.LIN4.MED qc_bpm_lin0_mean 0.0 median linearity coefficient C4 (not computed by the pipeline)
QC.GAIN qc_gain 2.92 detector gain (e/ADU)
QC.GAINERR qc_gain_err 0.23 standard deviation of detector gain (e/ADU)
QCsinfo_line.py qc_med_flux_dit 486.30 median flux per DIT (ADU/sec) (QC script)
QCsinfo_line.py qc_med_flux_dit_err 2.92 standard deviation of median flux per DIT (ADU/sec) (QC script)


ALGORITHM 
Description of algorithms:
qc_bpm_lin0_mean: Each DIT in a linearity series is made up of four frames (two lampon and two lampoff frames).
The median of each image is computed and the lampon and lampoff frames are subtracted:
med_dit(i) = [median(F(i)_on)  median(F(i)_off)]/DIT
The mean of all N med_diti is computed as:
med_dit = Sum[med_dit(i)/N]
Finally, a parabolic fit of the product of (DIT(i) * mean), as a function of med_dit(i)i, is made with the coefficients C0, C1, and C2.
qc_bpm_lin1_mean: as above
qc_bpm_lin2_mean: as above
qc_bpm_lin3_mean: as above
qc_bpm_lin4_mean: as above
qc_bpm_nbadpix: For each pixel a median flux level as a function of DIT is known and is compared to a linear fit. Those pixels
that diverge from the linear fit by a given threshold are flagged as nonlinear. The nonlinear bad pixel map (BAD_MAP_NL) is combined
with the hot and cold pixel maps to create a master bad pixel map (MASTER_BP_MAP).
qc_bpm_lin0_med: as for the qc_bpm_lin0_mean above, but with a median of the coefficients.
qc_bpm_lin1_med: as for the qc_bpm_lin1_mean above, but with a median of the coefficients.
qc_bpm_lin2_med: as for the qc_bpm_lin2_mean above, but with a median of the coefficients.
qc_bpm_lin3_med: as for the qc_bpm_lin3_mean above, but with a median of the coefficients.
qc_bpm_lin4_med: as for the qc_bpm_lin4_mean above, but with a median of the coefficients.
qc_gain: Pairs of consecutive lampon flats (F1_on and F2_on) and lampoff flats (F1_off and F2_off) are selected from the input data
frames and their differences are computed: diff_on = F1_on  F2_on and diff_off = F1_off  F2_off. The mean of each frame (F1_on, F1_off, . . . )
and the standard deviation of the differences sigma(diff_on) and sigma(diff_off) are computed. The gain is then given by:
gain = [(F1_on and F2_on)  (F1_off and F2_off)]/[sigma(diff_on)^2  sigma(diff_off)^2].


CERTIF 
Reasons for rejection:
The overall lamp intensity of the flat used to make the linearities has sometimes been set too high (> 40, 000 counts),
with the result that an excessive number of pixels enter the nonlinear range.
If the fit deduced for the nonlinearity is a very poor match to the data.


COMMENTS 

top 
[20151030T08:20:47] created by qcDocu v1.1.2, a tqs tool
