Up to top level
AO15   AO16   AO17   AO18   AO19   Backgrounds   Calibration   Conference   Data   Docs   EPICMOS   EPICpn   Feedback   Gallery   Misc   OM   Pending   PhD_Theses   Publications   RGS   RadMonitor   SAS_Hardware   SAS_WS   SASv16.0   SASv16.0_Installation   SASv16.1   SASv16.1_Installation   SASv17.0   SASv17.0_Installation   SASv18.0   SASv18.0_Installation   SciSim   Simulators_other   Suggestions   Trash   Visibility   XMM-bouncing   XMM-news   XRPS   XSA   esas   incoming  

Logged in as guest

Viewing EPICMOS/10059
Full headers

From: lewis@astro.psu.edu
Subject: Problem with SAS environment variables
Compose reply
Download message
Move To:
8 replies: 1 2 3 4 5 6 7 8
7 followups: 1 2 3 4 5 6 7

Private message: yes  no

Notes:

Notification:


Date: Thu, 29 Jan 2004 17:56:17 GMT
From: lewis@astro.psu.edu
To: xmmhelp@xmm.vilspa.esa.es
CC: lewis@astro.psu.edu
Subject: Problem with SAS environment variables
Full_Name: Karen Lewis
Submission from: (NULL) (64.8.90.129)


Hello,
   I processed some XMM data last Feb. using SAS v 5.3 and it turns out now that
the two
arfs I generated for mos 1 and mos 2 are not consistent even though they were
made identically.  
The mos 1 is wrong, but when I try to make a new one, I run into problems. When
I did the original
analysis, the data were on a computer call gandalf, now they are on a computer
called admin1. Although I have set up SAS with new environment variabiles to
reflect
this change:

(i.e. SAS_ODF=/bulk/admin1/lewis/xmm/3c111/xmm_cd/odf
       SAS_CCF=/bulk/admin1/lewis/xmm/3c111/xmm_cd/odf/ccf.cif

originally these env. variabiles had "gandalf1" in place of the "admin1")

I  get the following error when making the arf (the full output is at the bottom
of this
email)

arfgen:- regPos= 1
** arfgen: error (datasetCouldNotBeRead), The dataset with name
'/bulk/gandalf1/lewis/xmm/3c111/xmm_cd/odf/0231_0065940101_SCX00000ATS.FIT'
could not be read; either it does not exist or it is in an unrecognised format

It seems that somehow file names have been "hardwired" somewhere in the
processing
of the data. I am wondering (1) if you know why this has happened or (2) if
there
is any way around this other than to start completely from the beginning and 
remake the ccf.cif file and reprocess the data. I'm in the midst of writing a
paper
on these results and I would like to refit the data with the correct arf and
update the results 
as soon as possible.  The computer "gandalf" has died, so it is impossible
for me to reprocess the data on that computer. 

I have been able to re-extract
an events list and spectrum for the source region and set the backscale for the
spectrum and make an RMF (all of which I used in attempting to make a new arf),
so SAS must be able to find some of what it needs. 

Thank you!
   Karen Lewis

----- full output of arfgen ---------

pentadaktylos[51] arfgen arfset='SOURCE_M1_new.ARF'extendedsource=no modelee=yes
eegridfactor=100 withrmfset=yes rmfset='SOURCE_M1.RMF'
spectrumset='SOURCE_M1.PI' setbackscale=yes badpixlocation=MOS1.FILTER.EVT.FITS
arfgen:- Executing (routine): arfgen spectrumset='SOURCE_M1.PI' withrmfset=yes
rmfset='SOURCE_M1.RMF' arfset='SOURCE_M1_new.ARFextendedsource=no'
detmaptype='flat' detmaparray='detmapfile.ds:' withdetbounds=no detxoffset=1200
detxbins=5 detyoffset=1200 detybins=5 psfenergy=5 filterdss=yes
withfilteredset=no filteredset='filteredpixellist.ds' withsourcepos=no
sourcecoords='eqpos' sourcex=0 sourcey=0 extendedsource=no modeleffarea=yes
modelquantumeff=yes modelfiltertrans=yes modelee=yes modelootcorr=yes
eegridfactor=100 withbadpixcorr=yes badpixlocation='MOS1.FILTER.EVT.FITS'
setbackscale=yes keeparfset=yes useodfatt=yes  -V 5
arfgen:- arfgen (arfgen-1.54.7)  [xmmsas_20030110_1802-5.4.1] started: 
2004-01-29T17:20:53.000
arfgen:- Opening spectrumset SOURCE_M1.PI...
arfgen:- Window mode: 2 [PrimePartialW2]
arfgen:- DSS: components in Concrete: 7
arfgen:- Setting BIT mask 1986723840
arfgen:- Setting BIT mask 1986723840
arfgen:- Setting BIT mask 1986723840
arfgen:- Setting BIT mask 1986723840
arfgen:- Setting BIT mask 1986723840
arfgen:- Setting BIT mask 1986723840
arfgen:- Setting BIT mask 1986723840
pentadaktylos[51] arfgen arfset='SOURCE_M1_new.ARF'extendedsource=no modelee=yes
eegridfactor=100 withrmfset=yes rmfset='SOURCE_M1.RMF'
spectrumset='SOURCE_M1.PI' setbackscale=yes badpixlocation=MOS1.FILTER.EVT.FITS
arfgen:- Executing (routine): arfgen spectrumset='SOURCE_M1.PI' withrmfset=yes
rmfset='SOURCE_M1.RMF' arfset='SOURCE_M1_new.ARFextendedsource=no'
detmaptype='flat' detmaparray='detmapfile.ds:' withdetbounds=no detxoffset=1200
detxbins=5 detyoffset=1200 detybins=5 psfenergy=5 filterdss=yes
withfilteredset=no filteredset='filteredpixellist.ds' withsourcepos=no
sourcecoords='eqpos' sourcex=0 sourcey=0 extendedsource=no modeleffarea=yes
modelquantumeff=yes modelfiltertrans=yes modelee=yes modelootcorr=yes
eegridfactor=100 withbadpixcorr=yes badpixlocation='MOS1.FILTER.EVT.FITS'
setbackscale=yes keeparfset=yes useodfatt=yes  -V 5
arfgen:- arfgen (arfgen-1.54.7)  [xmmsas_20030110_1802-5.4.1] started: 
2004-01-29T17:20:53.000
arfgen:- Opening spectrumset SOURCE_M1.PI...
arfgen:- Window mode: 2 [PrimePartialW2]
arfgen:- DSS: components in Concrete: 7
arfgen:- Setting BIT mask 1986723840
arfgen:- Setting BIT mask 1986723840
arfgen:- Setting BIT mask 1986723840
arfgen:- Setting BIT mask 1986723840
arfgen:- Setting BIT mask 1986723840
arfgen:- Setting BIT mask 1986723840
arfgen:- Setting BIT mask 1986723840
arfgen:- Closing spectrumset SOURCE_M1.PI.
arfgen:- Creating a MOSCoreData object
arfgen:- Creating CalMOSCoreData object .. Thin1
arfgen:- CoreData init...
arfgen:-  Null Pileup Corrector being used. Returning 1. 
arfgen:- regPos= 1
** arfgen: error (datasetCouldNotBeRead), The dataset with name
'/bulk/gandalf1/lewis/xmm/3c111/xmm_cd/odf/0231_0065940101_SCX00000ATS.FIT'
could not be read; either it does not exist o

Message of length 5040 truncated

Reply 1

Resend
From: Maria Santos-Lleo <xmmhelp@xmm.vilspa.esa.es>
To: lewis@astro.psu.edu
Subject: Re: Problem with SAS environment variables (PR#10059)
Date: Fri Jan 30 09:21:28 2004
Dear Karen, 

Your problem is caused, as you guessed, by the change of directories
(or computers). However, you do not need to re-run everything 
again !. The problem you get is because SAS is looking into the 
odf summary file where to find the odf file constituents, and this 
odf summary file is pointing to the old computer

What I would do is to define (setenv) again the SAS_CCFPATH, then the 
SAS_ODF as the directory where the files are , then
re-run cifbuild, define SAS_CCF , re-run odfingest and, last, 
set the SAS_ODF environment variable to the new odf summary
file 

I hope this will solve your problem and you can then run arfgen
without further errors. Otherwise, please send us the output 
again and we will try to help you

With best regards

Maria




Followup 1

Compose reply
Download message
Date: Fri, 30 Jan 2004 09:07:01 -0500 (EST)
From: Karen Lewis <lewis@astro.psu.edu>
To: Maria Santos-Lleo <xmmhelp@xmm.vilspa.esa.es>
Subject: Re: Problem with SAS environment variables (PR#10059)
Thanks for getting back to me so quickly!

Karen




* * * * * * * * * * * * * * * * * * * * *
* Karen T. Lewis                        *
* Department of Astronomy               *
* 525 Davey Lab                         *
* University Park, PA 16802             *
* (814) 863-0182                        *
* http://www.astro.psu.edu/users/lewis/ *
* * * * * * * * * * * * * * * * * * * * *

On Fri, 30 Jan 2004, Maria Santos-Lleo wrote:

> Dear Karen,
>
> Your problem is caused, as you guessed, by the change of directories
> (or computers). However, you do not need to re-run everything
> again !. The problem you get is because SAS is looking into the
> odf summary file where to find the odf file constituents, and this
> odf summary file is pointing to the old computer
>
> What I would do is to define (setenv) again the SAS_CCFPATH, then the
> SAS_ODF as the directory where the files are , then
> re-run cifbuild, define SAS_CCF , re-run odfingest and, last,
> set the SAS_ODF environment variable to the new odf summary
> file
>
> I hope this will solve your problem and you can then run arfgen
> without further errors. Otherwise, please send us the output
> again and we will try to help you
>
> With best regards
>
> Maria
>
>
>



Followup 2

Compose reply
Download message
Date: Fri, 30 Jan 2004 09:31:21 -0500 (EST)
From: Karen Lewis <lewis@astro.psu.edu>
To: Maria Santos-Lleo <xmmhelp@xmm.vilspa.esa.es>
Subject: Re: Problem with SAS environment variables (PR#10059)
Hi,
   This didn't work. I ran cifbuild successfully, but I can't run
odfingest. It still is looking for files in /bulk/gandalf1/. . .

pentadaktylos[10] odfingest odfdir=$SAS_ODF outdir=$SAS_ODF
odfingest:- Executing (routine): odfingest
odfdir='/bulk/admin1/lewis/xmm/3c111/xmm_cd/odf' withodfdir=no
outdir='/bulk/admin1/lewis/xmm/3c111/xmm_cd/odf'
summaryfile='0000_0000000000_SCX000SUM.SAS' usecanonicalname=yes
writepath=yes findinstrumentmodes=yes usehousekeeping=yes oalcheck=no  -V
5
odfingest:- odfingest (odfingest-3.9)  [xmmsas_20030110_1802-5.4.1]
started:  2004-01-30T14:19:42.000
odfingest:- Looking for ODF constituents in
/bulk/gandalf1/lewis/xmm/3c111/xmm_cd/odf/
** odfingest: error (NoOdfFound), No valid ODF found in
/bulk/gandalf1/lewis/xmm/3c111/xmm_cd/odf

The environment varaibles were set in the following way when I ran
odfingest.

pentadaktylos[12] env | grep SAS
SAS_DIR=/bulk/pkg/xmm/sas
SAS_PATH=/bulk/pkg/xmm/sas
SAS_IMAGEVIEWER=ds9
SAS_CCFPATH=/bulk/pkg/xmm/ccf
SAS_ODF=/bulk/admin1/lewis/xmm/3c111/xmm_cd/odf
SAS_CCF=/bulk/admin1/lewis/xmm/3c111/xmm_cd/odf/ccf.cif
SAS_VERBOSITY=5



Karen

* * * * * * * * * * * * * * * * * * * * *
* Karen T. Lewis                        *
* Department of Astronomy               *
* 525 Davey Lab                         *
* University Park, PA 16802             *
* (814) 863-0182                        *
* http://www.astro.psu.edu/users/lewis/ *
* * * * * * * * * * * * * * * * * * * * *

On Fri, 30 Jan 2004, Maria Santos-Lleo wrote:

> Dear Karen,
>
> Your problem is caused, as you guessed, by the change of directories
> (or computers). However, you do not need to re-run everything
> again !. The problem you get is because SAS is looking into the
> odf summary file where to find the odf file constituents, and this
> odf summary file is pointing to the old computer
>
> What I would do is to define (setenv) again the SAS_CCFPATH, then the
> SAS_ODF as the directory where the files are , then
> re-run cifbuild, define SAS_CCF , re-run odfingest and, last,
> set the SAS_ODF environment variable to the new odf summary
> file
>
> I hope this will solve your problem and you can then run arfgen
> without further errors. Otherwise, please send us the output
> again and we will try to help you
>
> With best regards
>
> Maria
>
>
>




Reply 2

Resend
From: Maria Santos-Lleo <xmmhelp@xmm.vilspa.esa.es>
To: lewis@astro.psu.edu
Subject: Re: Problem with SAS environment variables (PR#10059)
Date: Fri Jan 30 15:31:38 2004
Dear Karen, 

I think you did nothing wrong, please simply try to remove
the old sas summary file i.e., something like

0rrr__xxxxxxxxxSCX00000SUM.SAS

(with rrr revolution number and xxxxxxxxx obs. id)

(or may be better to copy it to a completely different name,
like old-summary-file)

then run again 

odfingest 

it then will create the summary file from scratch

hope this helps ...

Best wishes

Maria

Maria Santos-Lleo, 
XMM-Newton SOC 
User Support Group


Followup 3

Compose reply
Download message
Date: Fri, 30 Jan 2004 11:57:25 -0500 (EST)
From: Karen Lewis <lewis@astro.psu.edu>
To: Maria Santos-Lleo <xmmhelp@xmm.vilspa.esa.es>
Subject: Re: Problem with SAS environment variables (PR#10059)
  This message is in MIME format.  The first part should be readable text,
  while the remaining parts are likely unreadable without MIME-aware tools.
  Send mail to mime@docserver.cac.washington.edu for more info.

---559023410-684387517-1075481845=:13457
Content-Type: TEXT/PLAIN; charset=US-ASCII

Hello,
  I was able to successfully re-make the ARFs for MOS 1 and 2, but they
still do not agree. I have done some tests with fitting a simple powerlaw
model to the two data sets. (errors are 90%) I want to verify with you
that what I've seen is actually unusual and see if you have any ideas
about how this might have happened. I can send you more details about how
I processed the data.

1) When each MOS data sets is given its own ARF, chi2 = 278 for 250 DOF

nH_mos1 = 0.82 +/- 0.02
Gamma_mos1 = 1.74 +/- 0.02
norm = (1.59 + 0.05 -0.04)x10^-2
2-10 flux = (5.70 +/- 0.09)x10^-11

nH_mos2 = 0.83 + 0.02 - 0.01
Gamma_mos2 = 1.78 + 0.03 -0.02
norm = (1.67 +/- 0.05)x10^-2
2-10 flux = (5.6 + 0.08 - 0.09)x10^-11

At first, I thought the error bars were so small that it would be
impossible for the photon indices to agree better than this, But then I
noticed that efficiencies curves were different, so I started doing some
tests. (I also spoke with other XMM observers in my department and they
said they found MOS 1 and 2 to agree extremely well. So I investigated
further.

2) When I give each data set the MOS 1 ARF, chi2 = 298 for 250 DOF

nH_mos1 = 0.82 +/- 0.02
Gamma_mos1 = 1.74 +/- 0.02
norm = (1.59 + 0.05 - 0.04)x10^-2
flux = (5.70 +0.1 -0.09)x10^-11

nH_mos2 = 0.82 +/- 0.02
Gamma_mos1 = 1.74 + 0.03 - 0.02
norm = (1.59 + 0.05 - 0.04)x10^-2
flux = (5.66 +/-0.09)x10^-11

3) When I give each data set the MOS 2 ARF, chi2 = 258 for 250 DOF

nH_mos1=0.83 + 0.02 -0.01
Gamma_mos1=1.78 + 0.02 -0.03
norm = (1.67 +/- 0.04)x10^-2
flux = (5.65 + 0.08 - 0.09)x10^-11

nH_mos2=0.83 + 0.01 -0.02
Gamma_mos2=1.78 +/- 0.02
norm = (1.67 +/- 0.04)x10^-2
flux = (5.60 + 0.09 -0.08)x10^-11

4) Now for the really strange thing. If I give each data set the
wrong arf (i.e. MOS 1 gets MOS 2 arf and vice verse) chi2 = 278 for 250
DOF

nH_mos1 = 0.83 +0.02 -0.01
Gamma_mos1 = 1.78 +0.02 -0.03
norm = (1.67 +0.05 - 0.04)x10^-2
flux = (5.65 + 0.08 -0.09)x10^-2

nH_mos2 =  0.82 +0.01 -0.02
Gamma_mos2 = 1.74 +0.03 -0.01
norm = (1.59 + 0.05 -0.04)x10^-2
flux = (5.66 +/-0.09)x10^-11

This is very similar to what I got in the first test (each file having the
correct arf) except that the values for MOS 1 and MOS 2 are swapped

Clearly the two data sets are consistent with each other (but not
identical). So there really must be something wrong with the ARF, and
based on the chi2 of the fit, I am guess it is MOS 1.

I wasn't sure of all the information you might need, so I haven't attached
anything besides a plot showing the two arfs and the arfs themselves.

Thank you!
Karen

* * * * * * * * * * * * * * * * * * * * *
* Karen T. Lewis                        *
* Department of Astronomy               *
* 525 Davey Lab                         *
* University Park, PA 16802             *
* (814) 863-0182                        *
* http://www.astro.psu.edu/users/lewis/ *
* * * * * * * * * * * * * * * * * * * * *

On Fri, 30 Jan 2004, Maria Santos-Lleo wrote:

> Dear Karen,
>
> I think you did nothing wrong, please simply try to remove
> the old sas summary file i.e., something like
>
> 0rrr__xxxxxxxxxSCX00000SUM.SAS
>
> (with rrr revolution number and xxxxxxxxx obs. id)
>
> (or may be better to copy it to a completely different name,
> like old-summary-file)
>
> then run again
>
> odfingest
>
> it then will create the summary file from scratch
>
> hope this helps ...
>
> Best wishes
>
> Maria
>
> Maria Santos-Lleo,
> XMM-Newton SOC
> User Support Group
>

---559023410-684387517-1075481845=:13457
Content-Type: APPLICATION/octet-stream; name="mos1-2_arfs.ps.gz"
Content-Transfer-Encoding: BASE64
Content-ID: <Pine.GSO.4.44.0401301157250.13457@pentadaktylos.astro.psu.edu>
Content-Description: Plot of two efficiency curves
Content-Disposition: attachment; filename="mos1-2_arfs.ps.gz"

H4sICLKMGkAAA21vczEtMl9hcmZzLnBzAM19W49kN47m+/kVsQ8Gdh9iWveL
38bV7QEWXrSBbmCfPXaOp3arK41yeWaAxv731UdKohTnkiciszyDdlcGRYmi
KIq6HJH66r99/5frP/70/M9PV/sP6vKn7//yLX4sX3317fOnry8fnv79/a8F
+Ov7zx+evr58/0/ff/fnv16+f/71819+/PT+l8+XXz48fy74d5+efviMApyj
pbx//vjHHz6XglZd/+cPH69GKXfR+msfSo5vnn/7+NP7jz9/8/wfX1/+e8n2
8af/UZL/+Pzjb397+vj52+ePn38dEd/98PHn3374+em7p397+vD1RZekP396
X3JSPV9fCv6nX3/84Zengvi+5JsK/+njT++e/wa6aM43Tz+///j9p+cPzz8v
f/ju8ve/Pf/b0+fny6cP7z/i74+/ffpUcv7y/P7j58uvnz89/9+nC2f5f5d/
fv/xp8tPT/+y/OHd5e/3Ffhjr0iV/91X9i/f/e/L3/3lb799uPz69BlF//39
T5//dcry7tvLH355/uXy4fmHmvTN95e/l5y//PD5Xzdofvf95Q+NCynzp++H
dn14/vWJSj89/8v7Dx/G0v/rm8vff/71h397unz+9MPHXz8UUV/+17f/+O7y
02+/XEo/fHi66InXi2lg6aQigAr8n9LwS2Vyov+nyx9+/vT0a1Grp4G9d0Xs
6mKDuvzw6ccqr7HYtxP+hmnSg9rvl6omRZNIl1gnSsJfnj7/9svyh6rr1EKU
Vf+gornwv9S8JWmXL8arQQC5

Message of length 74476 truncated


Reply 3

Resend
From: Maria Santos-Lleo <xmmhelp@xmm.vilspa.esa.es>
To: lewis@astro.psu.edu
Subject: Re: Problem with SAS environment variables (PR#10059)
Date: Mon Feb  2 12:40:31 2004
Dear Karen, 

I have forwarded your question to the EPIC calibration team. 

I will let you know as soon as I have their analysis results.

Sincerely

Maria

Maria Santos-Lleo, 
XMM-Newton SOC 
User Support Group


Reply 4

Resend
From: Maria Santos-Lleo <xmmhelp@xmm.vilspa.esa.es>
To: lewis@astro.psu.edu
Subject: Re: Problem with SAS environment variables (PR#10059)
Date: Wed Feb  4 15:58:01 2004
Dear Karen, 

The epic calibration team asked me to forward you the 
following:

Can you please let us know whether your source was off axis, 
and if yes, how much ?

This is because it could  be that the effect you are seeing 
is related to the still wrong vignetting correction in 
sas 5.4.1.

with many thanks 

Maria



Followup 4

Compose reply
Download message
Date: Wed, 4 Feb 2004 11:45:19 -0500 (EST)
From: Karen Lewis <lewis@astro.psu.edu>
To: Maria Santos-Lleo <xmmhelp@xmm.vilspa.esa.es>
Subject: Re: Problem with SAS environment variables (PR#10059)
Hello,
  The object must have been pretty close to on-axis because the data were
taken in small-frame mode and the object was pretty well centered in the
small central window that was read out. I don't see anything in the
headers of the events file that looked like it might indicate how far
off-axis the object was.

 Karen


* * * * * * * * * * * * * * * * * * * * *
* Karen T. Lewis                        *
* Department of Astronomy               *
* 525 Davey Lab                         *
* University Park, PA 16802             *
* (814) 863-0182                        *
* http://www.astro.psu.edu/users/lewis/ *
* * * * * * * * * * * * * * * * * * * * *

On Wed, 4 Feb 2004, Maria Santos-Lleo wrote:

> Dear Karen,
>
> The epic calibration team asked me to forward you the
> following:
>
> Can you please let us know whether your source was off axis,
> and if yes, how much ?
>
> This is because it could  be that the effect you are seeing
> is related to the still wrong vignetting correction in
> sas 5.4.1.
>
> with many thanks
>
> Maria
>
>




Reply 5

Resend
From: Maria Santos-Lleo <xmmhelp@xmm.vilspa.esa.es>
To: lewis@astro.psu.edu
Subject: Re: Problem with SAS environment variables (PR#10059)
Date: Wed Feb  4 16:54:20 2004
Dear Karen

Thank you very much for your quick reply, I think you 
are completely right, I will let the epic cal. experts
know and keep you informed on their analysis

best wishes

Maria


Followup 5

Compose reply
Download message
Date: Wed, 4 Feb 2004 15:07:43 -0500 (EST)
From: Karen Lewis <lewis@astro.psu.edu>
To: Maria Santos-Lleo <xmmhelp@xmm.vilspa.esa.es>
Subject: Re: Problem with SAS environment variables (PR#10059)
Hello,
  I finally got some of the x-ray astronomers here at Penn State to give
me several of their arf files for mos 1 and 2. They seem to suffer from
similar discrepancies in the best-fit powerlaw index for mos 1 and 2,
although not to quite the same extreme. (i.e. they agree at the 90% level,
but not necessarily at the 68% level.) This result may help the
calibration team narrow down the problem with my data set.

Karen


* * * * * * * * * * * * * * * * * * * * *
* Karen T. Lewis                        *
* Department of Astronomy               *
* 525 Davey Lab                         *
* University Park, PA 16802             *
* (814) 863-0182                        *
* http://www.astro.psu.edu/users/lewis/ *
* * * * * * * * * * * * * * * * * * * * *




Reply 6

Resend
From: Maria Santos-Lleo <xmmhelp@xmm.vilspa.esa.es>
To: lewis@astro.psu.edu
Subject: Re: Problem with SAS environment variables (PR#10059)
Date: Thu Feb  5 13:19:06 2004
Dear Karen, 

Could you please provide the two spectra you are using , we 
already have the two arf files, sent by you.  

Can you as well let us know which is the EMOS_QUANTUMEF file
you have been using ?. It is one of the CCF constituents in 
the ccf.cif file. 

With many thanks 

Maria



Followup 6

Compose reply
Download message
Date: Thu, 5 Feb 2004 10:51:15 -0500 (EST)
From: Karen Lewis <lewis@astro.psu.edu>
To: Maria Santos-Lleo <xmmhelp@xmm.vilspa.esa.es>
Subject: Re: Problem with SAS environment variables (PR#10059)
  This message is in MIME format.  The first part should be readable text,
  while the remaining parts are likely unreadable without MIME-aware tools.
  Send mail to mime@docserver.cac.washington.edu for more info.

---559023410-959030623-1075996275=:1086
Content-Type: TEXT/PLAIN; charset=US-ASCII

These are the QUANTUMEF files listed in the ccf.cif

/bulk/pkg/xmm/ccf/EMOS1_QUANTUMEF_0015.CCF
/bulk/pkg/xmm/ccf/EMOS2_QUANTUMEF_0015.CCF

I have included a gzipped tar file with the PIs and the RMFs. The files
were binned, so I also sent unbinned spectra.

Karen

On Thu, 5 Feb 2004, Maria Santos-Lleo wrote:

> Dear Karen,
>
> Could you please provide the two spectra you are using , we
> already have the two arf files, sent by you.
>
> Can you as well let us know which is the EMOS_QUANTUMEF file
> you have been using ?. It is one of the CCF constituents in
> the ccf.cif file.
>
> With many thanks
>
> Maria
>
>

---559023410-959030623-1075996275=:1086
Content-Type: APPLICATION/octet-stream; name="3c111.tar.gz"
Content-Transfer-Encoding: BASE64
Content-ID: <Pine.GSO.4.44.0402051051150.1086@pentadaktylos.astro.psu.edu>
Content-Description: Grouped PIs and the RMFs
Content-Disposition: attachment; filename="3c111.tar.gz"

H4sICKJkIkAAAzNjMTExLnRhcgDs3Xl4E9X6B/CylE2gckEvu6PiLQXbJmm2
mTnnlNKmpdiNNFSWQknbQANtUpLUUpbLrqAg+1JEUAoIggjIlYKyyG4BZUeQ
RcAFEVn04sPOnUkDPwptr17hSR5/388fpDTJm/POnMyc7zyBJCd2NkYa0uKV
Icb4aL/HQ6FUKLRqhZ9CoVKrdTrpVqHUadTybZhGpdZId/spdDqVTqVUhoWF
Sb+XbnQaP8VjGk8ZeU6X2SG9ZLYl3+qs5HFmp8thr+R+qRmFWqV03yq12kc9
zMclOTY+Kc7AcZQrh4kL5Xpbsy1cpt3i5DLstt52Rw7nsnPRsaZkTtpwtkyz
I7PMU9rHmpJiu1RQTy/Vs+XlpFscnL03l251Oblc6edMs8vM5VoHWLIffkpC
RJfYZK6Ceooy9dxlzAOkkVbC0MVkSIiqpF93a3Ipp8XF5ZgL5LZdZquNswxw
WWxOq91Wpn6XJGNipEKuF+jI6d3HYuOkG+mpNDAw+f63VmAg58pyWJxZ9uxM
quDyra4si83i6FOQbrU5qc3Ouf/2j8DIxARTbEJnaY8EFuRYbdJDSx+WYx5A
lRrOdt+TwhScM9eS4XLk5Tz4gkmx0utJO6tMvRyz/KDe0nbOlO59nmtdOuBg
ZYhaH6IJ4roPyMlxmp1pKultqVAqFWlKvUIVrAlRhyh7BJbpV/n/qN+oiDiF
e/6V7Y+TnxUsPV7Jm5R6QaURlMoQ6a3Pxdszrb0LOM/GeeA1y4yv0gFwHax9
srjkiOS0eEN8orFrWnxilCGOun9jTHw5ufSnMvW6GYyJ990XmRjXOT4h7eXY
ZIM0+MreE2Xms9Sv8r/3q1QLKq2730iHxeyy+Fi/v7tdLtJoiDAlGu+bz39s
mkgHIHOORT78ZNgzLZwrKsJk4Eq338MzRCFvMfk5GfJGkw4l8oHGUun4OsQm
S8Pr6tnMmVx6RVOr8q1rdnl24N16ZXbk795aFY/PPe2tf36Ad+uVfWf97+Nz
H+wBAB4DeTmZHJuYIB3v28cmmCLaxxnuP/mESqtcm9lRwLnM6dI6+t4assJ6
/3X9rA+W1s3SUdZV+Tr3rkrXzyqpnio405pTOihzdtnRVlhPWV69MCWvlurl
WzNdWfL5sLSGtHCudKzueqry6qnUirLre4c93ynXq3hwkqTIxM4JpkrygtM6
0H26lpeSVqnj0tQgnV3LrxdTWT2lVM9us5TW6OOw5+VKJz1L/zyrQzoR9rMU
5NsdmUFln2KKjjXERSWXX09bpl/pdJqd6e7YYs7Iktsv5ykmU9ckQ+l63JBg
MMakxSWWnX8JdmllkiPtYVf5DT5YLzrRGO+p5/lV2XruXuUcKJ2x7w5S4NTB
8l7mpMVU3AP1OifEmkrr9bOklFMvN6vAac2QdkSezfp/FSsen9yv6r5+O8T+
+X5Vj7hf1SPuN8xdLyEtxpj0UL3/pd/SerF/oF9Vab/SEc4QYzA+OD61u150
WmSHiIRHMT71Ix6fxrP9HtX4NI94fFp3vfgIk1E+9P/58ZXW0/Eaw+8dX4Xz
2dDFlBARb6h4fKYsy70I5MqyOis/PHMmQ5whOTIxSarXJT6+nO2XY3XK56JQ
pxR3srOtLk/1isQmJJuMnePliCvlRvnM9EA9q80pXzGQtl9opsVlyXDZHZVV
jI6NM8k7SKpnyrLaHq7X25rtko7P0lE5z1l5dHOTonOKwZgsrw+UPK8yP1Qv
MSY2icvINktd95aOC+5UKG1K92Uoz266nzyF5Skj1UvyTMCy9aLuNhmZZbbZ
LNmcqSDXcne4rZM6RHDSfXefynFRBpNcMrmc85Heff512V3Sweq+q2x362eU
1n/gzN4hqnNkXESyVC/Q3dlD44su7clzMdEpX010P7Dcq4n36imlekZDclJi
QrLh4fksX6pzWLLN8jpDqld6lUgatcPizLXbyuwmTz2VXC85Ka10TgeWU0+a
yeZyKkljd1gHPFQvzD2+KCm8Pny8t7ukXSqtCKzSRLSm57n38INl7q8nzxd5
/ilDwkIUD22/FIvD6ZkjnunR2r39ciw5di4yIi40xpAQyquCFQqVOehePWWF
9RLTnfZsaZ9ywdIkycjOy5SWLlJhLt2c0S9f2h/ydd+cXGlepluld2NBXGKa
qYO0JyjnvphxH0Nb93yJs+dLE+XetT952mXKO0Xa4fIbMcMl3XffZjTFxccm
qCtZr8VbbdacvBzuFXN2noXLtvQxZ2cXcNIf0utkyvM62n1Uz7Bn5+XY3PUi
upRfT8fzf7werh8AAAAAgC+RP8MhFh2u4+WPkQAAAAAAwF+anDrI80geAAAA
AADwOMmpg+RtmuDtcQAAAAAAwF+ZnDoIPm0FAAAAAACPlZw6yK5du709DgAA
AAAA+CuTUwe5gk9bAQAAAADA4ySnDhqQGuRXxc+/WjOaEr2V7bQfZq+93JRV
aRdEpz5tpC8YefL+rWdJME0V1283iK43F4iqScPEuk83F4oGd9JFfKHxdhcA
AAAAAODb5NRB5f/bqjR59ImdzL6cd5yNbvErvTGvL51QMpByA38iC260I63b
FIprlP5ijoUXg1N2iDVvfCfMWblMR56N8nYXAAAAAADg2+TUQfWdznuSx9CC
+uzgudfYiFq59HL6GjpWOESb1KlN5sT8QrgeXcXlhdPEdPPn4gtxLcQqS78R
ZnT+ThfW+4K3uwAAAAAAAN8mpw4at2u3J3lMWDmVnVjenA2ONtIzz0hJZMwZ
Wl93lExpkEie8jsrzn96uWjsUktsMl0nXLoeIIx7W6v7xwrB210AAAAAAIBv
k1MHNccs8ySPeSZ/9uOsHsx54lu6d6g/7X38ArlzLJaM0s8h/lcOi1NGrxNp
sxlinUYrhK8WfCcMPnhF99Sxm97uAgAAAAAAfJucOqj8TYKlyWNFMGOXzmcx
a09/+ulFG439m4Ic+/ZLMq5zUzL7RGvxn5ZvxeerzxQuBGwV1m7SC13/Hayr
osC3gQAAAAAAQKXk1EFHtyz2JI/1aQvYtY1tmSXkQ7qsyEEVN9uQDaNGkOz9
IikquiFmTNwg1j3VQNj9SXvhXUuSQLp9qj0Zm+LtLgAAAAAAwLfJqYNOuPe/
6m4/ezHcz1aNZdweRou+3UObPXuaFDlWkI7vLSRvNywUBw/fIlzYHCksS+kl
jNmSJTwze7l2nXaJt7sAAAAAAADfJqcOWlg4y5M8dqv2h1d74lnWx3KOvl3y
JvUvOU9G7VtNAtutIlPGa8Tht/YK69vMFV4/EiZ0Parjb9Pt2ukrI73dBQAA
AAAA+DY5ddCie9/n8fn098Or3trFHP1v06KYYeTC0wJJ2H+GVF2ZRcaMpeIb
+Q2EcdFrhI6FJ4SWl97h1wypre1+ZrK3uwAAAAAAAN8mpw66rNGgu//OY/UR
dmfxO2zonRS6ansYufRrPlHpa4mHi78jw8fPE9+0dRH6D4wUGv88kr94uSc/
ruoW7QvXOW93AQAAAAAAvk1OHbT43jcJrtwUz367eJ6NHnSNlnRpTf2bF5PQ
uATxs+U/kEHBM8XJTxYIea8f568dOcxvvryRz1w6VFvz9Q+93QUAAAAAAPg2
OXXQTRNSPclj4ZfL2M81CRv75Sf01M1OtImaEOrXSyxePYq84ldHnJkSJOR

Message of length 9787383 truncated


Reply 7

Resend
From: Maria Santos-Lleo <xmmhelp@xmm.vilspa.esa.es>
To: lewis@astro.psu.edu
Subject: Re: Problem with SAS environment variables (PR#10059)
Date: Wed Mar 31 12:48:17 2004
Dear Karen, 

Please find attached the answer from the EPIC experts

with best regards

Maria 

--------------------------------------------------------------------------------------


  thank you very much for your interesting observation that it is
possible to improve the combined MOS-1 and MOS-2 fit to a source
by interchanging the effective area files (ARFs) for the two instruments.

The reasons why this can be so for some sources is complex.
We have repeated your experiment on several sources from different
observations and in some cases the ARF swap improves the fit and in
other cases it makes it worse.

Firstly, we have checked that there is no simple error in the calibration
files such that the calibration quantities have been accidently switched
between the instruments.

The ARFs of the two instruments, generated by the SAS are very similar;.
For a near on-axis source, the MOS-2 camera registers a few percent more
effective area than MOS-1 at high energies (> 5 keV) and a few percent
less effective area at low-photon-energies.

The instrument calibration is not yet perfect at the 10% level and much effort
goes into understanding and improving the inter-camera fits.
One of the known problems is that parts of the spectrum below 1.5 keV show
signs of an excess MOS-2 flux for high significance sources with strong
low-energy flux. Now, as the MOS-2 ARFs is typically a few percent
less than that of the MOS-1 at these energies, switching the effective area
files can produce an improvement in the combined fit of the two cameras
at these energies. That doesn't mean that the swapped ARFs are a better
representation of the actual cameras but that the effect of the swap is to
counteract the error introduced by our ignorance of the true camera
effective areas.



Followup 7

Compose reply
Download message
Date: Wed, 31 Mar 2004 08:08:21 -0500 (EST)
From: Karen Lewis <lewis@astro.psu.edu>
To: Maria Santos-Lleo <xmmhelp@xmm.vilspa.esa.es>
Subject: Re: Problem with SAS environment variables (PR#10059)
Hi,
  Thank you for this information. It is very helpful!

Karen


* * * * * * * * * * * * * * * * * * * * *
* Karen T. Lewis                        *
* Department of Astronomy               *
* 525 Davey Lab                         *
* University Park, PA 16802             *
* (814) 863-0182                        *
* http://www.astro.psu.edu/users/lewis/ *
* * * * * * * * * * * * * * * * * * * * *

On Wed, 31 Mar 2004, Maria Santos-Lleo wrote:

> Dear Karen,
>
> Please find attached the answer from the EPIC experts
>
> with best regards
>
> Maria
>
> --------------------------------------------------------------------------------------
>
>
>   thank you very much for your interesting observation that it is
> possible to improve the combined MOS-1 and MOS-2 fit to a source
> by interchanging the effective area files (ARFs) for the two instruments.
>
> The reasons why this can be so for some sources is complex.
> We have repeated your experiment on several sources from different
> observations and in some cases the ARF swap improves the fit and in
> other cases it makes it worse.
>
> Firstly, we have checked that there is no simple error in the calibration
> files such that the calibration quantities have been accidently switched
> between the instruments.
>
> The ARFs of the two instruments, generated by the SAS are very similar;.
> For a near on-axis source, the MOS-2 camera registers a few percent more
> effective area than MOS-1 at high energies (> 5 keV) and a few percent
> less effective area at low-photon-energies.
>
> The instrument calibration is not yet perfect at the 10% level and much
effort
> goes into understanding and improving the inter-camera fits.
> One of the known problems is that parts of the spectrum below 1.5 keV show
> signs of an excess MOS-2 flux for high significance sources with strong
> low-energy flux. Now, as the MOS-2 ARFs is typically a few percent
> less than that of the MOS-1 at these energies, switching the effective area
> files can produce an improvement in the combined fit of the two cameras
> at these energies. That doesn't mean that the swapped ARFs are a better
> representation of the actual cameras but that the effect of the swap is to
> counteract the error introduced by our ignorance of the true camera
> effective areas.
>
>
>
>



Reply 8

Resend
From: Maria Santos-Lleo <xmmhelp@xmm.vilspa.esa.es>
To: lewis@astro.psu.edu
Subject: Re: Problem with SAS environment variables (PR#10059)
Date: Wed Mar 31 13:51:31 2004
Dear Karen, 

I am happy to hear that the information is useful.

Thanks for your interest in XMM-Newton data,

Maria

Up to top level
AO15   AO16   AO17   AO18   AO19   Backgrounds   Calibration   Conference   Data   Docs   EPICMOS   EPICpn   Feedback   Gallery   Misc   OM   Pending   PhD_Theses   Publications   RGS   RadMonitor   SAS_Hardware   SAS_WS   SASv16.0   SASv16.0_Installation   SASv16.1   SASv16.1_Installation   SASv17.0   SASv17.0_Installation   SASv18.0   SASv18.0_Installation   SciSim   Simulators_other   Suggestions   Trash   Visibility   XMM-bouncing   XMM-news   XRPS   XSA   esas   incoming  

Logged in as guest


Please make your (short) question the subject of your request!


Web interface using JitterBug ... back to the XMM home page