Up to top level
AO15   AO16   AO17   AO18   Backgrounds   Calibration   Conference   Data   Docs   EPICMOS   EPICpn   Feedback   Gallery   Misc   OM   Pending   PhD_Theses   Publications   RGS   RadMonitor   SAS_Hardware   SAS_WS   SASv16.0   SASv16.0_Installation   SASv16.1   SASv16.1_Installation   SASv17.0   SASv17.0_Installation   SASv18.0   SASv18.0_Installation   SciSim   Simulators_other   Suggestions   Trash   Visibility   XMM-bouncing   XMM-news   XRPS   XSA   esas   incoming  

Logged in as guest

Viewing esas/47599
Full headers

From: aszostek@slac.stanford.edu
Subject: SLCTEXPR keyword
Compose reply
Download message
Move To:
4 replies: 1 2 3 4
1 followups: 1

Private message: yes  no

Notes:

Notification:


Date: Thu, 24 Mar 2011 22:29:45 GMT
From: aszostek@slac.stanford.edu
To: xmmhelp@sciops.esa.int
Cc: aszostek@slac.stanford.edu
Subject: SLCTEXPR keyword
Full_Name: anna szostek
Submission from: (NULL) (198.129.218.82)


Dear Helpdesk Team,
I would like to ask about the spectrum selection expression within the framework
of the ESAS package. 

Does the keyword SLCTEXPR located in the header of the spectrum file (created by
mos-spectra I think) describe the data selection expression used to create the
spectrum? If yes my spectra have unexpected value in this keyword, namely:

SLCTEXPR= '(PATTERN<=12)&&(FLAG == 0)&&((DETX,DETY) IN
circle(254,-218,16800))&'
CONTINUE  '&&!((DETX,DETY) IN
circle(254,-218,14400))&&!BOX(6529,13027,6599,65&'
CONTINUE  '99,0,DETX,DETY)&&!BOX(-13169,-105,6599,6599,0,DETX,DETY)&&region(mo&'
CONTINUE  's1S002-bkg_region-sky.fits)&&(((DETX,DETY) IN
box(-2683.5,-15917,27&'
CONTINUE  '80.5,1340,0))||((DETX,DETY) IN
box(2743.5,-16051,2579.5,1340,0))||(&'
CONTINUE  '(DETX,DETY) IN circle(97,-172,17152)))' / Filtering expression used
b

I understand pattern, flag, the annulus which I select and two CCD which I
exclude (4 and 6) as well as a point source region file to be excluded. But the
last two boxes and circle are not clear to me especially the circle which
basically covers entire field of view whereas the two boxes include some small
regions outside of the field of view. What is the meaning of the last three
components?

When I extract spectrum from the same event file simply using evselect with same
annulus region, point sources exclusion and the two ccds not included, my
spectrum is by a factor of few lower than the spectrum obtained with
mos-spectra. What could be the reason for this?

Best regards
Anna





 


Reply 1

Resend
From: Jan-Uwe Ness <xmmhelp@sciops.esa.int>
To: aszostek@slac.stanford.edu
Subject: Re: SLCTEXPR keyword (PR#47599)
Date: Fri Mar 25 10:55:04 2011
Dear Anna,

 I have forwarded your question to the developers and will get back to you as
soon as I have a reply.

 Best regards,
Jan-Uwe

> Dear Helpdesk Team,
> I would like to ask about the spectrum selection expression within the
framework
> of the ESAS package. 
> 
> Does the keyword SLCTEXPR located in the header of the spectrum file
(created
by
> mos-spectra I think) describe the data selection expression used to create
the
> spectrum? If yes my spectra have unexpected value in this keyword, namely:
> 
> SLCTEXPR= '(PATTERN<=12)&&(FLAG == 0)&&((DETX,DETY) IN
> circle(254,-218,16800))&'
> CONTINUE  '&&!((DETX,DETY) IN
> circle(254,-218,14400))&&!BOX(6529,13027,6599,65&'
> CONTINUE  '99,0,DETX,DETY)&&!BOX(-13169,-105,6599,6599,0,DETX,DETY)&&region(mo&'
> CONTINUE  's1S002-bkg_region-sky.fits)&&(((DETX,DETY) IN
> box(-2683.5,-15917,27&'
> CONTINUE  '80.5,1340,0))||((DETX,DETY) IN
> box(2743.5,-16051,2579.5,1340,0))||(&'
> CONTINUE  '(DETX,DETY) IN circle(97,-172,17152)))' / Filtering expression
used
> b
> 
> I understand pattern, flag, the annulus which I select and two CCD which I
> exclude (4 and 6) as well as a point source region file to be excluded. But
the
> last two boxes and circle are not clear to me especially the circle which
> basically covers entire field of view whereas the two boxes include some
small
> regions outside of the field of view. What is the meaning of the last
three
> components?
> 
> When I extract spectrum from the same event file simply using evselect with
same
> annulus region, point sources exclusion and the two ccds not included, my
> spectrum is by a factor of few lower than the spectrum obtained with
> mos-spectra. What could be the reason for this?
> 
> Best regards
> Anna
> --
   Dr. Jan-Uwe Ness
   XMM-Newton User Support Group
   European Space Astronomy Centre


Reply 2

Resend
From: Jan-Uwe Ness <xmmhelp@sciops.esa.int>
To: aszostek@slac.stanford.edu
Subject: Re: SLCTEXPR keyword (PR#47599)
Date: Mon Mar 28 12:27:13 2011
Dear Anna,

 the three extra regions you see in the header indicate that the spectrum you
are looking at is a field-integrated spectrum. This is produced by esas in
addition to the source spectrum. This also explains why it is so much brighter.


 Best regards,
Jan-Uwe

--
Dr. Jan-Uwe Ness
XMM-Newton SOC


> Dear Helpdesk Team,
> I would like to ask about the spectrum selection expression within the
framework
> of the ESAS package. 
> 
> Does the keyword SLCTEXPR located in the header of the spectrum file
(created
by
> mos-spectra I think) describe the data selection expression used to create
the
> spectrum? If yes my spectra have unexpected value in this keyword, namely:
> 
> SLCTEXPR= '(PATTERN<=12)&&(FLAG == 0)&&((DETX,DETY) IN
> circle(254,-218,16800))&'
> CONTINUE  '&&!((DETX,DETY) IN
> circle(254,-218,14400))&&!BOX(6529,13027,6599,65&'
> CONTINUE  '99,0,DETX,DETY)&&!BOX(-13169,-105,6599,6599,0,DETX,DETY)&&region(mo&'
> CONTINUE  's1S002-bkg_region-sky.fits)&&(((DETX,DETY) IN
> box(-2683.5,-15917,27&'
> CONTINUE  '80.5,1340,0))||((DETX,DETY) IN
> box(2743.5,-16051,2579.5,1340,0))||(&'
> CONTINUE  '(DETX,DETY) IN circle(97,-172,17152)))' / Filtering expression
used
> b
> 
> I understand pattern, flag, the annulus which I select and two CCD which I
> exclude (4 and 6) as well as a point source region file to be excluded. But
the
> last two boxes and circle are not clear to me especially the circle which
> basically covers entire field of view whereas the two boxes include some
small
> regions outside of the field of view. What is the meaning of the last
three
> components?
> 
> When I extract spectrum from the same event file simply using evselect with
same
> annulus region, point sources exclusion and the two ccds not included, my
> spectrum is by a factor of few lower than the spectrum obtained with
> mos-spectra. What could be the reason for this?
> 
> Best regards
> Anna
> 


Followup 1

Compose reply
Download message
From: "Szostek, Anna" <aszostek@slac.stanford.edu>
To: Jan-Uwe Ness <xmmhelp@sciops.esa.int>
Date: Mon, 28 Mar 2011 09:58:29 -0700
Subject: Re: SLCTEXPR keyword (PR#47599)
Dear Jan-Uwe,
Thank you for your reply. The value of the keyword SLCTEXPR comes from the file
mos1S002-obj.pi which according to the manual is the source spectrum of an
annulus of my choice. This is the main spectrum, not an additional file created
with it. Therefore, I am confused and don't understand what is "field integrated
spectrum" in this context and I why is it different than the spectrum created
directly with evselect with the same annuli region file. 
 
Should I use the field integrated spectrum in my spectral modeling? Or should I
use spectrum created by evselect? I would like to make a spectrum of an annulus
to compare it with spectra of other annuli. In addition, I would like to use the
outermost annuli as a background for all inner annuli.  

The two commands I use are (sas 10.0):

Spectrum mos1S002-obj.pi created using mos-spectra, annulus11 contains:
((DETX,DETY) IN circle(254,-218,16800)) &&! ((DETX,DETY) IN
circle(254,-218,14400)) and takes into account point sources removal region
created by cheese.

mos-spectra prefix=1S002 caldb=$SAS_CCFPATH region=annulus11.reg mask=1 elow=350
ehigh=2000 ccd1=1 ccd2=1 ccd3=1 ccd4=0 ccd5=1 ccd6=0 ccd7=1

Spectrum created using evselect:

evselect table=mos1S002-clean.fits withspectrumset=yes
spectrumset=mos1S002-bkg-spectrum.fits energycolumn=PI spectralbinsize=5
withspecranges=yes specchannelmin=0 specchannelmax=11999
imageset=mos1S002-bkg-image.fits withimageset=yes xcolumn=X ycolumn=Y
ximagebinsize=80 yimagebinsize=80 expression='#XMMEA_EM &&
(PATTERN<=12) && ((DETX,DETY) IN circle(254,-218,16800)) &&!
((DETX,DETY) IN circle(254,-218,14400)) &&
region(mos1S002-bkg_region-sky.fits,X,Y) && (CCDNR==1 || CCDNR==2 ||
CCDNR==3 || CCDNR==5 || CCDNR==7)'


The first spectrum has a backscale keyword filled by mos-spectra task. for the
second spectrum I use backscale task to fill it.

Why are these two spectra different?

Best regards
Anna


On Mar 28, 2011, at 5:27 AM, Jan-Uwe Ness wrote:

> Dear Anna,
> 
> the three extra regions you see in the header indicate that the spectrum
you
> are looking at is a field-integrated spectrum. This is produced by esas in
> addition to the source spectrum. This also explains why it is so much
brighter.
> 
> 
> Best regards,
> Jan-Uwe
> 
> --
> Dr. Jan-Uwe Ness
> XMM-Newton SOC
> 
> 
>> Dear Helpdesk Team,
>> I would like to ask about the spectrum selection expression within the
> framework
>> of the ESAS package. 
>> 
>> Does the keyword SLCTEXPR located in the header of the spectrum file
(created
> by
>> mos-spectra I think) describe the data selection expression used to
create
> the
>> spectrum? If yes my spectra have unexpected value in this keyword,
namely:
>> 
>> SLCTEXPR= '(PATTERN<=12)&&(FLAG == 0)&&((DETX,DETY)
IN
>> circle(254,-218,16800))&'
>> CONTINUE  '&&!((DETX,DETY) IN
>> circle(254,-218,14400))&&!BOX(6529,13027,6599,65&'
>> CONTINUE  '99,0,DETX,DETY)&&!BOX(-13169,-105,6599,6599,0,DETX,DETY)&&region(mo&'
>> CONTINUE  's1S002-bkg_region-sky.fits)&&(((DETX,DETY) IN
>> box(-2683.5,-15917,27&'
>> CONTINUE  '80.5,1340,0))||((DETX,DETY) IN
>> box(2743.5,-16051,2579.5,1340,0))||(&'
>> CONTINUE  '(DETX,DETY) IN circle(97,-172,17152)))' / Filtering
expression
> used
>> b
>> 
>> I understand pattern, flag, the annulus which I select and two CCD
which I
>> exclude (4 and 6) as well as a point source region file to be excluded.
But
> the
>> last two boxes and circle are not clear to me especially the circle
which
>> basically covers entire field of view whereas the two boxes include
some
> small
>> regions outside of the field of view. What is the meaning of the last
three
>> components?
>> 
>> When I extract spectrum from the same event file simply using evselect
with
> same
>> annulus region, point sources exclusion and the two ccds not included,
my
>> spectrum is by a factor of few lower than the spectrum obtained with
>> mos-spectra. What could be the reason for this?
>> 
>> Best regards
>> Anna
>> 
> 
> ================================================================================================
> This message and any attachments are intended for the use of the addressee
or addressees only. The unauthorised disclosure, 
> 
> use, dissemination or copying (either in whole or in part) of its content
is not permitted. If you received this message in 
> 
> error, please notify the sender and delete it from your system. Emails can
be altered and their integrity cannot be guaranteed by   
> 
> the sender. 
> 
> Please consider the environment before printing this email.
> =============

Message of length 5093 truncated


Reply 3

Resend
From: Jan-Uwe Ness <xmmhelp@sciops.esa.int>
To: aszostek@slac.stanford.edu
Subject: Re: SLCTEXPR keyword (PR#47599)
Date: Mon Mar 28 18:32:46 2011
Dear Anna,

 could you produce a plot with the two spectra so one can see where and how much
they differ?

 Thanks,
Jan-Uwe

> Dear Jan-Uwe,
> Thank you for your reply. The value of the keyword SLCTEXPR comes from the
file
> mos1S002-obj.pi which according to the manual is the source spectrum of an
> annulus of my choice. This is the main spectrum, not an additional file
created
> with it. Therefore, I am confused and don't understand what is "field
integrated
> spectrum" in this context and I why is it different than the spectrum
created
> directly with evselect with the same annuli region file. 
>  
> Should I use the field integrated spectrum in my spectral modeling? Or
should
I
> use spectrum created by evselect? I would like to make a spectrum of an
annulus
> to compare it with spectra of other annuli. In addition, I would like to
use
the
> outermost annuli as a background for all inner annuli.  
> 
> The two commands I use are (sas 10.0):
> 
> Spectrum mos1S002-obj.pi created using mos-spectra, annulus11 contains:
> ((DETX,DETY) IN circle(254,-218,16800)) &&! ((DETX,DETY) IN
> circle(254,-218,14400)) and takes into account point sources removal
region
> created by cheese.
> 
> mos-spectra prefix=1S002 caldb=$SAS_CCFPATH region=annulus11.reg mask=1
elow=350
> ehigh=2000 ccd1=1 ccd2=1 ccd3=1 ccd4=0 ccd5=1 ccd6=0 ccd7=1
> 
> Spectrum created using evselect:
> 
> evselect table=mos1S002-clean.fits withspectrumset=yes
> spectrumset=mos1S002-bkg-spectrum.fits energycolumn=PI spectralbinsize=5
> withspecranges=yes specchannelmin=0 specchannelmax=11999
> imageset=mos1S002-bkg-image.fits withimageset=yes xcolumn=X ycolumn=Y
> ximagebinsize=80 yimagebinsize=80 expression='#XMMEA_EM &&
(PATTERN<=12) &&
> ((DETX,DETY) IN circle(254,-218,16800)) &&! ((DETX,DETY) IN
> circle(254,-218,14400)) && region(mos1S002-bkg_region-sky.fits,X,Y)
&&
(CCDNR==1
> || CCDNR==2 || CCDNR==3 || CCDNR==5 || CCDNR==7)'
> 
> 
> The first spectrum has a backscale keyword filled by mos-spectra task. for
the
> second spectrum I use backscale task to fill it.
> 
> Why are these two spectra different?
> 
> Best regards
> Anna
> 
> 
> On Mar 28, 2011, at 5:27 AM, Jan-Uwe Ness wrote:
> 
>> Dear Anna,
>> 
>> the three extra regions you see in the header indicate that the
spectrum you
>> are looking at is a field-integrated spectrum. This is produced by esas
in
>> addition to the source spectrum. This also explains why it is so much
> brighter.
>> 
>> 
>> Best regards,
>> Jan-Uwe
>> 
>> --
>> Dr. Jan-Uwe Ness
>> XMM-Newton SOC
>> 
>> 
>>> Dear Helpdesk Team,
>>> I would like to ask about the spectrum selection expression within
the
>> framework
>>> of the ESAS package. 
>>> 
>>> Does the keyword SLCTEXPR located in the header of the spectrum
file
(created
>> by
>>> mos-spectra I think) describe the data selection expression used to
create
>> the
>>> spectrum? If yes my spectra have unexpected value in this keyword,
namely:
>>> 
>>> SLCTEXPR= '(PATTERN<=12)&&(FLAG ==
0)&&((DETX,DETY) IN
>>> circle(254,-218,16800))&'
>>> CONTINUE  '&&!((DETX,DETY) IN
>>> circle(254,-218,14400))&&!BOX(6529,13027,6599,65&'
>>> CONTINUE 
'99,0,DETX,DETY)&&!BOX(-13169,-105,6599,6599,0,DETX,DETY)&&region(mo&'
>>> CONTINUE  's1S002-bkg_region-sky.fits)&&(((DETX,DETY) IN
>>> box(-2683.5,-15917,27&'
>>> CONTINUE  '80.5,1340,0))||((DETX,DETY) IN
>>> box(2743.5,-16051,2579.5,1340,0))||(&'
>>> CONTINUE  '(DETX,DETY) IN circle(97,-172,17152)))' / Filtering
expression
>> used
>>> b
>>> 
>>> I understand pattern, flag, the annulus which I select and two CCD
which I
>>> exclude (4 and 6) as well as a point source region file to be
excluded. But
>> the
>>> last two boxes and circle are not clear to me especially the circle
which
>>> basically covers entire field of view whereas the two boxes include
some
>> small
>>> regions outside of the field of view. What is the meaning of the
last three
>>> components?
>>> 
>>> When I extract spectrum from the same event file simply using
evselect with
>> same
>>> annulus region, point sources exclusion and the two ccds not
included, my
>>> spectrum is by a factor of few lower than the spectrum obtained
with
>>> mos-spectra. What could be the reason for this?
>>

Message of length 5066 truncated


Reply 4

Resend
From: Jan-Uwe Ness <xmmhelp@sciops.esa.int>
To: aszostek@slac.stanford.edu
Subject: Re: SLCTEXPR keyword (PR#47599)
Date: Tue Mar 29 07:34:09 2011
Dear Anna,

 the purpose of the three extra regions that you found in the header is to make
the tool more user friendly. Since they are logically connected to other
expressions with AND, they make no difference because they include the entire
FOV. Thus, in your case, the expression (apart from the pattern stuff) is
     1)  ((DETX,DETY) IN circle(254,-218,16800))
AND  2) !((DETX,DETY) IN circle(254,-218,14400))
AND  3) !BOX(6529,13027,6599,6599,0,DETX,DETY)
AND  4) !BOX(-13169,-105,6599,6599,0,DETX,DETY)
AND  5) region(mos1S002-bkg_region-sky.fits)
AND  6) (  ((DETX,DETY) IN box(-2683.5,-15917,2780.5,1340,0))
        OR ((DETX,DETY) IN box(2743.5,-16051,2579.5,1340,0))
        OR ((DETX,DETY) IN circle(97,-172,17152))
         )
or in other other words, all photons are collected that are inside your region
while at the same time inside the FOV. If an expression is defined, then the
last expression is obsolete, but if nothing is defined, then the entire FOV will
be used rather than having the tool crash or getting problems later with the
generation of rmf or arfs. You can visualize the selection regions by producing
images with evselect, one using the simple expression and one using the full
expression, and
then compare the two. They should look the same.

 Writing down your source expression used in evselect:
     1)  ((DETX,DETY) IN circle(254,-218,16800)) 
AND  2) !((DETX,DETY) IN circle(254,-218,14400))
AND  3) region(mos1S002-bkg_region-sky.fits,X,Y)
AND  4) (CCDNR==1 OR CCDNR==2 OR CCDNR==3 OR CCDNR==5 OR CCDNR==7)
 should produce the same spectrum, unless your region includes photons recorded
by CCD chips #4 or #6. That is the only possibility I can see that could explain
why your spectrum is lower than the one produced by mos-spectra. Perhaps you
could try to leave out the 4th expression and see whether the spectrum is then
brighter?

 Best regards,
Jan-Uwe


> Dear Jan-Uwe,
> Thank you for your reply. The value of the keyword SLCTEXPR comes from the
file
> mos1S002-obj.pi which according to the manual is the source spectrum of an
> annulus of my choice. This is the main spectrum, not an additional file
created
> with it. Therefore, I am confused and don't understand what is "field
integrated
> spectrum" in this context and I why is it different than the spectrum
created
> directly with evselect with the same annuli region file. 
>  
> Should I use the field integrated spectrum in my spectral modeling? Or
should
I
> use spectrum created by evselect? I would like to make a spectrum of an
annulus
> to compare it with spectra of other annuli. In addition, I would like to
use
the
> outermost annuli as a background for all inner annuli.  
> 
> The two commands I use are (sas 10.0):
> 
> Spectrum mos1S002-obj.pi created using mos-spectra, annulus11 contains:
> ((DETX,DETY) IN circle(254,-218,16800)) &&! ((DETX,DETY) IN
> circle(254,-218,14400)) and takes into account point sources removal
region
> created by cheese.
> 
> mos-spectra prefix=1S002 caldb=$SAS_CCFPATH region=annulus11.reg mask=1
elow=350
> ehigh=2000 ccd1=1 ccd2=1 ccd3=1 ccd4=0 ccd5=1 ccd6=0 ccd7=1
> 
> Spectrum created using evselect:
> 
> evselect table=mos1S002-clean.fits withspectrumset=yes
> spectrumset=mos1S002-bkg-spectrum.fits energycolumn=PI spectralbinsize=5
> withspecranges=yes specchannelmin=0 specchannelmax=11999
> imageset=mos1S002-bkg-image.fits withimageset=yes xcolumn=X ycolumn=Y
> ximagebinsize=80 yimagebinsize=80 expression='#XMMEA_EM &&
(PATTERN<=12) &&
> ((DETX,DETY) IN circle(254,-218,16800)) &&! ((DETX,DETY) IN
> circle(254,-218,14400)) && region(mos1S002-bkg_region-sky.fits,X,Y)
&&
(CCDNR==1
> || CCDNR==2 || CCDNR==3 || CCDNR==5 || CCDNR==7)'
> 
> 
> The first spectrum has a backscale keyword filled by mos-spectra task. for
the
> second spectrum I use backscale task to fill it.
> 
> Why are these two spectra different?
> 
> Best regards
> Anna
> 
> 
> On Mar 28, 2011, at 5:27 AM, Jan-Uwe Ness wrote:
> 
>> Dear Anna,
>> 
>> the three extra regions you see in the header indicate that the
spectrum you
>> are looking at is a field-integrated spectrum. This is produced by esas
in
>> addition to the source spectrum. This also explains why it is so much
> brighter.
>> 
>> 
>> Best regards,
>> Jan-Uwe
>> 
>> --
>> Dr. Jan-Uwe Ness
>> XMM-Newton SOC
>> 
>> 
>>> Dear Helpdesk Team,
>>> I would like to ask about the spectrum selection expression within
the
>> framework
>>> of the ESAS package. 
>>> 
>>> Does the keyword SLCTEXPR located in the header of the spectrum
file
(created
>> by
>>> mos-sp

Message of length 6859 truncated

Up to top level
AO15   AO16   AO17   AO18   Backgrounds   Calibration   Conference   Data   Docs   EPICMOS   EPICpn   Feedback   Gallery   Misc   OM   Pending   PhD_Theses   Publications   RGS   RadMonitor   SAS_Hardware   SAS_WS   SASv16.0   SASv16.0_Installation   SASv16.1   SASv16.1_Installation   SASv17.0   SASv17.0_Installation   SASv18.0   SASv18.0_Installation   SciSim   Simulators_other   Suggestions   Trash   Visibility   XMM-bouncing   XMM-news   XRPS   XSA   esas   incoming  

Logged in as guest


Please make your (short) question the subject of your request!


Web interface using JitterBug ... back to the XMM home page