Up to top level
AO15   AO16   AO17   AO18   AO19   Backgrounds   Calibration   Conference   Data   Docs   EPICMOS   EPICpn   Feedback   Gallery   Misc   OM   Pending   PhD_Theses   Publications   RGS   RadMonitor   SAS_Hardware   SAS_WS   SASv16.0   SASv16.0_Installation   SASv16.1   SASv16.1_Installation   SASv17.0   SASv17.0_Installation   SASv18.0   SASv18.0_Installation   SciSim   Simulators_other   Suggestions   Trash   Visibility   XMM-bouncing   XMM-news   XRPS   XSA   esas   incoming  

Logged in as guest

Viewing Backgrounds/84786
Full headers

From: jjung11@alaska.edu
Subject: backscale for instrumental background
Compose reply
Download message
Move To:
2 replies: 1 2
3 followups: 1 2 3

Private message: yes  no

Notes:

Notification:


Date: Tue, 19 Mar 2019 05:26:34 +0100
From: jjung11@alaska.edu
To: xmmhelp@sciops.esa.int
Subject: backscale for instrumental background
Full_Name: Jaewoong Jung
Submission from: (NULL) (193.147.152.102)


Dear XMM helpdesk team,

I was following 
https://www.cosmos.esa.int/web/xmm-newton/sas-thread-background.
to generate FWC spectrum for a observation.
But I've done some modification to the original event file ( I cut out some
fraction of area from the event file using 'region' expression of evselect)
But FWC file generated by evqpb (here I used modified event file, not original
event file) does not look like to take that into account, because it's RATE is
higher than COUNTS/EXPOSURE of my science spectrum.

I tried to generate ARF file of FWC spectrum but ARF files of them shows 0
area.
evqpb document has blank algorithm tab (
https://xmm-tools.cosmos.esa.int/external/sas/current/doc/evqpb/node9.html ) so
I cannot see how it works.
How does evqpb take account of area?

Regards,
Jaewoong


Followup 1

Compose reply
Download message
From: Jaewoong Jung <jjung11@alaska.edu>
Date: Mon, 18 Mar 2019 20:36:02 -0800
Subject: Re: backscale for instrumental background (PR#84786)
To: Simone Migliari <xmmhelp@sciops.esa.int>
--0000000000008e12ce05846b0b40
Content-Type: text/plain; charset="UTF-8"

PS. If evqpb doesn't take account of area, how can I find the effective
area for FWC spectrum file? As I said I tried arfgen but it didn't work
properly.

On Mon, Mar 18, 2019 at 8:27 PM <xmmhelp@sciops.esa.int> wrote:

> European  Space  Agency    -    XMM-Newton  Science  Operations  Centre
> -----------------------------------------------------------------------
>
> Dear colleague,
>
> Thank you for submitting your request. We shall deal with it as quickly
> as possible.
>
> Please  note that both your incoming mail and  the answer to it will be
> visible via  the  XMM-Newton Helpdesk  web interface, unless you marked
> your request as PRIVATE.
>
> You can enquire about its status by following this URL:
>
>
> http://xmm.esac.esa.int/xmmhelp?findid=84786
>
> Please note that  your feedback is extremely  useful  for us to improve
> the service  provided to the  Scientific  Community. When  you consider
> that  your  problem  or  question  has  been answered, please visit the
> following web address and send us your comments:
>
>
>
> https://xmm-tools.cosmos.esa.int/external/xmm_user_support/user_feedback/ufeedback.php?service=helpdesk&name_ref=84786
>
>
> Thank you very much for your attention and time.
>
>
> This message is intended only for the recipient(s) named above. It may
> contain proprietary information and/or
> protected content. Any unauthorised disclosure, use, retention or
> dissemination is prohibited. If you have received
> this e-mail in error, please notify the sender immediately. ESA applies
> appropriate organisational measures to protect
> personal data, in case of data privacy queries, please contact the ESA
> Data Protection Officer (dpo@esa.int).
>
>
>

--0000000000008e12ce05846b0b40
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">PS. If evqpb doesn&#39;t take account of area, how
can I f=
ind the effective area for FWC spectrum file? As I said I tried arfgen but =
it didn&#39;t work properly.</div><br><div
class=3D"gmail_quote"><div dir=
=3D"ltr" class=3D"gmail_attr">On Mon, Mar 18, 2019 at 8:27 PM &lt;<a
href=
=3D"mailto:xmmhelp@sciops.esa.int">xmmhelp@sciops.esa.int</a>&gt;
wrote:<br=
></div><blockquote class=3D"gmail_quote" style=3D"margin:0px 0px 0px
0.8ex;=
border-left:1px solid rgb(204,204,204);padding-left:1ex">European=C2=A0 Spa=
ce=C2=A0 Agency=C2=A0 =C2=A0 -=C2=A0 =C2=A0 XMM-Newton=C2=A0 Science=C2=A0 =
Operations=C2=A0 Centre<br>
----------------------------------------------------------------------- <br=
>
<br>
Dear colleague,<br>
<br>
Thank you for submitting your request. We shall deal with it as
quickly<br>
as possible. <br>
<br>
Please=C2=A0 note that both your incoming mail and=C2=A0 the answer to it w=
ill be <br>
visible via=C2=A0 the=C2=A0 XMM-Newton Helpdesk=C2=A0 web interface, unless=
 you marked <br>
your request as PRIVATE.<br>
<br>
You can enquire about its status by following this URL:<br>
<br>
<br>
<a href=3D"http://xmm.esac.esa.int/xmmhelp?findid=3D84786" rel=3D"noreferre=
r" target=3D"_blank">http://xmm.esac.esa.int/xmmhelp?findid=3D84786</a>=C2=
=A0 <br>
<br>
Please note that=C2=A0 your feedback is extremely=C2=A0 useful=C2=A0 for us=
 to improve<br>
the service=C2=A0 provided to the=C2=A0 Scientific=C2=A0 Community. When=C2=
=A0 you consider <br>
that=C2=A0 your=C2=A0 problem=C2=A0 or=C2=A0 question=C2=A0 has=C2=A0 been =
answered, please visit the <br>
following web address and send us your comments:<br>
<br>
<br>
<a href=3D"https://xmm-tools.cosmos.esa.int/external/xmm_user_support/user_=
feedback/ufeedback.php?service=3Dhelpdesk&amp;name_ref=3D84786" rel=3D"nore=
ferrer" target=3D"_blank">https://xmm-tools.cosmos.esa.int/external/xmm_use=
r_support/user_feedback/ufeedback.php?service=3Dhelpdesk&amp;name_ref=3D847=
86</a>=C2=A0 <br>
<br>
Thank you very much for your attention and time. <br>
<br>
<br>
This message is intended only for the recipient(s) named above. It may cont=
ain proprietary information and/or<br>
protected content. Any unauthorised disclosure, use, retention or dissemina=
tion is prohibited. If you have received<br>
this e-mail in error, please notify the sender immediately. ESA applies app=
ropriate organisational measures to protect<br>
personal data, in case of data privacy queries, please contact the ESA Data=
 Protection Officer (<a href=3D"mailto:dpo@esa.int"
target=3D"_blank">dpo@e=
sa.int</a>).<br>
<br>
<br>
</blockquote></div>

--000000

Message of length 5026 truncated


Reply 1

Resend
From: Ignacio de la Calle <xmmhelp@sciops.esa.int>
To: jjung11@alaska.edu
Subject: Re: backscale for instrumental background (PR#84786)
Date: Tue Mar 19 10:18:05 2019
Dear Jaewoong Jung,

evqpb does not take into account any area. It only selects a suitable FWC
event file for your observation. You then need to manipulate this file in 
a similar way as the science observation.

Why does arfgen not work ? we would need to see a log of that as well as the 
spectral file.

Regards,

Ignacio de la Calle
XMM-Newton SOC

> Submission from: (NULL) (193.147.152.102)
> 
> 
> Dear XMM helpdesk team,
> 
> I was following 
> https://www.cosmos.esa.int/web/xmm-newton/sas-thread-background.
> to generate FWC spectrum for a observation.
> But I've done some modification to the original event file ( I cut out
some
> fraction of area from the event file using 'region' expression of
evselect)
> But FWC file generated by evqpb (here I used modified event file, not
original
> event file) does not look like to take that into account, because it's RATE
is
> higher than COUNTS/EXPOSURE of my science spectrum.
> 
> I tried to generate ARF file of FWC spectrum but ARF files of them shows 0
> area.
> evqpb document has blank algorithm tab (
> https://xmm-tools.cosmos.esa.int/external/sas/current/doc/evqpb/node9.html
)
so
> I cannot see how it works.
> How does evqpb take account of area?
> 
> Regards,
> Jaewoong
> 
> 


Followup 2

Compose reply
Download message
From: Jaewoong Jung <jjung11@alaska.edu>
Date: Wed, 20 Mar 2019 15:20:51 -0800
Subject: Re: backscale for instrumental background (PR#84786)
To: Ignacio de la Calle <xmmhelp@sciops.esa.int>
--00000000000019849e05848ee062
Content-Type: multipart/alternative; boundary="00000000000019849305848ee060"

--00000000000019849305848ee060
Content-Type: text/plain; charset="UTF-8"

Here is a log how I generated these files and area value of arf file. I
found that area is not exactly zero, but for most of energy band it's zero.

*HYUNJU-MACPRO:test2 jjung11$ evqpb
table=1744_0554370101_EMOS1_S001_ImagingEvts.ds exposurefactor=2.0
attfile=1744_0554370101_AttHk.ds outset=evqpb_m1test.fits*

evqpb:- Executing (routine): evqpb
table=1744_0554370101_EMOS1_S001_ImagingEvts.ds exposurefactor=2
attfile=1744_0554370101_AttHk.ds outset=evqpb_m1test.fits calctlmax=no
overwritesubmode=no  -w 1 -V 4

evqpb:- evqpb (evqpb-0.5)  [xmmsas_20180620_1732-17.0.0] started:
2019-03-20T23:02:00.000

evqpb:- Exposure submode: PrimeFullWindow

evqpb:- Input Revolution 1744 startTime 2009-06-18T13:48:09.000stopTime
2009-06-18T20:05:10.000

evqpb:- Retrieving LIVETI01 Exposure time... 44520.4

evqpb:- Retrieving LIVETI02 Exposure time... 44575.9

evqpb:- Retrieving LIVETI03 Exposure time... 44591.2

evqpb:- Retrieving LIVETI04 Exposure time... 44514.2

evqpb:- Retrieving LIVETI05 Exposure time... 44527.5

evqpb:- LIVETI06 Not found

evqpb:- Retrieving LIVETI07 Exposure time... 44482.6

evqpb:- REV found  1796 index 406 lastElement 413

evqpb:- Rev. Number: 1796 ccd 1 current accum exposure 29742.4

evqpb:- Rev. Number: 1796 ccd 2 current accum exposure 29771.1

evqpb:- Rev. Number: 1796 ccd 3 current accum exposure 29802.5

evqpb:- Rev. Number: 1796 ccd 4 current accum exposure 29752.3

evqpb:- Rev. Number: 1796 ccd 5 current accum exposure 29751.7

evqpb:- Rev. Number: 1796 ccd 7 current accum exposure 29726.4

evqpb:- REV found  1844 index 413 lastElement 420

evqpb:- Rev. Number: 1844 ccd 1 current accum exposure 41072.6

evqpb:- Rev. Number: 1844 ccd 2 current accum exposure 41112.5

evqpb:- Rev. Number: 1844 ccd 3 current accum exposure 41151

evqpb:- Rev. Number: 1844 ccd 4 current accum exposure 41068.8

evqpb:- Rev. Number: 1844 ccd 5 current accum exposure 41082.4

evqpb:- Rev. Number: 1844 ccd 7 current accum exposure 41041.5

evqpb:- REV found  1607 index 399 lastElement 406

evqpb:- Rev. Number: 1607 ccd 1 current accum exposure 61852.1

evqpb:- Rev. Number: 1607 ccd 2 current accum exposure 61913.5

evqpb:- Rev. Number: 1607 ccd 3 current accum exposure 61958.9

evqpb:- Rev. Number: 1607 ccd 4 current accum exposure 61844.1

evqpb:- Rev. Number: 1607 ccd 5 current accum exposure 61862.6

evqpb:- Rev. Number: 1607 ccd 7 current accum exposure 61803.5

evqpb:- CCD 1 EXPOSURE 22260.2 TARGET 44520.4 TOTAL EXP 61852.1 Weight
Factor 0.359894

evqpb:- CCD 2 EXPOSURE 22287.9 TARGET 44575.9 TOTAL EXP 61913.5 Weight
Factor 0.359985

evqpb:- CCD 3 EXPOSURE 22295.6 TARGET 44591.2 TOTAL EXP 61958.9 Weight
Factor 0.359845

evqpb:- CCD 4 EXPOSURE 22257.1 TARGET 44514.2 TOTAL EXP 61844.1 Weight
Factor 0.35989

evqpb:- CCD 5 EXPOSURE 22263.7 TARGET 44527.5 TOTAL EXP 61862.6 Weight
Factor 0.35989

evqpb:- CCD 7 EXPOSURE 22241.3 TARGET 44482.6 TOTAL EXP 61803.5 Weight
Factor 0.359871

evqpb:- Deleting 106676 rows

evqpb:- New table size 237776

evqpb:- Creating timestamp for ccd 1

evqpb:- Creating timestamp for ccd 2

evqpb:- Creating timestamp for ccd 3

evqpb:- Creating timestamp for ccd 4

evqpb:- Creating timestamp for ccd 5

evqpb:- EXPOSU06 extension not found

evqpb:- Creating timestamp for ccd 7

evqpb:- Sorting time column...  Done.

evqpb:- running attcalc

evqpb:- Running attcalc to fix X,Y coordinates

evqpb:- Executing (routine): attcalc eventset=evqpb_m1test.fits fixedra=0
fixeddec=0 fixedposangle=0 attitudelabel=ahf nominalra=0 nominaldec=0
setpnttouser=no refpointlabel=pnt atthkset=1744_0554370101_AttHk.ds
withatthkset=yes withmedianpnt=yes calctlmax=no imagesize=0.36  -w 1 -V 4

evqpb:- attcalc (attcalc-4.39)  [xmmsas_20180620_1732-17.0.0] started:
2019-03-20T23:02:09.000

evqpb:- attcalc (attcalc-4.39)  [xmmsas_20180620_1732-17.0.0] ended:
2019-03-20T23:02:11.000

evqpb:- evqpb (evqpb-0.5)  [xmmsas_20180620_1732-17.0.0] ended:
2019-03-20T23:02:11.000

*HYUNJU-MACPRO:test2 jjung11$ evselect table=evqpb_m1test.fits
withfilteredset=Y filteredset=m1_qpb_cleantest.fits destruct=Y
keepfilteroutput=T expression='gti(MOS1gti.fits,TIME)'*

*evselect:- Executing (routine): evselect table=evqpb_m1test.fits
filteredset=m1_qpb_cleantest.fits *withfilteredset=yes keepfilteroutput=yes
flagcolumn=EVFLAG flagbit=-1 destruct=yes dssblock=''
expression=gti(MOS1gti.fits,TIME) filtertype=expression cleandss=no
updateexposure=yes filterexposure=yes writedss=yes blockstocopy=''
attributestocopy='' energycolumn=PHA zcolumn=WEIGHT zerrorcolumn=EWEIGHT
withzerrorcolumn=no withzcolumn=no ignorelegallimits=no imageset=image.fits
xcolumn=RAWX ycolumn=RAWY ximagebinsize=1 yimagebinsize=1 squarepixels=no
ximagesize=600 yimagesize=600 imagebinning=imageSize ximagemin=1
ximagemax=640 withxranges=no yimagemin=1 yimagemax=640 withyranges=no
imagedatatype

Message of length 11390992 truncated


Reply 2

Resend
From: Ignacio de la Calle <xmmhelp@sciops.esa.int>
To: jjung11@alaska.edu
Subject: Re: backscale for instrumental background (PR#84786)
Date: Thu Mar 21 13:36:13 2019
Dear Jaewoong Jung,



In order to extract  spectral files from the FWC data, you only need to generate
source and background spectra.

The arf and rmf come from the science observation. The effective are is not just
geometrical, several other things are taken into account, such as QE, filter
transmission, .... 

Since FWC is taken with the filter in the CLOSED position, it does not have a
filter transmission, hence you cannot run arfgen over the FWC spectra as the
result would be 0. 

If you have run the SAS task region over the science file to create regions to
remove and be filtered out later, do the same on the FWC event file. As the
thread says, perform the same operations on the science event file and on the
FWC event file. 


Regards,

Ignacio de la Calle
XMM-Newton SOC



Followup 3

Compose reply
Download message
From: Jaewoong Jung <jjung11@alaska.edu>
Date: Thu, 21 Mar 2019 14:22:38 -0800
Subject: Re: backscale for instrumental background (PR#84786)
To: Ignacio de la Calle <xmmhelp@sciops.esa.int>
--000000000000a718150584a22daa
Content-Type: text/plain; charset="UTF-8"

Dear Ignacio,

Thank you for the clarification. I think I haven't read the thread
carefully.

Best,
Jaewoong


On Thu, Mar 21, 2019 at 4:36 AM Ignacio de la Calle
<xmmhelp@sciops.esa.int>
wrote:

>
> Dear Jaewoong Jung,
>
>
>
> In order to extract  spectral files from the FWC data, you only need to
> generate
> source and background spectra.
>
> The arf and rmf come from the science observation. The effective are is
> not just
> geometrical, several other things are taken into account, such as QE,
> filter
> transmission, ....
>
> Since FWC is taken with the filter in the CLOSED position, it does not
> have a
> filter transmission, hence you cannot run arfgen over the FWC spectra as
> the
> result would be 0.
>
> If you have run the SAS task region over the science file to create
> regions to
> remove and be filtered out later, do the same on the FWC event file. As the
> thread says, perform the same operations on the science event file and on
> the
> FWC event file.
>
>
> Regards,
>
> Ignacio de la Calle
> XMM-Newton SOC
>
>
> This message is intended only for the recipient(s) named above. It may
> contain proprietary information and/or
> protected content. Any unauthorised disclosure, use, retention or
> dissemination is prohibited. If you have received
> this e-mail in error, please notify the sender immediately. ESA applies
> appropriate organisational measures to protect
> personal data, in case of data privacy queries, please contact the ESA
> Data Protection Officer (dpo@esa.int).
>
>
>

--000000000000a718150584a22daa
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr"><div>Dear
Ignacio,</div><div><br></div>Thank you for the c=
larification. I think I haven&#39;t read the thread
carefully.<div><br></di=
v><div>Best,<br>Jaewoong<br><div><br></div></div></div><br><div
class=3D"gm=
ail_quote"><div dir=3D"ltr" class=3D"gmail_attr">On Thu, Mar 21, 2019
at 4:=
36 AM Ignacio de la Calle &lt;<a
href=3D"mailto:xmmhelp@sciops.esa.int">xmm=
help@sciops.esa.int</a>&gt; wrote:<br></div><blockquote
class=3D"gmail_quot=
e" style=3D"margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204)=
;padding-left:1ex"><br>
Dear Jaewoong Jung,<br>
<br>
<br>
<br>
In order to extract=C2=A0 spectral files from the FWC data, you only need t=
o generate<br>
source and background spectra.<br>
<br>
The arf and rmf come from the science observation. The effective are is not=
 just<br>
geometrical, several other things are taken into account, such as QE, filte=
r<br>
transmission, .... <br>
<br>
Since FWC is taken with the filter in the CLOSED position, it does not have=
 a<br>
filter transmission, hence you cannot run arfgen over the FWC spectra as th=
e<br>
result would be 0. <br>
<br>
If you have run the SAS task region over the science file to create regions=
 to<br>
remove and be filtered out later, do the same on the FWC event file. As the=
<br>
thread says, perform the same operations on the science event file and on t=
he<br>
FWC event file. <br>
<br>
<br>
Regards,<br>
<br>
Ignacio de la Calle<br>
XMM-Newton SOC<br>
<br>
<br>
This message is intended only for the recipient(s) named above. It may cont=
ain proprietary information and/or<br>
protected content. Any unauthorised disclosure, use, retention or dissemina=
tion is prohibited. If you have received<br>
this e-mail in error, please notify the sender immediately. ESA applies app=
ropriate organisational measures to protect<br>
personal data, in case of data privacy queries, please contact the ESA Data=
 Protection Officer (<a href=3D"mailto:dpo@esa.int"
target=3D"_blank">dpo@e=
sa.int</a>).<br>
<br>
<br>
</blockquote></div>

--000000000000a718150584a22daa--


Up to top level
AO15   AO16   AO17   AO18   AO19   Backgrounds   Calibration   Conference   Data   Docs   EPICMOS   EPICpn   Feedback   Gallery   Misc   OM   Pending   PhD_Theses   Publications   RGS   RadMonitor   SAS_Hardware   SAS_WS   SASv16.0   SASv16.0_Installation   SASv16.1   SASv16.1_Installation   SASv17.0   SASv17.0_Installation   SASv18.0   SASv18.0_Installation   SciSim   Simulators_other   Suggestions   Trash   Visibility   XMM-bouncing   XMM-news   XRPS   XSA   esas   incoming  

Logged in as guest


Please make your (short) question the subject of your request!


Web interface using JitterBug ... back to the XMM home page