Up to top level
AO15   AO16   AO17   AO18   AO19   Backgrounds   Calibration   Conference   Data   Docs   EPICMOS   EPICpn   Feedback   Gallery   Misc   OM   Pending   PhD_Theses   Publications   RGS   RadMonitor   SAS_Hardware   SAS_WS   SASv16.0   SASv16.0_Installation   SASv16.1   SASv16.1_Installation   SASv17.0   SASv17.0_Installation   SASv18.0   SASv18.0_Installation   SciSim   Simulators_other   Suggestions   Trash   Visibility   XMM-bouncing   XMM-news   XRPS   XSA   esas   incoming  

Logged in as guest

Viewing SASv17.0/84007
Full headers

From: jjung11@alaska.edu
Subject: Soft proton filtering
Compose reply
Download message
Move To:
2 replies: 1 2
1 followups: 1

Private message: yes  no

Notes:

Notification:


Date: Mon, 24 Sep 2018 22:01:28 GMT
From: jjung11@alaska.edu
To: xmmhelp@sciops.esa.int
CC: jjung11@alaska.edu
Subject: Soft proton filtering
Full_Name: Jaewoong Jung
Submission from: (NULL) (193.147.152.102)


Dear XMM helpdesk team,

I'm trying to filter the event list for soft protons. This is my first time
processing XMM data, so I'm not sure about many points.
I installed SAS and downloaded specific ODF file from XMSA, and extracted event
list using emproc.
I'm trying to follow this,
https://www.cosmos.esa.int/web/xmm-newton/sas-thread-epic-filterbackground
but it says this:
1. Extract a single event (i.e. pattern zero only), high energy light curve,
from the event file to identify intervals of flaring particle background:
 evselect table=EPIC.fits withrateset=Y rateset=rateEPIC.fits \
   maketimecolumn=Y timebinsize=100 makeratecolumn=Y \
   expression='Selection_Expression'

I'm not sure what that means. I have many FITS files, like
1744_0554370101_M1S00100AUX.FIT and so on.  Should I choose one file among them?
If so, by what criteria? And should I do that file by file? 

Thanks,
Jaewoong Jung
Physic Department
University of Alaska Fairbanks


Reply 1

Resend
From: Rosario Gonzalez Riestra <xmmhelp@sciops.esa.int>
To: jjung11@alaska.edu
Subject: Re: Soft proton filtering (PR#84007)
Date: Tue Sep 25 09:18:42 2018
Dear Jaewoong Jung,


I assume that you have already run emproc and epproc to generate event lists

Then you have got files with names

????_??????????_EPN_????_ImagingEvts.ds
????_??????????_EMOS1_????_ImagingEvts.ds
????_??????????_EMOS2_????_ImagingEvts.ds

for EPIC-pn, EPIC-MOS1 and EPIC-MOS2, respectively 

To filter for high background periods, you should replace 'EPIC.fits' in the
call to 'evselect' with one of the three files above, depending on the
instrument you want to work with.

Regards,

Rosario


Followup 1

Compose reply
Download message
From: Jaewoong Jung <jjung11@alaska.edu>
Date: Tue, 25 Sep 2018 17:34:10 -0800
Subject: Re: Soft proton filtering (PR#84007)
To: xmmhelp@sciops.esa.int
--000000000000c693af0576bc3841
Content-Type: multipart/alternative; boundary="000000000000c693ad0576bc383f"

--000000000000c693ad0576bc383f
Content-Type: text/plain; charset="UTF-8"

Dear Rosario Gonzalez, Riestra,

Thanks.
But while I was processing, I got following warning (bold by me):

dyn-137-229-27-249:test jjung11$ evselect
table=1744_0554370101_EPN_S003_ImagingEvts.ds withfilteredset=Y
filteredset=1744_0554370101_EPN_S003_ImagingEvtsclean.fits destruct=Y
keepfilteroutput=T expression='#XMMEA_EP &&
gti(1744_0554370101_EPN_S003_ImagingEvtsgti.fits,TIME) && (PI>150)'

evselect:- Executing (routine): evselect
table=1744_0554370101_EPN_S003_ImagingEvts.ds
filteredset=1744_0554370101_EPN_S003_ImagingEvtsclean.fits
withfilteredset=yes keepfilteroutput=yes flagcolumn=EVFLAG flagbit=-1
destruct=yes dssblock='' expression='#XMMEA_EP &&
gti(1744_0554370101_EPN_S003_ImagingEvtsgti.fits,TIME) && (PI>150)'
filtertype=expression cleandss=no updateexposure=yes filterexposure=yes
writedss=yes blockstocopy='' attributestocopy='' energycolumn=PHA
zcolumn=WEIGHT zerrorcolumn=EWEIGHT withzerrorcolumn=no withzcolumn=no
ignorelegallimits=no imageset=image.fits xcolumn=RAWX ycolumn=RAWY
ximagebinsize=1 yimagebinsize=1 squarepixels=no ximagesize=600
yimagesize=600 imagebinning=imageSize ximagemin=1 ximagemax=640
withxranges=no yimagemin=1 yimagemax=640 withyranges=no
imagedatatype=Real64 withimagedatatype=no raimagecenter=0 decimagecenter=0
withcelestialcenter=no withimageset=no spectrumset=spectrum.fits
spectralbinsize=5 specchannelmin=0 specchannelmax=11999 withspecranges=no
withspectrumset=no rateset=rate.fits timecolumn=TIME timebinsize=1
timemin=0 timemax=1000 withtimeranges=no maketimecolumn=no
makeratecolumn=no withrateset=no histogramset=histo.fits
histogramcolumn=TIME histogrambinsize=1 histogrammin=0 histogrammax=1000
withhistoranges=no withhistogramset=no  -w 1 -V 4

evselect:- evselect (evselect-3.64)  [xmmsas_20180620_1732-17.0.0] started:
2018-09-26T00:10:39.000

*** evselect: warning (EmptyGtiTable), The GTI table in
`1744_0554370101_EPN_S003_ImagingEvtsgti.fits' is empty - nothing will pass
this filter*

*evselect:- selected 0 rows from the input table.*

*** evselect: warning (NoFilteredEvents), No events have been selected -
filtering of the event list resulted in an empty table*

evselect:- evselect (evselect-3.64)  [xmmsas_20180620_1732-17.0.0] ended:
  2018-09-26T00:10:40.000


I proceeded in this order (for EPIC-pn)


evselect table=1744_0554370101_EPN_S003_ImagingEvts.ds withrateset=Y
rateset=rate1744_0554370101_EPN_S003_ImagingEvts.ds maketimecolumn=Y
timebinsize=100 makeratecolumn=Y expression='#XMM_EP &&
(PI>10000&&PI<12000) && (PATTERN==0)'


tabgtigen table=rate1744_0554370101_EPN_S003_ImagingEvts.ds
expression='RATE<=0.4' gtiset=1744_0554370101_EPN_S003_ImagingEvtsgti.fits


evselect table=1744_0554370101_EPN_S003_ImagingEvts.ds withfilteredset=Y
filteredset=1744_0554370101_EPN_S003_ImagingEvtsclean.fits destruct=Y
keepfilteroutput=T expression='#XMMEA_EP &&
gti(1744_0554370101_EPN_S003_ImagingEvtsgti.fits,TIME) && (PI>150)'


MOS files were processed well (at least there was no warning).

So I suspect that maybe this is not the technical problem. I attached the
result of


dsplot table=rate1744_0554370101_EPN_S003_ImagingEvts.ds  x=TIME y=RATE




Regards,

Jaewoong

On Tue, Sep 25, 2018 at 1:19 AM Rosario Gonzalez Riestra <
xmmhelp@sciops.esa.int> wrote:

>
> Dear Jaewoong Jung,
>
>
> I assume that you have already run emproc and epproc to generate event
> lists
>
> Then you have got files with names
>
> ????_??????????_EPN_????_ImagingEvts.ds
> ????_??????????_EMOS1_????_ImagingEvts.ds
> ????_??????????_EMOS2_????_ImagingEvts.ds
>
> for EPIC-pn, EPIC-MOS1 and EPIC-MOS2, respectively
>
> To filter for high background periods, you should replace 'EPIC.fits' in
> the
> call to 'evselect' with one of the three files above, depending on the
> instrument you want to work with.
>
> Regards,
>
> Rosario
>
>
> This message is intended only for the recipient(s) named above. It may
> contain proprietary information and/or
> protected content. Any unauthorised disclosure, use, retention or
> dissemination is prohibited. If you have received
> this e-mail in error, please notify the sender immediately. ESA applies
> appropriate organisational measures to protect
> personal data, in case of data privacy queries, please contact the ESA
> Data Protection Officer (dpo@esa.int).
>
>
>

--000000000000c693ad0576bc383f
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">Dear Rosario Gonzalez,
Riestra,<div><br></div><div>Thanks.=
</div><div>But while I was processing, I got following warning (bold
by me)=
:</div><

Message of length 72681 truncated


Reply 2

Resend
From: Rosario Gonzalez Riestra <xmmhelp@sciops.esa.int>
To: jjung11@alaska.edu
Subject: Re: Soft proton filtering (PR#84007)
Date: Wed Sep 26 12:21:24 2018
Dear Jaewoong,

The warnings you get mean that there are no periods of time in the observation
during which the condition 'RATE<=0.4' is fulfilled. This is shown in the
plot
of the lightcurve, where all values are about this threshold.

As explained in the thread:

"This value will be different for each data set"

Please refer to the corresponding section in the SAS User Guide:

https://xmm-tools.cosmos.esa.int/external/xmm_user_support/documentation/sas_usg/USG/

Regards,

Rosario

Up to top level
AO15   AO16   AO17   AO18   AO19   Backgrounds   Calibration   Conference   Data   Docs   EPICMOS   EPICpn   Feedback   Gallery   Misc   OM   Pending   PhD_Theses   Publications   RGS   RadMonitor   SAS_Hardware   SAS_WS   SASv16.0   SASv16.0_Installation   SASv16.1   SASv16.1_Installation   SASv17.0   SASv17.0_Installation   SASv18.0   SASv18.0_Installation   SciSim   Simulators_other   Suggestions   Trash   Visibility   XMM-bouncing   XMM-news   XRPS   XSA   esas   incoming  

Logged in as guest


Please make your (short) question the subject of your request!


Web interface using JitterBug ... back to the XMM home page