Up to top level
AO15   AO16   AO17   AO18   Backgrounds   Calibration   Conference   Data   Docs   EPICMOS   EPICpn   Feedback   Gallery   Misc   OM   Pending   PhD_Theses   Publications   RGS   RadMonitor   SAS_Hardware   SAS_WS   SASv16.0   SASv16.0_Installation   SASv16.1   SASv16.1_Installation   SASv17.0   SASv17.0_Installation   SciSim   Simulators_other   Suggestions   Trash   Visibility   XMM-bouncing   XMM-news   XRPS   XSA   esas   incoming  

Logged in as guest

Viewing SciSim/43086
Full headers

From: manuel.meyer@desy.de
Subject: Problem with SCISIM simulations and epproc
Compose reply
Download message
Move To:
2 replies: 1 2
1 followups: 1

Private message: yes  no

Notes:

Notification:


Date: Mon, 8 Feb 2010 11:08:54 GMT
From: manuel.meyer@desy.de
To: xmmhelp@sciops.esa.int
Cc: manuel.meyer@desy.de
Subject: Problem with SCISIM simulations and epproc
Full_Name: Manuel Meyer
Submission from: (NULL) (131.169.139.53)


Dear Helpdesk,

I am trying to simulate a Crab spectrum with SciSim with the PN camera in the
Burst mode. Whenever I try to process my output with epproc I get a number of
warnings and an empty Event List is created. I think my problem is similar to
the one in the thread
http://xmm2.esac.esa.int/xmmhelp/SciSim?id=39359;page=4;user=guest

In order to avoid the problem with empty frames mentioned in the thread above I
tried to add simulated sources and different exposure times. But unfortunately
it does not do the trick. 
I am using Scisim 4.0.4, SAS 9.0 and the ccf files provided for Scisim. I have
attached the epproc output below. I use the following commands:

podf < epic.out 
odffix ra=83.633 dec=22.014 posangle=0 findnominalpointing=0
epproc analyzingSciSimdata=yes

Do you have any suggestions how I can avoid this problem? 
Thank you very muchin advance for your help.

Regards,

Manuel Meyer



epproc:- Executing (routine): epproc removetemporaries=yes
removeintermediategtis=yes removeintermediateeventlists=yes selectccds=no
ccd1=no ccd2=no ccd3=no ccd4=no ccd5=no ccd6=no ccd7=no ccd8=no ccd9=no ccd10=no
ccd11=no ccd12=no selectmodes=yes imaging=yes timing=yes burst=no
timingsrcposition=190 withinstexpids=no instexpids='' withgtiset=no
gtiset=gti.ds runhkgtigen=yes runatthkgen=yes referencepointing=median ra=0
dec=0 posangle=0 filterevents=yes filterexpression='(PI > 150 && RAWY
> 0)'
flagfilteredevents=no rungtimerge=no applygti=yes runevlistcomb=yes
runepexposure=yes randomizetime=yes deleteexposurecolumns=yes
searchforbadpixels=yes searchforbadcolumns=yes thresholdlabel=rate lothresh=0
hithresh=0.0045 columnsearchlabel=median locolthresh=0 hicolthresh=0.00105
flickertimesteps=1 flickerksthresh=0.55 flickerchisqthresh=15
backgroundrate=0.0001 narrowerthanpsf=1.5 threshabovebackground=no
loenergythresh=0.14 hienergythresh=12 randomizeposition=yes randomizeenergy=yes
gainctiaccuracy=2 reemissionthresh=0 withoutoftime=no mappatterntype=sssd
withtempcorrection=yes wrongpixlimit=20 setupbpx=nom3 lowerthreshold=20
withsrccoords=no srcra=0 srcdec=0 mipthreshold=3000 mipmethod=onboard mipdist=no
mipdiscard=yes withparameters=no parameters='' except=no
withoverrideparameters=no overrideparameters='' analyzingSciSimdata=yes
runepreject=no badcolumnset=badcolumns.tab sigma=4 noiseparameters='0.98 1 1 1 1
1 1 1 1 1 1 1 1' withoffsetmap=yes set=odfset withsoftflarescreening=no
softflarethreshold1=10 softflarethreshold2=1 softflaresmooth=BOX
softflareenergyrange='40 50' softflaresmoothparams='2 1 1'  -w 3 -V 3
epproc:- Selected data mode: 0 [Imaging]
epproc:- Selected data mode: 1 [Timing]
epproc:- Selected CCD: 1
epproc:- Selected CCD: 2
epproc:- Selected CCD: 3
epproc:- Selected CCD: 4
epproc:- Selected CCD: 5
epproc:- Selected CCD: 6
epproc:- Selected CCD: 7
epproc:- Selected CCD: 8
epproc:- Selected CCD: 9
epproc:- Selected CCD: 10
epproc:- Selected CCD: 11
epproc:- Selected CCD: 12
epproc:- 0 [Imaging] -> 0
epproc:- 1 [Timing] -> 1
epproc:- Considering one of the 0 exposures for mode 0 [Imaging]
epproc:- Considering one of the 1 exposures for mode 1 [Timing]
epproc:- Considering exposure PNS001[index=0]
epproc:- Selected exposure: 1 mode 1 [Timing]
epproc:- .//0411_0000000000_AttHk.ds exists. atthkgen will not be run again.
epproc:- Executing (invoked): hkgtigen instrument=epn
gtiset=.//0411_0000000000_EPN_HkGti.ds diagfile=STDOUT plotgtis=no
diagnosticmode=no withgtiset=yes parameters='' withparameters=no except=no
overrideparameters='' overrideparametervalues='' withoverrideparameters=no
timecolumn=TIME prefraction=0.5 postfraction=0.5  -w 3 -V 3
epproc::hkgtigen:- Executing (routine): hkgtigen instrument=epn
gtiset=.//0411_0000000000_EPN_HkGti.ds diagfile=STDOUT plotgtis=no
diagnosticmode=no withgtiset=yes parameters='' withparameters=no except=no
overrideparameters='' overrideparametervalues='' withoverrideparameters=no
timecolumn=TIME prefraction=0.5 postfraction=0.5  -w 3 -V 3

** epproc::hkgtigen: warning (UnusedValidityRanges), The following validity
ranges are not considered in the GTI list generation:
F1119 : @ =="STOPPED"
F1128 : @ IN [-91.0:-89.0]
F1225 :  @ =="HIGH"
F1226 :  @ =="HIGH"
F1227 :  @ =="HIGH"
F1232 :  @ =="HIGH"
F1233 :  @ =="HIGH"
F1234 :  @ =="HIGH"
F1239 :  @ =="HIGH"
F1240 :  @ =="HIGH"
F1241 :  @ =="HIGH"
F1246 :  @ =="HIGH"
F1247 :  @ =="HIGH"
F1248 :  @ =="HIGH"
F1330 : @ <=1000
F1375 : @ <=1000
F1420 : @ <=1000
F1465 : @ <=1000

** epproc::hkgtigen: warning (EmptyGtiSet), The generated GTI data set
`.//0411_0000000000_EPN_HkGti.ds' is empty - applying it to any event list will
result in no events getting selected.
epproc:- Processing S001
epproc:- Processing data set:
/scratch/Programme/SAS/sim/crab/0411_0000000000_PNS00104TIE.FIT
epproc:- Executing (invoked): epframes
set=/scratch/Programme/SAS/sim/crab/0411_0000000000_PNS00104TIE.FIT
eventset=.//0411_0000000000_EPN_S001_04_Ev

Message of length 8926 truncated

Reply 1

Resend
From: Ignacio de la Calle <xmmhelp@sciops.esa.int>
To: manuel.meyer@desy.de
Subject: Re: Problem with SCISIM simulations and epproc (PR#43086)
Date: Mon Feb  8 16:12:17 2010
Dear Manuel,

Could you let me know what you mean to obtain from SciSim ?
What is your aim by using this software.

Regards,

Ignacio de la Calle
XMM-Newton SOC

> Submission from: (NULL) (131.169.139.53)
> 
> 
> Dear Helpdesk,
> 
> I am trying to simulate a Crab spectrum with SciSim with the PN camera in
the
> Burst mode. Whenever I try to process my output with epproc I get a number
of
> warnings and an empty Event List is created. I think my problem is similar
to
> the one in the thread
> http://xmm2.esac.esa.int/xmmhelp/SciSim?id=39359;page=4;user=guest
> 
> In order to avoid the problem with empty frames mentioned in the thread
above
I
> tried to add simulated sources and different exposure times. But
unfortunately
> it does not do the trick. 
> I am using Scisim 4.0.4, SAS 9.0 and the ccf files provided for Scisim. I
have
> attached the epproc output below. I use the following commands:
> 
> podf < epic.out 
> odffix ra=83.633 dec=22.014 posangle=0 findnominalpointing=0
> epproc analyzingSciSimdata=yes
> 
> Do you have any suggestions how I can avoid this problem? 
> Thank you very muchin advance for your help.
> 
> Regards,
> 
> Manuel Meyer
> 
> 
> 
> epproc:- Executing (routine): epproc removetemporaries=yes
> removeintermediategtis=yes removeintermediateeventlists=yes selectccds=no
> ccd1=no ccd2=no ccd3=no ccd4=no ccd5=no ccd6=no ccd7=no ccd8=no ccd9=no
ccd10=no
> ccd11=no ccd12=no selectmodes=yes imaging=yes timing=yes burst=no
> timingsrcposition=190 withinstexpids=no instexpids='' withgtiset=no
> gtiset=gti.ds runhkgtigen=yes runatthkgen=yes referencepointing=median
ra=0
> dec=0 posangle=0 filterevents=yes filterexpression='(PI > 150 &&
RAWY > 0)'
> flagfilteredevents=no rungtimerge=no applygti=yes runevlistcomb=yes
> runepexposure=yes randomizetime=yes deleteexposurecolumns=yes
> searchforbadpixels=yes searchforbadcolumns=yes thresholdlabel=rate
lothresh=0
> hithresh=0.0045 columnsearchlabel=median locolthresh=0 hicolthresh=0.00105
> flickertimesteps=1 flickerksthresh=0.55 flickerchisqthresh=15
> backgroundrate=0.0001 narrowerthanpsf=1.5 threshabovebackground=no
> loenergythresh=0.14 hienergythresh=12 randomizeposition=yes
randomizeenergy=yes
> gainctiaccuracy=2 reemissionthresh=0 withoutoftime=no mappatterntype=sssd
> withtempcorrection=yes wrongpixlimit=20 setupbpx=nom3 lowerthreshold=20
> withsrccoords=no srcra=0 srcdec=0 mipthreshold=3000 mipmethod=onboard
mipdist=no
> mipdiscard=yes withparameters=no parameters='' except=no
> withoverrideparameters=no overrideparameters='' analyzingSciSimdata=yes
> runepreject=no badcolumnset=badcolumns.tab sigma=4 noiseparameters='0.98 1
1 1
1
> 1 1 1 1 1 1 1 1' withoffsetmap=yes set=odfset withsoftflarescreening=no
> softflarethreshold1=10 softflarethreshold2=1 softflaresmooth=BOX
> softflareenergyrange='40 50' softflaresmoothparams='2 1 1'  -w 3 -V 3
> epproc:- Selected data mode: 0 [Imaging]
> epproc:- Selected data mode: 1 [Timing]
> epproc:- Selected CCD: 1
> epproc:- Selected CCD: 2
> epproc:- Selected CCD: 3
> epproc:- Selected CCD: 4
> epproc:- Selected CCD: 5
> epproc:- Selected CCD: 6
> epproc:- Selected CCD: 7
> epproc:- Selected CCD: 8
> epproc:- Selected CCD: 9
> epproc:- Selected CCD: 10
> epproc:- Selected CCD: 11
> epproc:- Selected CCD: 12
> epproc:- 0 [Imaging] -> 0
> epproc:- 1 [Timing] -> 1
> epproc:- Considering one of the 0 exposures for mode 0 [Imaging]
> epproc:- Considering one of the 1 exposures for mode 1 [Timing]
> epproc:- Considering exposure PNS001[index=0]
> epproc:- Selected exposure: 1 mode 1 [Timing]
> epproc:- .//0411_0000000000_AttHk.ds exists. atthkgen will not be run
again.
> epproc:- Executing (invoked): hkgtigen instrument=epn
> gtiset=.//0411_0000000000_EPN_HkGti.ds diagfile=STDOUT plotgtis=no
> diagnosticmode=no withgtiset=yes parameters='' withparameters=no except=no
> overrideparameters='' overrideparametervalues='' withoverrideparameters=no
> timecolumn=TIME prefraction=0.5 postfraction=0.5  -w 3 -V 3
> epproc::hkgtigen:- Executing (routine): hkgtigen instrument=epn
> gtiset=.//0411_0000000000_EPN_HkGti.ds diagfile=STDOUT plotgtis=no
> diagnosticmode=no withgtiset=yes parameters='' withparameters=no except=no
> overrideparameters='' overrideparametervalues='' withoverrideparameters=no
> timecolumn=TIME prefraction=0.5 postfraction=0.5  -w 3 -V 3
> 
> ** epproc::hkgtigen: warning (UnusedValidityRanges), The following
validity
> ranges are not considered in the GTI list generation:
> F1119 : @ =="STOPPED"
> F1128 : @ IN [-91.0:-89.0]
> F1225 :  @ =="HIGH"
> F1226 :  @ =="HIGH"
> F1227 :  @ =="HIGH"
> F1232 :  @ ==

Message of length 10153 truncated


Followup 1

Compose reply
Download message
Date: Mon, 08 Feb 2010 17:41:09 +0100
From: Manuel Meyer <manuel.meyer@desy.de>
To: Ignacio de la Calle <xmmhelp@sciops.esa.int>
Subject: Re: Problem with SCISIM simulations and epproc (PR#43086)
Dear Ignacio,

I am searching for oscillatory features in energy in real Crab spectra. 
In order to get a reference spectrum without any oscillatory features I 
would like to simulate such a Crab like source with Scisim. For my 
analysis I eventually need an event file that contains the incident 
photon energies. Hence, the imaging is not important for me. For that 
purpose, I supply Scisim with a power law spectrum that I have created 
with Xspec.
Thanks again for the help,
regards,
Manuel Meyer

Ignacio de la Calle wrote:
> Dear Manuel,
>
> Could you let me know what you mean to obtain from SciSim ?
> What is your aim by using this software.
>
> Regards,
>
> Ignacio de la Calle
> XMM-Newton SOC
>
>   
>> Submission from: (NULL) (131.169.139.53)
>>
>>
>> Dear Helpdesk,
>>
>> I am trying to simulate a Crab spectrum with SciSim with the PN camera
in the
>> Burst mode. Whenever I try to process my output with epproc I get a
number of
>> warnings and an empty Event List is created. I think my problem is
similar to
>> the one in the thread
>> http://xmm2.esac.esa.int/xmmhelp/SciSim?id=39359;page=4;user=guest
>>
>> In order to avoid the problem with empty frames mentioned in the thread
above
>>     
> I
>   
>> tried to add simulated sources and different exposure times. But
>>     
> unfortunately
>   
>> it does not do the trick. 
>> I am using Scisim 4.0.4, SAS 9.0 and the ccf files provided for Scisim.
I
>>     
> have
>   
>> attached the epproc output below. I use the following commands:
>>
>> podf < epic.out 
>> odffix ra=83.633 dec=22.014 posangle=0 findnominalpointing=0
>> epproc analyzingSciSimdata=yes
>>
>> Do you have any suggestions how I can avoid this problem? 
>> Thank you very muchin advance for your help.
>>
>> Regards,
>>
>> Manuel Meyer
>>
>>
>>
>> epproc:- Executing (routine): epproc removetemporaries=yes
>> removeintermediategtis=yes removeintermediateeventlists=yes
selectccds=no
>> ccd1=no ccd2=no ccd3=no ccd4=no ccd5=no ccd6=no ccd7=no ccd8=no ccd9=no
>>     
> ccd10=no
>   
>> ccd11=no ccd12=no selectmodes=yes imaging=yes timing=yes burst=no
>> timingsrcposition=190 withinstexpids=no instexpids='' withgtiset=no
>> gtiset=gti.ds runhkgtigen=yes runatthkgen=yes referencepointing=median
ra=0
>> dec=0 posangle=0 filterevents=yes filterexpression='(PI > 150
&& RAWY > 0)'
>> flagfilteredevents=no rungtimerge=no applygti=yes runevlistcomb=yes
>> runepexposure=yes randomizetime=yes deleteexposurecolumns=yes
>> searchforbadpixels=yes searchforbadcolumns=yes thresholdlabel=rate
lothresh=0
>> hithresh=0.0045 columnsearchlabel=median locolthresh=0
hicolthresh=0.00105
>> flickertimesteps=1 flickerksthresh=0.55 flickerchisqthresh=15
>> backgroundrate=0.0001 narrowerthanpsf=1.5 threshabovebackground=no
>> loenergythresh=0.14 hienergythresh=12 randomizeposition=yes
>>     
> randomizeenergy=yes
>   
>> gainctiaccuracy=2 reemissionthresh=0 withoutoftime=no
mappatterntype=sssd
>> withtempcorrection=yes wrongpixlimit=20 setupbpx=nom3 lowerthreshold=20
>> withsrccoords=no srcra=0 srcdec=0 mipthreshold=3000 mipmethod=onboard
>>     
> mipdist=no
>   
>> mipdiscard=yes withparameters=no parameters='' except=no
>> withoverrideparameters=no overrideparameters='' analyzingSciSimdata=yes
>> runepreject=no badcolumnset=badcolumns.tab sigma=4
noiseparameters='0.98 1 1 1
>>     
> 1
>   
>> 1 1 1 1 1 1 1 1' withoffsetmap=yes set=odfset withsoftflarescreening=no
>> softflarethreshold1=10 softflarethreshold2=1 softflaresmooth=BOX
>> softflareenergyrange='40 50' softflaresmoothparams='2 1 1'  -w 3 -V 3
>> epproc:- Selected data mode: 0 [Imaging]
>> epproc:- Selected data mode: 1 [Timing]
>> epproc:- Selected CCD: 1
>> epproc:- Selected CCD: 2
>> epproc:- Selected CCD: 3
>> epproc:- Selected CCD: 4
>> epproc:- Selected CCD: 5
>> epproc:- Selected CCD: 6
>> epproc:- Selected CCD: 7
>> epproc:- Selected CCD: 8
>> epproc:- Selected CCD: 9
>> epproc:- Selected CCD: 10
>> epproc:- Selected CCD: 11
>> epproc:- Selected CCD: 12
>> epproc:- 0 [Imaging] -> 0
>> epproc:- 1 [Timing] -> 1
>> epproc:- Considering one of the 0 exposures for mode 0 [Imaging]
>> epproc:- Considering one of the 1 exposures for mode 1 [Timing]
>> epproc:- Considering exposure PNS001[index=0]
>> epproc:- Selected exposure: 1 mode 1 [Timing]
>> epproc:- .//0411_0000000000_AttHk.ds exists. atthkgen will not be run
again.
>> epproc:- Executing (invoked): hkgtigen instrument=epn
&

Message of length 12528 truncated


Reply 2

Resend
From: Ignacio de la Calle <xmmhelp@sciops.esa.int>
To: manuel.meyer@desy.de
Subject: Re: Problem with SCISIM simulations and epproc (PR#43086)
Date: Tue Feb  9 14:08:21 2010
Dear Manuel,

I can see in the log you send that these two flags:

runhkgtigen=yes runatthkgen=yes

are still set to yes. They should be set to now.

On another matter, it is not possible to simulate burst mode
in SciSim. However, there are some observations of Cas A that
have been taken in burst mode. I dont know if using this set 
would help you or not in achieving your goal.

Regards,

Ignacio de la Calle
XMM-Newton SOC

> 
> I am searching for oscillatory features in energy in real Crab spectra. 
> In order to get a reference spectrum without any oscillatory features I 
> would like to simulate such a Crab like source with Scisim. For my 
> analysis I eventually need an event file that contains the incident 
> photon energies. Hence, the imaging is not important for me. For that 
> purpose, I supply Scisim with a power law spectrum that I have created 
> with Xspec.
> Thanks again for the help,
> regards,
> Manuel Meyer
> 
> Ignacio de la Calle wrote:
>> Dear Manuel,
>>
>> Could you let me know what you mean to obtain from SciSim ?
>> What is your aim by using this software.
>>
>> Regards,
>>
>> Ignacio de la Calle
>> XMM-Newton SOC
>>
>>   
>>> Submission from: (NULL) (131.169.139.53)
>>>
>>>
>>> Dear Helpdesk,
>>>
>>> I am trying to simulate a Crab spectrum with SciSim with the PN
camera in
the
>>> Burst mode. Whenever I try to process my output with epproc I get a
number
of
>>> warnings and an empty Event List is created. I think my problem is
similar
to
>>> the one in the thread
>>> http://xmm2.esac.esa.int/xmmhelp/SciSim?id=39359;page=4;user=guest
>>>
>>> In order to avoid the problem with empty frames mentioned in the
thread
above
>>>     
>> I
>>   
>>> tried to add simulated sources and different exposure times. But
>>>     
>> unfortunately
>>   
>>> it does not do the trick. 
>>> I am using Scisim 4.0.4, SAS 9.0 and the ccf files provided for
Scisim. I
>>>     
>> have
>>   
>>> attached the epproc output below. I use the following commands:
>>>
>>> podf < epic.out 
>>> odffix ra=83.633 dec=22.014 posangle=0 findnominalpointing=0
>>> epproc analyzingSciSimdata=yes
>>>
>>> Do you have any suggestions how I can avoid this problem? 
>>> Thank you very muchin advance for your help.
>>>
>>> Regards,
>>>
>>> Manuel Meyer
>>>
>>>
>>>
>>> epproc:- Executing (routine): epproc removetemporaries=yes
>>> removeintermediategtis=yes removeintermediateeventlists=yes
selectccds=no
>>> ccd1=no ccd2=no ccd3=no ccd4=no ccd5=no ccd6=no ccd7=no ccd8=no
ccd9=no
>>>     
>> ccd10=no
>>   
>>> ccd11=no ccd12=no selectmodes=yes imaging=yes timing=yes burst=no
>>> timingsrcposition=190 withinstexpids=no instexpids=''
withgtiset=no
>>> gtiset=gti.ds runhkgtigen=yes runatthkgen=yes
referencepointing=median ra=0
>>> dec=0 posangle=0 filterevents=yes filterexpression='(PI > 150
&& RAWY > 0)'
>>> flagfilteredevents=no rungtimerge=no applygti=yes
runevlistcomb=yes
>>> runepexposure=yes randomizetime=yes deleteexposurecolumns=yes
>>> searchforbadpixels=yes searchforbadcolumns=yes thresholdlabel=rate
lothresh=0
>>> hithresh=0.0045 columnsearchlabel=median locolthresh=0
hicolthresh=0.00105
>>> flickertimesteps=1 flickerksthresh=0.55 flickerchisqthresh=15
>>> backgroundrate=0.0001 narrowerthanpsf=1.5 threshabovebackground=no
>>> loenergythresh=0.14 hienergythresh=12 randomizeposition=yes
>>>     
>> randomizeenergy=yes
>>   
>>> gainctiaccuracy=2 reemissionthresh=0 withoutoftime=no
mappatterntype=sssd
>>> withtempcorrection=yes wrongpixlimit=20 setupbpx=nom3
lowerthreshold=20
>>> withsrccoords=no srcra=0 srcdec=0 mipthreshold=3000
mipmethod=onboard
>>>     
>> mipdist=no
>>   
>>> mipdiscard=yes withparameters=no parameters='' except=no
>>> withoverrideparameters=no overrideparameters=''
analyzingSciSimdata=yes
>>> runepreject=no badcolumnset=badcolumns.tab sigma=4
noiseparameters='0.98 1
1
> 1
>>>     
>> 1
>>   
>>> 1 1 1 1 1 1 1 1' withoffsetmap=yes set=odfset
withsoftflarescreening=no
>>> softflarethreshold1=10 softflarethreshold2=1 softflaresmooth=BOX
>>> softflareenergyrange='40 50' softflaresmoothparams='2 1 1'  -w 3 -V
3
>>> epproc:- Selected data mode: 0 [Imagin

Message of length 14418 truncated

Up to top level
AO15   AO16   AO17   AO18   Backgrounds   Calibration   Conference   Data   Docs   EPICMOS   EPICpn   Feedback   Gallery   Misc   OM   Pending   PhD_Theses   Publications   RGS   RadMonitor   SAS_Hardware   SAS_WS   SASv16.0   SASv16.0_Installation   SASv16.1   SASv16.1_Installation   SASv17.0   SASv17.0_Installation   SciSim   Simulators_other   Suggestions   Trash   Visibility   XMM-bouncing   XMM-news   XRPS   XSA   esas   incoming  

Logged in as guest


Please make your (short) question the subject of your request!


Web interface using JitterBug ... back to the XMM home page