Up to top level
AO15   AO16   AO17   AO18   AO19   Backgrounds   Calibration   Conference   Data   Docs   EPICMOS   EPICpn   Feedback   Gallery   Misc   OM   Pending   PhD_Theses   Publications   RGS   RadMonitor   SAS_Hardware   SAS_WS   SASv16.0   SASv16.0_Installation   SASv16.1   SASv16.1_Installation   SASv17.0   SASv17.0_Installation   SASv18.0   SASv18.0_Installation   SciSim   Simulators_other   Suggestions   Trash   Visibility   XMM-bouncing   XMM-news   XRPS   XSA   esas   incoming  

Logged in as guest

Viewing SASv16.0_Installation/81898
Full headers

From: jingyi_wang@berkeley.edu
Subject: error NoOdf in epproc
Compose reply
Download message
Move To:
2 replies: 1 2
2 followups: 1 2

Private message: yes  no

Notes:

Notification:


Date: Fri, 23 Jun 2017 00:53:42 GMT
From: jingyi_wang@berkeley.edu
To: xmmhelp@sciops.esa.int
CC: jingyi_wang@berkeley.edu
Subject: error NoOdf in epproc
Full_Name: Jingyi Wang
Submission from: (NULL) (131.215.220.165)


Hi,

I met some problem when I do pipeline (epproc) for PN data. Here are what I've
done in the directory
/Users/jingyi/gx339-4/raw_data/raw_xmm_data/0760646501/ODF:

export SAS_DIR=/Users/jingyi/SAS/xmmsas_20170112_1337
. $SAS_DIR/setsas.sh
export SAS_CCFPATH=/Users/jingyi/gx339-4/raw_data/xmm_ccf
export SAS_ODF=/Users/jingyi/gx339-4/raw_data/raw_xmm_data/0760646501/ODF
cifbuild
export SAS_CCF=/Users/jingyi/gx339-4/raw_data/raw_xmm_data/0760646501/ODF/ccf.cif
odfingest odfdir=$SAS_ODF outdir=$SAS_ODF
export SAS_ODF=/Users/jingyi/gx339-4/raw_data/raw_xmm_data/076064501/ODF/2886_0760646501_SCX00000SUM.SAS
epproc

But epproc gave out:

epproc:- Executing (routine): epproc withdefaultcal=yes removetemporaries=yes
removeintermediategtis=yes removeintermediateeventlists=yes pileuptempfile=no
selectccds=no ccd1=no ccd2=no ccd3=no ccd4=no ccd5=no ccd6=no ccd7=no ccd8=no
ccd9=no ccd10=no ccd11=no ccd12=no selectmodes=yes imaging=yes timing=yes
burst=no timingsrcposition=190 withinstexpids=no instexpids='' withgtiset=no
gtiset=gti.ds runhkgtigen=yes runatthkgen=yes referencepointing=median ra=0
dec=0 posangle=0 filterevents=yes filterexpression='(PI > 150 && RAWY
> 0)'
flagfilteredevents=no rungtimerge=no applygti=yes runevlistcomb=yes
runepexposure=yes randomizetime=yes spatialexposure=yes
deleteexposurecolumns=yes searchforbadpixels=yes searchforbadcolumns=yes
thresholdlabel=rate lothresh=0 hithresh=0.0045 columnsearchlabel=median
locolthresh=0 hicolthresh=0.00105 flickertimesteps=1 flickerksthresh=0.55
flickerchisqthresh=15 backgroundrate=0.00011 narrowerthanpsf=1.5
threshabovebackground=no loenergythresh=0.14 hienergythresh=12
randomizeposition=yes randomizeenergy=yes ctilongtermsoft=yes
testenergywidth=yes gainctiaccuracy=2 reemissionthresh=0 withoutoftime=no
mappatterntype=sssd withtempcorrection=yes patternanalysis=yes withframecti=no
withpatternoffset=yes withbackgroundgain=yes withrdpha=yes rdphatimebinsize=100
checksasmip=no wrongpixlimit=20 setupbpx=nom3 lowerthreshold=20 guessdeltap=no
withsrccoords=no srcra=0 srcdec=0 mipthreshold=3000 mipmethod=onboard mipdist=no
mipdiscard=yes withparameters=no parameters='' except=no
withoverrideparameters=no overrideparameters='' analyzingSciSimdata=no
runepnoise=no sigmacut=3 noisecut=2 savemasks=no applyfilter=yes runepreject=no
badcolumnset=badcolumns.tab sigma=4 withnoisehandling=no noiseparameters='0.98 1
1 1 1 1 1 1 1 1 1 1 1' withoffsetmap=yes withxrlcorrection=no
withsoftflarescreening=no softflarethreshold1=10 softflarethreshold2=1
softflaresmooth=BOX softflareenergyrange='40 50' softflaresmoothparams='2 0 0'
runepxrlcorr=no runepfast=no  -w 1 -V 4
epproc:- epproc (epicproc-2.21.1)  [xmmsas_20170112_1337-16.0.0] started: 
2017-06-23T00:40:30.000
epproc:- Selected data mode: 0 [Imaging]
epproc:- Selected data mode: 1 [Timing]
epproc:- Selected CCD: 1
epproc:- Selected CCD: 2
epproc:- Selected CCD: 3
epproc:- Selected CCD: 4
epproc:- Selected CCD: 5
epproc:- Selected CCD: 6
epproc:- Selected CCD: 7
epproc:- Selected CCD: 8
epproc:- Selected CCD: 9
epproc:- Selected CCD: 10
epproc:- Selected CCD: 11
epproc:- Selected CCD: 12
** epproc: error (NoOdf),
`/Users/jingyi/gx339-4/raw_data/raw_xmm_data/076064501/ODF/2886_0760646501_SCX00000SUM.SAS'
is neither the name of a directory nor the name of an ODF summary file

Can you please tell me how to fix this problem? Thanks in advance.

Best regards,
Jingyi



Reply 1

Resend
From: Jacobo Ebrero <xmmhelp@sciops.esa.int>
To: jingyi_wang@berkeley.edu
Subject: Re: error NoOdf in epproc (PR#81898)
Date: Fri Jun 23 10:34:04 2017
Dear Jingyi,

Perhaps it is just a typo but I have noticed that in your export declaration:

export SAS_ODF=/Users/jingyi/gx339-4/raw_data/raw_xmm_data/076064501/ODF/2886_0760646501_SCX00000SUM.SAS

the name of the sub-directory "076064501" has one number less than in the ODF
directory you first declared:

export SAS_ODF=/Users/jingyi/gx339-4/raw_data/raw_xmm_data/0760646501/ODF

There is a "6" missing between the "4" and the "5". Could you please check if
the reason why epproc cannot find the summary file is because is looking in the
wrong path?

Best regards,
Jacobo
----------------------
Dr. Jacobo Ebrero
XMM-Newton SOC
User Support Group


Followup 1

Compose reply
Download message
From: Jingyi Wang <jingyi_wang@berkeley.edu>
Date: Fri, 23 Jun 2017 09:02:01 -0700
Subject: Re: error NoOdf in epproc (PR#81898)
To: Jacobo Ebrero <xmmhelp@sciops.esa.int>
--94eb2c0834deca42320552a2b813
Content-Type: text/plain; charset="UTF-8"

Dear Jacobo,

Thanks for finding the typo, I feel stupid...Now the epproc gives out:

jingyis-MacBook-Pro:ODF jingyi$ epproc

epproc:- Executing (routine): epproc withdefaultcal=yes
removetemporaries=yes removeintermediategtis=yes
removeintermediateeventlists=yes pileuptempfile=no selectccds=no ccd1=no
ccd2=no ccd3=no ccd4=no ccd5=no ccd6=no ccd7=no ccd8=no ccd9=no ccd10=no
ccd11=no ccd12=no selectmodes=yes imaging=yes timing=yes burst=no
timingsrcposition=190 withinstexpids=no instexpids='' withgtiset=no
gtiset=gti.ds runhkgtigen=yes runatthkgen=yes referencepointing=median ra=0
dec=0 posangle=0 filterevents=yes filterexpression='(PI > 150 && RAWY
> 0)'
flagfilteredevents=no rungtimerge=no applygti=yes runevlistcomb=yes
runepexposure=yes randomizetime=yes spatialexposure=yes
deleteexposurecolumns=yes searchforbadpixels=yes searchforbadcolumns=yes
thresholdlabel=rate lothresh=0 hithresh=0.0045 columnsearchlabel=median
locolthresh=0 hicolthresh=0.00105 flickertimesteps=1 flickerksthresh=0.55
flickerchisqthresh=15 backgroundrate=0.00011 narrowerthanpsf=1.5
threshabovebackground=no loenergythresh=0.14 hienergythresh=12
randomizeposition=yes randomizeenergy=yes ctilongtermsoft=yes
testenergywidth=yes gainctiaccuracy=2 reemissionthresh=0 withoutoftime=no
mappatterntype=sssd withtempcorrection=yes patternanalysis=yes
withframecti=no withpatternoffset=yes withbackgroundgain=yes withrdpha=yes
rdphatimebinsize=100 checksasmip=no wrongpixlimit=20 setupbpx=nom3
lowerthreshold=20 guessdeltap=no withsrccoords=no srcra=0 srcdec=0
mipthreshold=3000 mipmethod=onboard mipdist=no mipdiscard=yes
withparameters=no parameters='' except=no withoverrideparameters=no
overrideparameters='' analyzingSciSimdata=no runepnoise=no sigmacut=3
noisecut=2 savemasks=no applyfilter=yes runepreject=no
badcolumnset=badcolumns.tab sigma=4 withnoisehandling=no
noiseparameters='0.98 1 1 1 1 1 1 1 1 1 1 1 1' withoffsetmap=yes
withxrlcorrection=no withsoftflarescreening=no softflarethreshold1=10
softflarethreshold2=1 softflaresmooth=BOX softflareenergyrange='40 50'
softflaresmoothparams='2 0 0' runepxrlcorr=no runepfast=no  -w 1 -V 4

epproc:- epproc (epicproc-2.21.1)  [xmmsas_20170112_1337-16.0.0] started:
2017-06-23T15:58:37.000

epproc:- Selected data mode: 0 [Imaging]

epproc:- Selected data mode: 1 [Timing]

epproc:- Selected CCD: 1

epproc:- Selected CCD: 2

epproc:- Selected CCD: 3

epproc:- Selected CCD: 4

epproc:- Selected CCD: 5

epproc:- Selected CCD: 6

epproc:- Selected CCD: 7

epproc:- Selected CCD: 8

epproc:- Selected CCD: 9

epproc:- Selected CCD: 10

epproc:- Selected CCD: 11

epproc:- Selected CCD: 12

epproc:- 0 [Imaging] -> 0

epproc:- 1 [Timing] -> 1

epproc:- Considering one of the 0 exposures for mode 0 [Imaging]

epproc:- Considering one of the 1 exposures for mode 1 [Timing]

epproc:- Considering exposure PNS003[index=0]

epproc:- Selected exposure: 3 mode 1 [Timing]

epproc:- Executing (invoked): atthkgen atthkset=.//2886_0760646501_AttHk.ds
timestep=1 timebegin=0 timeend=0 withtimeranges=no withpreqgti=no
preqgtifile=pointings.fit  -w 1 -V 4

epproc:- atthkgen (atthkgen-1.21)  [xmmsas_20170112_1337-16.0.0] started:
2017-06-23T15:58:37.000

dyld: Library not loaded:
/Volumes/SAS/sasbuild/build/sierra/GNU_CC_CXX_6.2/reltrack_relgfortran6.2_6.2_build/lib/libmetatask.1.95.dylib

  Referenced from: /Users/jingyi/SAS/xmmsas_20170112_1337/bin/atthkgen

  Reason: image not found

** epproc: warning (SubTaskError), atthkgen terminated with the error
invalidInvocation that said:

Execution failed of atthkgen (atthkgen-1.21)  [xmmsas_20170112_1337-16.0.0]

epproc:- Executing (invoked): hkgtigen instrument=epn
gtiset=.//2886_0760646501_EPN_HkGti.ds diagfile=STDOUT plotgtis=no
diagnosticmode=no withgtiset=yes parameters='' withparameters=no except=no
overrideparameters='' overrideparametervalues='' withoverrideparameters=no
timecolumn=TIME prefraction=0.5 postfraction=0.5  -w 1 -V 4

epproc:- hkgtigen (hkgtigen-1.14.2)  [xmmsas_20170112_1337-16.0.0]
started:  2017-06-23T15:58:37.000

dyld: Library not loaded:
/Volumes/SAS/sasbuild/build/sierra/GNU_CC_CXX_6.2/reltrack_relgfortran6.2_6.2_build/lib/libmetatask.1.95.dylib

  Referenced from: /Users/jingyi/SAS/xmmsas_20170112_1337/bin/hkgtigen

  Reason: image not found

epproc:- Processing S003

epproc:- Processing data set:
/Users/jingyi/gx339-4/raw_data/raw_xmm_data/0760646501/ODF/2886_0760646501_PNS00304TIE.FIT

epproc:- Executing (invoked): epframes
set=/Users/jingyi/gx339-4/raw_data/raw_xmm_data/0760646501/ODF/2886_0760646501_PNS00304TIE.FIT
eventset=.//2886_0760646501_EPN_S003_04_EvtsFramesTemp.ds
gtiset=.//2886_0760646501_EPN_S003_04_FrmGti.ds wrongpixlimit=20 srcra=0
srcdec=0 withsrccoords=no srcposition=190 withsrcrawy=no withfinetime=yes
lowerthreshold=0 fifogtithresh=76 withfifogti=no mipthreshold=3000
mipmethod=onboard qualmax=0 eventmapset=eventmap.dat nomipthresholdlow=40
nomipthr

Message of length 28917 truncated


Reply 2

Resend
From: Jacobo Ebrero <xmmhelp@sciops.esa.int>
To: jingyi_wang@berkeley.edu
Subject: Re: error NoOdf in epproc (PR#81898)
Date: Mon Jun 26 09:17:56 2017
Dear Jingyi,

From your log it seems that you are having troubles with some libraries. This
kind of errors have been reported before and we provide a possible solution in
the SAS Watchout page:

https://www.cosmos.esa.int/web/xmm-newton/sas-watchout

Could you please try and see if the proposed solution works also for you?
Otherwise please do not hesitate in contacting us again.

Best regards,
Jacobo
----------------------
Dr. Jacobo Ebrero
XMM-Newton SOC
User Support Group


Followup 2

Compose reply
Download message
From: Jingyi Wang <jingyi_wang@berkeley.edu>
Date: Mon, 26 Jun 2017 09:41:10 -0700
Subject: Re: error NoOdf in epproc (PR#81898)
To: Jacobo Ebrero <xmmhelp@sciops.esa.int>
--94eb2c0834de51608c0552df9e84
Content-Type: text/plain; charset="UTF-8"

Dear Jacobo,

The error went away after I turned off the SIP. Thanks again for your help!

Best regards,
Jingyi

On Mon, Jun 26, 2017 at 2:17 AM, Jacobo Ebrero <xmmhelp@sciops.esa.int>
wrote:

> Dear Jingyi,
>
> From your log it seems that you are having troubles with some libraries.
> This
> kind of errors have been reported before and we provide a possible
> solution in
> the SAS Watchout page:
>
> https://www.cosmos.esa.int/web/xmm-newton/sas-watchout
>
> Could you please try and see if the proposed solution works also for you?
> Otherwise please do not hesitate in contacting us again.
>
> Best regards,
> Jacobo
> ----------------------
> Dr. Jacobo Ebrero
> XMM-Newton SOC
> User Support Group
>
> This message and any attachments are intended for the use of the addressee
> or addressees only.
> The unauthorised disclosure, use, dissemination or copying (either in
> whole or in part) of its
> content is not permitted.
> If you received this message in error, please notify the sender and delete
> it from your system.
> Emails can be altered and their integrity cannot be guaranteed by the
> sender.
>
> Please consider the environment before printing this email.
>
>
>


-- 
Jingyi Wang
Exchange at UCB

Department of Physics, Fudan University, Shanghai

Tel
(510)345-9320
(+86)151-2108-3826
Email
jingyi_wang@berkeley.edu
wangjingyi14@fudan.edu.cn
jingyi_wang@126.com

--94eb2c0834de51608c0552df9e84
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">Dear
Jacobo,<div><br></div><div>The error went away after =
I turned off the SIP. Thanks again for your
help!</div><div><br></div><div>=
Best regards,</div><div>Jingyi</div></div><div
class=3D"gmail_extra"><br><d=
iv class=3D"gmail_quote">On Mon, Jun 26, 2017 at 2:17 AM, Jacobo Ebrero
<sp=
an dir=3D"ltr">&lt;<a href=3D"mailto:xmmhelp@sciops.esa.int"
target=3D"_bla=
nk">xmmhelp@sciops.esa.int</a>&gt;</span>
wrote:<br><blockquote class=3D"gm=
ail_quote" style=3D"margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-le=
ft:1ex">Dear Jingyi,<br>
<br>
From your log it seems that you are having troubles with some libraries. Th=
is<br>
kind of errors have been reported before and we provide a possible solution=
 in<br>
the SAS Watchout page:<br>
<br>
<a href=3D"https://www.cosmos.esa.int/web/xmm-newton/sas-watchout" rel=3D"n=
oreferrer" target=3D"_blank">https://www.cosmos.esa.int/<wbr>web/xmm-newton=
/sas-watchout</a><br>
<br>
Could you please try and see if the proposed solution works also for you?<b=
r>
Otherwise please do not hesitate in contacting us again.<br>
<div class=3D"HOEnZb"><div class=3D"h5"><br>
Best regards,<br>
Jacobo<br>
----------------------<br>
Dr. Jacobo Ebrero<br>
XMM-Newton SOC<br>
User Support Group<br>
<br>
This message and any attachments are intended for the use of the addressee =
or addressees only.<br>
The unauthorised disclosure, use, dissemination or copying (either in whole=
 or in part) of its<br>
content is not permitted.<br>
If you received this message in error, please notify the sender and delete =
it from your system.<br>
Emails can be altered and their integrity cannot be guaranteed by the sende=
r.<br>
<br>
Please consider the environment before printing this email.<br>
<br>
<br>
</div></div></blockquote></div><br><br
clear=3D"all"><div><br></div>-- <br>=
<div class=3D"gmail_signature" data-smartmail=3D"gmail_signature"><div
dir=
=3D"ltr"><div><div dir=3D"ltr"><span
style=3D"color:rgb(0,0,0);font-size:14=
px;font-family:courier">Jingyi Wang</span></div><div
dir=3D"ltr"><font face=
=3D"courier">Exchange at UCB<br
style=3D"color:rgb(0,0,0);font-size:14px"><=
/font><blockquote
style=3D"color:rgb(0,0,0);font-family:tahoma,verdana,aria=
l,helvetica,sans-serif;font-size:14px;margin:0px 0px 0px 40px;border:none;p=
adding:0px"></blockquote><span
style=3D"color:rgb(0,0,0);font-size:14px;fon=
t-family:courier">Department of Physics, Fudan
University,=C2=A0Shanghai</s=
pan><br style=3D"color:rgb(0,0,0);font-family:tahoma,verdana,arial,helvetic=
a,sans-serif;font-size:14px"><blockquote
style=3D"color:rgb(0,0,0);font-fam=
ily:tahoma,verdana,arial,helvetica,sans-serif;font-size:14px;margin:0px 0px=
 0px 40px;border:none;padding:0px"></blockquote><span
style=3D"color:rgb(0,=
0,0);font-size:14px;font-family:courier">Te

Message of length 6140 truncated

Up to top level
AO15   AO16   AO17   AO18   AO19   Backgrounds   Calibration   Conference   Data   Docs   EPICMOS   EPICpn   Feedback   Gallery   Misc   OM   Pending   PhD_Theses   Publications   RGS   RadMonitor   SAS_Hardware   SAS_WS   SASv16.0   SASv16.0_Installation   SASv16.1   SASv16.1_Installation   SASv17.0   SASv17.0_Installation   SASv18.0   SASv18.0_Installation   SciSim   Simulators_other   Suggestions   Trash   Visibility   XMM-bouncing   XMM-news   XRPS   XSA   esas   incoming  

Logged in as guest


Please make your (short) question the subject of your request!


Web interface using JitterBug ... back to the XMM home page