Up to top level
AO15   AO16   AO17   AO18   AO19   Backgrounds   Calibration   Conference   Data   Docs   EPICMOS   EPICpn   Feedback   Gallery   Misc   OM   Pending   PhD_Theses   Publications   RGS   RadMonitor   SAS_Hardware   SAS_WS   SASv16.0   SASv16.0_Installation   SASv16.1   SASv16.1_Installation   SASv17.0   SASv17.0_Installation   SASv18.0   SASv18.0_Installation   SciSim   Simulators_other   Suggestions   Trash   Visibility   XMM-bouncing   XMM-news   XRPS   XSA   esas   incoming  

Logged in as guest

Viewing Pending/85513
Full headers

From: eosullivan@cfa.harvard.edu
Subject: FITSIO error in asmooth
Compose reply
Download message
Move To:
2 replies: 1 2
2 followups: 1 2

Private message: yes  no

Notes:

Notification:


Date: Fri, 2 Aug 2019 02:23:05 +0200
From: eosullivan@cfa.harvard.edu
To: xmmhelp@sciops.esa.int
Subject: FITSIO error in asmooth
Full_Name: Ewan O'Sullivan
Submission from: (NULL) (193.147.152.102)


Hi,

I'm running into a strange error using asmooth. I'm attempting to smooth a
mosaiced image, using a command of the form:

asmooth -V 3 -w 3 inset=mos12pn_mosaic_im_300_7000.fits
outset=mos12pn_mosaic_smooth_300_7000.fits smoothstyle=adaptive nconvolvers=20
minwidth=1.0 maxwidth=10.0 widthliststyle=linear desiredsnr=10 withweightset=Y
weightset=mos12pn_mosaic_exp_300_7000.fits withoutmaskset=Y
outmaskset=mos12pn_mosaic_msk_300_7000.fits withexpimageset=Y
expimageset=mos12pn_mosaic_exp_300_7000.fits expmapuse=samesnr remultiply=no
writevarianceset=Y outvarianceset=mos12pn_smooth_variance.fits
writetemplateset=Y outtemplateset=mos12pn_smooth_template.fits

this results in an error:

** asmooth: error (FITSIO), FITS error 402 while accessing file
'mos12pn_smooth_variance.fits': bad float to string conversion
Error in ffd2e: double value is a NaN or INDEF

The error does not occur if I set writevarianceset=N or withoutmaskset=N,
suggesting something is going wrong during the creation of the variance image.
So far as I can see there are no NaNs in the input files.

Weirdly, if I set -V 9 -w 9, thes task will run to completion and create the
variance image with no errors!

I get the same error with SAS 17 and 18, running on a Centos 7 machine.

Any suggestions much appreciated! I can provide the input files if that would
help.

anan%2 D0DA%A%%0%0wawan


Reply 1

Resend
From: Jan-Uwe Ness <xmmhelp@sciops.esa.int>
To: eosullivan@cfa.harvard.edu
Subject: Re: FITSIO error in asmooth (PR#85513)
Date: Fri Aug  2 12:06:37 2019
Dear Ewan O'Sullivan,

 this looks like a memory problem that may be very hard to spot. It seems you
have a workaround to get data you can work with, but we need to investigate it.
Can you send us all the input files so we can start reproducing the problem. It
will take some time, though.

Thanks,
Jan-Uwe


> 
> Hi,
> 
> I'm running into a strange error using asmooth. I'm attempting to smooth a
> mosaiced image, using a command of the form:
> 
> asmooth -V 3 -w 3 inset=mos12pn_mosaic_im_300_7000.fits
> outset=mos12pn_mosaic_smooth_300_7000.fits smoothstyle=adaptive
nconvolvers=20
> minwidth=1.0 maxwidth=10.0 widthliststyle=linear desiredsnr=10
withweightset=Y
> weightset=mos12pn_mosaic_exp_300_7000.fits withoutmaskset=Y
> outmaskset=mos12pn_mosaic_msk_300_7000.fits withexpimageset=Y
> expimageset=mos12pn_mosaic_exp_300_7000.fits expmapuse=samesnr
remultiply=no
> writevarianceset=Y outvarianceset=mos12pn_smooth_variance.fits
> writetemplateset=Y outtemplateset=mos12pn_smooth_template.fits
> 
> this results in an error:
> 
> ** asmooth: error (FITSIO), FITS error 402 while accessing file
> 'mos12pn_smooth_variance.fits': bad float to string conversion
> Error in ffd2e: double value is a NaN or INDEF
> 
> The error does not occur if I set writevarianceset=N or withoutmaskset=N,
> suggesting something is going wrong during the creation of the variance
image.
> So far as I can see there are no NaNs in the input files.
> 
> Weirdly, if I set -V 9 -w 9, thes task will run to completion and create
the
> variance image with no errors!
> 
> I get the same error with SAS 17 and 18, running on a Centos 7 machine.
> 
> Any suggestions much appreciated! I can provide the input files if that
would
> help.
> 
> anan%2 D0DA%A%%0%0wawan
> 
> 


Followup 1

Compose reply
Download message
From: "O'Sullivan, Ewan" <eosullivan@cfa.harvard.edu>
Date: Fri, 2 Aug 2019 08:47:56 -0400
Subject: Re: FITSIO error in asmooth (PR#85513)
To: Jan-Uwe Ness <xmmhelp@sciops.esa.int>
--0000000000002bfba6058f21c5e5
Content-Type: text/plain; charset="UTF-8"

Hi,

The files should now be visible on our ftp site at:

ftp://sao-ftp.harvard.edu/ejos

Filenames are:
mos12pn_mosaic_exp_300_7000.fits
mos12pn_mosaic_im_300_7000.fits
mos12pn_mosaic_msk_300_7000.fits

Thanks,

Ewan

On Fri, Aug 2, 2019 at 6:06 AM Jan-Uwe Ness <xmmhelp@sciops.esa.int>
wrote:

> Dear Ewan O'Sullivan,
>
>  this looks like a memory problem that may be very hard to spot. It seems
> you
> have a workaround to get data you can work with, but we need to
> investigate it.
> Can you send us all the input files so we can start reproducing the
> problem. It
> will take some time, though.
>
> Thanks,
> Jan-Uwe
>
>
> >
> > Hi,
> >
> > I'm running into a strange error using asmooth. I'm attempting to
smooth
> a
> > mosaiced image, using a command of the form:
> >
> > asmooth -V 3 -w 3 inset=mos12pn_mosaic_im_300_7000.fits
> > outset=mos12pn_mosaic_smooth_300_7000.fits smoothstyle=adaptive
> nconvolvers=20
> > minwidth=1.0 maxwidth=10.0 widthliststyle=linear desiredsnr=10
> withweightset=Y
> > weightset=mos12pn_mosaic_exp_300_7000.fits withoutmaskset=Y
> > outmaskset=mos12pn_mosaic_msk_300_7000.fits withexpimageset=Y
> > expimageset=mos12pn_mosaic_exp_300_7000.fits expmapuse=samesnr
> remultiply=no
> > writevarianceset=Y outvarianceset=mos12pn_smooth_variance.fits
> > writetemplateset=Y outtemplateset=mos12pn_smooth_template.fits
> >
> > this results in an error:
> >
> > ** asmooth: error (FITSIO), FITS error 402 while accessing file
> > 'mos12pn_smooth_variance.fits': bad float to string conversion
> > Error in ffd2e: double value is a NaN or INDEF
> >
> > The error does not occur if I set writevarianceset=N or
withoutmaskset=N,
> > suggesting something is going wrong during the creation of the
variance
> image.
> > So far as I can see there are no NaNs in the input files.
> >
> > Weirdly, if I set -V 9 -w 9, thes task will run to completion and
create
> the
> > variance image with no errors!
> >
> > I get the same error with SAS 17 and 18, running on a Centos 7
machine.
> >
> > Any suggestions much appreciated! I can provide the input files if
that
> would
> > help.
> >
> > anan%2 D0DA%A%%0%0wawan
> >
> >
>
> This message is intended only for the recipient(s) named above. It may
> contain proprietary information and/or
> protected content. Any unauthorised disclosure, use, retention or
> dissemination is prohibited. If you have received
> this e-mail in error, please notify the sender immediately. ESA applies
> appropriate organisational measures to protect
> personal data, in case of data privacy queries, please contact the ESA
> Data Protection Officer (dpo@esa.int).
>
>
>

--0000000000002bfba6058f21c5e5
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr"><div>Hi,</div><div><br></div>The
files should now be visib=
le on our ftp site at:<br><br><div><a
href=3D"ftp://sao-ftp.harvard.edu/ejo=
s">ftp://sao-ftp.harvard.edu/ejos</a></div><div><br></div><div>Filenames
ar=
e:</div><div>mos12pn_mosaic_exp_300_7000.fits<br>mos12pn_mosaic_im_300_7000=
.fits<br>mos12pn_mosaic_msk_300_7000.fits</div><div><br></div><div>Thanks,<=
/div><div><br></div><div>Ewan<br></div></div><br><div
class=3D"gmail_quote"=
><div dir=3D"ltr" class=3D"gmail_attr">On Fri, Aug 2, 2019 at 6:06 AM
Jan-U=
we Ness &lt;<a
href=3D"mailto:xmmhelp@sciops.esa.int">xmmhelp@sciops.esa.in=
t</a>&gt; wrote:<br></div><blockquote
class=3D"gmail_quote" style=3D"margin=
:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"=
>Dear Ewan O&#39;Sullivan,<br>
<br>
=C2=A0this looks like a memory problem that may be very hard to spot. It se=
ems you<br>
have a workaround to get data you can work with, but we need to investigate=
 it.<br>
Can you send us all the input files so we can start reproducing the problem=
. It<br>
will take some time, though.<br>
<br>
Thanks,<br>
Jan-Uwe<br>
<br>
<br>
&gt; <br>
&gt; Hi,<br>
&gt; <br>
&gt; I&#39;m running into a strange error using asmooth. I&#39;m
attempting=
 to smooth a<br>
&gt; mosaiced image, using a command of the form:<br>
&gt; <br>
&gt; asmooth -V 3 -w 3 inset=3Dmos12pn_mosaic_im_300_7000.fits<br>
&gt; outset=3Dmos12pn_mosaic_smooth_300_7000.fits
smooth

Message of length 7458 truncated


Reply 2

Resend
From: Jan-Uwe Ness <xmmhelp@sciops.esa.int>
To: eosullivan@cfa.harvard.edu
Subject: Re: FITSIO error in asmooth (PR#85513)
Date: Fri Aug  2 15:03:25 2019
Hi,

 it seems I cannot access this directory:

 ftp sao-ftp.harvard.edu

ftp> ls
227 Entering Passive Mode (131,142,18,11,61,4).
150 Here comes the directory listing.
drwxr-xr-x    5 10580    50           4096 Apr 16 15:05 AtomDB
drwxrwxr-x    3 20306    50           4096 Jul 24 04:10 Einstein
drwx------    2 0        0            4096 Apr 15  2016 HOLD
drwxr-xr-x    3 32001    20           4096 Aug 02 12:00 IRIS_SolarSoft
-rw-r--r--    1 14       50            671 Apr 15  2016 README
drwxr-xr-x    3 1003     20           4096 Aug 02 07:00 XRT_SolarSoft
dr-xr-xr-x   15 20124    50           4096 Jul 14  2015 jcm
lrwxrwxrwx    1 0        0               1 Jul 14  2015 pub -> .
dr-xr-sr-x   11 20352    50           4096 Jul 14  2015 rd
drwxrwxr-x    4 14       50          20480 Aug 02 12:43 transfer
drwxrwxr-x    2 20444    50           4096 Jun 04 13:40 zetapup
226 Directory send OK.

I don't see a directory ejos.

Thanks,
Jan-Uwe

> Hi,
> 
> The files should now be visible on our ftp site at:
> 
> ftp://sao-ftp.harvard.edu/ejos
> 
> Filenames are:
> mos12pn_mosaic_exp_300_7000.fits
> mos12pn_mosaic_im_300_7000.fits
> mos12pn_mosaic_msk_300_7000.fits
> 
> Thanks,
> 
> Ewan
> 
> On Fri, Aug 2, 2019 at 6:06 AM Jan-Uwe Ness <xmmhelp@sciops.esa.int>
wrote:
> 
>> Dear Ewan O'Sullivan,
>>
>>  this looks like a memory problem that may be very hard to spot. It
seems
>> you
>> have a workaround to get data you can work with, but we need to
>> investigate it.
>> Can you send us all the input files so we can start reproducing the
>> problem. It
>> will take some time, though.
>>
>> Thanks,
>> Jan-Uwe
>>
>>
>> >
>> > Hi,
>> >
>> > I'm running into a strange error using asmooth. I'm attempting to
smooth
>> a
>> > mosaiced image, using a command of the form:
>> >
>> > asmooth -V 3 -w 3 inset=mos12pn_mosaic_im_300_7000.fits
>> > outset=mos12pn_mosaic_smooth_300_7000.fits smoothstyle=adaptive
>> nconvolvers=20
>> > minwidth=1.0 maxwidth=10.0 widthliststyle=linear desiredsnr=10
>> withweightset=Y
>> > weightset=mos12pn_mosaic_exp_300_7000.fits withoutmaskset=Y
>> > outmaskset=mos12pn_mosaic_msk_300_7000.fits withexpimageset=Y
>> > expimageset=mos12pn_mosaic_exp_300_7000.fits expmapuse=samesnr
>> remultiply=no
>> > writevarianceset=Y outvarianceset=mos12pn_smooth_variance.fits
>> > writetemplateset=Y outtemplateset=mos12pn_smooth_template.fits
>> >
>> > this results in an error:
>> >
>> > ** asmooth: error (FITSIO), FITS error 402 while accessing file
>> > 'mos12pn_smooth_variance.fits': bad float to string conversion
>> > Error in ffd2e: double value is a NaN or INDEF
>> >
>> > The error does not occur if I set writevarianceset=N or
withoutmaskset=N,
>> > suggesting something is going wrong during the creation of the
variance
>> image.
>> > So far as I can see there are no NaNs in the input files.
>> >
>> > Weirdly, if I set -V 9 -w 9, thes task will run to completion and
create
>> the
>> > variance image with no errors!
>> >
>> > I get the same error with SAS 17 and 18, running on a Centos 7
machine.
>> >
>> > Any suggestions much appreciated! I can provide the input files if
that
>> would
>> > help.
>> >
>> > anan%2 D0DA%A%%0%0wawan
>> >
>> >
>>
>> This message is intended only for the recipient(s) named above. It may
>> contain proprietary information and/or
>> protected content. Any unauthorised disclosure, use, retention or
>> dissemination is prohibited. If you have received
>> this e-mail in error, please notify the sender immediately. ESA
applies
>> appropriate organisational measures to protect
>> personal data, in case of data privacy queries, please contact the ESA
>> Data Protection Officer (dpo@esa.int).
>>
>>
>>
> 
> --0000000000002bfba6058f21c5e5
> Content-Type: text/html; charset="UTF-8"
> Content-Transfer-Encoding: quoted-printable
> 
> <div dir=3D"ltr"><div>Hi,</div><div><br></div>The
files should now be visib=
> le on our ftp site at:<br><br><div><a
href=3D"ftp://sao-ftp.harvard.edu/ejo=
> s">ftp://sao-ftp.harvard.edu/ejos</a></div><div><br></div><div>Filenames
ar=
> e:</div><div>mos12pn_mosaic_exp_300_7000.fits<br>mos12pn_mosaic_im_300_7000=
> .fits<br>mos12pn_mos

Message of length 9184 truncated


Followup 2

Compose reply
Download message
From: "O'Sullivan, Ewan" <eosullivan@cfa.harvard.edu>
Date: Fri, 2 Aug 2019 09:04:07 -0400
Subject: Re: FITSIO error in asmooth (PR#85513)
To: Jan-Uwe Ness <xmmhelp@sciops.esa.int>
--00000000000011801a058f21ffc9
Content-Type: text/plain; charset="UTF-8"

Sorry, try the directory /pub/transfer/ejos/

On Fri, Aug 2, 2019 at 9:03 AM Jan-Uwe Ness <xmmhelp@sciops.esa.int>
wrote:

> Hi,
>
>  it seems I cannot access this directory:
>
>  ftp sao-ftp.harvard.edu
>
> ftp> ls
> 227 Entering Passive Mode (131,142,18,11,61,4).
> 150 Here comes the directory listing.
> drwxr-xr-x    5 10580    50           4096 Apr 16 15:05 AtomDB
> drwxrwxr-x    3 20306    50           4096 Jul 24 04:10 Einstein
> drwx------    2 0        0            4096 Apr 15  2016 HOLD
> drwxr-xr-x    3 32001    20           4096 Aug 02 12:00 IRIS_SolarSoft
> -rw-r--r--    1 14       50            671 Apr 15  2016 README
> drwxr-xr-x    3 1003     20           4096 Aug 02 07:00 XRT_SolarSoft
> dr-xr-xr-x   15 20124    50           4096 Jul 14  2015 jcm
> lrwxrwxrwx    1 0        0               1 Jul 14  2015 pub -> .
> dr-xr-sr-x   11 20352    50           4096 Jul 14  2015 rd
> drwxrwxr-x    4 14       50          20480 Aug 02 12:43 transfer
> drwxrwxr-x    2 20444    50           4096 Jun 04 13:40 zetapup
> 226 Directory send OK.
>
> I don't see a directory ejos.
>
> Thanks,
> Jan-Uwe
>
> > Hi,
> >
> > The files should now be visible on our ftp site at:
> >
> > ftp://sao-ftp.harvard.edu/ejos
> >
> > Filenames are:
> > mos12pn_mosaic_exp_300_7000.fits
> > mos12pn_mosaic_im_300_7000.fits
> > mos12pn_mosaic_msk_300_7000.fits
> >
> > Thanks,
> >
> > Ewan
> >
> > On Fri, Aug 2, 2019 at 6:06 AM Jan-Uwe Ness
<xmmhelp@sciops.esa.int>
> wrote:
> >
> >> Dear Ewan O'Sullivan,
> >>
> >>  this looks like a memory problem that may be very hard to spot.
It
> seems
> >> you
> >> have a workaround to get data you can work with, but we need to
> >> investigate it.
> >> Can you send us all the input files so we can start reproducing
the
> >> problem. It
> >> will take some time, though.
> >>
> >> Thanks,
> >> Jan-Uwe
> >>
> >>
> >> >
> >> > Hi,
> >> >
> >> > I'm running into a strange error using asmooth. I'm
attempting to
> smooth
> >> a
> >> > mosaiced image, using a command of the form:
> >> >
> >> > asmooth -V 3 -w 3 inset=mos12pn_mosaic_im_300_7000.fits
> >> > outset=mos12pn_mosaic_smooth_300_7000.fits
smoothstyle=adaptive
> >> nconvolvers=20
> >> > minwidth=1.0 maxwidth=10.0 widthliststyle=linear
desiredsnr=10
> >> withweightset=Y
> >> > weightset=mos12pn_mosaic_exp_300_7000.fits withoutmaskset=Y
> >> > outmaskset=mos12pn_mosaic_msk_300_7000.fits withexpimageset=Y
> >> > expimageset=mos12pn_mosaic_exp_300_7000.fits
expmapuse=samesnr
> >> remultiply=no
> >> > writevarianceset=Y
outvarianceset=mos12pn_smooth_variance.fits
> >> > writetemplateset=Y
outtemplateset=mos12pn_smooth_template.fits
> >> >
> >> > this results in an error:
> >> >
> >> > ** asmooth: error (FITSIO), FITS error 402 while accessing
file
> >> > 'mos12pn_smooth_variance.fits': bad float to string
conversion
> >> > Error in ffd2e: double value is a NaN or INDEF
> >> >
> >> > The error does not occur if I set writevarianceset=N or
> withoutmaskset=N,
> >> > suggesting something is going wrong during the creation of
the
> variance
> >> image.
> >> > So far as I can see there are no NaNs in the input files.
> >> >
> >> > Weirdly, if I set -V 9 -w 9, thes task will run to completion
and
> create
> >> the
> >> > variance image with no errors!
> >> >
> >> > I get the same error with SAS 17 and 18, running on a Centos
7
> machine.
> >> >
> >> > Any suggestions much appreciated! I can provide the input
files if
> that
> >> would
> >> > help.
> >> >
> >> > anan%2 D0DA%A%%0%0wawan
> >> >
> >> >
> >>
> >> This message is intended only for the recipient(s) named above. It
may
> >> contain proprietary information and/or
> >> protected content. Any unauthorised disclosure, use, retention or
> >> dissemination is prohibited. If you have received
> >> this e-mail in error, please notify the sender immediately. ESA
applies
> >> appropriate organisational measures to protect
> >> personal data, in case of data privacy queries, please contact the
ESA
> >> Data Protection Officer 

Message of length 27394 truncated

Up to top level
AO15   AO16   AO17   AO18   AO19   Backgrounds   Calibration   Conference   Data   Docs   EPICMOS   EPICpn   Feedback   Gallery   Misc   OM   Pending   PhD_Theses   Publications   RGS   RadMonitor   SAS_Hardware   SAS_WS   SASv16.0   SASv16.0_Installation   SASv16.1   SASv16.1_Installation   SASv17.0   SASv17.0_Installation   SASv18.0   SASv18.0_Installation   SciSim   Simulators_other   Suggestions   Trash   Visibility   XMM-bouncing   XMM-news   XRPS   XSA   esas   incoming  

Logged in as guest


Please make your (short) question the subject of your request!


Web interface using JitterBug ... back to the XMM home page