<!DOCTYPE html PUBLIC '-//W3C//DTD HTML 4.01 Transitional//EN'>
<html>
<head>
<meta http-equiv='Content-Type' content='text/html;charset=iso-8859-1'>
<style>BODY{font:10pt Tahoma, Verdana, sans-serif;}</style>
</head>
<body>
Hi Markus,<br><br>I already tried your suggestion to
add the JAVA_OPTS setting according to your previous suggestion to
Peter Desmet on February 5. I also tried to add this JAVA_OPTS to the
setenv.sh to my tomcat bin folder as suggested by Tim.<br><br>Digging a bit deeper I found that my Tomcat configured to start at boot time from a plist instruction (following <a href="http://www.malisphoto.com/tips/tomcatonosx.html%29" target="_blank" defaultcontextmenu="yes">http://www.malisphoto.com/tips/tomcatonosx.html)</a>.
This plist instruction does not start Tomcat from the catalina.sh
script, nor does this startup include the setenv.sh script (the plist
script was using Tomcat5.sh). I tried to start Tomcat from catalina.sh
instead and now both options of adding the JAVA_OPTS directly in the
catalina.sh or in the setenv.sh scripts works fine. Another option I
found with Google is to set JAVA_OPTS (and CATALINA_OPTS) in the
environment (eg. in .bask_profile).<br><br>I was getting a maximum
memory for tomcat of only 63.56 MB, now I get the 1 GB (1016.12 MB) as
you suggests - and both the IPT and the Geoserver now starts and
persists very fine! I may still sometimes get the Yikes memory error
when I also have the PostgreSQL database running, but everything
generally flows excellent now. Thanks!!<br><br>Trying the SQL data
source Upload again I still get the same problem. "Upload in Progress -
Source ready to be used", but no records indexed. I have limited the
results to 165 records and I have verified the SQL statement to be
valid from the PostgreSQL database promt. But no records gets cached
(not visible from IPT menu Explore). I use the very same SQL statement
to generate the tab delimited text file as dataset source for the IPT.
When using the text file import, automapping works fine (I am using
lowercase DarwinCore terms as descriptors), but when using the SQL data
source, there is no automapping...?<br><br>Looking in the PostgreSQL log I find:<br> LOG: unexpected EOF on client connection<br><br>Thanks!!<br>Dag Terje<br><br><blockquote style="border-left: 2px solid rgb(0, 0, 255); padding-left: 5px; margin-left: 5px; margin-right: 0px;"><hr><b>From:</b> "Markus Döring (GBIF)" [mailto:mdoering@gbif.org]<br><b>To:</b> Dag Terje Filip Endresen [mailto:dag.endresen@nordgen.org]<br><b>Cc:</b> ipt@lists.gbif.org<br><b>Sent:</b> Fri, 27 Feb 2009 20:44:13 +0100<br><b>Subject:</b> Re: [IPT] Beta update<br><br>Dag,<div>thanks for those reports. The SQL import has been neglected for a while, I will try my best next week.</div><div>Regarding memory your macbook with 2gb should be more than fine. All tomcats I have used so far were configured to use no more than 1gb. Did you increase tomcats default memory size? It is very little by default, so increasing to 1gb is sometimes needed. If you run jetty via maven you can do the following to allow java to use up to 1gb of memory:</div><div><br></div><div><div>export MAVEN_OPTS='-Xmx1024m'</div><div><br></div><div>for tomcat edit the catalina.sh and add:</div><div><span class="Apple-style-span" style="font-family: Tahoma; font-size: 15px;"><pre style="font-size: 80%; font-family: 'Courier New',Courier,monospace;">JAVA_OPTS="-Xms512M -Xmx1024M"</pre></span></div></div><div><br></div><div>I have just finished implementing file upload for zip archives. So for those of you using the subversion trunk version locally you should be able to upload 100MB of zipped data.</div><div>And thanks to Javi there are also much nicer maps now instead of openlayers... more soon.</div><div><br></div><div>Markus</div><div><br></div><div><br></div><div><br></div><div><br></div><div><div><div>On Feb 27, 2009, at 1:33 PM, Dag Terje Filip Endresen wrote:</div><br class="Apple-interchange-newline"><blockquote type="cite"><span class="Apple-style-span" style="border-collapse: separate; color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: 2; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px;"><div style="font-family: Tahoma,Verdana,sans-serif; font-style: normal; font-variant: normal; font-weight: normal; font-size: 10pt; line-height: normal; font-size-adjust: none; font-stretch: normal; -x-system-font: none;">Hi Markus,<br><br>Saving the SQL settings from the IPT GUI, I only get the Yikes error message when trying to (both ipt-1.0b.3 and ipt.1.0b.5). But the settings seems to be saved ok when I revisit the Source data settings! Next I may successfully use the Resource Configuration to give the SQL statement and the property mappings. In the property mappings I can see genuine data from my database with the "view source" button. Next step is Cache - and does not work. I get relatively fast to the message "Source ready to be used.", but no data is actually to be seen from Explore - and the Validate button is still gray.<br><br>Automapping works for uploaded tab-delimited dataset, but not for the SQL statement (using SELECT column AS dwc_term).<br><br>I have tried with both ipt-1.ob.3 and ipt-1.0b.5 (built with Maven from the SVN version at Google Code).<br>My system is: a MacBook OS X version 10.5.6 (Leopard), Tomcat version 6.0.18 (and version 5.5.27 briefly tested), JVM version 1.5.0, Apache 2.2.11 with mod_jk version 1.2.27 (briefly tested, works fine).<br><br>When adding dataset from tab-delimited file, I leave empty values empty (just going ahead with the next tab (double tab). It seems to me like the IPT treats these as if one tab shifting the coulmns to the left...?<br><br>I also have severe problems with memory! My poor MacBook have only 2 GB and the IPT very often flips very very slow and takes a lot of time before it comes back to responding again. I do not at all manage to load the Geoserver application due to memory. I know I have too little memory and have been stretching the few 2 GB the MacBook came with too long already.<br><br>I often see the OutOfMemoryError in a Yikes page.<br><pre>Caused by: java.lang.OutOfMemoryError: Java heap space<br></pre>Cheers<br>Dag Terje<br><br>PS. Great application - if oly it could be a bit less memory hungry...?<br><br><blockquote style="border-left: 2px solid rgb(0, 0, 255); padding-left: 5px; margin-left: 5px; margin-right: 0px;"><hr><b>From:</b><span class="Apple-converted-space"> </span>"Markus Döring (GBIF)" [<a href="mailto:mdoering@gbif.org">mailto:mdoering@gbif.org</a>]<br><b>To:</b><span class="Apple-converted-space"> </span>Tim Robertson (GBIF) [<a href="mailto:trobertson@gbif.org">mailto:trobertson@gbif.org</a>]<br><b>Cc:</b><span class="Apple-converted-space"> </span>Mihail-Constantin Carausu [<a href="mailto:MCCarausu@snm.ku.dk">mailto:MCCarausu@snm.ku.dk</a>],<span class="Apple-converted-space"> </span><a href="mailto:ipt@lists.gbif.org">ipt@lists.gbif.org</a><br><b>Sent:</b><span class="Apple-converted-space"> </span>Fri, 27 Feb 2009 10:36:11 +0100<br><b>Subject:</b><span class="Apple-converted-space"> </span>Re: [IPT] Beta update<br><br>it would also be nice if someone could test the SQL based upload,<span class="Apple-converted-space"> </span><br>which requires a local installation.<br>If there is help needed with the installation, just post to this list<span class="Apple-converted-space"> </span><br>please.<br><br>Markus<br><br><br></blockquote></div></span></blockquote></div><br></div></blockquote><style>
* {word-wrap:break-word;-webkit-nbsp-mode:space;-webkit-line-break:after-white-space;;}
</style>
</body></html>