I'm running IPT in Tomcat and experiencing PermGen memory errors.
From the Tomcat Manager, I can use "Find Leaks", and as suspected get:
"The following web applications were stopped (reloaded, undeployed), but their classes from previous runs are still loaded in memory, thus causing a memory leak (use a profiler to confirm): /ipt" http://frankkieviet.blogspot.ca/2006/10/classloader-leaks-dreaded-permgen-sp... does a pretty good job of explaining _why_ this happens. Unfortunately, I can't seem to find part two which is supposed to tell me how to go about fixing it. His blog also only deals with memory leaks on redeployment, but this is happening any time IPT is running for a while, so IPT is leaking in ordinary use, rather than just at context initialization. I'm going to try to find what's happening with a profiler, but I'm new to this... Tomcat Version 6.0.35 JVM Version Sun 1.6.0_24-b07 Linux 2.6.24-28-generic amd64 -- derek
Hi Derek, Thanks for taking the time to investigate this. Please know that the IPT uses Google Guice which has a known memory leak [ e.g. 1], but is not particularly critical, and we are all waiting for some time for it to be fixed in the next major release. You might find that this is the cause of the error report. There have been IPTs known to run for more than a year without issues, so I hope you don't find this to be critical to your deployment - if you find you are doing a lot of redeployments however, then perhaps it would become more problematic. HTH, Tim [1] http://code.google.com/p/google-guice/issues/detail?id=288 On Sep 5, 2012, at 5:02 PM, Derek Broughton wrote:
I'm running IPT in Tomcat and experiencing PermGen memory errors.
From the Tomcat Manager, I can use "Find Leaks", and as suspected get:
"The following web applications were stopped (reloaded, undeployed), but their classes from previous runs are still loaded in memory, thus causing a memory leak (use a profiler to confirm): /ipt"
http://frankkieviet.blogspot.ca/2006/10/classloader-leaks-dreaded-permgen-sp... does a pretty good job of explaining _why_ this happens. Unfortunately, I can't seem to find part two which is supposed to tell me how to go about fixing it. His blog also only deals with memory leaks on redeployment, but this is happening any time IPT is running for a while, so IPT is leaking in ordinary use, rather than just at context initialization.
I'm going to try to find what's happening with a profiler, but I'm new to this...
Tomcat Version 6.0.35 JVM Version Sun 1.6.0_24-b07 Linux 2.6.24-28-generic amd64 -- derek _______________________________________________ IPT mailing list IPT@lists.gbif.org http://lists.gbif.org/mailman/listinfo/ipt
On Thu, Sep 6, 2012 at 4:32 AM, Tim Robertson [GBIF] <trobertson@gbif.org> wrote:
Hi Derek,
Thanks for taking the time to investigate this.
Please know that the IPT uses Google Guice which has a known memory leak [ e.g. 1], but is not particularly critical, and we are all waiting for some time for it to be fixed in the next major release. You might find that this is the cause of the error report.
Well, if that's my problem it really _is_ critical, because it brings down my whole Tomcat after a few days.
There have been IPTs known to run for more than a year without issues, so I hope you don't find this to be critical to your deployment - if you find you are doing a lot of redeployments however, then perhaps it would become more problematic.
I've had this happening without doing _any_ redeployments. The redeployment just makes it possible to see that the leaks happened.
Thanks Derek for the info. What other apps have you got running on tomcat please? I mean, are you sure this is an IPT issue alone, in which case we will try and replicate your environment and profile? Cheers, Tim On Sep 6, 2012, at 2:59 PM, Derek Broughton wrote:
On Thu, Sep 6, 2012 at 4:32 AM, Tim Robertson [GBIF] <trobertson@gbif.org> wrote:
Hi Derek,
Thanks for taking the time to investigate this.
Please know that the IPT uses Google Guice which has a known memory leak [ e.g. 1], but is not particularly critical, and we are all waiting for some time for it to be fixed in the next major release. You might find that this is the cause of the error report.
Well, if that's my problem it really _is_ critical, because it brings down my whole Tomcat after a few days.
There have been IPTs known to run for more than a year without issues, so I hope you don't find this to be critical to your deployment - if you find you are doing a lot of redeployments however, then perhaps it would become more problematic.
I've had this happening without doing _any_ redeployments. The redeployment just makes it possible to see that the leaks happened. _______________________________________________ IPT mailing list IPT@lists.gbif.org http://lists.gbif.org/mailman/listinfo/ipt
I have two pure JSP apps (that is, there's absolutely no servlet code), and GeoServer. The JSP apps have been running for 5 years or more, Geoserver for at least 3, and I never had a memory issue until I tried to run IPT On Thu, Sep 6, 2012 at 10:16 AM, Tim Robertson [GBIF] <trobertson@gbif.org> wrote:
Thanks Derek for the info.
What other apps have you got running on tomcat please? I mean, are you sure this is an IPT issue alone, in which case we will try and replicate your environment and profile?
Cheers, Tim
On Sep 6, 2012, at 2:59 PM, Derek Broughton wrote:
On Thu, Sep 6, 2012 at 4:32 AM, Tim Robertson [GBIF] <trobertson@gbif.org> wrote:
Hi Derek,
Thanks for taking the time to investigate this.
Please know that the IPT uses Google Guice which has a known memory leak [ e.g. 1], but is not particularly critical, and we are all waiting for some time for it to be fixed in the next major release. You might find that this is the cause of the error report.
Well, if that's my problem it really _is_ critical, because it brings down my whole Tomcat after a few days.
There have been IPTs known to run for more than a year without issues, so I hope you don't find this to be critical to your deployment - if you find you are doing a lot of redeployments however, then perhaps it would become more problematic.
I've had this happening without doing _any_ redeployments. The redeployment just makes it possible to see that the leaks happened. _______________________________________________ IPT mailing list IPT@lists.gbif.org http://lists.gbif.org/mailman/listinfo/ipt
-- derek
Hi, I have just recently set up a brand new IPT and have been working with one test dataset. I have finally mapped my fields to the DwC and now would like to load a few more resources. All of the files being uploaded will be in OBIS format. Is there a way to copy over my mappings? Can I make a replicate of a resource and then simply change the underlying source data? I don't see how one can change the resourceName... the mapping exercise was tedious...(boring)and not something that I wish to do manually each time I have a new dataset. Any suggestions? Help! Mary Kennedy Ocean Data and Information Section Program Support and Coordination Division Science Branch | Direction des Sciences Maritimes Region | Région des Maritimes Fisheries and Oceans Canada |Pêches et Océans Canada 1 Challenger Drive, Dartmouth, Nova Scotia B2Y 4A2 Mary.Kennedy@dfo-mpo.gc.ca Telephone | Téléphone 902 407-8135 Facsimile | Télécopieur 902 426-1843 Government of Canada | Gouvernement du Canada
Hi Mary, you should be able to zip a resource folder in the IPTs data directory and upload that to create a new resource. There seems to be a bug though that is fixed already for the next release later this week: http://code.google.com/p/gbif-providertoolkit/issues/detail?id=538 Otherwise you should also be able to just manually copy a resource config folder in the filesystem while the IPT is not running. This should work at least for not yet registered resources. Once they are registered I would not recommend to do this. best, Markus -- Markus Döring Senior Developer ECAT GBIF Secretariat mdoering@gbif.org On 06.09.2012, at 17:34, Kennedy, Mary wrote:
Hi, I have just recently set up a brand new IPT and have been working with one test dataset. I have finally mapped my fields to the DwC and now would like to load a few more resources.
All of the files being uploaded will be in OBIS format. Is there a way to copy over my mappings? Can I make a replicate of a resource and then simply change the underlying source data? I don't see how one can change the resourceName... the mapping exercise was tedious...(boring)and not something that I wish to do manually each time I have a new dataset. Any suggestions?
Help!
Mary Kennedy
Ocean Data and Information Section Program Support and Coordination Division Science Branch | Direction des Sciences Maritimes Region | Région des Maritimes Fisheries and Oceans Canada |Pêches et Océans Canada 1 Challenger Drive, Dartmouth, Nova Scotia B2Y 4A2 Mary.Kennedy@dfo-mpo.gc.ca Telephone | Téléphone 902 407-8135 Facsimile | Télécopieur 902 426-1843
Government of Canada | Gouvernement du Canada _______________________________________________ IPT mailing list IPT@lists.gbif.org http://lists.gbif.org/mailman/listinfo/ipt
participants (4)
-
"Markus Döring (GBIF)" -
Derek Broughton -
Kennedy, Mary -
Tim Robertson [GBIF]