- IPT - lists.gbif.org

Re: [IPT] Beta update
by Holetschek, Jörg 05 Mar '09

05 Mar '09

Hi Markus, I already setup our our google maps api. The domains are not also setup correctly (see screenshot). http://de.mirror.gbif.org:8080/ipt Anything else I can try? Jörg -----Ursprüngliche Nachricht----- Von: "Markus Döring (GBIF)" [mailto:mdoering@gbif.org] Gesendet: Donnerstag, 5. März 2009 11:46 An: Holetschek, Jörg Cc: Tim Robertson (GBIF); ipt(a)lists.gbif.org; Kelbert, Patricia Betreff: Re: AW: AW: AW: AW: [IPT] Beta update Jörg, this seems to be a local IP address, doesnt work from here. For the maps to work you need to make sure the IPT & geoserver host domains are all correctly configured in the settings. If they use localhost you can only access them from that very machine. when looking at http://de.mirror.gbif.org/ipt/resources.html this seems to work. you just have to use your google maps api key for de.mirror.gbif.org to get rid of the map error message. Markus On Mar 5, 2009, at 11:40, Holetschek, Jörg wrote: > Hi Markus, > > thanks... looks better this time... but no maps yet: > http://192.168.2.251:8080/ipt/resources.html > > Attached the log with some error messages at the end... > > > Cheers, > Jörg > > -----Ursprüngliche Nachricht----- > Von: "Markus Döring (GBIF)" [mailto:mdoering@gbif.org] > Gesendet: Mittwoch, 4. März 2009 18:00 > An: Holetschek, Jörg > Cc: Tim Robertson (GBIF); ipt(a)lists.gbif.org; Kelbert, Patricia > Betreff: Re: AW: AW: AW: [IPT] Beta update > > > Jörg, > I have just uploaded a new ipt version 1.0b.7. Would you mind to > replace your existing one with this, including geoserver? > Especially the geoserver plugin is updated to do taxonomic and > regional nested searches for occurrences in maps. Also for > configuration there shouuld not be the need anymore to visit the > geoserver UI. From within the IPT admin configuration you can now > update the geoserver settings, which writes the current IPT data > directory into geoservers config files. > > As before IPT and the geoserver bundle are preconfigured to work when > dropped into tomcat on port 8080. > > http://code.google.com/p/gbif-providertoolkit/downloads/list?can=3&q=&colsp… > > Markus > > > > On Mar 4, 2009, at 11:41, Holetschek, Jörg wrote: > >> Hi Markus, >> >> I've set the data directory in the geoserver configuration (see >> screenshot), but to no avail :/ >> >> After restarting tomcat, the IPT application didn't work anymore - >> like yesterday. And in case it will work in an hour or so (like >> yesterday), there's a lot of errors in the log - is that still a >> configuration problem? I've set the path to the IPT data folder in >> geoserver, that shouldn't be the problem anymore... >> >> Jörg >> >> -----Ursprüngliche Nachricht----- >> Von: "Markus Döring (GBIF)" [mailto:mdoering@gbif.org] >> Gesendet: Dienstag, 3. März 2009 20:45 >> An: Holetschek, Jörg >> Cc: Tim Robertson (GBIF); ipt(a)lists.gbif.org >> Betreff: Re: AW: AW: [IPT] Beta update >> >> >> this looks like a configuration problem. It cant find the IPTs H2 >> database. >> Ive seen that in your installation geoserver doesnt automatically >> find >> the IPT data directory. >> You need to set the IPT data directory manually in the geoserver >> config interface config->data->IPT datasource >> use the full absolute file path to your data dir, by default >> PATH_TO_TOMCAT/webapps/ipt/data >> >> Markus >> >> >> On Mar 3, 2009, at 18:25, Holetschek, Jörg wrote: >> >>> Hmm... I didn't change anything! But I like that sort of magic... >>> just wait until it works :) >>> >>> Just found out one of the menu entries doesn't work... is this a >>> problem of our installation? >>> http://de.mirror.gbif.org/ipt/admin/activeDatasources.html >>> >>> The maps do not get rendered by geoserver correctly, I found a "bad >>> SQL grammar" error in the log (see attachement). Is this a bug or a >>> configuration problem? >>> >>> >>> Cheers from Berlin, >>> Jörg >>> >>> -----Ursprüngliche Nachricht----- >>> Von: "Markus Döring (GBIF)" [mailto:mdoering@gbif.org] >>> Gesendet: Dienstag, 3. März 2009 15:45 >>> An: Holetschek, Jörg >>> Cc: Tim Robertson (GBIF); ipt(a)lists.gbif.org >>> Betreff: Re: AW: [IPT] Beta update >>> >>> >>> hmm, there are a couple of errors in the log, but the site seems to >>> work fine: >>> http://de.mirror.gbif.org/ipt >>> >>> apart from the geoserver maps, I have to admit. >>> I have changed your IPT & Geoserver settings to reflect the domain >>> de.mirror.gbif.org, but that didnt solve the problem. >>> As I have completely replaced the openlayers maps with flash based >>> google maps in the latest trunk, do you mind to test the latest >>> version? >>> >>> I will upload a 1.0b.6 war in a few minutes. >>> thanks for trying, Jörg. >>> Markus >>> >>> >>> >>> >>> On Mar 3, 2009, at 13:10, Holetschek, Jörg wrote: >>> >>>> sorry.. little bit scatterbrained today! >>>> here are the logs... >>>> >>>> -----Ursprüngliche Nachricht----- >>>> Von: Holetschek, Jörg >>>> Gesendet: Dienstag, 3. März 2009 13:04 >>>> An: '"Markus Döring (GBIF)"'; Tim Robertson (GBIF) >>>> Cc: ipt(a)lists.gbif.org; Kelbert, Patricia; Roepert, Dominik >>>> Betreff: AW: [IPT] Beta update >>>> >>>> >>>> Hi Markus, >>>> >>>> I'm trying to install the latest IPT on our server. It worked fine, >>>> but after installing the geoserveer application, th IPT doesn't >>>> work >>>> anymore :/ >>>> >>>> Attached the logs... do you have an idea? >>>> Using Tomcat 6.0.16 on Red Hat 3.4.3-22. >>>> >>>> >>>> Cheers, >>>> Jörg >>>> >>>> -----Ursprüngliche Nachricht----- >>>> Von: ipt-bounces(a)lists.gbif.org [mailto:ipt- >>>> bounces(a)lists.gbif.org]Im >>>> Auftrag von "Markus Döring (GBIF)" >>>> Gesendet: Freitag, 27. Februar 2009 10:36 >>>> An: Tim Robertson (GBIF) >>>> Cc: Mihail-Constantin Carausu; ipt(a)lists.gbif.org >>>> Betreff: Re: [IPT] Beta update >>>> >>>> >>>> it would also be nice if someone could test the SQL based upload, >>>> which requires a local installation. >>>> If there is help needed with the installation, just post to this >>>> list >>>> please. >>>> >>>> Markus >>>> >>>> >>>> On Feb 26, 2009, at 8:59 PM, Tim Robertson (GBIF) wrote: >>>> >>>>> Thank you very much. >>>>> >>>>> I suggest starting with 0.5million, and then 1 million and then 3 >>>>> million. >>>>> I will be surprised if this works without some bug fixing. >>>>> >>>>> You may just use http://ipt.gbif.org rather than installation. >>>>> >>>>> Thanks Mihail, help with tests like this is greatly appreciated. >>>>> >>>>> Tim >>>>> >>>>> >>>>>> Dear Tim >>>>>> >>>>>> I can volunteer for uploading up to 3 million records if you >>>>>> want. >>>>>> The >>>>>> only problem is I have not installed yet the IPT software on our >>>>>> servers >>>>>> (sorry) because I didn't get the time, yet. But I will definitely >>>>>> try to >>>>>> do the installation tomorrow and the upload too. >>>>>> >>>>>> Best wishes >>>>>> Mihail >>>>>> >>>>>> ---------------------------- >>>>>> Mihail Carausu >>>>>> MSc.Eng., Informatics Manager >>>>>> Danish Biodiversity Information Facility (DanBIF) >>>>>> c/o Zoological Museum >>>>>> University of Copenhagen >>>>>> Universitetsparken 15 >>>>>> DK-2100 Copenhagen Ø >>>>>> >>>>>> Tel.: (+45) 3532 1063 >>>>>> Mobil:(+45) 2618 3636 >>>>>> email:mccarausu@zmuc.ku.dk >>>>>> web: http://www.DanBIF.dk >>>>>> ....oooO.............. >>>>>> ....(....)....Oooo.... >>>>>> .....)../. ...(....)... >>>>>> .....(_/.......)../...... >>>>>> .............. (_/....... >>>>>> -------------------------------------------- >>>>>> >>>>>> >>>>>> -----Original Message----- >>>>>> From: ipt-bounces(a)lists.gbif.org [mailto:ipt- >>>>>> bounces(a)lists.gbif.org] On >>>>>> Behalf Of Tim Robertson >>>>>> Sent: 26. februar 2009 16:26 >>>>>> To: ipt(a)lists.gbif.org >>>>>> Subject: [IPT] Beta update >>>>>> >>>>>> Dear All, >>>>>> >>>>>> A new version has just been deployed, and all user accounts have >>>>>> been >>>>>> kept intact, but you will notice significant changes, and we hope >>>>>> improvements. >>>>>> Please use the http://code.google.com/p/gbif-providertoolkit/ >>>>>> issues/ >>>>>> list to track and input issues. >>>>>> >>>>>> If there is a volunteer wishing to test an upload of a large >>>>>> dataset >>>>>> (500,000+ records) it would be very much appreciated if you could >>>>>> report back on the experience. >>>>>> >>>>>> Thanks for all your feedback, >>>>>> >>>>>> Best wishes, >>>>>> >>>>>> Tim >>>>>> >>>>>> _______________________________________________ >>>>>> IPT mailing list >>>>>> IPT(a)lists.gbif.org >>>>>> http://lists.gbif.org/mailman/listinfo/ipt >>>>>> >>>>>> >>>>> >>>>> >>>>> ____________________________________________________________ >>>>> Tim Robertson >>>>> Systems Architect >>>>> Global Biodiversity Information Facility Secretariat (GBIF) >>>>> Universitetsparken 15, 2100 Copenhagen Ø, Denmark >>>>> http://www.gbif.org >>>>> trobertson(a)gbif.org >>>>> Phone: +45 35 32 14 87 (Office) >>>>> Fax: +45 35 32 14 80 >>>>> ____________________________________________________________ >>>>> >>>>> _______________________________________________ >>>>> IPT mailing list >>>>> IPT(a)lists.gbif.org >>>>> http://lists.gbif.org/mailman/listinfo/ipt >>>>> >>>> >>>> _______________________________________________ >>>> IPT mailing list >>>> IPT(a)lists.gbif.org >>>> http://lists.gbif.org/mailman/listinfo/ipt >>>> <logs.zip> >>> >>> <catalina.out> >> >> <GeoServer Feature Datensatz Editor.png><localhost.2009-03-04.log> > > <catalina.out>

1 0

Re: [IPT] Beta update
by Holetschek, Jörg 05 Mar '09

05 Mar '09

Hi Markus, thanks... looks better this time... but no maps yet: http://192.168.2.251:8080/ipt/resources.html Attached the log with some error messages at the end... Cheers, Jörg -----Ursprüngliche Nachricht----- Von: "Markus Döring (GBIF)" [mailto:mdoering@gbif.org] Gesendet: Mittwoch, 4. März 2009 18:00 An: Holetschek, Jörg Cc: Tim Robertson (GBIF); ipt(a)lists.gbif.org; Kelbert, Patricia Betreff: Re: AW: AW: AW: [IPT] Beta update Jörg, I have just uploaded a new ipt version 1.0b.7. Would you mind to replace your existing one with this, including geoserver? Especially the geoserver plugin is updated to do taxonomic and regional nested searches for occurrences in maps. Also for configuration there shouuld not be the need anymore to visit the geoserver UI. From within the IPT admin configuration you can now update the geoserver settings, which writes the current IPT data directory into geoservers config files. As before IPT and the geoserver bundle are preconfigured to work when dropped into tomcat on port 8080. http://code.google.com/p/gbif-providertoolkit/downloads/list?can=3&q=&colsp… Markus On Mar 4, 2009, at 11:41, Holetschek, Jörg wrote: > Hi Markus, > > I've set the data directory in the geoserver configuration (see > screenshot), but to no avail :/ > > After restarting tomcat, the IPT application didn't work anymore - > like yesterday. And in case it will work in an hour or so (like > yesterday), there's a lot of errors in the log - is that still a > configuration problem? I've set the path to the IPT data folder in > geoserver, that shouldn't be the problem anymore... > > Jörg > > -----Ursprüngliche Nachricht----- > Von: "Markus Döring (GBIF)" [mailto:mdoering@gbif.org] > Gesendet: Dienstag, 3. März 2009 20:45 > An: Holetschek, Jörg > Cc: Tim Robertson (GBIF); ipt(a)lists.gbif.org > Betreff: Re: AW: AW: [IPT] Beta update > > > this looks like a configuration problem. It cant find the IPTs H2 > database. > Ive seen that in your installation geoserver doesnt automatically find > the IPT data directory. > You need to set the IPT data directory manually in the geoserver > config interface config->data->IPT datasource > use the full absolute file path to your data dir, by default > PATH_TO_TOMCAT/webapps/ipt/data > > Markus > > > On Mar 3, 2009, at 18:25, Holetschek, Jörg wrote: > >> Hmm... I didn't change anything! But I like that sort of magic... >> just wait until it works :) >> >> Just found out one of the menu entries doesn't work... is this a >> problem of our installation? >> http://de.mirror.gbif.org/ipt/admin/activeDatasources.html >> >> The maps do not get rendered by geoserver correctly, I found a "bad >> SQL grammar" error in the log (see attachement). Is this a bug or a >> configuration problem? >> >> >> Cheers from Berlin, >> Jörg >> >> -----Ursprüngliche Nachricht----- >> Von: "Markus Döring (GBIF)" [mailto:mdoering@gbif.org] >> Gesendet: Dienstag, 3. März 2009 15:45 >> An: Holetschek, Jörg >> Cc: Tim Robertson (GBIF); ipt(a)lists.gbif.org >> Betreff: Re: AW: [IPT] Beta update >> >> >> hmm, there are a couple of errors in the log, but the site seems to >> work fine: >> http://de.mirror.gbif.org/ipt >> >> apart from the geoserver maps, I have to admit. >> I have changed your IPT & Geoserver settings to reflect the domain >> de.mirror.gbif.org, but that didnt solve the problem. >> As I have completely replaced the openlayers maps with flash based >> google maps in the latest trunk, do you mind to test the latest >> version? >> >> I will upload a 1.0b.6 war in a few minutes. >> thanks for trying, Jörg. >> Markus >> >> >> >> >> On Mar 3, 2009, at 13:10, Holetschek, Jörg wrote: >> >>> sorry.. little bit scatterbrained today! >>> here are the logs... >>> >>> -----Ursprüngliche Nachricht----- >>> Von: Holetschek, Jörg >>> Gesendet: Dienstag, 3. März 2009 13:04 >>> An: '"Markus Döring (GBIF)"'; Tim Robertson (GBIF) >>> Cc: ipt(a)lists.gbif.org; Kelbert, Patricia; Roepert, Dominik >>> Betreff: AW: [IPT] Beta update >>> >>> >>> Hi Markus, >>> >>> I'm trying to install the latest IPT on our server. It worked fine, >>> but after installing the geoserveer application, th IPT doesn't work >>> anymore :/ >>> >>> Attached the logs... do you have an idea? >>> Using Tomcat 6.0.16 on Red Hat 3.4.3-22. >>> >>> >>> Cheers, >>> Jörg >>> >>> -----Ursprüngliche Nachricht----- >>> Von: ipt-bounces(a)lists.gbif.org [mailto:ipt- >>> bounces(a)lists.gbif.org]Im >>> Auftrag von "Markus Döring (GBIF)" >>> Gesendet: Freitag, 27. Februar 2009 10:36 >>> An: Tim Robertson (GBIF) >>> Cc: Mihail-Constantin Carausu; ipt(a)lists.gbif.org >>> Betreff: Re: [IPT] Beta update >>> >>> >>> it would also be nice if someone could test the SQL based upload, >>> which requires a local installation. >>> If there is help needed with the installation, just post to this >>> list >>> please. >>> >>> Markus >>> >>> >>> On Feb 26, 2009, at 8:59 PM, Tim Robertson (GBIF) wrote: >>> >>>> Thank you very much. >>>> >>>> I suggest starting with 0.5million, and then 1 million and then 3 >>>> million. >>>> I will be surprised if this works without some bug fixing. >>>> >>>> You may just use http://ipt.gbif.org rather than installation. >>>> >>>> Thanks Mihail, help with tests like this is greatly appreciated. >>>> >>>> Tim >>>> >>>> >>>>> Dear Tim >>>>> >>>>> I can volunteer for uploading up to 3 million records if you want. >>>>> The >>>>> only problem is I have not installed yet the IPT software on our >>>>> servers >>>>> (sorry) because I didn't get the time, yet. But I will definitely >>>>> try to >>>>> do the installation tomorrow and the upload too. >>>>> >>>>> Best wishes >>>>> Mihail >>>>> >>>>> ---------------------------- >>>>> Mihail Carausu >>>>> MSc.Eng., Informatics Manager >>>>> Danish Biodiversity Information Facility (DanBIF) >>>>> c/o Zoological Museum >>>>> University of Copenhagen >>>>> Universitetsparken 15 >>>>> DK-2100 Copenhagen Ø >>>>> >>>>> Tel.: (+45) 3532 1063 >>>>> Mobil:(+45) 2618 3636 >>>>> email:mccarausu@zmuc.ku.dk >>>>> web: http://www.DanBIF.dk >>>>> ....oooO.............. >>>>> ....(....)....Oooo.... >>>>> .....)../. ...(....)... >>>>> .....(_/.......)../...... >>>>> .............. (_/....... >>>>> -------------------------------------------- >>>>> >>>>> >>>>> -----Original Message----- >>>>> From: ipt-bounces(a)lists.gbif.org [mailto:ipt- >>>>> bounces(a)lists.gbif.org] On >>>>> Behalf Of Tim Robertson >>>>> Sent: 26. februar 2009 16:26 >>>>> To: ipt(a)lists.gbif.org >>>>> Subject: [IPT] Beta update >>>>> >>>>> Dear All, >>>>> >>>>> A new version has just been deployed, and all user accounts have >>>>> been >>>>> kept intact, but you will notice significant changes, and we hope >>>>> improvements. >>>>> Please use the http://code.google.com/p/gbif-providertoolkit/ >>>>> issues/ >>>>> list to track and input issues. >>>>> >>>>> If there is a volunteer wishing to test an upload of a large >>>>> dataset >>>>> (500,000+ records) it would be very much appreciated if you could >>>>> report back on the experience. >>>>> >>>>> Thanks for all your feedback, >>>>> >>>>> Best wishes, >>>>> >>>>> Tim >>>>> >>>>> _______________________________________________ >>>>> IPT mailing list >>>>> IPT(a)lists.gbif.org >>>>> http://lists.gbif.org/mailman/listinfo/ipt >>>>> >>>>> >>>> >>>> >>>> ____________________________________________________________ >>>> Tim Robertson >>>> Systems Architect >>>> Global Biodiversity Information Facility Secretariat (GBIF) >>>> Universitetsparken 15, 2100 Copenhagen Ø, Denmark >>>> http://www.gbif.org >>>> trobertson(a)gbif.org >>>> Phone: +45 35 32 14 87 (Office) >>>> Fax: +45 35 32 14 80 >>>> ____________________________________________________________ >>>> >>>> _______________________________________________ >>>> IPT mailing list >>>> IPT(a)lists.gbif.org >>>> http://lists.gbif.org/mailman/listinfo/ipt >>>> >>> >>> _______________________________________________ >>> IPT mailing list >>> IPT(a)lists.gbif.org >>> http://lists.gbif.org/mailman/listinfo/ipt >>> <logs.zip> >> >> <catalina.out> > > <GeoServer Feature Datensatz Editor.png><localhost.2009-03-04.log>

2 1

Re: [IPT] Beta update
by Holetschek, Jörg 04 Mar '09

04 Mar '09

Hi Markus, I've set the data directory in the geoserver configuration (see screenshot), but to no avail :/ After restarting tomcat, the IPT application didn't work anymore - like yesterday. And in case it will work in an hour or so (like yesterday), there's a lot of errors in the log - is that still a configuration problem? I've set the path to the IPT data folder in geoserver, that shouldn't be the problem anymore... Jörg -----Ursprüngliche Nachricht----- Von: "Markus Döring (GBIF)" [mailto:mdoering@gbif.org] Gesendet: Dienstag, 3. März 2009 20:45 An: Holetschek, Jörg Cc: Tim Robertson (GBIF); ipt(a)lists.gbif.org Betreff: Re: AW: AW: [IPT] Beta update this looks like a configuration problem. It cant find the IPTs H2 database. Ive seen that in your installation geoserver doesnt automatically find the IPT data directory. You need to set the IPT data directory manually in the geoserver config interface config->data->IPT datasource use the full absolute file path to your data dir, by default PATH_TO_TOMCAT/webapps/ipt/data Markus On Mar 3, 2009, at 18:25, Holetschek, Jörg wrote: > Hmm... I didn't change anything! But I like that sort of magic... > just wait until it works :) > > Just found out one of the menu entries doesn't work... is this a > problem of our installation? > http://de.mirror.gbif.org/ipt/admin/activeDatasources.html > > The maps do not get rendered by geoserver correctly, I found a "bad > SQL grammar" error in the log (see attachement). Is this a bug or a > configuration problem? > > > Cheers from Berlin, > Jörg > > -----Ursprüngliche Nachricht----- > Von: "Markus Döring (GBIF)" [mailto:mdoering@gbif.org] > Gesendet: Dienstag, 3. März 2009 15:45 > An: Holetschek, Jörg > Cc: Tim Robertson (GBIF); ipt(a)lists.gbif.org > Betreff: Re: AW: [IPT] Beta update > > > hmm, there are a couple of errors in the log, but the site seems to > work fine: > http://de.mirror.gbif.org/ipt > > apart from the geoserver maps, I have to admit. > I have changed your IPT & Geoserver settings to reflect the domain > de.mirror.gbif.org, but that didnt solve the problem. > As I have completely replaced the openlayers maps with flash based > google maps in the latest trunk, do you mind to test the latest > version? > > I will upload a 1.0b.6 war in a few minutes. > thanks for trying, Jörg. > Markus > > > > > On Mar 3, 2009, at 13:10, Holetschek, Jörg wrote: > >> sorry.. little bit scatterbrained today! >> here are the logs... >> >> -----Ursprüngliche Nachricht----- >> Von: Holetschek, Jörg >> Gesendet: Dienstag, 3. März 2009 13:04 >> An: '"Markus Döring (GBIF)"'; Tim Robertson (GBIF) >> Cc: ipt(a)lists.gbif.org; Kelbert, Patricia; Roepert, Dominik >> Betreff: AW: [IPT] Beta update >> >> >> Hi Markus, >> >> I'm trying to install the latest IPT on our server. It worked fine, >> but after installing the geoserveer application, th IPT doesn't work >> anymore :/ >> >> Attached the logs... do you have an idea? >> Using Tomcat 6.0.16 on Red Hat 3.4.3-22. >> >> >> Cheers, >> Jörg >> >> -----Ursprüngliche Nachricht----- >> Von: ipt-bounces(a)lists.gbif.org [mailto:ipt-bounces@lists.gbif.org]Im >> Auftrag von "Markus Döring (GBIF)" >> Gesendet: Freitag, 27. Februar 2009 10:36 >> An: Tim Robertson (GBIF) >> Cc: Mihail-Constantin Carausu; ipt(a)lists.gbif.org >> Betreff: Re: [IPT] Beta update >> >> >> it would also be nice if someone could test the SQL based upload, >> which requires a local installation. >> If there is help needed with the installation, just post to this list >> please. >> >> Markus >> >> >> On Feb 26, 2009, at 8:59 PM, Tim Robertson (GBIF) wrote: >> >>> Thank you very much. >>> >>> I suggest starting with 0.5million, and then 1 million and then 3 >>> million. >>> I will be surprised if this works without some bug fixing. >>> >>> You may just use http://ipt.gbif.org rather than installation. >>> >>> Thanks Mihail, help with tests like this is greatly appreciated. >>> >>> Tim >>> >>> >>>> Dear Tim >>>> >>>> I can volunteer for uploading up to 3 million records if you want. >>>> The >>>> only problem is I have not installed yet the IPT software on our >>>> servers >>>> (sorry) because I didn't get the time, yet. But I will definitely >>>> try to >>>> do the installation tomorrow and the upload too. >>>> >>>> Best wishes >>>> Mihail >>>> >>>> ---------------------------- >>>> Mihail Carausu >>>> MSc.Eng., Informatics Manager >>>> Danish Biodiversity Information Facility (DanBIF) >>>> c/o Zoological Museum >>>> University of Copenhagen >>>> Universitetsparken 15 >>>> DK-2100 Copenhagen Ø >>>> >>>> Tel.: (+45) 3532 1063 >>>> Mobil:(+45) 2618 3636 >>>> email:mccarausu@zmuc.ku.dk >>>> web: http://www.DanBIF.dk >>>> ....oooO.............. >>>> ....(....)....Oooo.... >>>> .....)../. ...(....)... >>>> .....(_/.......)../...... >>>> .............. (_/....... >>>> -------------------------------------------- >>>> >>>> >>>> -----Original Message----- >>>> From: ipt-bounces(a)lists.gbif.org [mailto:ipt- >>>> bounces(a)lists.gbif.org] On >>>> Behalf Of Tim Robertson >>>> Sent: 26. februar 2009 16:26 >>>> To: ipt(a)lists.gbif.org >>>> Subject: [IPT] Beta update >>>> >>>> Dear All, >>>> >>>> A new version has just been deployed, and all user accounts have >>>> been >>>> kept intact, but you will notice significant changes, and we hope >>>> improvements. >>>> Please use the http://code.google.com/p/gbif-providertoolkit/ >>>> issues/ >>>> list to track and input issues. >>>> >>>> If there is a volunteer wishing to test an upload of a large >>>> dataset >>>> (500,000+ records) it would be very much appreciated if you could >>>> report back on the experience. >>>> >>>> Thanks for all your feedback, >>>> >>>> Best wishes, >>>> >>>> Tim >>>> >>>> _______________________________________________ >>>> IPT mailing list >>>> IPT(a)lists.gbif.org >>>> http://lists.gbif.org/mailman/listinfo/ipt >>>> >>>> >>> >>> >>> ____________________________________________________________ >>> Tim Robertson >>> Systems Architect >>> Global Biodiversity Information Facility Secretariat (GBIF) >>> Universitetsparken 15, 2100 Copenhagen Ø, Denmark >>> http://www.gbif.org >>> trobertson(a)gbif.org >>> Phone: +45 35 32 14 87 (Office) >>> Fax: +45 35 32 14 80 >>> ____________________________________________________________ >>> >>> _______________________________________________ >>> IPT mailing list >>> IPT(a)lists.gbif.org >>> http://lists.gbif.org/mailman/listinfo/ipt >>> >> >> _______________________________________________ >> IPT mailing list >> IPT(a)lists.gbif.org >> http://lists.gbif.org/mailman/listinfo/ipt >> <logs.zip> > > <catalina.out>

2 1

Re: [IPT] Beta update
by Holetschek, Jörg 03 Mar '09

03 Mar '09

Hmm... I didn't change anything! But I like that sort of magic... just wait until it works :) Just found out one of the menu entries doesn't work... is this a problem of our installation? http://de.mirror.gbif.org/ipt/admin/activeDatasources.html The maps do not get rendered by geoserver correctly, I found a "bad SQL grammar" error in the log (see attachement). Is this a bug or a configuration problem? Cheers from Berlin, Jörg -----Ursprüngliche Nachricht----- Von: "Markus Döring (GBIF)" [mailto:mdoering@gbif.org] Gesendet: Dienstag, 3. März 2009 15:45 An: Holetschek, Jörg Cc: Tim Robertson (GBIF); ipt(a)lists.gbif.org Betreff: Re: AW: [IPT] Beta update hmm, there are a couple of errors in the log, but the site seems to work fine: http://de.mirror.gbif.org/ipt apart from the geoserver maps, I have to admit. I have changed your IPT & Geoserver settings to reflect the domain de.mirror.gbif.org, but that didnt solve the problem. As I have completely replaced the openlayers maps with flash based google maps in the latest trunk, do you mind to test the latest version? I will upload a 1.0b.6 war in a few minutes. thanks for trying, Jörg. Markus On Mar 3, 2009, at 13:10, Holetschek, Jörg wrote: > sorry.. little bit scatterbrained today! > here are the logs... > > -----Ursprüngliche Nachricht----- > Von: Holetschek, Jörg > Gesendet: Dienstag, 3. März 2009 13:04 > An: '"Markus Döring (GBIF)"'; Tim Robertson (GBIF) > Cc: ipt(a)lists.gbif.org; Kelbert, Patricia; Roepert, Dominik > Betreff: AW: [IPT] Beta update > > > Hi Markus, > > I'm trying to install the latest IPT on our server. It worked fine, > but after installing the geoserveer application, th IPT doesn't work > anymore :/ > > Attached the logs... do you have an idea? > Using Tomcat 6.0.16 on Red Hat 3.4.3-22. > > > Cheers, > Jörg > > -----Ursprüngliche Nachricht----- > Von: ipt-bounces(a)lists.gbif.org [mailto:ipt-bounces@lists.gbif.org]Im > Auftrag von "Markus Döring (GBIF)" > Gesendet: Freitag, 27. Februar 2009 10:36 > An: Tim Robertson (GBIF) > Cc: Mihail-Constantin Carausu; ipt(a)lists.gbif.org > Betreff: Re: [IPT] Beta update > > > it would also be nice if someone could test the SQL based upload, > which requires a local installation. > If there is help needed with the installation, just post to this list > please. > > Markus > > > On Feb 26, 2009, at 8:59 PM, Tim Robertson (GBIF) wrote: > >> Thank you very much. >> >> I suggest starting with 0.5million, and then 1 million and then 3 >> million. >> I will be surprised if this works without some bug fixing. >> >> You may just use http://ipt.gbif.org rather than installation. >> >> Thanks Mihail, help with tests like this is greatly appreciated. >> >> Tim >> >> >>> Dear Tim >>> >>> I can volunteer for uploading up to 3 million records if you want. >>> The >>> only problem is I have not installed yet the IPT software on our >>> servers >>> (sorry) because I didn't get the time, yet. But I will definitely >>> try to >>> do the installation tomorrow and the upload too. >>> >>> Best wishes >>> Mihail >>> >>> ---------------------------- >>> Mihail Carausu >>> MSc.Eng., Informatics Manager >>> Danish Biodiversity Information Facility (DanBIF) >>> c/o Zoological Museum >>> University of Copenhagen >>> Universitetsparken 15 >>> DK-2100 Copenhagen Ø >>> >>> Tel.: (+45) 3532 1063 >>> Mobil:(+45) 2618 3636 >>> email:mccarausu@zmuc.ku.dk >>> web: http://www.DanBIF.dk >>> ....oooO.............. >>> ....(....)....Oooo.... >>> .....)../. ...(....)... >>> .....(_/.......)../...... >>> .............. (_/....... >>> -------------------------------------------- >>> >>> >>> -----Original Message----- >>> From: ipt-bounces(a)lists.gbif.org [mailto:ipt- >>> bounces(a)lists.gbif.org] On >>> Behalf Of Tim Robertson >>> Sent: 26. februar 2009 16:26 >>> To: ipt(a)lists.gbif.org >>> Subject: [IPT] Beta update >>> >>> Dear All, >>> >>> A new version has just been deployed, and all user accounts have >>> been >>> kept intact, but you will notice significant changes, and we hope >>> improvements. >>> Please use the http://code.google.com/p/gbif-providertoolkit/issues/ >>> list to track and input issues. >>> >>> If there is a volunteer wishing to test an upload of a large dataset >>> (500,000+ records) it would be very much appreciated if you could >>> report back on the experience. >>> >>> Thanks for all your feedback, >>> >>> Best wishes, >>> >>> Tim >>> >>> _______________________________________________ >>> IPT mailing list >>> IPT(a)lists.gbif.org >>> http://lists.gbif.org/mailman/listinfo/ipt >>> >>> >> >> >> ____________________________________________________________ >> Tim Robertson >> Systems Architect >> Global Biodiversity Information Facility Secretariat (GBIF) >> Universitetsparken 15, 2100 Copenhagen Ø, Denmark >> http://www.gbif.org >> trobertson(a)gbif.org >> Phone: +45 35 32 14 87 (Office) >> Fax: +45 35 32 14 80 >> ____________________________________________________________ >> >> _______________________________________________ >> IPT mailing list >> IPT(a)lists.gbif.org >> http://lists.gbif.org/mailman/listinfo/ipt >> > > _______________________________________________ > IPT mailing list > IPT(a)lists.gbif.org > http://lists.gbif.org/mailman/listinfo/ipt > <logs.zip>

2 1

Re: [IPT] Beta update
by Holetschek, Jörg 03 Mar '09

03 Mar '09

sorry.. little bit scatterbrained today! here are the logs... -----Ursprüngliche Nachricht----- Von: Holetschek, Jörg Gesendet: Dienstag, 3. März 2009 13:04 An: '"Markus Döring (GBIF)"'; Tim Robertson (GBIF) Cc: ipt(a)lists.gbif.org; Kelbert, Patricia; Roepert, Dominik Betreff: AW: [IPT] Beta update Hi Markus, I'm trying to install the latest IPT on our server. It worked fine, but after installing the geoserveer application, th IPT doesn't work anymore :/ Attached the logs... do you have an idea? Using Tomcat 6.0.16 on Red Hat 3.4.3-22. Cheers, Jörg -----Ursprüngliche Nachricht----- Von: ipt-bounces(a)lists.gbif.org [mailto:ipt-bounces@lists.gbif.org]Im Auftrag von "Markus Döring (GBIF)" Gesendet: Freitag, 27. Februar 2009 10:36 An: Tim Robertson (GBIF) Cc: Mihail-Constantin Carausu; ipt(a)lists.gbif.org Betreff: Re: [IPT] Beta update it would also be nice if someone could test the SQL based upload, which requires a local installation. If there is help needed with the installation, just post to this list please. Markus On Feb 26, 2009, at 8:59 PM, Tim Robertson (GBIF) wrote: > Thank you very much. > > I suggest starting with 0.5million, and then 1 million and then 3 > million. > I will be surprised if this works without some bug fixing. > > You may just use http://ipt.gbif.org rather than installation. > > Thanks Mihail, help with tests like this is greatly appreciated. > > Tim > > >> Dear Tim >> >> I can volunteer for uploading up to 3 million records if you want. >> The >> only problem is I have not installed yet the IPT software on our >> servers >> (sorry) because I didn't get the time, yet. But I will definitely >> try to >> do the installation tomorrow and the upload too. >> >> Best wishes >> Mihail >> >> ---------------------------- >> Mihail Carausu >> MSc.Eng., Informatics Manager >> Danish Biodiversity Information Facility (DanBIF) >> c/o Zoological Museum >> University of Copenhagen >> Universitetsparken 15 >> DK-2100 Copenhagen Ø >> >> Tel.: (+45) 3532 1063 >> Mobil:(+45) 2618 3636 >> email:mccarausu@zmuc.ku.dk >> web: http://www.DanBIF.dk >> ....oooO.............. >> ....(....)....Oooo.... >> .....)../. ...(....)... >> .....(_/.......)../...... >> .............. (_/....... >> -------------------------------------------- >> >> >> -----Original Message----- >> From: ipt-bounces(a)lists.gbif.org [mailto:ipt- >> bounces(a)lists.gbif.org] On >> Behalf Of Tim Robertson >> Sent: 26. februar 2009 16:26 >> To: ipt(a)lists.gbif.org >> Subject: [IPT] Beta update >> >> Dear All, >> >> A new version has just been deployed, and all user accounts have been >> kept intact, but you will notice significant changes, and we hope >> improvements. >> Please use the http://code.google.com/p/gbif-providertoolkit/issues/ >> list to track and input issues. >> >> If there is a volunteer wishing to test an upload of a large dataset >> (500,000+ records) it would be very much appreciated if you could >> report back on the experience. >> >> Thanks for all your feedback, >> >> Best wishes, >> >> Tim >> >> _______________________________________________ >> IPT mailing list >> IPT(a)lists.gbif.org >> http://lists.gbif.org/mailman/listinfo/ipt >> >> > > > ____________________________________________________________ > Tim Robertson > Systems Architect > Global Biodiversity Information Facility Secretariat (GBIF) > Universitetsparken 15, 2100 Copenhagen Ø, Denmark > http://www.gbif.org > trobertson(a)gbif.org > Phone: +45 35 32 14 87 (Office) > Fax: +45 35 32 14 80 > ____________________________________________________________ > > _______________________________________________ > IPT mailing list > IPT(a)lists.gbif.org > http://lists.gbif.org/mailman/listinfo/ipt > _______________________________________________ IPT mailing list IPT(a)lists.gbif.org http://lists.gbif.org/mailman/listinfo/ipt

2 1

Re: [IPT] Beta update
by Holetschek, Jörg 03 Mar '09

03 Mar '09

the geoserver itself seems to work fine, by the way... http://de.mirror.gbif.org/geoserver -----Ursprüngliche Nachricht----- Von: Holetschek, Jörg Gesendet: Dienstag, 3. März 2009 13:04 An: '"Markus Döring (GBIF)"'; Tim Robertson (GBIF) Cc: ipt(a)lists.gbif.org; Kelbert, Patricia; Roepert, Dominik Betreff: AW: [IPT] Beta update Hi Markus, I'm trying to install the latest IPT on our server. It worked fine, but after installing the geoserveer application, th IPT doesn't work anymore :/ Attached the logs... do you have an idea? Using Tomcat 6.0.16 on Red Hat 3.4.3-22. Cheers, Jörg -----Ursprüngliche Nachricht----- Von: ipt-bounces(a)lists.gbif.org [mailto:ipt-bounces@lists.gbif.org]Im Auftrag von "Markus Döring (GBIF)" Gesendet: Freitag, 27. Februar 2009 10:36 An: Tim Robertson (GBIF) Cc: Mihail-Constantin Carausu; ipt(a)lists.gbif.org Betreff: Re: [IPT] Beta update it would also be nice if someone could test the SQL based upload, which requires a local installation. If there is help needed with the installation, just post to this list please. Markus On Feb 26, 2009, at 8:59 PM, Tim Robertson (GBIF) wrote: > Thank you very much. > > I suggest starting with 0.5million, and then 1 million and then 3 > million. > I will be surprised if this works without some bug fixing. > > You may just use http://ipt.gbif.org rather than installation. > > Thanks Mihail, help with tests like this is greatly appreciated. > > Tim > > >> Dear Tim >> >> I can volunteer for uploading up to 3 million records if you want. >> The >> only problem is I have not installed yet the IPT software on our >> servers >> (sorry) because I didn't get the time, yet. But I will definitely >> try to >> do the installation tomorrow and the upload too. >> >> Best wishes >> Mihail >> >> ---------------------------- >> Mihail Carausu >> MSc.Eng., Informatics Manager >> Danish Biodiversity Information Facility (DanBIF) >> c/o Zoological Museum >> University of Copenhagen >> Universitetsparken 15 >> DK-2100 Copenhagen Ø >> >> Tel.: (+45) 3532 1063 >> Mobil:(+45) 2618 3636 >> email:mccarausu@zmuc.ku.dk >> web: http://www.DanBIF.dk >> ....oooO.............. >> ....(....)....Oooo.... >> .....)../. ...(....)... >> .....(_/.......)../...... >> .............. (_/....... >> -------------------------------------------- >> >> >> -----Original Message----- >> From: ipt-bounces(a)lists.gbif.org [mailto:ipt- >> bounces(a)lists.gbif.org] On >> Behalf Of Tim Robertson >> Sent: 26. februar 2009 16:26 >> To: ipt(a)lists.gbif.org >> Subject: [IPT] Beta update >> >> Dear All, >> >> A new version has just been deployed, and all user accounts have been >> kept intact, but you will notice significant changes, and we hope >> improvements. >> Please use the http://code.google.com/p/gbif-providertoolkit/issues/ >> list to track and input issues. >> >> If there is a volunteer wishing to test an upload of a large dataset >> (500,000+ records) it would be very much appreciated if you could >> report back on the experience. >> >> Thanks for all your feedback, >> >> Best wishes, >> >> Tim >> >> _______________________________________________ >> IPT mailing list >> IPT(a)lists.gbif.org >> http://lists.gbif.org/mailman/listinfo/ipt >> >> > > > ____________________________________________________________ > Tim Robertson > Systems Architect > Global Biodiversity Information Facility Secretariat (GBIF) > Universitetsparken 15, 2100 Copenhagen Ø, Denmark > http://www.gbif.org > trobertson(a)gbif.org > Phone: +45 35 32 14 87 (Office) > Fax: +45 35 32 14 80 > ____________________________________________________________ > > _______________________________________________ > IPT mailing list > IPT(a)lists.gbif.org > http://lists.gbif.org/mailman/listinfo/ipt > _______________________________________________ IPT mailing list IPT(a)lists.gbif.org http://lists.gbif.org/mailman/listinfo/ipt

1 0

Re: [IPT] Beta update
by Holetschek, Jörg 03 Mar '09

03 Mar '09

Hi Markus, I'm trying to install the latest IPT on our server. It worked fine, but after installing the geoserveer application, th IPT doesn't work anymore :/ Attached the logs... do you have an idea? Using Tomcat 6.0.16 on Red Hat 3.4.3-22. Cheers, Jörg -----Ursprüngliche Nachricht----- Von: ipt-bounces(a)lists.gbif.org [mailto:ipt-bounces@lists.gbif.org]Im Auftrag von "Markus Döring (GBIF)" Gesendet: Freitag, 27. Februar 2009 10:36 An: Tim Robertson (GBIF) Cc: Mihail-Constantin Carausu; ipt(a)lists.gbif.org Betreff: Re: [IPT] Beta update it would also be nice if someone could test the SQL based upload, which requires a local installation. If there is help needed with the installation, just post to this list please. Markus On Feb 26, 2009, at 8:59 PM, Tim Robertson (GBIF) wrote: > Thank you very much. > > I suggest starting with 0.5million, and then 1 million and then 3 > million. > I will be surprised if this works without some bug fixing. > > You may just use http://ipt.gbif.org rather than installation. > > Thanks Mihail, help with tests like this is greatly appreciated. > > Tim > > >> Dear Tim >> >> I can volunteer for uploading up to 3 million records if you want. >> The >> only problem is I have not installed yet the IPT software on our >> servers >> (sorry) because I didn't get the time, yet. But I will definitely >> try to >> do the installation tomorrow and the upload too. >> >> Best wishes >> Mihail >> >> ---------------------------- >> Mihail Carausu >> MSc.Eng., Informatics Manager >> Danish Biodiversity Information Facility (DanBIF) >> c/o Zoological Museum >> University of Copenhagen >> Universitetsparken 15 >> DK-2100 Copenhagen Ø >> >> Tel.: (+45) 3532 1063 >> Mobil:(+45) 2618 3636 >> email:mccarausu@zmuc.ku.dk >> web: http://www.DanBIF.dk >> ....oooO.............. >> ....(....)....Oooo.... >> .....)../. ...(....)... >> .....(_/.......)../...... >> .............. (_/....... >> -------------------------------------------- >> >> >> -----Original Message----- >> From: ipt-bounces(a)lists.gbif.org [mailto:ipt- >> bounces(a)lists.gbif.org] On >> Behalf Of Tim Robertson >> Sent: 26. februar 2009 16:26 >> To: ipt(a)lists.gbif.org >> Subject: [IPT] Beta update >> >> Dear All, >> >> A new version has just been deployed, and all user accounts have been >> kept intact, but you will notice significant changes, and we hope >> improvements. >> Please use the http://code.google.com/p/gbif-providertoolkit/issues/ >> list to track and input issues. >> >> If there is a volunteer wishing to test an upload of a large dataset >> (500,000+ records) it would be very much appreciated if you could >> report back on the experience. >> >> Thanks for all your feedback, >> >> Best wishes, >> >> Tim >> >> _______________________________________________ >> IPT mailing list >> IPT(a)lists.gbif.org >> http://lists.gbif.org/mailman/listinfo/ipt >> >> > > > ____________________________________________________________ > Tim Robertson > Systems Architect > Global Biodiversity Information Facility Secretariat (GBIF) > Universitetsparken 15, 2100 Copenhagen Ø, Denmark > http://www.gbif.org > trobertson(a)gbif.org > Phone: +45 35 32 14 87 (Office) > Fax: +45 35 32 14 80 > ____________________________________________________________ > > _______________________________________________ > IPT mailing list > IPT(a)lists.gbif.org > http://lists.gbif.org/mailman/listinfo/ipt > _______________________________________________ IPT mailing list IPT(a)lists.gbif.org http://lists.gbif.org/mailman/listinfo/ipt

1 0

Re: [IPT] Beta update
by Tim Robertson (GBIF) 28 Feb '09

28 Feb '09

Thank you very much. I suggest starting with 0.5million, and then 1 million and then 3 million. I will be surprised if this works without some bug fixing. You may just use http://ipt.gbif.org rather than installation. Thanks Mihail, help with tests like this is greatly appreciated. Tim > Dear Tim > > I can volunteer for uploading up to 3 million records if you want. The > only problem is I have not installed yet the IPT software on our servers > (sorry) because I didn't get the time, yet. But I will definitely try to > do the installation tomorrow and the upload too. > > Best wishes > Mihail > > ---------------------------- > Mihail Carausu > MSc.Eng., Informatics Manager > Danish Biodiversity Information Facility (DanBIF) > c/o Zoological Museum > University of Copenhagen > Universitetsparken 15 > DK-2100 Copenhagen Ø > > Tel.: (+45) 3532 1063 > Mobil:(+45) 2618 3636 > email:mccarausu@zmuc.ku.dk > web: http://www.DanBIF.dk > ....oooO.............. > ....(....)....Oooo.... > .....)../. ...(....)... > .....(_/.......)../...... > .............. (_/....... > -------------------------------------------- > > > -----Original Message----- > From: ipt-bounces(a)lists.gbif.org [mailto:ipt-bounces@lists.gbif.org] On > Behalf Of Tim Robertson > Sent: 26. februar 2009 16:26 > To: ipt(a)lists.gbif.org > Subject: [IPT] Beta update > > Dear All, > > A new version has just been deployed, and all user accounts have been > kept intact, but you will notice significant changes, and we hope > improvements. > Please use the http://code.google.com/p/gbif-providertoolkit/issues/ > list to track and input issues. > > If there is a volunteer wishing to test an upload of a large dataset > (500,000+ records) it would be very much appreciated if you could > report back on the experience. > > Thanks for all your feedback, > > Best wishes, > > Tim > > _______________________________________________ > IPT mailing list > IPT(a)lists.gbif.org > http://lists.gbif.org/mailman/listinfo/ipt > > ____________________________________________________________ Tim Robertson Systems Architect Global Biodiversity Information Facility Secretariat (GBIF) Universitetsparken 15, 2100 Copenhagen Ø, Denmark http://www.gbif.org trobertson(a)gbif.org Phone: +45 35 32 14 87 (Office) Fax: +45 35 32 14 80 ____________________________________________________________

5 6

Re: [IPT] text file upload (larger record numbers)
by "Markus Döring (GBIF)" 27 Feb '09

27 Feb '09

you can upload zipped file archives now with the latest subversion trunk version. it automatically detects if your file is a ZIP and then inserts all its files as IPT sources. Soon to be on ipt.gbif.org. Markus On Feb 27, 2009, at 5:24 PM, Tim Robertson wrote: > Agree - need to support GZip and Zips... > > and then limit to 100M I reckon > > > On 27 Feb 2009, at 17:17, Markus Döring (GBIF) wrote: > >> Andrea, >> the upload of files is limited to 100MB at the GBIF installation. >> We might want to increase it, but it might be better to allow >> upload of compressed files. >> what do you think? >> >> markus >> >> >> On Feb 27, 2009, at 4:57 PM, Andrea Hahn (GBIF) wrote: >> >>> Hi, >>> >>> quick note: I have been playing a bit with text file uploads for >>> occurrence records, using a tabular export from the GBIF index on >>> a 500,000+ record dataset. Using different subsets of the same >>> recordset, I have not been able to get beyond the 310,000 records >>> cutdown of the test set so far - this equals a file size of >>> 99,974kB in the given example. The next larger set (320,000 >>> records, 100MB) and all larger ones fail with >>> Yikes! >>> >>> javax.servlet.ServletException: Expression resource is undefined >>> on line 87, column 30 in WEB-INF/pages/manage/sources.ftl. >>> at >>> net >>> .sf.ehcache.constructs.web.filter.Filter.logThrowable(Filter.java: >>> 152) >>> at >>> net.sf.ehcache.constructs.web.filter.Filter.doFilter(Filter.java:97) >>> at >>> org >>> .apache >>> .catalina >>> .core >>> .ApplicationFilterChain >>> .internalDoFilter(ApplicationFilterChain.java:215) >>> at >>> org >>> .apache >>> .catalina >>> .core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java: >>> 188) >>> at >>> org >>> .appfuse >>> .webapp.filter.LocaleFilter.doFilterInternal(LocaleFilter.java:74) >>> at org.springframework.web.filter.OncePerRequestFilter.doFilter >>> (OncePerRequestFilter.java:76) >>> at >>> org >>> .apache >>> .catalina >>> .core >>> .ApplicationFilterChain >>> .internalDoFilter(ApplicationFilterChain.java:215) >>> at >>> org >>> .apache >>> .catalina >>> .core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java: >>> 188) >>> at >>> org >>> .springframework >>> .orm >>> .hibernate3 >>> .support >>> .OpenSessionInViewFilter >>> .doFilterInternal(OpenSessionInViewFilter.java:198) >>> at org.springframework.web.filter.OncePerRequestFilter.doFilter >>> (OncePerRequestFilter.java:76) >>> at >>> org >>> .apache >>> .catalina >>> .core >>> .ApplicationFilterChain >>> .internalDoFilter(ApplicationFilterChain.java:215) >>> at >>> org >>> .apache >>> .catalina >>> .core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java: >>> 188) >>> at org.springframework.security.util.FilterChainProxy >>> $VirtualFilterChain.doFilter(FilterChainProxy.java:359) >>> at org.springframework.security.intercept.web.FilterSecurityInterceptor.invoke >>> (FilterSecurityInterceptor.java:109) >>> at org.springframework.security.intercept.web.FilterSecurityInterceptor.doFilter >>> (FilterSecurityInterceptor.java:83) >>> at org.springframework.security.util.FilterChainProxy >>> $VirtualFilterChain.doFilter(FilterChainProxy.java:371) >>> at >>> org >>> .springframework >>> .security >>> .ui >>> .ExceptionTranslationFilter >>> .doFilterHttp(ExceptionTranslationFilter.java:101) >>> at >>> org >>> .springframework >>> .security >>> .ui.SpringSecurityFilter.doFilter(SpringSecurityFilter.java:53) >>> at org.springframework.security.util.FilterChainProxy >>> $VirtualFilterChain.doFilter(FilterChainProxy.java:371) >>> at >>> org >>> .springframework >>> .security >>> .providers >>> .anonymous >>> .AnonymousProcessingFilter >>> .doFilterHttp(AnonymousProcessingFilter.java:105) >>> at >>> org >>> .springframework >>> .security >>> .ui.SpringSecurityFilter.doFilter(SpringSecurityFilter.java:53) >>> at org.springframework.security.util.FilterChainProxy >>> $VirtualFilterChain.doFilter(FilterChainProxy.java:371) >>> at >>> org >>> .springframework >>> .security >>> .ui >>> .rememberme >>> .RememberMeProcessingFilter >>> .doFilterHttp(RememberMeProcessingFilter.java:116) >>> at >>> org >>> .springframework >>> .security >>> .ui.SpringSecurityFilter.doFilter(SpringSecurityFilter.java:53) >>> at org.springframework.security.util.FilterChainProxy >>> $VirtualFilterChain.doFilter(FilterChainProxy.java:371) >>> at >>> org >>> .springframework >>> .security >>> .wrapper >>> .SecurityContextHolderAwareRequestFilter >>> .doFilterHttp(SecurityContextHolderAwareRequestFilter.java:91) >>> at >>> org >>> .springframework >>> .security >>> .ui.SpringSecurityFilter.doFilter(SpringSecurityFilter.java:53) >>> at org.springframework.security.util.FilterChainProxy >>> $VirtualFilterChain.doFilter(FilterChainProxy.java:371) >>> at >>> org >>> .springframework >>> .security >>> .ui >>> .basicauth >>> .BasicProcessingFilter.doFilterHttp(BasicProcessingFilter.java:172) >>> at >>> org >>> .springframework >>> .security >>> .ui.SpringSecurityFilter.doFilter(SpringSecurityFilter.java:53) >>> at org.springframework.security.util.FilterChainProxy >>> $VirtualFilterChain.doFilter(FilterChainProxy.java:371) >>> at >>> org >>> .springframework >>> .security >>> .ui >>> .AbstractProcessingFilter >>> .doFilterHttp(AbstractProcessingFilter.java:268) >>> at >>> org >>> .springframework >>> .security >>> .ui.SpringSecurityFilter.doFilter(SpringSecurityFilter.java:53) >>> at org.springframework.security.util.FilterChainProxy >>> $VirtualFilterChain.doFilter(FilterChainProxy.java:371) >>> at >>> org >>> .springframework >>> .security.ui.logout.LogoutFilter.doFilterHttp(LogoutFilter.java:87) >>> at >>> org >>> .springframework >>> .security >>> .ui.SpringSecurityFilter.doFilter(SpringSecurityFilter.java:53) >>> at org.springframework.security.util.FilterChainProxy >>> $VirtualFilterChain.doFilter(FilterChainProxy.java:371) >>> at >>> org >>> .springframework >>> .security >>> .ui >>> .SessionFixationProtectionFilter >>> .doFilterHttp(SessionFixationProtectionFilter.java:61) >>> at >>> org >>> .springframework >>> .security >>> .ui.SpringSecurityFilter.doFilter(SpringSecurityFilter.java:53) >>> at org.springframework.security.util.FilterChainProxy >>> $VirtualFilterChain.doFilter(FilterChainProxy.java:371) >>> at >>> org >>> .springframework >>> .security >>> .context >>> .HttpSessionContextIntegrationFilter >>> .doFilterHttp(HttpSessionContextIntegrationFilter.java:235) >>> at >>> org >>> .springframework >>> .security >>> .ui.SpringSecurityFilter.doFilter(SpringSecurityFilter.java:53) >>> at org.springframework.security.util.FilterChainProxy >>> $VirtualFilterChain.doFilter(FilterChainProxy.java:371) >>> at >>> org >>> .springframework >>> .security.util.FilterChainProxy.doFilter(FilterChainProxy.java:174) >>> at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate >>> (DelegatingFilterProxy.java:236) >>> at org.springframework.web.filter.DelegatingFilterProxy.doFilter >>> (DelegatingFilterProxy.java:167) >>> at >>> org >>> .apache >>> .catalina >>> .core >>> .ApplicationFilterChain >>> .internalDoFilter(ApplicationFilterChain.java:215) >>> at >>> org >>> .apache >>> .catalina >>> .core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java: >>> 188) >>> at org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal >>> (CharacterEncodingFilter.java:96) >>> at org.springframework.web.filter.OncePerRequestFilter.doFilter >>> (OncePerRequestFilter.java:76) >>> at >>> org >>> .apache >>> .catalina >>> .core >>> .ApplicationFilterChain >>> .internalDoFilter(ApplicationFilterChain.java:215) >>> at >>> org >>> .apache >>> .catalina >>> .core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java: >>> 188) >>> at >>> org >>> .apache >>> .catalina >>> .core.StandardWrapperValve.invoke(StandardWrapperValve.java:210) >>> at >>> org >>> .apache >>> .catalina >>> .core.StandardContextValve.invoke(StandardContextValve.java:174) >>> at >>> org >>> .apache >>> .catalina.core.StandardHostValve.invoke(StandardHostValve.java:127) >>> at >>> org >>> .apache >>> .catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:117) >>> at >>> org >>> .apache >>> .catalina.core.StandardEngineValve.invoke(StandardEngineValve.java: >>> 108) >>> at >>> org >>> .apache >>> .catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:151) >>> at >>> org.apache.jk.server.JkCoyoteHandler.invoke(JkCoyoteHandler.java: >>> 200) >>> at >>> org.apache.jk.common.HandlerRequest.invoke(HandlerRequest.java:283) >>> at >>> org.apache.jk.common.ChannelSocket.invoke(ChannelSocket.java:773) >>> at >>> org >>> .apache >>> .jk.common.ChannelSocket.processConnection(ChannelSocket.java:703) >>> at org.apache.jk.common.ChannelSocket >>> $SocketConnection.runIt(ChannelSocket.java:895) >>> at org.apache.tomcat.util.threads.ThreadPool >>> $ControlRunnable.run(ThreadPool.java:685) >>> at java.lang.Thread.run(Thread.java:595) >>> >>> >>> --------------------------------------------------------------- >>> Andrea Hahn (ahahn(a)gbif.org) >>> Data Portal Manager >>> Global Biodiversity Information Facility Secretariat >>> Universitetsparken 15, DK-2100 Copenhagen, Denmark >>> Tel: +45-35321491 Fax: +45-35321480 >>> URL: http://www.gbif.org >>> --------------------------------------------------------------- >>> >>> _______________________________________________ >>> IPT mailing list >>> IPT(a)lists.gbif.org >>> http://lists.gbif.org/mailman/listinfo/ipt >> >> _______________________________________________ >> IPT mailing list >> IPT(a)lists.gbif.org >> http://lists.gbif.org/mailman/listinfo/ipt >

1 0

text file upload (larger record numbers)
by Andrea Hahn (GBIF) 27 Feb '09

27 Feb '09

Hi, quick note: I have been playing a bit with text file uploads for occurrence records, using a tabular export from the GBIF index on a 500,000+ record dataset. Using different subsets of the same recordset, I have not been able to get beyond the 310,000 records cutdown of the test set so far - this equals a file size of 99,974kB in the given example. The next larger set (320,000 records, 100MB) and all larger ones fail with Yikes! javax.servlet.ServletException: Expression resource is undefined on line 87, column 30 in WEB-INF/pages/manage/sources.ftl. at net.sf.ehcache.constructs.web.filter.Filter.logThrowable(Filter.java:152) at net.sf.ehcache.constructs.web.filter.Filter.doFilter(Filter.java:97) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(Application FilterChain.java:215) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterCh ain.java:188) at org.appfuse.webapp.filter.LocaleFilter.doFilterInternal(LocaleFilter.java:74 ) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestF ilter.java:76) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(Application FilterChain.java:215) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterCh ain.java:188) at org.springframework.orm.hibernate3.support.OpenSessionInViewFilter.doFilterI nternal(OpenSessionInViewFilter.java:198) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestF ilter.java:76) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(Application FilterChain.java:215) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterCh ain.java:188) at org.springframework.security.util.FilterChainProxy$VirtualFilterChain.doFilt er(FilterChainProxy.java:359) at org.springframework.security.intercept.web.FilterSecurityInterceptor.invoke( FilterSecurityInterceptor.java:109) at org.springframework.security.intercept.web.FilterSecurityInterceptor.doFilte r(FilterSecurityInterceptor.java:83) at org.springframework.security.util.FilterChainProxy$VirtualFilterChain.doFilt er(FilterChainProxy.java:371) at org.springframework.security.ui.ExceptionTranslationFilter.doFilterHttp(Exce ptionTranslationFilter.java:101) at org.springframework.security.ui.SpringSecurityFilter.doFilter(SpringSecurity Filter.java:53) at org.springframework.security.util.FilterChainProxy$VirtualFilterChain.doFilt er(FilterChainProxy.java:371) at org.springframework.security.providers.anonymous.AnonymousProcessingFilter.d oFilterHttp(AnonymousProcessingFilter.java:105) at org.springframework.security.ui.SpringSecurityFilter.doFilter(SpringSecurity Filter.java:53) at org.springframework.security.util.FilterChainProxy$VirtualFilterChain.doFilt er(FilterChainProxy.java:371) at org.springframework.security.ui.rememberme.RememberMeProcessingFilter.doFilt erHttp(RememberMeProcessingFilter.java:116) at org.springframework.security.ui.SpringSecurityFilter.doFilter(SpringSecurity Filter.java:53) at org.springframework.security.util.FilterChainProxy$VirtualFilterChain.doFilt er(FilterChainProxy.java:371) at org.springframework.security.wrapper.SecurityContextHolderAwareRequestFilter .doFilterHttp(SecurityContextHolderAwareRequestFilter.java:91) at org.springframework.security.ui.SpringSecurityFilter.doFilter(SpringSecurity Filter.java:53) at org.springframework.security.util.FilterChainProxy$VirtualFilterChain.doFilt er(FilterChainProxy.java:371) at org.springframework.security.ui.basicauth.BasicProcessingFilter.doFilterHttp (BasicProcessingFilter.java:172) at org.springframework.security.ui.SpringSecurityFilter.doFilter(SpringSecurity Filter.java:53) at org.springframework.security.util.FilterChainProxy$VirtualFilterChain.doFilt er(FilterChainProxy.java:371) at org.springframework.security.ui.AbstractProcessingFilter.doFilterHttp(Abstra ctProcessingFilter.java:268) at org.springframework.security.ui.SpringSecurityFilter.doFilter(SpringSecurity Filter.java:53) at org.springframework.security.util.FilterChainProxy$VirtualFilterChain.doFilt er(FilterChainProxy.java:371) at org.springframework.security.ui.logout.LogoutFilter.doFilterHttp(LogoutFilte r.java:87) at org.springframework.security.ui.SpringSecurityFilter.doFilter(SpringSecurity Filter.java:53) at org.springframework.security.util.FilterChainProxy$VirtualFilterChain.doFilt er(FilterChainProxy.java:371) at org.springframework.security.ui.SessionFixationProtectionFilter.doFilterHttp (SessionFixationProtectionFilter.java:61) at org.springframework.security.ui.SpringSecurityFilter.doFilter(SpringSecurity Filter.java:53) at org.springframework.security.util.FilterChainProxy$VirtualFilterChain.doFilt er(FilterChainProxy.java:371) at org.springframework.security.context.HttpSessionContextIntegrationFilter.doF ilterHttp(HttpSessionContextIntegrationFilter.java:235) at org.springframework.security.ui.SpringSecurityFilter.doFilter(SpringSecurity Filter.java:53) at org.springframework.security.util.FilterChainProxy$VirtualFilterChain.doFilt er(FilterChainProxy.java:371) at org.springframework.security.util.FilterChainProxy.doFilter(FilterChainProxy .java:174) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(Delegati ngFilterProxy.java:236) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilt erProxy.java:167) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(Application FilterChain.java:215) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterCh ain.java:188) at org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(Char acterEncodingFilter.java:96) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestF ilter.java:76) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(Application FilterChain.java:215) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterCh ain.java:188) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.ja va:210) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.ja va:174) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127 ) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:117 ) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java :108) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:151) at org.apache.jk.server.JkCoyoteHandler.invoke(JkCoyoteHandler.java:200) at org.apache.jk.common.HandlerRequest.invoke(HandlerRequest.java:283) at org.apache.jk.common.ChannelSocket.invoke(ChannelSocket.java:773) at org.apache.jk.common.ChannelSocket.processConnection(ChannelSocket.java:703) at org.apache.jk.common.ChannelSocket$SocketConnection.runIt(ChannelSocket.java :895) at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.jav a:685) at java.lang.Thread.run(Thread.java:595) --------------------------------------------------------------- Andrea Hahn (ahahn(a)gbif.org) Data Portal Manager Global Biodiversity Information Facility Secretariat Universitetsparken 15, DK-2100 Copenhagen, Denmark Tel: +45-35321491 Fax: +45-35321480 URL: http://www.gbif.org ---------------------------------------------------------------

2 1