- IPT - lists.gbif.org

Re: [IPT] SQL datasource upload
by "Holetschek, Jörg" 18 Mar '09

18 Mar '09

Good idea, Tim! But no SELECT gets to the server... apparently only some preparations: SELECT @@MAX_PRECISION SET TRANSACTION ISOLATION LEVEL READ COMMITTED SET IMPLICIT_TRANSACTIONS OFF SET QUOTED_IDENTIFIER ON SET TEXTSIZE 2147483647 Cheers, Jörg -----Ursprüngliche Nachricht----- Von: Tim Robertson [mailto:trobertson@gbif.org] Gesendet: Mittwoch, 18. März 2009 11:06 An: =?ISO-8859-1?Q?=22Holetschek(a)ns.gbif.org; Holetschek, Jörg Cc: "Markus Döring (GBIF)"; ipt(a)lists.gbif.org Betreff: Re: [IPT] SQL datasource upload Hi Jörg I've looked through the code and it is not possible to switch on the SQL logging through configuration. I will change this for the next release so that the SQL is logged prior to execution for easier debug. Could you please check the SQLServer logs and report if the query reaches the DB? Cheers, Tim On 18 Mar 2009, at 10:48, Holetschek, Jörg wrote: > Hi Markus, > > I've tried to upload data from our SQL server database, after > creating one datasource and 11 mappings. > The upload takes only a second and ends up with 0 records uploaded, > even though I can't find an error in the logs... Is there something > I need to do first? > > INFO pool-1-thread-1-OccUploadTask.call(105) | Import preparation > took 78 ms > INFO pool-1-thread-1-OccUploadTask.uploadCore(225) | Starting upload > of core records for resource Desmids > INFO pool-1-thread-1-DarwinCoreManagerHibernate.removeAll(41) | > Removed 0 DarwinCores bound to resource Desmids > INFO pool-1-thread-1- > DarwinCoreManagerHibernate.flagAllAsDeleted(109) | 0 > org.gbif.provider.model.DarwinCore records of resource were flagged > as deleted. > INFO pool-1-thread-1-OccStatManagerHibernate.removeAll(41) | Removed > 0 OccStatByRegionAndTaxons bound to resource Desmids > INFO pool-1-thread-1-TreeNodeSupportHibernate.removeAll(85) | > Removed 0 taxons bound to resource Desmids > INFO pool-1-thread-1-TreeNodeSupportHibernate.removeAll(85) | > Removed 0 regions bound to resource Desmids > INFO pool-1-thread-1-AnnotationManagerHibernate.removeAll(133) | > Removed 2 annotations bound to resource Desmids > > > Cheers, > Jörg > _______________________________________________ > IPT mailing list > IPT(a)lists.gbif.org > http://lists.gbif.org/mailman/listinfo/ipt >

1 0

SQL datasource upload
by "Holetschek, Jörg" 18 Mar '09

18 Mar '09

Hi Markus, I've tried to upload data from our SQL server database, after creating one datasource and 11 mappings. The upload takes only a second and ends up with 0 records uploaded, even though I can't find an error in the logs... Is there something I need to do first? INFO pool-1-thread-1-OccUploadTask.call(105) | Import preparation took 78 ms INFO pool-1-thread-1-OccUploadTask.uploadCore(225) | Starting upload of core records for resource Desmids INFO pool-1-thread-1-DarwinCoreManagerHibernate.removeAll(41) | Removed 0 DarwinCores bound to resource Desmids INFO pool-1-thread-1-DarwinCoreManagerHibernate.flagAllAsDeleted(109) | 0 org.gbif.provider.model.DarwinCore records of resource were flagged as deleted. INFO pool-1-thread-1-OccStatManagerHibernate.removeAll(41) | Removed 0 OccStatByRegionAndTaxons bound to resource Desmids INFO pool-1-thread-1-TreeNodeSupportHibernate.removeAll(85) | Removed 0 taxons bound to resource Desmids INFO pool-1-thread-1-TreeNodeSupportHibernate.removeAll(85) | Removed 0 regions bound to resource Desmids INFO pool-1-thread-1-AnnotationManagerHibernate.removeAll(133) | Removed 2 annotations bound to resource Desmids Cheers, Jörg

2 1

Re: [IPT] IPT 1.0b.8 online
by "Holetschek, Jörg" 18 Mar '09

18 Mar '09

Hi Markus et al, pressing the "publish" button for a data resource doesn't work like in the previous versions, I just get a never ending animation (see screenshot). Is that somehow connected to not being registered yet? Cheers, Jörg -----Ursprüngliche Nachricht----- Von: ipt-bounces(a)lists.gbif.org [mailto:ipt-bounces@lists.gbif.org]Im Auftrag von "Markus Döring (GBIF)" Gesendet: Mittwoch, 18. März 2009 09:20 An: Burke Chih-Jen Ko Cc: ipt(a)lists.gbif.org Betreff: Re: [IPT] IPT 1.0b.8 online Burke, you dont have to register,but you can if you like to try the registry integration. The registry connected is a test one until the real release, so you dont harm anyone, just go ahead and register anything you want. The functionality of the registry is still being updated, not all email notifications for example might work right now, in particular the resend password link (which you need to use an existing organisation without knowing its password). Once you have selected an existing or registered a new organisation, publishing a resource also registers it with GBIF and updates its metadata in the registry (not fully working in the current registry version). A resource therefore has 3 states: - private/draft: this is the default for new resources. Its neither registered nor should it be visible in the public portal part of the IPT - public/modified: the resource is intended to be public, its present in the IPT portal and if all goes well and your settings allow to, its also registered with GBIF. The resource metadata is modified though and differes from a) GBIFs registry metadata or b) the versioned EML document which is generated each time you press publish (actually also the geoserver WFS/WMS services have their own metadata which is out of date then too) - public/clean: same as above, but the metadata in the registry/ EML&geoserver should reflect your latest state Does this clarify the registry integration? Markus On Mar 18, 2009, at 3:59, Burke Chih-Jen Ko wrote: > Dear Markus, > > Thank GBIF team for this brilliant work! > > A question: > Now in Admin->settings->Organisation, > Must we register to test IPT? > In the publishing box, does the "private, not registered" mean the > same thing? > > Best regards, > Burke > > > Taiwan Biodiversity Information Facility, TaiBIF > Biodiversity Research Center, Academia Sinica > No. 128, Sec 2, Academia Rd., Nangang District > Taipei 115, Taiwan > Tel: +886+2+27899621 ext.220 > > _______________________________________________ IPT mailing list IPT(a)lists.gbif.org http://lists.gbif.org/mailman/listinfo/ipt

1 0

IPT on glassfish
by Esteban Mata 17 Mar '09

17 Mar '09

Hi everybody! I was trying to deploy the ipt.war on glassfish! ... I know probably it would be easier on Tomcat but i have glassfish already installed, so I have to know if is posible to run IPT on glassfish? Could someone help me?! Thanks.

2 1

Re: [IPT] IPT Documentation
by Mergen Patricia 17 Mar '09

17 Mar '09

Hi Arnaud First of all congratulation for your new position! In the framework of mainly the project "Central Biodiversity Information Network" to be installed in Central Africa, we are currently testing a lot with the GBIF tool including already a bit the IPT portal. For the EDIT project, there are also training materials being compiled for the moment (more for the GIS part, which is also present in form of maps in the IPT tool.) My colleague Franck is currently in Africa to do some testing, but he has internet and can answers mails from time to time. We will be happy to collaborate with you and do not hesitate to contact us to know more about the ongoing projects and compare the available docs or those in preparation in near future so that we can help each other out at best. Best regards Patricia Patricia Mergen Project Manager Biodiversity Information and Cybertaxonomy Unit Royal Museum for Central Africa Leuvensesteenweg 13 B-3080 Tervuren Phone:+ 32 2 769 56 26 Fax: + 32 2 769 56 42 E-mail: patricia.mergen(a)africamuseum.be http://www.africamuseum.be/research/cooperation -----Original Message----- From: ipt-bounces(a)lists.gbif.org [mailto:ipt-bounces@lists.gbif.org] On Behalf Of Arnaud Réveillon Sent: mardi 17 mars 2009 15:44 To: ipt(a)lists.gbif.org Subject: [IPT] IPT Documentation Dear all, My name is Arnaud Réveillon and I have been appointed to write the documentation for the IPT. I am not new to the GBIF and biodiversity-related software as I worked during four years (2004-2008) for the Belgian focal point for the Convention on Biological Diversity, acting as tutor (mostly on databases, web applications, web pages editors, etc.) and as webmaster. During this period, I have been regularly in contact with members of several national GBIF nodes and am generally well aware of their work. I am not yet fully familiar with the IPT but hope to get up to speed in the next few days, with the help of the list. Please do not hesitate to let me know about your needs, the difficulties you are having with the IPT or anything that may be of interest regarding the documentation, which is scheduled to be ready on 16 April. Thank you, Arnaud Réveillon- _______________________________________________ IPT mailing list IPT(a)lists.gbif.org http://lists.gbif.org/mailman/listinfo/ipt ########################################### This message has been scanned by ICT - Africa Museum ________________________________________ 17/3/2009 - Filtered through antispam by ICT

1 0

SQL Database connection
by Holetschek, Jörg 12 Mar '09

12 Mar '09

Hi Markus and Tim, I've just connected the IPT to our mySQL server. On the "property mappings" page there's a hint "There are no data sources configured. Please define at least one source first." What am I supposed to do? Isn't the mySQL database connection (jdbc:mysql://192.168.2.10/pontaurus) the data source? Cheers from Berlin, Jörg

2 1

Re: [IPT] tomcat question
by H 12 Mar '09

12 Mar '09

Markus, all/ How can tomcat and/or the ipt be viewed from specific machines [ip addresses]? I've found tomcat 5.5 documentation [ http://tomcat.apache.org/tomcat-5.5-doc/manager-howto.html] but have yet to successfully open up the manager application. Also when trying to install Extensions like "ResourceRelationship" I'm getting a not so nice javax.servlet.... YIKES! Is this part of my instellation error? Thanks, HW Ikerd

2 1

Selecting area in Geographic Coverage never take effect
by Burke Chih-Jen Ko 11 Mar '09

11 Mar '09

Hi Tim, I am not sure if these issues are correlated, so maybe it's good to write it together. I tried using the dataset, pontaurus.txt, to reproduce the same presentation as the default one. Let's say, the original is ponTaurus1 and the one I set up by choosing "new occurrence resource" is ponTaurus2. I can adjust the geographic coverage of ponTaurus1: 1. In geographic coverage page, re-select the area and save. 2. IPT then brings us to the taxonomic coverage page, if I click "publish" in this page, I get Yikes. Please see error1.txt as attached. 3. I then click the "previous page" bottom of the browser, navigate to basic resource page of ponTaurus1 4. Click "publish" in this page, then I can see the updated shape in the main "Explore" page. But I can't make selecting area take effect with ponTaurus2. Actually I can't do the same thing on any newly established resources. After I did the property mapping and uploaded to the cache, the server once became unresponsive when I clicked done. It stopped when loading(or calculating?) the occResource.html. Restart Tomcat I get messages in catalina.out said "Could not get JDBC Connection". See error3.txt as attached. 1. Choose ponTaurus2 in manage page, navigate to geographic coverage. 2. Select Area and save. IPT brings me to the taxonomic coverage. 3. Publish in the basic metadata page or not, when click back to the geographic coverage page, the map remains blank without any selection made. error2.txt is the new message of /Library/Tomcat/logs/catalina.out during the above operation. If I "publish all" or "republish" in the main Manage page, then when I click to the Explore page, I get another Yikes. Attached as error4.txt Because the Explore page is broken since the last action, I then restart Tomcat, the Explore page remains broken. You can visit http://informatics.biodiv.tw:8080/ipt/resources.html. Hope this make sense. I am using Safari 4b and the IPT1.0b7 is set up on a Mac OS X Server with the Tomcat 6.0.18 coming with the OS. Cheers, Chih-Jen (Burke) Taiwan Biodiversity Information Facility, TaiBIF Biodiversity Research Center, Academia Sinica No. 128, Sec 2, Academia Rd., Nangang District Taipei 115, Taiwan Tel: +886+2+27899621 ext.220

1 0

Re: [IPT] User Manager
by Holetschek, Jörg 11 Mar '09

11 Mar '09

Hi again, seems I can't edit the "Source Data" settings for a SQL datasource. After entering connection URL and database user with empty password, I get Sapperlott! java.lang.NullPointerException at org.apache.struts2.views.jsp.ComponentTagSupport.doStartTag(ComponentTagSupport.java:50) at org.apache.jsp._404_jsp._jspx_meth_s_005ftext_005f0(_404_jsp.java:186) at org.apache.jsp._404_jsp._jspx_meth_c_005fset_005f1(_404_jsp.java:158) at org.apache.jsp._404_jsp._jspService(_404_jsp.java:101) at org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:70) at javax.servlet.http.HttpServlet.service(HttpServlet.java:803) at org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.java:374) at org.apache.jasper.servlet.JspServlet.serviceJspFile(JspServlet.java:337) at org.apache.jasper.servlet.JspServlet.service(JspServlet.java:266) at javax.servlet.http.HttpServlet.service(HttpServlet.java:803) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) at org.apache.catalina.core.ApplicationDispatcher.invoke(ApplicationDispatcher.java:630) at org.apache.catalina.core.ApplicationDispatcher.processRequest(ApplicationDispatcher.java:438) at org.apache.catalina.core.ApplicationDispatcher.doForward(ApplicationDispatcher.java:374) at org.apache.catalina.core.ApplicationDispatcher.forward(ApplicationDispatcher.java:302) at org.apache.catalina.core.StandardHostValve.custom(StandardHostValve.java:424) at org.apache.catalina.core.StandardHostValve.status(StandardHostValve.java:343) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:144) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:286) at org.apache.jk.server.JkCoyoteHandler.invoke(JkCoyoteHandler.java:190) at org.apache.jk.common.HandlerRequest.invoke(HandlerRequest.java:283) at org.apache.jk.common.ChannelSocket.invoke(ChannelSocket.java:767) at org.apache.jk.common.ChannelSocket.processConnection(ChannelSocket.java:697) at org.apache.jk.common.ChannelSocket$SocketConnection.runIt(ChannelSocket.java:889) at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:690) at java.lang.Thread.run(Thread.java:619) Jörg -----Ursprüngliche Nachricht----- Von: "Markus Döring (GBIF)" [mailto:mdoering@gbif.org] Gesendet: Mittwoch, 11. März 2009 15:28 An: Holetschek, Jörg Cc: Tim Robertson (GBIF); ipt(a)lists.gbif.org Betreff: Re: User Manager I am working on that, Jörg, just today! Its because I switched javascript frameworks...to assign different roles for users right now you can only do this in the database, I am sorry. But will be fixed this week! m On Mar 11, 2009, at 15:17, Holetschek, Jörg wrote: > Hi Tim & Markus, > > it's not possible in our installation to edit any user. There's an > error in the underlying link is > http://de.mirror.gbif.org/ipteditUser.html?id=5&from=list > > Is there something I can do about it? > > > Cheers, > Jörg > > -----Ursprüngliche Nachricht----- > Von: ipt-bounces(a)lists.gbif.org [mailto:ipt-bounces@lists.gbif.org]Im > Auftrag von Tim Robertson (GBIF) > Gesendet: Donnerstag, 26. Februar 2009 21:00 > An: Mihail-Constantin Carausu > Cc: ipt(a)lists.gbif.org > Betreff: Re: [IPT] Beta update > > > Thank you very much. > > I suggest starting with 0.5million, and then 1 million and then 3 > million. > I will be surprised if this works without some bug fixing. > > You may just use http://ipt.gbif.org rather than installation. > > Thanks Mihail, help with tests like this is greatly appreciated. > > Tim > > >> Dear Tim >> >> I can volunteer for uploading up to 3 million records if you want. >> The >> only problem is I have not installed yet the IPT software on our >> servers >> (sorry) because I didn't get the time, yet. But I will definitely >> try to >> do the installation tomorrow and the upload too. >> >> Best wishes >> Mihail >> >> ---------------------------- >> Mihail Carausu >> MSc.Eng., Informatics Manager >> Danish Biodiversity Information Facility (DanBIF) >> c/o Zoological Museum >> University of Copenhagen >> Universitetsparken 15 >> DK-2100 Copenhagen Ø >> >> Tel.: (+45) 3532 1063 >> Mobil:(+45) 2618 3636 >> email:mccarausu@zmuc.ku.dk >> web: http://www.DanBIF.dk >> ....oooO.............. >> ....(....)....Oooo.... >> .....)../. ...(....)... >> .....(_/.......)../...... >> .............. (_/....... >> -------------------------------------------- >> >> >> -----Original Message----- >> From: ipt-bounces(a)lists.gbif.org [mailto:ipt- >> bounces(a)lists.gbif.org] On >> Behalf Of Tim Robertson >> Sent: 26. februar 2009 16:26 >> To: ipt(a)lists.gbif.org >> Subject: [IPT] Beta update >> >> Dear All, >> >> A new version has just been deployed, and all user accounts have been >> kept intact, but you will notice significant changes, and we hope >> improvements. >> Please use the http://code.google.com/p/gbif-providertoolkit/issues/ >> list to track and input issues. >> >> If there is a volunteer wishing to test an upload of a large dataset >> (500,000+ records) it would be very much appreciated if you could >> report back on the experience. >> >> Thanks for all your feedback, >> >> Best wishes, >> >> Tim >> >> _______________________________________________ >> IPT mailing list >> IPT(a)lists.gbif.org >> http://lists.gbif.org/mailman/listinfo/ipt >> >> > > > ____________________________________________________________ > Tim Robertson > Systems Architect > Global Biodiversity Information Facility Secretariat (GBIF) > Universitetsparken 15, 2100 Copenhagen Ø, Denmark > http://www.gbif.org > trobertson(a)gbif.org > Phone: +45 35 32 14 87 (Office) > Fax: +45 35 32 14 80 > ____________________________________________________________ > > _______________________________________________ > IPT mailing list > IPT(a)lists.gbif.org > http://lists.gbif.org/mailman/listinfo/ipt >

1 0

User Manager
by Holetschek, Jörg 11 Mar '09

11 Mar '09

Hi Tim & Markus, it's not possible in our installation to edit any user. There's an error in the underlying link is http://de.mirror.gbif.org/ipteditUser.html?id=5&from=list Is there something I can do about it? Cheers, Jörg -----Ursprüngliche Nachricht----- Von: ipt-bounces(a)lists.gbif.org [mailto:ipt-bounces@lists.gbif.org]Im Auftrag von Tim Robertson (GBIF) Gesendet: Donnerstag, 26. Februar 2009 21:00 An: Mihail-Constantin Carausu Cc: ipt(a)lists.gbif.org Betreff: Re: [IPT] Beta update Thank you very much. I suggest starting with 0.5million, and then 1 million and then 3 million. I will be surprised if this works without some bug fixing. You may just use http://ipt.gbif.org rather than installation. Thanks Mihail, help with tests like this is greatly appreciated. Tim > Dear Tim > > I can volunteer for uploading up to 3 million records if you want. The > only problem is I have not installed yet the IPT software on our servers > (sorry) because I didn't get the time, yet. But I will definitely try to > do the installation tomorrow and the upload too. > > Best wishes > Mihail > > ---------------------------- > Mihail Carausu > MSc.Eng., Informatics Manager > Danish Biodiversity Information Facility (DanBIF) > c/o Zoological Museum > University of Copenhagen > Universitetsparken 15 > DK-2100 Copenhagen Ø > > Tel.: (+45) 3532 1063 > Mobil:(+45) 2618 3636 > email:mccarausu@zmuc.ku.dk > web: http://www.DanBIF.dk > ....oooO.............. > ....(....)....Oooo.... > .....)../. ...(....)... > .....(_/.......)../...... > .............. (_/....... > -------------------------------------------- > > > -----Original Message----- > From: ipt-bounces(a)lists.gbif.org [mailto:ipt-bounces@lists.gbif.org] On > Behalf Of Tim Robertson > Sent: 26. februar 2009 16:26 > To: ipt(a)lists.gbif.org > Subject: [IPT] Beta update > > Dear All, > > A new version has just been deployed, and all user accounts have been > kept intact, but you will notice significant changes, and we hope > improvements. > Please use the http://code.google.com/p/gbif-providertoolkit/issues/ > list to track and input issues. > > If there is a volunteer wishing to test an upload of a large dataset > (500,000+ records) it would be very much appreciated if you could > report back on the experience. > > Thanks for all your feedback, > > Best wishes, > > Tim > > _______________________________________________ > IPT mailing list > IPT(a)lists.gbif.org > http://lists.gbif.org/mailman/listinfo/ipt > > ____________________________________________________________ Tim Robertson Systems Architect Global Biodiversity Information Facility Secretariat (GBIF) Universitetsparken 15, 2100 Copenhagen Ø, Denmark http://www.gbif.org trobertson(a)gbif.org Phone: +45 35 32 14 87 (Office) Fax: +45 35 32 14 80 ____________________________________________________________ _______________________________________________ IPT mailing list IPT(a)lists.gbif.org http://lists.gbif.org/mailman/listinfo/ipt

3 3