- IPT - lists.gbif.org

Re: [IPT] IPT post from mukul.kapur@gmail.com requires approval
by Tim Robertson (GBIF) 09 Jan '11

09 Jan '11

Dear Mukul, Thank you also from me for your interest in the IPT, and your offer to contribute. The IPT has recently undergone a huge refactoring effort recently, with the latest IPT 2.0 in the trunk/gbif-ipt directory. It is this codebase that we are all working towards. We have just announced 2.0RC3 and are shortly going to release version 2.0GA, but following this there is likely to be some exciting new developments on the IPT during 2011. I think it could be a great time to be involved; The IPT development team is widespread (Colombia, US, Denmark, Germany and I am in Kiribati currently and there are active testers in Sweden, France, Argentina, Italy, Australia, Korea, Taiwan, Madagascar, India etc etc) - we anticipate worldwide installations. Like Markus says, and similar to the way Apache runs open source projects, the best way to get into the project would be to indicate that you are working on an issue, and then submit a patch (eclipse right click, create patch) which will be verified by a developer before being applied to the truck. I would suggest doing a couple of very small ones, before tackling something more sizable - there are things like setting eclipse to use the correct coding conventions (http://rs.gbif.org ) that need to be respected, and with appropriate JUnit coverage where applicable before code will be accepted. After a few contributions, you would then become a committer. There are some issues in there to build some good unit test coverages - this could be a good place to learn the code, which will make a great addition to the continued stability of the software, especially as the development team expands. Best wishes and thank you for your interest Tim On Jan 9, 2011, at 6:33 AM, Markus Döring (GBIF) wrote: > Dear Mukul, > as the IPT is an open source project we always welcome > contributions. Before you dive into the codebase though be aware > that we use struts2, google guice instead of spring and only a very > slim persistency layer around XStream using xml files. > > Issues targeted at the next 2.0.1 release might be candidates to > work on: > http://code.google.com/p/gbif-providertoolkit/issues/list?q=milestone=Relea… > > If you are interested in working on any of these issues please drop > us a line. > As a start please send us patches before we will make you a committer. > > Developer documentation is on its way, but as a start we have this > FAQ and some more wiki pages: > http://code.google.com/p/gbif-providertoolkit/wiki/DeveloperFAQ > > Thanks for getting in touch, > > Markus > > > -- > Markus Döring > Senior Developer ECAT > GBIF Secretariat > mdoering(a)gbif.org > > > On Jan 8, 2011, at 15:59, ipt-owner(a)lists.gbif.org wrote: > >> As list administrator, your authorization is requested for the >> following mailing list posting: >> >> List: IPT(a)lists.gbif.org >> From: mukul.kapur(a)gmail.com >> Subject: Fwd: Enquiry for volunteer contribution to gbif project >> Reason: Post by non-member to a members-only list >> >> At your convenience, visit: >> >> http://lists.gbif.org/mailman/admindb/ipt >> >> to approve or deny the request. >> >> From: Mukul Kapur <mukul.kapur(a)gmail.com> >> Date: January 8, 2011 15:59:45 GMT+01:00 >> To: ipt(a)lists.gbif.org >> Subject: Fwd: Enquiry for volunteer contribution to gbif project >> >> >> >> Hi >> >> I am a junior software developer from New Delhi India. >> >> I was looking for some hands on experience on Struts/Spring/ >> Hibernate framework . >> >> I wished to enquire whether the gbif project is currently looking >> for any volunteer developers.. >> >> Looking forward to hearing from you.. >> >> Thanks and Regards >> >> Mukul >> >> >> >> >> >> >> From: ipt-request(a)lists.gbif.org >> Subject: confirm cd6bce1f1071cc4a876301519cc087bd7e7a791a >> >> >> If you reply to this message, keeping the Subject: header intact, >> Mailman will discard the held message. Do this if the message is >> spam. If you reply to this message and include an Approved: header >> with the list password in it, the message will be approved for >> posting >> to the list. The Approved: header can also appear in the first line >> of the body of the reply. >> > > > > > > > > > > >

1 0

Fwd: Enquiry for volunteer contribution to gbif project
by Mukul Kapur 09 Jan '11

09 Jan '11

Hi I am a junior software developer from New Delhi India. I was looking for some hands on experience on Struts framework . I wished to enquire whether the gbif project is currently looking for any volunteer developers.. Looking forward to hearing from you.. Thanks and Regards Mukul

1 0

IPT 2.0RC3 available for download
by Tim Robertson 08 Jan '11

08 Jan '11

Dear all, The IPT development team are happy to announce that the IPT 2.0 release candidate 3 (IPT 2.0RC3) is now available for download and testing from http://code.google.com/p/gbif-providertoolkit/downloads/list Thank you once again to everyone who has reported bugs and proposed enhancements during the testing phase. Since the IPT 2.0RC2 was released some further 36 issues have been reported and addressed (http://tinyurl.com/2dev7uu ), with a total of 159 issues now fixed since testing commenced – well done to everyone involved! As we are approaching the 2.0 General Availability release, RC3 allows users to configure the IPT to register against the GBIF live registry and register and publish data to the GBIF network. On a new installation, after the data directory is selected, you may choose “production use”, which will ensure the IPT communicates with the LIVE GBIF registry. Once selected, this cannot be altered so please be vigilant in your selection. If your intention is to test and evaluate, please do not select production installation. The expectation is that the 2.0 General Availability release (2.0GA) will be offered in week 3, 2011, but this will not be done without the agreement from the testing community. During that week, we will call a vote on the mailing list, to ask if anyone believes the IPT is not yet ready to use for publishing data through GBIF so please consider this during your testing. Following 2.0GA we will continue to provide corrective fixes, and will initiate discussions on the future direction and functionality of the product. The IPT roadmap planning is primarily based on the issues reported on http://code.google.com/p/gbif-providertoolkit/issues/list Thank you once again for all your contributions and we welcome all suggestions on how we can improve the process. Kind regards, Tim, on behalf of the IPT development team

1 0

IPT-2.0RC2: no .jsp files
by Bruce Wilson 17 Dec '10

17 Dec '10

I must be doing something wrong in the installation of the itp-2.0RC2.war file. Here is what I did: 1. Download ipt-2.0RC2.war into the .../tomcat 6.0/webapps folder (in a Windows Server 2003 system) 2. Wait for the directories to be built out: only webapps/itp-2.0RC2/WEB-INF was created. No index.jsp showed up. 3. Go to http://science.uvu.edu:8080/itp-2.0RC2/ and get only an apache 404 error message. So is this a problem in the installer not having all the files it needs, or should I have named it itp.war to put the new .jar files into the existing ipt-1.0RC3 installation (which I renamed to just /ipt/)? I guess a third option exists, should I just not try to test and wait for the GA release? References: http://science.uvu.edu:8080/ipt/ current 1.0RC3 installation, not completed, unpublished, but mostly running http://science.uvu.edu:8080/ipt-2.0RC2/ the 404 error message. Directory structure created: ../tomcat 6.0/webapps/ipt-2.0RC2/WEB-INF/classes (contains one .properties file) ../tomcat 6.0/webapps/ipt-2.0RC2/WEB-INF/lib (contains 11.3 MB in 35 .jar files) Bruce Wilson Department of Chemistry | Mail Stop 179 | UVU | 800 W University Parkway, Orem UT 84058 (801)863-7138 | bruce.wilson(a)uvu.edu | http://science.uvu.edu/wilson

2 3

IPT 2.0RC2 available for download
by Tim Robertson (GBIF) 15 Dec '10

15 Dec '10

Dear all, The IPT development team are happy to announce that the IPT 2.0 release candidate 2 (IPT 2.0RC2) is now available for download and testing from http://code.google.com/p/gbif-providertoolkit/downloads/list Thank you once again to everyone who has reported bugs and proposed enhancements during the testing phase. Since the IPT 2.0RC1 was released some 43 issues have been reported and addressed (http://tinyurl.com/2g9jzjo) In particular the following critical issues have been worked on, and any assistance in testing them would be greatly appreciated. - IPT operation on windows environments - Performance in connection of the IPT to databases (PostGRES, MySQL, Oracle, MSSql) - We particularly seek assistance testing connections to Oracle and MSSql The IPT will not be released until the testing community confirms that the product is suitably robust to do so. At this stage, we anticipate releasing 2.0RC3 during week 1, 2011 which will allow users to register against the live GBIF registry, with the expectation that a final 2.0 General Availability release (2.0GA) will be offered in week 3, 2011. However, this depends on the outcome of further tests. Our roadmap planning is based on the issues on http://code.google.com/p/gbif-providertoolkit/issues/list Thank you once again for all your contributions and as always, we welcome suggestions on how we can improve the process. Kind regards, Tim, on behalf of the IPT development team

1 0

Open call for testing of the IPT 2.0RC1
by Tim Robertson 14 Dec '10

14 Dec '10

Dear all, The IPT development team are pleased to invite you to participate in the testing of the re-engineered and simplified IPT. The revised IPT is the result of a re-engineering effort of the 1.0 version of the IPT, specifically to: - Reduce the server requirements significantly - Increase the data import performance by removing the embedded database - Remove the dependency on heavy libraries and tools such as Geoserver - Remove all data interfaces that are not necessary for data publication through GBIF - Improve the robustness of the tool The result is an IPT that: - is less than 12MB - starts in only a few seconds - supports fast import (1 million records in 15 seconds or so) - includes an expanded metadata profile - supports the importing of DwC Archives - allows multiple organisation support (an IPT may be installed by an institution, but the resource associated with a different institution) We would like to thank those early testers who have helped us, over the last 5 weeks, identify and address some 81 issues and enhancements already (http://code.google.com/p/gbif-providertoolkit/issues/list?can=1&q=Milestone… ). All reported defects have been addressed, and therefore we have indicated this is a version that is a candidate for being a formal release and therefore labelled IPT 2.0RC1. Issues are actively being tracked, monitored and will be prioritised and addressed, and I ask that you use this utility to record any issues that you come across: http://code.google.com/p/gbif-providertoolkit/issues/list The user manual and engineering documentation drafting are under way and expected to be finished by the end of 2010 prior to the general availability (IPT 2.0GA) release. The IPT 2.0GA release is targeted by the end of the 2010 but will only be made available following a successful community test phase. The IPT 2.0RC1 for this test can be downloaded: http://gbif-providertoolkit.googlecode.com/files/ipt-2.0RC1.war The IPT 2.0RC1 is restricted for use to the GBIF development registry at this stage and therefore can not be used for publication onto the GBIF network during this testing phase. Please find attached some basic guideline information for testers in the absence of the user manual. Thank you once again to all IPT contributers. Best wishes, Tim

5 4

v2.0 release timeline?
by Bruce Wilson 18 Nov '10

18 Nov '10

Hi All. Does an timeline exist for deployment of the v2.0 IPT package? I've been moving slowly on publishing via the v1.0-RC3 package anticipating the release of v2.0. Bruce Wilson - UVSC Department of Chemistry | Mail Stop 179 | UVU | 800 W University Parkway, Orem UT 84058 (801)863-7138 | bruce.wilson(a)uvu.edu | http://science.uvu.edu/wilson

2 1

Notes on configuring RHEL to run IPT (ipt-2.0-SNAPSHOT-r2482)
by Matt 18 Nov '10

18 Nov '10

Hi all, Some notes on my recent effort to get IPT running on RHEL- at minimum they'll help me remember howto repeat this for real in the future. Special thanks to Tim for the very speedy help. One quick question now- if I configure everything is it easy to save the configuration file, then wipe the install, then toss the config back in? Cheers, Matt --- Running RHEL (Realm Linux flavour), see http://www.linux.ncsu.edu/realm_linux/. Did (all) this as a su. Yum installed packages of note (I'm not sure if these were all required or not, it's just the overall configuration): java-1.4.2-gcj-compat.x86_64 java-1.4.2-gcj-compat-devel.x86_64 java-1.6.0-openjdk.x86_64 java-1.6.0-openjdk-devel.x86_64 java_cup.x86_64 xalan-j2.x86_64 xalan-j2-xsltc.x86_64 xerces-j2.x86_64 xerces-j2-scripts.x86_64 tomcat5.x86_64 tomcat5-common-lib.x86_64 tomcat5-jasper.x86_64 tomcat5-jsp-2.0-api.x86_64 tomcat5-server-lib.x86_64 tomcat5-servlet-2.4-api.x86_64 tomcat5-webapps.x86_64 I answered y to all the dependency questions on yum installs. It took me a bit to figure out that the the webapps folder linked at /usr/share/tomcat5/webapps or /var/lib/tomcat5/webapps After cding there I grabbed the files wget http://gbif-providertoolkit.googlecode.com/files/ipt-2.0-SNAPSHOT-r2482.war wget http://gbif-providertoolkit.googlecode.com/files/ipt-geoserver-1.0-RC3.zip Then I chowned/chgrped them to user 'tomcat' and did 'service tomcat5 restart'. After you hit http://your.site.com:8080/ipt-2.0-SNAPSHOT-r2482 you'll have a ipt-2.0-SNAPSHOT-r2482 folder back in webapps. Went there, and edited webapps/ipt/WEB-INF/classes/log4j.xml changing the log lines to: <param name="file" value="/tmp/debug.log "/> <param name="file" value="/tmp/admin.log "/> Note that the Issue 451 fix describing this problem doesn't include the slash preceding tmp in the steps body but the attached file does (the latter is correct). The last trick was to: cd /var/lib/tomcat5/common/endorsed and do a number of "rebuild-jar-repository" rebuild-jar-repository /var/lib/tomcat5/common/endorsed xalan-j2-serializer.jar rebuild-jar-repository /var/lib/tomcat5/common/endorsed xalan-j2.jar rebuild-jar-repository /var/lib/tomcat5/common/endorsed xerces-j2.jar ... and some others The end product of the endorsed folder looks like this: [jaxp_parser_impl].jar -> /usr/share/java/jaxp_parser_impl.jar [xalan-j2-2.7.0].jar -> /usr/share/java/xalan-j2-2.7.0.jar [xalan-j2].jar -> /usr/share/java/xalan-j2.jar [xalan-j2-serializer].jar -> /usr/share/java/xalan-j2-serializer.jar [xerces-j2-2.7.1].jar -> /usr/share/java/xerces-j2-2.7.1.jar [xerces-j2].jar -> /usr/share/java/xerces-j2.jar [xml-commons-apis].jar -> /usr/share/java/xml-commons-apis.jar The xalan-j2-serializer.jar was definitely needed as including this link ultimately resolved the problem. I'm not sure which others were required. After all this (and at various points in the debugging) a "service tomcat5 restart" and the site was live.

2 1

Configuring IPT for RHEL/Centos?
by Matt 18 Nov '10

18 Nov '10

Hi All, Trying to get IPT running. I assume it's possible to do on linux? Is it possible to configure remotely (i.e. not going the localhost route as per the docs)? I think I'm configured thus far correctly since I can see /geoserver fine. I tried both the 1.0 RC3 and the 2.0 invite versions. Present error is a 404, resource () not found. Running Apache Tomcat/5.5.23 installed via yum. Any thoughts? I'd be happy to document the process if I can get something running. Thanks in advance, Matt

3 3

Re: [IPT] IPT v2 Snapshot frequency
by "Markus Döring (GBIF)" 16 Oct '10

16 Oct '10

when setting up a data directory for the IPT a small file called "datadir.location" is created in the WEB-INF folder that points to the actual data dir. If you simply remove this file you force the IPT to the setup page. You can enter an existing data dir if you want and all its configuration is loaded - or create a new, empty one. For jetty when running "mvn" this file is kept with the source files. To remove it simply do: $ cd gbif-ipt $ rm src/main/webapp/WEB-INF/datadir.location Markus On Oct 15, 2010, at 14:12, Nicolas Noé wrote: > One last question, when playing with it (without building the war, letting mvn launch jetty), how can I restore it to its original state (to lose all configurations and send me back on the first (select datat dir) page ? > > Thanks, > > Nicolas > > On 10/15/2010 12:07 PM, "Markus Döring (GBIF)" wrote: >> Nicolas, >> that is indeed a good idea. We will consider some regular build of the war, maybe even on a daily basis. I will upload a new version later today once the serious bugs are fixed that Ive introduced when refactoring the http/registry communication. >> >> If you ever want to try the latest trunk from the svn its rather simple if you have java, maven and svn installed (OSX comes with all of these): >> >> $ svn checkout http://gbif-providertoolkit.googlecode.com/svn/trunk/gbif-ipt >> $ cd gbif-ipt >> $ mvn >> >> The last "mvn" command should start up the IPT with a local jetty instance on port 7001 and you can go into your browser of choice with this url: >> http://localhost:7001/ipt >> >> If you want to build a war instead you need to issue a different maven command: >> >> $ mvn install >> >> and then you should find the war in this folder (example revision 2396): >> >> $ cp target/ipt-2.0-RC1-SNAPSHOT-r2396.war >> >> >> When you do the maven command for the very first time it will download quite a few libraries, so you need some patience at that point. But when done once it will be fairly fast afterwards, even if you update to the latest trunk again. That can be done like this by the way: >> >> $ cd gbif-ipt >> $ svn up >> >> Markus >> >> >> On Oct 15, 2010, at 11:48, Nicolas Noé wrote: >> >>> Hi, >>> >>> With the current move to the v2 of the IPT and the very fast development of the last few weeks, I think it could be great to provide development snapshots (similar to the one Tim uploaded a few days ago) on a regular and very frequent basis. >>> >>> For example, I've reported a bug 2 days ago that is supposed to be fixed, and I'd like to re-test this and investigate deeper the IPT (hat bug make me stuck at the beginning), so I could follow the development day after day and provide immediate feedback to the development team. I think this transparency and rapid feedback mechanism is important if we want a very fast development rate and at the same time keep a good stability. It could also lead to a better communication between IPT developers and end users (for example to keep them aware of which features/bugs should be on the top-priority list). >>> >>> I see 3 ways to make these builds for "faster feedback" possible : >>> >>> 1) The GBIF manually creates "ipt-snapshot.war" on a regular basis (i.e. weekly) >>> 2) Putting an automatic mechanism to create these builds, the frequence could so be increased (nightly builds). >>> 3) Update (and detail) the documentation of the build process on the wiki (available for v1). The java build process/ build tools and the quirks that can be encountered at that step can be, to say the least, quite intimidating for someone who isn't a Java developer. >>> >>> What do you think of this ? >>> >>> Thanks, Nicolas. >>> <niconoe.vcf>_______________________________________________ >>> IPT mailing list >>> IPT(a)lists.gbif.org >>> http://lists.gbif.org/mailman/listinfo/ipt > > <niconoe.vcf>

1 0