<div dir="ltr">Hi Nick and Dave,<div><br></div><div>We are having some problems in Biocache during the upload of DwC-A files.</div><div><br></div><div><div>As shown below, after run the method "au.org.ala.util.DwCALoader", our system returns the error message <font color="#ff0000">"Exception in thread "main" org.gbif.dwc.text.UnkownDelimitersException: Unable to detect field delimiter"</font></div>
<div><br></div><div>I accomplished tests using DwC-A files with tab-delimited text files and comma-delimited text files. In both cases the error generated was the same.</div></div><div><br></div><div>What causes these problems? (** CSV Loader works great)<br>
</div><div><br></div><div><b><i><span id="7bc71814-c1fc-4832-a6d6-35f9ac12478a" class="GINGER_SOFTWARE_mark">tab</span>-delimited file test</i></b></div><div><b><br></b></div><div><div>poliusp@poliusp-VirtualBox:~/dev/biocache$ s<b>udo java -cp .:biocache.jar au.org.ala.util.DwCALoader dr7 -l /data/collectory/upload/1398658607824/2f676abc-4503-489e-8f0c-fcb6e1bc554b.zip</b></div>
<div>2014-04-28 01:44:02,837 INFO<span id="4ea8f30e-c250-4efa-bc23-cdb2447fca3e" class="GINGER_SOFTWARE_mark"> :</span> [<span id="94ddbe70-4055-41c3-af19-ef2a2d20ca17" class="GINGER_SOFTWARE_mark">ConfigModule</span>] - Loading configuration from /data/biocache/config/biocache-config.properties</div>
<div>2014-04-28 01:44:03,090 INFO<span id="f5fc5bee-1050-49ad-9757-754ec3c186a7" class="GINGER_SOFTWARE_mark"> :</span> [<span id="062f8f95-e1b9-4e43-8592-19c40deb7d8e" class="GINGER_SOFTWARE_mark">ConfigModule</span>] - Initialise SOLR</div>
<div>2014-04-28 01:44:03,103 INFO<span id="859fae9d-c751-4302-ae26-17fcc9c11450" class="GINGER_SOFTWARE_mark"> :</span> [<span id="c15767b9-4f4b-4152-b7a2-c59da78c4a51" class="GINGER_SOFTWARE_mark">ConfigModule</span>] - <span id="e5e62c3e-f355-4001-9675-5a6ad90787ed" class="GINGER_SOFTWARE_mark">Initialise</span> name matching indexes</div>
<div>2014-04-28 01:44:03,605 INFO<span id="b6d1ba33-a6e0-48ac-849c-ffe93079795e" class="GINGER_SOFTWARE_mark"> :</span> [<span id="33161cb4-766c-4dae-a21c-c9447fde89bc" class="GINGER_SOFTWARE_mark">ConfigModule</span>] - Initialise persistence manager</div>
<div>2014-04-28 01:44:03,606 INFO<span id="9fcdfe4a-78f6-4365-b982-da51ffbbb76a" class="GINGER_SOFTWARE_mark"> :</span> [<span id="ddb1677c-cf21-4e11-aea6-5304aa4743f1" class="GINGER_SOFTWARE_mark">ConfigModule</span>] - Configure complete</div>
<div>Loading archive /data/<span id="2dde5863-af87-4fae-8d7c-9eb20701f1e2" class="GINGER_SOFTWARE_mark">collectory</span>/upload/1398658607824/2f676abc-4503-489e-8f0c-fcb6e1bc554b<span id="a1d09047-bf57-4d4e-98c7-331dc6ee83d5" class="GINGER_SOFTWARE_mark">.</span>zip for resource dr7 with unique terms List<span id="dc2e15ea-3065-4922-9a48-ed519b28720e" class="GINGER_SOFTWARE_mark">(</span><span id="603eaa14-b3bb-4180-a45f-94a0065bdd48" class="GINGER_SOFTWARE_mark">dwc</span><span id="adede8fc-75a0-4173-95e0-cb5deb7e1bb8" class="GINGER_SOFTWARE_mark">:</span><span id="826f8fff-5f29-498f-8b0e-2394c0a7db98" class="GINGER_SOFTWARE_mark">occurrenceID</span>) stripping spaces false incremental false testing <span id="e1f3c2b6-25f7-4246-9cbd-2b2734d6b3fd" class="GINGER_SOFTWARE_mark">false</span></div>
<div><b>Exception in thread "main" org<span id="75d01506-c73a-4b39-b758-bf6e908d0e31" class="GINGER_SOFTWARE_mark">.</span><span id="c748d274-eee2-475d-a284-720c9beb4a7d" class="GINGER_SOFTWARE_mark">gbif</span><span id="ea6bc9d6-2a8a-4a85-b2fd-e2446c49b5b5" class="GINGER_SOFTWARE_mark">.</span><span id="b24a3154-b094-41c0-bab0-1aa30ea3fabb" class="GINGER_SOFTWARE_mark">dwc</span><span id="9745f62f-1198-4032-b013-614ce01b90fb" class="GINGER_SOFTWARE_mark">.</span>text<span id="4566c688-4462-42b2-96d7-003e4b7963e3" class="GINGER_SOFTWARE_mark">.</span>UnkownDelimitersException: Unable to detect field delimiter</b></div>
<div> <span id="23da1997-855c-41bd-9c0a-b0340b6b8ccb" class="GINGER_SOFTWARE_mark">at</span> org<span id="0f1c211e-45cb-4c9f-bf62-f1c70035a9f2" class="GINGER_SOFTWARE_mark">.</span><span id="3368b197-0e41-4756-992e-dcc9384d36e7" class="GINGER_SOFTWARE_mark">gbif</span><span id="a97cf445-fca7-430f-8acb-f4dd27552dc3" class="GINGER_SOFTWARE_mark">.</span>file<span id="8fa69e8b-2014-4e56-8844-1d61834a3741" class="GINGER_SOFTWARE_mark">.</span>CSVReaderFactory<span id="831b0bfc-2a73-42bf-a9aa-27046803383b" class="GINGER_SOFTWARE_mark">.</span><span id="84493c98-7f2c-488e-b326-6332ea79a205" class="GINGER_SOFTWARE_mark">buildArchiveFile</span><span id="68d4728e-f242-4397-a96f-ebf823c0aab3" class="GINGER_SOFTWARE_mark">(</span>CSVReaderFactory.java<span id="9635f0ae-8bc7-44e8-bd0e-6a96bf4fb95f" class="GINGER_SOFTWARE_mark">:</span>129)</div>
<div> <span id="23168c79-bdb0-4bf1-86c7-44d6b369d66b" class="GINGER_SOFTWARE_mark">at</span> org<span id="2a1b65d4-0fb4-4e7f-b3b7-e97769829d49" class="GINGER_SOFTWARE_mark">.</span><span id="295880f0-d317-463b-bfce-785239b24bd6" class="GINGER_SOFTWARE_mark">gbif</span><span id="655aedcf-7f60-4018-82c9-666fc2ccf422" class="GINGER_SOFTWARE_mark">.</span>file<span id="270b9bfb-e169-48b2-b57e-a6ec5248f5ce" class="GINGER_SOFTWARE_mark">.</span>CSVReaderFactory<span id="b1f40a10-63d0-4ab2-9cb8-1923077ef5ab" class="GINGER_SOFTWARE_mark">.</span>build<span id="90e7d10f-917b-471e-956f-bd6a13b0b6e3" class="GINGER_SOFTWARE_mark">(</span>CSVReaderFactory.java<span id="5047dece-2b57-4af2-8756-eb3badcb5556" class="GINGER_SOFTWARE_mark">:</span>46)</div>
<div> <span id="cdb2b753-bc3e-4c62-8df1-313562aa1025" class="GINGER_SOFTWARE_mark">at</span> org<span id="dfafb499-874c-48ee-b049-14f8a67794d0" class="GINGER_SOFTWARE_mark">.</span><span id="b937d319-b8c7-45e9-9e9f-35859d878812" class="GINGER_SOFTWARE_mark">gbif</span><span id="d2d52782-62c0-4eac-9f3d-ed870703fba4" class="GINGER_SOFTWARE_mark">.</span><span id="1e3e69d6-e56e-47bb-a67b-37179deb1d20" class="GINGER_SOFTWARE_mark">dwc</span><span id="188567fb-3d0a-4ea3-a7e7-4c6cd1b2db6d" class="GINGER_SOFTWARE_mark">.</span>text<span id="bf2a6834-3869-4aff-99cb-222202df5836" class="GINGER_SOFTWARE_mark">.</span>ArchiveFactory<span id="9805bd17-8e64-4d6e-9055-46f6a407ed3b" class="GINGER_SOFTWARE_mark">.</span><span id="51597fca-1ca7-4479-bf36-ff32a7fcb152" class="GINGER_SOFTWARE_mark">readFileHeaders</span><span id="ef2290ff-9362-44cc-b599-a0f4c3534d25" class="GINGER_SOFTWARE_mark">(</span>ArchiveFactory.java<span id="eb0a5195-ddc9-4ffc-bd16-98681129c662" class="GINGER_SOFTWARE_mark">:</span>344)</div>
<div> <span id="f6ce6165-cbab-4dd6-87c3-ef1139026d50" class="GINGER_SOFTWARE_mark">at</span> org<span id="a30167ee-4a77-46a2-87a2-28863d78ffd0" class="GINGER_SOFTWARE_mark">.</span><span id="f2556bd2-b703-46da-92d5-164ca10afca6" class="GINGER_SOFTWARE_mark">gbif</span><span id="2ae9a5fa-1fd9-4478-b9f0-346fec9c7ba7" class="GINGER_SOFTWARE_mark">.</span><span id="f6340af6-ad21-4007-bb47-87fd5c780c3f" class="GINGER_SOFTWARE_mark">dwc</span><span id="34675b92-ef79-4540-89fc-b121f257f028" class="GINGER_SOFTWARE_mark">.</span>text<span id="5f299d1d-336a-4022-8856-dde0b84524e8" class="GINGER_SOFTWARE_mark">.</span>ArchiveFactory<span id="9c2856ff-f685-4741-abb3-97643bea0471" class="GINGER_SOFTWARE_mark">.</span><span id="56eda9ac-423e-4676-8d99-dfa41d2e9322" class="GINGER_SOFTWARE_mark">openArchive</span><span id="d66beced-016b-46cd-9e7d-332fb57ba1ff" class="GINGER_SOFTWARE_mark">(</span>ArchiveFactory.java<span id="aa5d677f-1599-4d0e-8842-c3bbfd91acb1" class="GINGER_SOFTWARE_mark">:</span>289)</div>
<div> <span id="451a97b3-4412-4e11-b9e3-5cbf9763fa34" class="GINGER_SOFTWARE_mark">at</span> au.org.ala.util.DwCALoader.loadArchive(DwCALoader.scala:129)</div><div> <span id="4f70a547-8039-4829-a75e-5dcd7b4150c3" class="GINGER_SOFTWARE_mark">at</span> au.org.ala.util.DwCALoader.loadLocal(DwCALoader.scala:106)</div>
<div> <span id="e437f5dd-a273-4b31-9009-e3b7b0bd77f6" class="GINGER_SOFTWARE_mark">at</span> au.org.ala.util.DwCALoader$.main(DwCALoader.scala:52)</div><div> <span id="bdf8b8cf-e6e5-42c0-ad8a-871cffe48232" class="GINGER_SOFTWARE_mark">at</span> au.org.ala.util.DwCALoader.main(DwCALoader.scala)</div>
<div><br></div><div><br></div><div><b><i><span id="ace00022-8d18-446f-ad72-1d8390acd505" class="GINGER_SOFTWARE_mark">comma</span>-delimited file test</i></b><br></div><div><br></div><div><div>poliusp@poliusp-VirtualBox:~/dev/biocache$ <b>sudo java -cp .:biocache.jar au.org.ala.util.DwCALoader dr7 -l ./<span id="81dc9843-f40a-46ef-be9f-2f26108395d0" class="GINGER_SOFTWARE_mark">dwca</span>-teste3<span id="1e7452c6-c88d-424c-b9c5-4823c93544e0" class="GINGER_SOFTWARE_mark">.</span>zip</b></div>
<div>2014-04-28 01:56:04,683 INFO<span id="8522049a-ba3e-4eca-9de5-0728391c459b" class="GINGER_SOFTWARE_mark"> :</span> [<span id="8376b937-03d5-4b9e-8ecd-69ae792b39cd" class="GINGER_SOFTWARE_mark">ConfigModule</span>] - Loading configuration from /data/biocache/config/biocache-config.properties</div>
<div>2014-04-28 01:56:04,940 INFO<span id="1542bad6-1119-4758-a32b-cd4b1a549dcb" class="GINGER_SOFTWARE_mark"> :</span> [<span id="ecf213ef-6705-4a5e-9edf-e60d3abfcb17" class="GINGER_SOFTWARE_mark">ConfigModule</span>] - Initialise SOLR</div>
<div>2014-04-28 01:56:04,951 INFO<span id="90b9fa05-61ce-457f-9886-19ba1e983c08" class="GINGER_SOFTWARE_mark"> :</span> [<span id="dde669d6-d95d-45ec-8e5f-7af1f54ab68e" class="GINGER_SOFTWARE_mark">ConfigModule</span>] - <span id="e9f02563-d46c-4b46-89d0-7f20063b8aff" class="GINGER_SOFTWARE_mark">Initialise</span> name matching indexes</div>
<div>2014-04-28 01:56:05,437 INFO<span id="232c3a1e-c301-43b2-8a71-f4e821c8da3d" class="GINGER_SOFTWARE_mark"> :</span> [<span id="526565c0-8682-426e-963b-c0129de9e420" class="GINGER_SOFTWARE_mark">ConfigModule</span>] - Initialise persistence manager</div>
<div>2014-04-28 01:56:05,438 INFO<span id="398bb115-aa49-4d1c-9dff-5b6c253e011e" class="GINGER_SOFTWARE_mark"> :</span> [<span id="f05d4386-fc82-4f7f-9a11-765b28ba4180" class="GINGER_SOFTWARE_mark">ConfigModule</span>] - Configure complete</div>
<div>Loading archive<span id="4484fdb1-a78f-4387-be6d-9eb2a63ce5ce" class="GINGER_SOFTWARE_mark"> .</span>/<span id="ea85e164-65a2-4b7c-bf05-e53af4646fd8" class="GINGER_SOFTWARE_mark">dwca</span>-teste3<span id="8ada094c-332c-4be3-8398-b34ee3b324c2" class="GINGER_SOFTWARE_mark">.</span>zip for resource dr7 with unique terms List<span id="ee97b0e1-f412-4b7b-8c09-c50cbee831b6" class="GINGER_SOFTWARE_mark">(</span><span id="d0ed3bf5-ede5-4df2-bd35-bf4f057ad8ec" class="GINGER_SOFTWARE_mark">dwc</span><span id="1b02feff-4f62-4503-aefe-915f57adaa5d" class="GINGER_SOFTWARE_mark">:</span><span id="6219e92a-6d37-4bff-93ec-7d31dfa65e7b" class="GINGER_SOFTWARE_mark">occurrenceID</span>) stripping spaces false incremental false testing <span id="4a7745b8-1731-4756-99ce-da79f13ca497" class="GINGER_SOFTWARE_mark">false</span></div>
<div><b>Exception in thread "main" org<span id="bab3e1c9-487a-478e-a0df-a29db99d0471" class="GINGER_SOFTWARE_mark">.</span><span id="9a2fb2a9-ff69-40db-9d65-19940aeaf677" class="GINGER_SOFTWARE_mark">gbif</span><span id="72505e88-3e9f-4e97-bb5c-afde63fa9357" class="GINGER_SOFTWARE_mark">.</span><span id="974f90e8-1526-4c09-9ecd-73e389a21ec1" class="GINGER_SOFTWARE_mark">dwc</span><span id="fa307c8b-5355-4628-b442-860d459116ca" class="GINGER_SOFTWARE_mark">.</span>text<span id="9b0888d2-9128-43f4-ad77-29537f7fe5f1" class="GINGER_SOFTWARE_mark">.</span>UnkownDelimitersException: Unable to detect field delimiter</b></div>
<div> <span id="35ca4ef4-93f7-495f-a24c-df3f6f17d49f" class="GINGER_SOFTWARE_mark">at</span> org<span id="d11926f5-3954-4447-839b-09661f806b3a" class="GINGER_SOFTWARE_mark">.</span><span id="7f322522-b921-45f0-9408-9fb739583b64" class="GINGER_SOFTWARE_mark">gbif</span><span id="6152c3db-203d-4446-bd90-40dc2c04fd84" class="GINGER_SOFTWARE_mark">.</span>file<span id="321d107d-ac4d-4b22-a38a-00b7ad6508ef" class="GINGER_SOFTWARE_mark">.</span>CSVReaderFactory<span id="4e3e03fa-ab2d-4714-b012-151bfcb7c076" class="GINGER_SOFTWARE_mark">.</span><span id="2ffccda8-8a5a-46ca-b778-ff6cf7bbfc53" class="GINGER_SOFTWARE_mark">buildArchiveFile</span><span id="be853c58-f3a5-43e0-8254-baf27226bbca" class="GINGER_SOFTWARE_mark">(</span>CSVReaderFactory.java<span id="0ae827b2-cfea-4b56-8fe7-99ef87dc9068" class="GINGER_SOFTWARE_mark">:</span>129)</div>
<div> <span id="2b5ef466-3088-4219-b190-a4686f704be6" class="GINGER_SOFTWARE_mark">at</span> org<span id="d6142534-4c66-477c-953e-b532ea887715" class="GINGER_SOFTWARE_mark">.</span><span id="ed584ec5-aa18-4560-b15b-83f30851c3a0" class="GINGER_SOFTWARE_mark">gbif</span><span id="9b56a0de-99e1-4dbb-83ae-765759ef1c2c" class="GINGER_SOFTWARE_mark">.</span>file<span id="0538d5d6-9495-49f7-81f0-d221fabe35a9" class="GINGER_SOFTWARE_mark">.</span>CSVReaderFactory<span id="c1c12f0c-282f-489f-b7c9-85b06bc6499b" class="GINGER_SOFTWARE_mark">.</span>build<span id="2a20af99-a684-4b78-b12b-f5b0d09e62dd" class="GINGER_SOFTWARE_mark">(</span>CSVReaderFactory.java<span id="be8e20e4-4e7c-44c6-a67a-e2c08165a165" class="GINGER_SOFTWARE_mark">:</span>46)</div>
<div> <span id="99fdb233-697d-4d6f-8be1-3514363d4e76" class="GINGER_SOFTWARE_mark">at</span> org<span id="f9448653-25bc-4aca-9879-f355166a4007" class="GINGER_SOFTWARE_mark">.</span><span id="77cd0154-4948-4ced-b361-389c2d2bfa9f" class="GINGER_SOFTWARE_mark">gbif</span><span id="3a5f44ce-e51f-4780-bfd0-2f041bb6283a" class="GINGER_SOFTWARE_mark">.</span><span id="42db3f9f-7337-4008-8a4b-8d6d7374c635" class="GINGER_SOFTWARE_mark">dwc</span><span id="02ac23d5-2bba-428a-b434-893d886119db" class="GINGER_SOFTWARE_mark">.</span>text<span id="3d1d6490-3ec1-45e3-846b-504055a49879" class="GINGER_SOFTWARE_mark">.</span>ArchiveFactory<span id="d018eab9-4cf6-4a66-aff5-37943c463b89" class="GINGER_SOFTWARE_mark">.</span><span id="17936eb1-1477-4cc9-acd3-e0754f35de87" class="GINGER_SOFTWARE_mark">readFileHeaders</span><span id="a412e5c3-e03b-486a-b70b-8bfc8366396a" class="GINGER_SOFTWARE_mark">(</span>ArchiveFactory.java<span id="7c91b80f-d0fa-49ec-b3ec-7dc361069924" class="GINGER_SOFTWARE_mark">:</span>344)</div>
<div> <span id="5554807a-61a4-48fc-9cb9-04871ecf8c69" class="GINGER_SOFTWARE_mark">at</span> org<span id="d2a12e1e-19ad-4f22-8d02-a7afb0535eb3" class="GINGER_SOFTWARE_mark">.</span><span id="d20d395d-e976-4746-a659-50a090aec723" class="GINGER_SOFTWARE_mark">gbif</span><span id="3fcef46a-d2df-4cae-a043-6bf81c875832" class="GINGER_SOFTWARE_mark">.</span><span id="f432610e-4199-48f7-bf88-1d3fca10e04f" class="GINGER_SOFTWARE_mark">dwc</span><span id="e6464bf7-204f-46c8-89fa-55af9ad3bf46" class="GINGER_SOFTWARE_mark">.</span>text<span id="878ea93e-ef8b-47dc-a045-d0c7c99a64dc" class="GINGER_SOFTWARE_mark">.</span>ArchiveFactory<span id="d5c71b6e-44db-41b4-9548-d7dbeddfd2d6" class="GINGER_SOFTWARE_mark">.</span><span id="ae8938fb-67d9-4bdb-8c62-75ddbe33abda" class="GINGER_SOFTWARE_mark">openArchive</span><span id="8e472d0c-54c5-4e7b-9005-794cc50bb8b7" class="GINGER_SOFTWARE_mark">(</span>ArchiveFactory.java<span id="c3db3a6d-cb4a-4cf5-b308-58d9ae53de82" class="GINGER_SOFTWARE_mark">:</span>289)</div>
<div> <span id="4c1d9d40-34d6-4752-9841-ba5ea37c52b6" class="GINGER_SOFTWARE_mark">at</span> au.org.ala.util.DwCALoader.loadArchive(DwCALoader.scala:129)</div><div> <span id="d08d45e3-b741-4bab-a9c5-639d2759f6e9" class="GINGER_SOFTWARE_mark">at</span> au.org.ala.util.DwCALoader.loadLocal(DwCALoader.scala:106)</div>
<div> <span id="7c80b240-1340-4228-986a-d7e328925d24" class="GINGER_SOFTWARE_mark">at</span> au.org.ala.util.DwCALoader$.main(DwCALoader.scala:52)</div><div> <span id="f813e026-8d7f-41a2-a360-9f815b0b6361" class="GINGER_SOFTWARE_mark">at</span> au.org.ala.util.DwCALoader.main(DwCALoader.scala)</div>
</div><div><br></div><div><br></div><div>Thanks!</div><div><br></div><div>Regards.</div>-- <br><div><div class="gmail_extra" style="font-family:arial,sans-serif;font-size:13px">Daniel Lins da Silva</div><div class="gmail_extra" style="font-family:arial,sans-serif;font-size:13px">
(Mobile) <a href="tel:55%2011%2096144-4050" value="+5511961444050" target="_blank">55 11 96144-4050</a></div><div class="im" style="font-family:arial,sans-serif;font-size:13px"><div class="gmail_extra"><font color="#000000">Research Center <span id="c503d4ac-9544-4a27-921d-b91828d927bb" class="GINGER_SOFTWARE_mark">on</span> Biodiversity and Computing (Biocomp)</font></div>
<div class="gmail_extra"><font color="#000000">University of Sao Paulo, Brazil</font></div></div><div class="gmail_extra" style="font-family:arial,sans-serif;font-size:13px"><a href="mailto:daniellins@usp.br" target="_blank">daniellins@usp.br</a></div>
<div class="gmail_extra" style="font-family:arial,sans-serif;font-size:13px"><a href="mailto:daniel.lins@gmail.com" target="_blank">daniel.lins@gmail.com</a></div></div><div><br></div>
</div></div>