[Ala-portal] [ExternalEmail] Re: Using Biocache-Store and Apache Cassandra on different servers

[David.Martin at csiro.au]

I thought I'd just post the following shell transcript to the list in case its of use to others.
The cassandra-cli tool is part of the cassandra distribution.
To view the data in cassandra using the cassandra-cli tool:

mar759 at ala-ono:~$ cassandra-cli -h localhost -p 9160 -k occ

Column Family assumptions read from /home/mar759/.cassandra/assumptions.json

Connected to: "Biocache" on localhost/9160

Welcome to Cassandra CLI version 1.2.10


Type 'help;' or '?' for help.

Type 'quit;' or 'exit;' to quit.


[default at occ] list occ limit 1;

Using default cell limit of 100

-------------------

RowKey: dr107|43704421

=> (name=attr.qa, value=[], timestamp=1397043413407000)

=> (name=basisOfRecord, value=UNKNOWN, timestamp=1397043412777000)

=> (name=bor.qa, value=[20002], timestamp=1397043413407000)

=> (name=catalogNumber, value=1, timestamp=1397043412777000)

=> (name=class.qa, value=[10008,10005], timestamp=1397043413407

.....


________________________________
From: ala-portal-bounces at lists.gbif.org [ala-portal-bounces at lists.gbif.org] on behalf of David.Martin at csiro.au [David.Martin at csiro.au]
Sent: 25 June 2014 15:24
To: daniel.lins at gmail.com; ala-portal at lists.gbif.org; pedro.correa at usp.br
Subject: [ExternalEmail] Re: [Ala-portal] Using Biocache-Store and Apache Cassandra on different servers

Thanks Daniel.

How did you load the data ?
Also can you see the records using the cassandra-cli tool ?

Dave


________________________________
From: Daniel Lins [daniel.lins at gmail.com]
Sent: 25 June 2014 15:21
To: Martin, Dave (CES, Black Mountain); ala-portal at lists.gbif.org; Pedro Corrêa
Subject: Using Biocache-Store and Apache Cassandra on different servers

Hi,

We configured the ALA applications on different Servers of the database Server. However, we are having problems running the biocache-store.

I changed the biocache configuration file (/data/biocache/config/biocache-config.properties) and the Cassandra configuration (cassandra.yaml) for enabling remote access.

(biocache-config.properties)
# Cassandra Config
db=cassandra
cassandra.hosts=192.168.15.199
cassandra.port=9160
cassandra.pool=biocache-store-pool
cassandra.keyspace=occ
cassandra.max.connections=-1
cassandra.max.retries=6
thrift.operation.timeout=8000

(cassandra.yaml)
listen_address: 192.168.15.199
rpc_address: 192.168.15.199
rpc_port: 9160
...

Running the Biocache-store in the server 192.168.15.132

When I ran the Loading method, the data were saved correctly in the Cassandra Database. However, in the Processing method, the data was not recovered (see message below) and the Indexing method did not index.

biocache> process dr0
Processing dr0 incremental=false
2014-06-25 00:17:20,228 INFO : [Consumer] - Initialising thread: 0
2014-06-25 00:17:20,270 INFO : [Consumer] - Initialising thread: 1
2014-06-25 00:17:20,271 INFO : [Consumer] - Initialising thread: 2
2014-06-25 00:17:20,274 INFO : [Consumer] - Initialising thread: 3
2014-06-25 00:17:20,275 INFO : [ProcessWithActors] - Starting with dr0| endingwith dr0|~
2014-06-25 00:17:20,275 INFO : [ProcessWithActors] - Initialised actors...
2014-06-25 00:17:20,274 INFO : [Consumer] - In thread: 0
2014-06-25 00:17:20,274 INFO : [Consumer] - In thread: 1
2014-06-25 00:17:20,281 INFO : [Consumer] - In thread: 2
2014-06-25 00:17:20,293 INFO : [Consumer] - In thread: 3
2014-06-25 00:17:20,326 INFO : [ProcessWithActors] - Last row key processed:
2014-06-25 00:17:20,327 INFO : [ProcessWithActors] - Finished.
2014-06-25 00:17:20,333 INFO : [Consumer] - Killing (Actor.act) thread: 0
2014-06-25 00:17:20,333 INFO : [Consumer] - Killing (Actor.act) thread: 3
2014-06-25 00:17:20,333 INFO : [Consumer] - Killing (Actor.act) thread: 2
2014-06-25 00:17:20,333 INFO : [Consumer] - Killing (Actor.act) thread: 1

biocache> index dr0
2014-06-25 00:17:36,848 INFO : [IndexRecords] - Starting to index dr0| until dr0|~
2014-06-25 00:17:36,858 INFO : [IndexRecords] - Total indexing time 0.005 seconds
2014-06-25 00:17:36,858 INFO : [SolrIndexDAO] - Initialising the solr server http://192.168.15.132:8080/solr null null
2014-06-25 00:17:36,859 INFO : [SolrIndexDAO] - Initialising connection to SOLR server.....
2014-06-25 00:17:37,764 INFO : [SolrIndexDAO] - Initialising connection to SOLR server - done.
2014-06-25 00:17:38,040 INFO : [SolrIndexDAO] - >>>>>>>>>>>>> Document count of index: 0
2014-06-25 00:17:38,041 INFO : [SolrIndexDAO] - Finalise finished.

** The delete_resource method also didn't work and I need to delete the occurrence table using the truncate command.

Does anyone know how to solve this issue?

Thanks!!

Regards,

--
Daniel Lins da Silva
(Mobile) 55 11 96144-4050<tel:55%2011%2096144-4050>
Research Center on Biodiversity and Computing (Biocomp)
University of Sao Paulo, Brazil
daniellins at usp.br<mailto:daniellins at usp.br>
daniel.lins at gmail.com<mailto:daniel.lins at gmail.com>

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.gbif.org/pipermail/ala-portal/attachments/20140625/63f45773/attachment-0001.html