You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@rya.apache.org by Adina Crainiceanu <ad...@usna.edu> on 2016/05/02 17:09:47 UTC
GSoC - community bonding period
Hi Amila,
Were you able to get Accumulo and Rya running on your machine? If not, did
you take a look at the Rya Vagrant example
https://github.com/apache/incubator-rya/tree/develop/extras/vagrantExample/src/main/vagrant
to see if it helps?
During this community bonding period, you will need to refine the project
proposal and have a concrete plan that you can start implementing when the
coding starts. A weekly plan would be best, or at least a plan that has
2-week period sprints. When making the plan, please take into consideration
your outside commitments, exams, etc, and include those in planning, so we
know what to expect. We will help with the plan, just ask.
In order to make it easy for everyone to collaborate, I created a page on
the Rya Confluence for your proposal - you should be able to create a
Confluence account and edit the page/add pages with details.
https://cwiki.apache.org/confluence/display/RYA/Set-up+continuous+integration+for+Apache+Rya
Here is an example for how a proposal and the details/planning, etc looks
like for a different project (not Rya) from last year GSoC:
https://cwiki.apache.org/confluence/display/AIRAVATA/%5BGSoC+Proposal%5D+Securing+Airavata+API
Here is a fragment from a message about the expectation for students during
the community bonding period April 22-May 22:
*Community Bonding activities may involve:*
- Becoming familiar with the community practices and processes. (This
often involves a mix of observation and participation.)
- Participating on Mailing Lists / IRC / etc. (Not just lurking.)
- Setting up their development environment.
- Small (or large) patches/bug fixes. (These do not need to be directly
related to their GSoC project.)
- Participating in code reviews for others. (Even someone who isn't
familiar with the project can contribute by pointing out potential
inefficiencies, bad error handling, etc.)
- Working with their mentor and other org members on refining their
project plan. This might include finalizing deadlines and milestones,
adding more detail, figuring out potential issues, etc.
- If the student is already familiar with the organization, they could
be helping others get involved in the community.
- Reading (and updating!) documentation they will need to understand to
complete their project.
- Reporting or replicating bugs.
Looking forward to working with you,
Adina
--
Dr. Adina Crainiceanu
Associate Professor, Computer Science Department
United States Naval Academy
410-293-6822
adina@usna.edu
http://www.usna.edu/Users/cs/adina/
Re: GSoC - community bonding period
Posted by David Lotts <dl...@gmail.com>.
Amila, and anyone else:
I have done a pull request. This is the same file I sent you May 17.
Did you get a chance to try it?? I hoping this makes it into the release.
https://github.com/apache/incubator-rya/pull/47
You should not need to troubleshoot it, just run it and let me know if you
succeeded. or make a comment in the pull request. Hopefully there will be
no more silent failures! If it fails, it will complain horribly at the
point where something failed.
I have attached the vagrant file and instructions.
Download them from here:
https://github.com/DLotts/incubator-rya/blob/RYA-54_vagrant-cleanup-squ/extras/vagrantExample/src/main/vagrant/Vagrantfile
No other bit's of code are needed. Just the Vagrant install and the
attached.
david.
On Tue, May 17, 2016 at 10:54 AM, David Lotts <dl...@gmail.com> wrote:
> Amila,
> I have re-worked the Vagrant Example. There were some race conditions and
> places where errors become lost or skipped over.
> I am going to do a pull request on this soon, but would be good if you
> could try this version from my Rya github branch:
>
>
> https://github.com/DLotts/incubator-rya/blob/RYA-54_vagrant-cleanup/extras/vagrantExample/src/main/vagrant/Vagrantfile
>
> It uses the same instructions.
> You can do the command:
>
> vagrant destroy
>
> To remove your last attempt. Then use the new file and the same readme to
> start over.
>
> The new version is made to be re-run and possible fix errors from the last
> attempt -- so you could just copy this over your old version and type:
>
> vagrant provision
>
> Then follow the readme instructions.
> I am interested in your experience with this.
> david lotts.
>
> On Sat, May 14, 2016 at 7:53 AM, Amila Wijayarathna <
> amwijayarathna@gmail.com> wrote:
>
>> Hi Adina,
>> I went through the vagrant file. And there is a line,...
>>
>
Re: GSoC - community bonding period
Posted by David Lotts <dl...@gmail.com>.
Amila,
I have re-worked the Vagrant Example. There were some race conditions and
places where errors become lost or skipped over.
I am going to do a pull request on this soon, but would be good if you
could try this version from my Rya github branch:
https://github.com/DLotts/incubator-rya/blob/RYA-54_vagrant-cleanup/extras/vagrantExample/src/main/vagrant/Vagrantfile
It uses the same instructions.
You can do the command:
vagrant destroy
To remove your last attempt. Then use the new file and the same readme to
start over.
The new version is made to be re-run and possible fix errors from the last
attempt -- so you could just copy this over your old version and type:
vagrant provision
Then follow the readme instructions.
I am interested in your experience with this.
david lotts.
On Sat, May 14, 2016 at 7:53 AM, Amila Wijayarathna <
amwijayarathna@gmail.com> wrote:
> Hi Adina,
> I went through the vagrant file. And there is a line,
>
>
> *# soft linking the files doesn't seem to work in tomcat, so we copy them
> instead :(*
>
> *sudo cp
> rya.indexing.example-${RYA_EXAMPLE_VERSION}-distribution/dist/lib/*
> /var/lib/tomcat7/webapps/openrdf-workbench/WEB-INF/lib/*
>
> *sudo cp
> rya.indexing.example-${RYA_EXAMPLE_VERSION}-distribution/dist/lib/*
> /var/lib/tomcat7/webapps/openrdf-sesame/WEB-INF/lib/*
>
> But I was unable to do so because I cannot find */dist/lib/* .*
> Any guidelines about this is thoroughly appreciated.
>
> Thank you!
>
> On Mon, May 9, 2016 at 7:45 PM, Amila Wijayarathna <
> amwijayarathna@gmail.com
> > wrote:
>
> > Hi Adina,
> >
> > The files you mentioned are not existing in the directory.
> > I will go through your guidelines and vagrant file.
> >
> > Thank you!
> >
> > On Mon, May 9, 2016 at 7:29 PM, Adina Crainiceanu <ad...@usna.edu>
> wrote:
> >
> >> Based on your error and the vagrant readme file, I think the OpenRDF
> >> Workbench transformations are not installed.
> >>
> >> Try this - adapted for your computer instead of the vagrant VM:
> >> "OpenRDF Workbench requires a set of "transformations" for listing Rya
> in
> >> the OpenRDF Workbench Repository list. The transforms are in this
> >> directory: /var/lib/tomcat7/webapps/openrdf-workbench/transformations/
> >>
> >> 1. Verify that this file exists: create-RyaAccumuloSail.xsl
> >> 2. Verify that create.xsl has been updated for rya. (run: "cat
> >> create.xsl | grep Rya" and make sure there's some stuff there.)
> >>
> >> If these files do note exists, open the vagrant file and look for the
> >> line echo "Downloading Rya". Try working through those commands manually
> >> on your Vagrant VM."
> >>
> >> In particular, the lines for "# Download and install new templates for
> >> OpenRdf WorkBench" in the vagrant file might be the ones that you are
> >> missing.
> >>
> >> Please make detailed notes of what you are doing, so we can reproduce
> the
> >> process on a new machine - I'm tryiong to get an Amazon EC2 instance
> so we
> >> can all have access to it.
> >>
> >>
> >> Adina
> >>
> >>
> >>
> >>
> >> On Mon, May 9, 2016 at 9:09 AM, Amila Wijayarathna <
> >> amwijayarathna@gmail.com> wrote:
> >>
> >>> Hi Adina,
> >>> As in the vagrant file i tried to connect Rya via OpenRDF workbench to
> >>> insert data. When i create new repository in workbench i have chose
> the
> >>> type. But there is no "Rya Accumulo Store" type to chose as in the
> >>> vagrant file.
> >>> Any idea about this is thoroughly appriciated.
> >>>
> >>> Thank you!
> >>>
> >>> On Sat, May 7, 2016 at 9:36 PM, Adina Crainiceanu <ad...@usna.edu>
> >>> wrote:
> >>>
> >>>> Hi,
> >>>>
> >>>> The screen shot for the web.rya/sparqlQuery.jsp looks correct. You
> >>>> should try to insert some data and see if you can query it back. You
> might
> >>>> be able to do an insert and select through the web.rya interface, but
> I'm
> >>>> not sure about the insert.
> >>>>
> >>>>
> >>>> The easiest way to do insert is through the openRDF Workbench
> interface.
> >>>> Look in the vagrant file to see how to set it up.
> >>>> Look in the Readme file for the vagrant example to see how to load
> some
> >>>> data
> >>>>
> https://github.com/apache/incubator-rya/tree/develop/extras/vagrantExample/src/main/vagrant
> >>>>
> >>>> Once you have data, you should be able to use either the we.rya
> >>>> interface or the openRDf workbench interface to query the data using a
> >>>> sparql select query.
> >>>>
> >>>> Adina
> >>>>
> >>>> On Sat, May 7, 2016 at 8:37 AM, Amila Wijayarathna <
> >>>> amwijayarathna@gmail.com> wrote:
> >>>>
> >>>>> Hi Adina,
> >>>>>
> >>>>> I changed some settings and restart tomcat server. And when I browse
> >>>>> in to http://localhost:8080/web.rya/sparqlQuery.jsp , I got the
> >>>>> following window.
> >>>>>
> >>>>> Am I doing it correctly? If it is, I would like to know how to
> proceed
> >>>>> further.
> >>>>>
> >>>>>
> >>>>> Thank you!
> >>>>>
> >>>>> On Sat, May 7, 2016 at 12:43 PM, Amila Wijayarathna <
> >>>>> amwijayarathna@gmail.com> wrote:
> >>>>>
> >>>>>> Hi Adina,
> >>>>>>
> >>>>>> When I changed the Accumulo instance volume in accumulo site.xml , I
> >>>>>> can successfully start accumulo and I think it will not a problem
> for
> >>>>>> instance name, it is remaining the same. So after a restart my
> laptop I
> >>>>>> started the hadoop, zookeeper and accumulo and got the following,
> >>>>>>
> >>>>>> amila@amila-X550LD:~$ ~/Installs/hadoop-2.7.2/sbin/start-dfs.sh
> >>>>>> Starting namenodes on [localhost]
> >>>>>> localhost: starting namenode, logging to
> >>>>>>
> /home/amila/Installs/hadoop-2.7.2/logs/hadoop-amila-namenode-amila-X550LD.out
> >>>>>> localhost: starting datanode, logging to
> >>>>>>
> /home/amila/Installs/hadoop-2.7.2/logs/hadoop-amila-datanode-amila-X550LD.out
> >>>>>> Starting secondary namenodes [0.0.0.0]
> >>>>>> 0.0.0.0: starting secondarynamenode, logging to
> >>>>>>
> /home/amila/Installs/hadoop-2.7.2/logs/hadoop-amila-secondarynamenode-amila-X550LD.out
> >>>>>>
> >>>>>> amila@amila-X550LD:~$ ~/Installs/zookeeper-3.4.8/bin/zkServer.sh
> >>>>>> start
> >>>>>> ZooKeeper JMX enabled by default
> >>>>>> Using config:
> /home/amila/Installs/zookeeper-3.4.8/bin/../conf/zoo.cfg
> >>>>>> Starting zookeeper ... STARTED
> >>>>>>
> >>>>>> amila@amila-X550LD:~$ ~/Installs/accumulo-1.6.4/bin/accumulo init
> >>>>>> 2016-05-07 08:44:23,775 [init.Initialize] INFO : Hadoop Filesystem
> is
> >>>>>> hdfs://localhost:9000
> >>>>>> 2016-05-07 08:44:23,776 [init.Initialize] INFO : Accumulo data dirs
> >>>>>> are [hdfs://localhost:9000/ACCUMULO]
> >>>>>> 2016-05-07 08:44:23,776 [init.Initialize] INFO : Zookeeper server is
> >>>>>> localhost:2181
> >>>>>> 2016-05-07 08:44:23,776 [init.Initialize] INFO : Checking if
> >>>>>> Zookeeper is available. If this hangs, then you need to make sure
> zookeeper
> >>>>>> is running
> >>>>>> Instance name : AMILA
> >>>>>> Enter initial password for root (this may not be applicable for your
> >>>>>> security setup): *******
> >>>>>> Confirm initial password for root: *******
> >>>>>> 2016-05-07 08:45:35,904 [Configuration.deprecation] INFO :
> >>>>>> dfs.replication.min is deprecated. Instead, use
> dfs.namenode.replication.min
> >>>>>> 2016-05-07 08:45:36,948 [Configuration.deprecation] INFO :
> >>>>>> dfs.block.size is deprecated. Instead, use dfs.blocksize
> >>>>>> 2016-05-07 08:45:37,903 [conf.AccumuloConfiguration] INFO : Loaded
> >>>>>> class : org.apache.accumulo.server.security.handler.ZKAuthorizor
> >>>>>> 2016-05-07 08:45:37,907 [conf.AccumuloConfiguration] INFO : Loaded
> >>>>>> class : org.apache.accumulo.server.security.handler.ZKAuthenticator
> >>>>>> 2016-05-07 08:45:37,911 [conf.AccumuloConfiguration] INFO : Loaded
> >>>>>> class : org.apache.accumulo.server.security.handler.ZKPermHandler
> >>>>>>
> >>>>>> amila@amila-X550LD:~$
> >>>>>> ~/Installs/accumulo-1.6.4/bin/start-all.shStarting monitor on
> localhost
> >>>>>> WARN : Max open files on localhost is 1024, recommend 32768
> >>>>>> Starting tablet servers .... done
> >>>>>> Starting tablet server on localhost
> >>>>>> WARN : Max open files on localhost is 1024, recommend 32768
> >>>>>> 2016-05-07 08:46:05,553 [server.Accumulo] INFO : Attempting to talk
> >>>>>> to zookeeper
> >>>>>> 2016-05-07 08:46:05,711 [server.Accumulo] INFO : ZooKeeper connected
> >>>>>> and initialized, attempting to talk to HDFS
> >>>>>> 2016-05-07 08:46:05,844 [server.Accumulo] INFO : Connected to HDFS
> >>>>>> Starting master on localhost
> >>>>>> WARN : Max open files on localhost is 1024, recommend 32768
> >>>>>> Starting garbage collector on localhost
> >>>>>> WARN : Max open files on localhost is 1024, recommend 32768
> >>>>>> Starting tracer on localhost
> >>>>>> WARN : Max open files on localhost is 1024, recommend 32768
> >>>>>>
> >>>>>> amila@amila-X550LD:~/Downloads$ cd apache-tomcat-7.0.68
> >>>>>> amila@amila-X550LD:~/Downloads/apache-tomcat-7.0.68$
> ./bin/startup.sh
> >>>>>> Using CATALINA_BASE: /home/amila/Downloads/apache-tomcat-7.0.68
> >>>>>> Using CATALINA_HOME: /home/amila/Downloads/apache-tomcat-7.0.68
> >>>>>> Using CATALINA_TMPDIR:
> /home/amila/Downloads/apache-tomcat-7.0.68/temp
> >>>>>> Using JRE_HOME: /usr/local/java/jdk1.8.0_74/jre
> >>>>>> Using CLASSPATH:
> >>>>>>
> /home/amila/Downloads/apache-tomcat-7.0.68/bin/bootstrap.jar:/home/amila/Downloads/apache-tomcat-7.0.68/bin/tomcat-juli.jar
> >>>>>> Tomcat started.
> >>>>>>
> >>>>>> Earlier I didn't add the openrdf-sesame and openrdf-workbench war
> >>>>>> files to the webapp folder as in the vagrant file. So I added them.
> But
> >>>>>> when I open browser to
> http://localhost:8080/openrdf-sesame/protocol
> >>>>>> I got the massage HTTP Status 404 - /openrdf-sesame/protocol
> >>>>>> I think there must be a problem with tomcat cofigurations and i'm
> >>>>>> working on that.
> >>>>>>
> >>>>>> Am I doing these things in a correct way? Any ideas about this is
> >>>>>> appriciated.
> >>>>>>
> >>>>>> Thank you!
> >>>>>>
> >>>>>> On Fri, May 6, 2016 at 8:38 PM, Adina Crainiceanu <ad...@usna.edu>
> >>>>>> wrote:
> >>>>>>
> >>>>>>> Amila,
> >>>>>>>
> >>>>>>> Any progress in getting Accumulo and Rya running? What did you try
> >>>>>>> for this?
> >>>>>>>
> >>>>>>> As one of the emails suggested, you can delete the directory where
> >>>>>>> accumulo stores it data, and then re-initialize. The instance name
> does not
> >>>>>>> matter for Rya - it is just a parameter provided to Rya.
> >>>>>>>
> >>>>>>> The following snippet is the relevant part in the vagrant script to
> >>>>>>> re-create the data folders and re-initialize accumulo - note that
> the
> >>>>>>> vagrant script does not use hadoop, just the file system and
> zookeeper:
> >>>>>>>
> >>>>>>> sudo mkdir /data
> >>>>>>> sudo chown vagrant:vagrant /data
> >>>>>>> mkdir /data/accumulo
> >>>>>>> mkdir /data/accumulo/lib
> >>>>>>> mkdir /data/accumulo/lib/ext
> >>>>>>> echo "Starting Accumulo..."
> >>>>>>> accumulo-${ACCUMULO_VERSION}/bin/accumulo init --instance-name dev
> >>>>>>> --password root
> >>>>>>> accumulo-${ACCUMULO_VERSION}/bin/start-all.sh
> >>>>>>>
> >>>>>>> I am concerned by the lack of progress and the lack of a clear plan
> >>>>>>> for the project once the coding period begins. Please let me know
> what your
> >>>>>>> plans are. I'm here to help you to be successful. Failing, either
> after the
> >>>>>>> bonding period, at the mid-term time or at the end is not
> something that
> >>>>>>> anyone wants.
> >>>>>>>
> >>>>>>>
> >>>>>>> Adina
> >>>>>>>
> >>>>>>> On Tue, May 3, 2016 at 1:36 PM, Adina Crainiceanu <ad...@usna.edu>
> >>>>>>> wrote:
> >>>>>>>
> >>>>>>>> Hi Amila,
> >>>>>>>>
> >>>>>>>> 1) Rya should be able to use whatever Accumulo instance name you
> >>>>>>>> provide - did you try to use Rya with a given Accumulo instance
> name and it
> >>>>>>>> did not work? What did you try?
> >>>>>>>>
> >>>>>>>> 2)
> >>>>>>>>
> >>>>>>>> DId you look at the vagrant script to see if it does something
> >>>>>>>> different than you did?
> >>>>>>>>
> >>>>>>>> DId you have the problem first time you installed Accumulo, or
> only
> >>>>>>>> on restart?
> >>>>>>>>
> >>>>>>>> Did you try to ping Zookeeper, to make sure it is up?
> >>>>>>>> Ping Zookeeper (run: echo ruok | nc 127.0.0.1 2181). -- or
> >>>>>>>> whatever ip/port you use for Zookeeper
> >>>>>>>>
> >>>>>>>> - If Zookeeper is okay, you should see the response imok
> >>>>>>>> - Otherwise, restart Zookeeper (run something similar to
> ~/Installs//zookeeper-3.4.5-cdh4.5.0/bin/zkServer.sh
> >>>>>>>> start)
> >>>>>>>>
> >>>>>>>>
> >>>>>>>> 3) Try to connect to the Rya "office hours" tomorrow (Wednesday)
> at
> >>>>>>>> 12pm EST. A message with connect information should be sent out
> tomorrow
> >>>>>>>> morning. Then maybe you will be able to share your screen and ask
> for help.
> >>>>>>>>
> >>>>>>>> Adina
> >>>>>>>>
> >>>>>>>>
> >>>>>>>>
> >>>>>>>> On Tue, May 3, 2016 at 9:25 AM, Amila Wijayarathna <
> >>>>>>>> amwijayarathna@gmail.com> wrote:
> >>>>>>>>
> >>>>>>>>> Hi Adina, These days I'm trying to run Rya in my Ubuntu laptop.
> >>>>>>>>> Therefore I set up Hadoop, Zookeeper and Accumulo. After a
> shutdown, I need
> >>>>>>>>> to restart hadoop, zookeeper and accumulo. But when i do Hadoop
> and
> >>>>>>>>> Zookeeper servers are starting successfully but when i
> initialize Accumulo
> >>>>>>>>> i get the following, 2016-04-19 16:56:06,984
> [fs.VolumeManagerImpl] WARN :
> >>>>>>>>> dfs.datanode.synconclose set to false in : data loss is possible
> on hard
> >>>>>>>>> system reset or power loss 2016-04-19 16:56:06,985
> [init.Initialize] INFO :
> >>>>>>>>> Hadoop Filesystem is hdfs://localhost:9000 2016-04-19
> 16:56:06,986
> >>>>>>>>> [init.Initialize] INFO : Accumulo data dirs are
> >>>>>>>>> [hdfs://localhost:9000/accumulo] 2016-04-19 16:56:06,986
> [init.Initialize]
> >>>>>>>>> INFO : Zookeeper server is localhost:2181 2016-04-19 16:56:06,986
> >>>>>>>>> [init.Initialize] INFO : Checking if Zookeeper is available. If
> this hangs,
> >>>>>>>>> then you need to make sure zookeeper is running 2016-04-19
> 16:56:07,250
> >>>>>>>>> [init.Initialize] FATAL: It appears the directories
> >>>>>>>>> [hdfs://localhost:9000/accumulo] were previously initialized.
> 2016-04-19
> >>>>>>>>> 16:56:07,250 [init.Initialize] FATAL: Change the property
> instance.volumes
> >>>>>>>>> to use different filesystems, 2016-04-19 16:56:07,250
> [init.Initialize]
> >>>>>>>>> FATAL: or change the property instance.dfs.dir to use a different
> >>>>>>>>> directory. 2016-04-19 16:56:07,250 [init.Initialize] FATAL: The
> current
> >>>>>>>>> value of instance.dfs.uri is || 2016-04-19 16:56:07,250
> [init.Initialize]
> >>>>>>>>> FATAL: The current value of instance.dfs.dir is |/accumulo|
> 2016-04-19
> >>>>>>>>> 16:56:07,250 [init.Initialize] FATAL: The current value of
> instance.volumes
> >>>>>>>>> is |hdfs://localhost:9000/accumulo| Then i tried to start
> Accumulo with
> >>>>>>>>> ~/Installs/accumulo-1.6.4/bin/start-all.sh then i get following,
> WARN :
> >>>>>>>>> Using Zookeeper
> /home/amila/Installs/zookeeper-3.4.8/zookeeper-3.4.8. Use
> >>>>>>>>> version 3.3.0 or greater to avoid zookeeper deadlock bug.
> Starting monitor
> >>>>>>>>> on localhost WARN : Max open files on localhost is 1024,
> recommend 32768
> >>>>>>>>> Starting tablet servers .... done 2016-04-19 17:40:43,303
> >>>>>>>>> [fs.VolumeManagerImpl] WARN : dfs.datanode.synconclose set to
> false in
> >>>>>>>>> hdfs-site.xml: data loss is possible on hard system reset or
> power loss
> >>>>>>>>> 2016-04-19 17:40:43,308 [server.Accumulo] INFO : Attempting to
> talk to
> >>>>>>>>> zookeeper 2016-04-19 17:40:43,522 [server.Accumulo] INFO :
> Waiting for
> >>>>>>>>> accumulo to be initialized 2016-04-19 17:40:44,534
> [server.Accumulo] INFO :
> >>>>>>>>> Waiting for accumulo to be initialized 2016-04-19 17:40:45,536
> >>>>>>>>> [server.Accumulo] INFO : Waiting for accumulo to be initialized
> 2016-04-19
> >>>>>>>>> 17:40:46,538 [server.Accumulo] INFO : Waiting for accumulo to be
> >>>>>>>>> initialized 2016-04-19 17:40:47,541 [server.Accumulo] INFO :
> Waiting for
> >>>>>>>>> accumulo to be initialized 2016-04-19 17:40:48,543
> [server.Accumulo] INFO :
> >>>>>>>>> Waiting for accumulo to be initialized 2016-04-19 17:40:49,545
> >>>>>>>>> [server.Accumulo] INFO : Waiting for accumulo to be initialized
> 2016-04-19
> >>>>>>>>> 17:40:50,547 [server.Accumulo] INFO : Waiting for accumulo to be
> >>>>>>>>> initialized 2016-04-19 17:40:51,549 [server.Accumulo] INFO :
> Waiting for
> >>>>>>>>> accumulo to be initialized 2016-04-19 17:40:52,550
> [server.Accumulo] INFO :
> >>>>>>>>> Waiting for accumulo to be initialized Starting tablet server on
> localhost
> >>>>>>>>> WARN : Max open files on localhost is 1024, recommend 32768
> 2016-04-19
> >>>>>>>>> 17:40:53,551 [server.Accumulo] INFO : Waiting for accumulo to be
> >>>>>>>>> initialized 2016-04-19 17:40:54,552 [server.Accumulo] INFO :
> Waiting for
> >>>>>>>>> accumulo to be initialized 2016-04-19 17:40:55,554
> [server.Accumulo] INFO :
> >>>>>>>>> Waiting for accumulo to be initialized 2016-04-19 17:40:56,555
> >>>>>>>>> [server.Accumulo] INFO : Waiting for accumulo to be initialized
> 2016-04-19
> >>>>>>>>> 17:40:57,556 [server.Accumulo] INFO : Waiting for accumulo to be
> >>>>>>>>> initialized 2016-04-19 17:40:58,558 [server.Accumulo] INFO :
> Waiting for
> >>>>>>>>> accumulo to be initialized 2016-04-19 17:40:59,559
> [server.Accumulo] INFO :
> >>>>>>>>> Waiting for accumulo to be initialized 2016-04-19 17:41:00,561
> >>>>>>>>> [server.Accumulo] INFO : Waiting for accumulo to be initialized
> But when I
> >>>>>>>>> change the instance name in accumulo-site.xml then I can
> successfully start
> >>>>>>>>> Accumulo. But I think to run Rya there must be a constant
> instance name as
> >>>>>>>>> in Rya README.md. I asked help from Accumulo-dev about this
> problem but I'm
> >>>>>>>>> unable to find a correct path to solve this.
> >>>>>>>>> Any idea about this is thoroughly appriciated.
> >>>>>>>>> Thank you.
> >>>>>>>>>
> >>>>>>>>> On Mon, May 2, 2016 at 8:39 PM, Adina Crainiceanu <
> adina@usna.edu>
> >>>>>>>>> wrote:
> >>>>>>>>>
> >>>>>>>>>> Hi Amila,
> >>>>>>>>>>
> >>>>>>>>>> Were you able to get Accumulo and Rya running on your machine?
> If
> >>>>>>>>>> not, did you take a look at the Rya Vagrant example
> >>>>>>>>>>
> https://github.com/apache/incubator-rya/tree/develop/extras/vagrantExample/src/main/vagrant
> >>>>>>>>>> to see if it helps?
> >>>>>>>>>>
> >>>>>>>>>> During this community bonding period, you will need to refine
> the
> >>>>>>>>>> project proposal and have a concrete plan that you can start
> implementing
> >>>>>>>>>> when the coding starts. A weekly plan would be best, or at
> least a plan
> >>>>>>>>>> that has 2-week period sprints. When making the plan, please
> take into
> >>>>>>>>>> consideration your outside commitments, exams, etc, and include
> those in
> >>>>>>>>>> planning, so we know what to expect. We will help with the
> plan, just ask.
> >>>>>>>>>>
> >>>>>>>>>> In order to make it easy for everyone to collaborate, I created
> a
> >>>>>>>>>> page on the Rya Confluence for your proposal - you should be
> able to create
> >>>>>>>>>> a Confluence account and edit the page/add pages with details.
> >>>>>>>>>>
> https://cwiki.apache.org/confluence/display/RYA/Set-up+continuous+integration+for+Apache+Rya
> >>>>>>>>>>
> >>>>>>>>>> Here is an example for how a proposal and the details/planning,
> >>>>>>>>>> etc looks like for a different project (not Rya) from last year
> GSoC:
> >>>>>>>>>>
> >>>>>>>>>>
> https://cwiki.apache.org/confluence/display/AIRAVATA/%5BGSoC+Proposal%5D+Securing+Airavata+API
> >>>>>>>>>>
> >>>>>>>>>> Here is a fragment from a message about the expectation for
> >>>>>>>>>> students during the community bonding period April 22-May 22:
> >>>>>>>>>>
> >>>>>>>>>> *Community Bonding activities may involve:*
> >>>>>>>>>>
> >>>>>>>>>> - Becoming familiar with the community practices and
> >>>>>>>>>> processes. (This often involves a mix of observation and
> participation.)
> >>>>>>>>>> - Participating on Mailing Lists / IRC / etc. (Not just
> >>>>>>>>>> lurking.)
> >>>>>>>>>> - Setting up their development environment.
> >>>>>>>>>> - Small (or large) patches/bug fixes. (These do not need to
> >>>>>>>>>> be directly related to their GSoC project.)
> >>>>>>>>>> - Participating in code reviews for others. (Even someone who
> >>>>>>>>>> isn't familiar with the project can contribute by pointing
> out potential
> >>>>>>>>>> inefficiencies, bad error handling, etc.)
> >>>>>>>>>> - Working with their mentor and other org members on refining
> >>>>>>>>>> their project plan. This might include finalizing deadlines
> and milestones,
> >>>>>>>>>> adding more detail, figuring out potential issues, etc.
> >>>>>>>>>> - If the student is already familiar with the organization,
> >>>>>>>>>> they could be helping others get involved in the community.
> >>>>>>>>>> - Reading (and updating!) documentation they will need to
> >>>>>>>>>> understand to complete their project.
> >>>>>>>>>> - Reporting or replicating bugs.
> >>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>> Looking forward to working with you,
> >>>>>>>>>> Adina
> >>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>> --
> >>>>>>>>>> Dr. Adina Crainiceanu
> >>>>>>>>>> Associate Professor, Computer Science Department
> >>>>>>>>>> United States Naval Academy
> >>>>>>>>>> 410-293-6822
> >>>>>>>>>> adina@usna.edu
> >>>>>>>>>> http://www.usna.edu/Users/cs/adina/
> >>>>>>>>>>
> >>>>>>>>>
> >>>>>>>>>
> >>>>>>>>>
> >>>>>>>>> --
> >>>>>>>>>
> >>>>>>>>> *Amila Wijayarathna*
> >>>>>>>>> Undergraduate,
> >>>>>>>>> Faculty of Information Technology,
> >>>>>>>>> University of Moratuwa,
> >>>>>>>>> Sri Lanka.
> >>>>>>>>>
> >>>>>>>>
> >>>>>>>>
> >>>>>>>>
> >>>>>>>> --
> >>>>>>>> Dr. Adina Crainiceanu
> >>>>>>>> Associate Professor, Computer Science Department
> >>>>>>>> United States Naval Academy
> >>>>>>>> 410-293-6822
> >>>>>>>> adina@usna.edu
> >>>>>>>> http://www.usna.edu/Users/cs/adina/
> >>>>>>>>
> >>>>>>>
> >>>>>>>
> >>>>>>>
> >>>>>>> --
> >>>>>>> Dr. Adina Crainiceanu
> >>>>>>> Associate Professor, Computer Science Department
> >>>>>>> United States Naval Academy
> >>>>>>> 410-293-6822
> >>>>>>> adina@usna.edu
> >>>>>>> http://www.usna.edu/Users/cs/adina/
> >>>>>>>
> >>>>>>
> >>>>>>
> >>>>>>
> >>>>>> --
> >>>>>>
> >>>>>> *Amila Wijayarathna*
> >>>>>> Undergraduate,
> >>>>>> Faculty of Information Technology,
> >>>>>> University of Moratuwa,
> >>>>>> Sri Lanka.
> >>>>>>
> >>>>>
> >>>>>
> >>>>>
> >>>>> --
> >>>>>
> >>>>> *Amila Wijayarathna*
> >>>>> Undergraduate,
> >>>>> Faculty of Information Technology,
> >>>>> University of Moratuwa,
> >>>>> Sri Lanka.
> >>>>>
> >>>>
> >>>>
> >>>>
> >>>> --
> >>>> Dr. Adina Crainiceanu
> >>>> Associate Professor, Computer Science Department
> >>>> United States Naval Academy
> >>>> 410-293-6822
> >>>> adina@usna.edu
> >>>> http://www.usna.edu/Users/cs/adina/
> >>>>
> >>>
> >>>
> >>>
> >>> --
> >>>
> >>> *Amila Wijayarathna*
> >>> Undergraduate,
> >>> Faculty of Information Technology,
> >>> University of Moratuwa,
> >>> Sri Lanka.
> >>>
> >>
> >>
> >>
> >> --
> >> Dr. Adina Crainiceanu
> >> Associate Professor, Computer Science Department
> >> United States Naval Academy
> >> 410-293-6822
> >> adina@usna.edu
> >> http://www.usna.edu/Users/cs/adina/
> >>
> >
> >
> >
> > --
> >
> > *Amila Wijayarathna*
> > Undergraduate,
> > Faculty of Information Technology,
> > University of Moratuwa,
> > Sri Lanka.
> >
>
>
>
> --
>
> *Amila Wijayarathna*
> Undergraduate,
> Faculty of Information Technology,
> University of Moratuwa,
> Sri Lanka.
>
Re: GSoC - community bonding period
Posted by Adina Crainiceanu <ad...@usna.edu>.
If you get a 500 error message you should also look into the tomcat log
file, it might provide more info. The war files might not have been
deployed correctly. You should make sure permissions are set correctly and
tomcat is running before moving/copying the .war files in the webapps
folder for tomcat, so tomcat can deploy them correctly.
Adina
On Sun, May 15, 2016 at 2:41 PM, Fan Yang <fy...@umbc.edu> wrote:
> Hi Amila,
>
> I think you can try 192.168.33.10:8080 first, to see if tomcat is
> running. If so, you can check are zookeeper and accumulo installed
> configured correctly or not. You may redo the following steps:
>
> sudo rm -R /data (delete the existing data folder for accumulo)
>
> sudo mkdir /data
> sudo chown vagrant:vagrant /data
> mkdir /data/accumulo
> mkdir /data/accumulo/lib
> mkdir /data/accumulo/lib/ext
> accumulo-1.7.1/bin/accumulo init —instance-name dev —password root
> (re-initialize accumulo instance)
>
> And then restart zookeeper and accumulo to see if you can add data and
> send query on openrdf. Hope this can help you.
>
> Bests,
>
> Fan
>
> On May 15, 2016, at 11:51 AM, Amila Wijayarathna <am...@gmail.com>
> wrote:
>
> *Amila Wijayarathna*
>
>
>
--
Dr. Adina Crainiceanu
Associate Professor, Computer Science Department
United States Naval Academy
410-293-6822
adina@usna.edu
http://www.usna.edu/Users/cs/adina/
Re: GSoC - community bonding period
Posted by Fan Yang <fy...@umbc.edu>.
Hi Amila,
I think you can try 192.168.33.10:8080 first, to see if tomcat is running. If so, you can check are zookeeper and accumulo installed configured correctly or not. You may redo the following steps:
sudo rm -R /data (delete the existing data folder for accumulo)
sudo mkdir /data
sudo chown vagrant:vagrant /data
mkdir /data/accumulo
mkdir /data/accumulo/lib
mkdir /data/accumulo/lib/ext
accumulo-1.7.1/bin/accumulo init —instance-name dev —password root (re-initialize accumulo instance)
And then restart zookeeper and accumulo to see if you can add data and send query on openrdf. Hope this can help you.
Bests,
Fan
> On May 15, 2016, at 11:51 AM, Amila Wijayarathna <am...@gmail.com> wrote:
>
> Amila Wijayarathna
Re: GSoC - community bonding period
Posted by Amila Wijayarathna <am...@gmail.com>.
Hi Fan,
You were right, I didn't download the distribution package correctly. Thank
you for the idea.
After downloading distribution package, i did as the vagrant file says.
but now when i browse in to openrdf-workbench i don't get the correct
window. i get status 500 massage. any idea about this is appreciated.
Thank you!
On Sat, May 14, 2016 at 8:39 PM, Fan Yang <fy...@umbc.edu> wrote:
> Hi Amila,
>
> I’m nor sure if you download and unzip the distribution package correctly.
> For me, I have 226 jar packages under “lib” folder. You could try to
> manually download the distribution package from "
> https://www.dropbox.com/s/7e74yiuq4jmu0od/rya.indexing.example-3.2.10
> -distribution.zip” and redo the steps on vagrant file to see if it works.
>
> Bests,
>
> Fan
>
> On May 14, 2016, at 7:53 AM, Amila Wijayarathna <am...@gmail.com>
> wrote:
>
> Hi Adina,
> I went through the vagrant file. And there is a line,
>
>
> *# soft linking the files doesn't seem to work in tomcat, so we copy them
> instead :(*
>
> *sudo cp
> rya.indexing.example-${RYA_EXAMPLE_VERSION}-distribution/dist/lib/*
> /var/lib/tomcat7/webapps/openrdf-workbench/WEB-INF/lib/*
>
> *sudo cp
> rya.indexing.example-${RYA_EXAMPLE_VERSION}-distribution/dist/lib/*
> /var/lib/tomcat7/webapps/openrdf-sesame/WEB-INF/lib/*
>
> But I was unable to do so because I cannot find */dist/lib/* .*
> Any guidelines about this is thoroughly appreciated.
>
> Thank you!
>
> On Mon, May 9, 2016 at 7:45 PM, Amila Wijayarathna <
> amwijayarathna@gmail.com
>
> wrote:
>
>
> Hi Adina,
>
> The files you mentioned are not existing in the directory.
> I will go through your guidelines and vagrant file.
>
> Thank you!
>
> On Mon, May 9, 2016 at 7:29 PM, Adina Crainiceanu <ad...@usna.edu> wrote:
>
> Based on your error and the vagrant readme file, I think the OpenRDF
> Workbench transformations are not installed.
>
> Try this - adapted for your computer instead of the vagrant VM:
> "OpenRDF Workbench requires a set of "transformations" for listing Rya in
> the OpenRDF Workbench Repository list. The transforms are in this
> directory: /var/lib/tomcat7/webapps/openrdf-workbench/transformations/
>
> 1. Verify that this file exists: create-RyaAccumuloSail.xsl
> 2. Verify that create.xsl has been updated for rya. (run: "cat
>
> create.xsl | grep Rya" and make sure there's some stuff there.)
>
> If these files do note exists, open the vagrant file and look for the
> line echo "Downloading Rya". Try working through those commands manually
> on your Vagrant VM."
>
> In particular, the lines for "# Download and install new templates for
> OpenRdf WorkBench" in the vagrant file might be the ones that you are
> missing.
>
> Please make detailed notes of what you are doing, so we can reproduce the
> process on a new machine - I'm tryiong to get an Amazon EC2 instance so we
> can all have access to it.
>
>
> Adina
>
>
>
>
> On Mon, May 9, 2016 at 9:09 AM, Amila Wijayarathna <
> amwijayarathna@gmail.com> wrote:
>
> Hi Adina,
> As in the vagrant file i tried to connect Rya via OpenRDF workbench to
> insert data. When i create new repository in workbench i have chose the
> type. But there is no "Rya Accumulo Store" type to chose as in the
> vagrant file.
> Any idea about this is thoroughly appriciated.
>
> Thank you!
>
> On Sat, May 7, 2016 at 9:36 PM, Adina Crainiceanu <ad...@usna.edu>
> wrote:
>
> Hi,
>
> The screen shot for the web.rya/sparqlQuery.jsp looks correct. You
> should try to insert some data and see if you can query it back. You might
> be able to do an insert and select through the web.rya interface, but I'm
> not sure about the insert.
>
>
> The easiest way to do insert is through the openRDF Workbench interface.
> Look in the vagrant file to see how to set it up.
> Look in the Readme file for the vagrant example to see how to load some
> data
>
> https://github.com/apache/incubator-rya/tree/develop/extras/vagrantExample/src/main/vagrant
>
> Once you have data, you should be able to use either the we.rya
> interface or the openRDf workbench interface to query the data using a
> sparql select query.
>
> Adina
>
> On Sat, May 7, 2016 at 8:37 AM, Amila Wijayarathna <
> amwijayarathna@gmail.com> wrote:
>
> Hi Adina,
>
> I changed some settings and restart tomcat server. And when I browse
> in to http://localhost:8080/web.rya/sparqlQuery.jsp , I got the
> following window.
>
> Am I doing it correctly? If it is, I would like to know how to proceed
> further.
>
>
> Thank you!
>
> On Sat, May 7, 2016 at 12:43 PM, Amila Wijayarathna <
> amwijayarathna@gmail.com> wrote:
>
> Hi Adina,
>
> When I changed the Accumulo instance volume in accumulo site.xml , I
> can successfully start accumulo and I think it will not a problem for
> instance name, it is remaining the same. So after a restart my laptop I
> started the hadoop, zookeeper and accumulo and got the following,
>
> amila@amila-X550LD:~$ ~/Installs/hadoop-2.7.2/sbin/start-dfs.sh
> Starting namenodes on [localhost]
> localhost: starting namenode, logging to
>
> /home/amila/Installs/hadoop-2.7.2/logs/hadoop-amila-namenode-amila-X550LD.out
> localhost: starting datanode, logging to
>
> /home/amila/Installs/hadoop-2.7.2/logs/hadoop-amila-datanode-amila-X550LD.out
> Starting secondary namenodes [0.0.0.0]
> 0.0.0.0: starting secondarynamenode, logging to
>
> /home/amila/Installs/hadoop-2.7.2/logs/hadoop-amila-secondarynamenode-amila-X550LD.out
>
> amila@amila-X550LD:~$ ~/Installs/zookeeper-3.4.8/bin/zkServer.sh
> start
> ZooKeeper JMX enabled by default
> Using config: /home/amila/Installs/zookeeper-3.4.8/bin/../conf/zoo.cfg
> Starting zookeeper ... STARTED
>
> amila@amila-X550LD:~$ ~/Installs/accumulo-1.6.4/bin/accumulo init
> 2016-05-07 08:44:23,775 [init.Initialize] INFO : Hadoop Filesystem is
> hdfs://localhost:9000
> 2016-05-07 08:44:23,776 [init.Initialize] INFO : Accumulo data dirs
> are [hdfs://localhost:9000/ACCUMULO]
> 2016-05-07 08:44:23,776 [init.Initialize] INFO : Zookeeper server is
> localhost:2181
> 2016-05-07 08:44:23,776 [init.Initialize] INFO : Checking if
> Zookeeper is available. If this hangs, then you need to make sure zookeeper
> is running
> Instance name : AMILA
> Enter initial password for root (this may not be applicable for your
> security setup): *******
> Confirm initial password for root: *******
> 2016-05-07 08:45:35,904 [Configuration.deprecation] INFO :
> dfs.replication.min is deprecated. Instead, use
> dfs.namenode.replication.min
> 2016-05-07 08:45:36,948 [Configuration.deprecation] INFO :
> dfs.block.size is deprecated. Instead, use dfs.blocksize
> 2016-05-07 08:45:37,903 [conf.AccumuloConfiguration] INFO : Loaded
> class : org.apache.accumulo.server.security.handler.ZKAuthorizor
> 2016-05-07 08:45:37,907 [conf.AccumuloConfiguration] INFO : Loaded
> class : org.apache.accumulo.server.security.handler.ZKAuthenticator
> 2016-05-07 08:45:37,911 [conf.AccumuloConfiguration] INFO : Loaded
> class : org.apache.accumulo.server.security.handler.ZKPermHandler
>
> amila@amila-X550LD:~$
> ~/Installs/accumulo-1.6.4/bin/start-all.shStarting monitor on localhost
> WARN : Max open files on localhost is 1024, recommend 32768
> Starting tablet servers .... done
> Starting tablet server on localhost
> WARN : Max open files on localhost is 1024, recommend 32768
> 2016-05-07 08:46:05,553 [server.Accumulo] INFO : Attempting to talk
> to zookeeper
> 2016-05-07 08:46:05,711 [server.Accumulo] INFO : ZooKeeper connected
> and initialized, attempting to talk to HDFS
> 2016-05-07 08:46:05,844 [server.Accumulo] INFO : Connected to HDFS
> Starting master on localhost
> WARN : Max open files on localhost is 1024, recommend 32768
> Starting garbage collector on localhost
> WARN : Max open files on localhost is 1024, recommend 32768
> Starting tracer on localhost
> WARN : Max open files on localhost is 1024, recommend 32768
>
> amila@amila-X550LD:~/Downloads$ cd apache-tomcat-7.0.68
> amila@amila-X550LD:~/Downloads/apache-tomcat-7.0.68$ ./bin/startup.sh
> Using CATALINA_BASE: /home/amila/Downloads/apache-tomcat-7.0.68
> Using CATALINA_HOME: /home/amila/Downloads/apache-tomcat-7.0.68
> Using CATALINA_TMPDIR: /home/amila/Downloads/apache-tomcat-7.0.68/temp
> Using JRE_HOME: /usr/local/java/jdk1.8.0_74/jre
> Using CLASSPATH:
>
> /home/amila/Downloads/apache-tomcat-7.0.68/bin/bootstrap.jar:/home/amila/Downloads/apache-tomcat-7.0.68/bin/tomcat-juli.jar
> Tomcat started.
>
> Earlier I didn't add the openrdf-sesame and openrdf-workbench war
> files to the webapp folder as in the vagrant file. So I added them. But
> when I open browser to http://localhost:8080/openrdf-sesame/protocol
> I got the massage HTTP Status 404 - /openrdf-sesame/protocol
> I think there must be a problem with tomcat cofigurations and i'm
> working on that.
>
> Am I doing these things in a correct way? Any ideas about this is
> appriciated.
>
> Thank you!
>
> On Fri, May 6, 2016 at 8:38 PM, Adina Crainiceanu <ad...@usna.edu>
> wrote:
>
> Amila,
>
> Any progress in getting Accumulo and Rya running? What did you try
> for this?
>
> As one of the emails suggested, you can delete the directory where
> accumulo stores it data, and then re-initialize. The instance name does not
> matter for Rya - it is just a parameter provided to Rya.
>
> The following snippet is the relevant part in the vagrant script to
> re-create the data folders and re-initialize accumulo - note that the
> vagrant script does not use hadoop, just the file system and zookeeper:
>
> sudo mkdir /data
> sudo chown vagrant:vagrant /data
> mkdir /data/accumulo
> mkdir /data/accumulo/lib
> mkdir /data/accumulo/lib/ext
> echo "Starting Accumulo..."
> accumulo-${ACCUMULO_VERSION}/bin/accumulo init --instance-name dev
> --password root
> accumulo-${ACCUMULO_VERSION}/bin/start-all.sh
>
> I am concerned by the lack of progress and the lack of a clear plan
> for the project once the coding period begins. Please let me know what your
> plans are. I'm here to help you to be successful. Failing, either after the
> bonding period, at the mid-term time or at the end is not something that
> anyone wants.
>
>
> Adina
>
> On Tue, May 3, 2016 at 1:36 PM, Adina Crainiceanu <ad...@usna.edu>
> wrote:
>
> Hi Amila,
>
> 1) Rya should be able to use whatever Accumulo instance name you
> provide - did you try to use Rya with a given Accumulo instance name and it
> did not work? What did you try?
>
> 2)
>
> DId you look at the vagrant script to see if it does something
> different than you did?
>
> DId you have the problem first time you installed Accumulo, or only
> on restart?
>
> Did you try to ping Zookeeper, to make sure it is up?
> Ping Zookeeper (run: echo ruok | nc 127.0.0.1 2181). -- or
> whatever ip/port you use for Zookeeper
>
> - If Zookeeper is okay, you should see the response imok
> - Otherwise, restart Zookeeper (run something similar to
> ~/Installs//zookeeper-3.4.5-cdh4.5.0/bin/zkServer.sh
>
> start)
>
>
> 3) Try to connect to the Rya "office hours" tomorrow (Wednesday) at
> 12pm EST. A message with connect information should be sent out tomorrow
> morning. Then maybe you will be able to share your screen and ask for help.
>
> Adina
>
>
>
> On Tue, May 3, 2016 at 9:25 AM, Amila Wijayarathna <
> amwijayarathna@gmail.com> wrote:
>
> Hi Adina, These days I'm trying to run Rya in my Ubuntu laptop.
> Therefore I set up Hadoop, Zookeeper and Accumulo. After a shutdown, I need
> to restart hadoop, zookeeper and accumulo. But when i do Hadoop and
> Zookeeper servers are starting successfully but when i initialize Accumulo
> i get the following, 2016-04-19 16:56:06,984 [fs.VolumeManagerImpl] WARN :
> dfs.datanode.synconclose set to false in : data loss is possible on hard
> system reset or power loss 2016-04-19 16:56:06,985 [init.Initialize] INFO :
> Hadoop Filesystem is hdfs://localhost:9000 2016-04-19 16:56:06,986
> [init.Initialize] INFO : Accumulo data dirs are
> [hdfs://localhost:9000/accumulo] 2016-04-19 16:56:06,986 [init.Initialize]
> INFO : Zookeeper server is localhost:2181 2016-04-19 16:56:06,986
> [init.Initialize] INFO : Checking if Zookeeper is available. If this hangs,
> then you need to make sure zookeeper is running 2016-04-19 16:56:07,250
> [init.Initialize] FATAL: It appears the directories
> [hdfs://localhost:9000/accumulo] were previously initialized. 2016-04-19
> 16:56:07,250 [init.Initialize] FATAL: Change the property instance.volumes
> to use different filesystems, 2016-04-19 16:56:07,250 [init.Initialize]
> FATAL: or change the property instance.dfs.dir to use a different
> directory. 2016-04-19 16:56:07,250 [init.Initialize] FATAL: The current
> value of instance.dfs.uri is || 2016-04-19 16:56:07,250 [init.Initialize]
> FATAL: The current value of instance.dfs.dir is |/accumulo| 2016-04-19
> 16:56:07,250 [init.Initialize] FATAL: The current value of instance.volumes
> is |hdfs://localhost:9000/accumulo| Then i tried to start Accumulo with
> ~/Installs/accumulo-1.6.4/bin/start-all.sh then i get following, WARN :
> Using Zookeeper /home/amila/Installs/zookeeper-3.4.8/zookeeper-3.4.8. Use
> version 3.3.0 or greater to avoid zookeeper deadlock bug. Starting monitor
> on localhost WARN : Max open files on localhost is 1024, recommend 32768
> Starting tablet servers .... done 2016-04-19 17:40:43,303
> [fs.VolumeManagerImpl] WARN : dfs.datanode.synconclose set to false in
> hdfs-site.xml: data loss is possible on hard system reset or power loss
> 2016-04-19 17:40:43,308 [server.Accumulo] INFO : Attempting to talk to
> zookeeper 2016-04-19 17:40:43,522 [server.Accumulo] INFO : Waiting for
> accumulo to be initialized 2016-04-19 17:40:44,534 [server.Accumulo] INFO :
> Waiting for accumulo to be initialized 2016-04-19 17:40:45,536
> [server.Accumulo] INFO : Waiting for accumulo to be initialized 2016-04-19
> 17:40:46,538 [server.Accumulo] INFO : Waiting for accumulo to be
> initialized 2016-04-19 17:40:47,541 [server.Accumulo] INFO : Waiting for
> accumulo to be initialized 2016-04-19 17:40:48,543 [server.Accumulo] INFO :
> Waiting for accumulo to be initialized 2016-04-19 17:40:49,545
> [server.Accumulo] INFO : Waiting for accumulo to be initialized 2016-04-19
> 17:40:50,547 [server.Accumulo] INFO : Waiting for accumulo to be
> initialized 2016-04-19 17:40:51,549 [server.Accumulo] INFO : Waiting for
> accumulo to be initialized 2016-04-19 17:40:52,550 [server.Accumulo] INFO :
> Waiting for accumulo to be initialized Starting tablet server on localhost
> WARN : Max open files on localhost is 1024, recommend 32768 2016-04-19
> 17:40:53,551 [server.Accumulo] INFO : Waiting for accumulo to be
> initialized 2016-04-19 17:40:54,552 [server.Accumulo] INFO : Waiting for
> accumulo to be initialized 2016-04-19 17:40:55,554 [server.Accumulo] INFO :
> Waiting for accumulo to be initialized 2016-04-19 17:40:56,555
> [server.Accumulo] INFO : Waiting for accumulo to be initialized 2016-04-19
> 17:40:57,556 [server.Accumulo] INFO : Waiting for accumulo to be
> initialized 2016-04-19 17:40:58,558 [server.Accumulo] INFO : Waiting for
> accumulo to be initialized 2016-04-19 17:40:59,559 [server.Accumulo] INFO :
> Waiting for accumulo to be initialized 2016-04-19 17:41:00,561
> [server.Accumulo] INFO : Waiting for accumulo to be initialized But when I
> change the instance name in accumulo-site.xml then I can successfully start
> Accumulo. But I think to run Rya there must be a constant instance name as
> in Rya README.md. I asked help from Accumulo-dev about this problem but I'm
> unable to find a correct path to solve this.
> Any idea about this is thoroughly appriciated.
> Thank you.
>
> On Mon, May 2, 2016 at 8:39 PM, Adina Crainiceanu <ad...@usna.edu>
> wrote:
>
> Hi Amila,
>
> Were you able to get Accumulo and Rya running on your machine? If
> not, did you take a look at the Rya Vagrant example
>
> https://github.com/apache/incubator-rya/tree/develop/extras/vagrantExample/src/main/vagrant
> to see if it helps?
>
> During this community bonding period, you will need to refine the
> project proposal and have a concrete plan that you can start implementing
> when the coding starts. A weekly plan would be best, or at least a plan
> that has 2-week period sprints. When making the plan, please take into
> consideration your outside commitments, exams, etc, and include those in
> planning, so we know what to expect. We will help with the plan, just ask.
>
> In order to make it easy for everyone to collaborate, I created a
> page on the Rya Confluence for your proposal - you should be able to create
> a Confluence account and edit the page/add pages with details.
>
> https://cwiki.apache.org/confluence/display/RYA/Set-up+continuous+integration+for+Apache+Rya
>
> Here is an example for how a proposal and the details/planning,
> etc looks like for a different project (not Rya) from last year GSoC:
>
>
> https://cwiki.apache.org/confluence/display/AIRAVATA/%5BGSoC+Proposal%5D+Securing+Airavata+API
>
> Here is a fragment from a message about the expectation for
> students during the community bonding period April 22-May 22:
>
> *Community Bonding activities may involve:*
>
> - Becoming familiar with the community practices and
> processes. (This often involves a mix of observation and participation.)
> - Participating on Mailing Lists / IRC / etc. (Not just
> lurking.)
> - Setting up their development environment.
> - Small (or large) patches/bug fixes. (These do not need to
> be directly related to their GSoC project.)
> - Participating in code reviews for others. (Even someone who
> isn't familiar with the project can contribute by pointing out potential
> inefficiencies, bad error handling, etc.)
> - Working with their mentor and other org members on refining
> their project plan. This might include finalizing deadlines and
> milestones,
> adding more detail, figuring out potential issues, etc.
> - If the student is already familiar with the organization,
> they could be helping others get involved in the community.
> - Reading (and updating!) documentation they will need to
> understand to complete their project.
> - Reporting or replicating bugs.
>
>
>
> Looking forward to working with you,
> Adina
>
>
> --
> Dr. Adina Crainiceanu
> Associate Professor, Computer Science Department
> United States Naval Academy
> 410-293-6822
> adina@usna.edu
> http://www.usna.edu/Users/cs/adina/
>
>
>
>
> --
>
> *Amila Wijayarathna*
> Undergraduate,
> Faculty of Information Technology,
> University of Moratuwa,
> Sri Lanka.
>
>
>
>
> --
> Dr. Adina Crainiceanu
> Associate Professor, Computer Science Department
> United States Naval Academy
> 410-293-6822
> adina@usna.edu
> http://www.usna.edu/Users/cs/adina/
>
>
>
>
> --
> Dr. Adina Crainiceanu
> Associate Professor, Computer Science Department
> United States Naval Academy
> 410-293-6822
> adina@usna.edu
> http://www.usna.edu/Users/cs/adina/
>
>
>
>
> --
>
> *Amila Wijayarathna*
> Undergraduate,
> Faculty of Information Technology,
> University of Moratuwa,
> Sri Lanka.
>
>
>
>
> --
>
> *Amila Wijayarathna*
> Undergraduate,
> Faculty of Information Technology,
> University of Moratuwa,
> Sri Lanka.
>
>
>
>
> --
> Dr. Adina Crainiceanu
> Associate Professor, Computer Science Department
> United States Naval Academy
> 410-293-6822
> adina@usna.edu
> http://www.usna.edu/Users/cs/adina/
>
>
>
>
> --
>
> *Amila Wijayarathna*
> Undergraduate,
> Faculty of Information Technology,
> University of Moratuwa,
> Sri Lanka.
>
>
>
>
> --
> Dr. Adina Crainiceanu
> Associate Professor, Computer Science Department
> United States Naval Academy
> 410-293-6822
> adina@usna.edu
> http://www.usna.edu/Users/cs/adina/
>
>
>
>
> --
>
> *Amila Wijayarathna*
> Undergraduate,
> Faculty of Information Technology,
> University of Moratuwa,
> Sri Lanka.
>
>
>
>
> --
>
> *Amila Wijayarathna*
> Undergraduate,
> Faculty of Information Technology,
> University of Moratuwa,
> Sri Lanka.
>
>
>
--
*Amila Wijayarathna*
Undergraduate,
Faculty of Information Technology,
University of Moratuwa,
Sri Lanka.
Re: GSoC - community bonding period
Posted by Fan Yang <fy...@umbc.edu>.
Hi Amila,
I’m nor sure if you download and unzip the distribution package correctly. For me, I have 226 jar packages under “lib” folder. You could try to manually download the distribution package from "https://www.dropbox.com/s/7e74yiuq4jmu0od/rya.indexing.example-3.2.10-distribution.zip” and redo the steps on vagrant file to see if it works.
Bests,
Fan
> On May 14, 2016, at 7:53 AM, Amila Wijayarathna <am...@gmail.com> wrote:
>
> Hi Adina,
> I went through the vagrant file. And there is a line,
>
>
> *# soft linking the files doesn't seem to work in tomcat, so we copy them
> instead :(*
>
> *sudo cp
> rya.indexing.example-${RYA_EXAMPLE_VERSION}-distribution/dist/lib/*
> /var/lib/tomcat7/webapps/openrdf-workbench/WEB-INF/lib/*
>
> *sudo cp
> rya.indexing.example-${RYA_EXAMPLE_VERSION}-distribution/dist/lib/*
> /var/lib/tomcat7/webapps/openrdf-sesame/WEB-INF/lib/*
>
> But I was unable to do so because I cannot find */dist/lib/* .*
> Any guidelines about this is thoroughly appreciated.
>
> Thank you!
>
> On Mon, May 9, 2016 at 7:45 PM, Amila Wijayarathna <amwijayarathna@gmail.com
>> wrote:
>
>> Hi Adina,
>>
>> The files you mentioned are not existing in the directory.
>> I will go through your guidelines and vagrant file.
>>
>> Thank you!
>>
>> On Mon, May 9, 2016 at 7:29 PM, Adina Crainiceanu <ad...@usna.edu> wrote:
>>
>>> Based on your error and the vagrant readme file, I think the OpenRDF
>>> Workbench transformations are not installed.
>>>
>>> Try this - adapted for your computer instead of the vagrant VM:
>>> "OpenRDF Workbench requires a set of "transformations" for listing Rya in
>>> the OpenRDF Workbench Repository list. The transforms are in this
>>> directory: /var/lib/tomcat7/webapps/openrdf-workbench/transformations/
>>>
>>> 1. Verify that this file exists: create-RyaAccumuloSail.xsl
>>> 2. Verify that create.xsl has been updated for rya. (run: "cat
>>> create.xsl | grep Rya" and make sure there's some stuff there.)
>>>
>>> If these files do note exists, open the vagrant file and look for the
>>> line echo "Downloading Rya". Try working through those commands manually
>>> on your Vagrant VM."
>>>
>>> In particular, the lines for "# Download and install new templates for
>>> OpenRdf WorkBench" in the vagrant file might be the ones that you are
>>> missing.
>>>
>>> Please make detailed notes of what you are doing, so we can reproduce the
>>> process on a new machine - I'm tryiong to get an Amazon EC2 instance so we
>>> can all have access to it.
>>>
>>>
>>> Adina
>>>
>>>
>>>
>>>
>>> On Mon, May 9, 2016 at 9:09 AM, Amila Wijayarathna <
>>> amwijayarathna@gmail.com> wrote:
>>>
>>>> Hi Adina,
>>>> As in the vagrant file i tried to connect Rya via OpenRDF workbench to
>>>> insert data. When i create new repository in workbench i have chose the
>>>> type. But there is no "Rya Accumulo Store" type to chose as in the
>>>> vagrant file.
>>>> Any idea about this is thoroughly appriciated.
>>>>
>>>> Thank you!
>>>>
>>>> On Sat, May 7, 2016 at 9:36 PM, Adina Crainiceanu <ad...@usna.edu>
>>>> wrote:
>>>>
>>>>> Hi,
>>>>>
>>>>> The screen shot for the web.rya/sparqlQuery.jsp looks correct. You
>>>>> should try to insert some data and see if you can query it back. You might
>>>>> be able to do an insert and select through the web.rya interface, but I'm
>>>>> not sure about the insert.
>>>>>
>>>>>
>>>>> The easiest way to do insert is through the openRDF Workbench interface.
>>>>> Look in the vagrant file to see how to set it up.
>>>>> Look in the Readme file for the vagrant example to see how to load some
>>>>> data
>>>>> https://github.com/apache/incubator-rya/tree/develop/extras/vagrantExample/src/main/vagrant
>>>>>
>>>>> Once you have data, you should be able to use either the we.rya
>>>>> interface or the openRDf workbench interface to query the data using a
>>>>> sparql select query.
>>>>>
>>>>> Adina
>>>>>
>>>>> On Sat, May 7, 2016 at 8:37 AM, Amila Wijayarathna <
>>>>> amwijayarathna@gmail.com> wrote:
>>>>>
>>>>>> Hi Adina,
>>>>>>
>>>>>> I changed some settings and restart tomcat server. And when I browse
>>>>>> in to http://localhost:8080/web.rya/sparqlQuery.jsp , I got the
>>>>>> following window.
>>>>>>
>>>>>> Am I doing it correctly? If it is, I would like to know how to proceed
>>>>>> further.
>>>>>>
>>>>>>
>>>>>> Thank you!
>>>>>>
>>>>>> On Sat, May 7, 2016 at 12:43 PM, Amila Wijayarathna <
>>>>>> amwijayarathna@gmail.com> wrote:
>>>>>>
>>>>>>> Hi Adina,
>>>>>>>
>>>>>>> When I changed the Accumulo instance volume in accumulo site.xml , I
>>>>>>> can successfully start accumulo and I think it will not a problem for
>>>>>>> instance name, it is remaining the same. So after a restart my laptop I
>>>>>>> started the hadoop, zookeeper and accumulo and got the following,
>>>>>>>
>>>>>>> amila@amila-X550LD:~$ ~/Installs/hadoop-2.7.2/sbin/start-dfs.sh
>>>>>>> Starting namenodes on [localhost]
>>>>>>> localhost: starting namenode, logging to
>>>>>>> /home/amila/Installs/hadoop-2.7.2/logs/hadoop-amila-namenode-amila-X550LD.out
>>>>>>> localhost: starting datanode, logging to
>>>>>>> /home/amila/Installs/hadoop-2.7.2/logs/hadoop-amila-datanode-amila-X550LD.out
>>>>>>> Starting secondary namenodes [0.0.0.0]
>>>>>>> 0.0.0.0: starting secondarynamenode, logging to
>>>>>>> /home/amila/Installs/hadoop-2.7.2/logs/hadoop-amila-secondarynamenode-amila-X550LD.out
>>>>>>>
>>>>>>> amila@amila-X550LD:~$ ~/Installs/zookeeper-3.4.8/bin/zkServer.sh
>>>>>>> start
>>>>>>> ZooKeeper JMX enabled by default
>>>>>>> Using config: /home/amila/Installs/zookeeper-3.4.8/bin/../conf/zoo.cfg
>>>>>>> Starting zookeeper ... STARTED
>>>>>>>
>>>>>>> amila@amila-X550LD:~$ ~/Installs/accumulo-1.6.4/bin/accumulo init
>>>>>>> 2016-05-07 08:44:23,775 [init.Initialize] INFO : Hadoop Filesystem is
>>>>>>> hdfs://localhost:9000
>>>>>>> 2016-05-07 08:44:23,776 [init.Initialize] INFO : Accumulo data dirs
>>>>>>> are [hdfs://localhost:9000/ACCUMULO]
>>>>>>> 2016-05-07 08:44:23,776 [init.Initialize] INFO : Zookeeper server is
>>>>>>> localhost:2181
>>>>>>> 2016-05-07 08:44:23,776 [init.Initialize] INFO : Checking if
>>>>>>> Zookeeper is available. If this hangs, then you need to make sure zookeeper
>>>>>>> is running
>>>>>>> Instance name : AMILA
>>>>>>> Enter initial password for root (this may not be applicable for your
>>>>>>> security setup): *******
>>>>>>> Confirm initial password for root: *******
>>>>>>> 2016-05-07 08:45:35,904 [Configuration.deprecation] INFO :
>>>>>>> dfs.replication.min is deprecated. Instead, use dfs.namenode.replication.min
>>>>>>> 2016-05-07 08:45:36,948 [Configuration.deprecation] INFO :
>>>>>>> dfs.block.size is deprecated. Instead, use dfs.blocksize
>>>>>>> 2016-05-07 08:45:37,903 [conf.AccumuloConfiguration] INFO : Loaded
>>>>>>> class : org.apache.accumulo.server.security.handler.ZKAuthorizor
>>>>>>> 2016-05-07 08:45:37,907 [conf.AccumuloConfiguration] INFO : Loaded
>>>>>>> class : org.apache.accumulo.server.security.handler.ZKAuthenticator
>>>>>>> 2016-05-07 08:45:37,911 [conf.AccumuloConfiguration] INFO : Loaded
>>>>>>> class : org.apache.accumulo.server.security.handler.ZKPermHandler
>>>>>>>
>>>>>>> amila@amila-X550LD:~$
>>>>>>> ~/Installs/accumulo-1.6.4/bin/start-all.shStarting monitor on localhost
>>>>>>> WARN : Max open files on localhost is 1024, recommend 32768
>>>>>>> Starting tablet servers .... done
>>>>>>> Starting tablet server on localhost
>>>>>>> WARN : Max open files on localhost is 1024, recommend 32768
>>>>>>> 2016-05-07 08:46:05,553 [server.Accumulo] INFO : Attempting to talk
>>>>>>> to zookeeper
>>>>>>> 2016-05-07 08:46:05,711 [server.Accumulo] INFO : ZooKeeper connected
>>>>>>> and initialized, attempting to talk to HDFS
>>>>>>> 2016-05-07 08:46:05,844 [server.Accumulo] INFO : Connected to HDFS
>>>>>>> Starting master on localhost
>>>>>>> WARN : Max open files on localhost is 1024, recommend 32768
>>>>>>> Starting garbage collector on localhost
>>>>>>> WARN : Max open files on localhost is 1024, recommend 32768
>>>>>>> Starting tracer on localhost
>>>>>>> WARN : Max open files on localhost is 1024, recommend 32768
>>>>>>>
>>>>>>> amila@amila-X550LD:~/Downloads$ cd apache-tomcat-7.0.68
>>>>>>> amila@amila-X550LD:~/Downloads/apache-tomcat-7.0.68$ ./bin/startup.sh
>>>>>>> Using CATALINA_BASE: /home/amila/Downloads/apache-tomcat-7.0.68
>>>>>>> Using CATALINA_HOME: /home/amila/Downloads/apache-tomcat-7.0.68
>>>>>>> Using CATALINA_TMPDIR: /home/amila/Downloads/apache-tomcat-7.0.68/temp
>>>>>>> Using JRE_HOME: /usr/local/java/jdk1.8.0_74/jre
>>>>>>> Using CLASSPATH:
>>>>>>> /home/amila/Downloads/apache-tomcat-7.0.68/bin/bootstrap.jar:/home/amila/Downloads/apache-tomcat-7.0.68/bin/tomcat-juli.jar
>>>>>>> Tomcat started.
>>>>>>>
>>>>>>> Earlier I didn't add the openrdf-sesame and openrdf-workbench war
>>>>>>> files to the webapp folder as in the vagrant file. So I added them. But
>>>>>>> when I open browser to http://localhost:8080/openrdf-sesame/protocol
>>>>>>> I got the massage HTTP Status 404 - /openrdf-sesame/protocol
>>>>>>> I think there must be a problem with tomcat cofigurations and i'm
>>>>>>> working on that.
>>>>>>>
>>>>>>> Am I doing these things in a correct way? Any ideas about this is
>>>>>>> appriciated.
>>>>>>>
>>>>>>> Thank you!
>>>>>>>
>>>>>>> On Fri, May 6, 2016 at 8:38 PM, Adina Crainiceanu <ad...@usna.edu>
>>>>>>> wrote:
>>>>>>>
>>>>>>>> Amila,
>>>>>>>>
>>>>>>>> Any progress in getting Accumulo and Rya running? What did you try
>>>>>>>> for this?
>>>>>>>>
>>>>>>>> As one of the emails suggested, you can delete the directory where
>>>>>>>> accumulo stores it data, and then re-initialize. The instance name does not
>>>>>>>> matter for Rya - it is just a parameter provided to Rya.
>>>>>>>>
>>>>>>>> The following snippet is the relevant part in the vagrant script to
>>>>>>>> re-create the data folders and re-initialize accumulo - note that the
>>>>>>>> vagrant script does not use hadoop, just the file system and zookeeper:
>>>>>>>>
>>>>>>>> sudo mkdir /data
>>>>>>>> sudo chown vagrant:vagrant /data
>>>>>>>> mkdir /data/accumulo
>>>>>>>> mkdir /data/accumulo/lib
>>>>>>>> mkdir /data/accumulo/lib/ext
>>>>>>>> echo "Starting Accumulo..."
>>>>>>>> accumulo-${ACCUMULO_VERSION}/bin/accumulo init --instance-name dev
>>>>>>>> --password root
>>>>>>>> accumulo-${ACCUMULO_VERSION}/bin/start-all.sh
>>>>>>>>
>>>>>>>> I am concerned by the lack of progress and the lack of a clear plan
>>>>>>>> for the project once the coding period begins. Please let me know what your
>>>>>>>> plans are. I'm here to help you to be successful. Failing, either after the
>>>>>>>> bonding period, at the mid-term time or at the end is not something that
>>>>>>>> anyone wants.
>>>>>>>>
>>>>>>>>
>>>>>>>> Adina
>>>>>>>>
>>>>>>>> On Tue, May 3, 2016 at 1:36 PM, Adina Crainiceanu <ad...@usna.edu>
>>>>>>>> wrote:
>>>>>>>>
>>>>>>>>> Hi Amila,
>>>>>>>>>
>>>>>>>>> 1) Rya should be able to use whatever Accumulo instance name you
>>>>>>>>> provide - did you try to use Rya with a given Accumulo instance name and it
>>>>>>>>> did not work? What did you try?
>>>>>>>>>
>>>>>>>>> 2)
>>>>>>>>>
>>>>>>>>> DId you look at the vagrant script to see if it does something
>>>>>>>>> different than you did?
>>>>>>>>>
>>>>>>>>> DId you have the problem first time you installed Accumulo, or only
>>>>>>>>> on restart?
>>>>>>>>>
>>>>>>>>> Did you try to ping Zookeeper, to make sure it is up?
>>>>>>>>> Ping Zookeeper (run: echo ruok | nc 127.0.0.1 2181). -- or
>>>>>>>>> whatever ip/port you use for Zookeeper
>>>>>>>>>
>>>>>>>>> - If Zookeeper is okay, you should see the response imok
>>>>>>>>> - Otherwise, restart Zookeeper (run something similar to ~/Installs//zookeeper-3.4.5-cdh4.5.0/bin/zkServer.sh
>>>>>>>>> start)
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> 3) Try to connect to the Rya "office hours" tomorrow (Wednesday) at
>>>>>>>>> 12pm EST. A message with connect information should be sent out tomorrow
>>>>>>>>> morning. Then maybe you will be able to share your screen and ask for help.
>>>>>>>>>
>>>>>>>>> Adina
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> On Tue, May 3, 2016 at 9:25 AM, Amila Wijayarathna <
>>>>>>>>> amwijayarathna@gmail.com> wrote:
>>>>>>>>>
>>>>>>>>>> Hi Adina, These days I'm trying to run Rya in my Ubuntu laptop.
>>>>>>>>>> Therefore I set up Hadoop, Zookeeper and Accumulo. After a shutdown, I need
>>>>>>>>>> to restart hadoop, zookeeper and accumulo. But when i do Hadoop and
>>>>>>>>>> Zookeeper servers are starting successfully but when i initialize Accumulo
>>>>>>>>>> i get the following, 2016-04-19 16:56:06,984 [fs.VolumeManagerImpl] WARN :
>>>>>>>>>> dfs.datanode.synconclose set to false in : data loss is possible on hard
>>>>>>>>>> system reset or power loss 2016-04-19 16:56:06,985 [init.Initialize] INFO :
>>>>>>>>>> Hadoop Filesystem is hdfs://localhost:9000 2016-04-19 16:56:06,986
>>>>>>>>>> [init.Initialize] INFO : Accumulo data dirs are
>>>>>>>>>> [hdfs://localhost:9000/accumulo] 2016-04-19 16:56:06,986 [init.Initialize]
>>>>>>>>>> INFO : Zookeeper server is localhost:2181 2016-04-19 16:56:06,986
>>>>>>>>>> [init.Initialize] INFO : Checking if Zookeeper is available. If this hangs,
>>>>>>>>>> then you need to make sure zookeeper is running 2016-04-19 16:56:07,250
>>>>>>>>>> [init.Initialize] FATAL: It appears the directories
>>>>>>>>>> [hdfs://localhost:9000/accumulo] were previously initialized. 2016-04-19
>>>>>>>>>> 16:56:07,250 [init.Initialize] FATAL: Change the property instance.volumes
>>>>>>>>>> to use different filesystems, 2016-04-19 16:56:07,250 [init.Initialize]
>>>>>>>>>> FATAL: or change the property instance.dfs.dir to use a different
>>>>>>>>>> directory. 2016-04-19 16:56:07,250 [init.Initialize] FATAL: The current
>>>>>>>>>> value of instance.dfs.uri is || 2016-04-19 16:56:07,250 [init.Initialize]
>>>>>>>>>> FATAL: The current value of instance.dfs.dir is |/accumulo| 2016-04-19
>>>>>>>>>> 16:56:07,250 [init.Initialize] FATAL: The current value of instance.volumes
>>>>>>>>>> is |hdfs://localhost:9000/accumulo| Then i tried to start Accumulo with
>>>>>>>>>> ~/Installs/accumulo-1.6.4/bin/start-all.sh then i get following, WARN :
>>>>>>>>>> Using Zookeeper /home/amila/Installs/zookeeper-3.4.8/zookeeper-3.4.8. Use
>>>>>>>>>> version 3.3.0 or greater to avoid zookeeper deadlock bug. Starting monitor
>>>>>>>>>> on localhost WARN : Max open files on localhost is 1024, recommend 32768
>>>>>>>>>> Starting tablet servers .... done 2016-04-19 17:40:43,303
>>>>>>>>>> [fs.VolumeManagerImpl] WARN : dfs.datanode.synconclose set to false in
>>>>>>>>>> hdfs-site.xml: data loss is possible on hard system reset or power loss
>>>>>>>>>> 2016-04-19 17:40:43,308 [server.Accumulo] INFO : Attempting to talk to
>>>>>>>>>> zookeeper 2016-04-19 17:40:43,522 [server.Accumulo] INFO : Waiting for
>>>>>>>>>> accumulo to be initialized 2016-04-19 17:40:44,534 [server.Accumulo] INFO :
>>>>>>>>>> Waiting for accumulo to be initialized 2016-04-19 17:40:45,536
>>>>>>>>>> [server.Accumulo] INFO : Waiting for accumulo to be initialized 2016-04-19
>>>>>>>>>> 17:40:46,538 [server.Accumulo] INFO : Waiting for accumulo to be
>>>>>>>>>> initialized 2016-04-19 17:40:47,541 [server.Accumulo] INFO : Waiting for
>>>>>>>>>> accumulo to be initialized 2016-04-19 17:40:48,543 [server.Accumulo] INFO :
>>>>>>>>>> Waiting for accumulo to be initialized 2016-04-19 17:40:49,545
>>>>>>>>>> [server.Accumulo] INFO : Waiting for accumulo to be initialized 2016-04-19
>>>>>>>>>> 17:40:50,547 [server.Accumulo] INFO : Waiting for accumulo to be
>>>>>>>>>> initialized 2016-04-19 17:40:51,549 [server.Accumulo] INFO : Waiting for
>>>>>>>>>> accumulo to be initialized 2016-04-19 17:40:52,550 [server.Accumulo] INFO :
>>>>>>>>>> Waiting for accumulo to be initialized Starting tablet server on localhost
>>>>>>>>>> WARN : Max open files on localhost is 1024, recommend 32768 2016-04-19
>>>>>>>>>> 17:40:53,551 [server.Accumulo] INFO : Waiting for accumulo to be
>>>>>>>>>> initialized 2016-04-19 17:40:54,552 [server.Accumulo] INFO : Waiting for
>>>>>>>>>> accumulo to be initialized 2016-04-19 17:40:55,554 [server.Accumulo] INFO :
>>>>>>>>>> Waiting for accumulo to be initialized 2016-04-19 17:40:56,555
>>>>>>>>>> [server.Accumulo] INFO : Waiting for accumulo to be initialized 2016-04-19
>>>>>>>>>> 17:40:57,556 [server.Accumulo] INFO : Waiting for accumulo to be
>>>>>>>>>> initialized 2016-04-19 17:40:58,558 [server.Accumulo] INFO : Waiting for
>>>>>>>>>> accumulo to be initialized 2016-04-19 17:40:59,559 [server.Accumulo] INFO :
>>>>>>>>>> Waiting for accumulo to be initialized 2016-04-19 17:41:00,561
>>>>>>>>>> [server.Accumulo] INFO : Waiting for accumulo to be initialized But when I
>>>>>>>>>> change the instance name in accumulo-site.xml then I can successfully start
>>>>>>>>>> Accumulo. But I think to run Rya there must be a constant instance name as
>>>>>>>>>> in Rya README.md. I asked help from Accumulo-dev about this problem but I'm
>>>>>>>>>> unable to find a correct path to solve this.
>>>>>>>>>> Any idea about this is thoroughly appriciated.
>>>>>>>>>> Thank you.
>>>>>>>>>>
>>>>>>>>>> On Mon, May 2, 2016 at 8:39 PM, Adina Crainiceanu <ad...@usna.edu>
>>>>>>>>>> wrote:
>>>>>>>>>>
>>>>>>>>>>> Hi Amila,
>>>>>>>>>>>
>>>>>>>>>>> Were you able to get Accumulo and Rya running on your machine? If
>>>>>>>>>>> not, did you take a look at the Rya Vagrant example
>>>>>>>>>>> https://github.com/apache/incubator-rya/tree/develop/extras/vagrantExample/src/main/vagrant
>>>>>>>>>>> to see if it helps?
>>>>>>>>>>>
>>>>>>>>>>> During this community bonding period, you will need to refine the
>>>>>>>>>>> project proposal and have a concrete plan that you can start implementing
>>>>>>>>>>> when the coding starts. A weekly plan would be best, or at least a plan
>>>>>>>>>>> that has 2-week period sprints. When making the plan, please take into
>>>>>>>>>>> consideration your outside commitments, exams, etc, and include those in
>>>>>>>>>>> planning, so we know what to expect. We will help with the plan, just ask.
>>>>>>>>>>>
>>>>>>>>>>> In order to make it easy for everyone to collaborate, I created a
>>>>>>>>>>> page on the Rya Confluence for your proposal - you should be able to create
>>>>>>>>>>> a Confluence account and edit the page/add pages with details.
>>>>>>>>>>> https://cwiki.apache.org/confluence/display/RYA/Set-up+continuous+integration+for+Apache+Rya
>>>>>>>>>>>
>>>>>>>>>>> Here is an example for how a proposal and the details/planning,
>>>>>>>>>>> etc looks like for a different project (not Rya) from last year GSoC:
>>>>>>>>>>>
>>>>>>>>>>> https://cwiki.apache.org/confluence/display/AIRAVATA/%5BGSoC+Proposal%5D+Securing+Airavata+API
>>>>>>>>>>>
>>>>>>>>>>> Here is a fragment from a message about the expectation for
>>>>>>>>>>> students during the community bonding period April 22-May 22:
>>>>>>>>>>>
>>>>>>>>>>> *Community Bonding activities may involve:*
>>>>>>>>>>>
>>>>>>>>>>> - Becoming familiar with the community practices and
>>>>>>>>>>> processes. (This often involves a mix of observation and participation.)
>>>>>>>>>>> - Participating on Mailing Lists / IRC / etc. (Not just
>>>>>>>>>>> lurking.)
>>>>>>>>>>> - Setting up their development environment.
>>>>>>>>>>> - Small (or large) patches/bug fixes. (These do not need to
>>>>>>>>>>> be directly related to their GSoC project.)
>>>>>>>>>>> - Participating in code reviews for others. (Even someone who
>>>>>>>>>>> isn't familiar with the project can contribute by pointing out potential
>>>>>>>>>>> inefficiencies, bad error handling, etc.)
>>>>>>>>>>> - Working with their mentor and other org members on refining
>>>>>>>>>>> their project plan. This might include finalizing deadlines and milestones,
>>>>>>>>>>> adding more detail, figuring out potential issues, etc.
>>>>>>>>>>> - If the student is already familiar with the organization,
>>>>>>>>>>> they could be helping others get involved in the community.
>>>>>>>>>>> - Reading (and updating!) documentation they will need to
>>>>>>>>>>> understand to complete their project.
>>>>>>>>>>> - Reporting or replicating bugs.
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> Looking forward to working with you,
>>>>>>>>>>> Adina
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> --
>>>>>>>>>>> Dr. Adina Crainiceanu
>>>>>>>>>>> Associate Professor, Computer Science Department
>>>>>>>>>>> United States Naval Academy
>>>>>>>>>>> 410-293-6822
>>>>>>>>>>> adina@usna.edu
>>>>>>>>>>> http://www.usna.edu/Users/cs/adina/
>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> --
>>>>>>>>>>
>>>>>>>>>> *Amila Wijayarathna*
>>>>>>>>>> Undergraduate,
>>>>>>>>>> Faculty of Information Technology,
>>>>>>>>>> University of Moratuwa,
>>>>>>>>>> Sri Lanka.
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> --
>>>>>>>>> Dr. Adina Crainiceanu
>>>>>>>>> Associate Professor, Computer Science Department
>>>>>>>>> United States Naval Academy
>>>>>>>>> 410-293-6822
>>>>>>>>> adina@usna.edu
>>>>>>>>> http://www.usna.edu/Users/cs/adina/
>>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> --
>>>>>>>> Dr. Adina Crainiceanu
>>>>>>>> Associate Professor, Computer Science Department
>>>>>>>> United States Naval Academy
>>>>>>>> 410-293-6822
>>>>>>>> adina@usna.edu
>>>>>>>> http://www.usna.edu/Users/cs/adina/
>>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> --
>>>>>>>
>>>>>>> *Amila Wijayarathna*
>>>>>>> Undergraduate,
>>>>>>> Faculty of Information Technology,
>>>>>>> University of Moratuwa,
>>>>>>> Sri Lanka.
>>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> --
>>>>>>
>>>>>> *Amila Wijayarathna*
>>>>>> Undergraduate,
>>>>>> Faculty of Information Technology,
>>>>>> University of Moratuwa,
>>>>>> Sri Lanka.
>>>>>>
>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> Dr. Adina Crainiceanu
>>>>> Associate Professor, Computer Science Department
>>>>> United States Naval Academy
>>>>> 410-293-6822
>>>>> adina@usna.edu
>>>>> http://www.usna.edu/Users/cs/adina/
>>>>>
>>>>
>>>>
>>>>
>>>> --
>>>>
>>>> *Amila Wijayarathna*
>>>> Undergraduate,
>>>> Faculty of Information Technology,
>>>> University of Moratuwa,
>>>> Sri Lanka.
>>>>
>>>
>>>
>>>
>>> --
>>> Dr. Adina Crainiceanu
>>> Associate Professor, Computer Science Department
>>> United States Naval Academy
>>> 410-293-6822
>>> adina@usna.edu
>>> http://www.usna.edu/Users/cs/adina/
>>>
>>
>>
>>
>> --
>>
>> *Amila Wijayarathna*
>> Undergraduate,
>> Faculty of Information Technology,
>> University of Moratuwa,
>> Sri Lanka.
>>
>
>
>
> --
>
> *Amila Wijayarathna*
> Undergraduate,
> Faculty of Information Technology,
> University of Moratuwa,
> Sri Lanka.
Re: GSoC - community bonding period
Posted by Amila Wijayarathna <am...@gmail.com>.
Hi Adina,
I went through the vagrant file. And there is a line,
*# soft linking the files doesn't seem to work in tomcat, so we copy them
instead :(*
*sudo cp
rya.indexing.example-${RYA_EXAMPLE_VERSION}-distribution/dist/lib/*
/var/lib/tomcat7/webapps/openrdf-workbench/WEB-INF/lib/*
*sudo cp
rya.indexing.example-${RYA_EXAMPLE_VERSION}-distribution/dist/lib/*
/var/lib/tomcat7/webapps/openrdf-sesame/WEB-INF/lib/*
But I was unable to do so because I cannot find */dist/lib/* .*
Any guidelines about this is thoroughly appreciated.
Thank you!
On Mon, May 9, 2016 at 7:45 PM, Amila Wijayarathna <amwijayarathna@gmail.com
> wrote:
> Hi Adina,
>
> The files you mentioned are not existing in the directory.
> I will go through your guidelines and vagrant file.
>
> Thank you!
>
> On Mon, May 9, 2016 at 7:29 PM, Adina Crainiceanu <ad...@usna.edu> wrote:
>
>> Based on your error and the vagrant readme file, I think the OpenRDF
>> Workbench transformations are not installed.
>>
>> Try this - adapted for your computer instead of the vagrant VM:
>> "OpenRDF Workbench requires a set of "transformations" for listing Rya in
>> the OpenRDF Workbench Repository list. The transforms are in this
>> directory: /var/lib/tomcat7/webapps/openrdf-workbench/transformations/
>>
>> 1. Verify that this file exists: create-RyaAccumuloSail.xsl
>> 2. Verify that create.xsl has been updated for rya. (run: "cat
>> create.xsl | grep Rya" and make sure there's some stuff there.)
>>
>> If these files do note exists, open the vagrant file and look for the
>> line echo "Downloading Rya". Try working through those commands manually
>> on your Vagrant VM."
>>
>> In particular, the lines for "# Download and install new templates for
>> OpenRdf WorkBench" in the vagrant file might be the ones that you are
>> missing.
>>
>> Please make detailed notes of what you are doing, so we can reproduce the
>> process on a new machine - I'm tryiong to get an Amazon EC2 instance so we
>> can all have access to it.
>>
>>
>> Adina
>>
>>
>>
>>
>> On Mon, May 9, 2016 at 9:09 AM, Amila Wijayarathna <
>> amwijayarathna@gmail.com> wrote:
>>
>>> Hi Adina,
>>> As in the vagrant file i tried to connect Rya via OpenRDF workbench to
>>> insert data. When i create new repository in workbench i have chose the
>>> type. But there is no "Rya Accumulo Store" type to chose as in the
>>> vagrant file.
>>> Any idea about this is thoroughly appriciated.
>>>
>>> Thank you!
>>>
>>> On Sat, May 7, 2016 at 9:36 PM, Adina Crainiceanu <ad...@usna.edu>
>>> wrote:
>>>
>>>> Hi,
>>>>
>>>> The screen shot for the web.rya/sparqlQuery.jsp looks correct. You
>>>> should try to insert some data and see if you can query it back. You might
>>>> be able to do an insert and select through the web.rya interface, but I'm
>>>> not sure about the insert.
>>>>
>>>>
>>>> The easiest way to do insert is through the openRDF Workbench interface.
>>>> Look in the vagrant file to see how to set it up.
>>>> Look in the Readme file for the vagrant example to see how to load some
>>>> data
>>>> https://github.com/apache/incubator-rya/tree/develop/extras/vagrantExample/src/main/vagrant
>>>>
>>>> Once you have data, you should be able to use either the we.rya
>>>> interface or the openRDf workbench interface to query the data using a
>>>> sparql select query.
>>>>
>>>> Adina
>>>>
>>>> On Sat, May 7, 2016 at 8:37 AM, Amila Wijayarathna <
>>>> amwijayarathna@gmail.com> wrote:
>>>>
>>>>> Hi Adina,
>>>>>
>>>>> I changed some settings and restart tomcat server. And when I browse
>>>>> in to http://localhost:8080/web.rya/sparqlQuery.jsp , I got the
>>>>> following window.
>>>>>
>>>>> Am I doing it correctly? If it is, I would like to know how to proceed
>>>>> further.
>>>>>
>>>>>
>>>>> Thank you!
>>>>>
>>>>> On Sat, May 7, 2016 at 12:43 PM, Amila Wijayarathna <
>>>>> amwijayarathna@gmail.com> wrote:
>>>>>
>>>>>> Hi Adina,
>>>>>>
>>>>>> When I changed the Accumulo instance volume in accumulo site.xml , I
>>>>>> can successfully start accumulo and I think it will not a problem for
>>>>>> instance name, it is remaining the same. So after a restart my laptop I
>>>>>> started the hadoop, zookeeper and accumulo and got the following,
>>>>>>
>>>>>> amila@amila-X550LD:~$ ~/Installs/hadoop-2.7.2/sbin/start-dfs.sh
>>>>>> Starting namenodes on [localhost]
>>>>>> localhost: starting namenode, logging to
>>>>>> /home/amila/Installs/hadoop-2.7.2/logs/hadoop-amila-namenode-amila-X550LD.out
>>>>>> localhost: starting datanode, logging to
>>>>>> /home/amila/Installs/hadoop-2.7.2/logs/hadoop-amila-datanode-amila-X550LD.out
>>>>>> Starting secondary namenodes [0.0.0.0]
>>>>>> 0.0.0.0: starting secondarynamenode, logging to
>>>>>> /home/amila/Installs/hadoop-2.7.2/logs/hadoop-amila-secondarynamenode-amila-X550LD.out
>>>>>>
>>>>>> amila@amila-X550LD:~$ ~/Installs/zookeeper-3.4.8/bin/zkServer.sh
>>>>>> start
>>>>>> ZooKeeper JMX enabled by default
>>>>>> Using config: /home/amila/Installs/zookeeper-3.4.8/bin/../conf/zoo.cfg
>>>>>> Starting zookeeper ... STARTED
>>>>>>
>>>>>> amila@amila-X550LD:~$ ~/Installs/accumulo-1.6.4/bin/accumulo init
>>>>>> 2016-05-07 08:44:23,775 [init.Initialize] INFO : Hadoop Filesystem is
>>>>>> hdfs://localhost:9000
>>>>>> 2016-05-07 08:44:23,776 [init.Initialize] INFO : Accumulo data dirs
>>>>>> are [hdfs://localhost:9000/ACCUMULO]
>>>>>> 2016-05-07 08:44:23,776 [init.Initialize] INFO : Zookeeper server is
>>>>>> localhost:2181
>>>>>> 2016-05-07 08:44:23,776 [init.Initialize] INFO : Checking if
>>>>>> Zookeeper is available. If this hangs, then you need to make sure zookeeper
>>>>>> is running
>>>>>> Instance name : AMILA
>>>>>> Enter initial password for root (this may not be applicable for your
>>>>>> security setup): *******
>>>>>> Confirm initial password for root: *******
>>>>>> 2016-05-07 08:45:35,904 [Configuration.deprecation] INFO :
>>>>>> dfs.replication.min is deprecated. Instead, use dfs.namenode.replication.min
>>>>>> 2016-05-07 08:45:36,948 [Configuration.deprecation] INFO :
>>>>>> dfs.block.size is deprecated. Instead, use dfs.blocksize
>>>>>> 2016-05-07 08:45:37,903 [conf.AccumuloConfiguration] INFO : Loaded
>>>>>> class : org.apache.accumulo.server.security.handler.ZKAuthorizor
>>>>>> 2016-05-07 08:45:37,907 [conf.AccumuloConfiguration] INFO : Loaded
>>>>>> class : org.apache.accumulo.server.security.handler.ZKAuthenticator
>>>>>> 2016-05-07 08:45:37,911 [conf.AccumuloConfiguration] INFO : Loaded
>>>>>> class : org.apache.accumulo.server.security.handler.ZKPermHandler
>>>>>>
>>>>>> amila@amila-X550LD:~$
>>>>>> ~/Installs/accumulo-1.6.4/bin/start-all.shStarting monitor on localhost
>>>>>> WARN : Max open files on localhost is 1024, recommend 32768
>>>>>> Starting tablet servers .... done
>>>>>> Starting tablet server on localhost
>>>>>> WARN : Max open files on localhost is 1024, recommend 32768
>>>>>> 2016-05-07 08:46:05,553 [server.Accumulo] INFO : Attempting to talk
>>>>>> to zookeeper
>>>>>> 2016-05-07 08:46:05,711 [server.Accumulo] INFO : ZooKeeper connected
>>>>>> and initialized, attempting to talk to HDFS
>>>>>> 2016-05-07 08:46:05,844 [server.Accumulo] INFO : Connected to HDFS
>>>>>> Starting master on localhost
>>>>>> WARN : Max open files on localhost is 1024, recommend 32768
>>>>>> Starting garbage collector on localhost
>>>>>> WARN : Max open files on localhost is 1024, recommend 32768
>>>>>> Starting tracer on localhost
>>>>>> WARN : Max open files on localhost is 1024, recommend 32768
>>>>>>
>>>>>> amila@amila-X550LD:~/Downloads$ cd apache-tomcat-7.0.68
>>>>>> amila@amila-X550LD:~/Downloads/apache-tomcat-7.0.68$ ./bin/startup.sh
>>>>>> Using CATALINA_BASE: /home/amila/Downloads/apache-tomcat-7.0.68
>>>>>> Using CATALINA_HOME: /home/amila/Downloads/apache-tomcat-7.0.68
>>>>>> Using CATALINA_TMPDIR: /home/amila/Downloads/apache-tomcat-7.0.68/temp
>>>>>> Using JRE_HOME: /usr/local/java/jdk1.8.0_74/jre
>>>>>> Using CLASSPATH:
>>>>>> /home/amila/Downloads/apache-tomcat-7.0.68/bin/bootstrap.jar:/home/amila/Downloads/apache-tomcat-7.0.68/bin/tomcat-juli.jar
>>>>>> Tomcat started.
>>>>>>
>>>>>> Earlier I didn't add the openrdf-sesame and openrdf-workbench war
>>>>>> files to the webapp folder as in the vagrant file. So I added them. But
>>>>>> when I open browser to http://localhost:8080/openrdf-sesame/protocol
>>>>>> I got the massage HTTP Status 404 - /openrdf-sesame/protocol
>>>>>> I think there must be a problem with tomcat cofigurations and i'm
>>>>>> working on that.
>>>>>>
>>>>>> Am I doing these things in a correct way? Any ideas about this is
>>>>>> appriciated.
>>>>>>
>>>>>> Thank you!
>>>>>>
>>>>>> On Fri, May 6, 2016 at 8:38 PM, Adina Crainiceanu <ad...@usna.edu>
>>>>>> wrote:
>>>>>>
>>>>>>> Amila,
>>>>>>>
>>>>>>> Any progress in getting Accumulo and Rya running? What did you try
>>>>>>> for this?
>>>>>>>
>>>>>>> As one of the emails suggested, you can delete the directory where
>>>>>>> accumulo stores it data, and then re-initialize. The instance name does not
>>>>>>> matter for Rya - it is just a parameter provided to Rya.
>>>>>>>
>>>>>>> The following snippet is the relevant part in the vagrant script to
>>>>>>> re-create the data folders and re-initialize accumulo - note that the
>>>>>>> vagrant script does not use hadoop, just the file system and zookeeper:
>>>>>>>
>>>>>>> sudo mkdir /data
>>>>>>> sudo chown vagrant:vagrant /data
>>>>>>> mkdir /data/accumulo
>>>>>>> mkdir /data/accumulo/lib
>>>>>>> mkdir /data/accumulo/lib/ext
>>>>>>> echo "Starting Accumulo..."
>>>>>>> accumulo-${ACCUMULO_VERSION}/bin/accumulo init --instance-name dev
>>>>>>> --password root
>>>>>>> accumulo-${ACCUMULO_VERSION}/bin/start-all.sh
>>>>>>>
>>>>>>> I am concerned by the lack of progress and the lack of a clear plan
>>>>>>> for the project once the coding period begins. Please let me know what your
>>>>>>> plans are. I'm here to help you to be successful. Failing, either after the
>>>>>>> bonding period, at the mid-term time or at the end is not something that
>>>>>>> anyone wants.
>>>>>>>
>>>>>>>
>>>>>>> Adina
>>>>>>>
>>>>>>> On Tue, May 3, 2016 at 1:36 PM, Adina Crainiceanu <ad...@usna.edu>
>>>>>>> wrote:
>>>>>>>
>>>>>>>> Hi Amila,
>>>>>>>>
>>>>>>>> 1) Rya should be able to use whatever Accumulo instance name you
>>>>>>>> provide - did you try to use Rya with a given Accumulo instance name and it
>>>>>>>> did not work? What did you try?
>>>>>>>>
>>>>>>>> 2)
>>>>>>>>
>>>>>>>> DId you look at the vagrant script to see if it does something
>>>>>>>> different than you did?
>>>>>>>>
>>>>>>>> DId you have the problem first time you installed Accumulo, or only
>>>>>>>> on restart?
>>>>>>>>
>>>>>>>> Did you try to ping Zookeeper, to make sure it is up?
>>>>>>>> Ping Zookeeper (run: echo ruok | nc 127.0.0.1 2181). -- or
>>>>>>>> whatever ip/port you use for Zookeeper
>>>>>>>>
>>>>>>>> - If Zookeeper is okay, you should see the response imok
>>>>>>>> - Otherwise, restart Zookeeper (run something similar to ~/Installs//zookeeper-3.4.5-cdh4.5.0/bin/zkServer.sh
>>>>>>>> start)
>>>>>>>>
>>>>>>>>
>>>>>>>> 3) Try to connect to the Rya "office hours" tomorrow (Wednesday) at
>>>>>>>> 12pm EST. A message with connect information should be sent out tomorrow
>>>>>>>> morning. Then maybe you will be able to share your screen and ask for help.
>>>>>>>>
>>>>>>>> Adina
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> On Tue, May 3, 2016 at 9:25 AM, Amila Wijayarathna <
>>>>>>>> amwijayarathna@gmail.com> wrote:
>>>>>>>>
>>>>>>>>> Hi Adina, These days I'm trying to run Rya in my Ubuntu laptop.
>>>>>>>>> Therefore I set up Hadoop, Zookeeper and Accumulo. After a shutdown, I need
>>>>>>>>> to restart hadoop, zookeeper and accumulo. But when i do Hadoop and
>>>>>>>>> Zookeeper servers are starting successfully but when i initialize Accumulo
>>>>>>>>> i get the following, 2016-04-19 16:56:06,984 [fs.VolumeManagerImpl] WARN :
>>>>>>>>> dfs.datanode.synconclose set to false in : data loss is possible on hard
>>>>>>>>> system reset or power loss 2016-04-19 16:56:06,985 [init.Initialize] INFO :
>>>>>>>>> Hadoop Filesystem is hdfs://localhost:9000 2016-04-19 16:56:06,986
>>>>>>>>> [init.Initialize] INFO : Accumulo data dirs are
>>>>>>>>> [hdfs://localhost:9000/accumulo] 2016-04-19 16:56:06,986 [init.Initialize]
>>>>>>>>> INFO : Zookeeper server is localhost:2181 2016-04-19 16:56:06,986
>>>>>>>>> [init.Initialize] INFO : Checking if Zookeeper is available. If this hangs,
>>>>>>>>> then you need to make sure zookeeper is running 2016-04-19 16:56:07,250
>>>>>>>>> [init.Initialize] FATAL: It appears the directories
>>>>>>>>> [hdfs://localhost:9000/accumulo] were previously initialized. 2016-04-19
>>>>>>>>> 16:56:07,250 [init.Initialize] FATAL: Change the property instance.volumes
>>>>>>>>> to use different filesystems, 2016-04-19 16:56:07,250 [init.Initialize]
>>>>>>>>> FATAL: or change the property instance.dfs.dir to use a different
>>>>>>>>> directory. 2016-04-19 16:56:07,250 [init.Initialize] FATAL: The current
>>>>>>>>> value of instance.dfs.uri is || 2016-04-19 16:56:07,250 [init.Initialize]
>>>>>>>>> FATAL: The current value of instance.dfs.dir is |/accumulo| 2016-04-19
>>>>>>>>> 16:56:07,250 [init.Initialize] FATAL: The current value of instance.volumes
>>>>>>>>> is |hdfs://localhost:9000/accumulo| Then i tried to start Accumulo with
>>>>>>>>> ~/Installs/accumulo-1.6.4/bin/start-all.sh then i get following, WARN :
>>>>>>>>> Using Zookeeper /home/amila/Installs/zookeeper-3.4.8/zookeeper-3.4.8. Use
>>>>>>>>> version 3.3.0 or greater to avoid zookeeper deadlock bug. Starting monitor
>>>>>>>>> on localhost WARN : Max open files on localhost is 1024, recommend 32768
>>>>>>>>> Starting tablet servers .... done 2016-04-19 17:40:43,303
>>>>>>>>> [fs.VolumeManagerImpl] WARN : dfs.datanode.synconclose set to false in
>>>>>>>>> hdfs-site.xml: data loss is possible on hard system reset or power loss
>>>>>>>>> 2016-04-19 17:40:43,308 [server.Accumulo] INFO : Attempting to talk to
>>>>>>>>> zookeeper 2016-04-19 17:40:43,522 [server.Accumulo] INFO : Waiting for
>>>>>>>>> accumulo to be initialized 2016-04-19 17:40:44,534 [server.Accumulo] INFO :
>>>>>>>>> Waiting for accumulo to be initialized 2016-04-19 17:40:45,536
>>>>>>>>> [server.Accumulo] INFO : Waiting for accumulo to be initialized 2016-04-19
>>>>>>>>> 17:40:46,538 [server.Accumulo] INFO : Waiting for accumulo to be
>>>>>>>>> initialized 2016-04-19 17:40:47,541 [server.Accumulo] INFO : Waiting for
>>>>>>>>> accumulo to be initialized 2016-04-19 17:40:48,543 [server.Accumulo] INFO :
>>>>>>>>> Waiting for accumulo to be initialized 2016-04-19 17:40:49,545
>>>>>>>>> [server.Accumulo] INFO : Waiting for accumulo to be initialized 2016-04-19
>>>>>>>>> 17:40:50,547 [server.Accumulo] INFO : Waiting for accumulo to be
>>>>>>>>> initialized 2016-04-19 17:40:51,549 [server.Accumulo] INFO : Waiting for
>>>>>>>>> accumulo to be initialized 2016-04-19 17:40:52,550 [server.Accumulo] INFO :
>>>>>>>>> Waiting for accumulo to be initialized Starting tablet server on localhost
>>>>>>>>> WARN : Max open files on localhost is 1024, recommend 32768 2016-04-19
>>>>>>>>> 17:40:53,551 [server.Accumulo] INFO : Waiting for accumulo to be
>>>>>>>>> initialized 2016-04-19 17:40:54,552 [server.Accumulo] INFO : Waiting for
>>>>>>>>> accumulo to be initialized 2016-04-19 17:40:55,554 [server.Accumulo] INFO :
>>>>>>>>> Waiting for accumulo to be initialized 2016-04-19 17:40:56,555
>>>>>>>>> [server.Accumulo] INFO : Waiting for accumulo to be initialized 2016-04-19
>>>>>>>>> 17:40:57,556 [server.Accumulo] INFO : Waiting for accumulo to be
>>>>>>>>> initialized 2016-04-19 17:40:58,558 [server.Accumulo] INFO : Waiting for
>>>>>>>>> accumulo to be initialized 2016-04-19 17:40:59,559 [server.Accumulo] INFO :
>>>>>>>>> Waiting for accumulo to be initialized 2016-04-19 17:41:00,561
>>>>>>>>> [server.Accumulo] INFO : Waiting for accumulo to be initialized But when I
>>>>>>>>> change the instance name in accumulo-site.xml then I can successfully start
>>>>>>>>> Accumulo. But I think to run Rya there must be a constant instance name as
>>>>>>>>> in Rya README.md. I asked help from Accumulo-dev about this problem but I'm
>>>>>>>>> unable to find a correct path to solve this.
>>>>>>>>> Any idea about this is thoroughly appriciated.
>>>>>>>>> Thank you.
>>>>>>>>>
>>>>>>>>> On Mon, May 2, 2016 at 8:39 PM, Adina Crainiceanu <ad...@usna.edu>
>>>>>>>>> wrote:
>>>>>>>>>
>>>>>>>>>> Hi Amila,
>>>>>>>>>>
>>>>>>>>>> Were you able to get Accumulo and Rya running on your machine? If
>>>>>>>>>> not, did you take a look at the Rya Vagrant example
>>>>>>>>>> https://github.com/apache/incubator-rya/tree/develop/extras/vagrantExample/src/main/vagrant
>>>>>>>>>> to see if it helps?
>>>>>>>>>>
>>>>>>>>>> During this community bonding period, you will need to refine the
>>>>>>>>>> project proposal and have a concrete plan that you can start implementing
>>>>>>>>>> when the coding starts. A weekly plan would be best, or at least a plan
>>>>>>>>>> that has 2-week period sprints. When making the plan, please take into
>>>>>>>>>> consideration your outside commitments, exams, etc, and include those in
>>>>>>>>>> planning, so we know what to expect. We will help with the plan, just ask.
>>>>>>>>>>
>>>>>>>>>> In order to make it easy for everyone to collaborate, I created a
>>>>>>>>>> page on the Rya Confluence for your proposal - you should be able to create
>>>>>>>>>> a Confluence account and edit the page/add pages with details.
>>>>>>>>>> https://cwiki.apache.org/confluence/display/RYA/Set-up+continuous+integration+for+Apache+Rya
>>>>>>>>>>
>>>>>>>>>> Here is an example for how a proposal and the details/planning,
>>>>>>>>>> etc looks like for a different project (not Rya) from last year GSoC:
>>>>>>>>>>
>>>>>>>>>> https://cwiki.apache.org/confluence/display/AIRAVATA/%5BGSoC+Proposal%5D+Securing+Airavata+API
>>>>>>>>>>
>>>>>>>>>> Here is a fragment from a message about the expectation for
>>>>>>>>>> students during the community bonding period April 22-May 22:
>>>>>>>>>>
>>>>>>>>>> *Community Bonding activities may involve:*
>>>>>>>>>>
>>>>>>>>>> - Becoming familiar with the community practices and
>>>>>>>>>> processes. (This often involves a mix of observation and participation.)
>>>>>>>>>> - Participating on Mailing Lists / IRC / etc. (Not just
>>>>>>>>>> lurking.)
>>>>>>>>>> - Setting up their development environment.
>>>>>>>>>> - Small (or large) patches/bug fixes. (These do not need to
>>>>>>>>>> be directly related to their GSoC project.)
>>>>>>>>>> - Participating in code reviews for others. (Even someone who
>>>>>>>>>> isn't familiar with the project can contribute by pointing out potential
>>>>>>>>>> inefficiencies, bad error handling, etc.)
>>>>>>>>>> - Working with their mentor and other org members on refining
>>>>>>>>>> their project plan. This might include finalizing deadlines and milestones,
>>>>>>>>>> adding more detail, figuring out potential issues, etc.
>>>>>>>>>> - If the student is already familiar with the organization,
>>>>>>>>>> they could be helping others get involved in the community.
>>>>>>>>>> - Reading (and updating!) documentation they will need to
>>>>>>>>>> understand to complete their project.
>>>>>>>>>> - Reporting or replicating bugs.
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> Looking forward to working with you,
>>>>>>>>>> Adina
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> --
>>>>>>>>>> Dr. Adina Crainiceanu
>>>>>>>>>> Associate Professor, Computer Science Department
>>>>>>>>>> United States Naval Academy
>>>>>>>>>> 410-293-6822
>>>>>>>>>> adina@usna.edu
>>>>>>>>>> http://www.usna.edu/Users/cs/adina/
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> --
>>>>>>>>>
>>>>>>>>> *Amila Wijayarathna*
>>>>>>>>> Undergraduate,
>>>>>>>>> Faculty of Information Technology,
>>>>>>>>> University of Moratuwa,
>>>>>>>>> Sri Lanka.
>>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> --
>>>>>>>> Dr. Adina Crainiceanu
>>>>>>>> Associate Professor, Computer Science Department
>>>>>>>> United States Naval Academy
>>>>>>>> 410-293-6822
>>>>>>>> adina@usna.edu
>>>>>>>> http://www.usna.edu/Users/cs/adina/
>>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> --
>>>>>>> Dr. Adina Crainiceanu
>>>>>>> Associate Professor, Computer Science Department
>>>>>>> United States Naval Academy
>>>>>>> 410-293-6822
>>>>>>> adina@usna.edu
>>>>>>> http://www.usna.edu/Users/cs/adina/
>>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> --
>>>>>>
>>>>>> *Amila Wijayarathna*
>>>>>> Undergraduate,
>>>>>> Faculty of Information Technology,
>>>>>> University of Moratuwa,
>>>>>> Sri Lanka.
>>>>>>
>>>>>
>>>>>
>>>>>
>>>>> --
>>>>>
>>>>> *Amila Wijayarathna*
>>>>> Undergraduate,
>>>>> Faculty of Information Technology,
>>>>> University of Moratuwa,
>>>>> Sri Lanka.
>>>>>
>>>>
>>>>
>>>>
>>>> --
>>>> Dr. Adina Crainiceanu
>>>> Associate Professor, Computer Science Department
>>>> United States Naval Academy
>>>> 410-293-6822
>>>> adina@usna.edu
>>>> http://www.usna.edu/Users/cs/adina/
>>>>
>>>
>>>
>>>
>>> --
>>>
>>> *Amila Wijayarathna*
>>> Undergraduate,
>>> Faculty of Information Technology,
>>> University of Moratuwa,
>>> Sri Lanka.
>>>
>>
>>
>>
>> --
>> Dr. Adina Crainiceanu
>> Associate Professor, Computer Science Department
>> United States Naval Academy
>> 410-293-6822
>> adina@usna.edu
>> http://www.usna.edu/Users/cs/adina/
>>
>
>
>
> --
>
> *Amila Wijayarathna*
> Undergraduate,
> Faculty of Information Technology,
> University of Moratuwa,
> Sri Lanka.
>
--
*Amila Wijayarathna*
Undergraduate,
Faculty of Information Technology,
University of Moratuwa,
Sri Lanka.
Re: GSoC - community bonding period
Posted by Adina Crainiceanu <ad...@usna.edu>.
Hi Amila,
1) Rya should be able to use whatever Accumulo instance name you provide -
did you try to use Rya with a given Accumulo instance name and it did not
work? What did you try?
2)
DId you look at the vagrant script to see if it does something different
than you did?
DId you have the problem first time you installed Accumulo, or only on
restart?
Did you try to ping Zookeeper, to make sure it is up?
Ping Zookeeper (run: echo ruok | nc 127.0.0.1 2181). -- or whatever ip/port
you use for Zookeeper
- If Zookeeper is okay, you should see the response imok
- Otherwise, restart Zookeeper (run something similar to
~/Installs//zookeeper-3.4.5-cdh4.5.0/bin/zkServer.sh
start)
3) Try to connect to the Rya "office hours" tomorrow (Wednesday) at 12pm
EST. A message with connect information should be sent out tomorrow
morning. Then maybe you will be able to share your screen and ask for help.
Adina
On Tue, May 3, 2016 at 9:25 AM, Amila Wijayarathna <amwijayarathna@gmail.com
> wrote:
> Hi Adina, These days I'm trying to run Rya in my Ubuntu laptop. Therefore
> I set up Hadoop, Zookeeper and Accumulo. After a shutdown, I need to
> restart hadoop, zookeeper and accumulo. But when i do Hadoop and Zookeeper
> servers are starting successfully but when i initialize Accumulo i get the
> following, 2016-04-19 16:56:06,984 [fs.VolumeManagerImpl] WARN :
> dfs.datanode.synconclose set to false in : data loss is possible on hard
> system reset or power loss 2016-04-19 16:56:06,985 [init.Initialize] INFO :
> Hadoop Filesystem is hdfs://localhost:9000 2016-04-19 16:56:06,986
> [init.Initialize] INFO : Accumulo data dirs are
> [hdfs://localhost:9000/accumulo] 2016-04-19 16:56:06,986 [init.Initialize]
> INFO : Zookeeper server is localhost:2181 2016-04-19 16:56:06,986
> [init.Initialize] INFO : Checking if Zookeeper is available. If this hangs,
> then you need to make sure zookeeper is running 2016-04-19 16:56:07,250
> [init.Initialize] FATAL: It appears the directories
> [hdfs://localhost:9000/accumulo] were previously initialized. 2016-04-19
> 16:56:07,250 [init.Initialize] FATAL: Change the property instance.volumes
> to use different filesystems, 2016-04-19 16:56:07,250 [init.Initialize]
> FATAL: or change the property instance.dfs.dir to use a different
> directory. 2016-04-19 16:56:07,250 [init.Initialize] FATAL: The current
> value of instance.dfs.uri is || 2016-04-19 16:56:07,250 [init.Initialize]
> FATAL: The current value of instance.dfs.dir is |/accumulo| 2016-04-19
> 16:56:07,250 [init.Initialize] FATAL: The current value of instance.volumes
> is |hdfs://localhost:9000/accumulo| Then i tried to start Accumulo with
> ~/Installs/accumulo-1.6.4/bin/start-all.sh then i get following, WARN :
> Using Zookeeper /home/amila/Installs/zookeeper-3.4.8/zookeeper-3.4.8. Use
> version 3.3.0 or greater to avoid zookeeper deadlock bug. Starting monitor
> on localhost WARN : Max open files on localhost is 1024, recommend 32768
> Starting tablet servers .... done 2016-04-19 17:40:43,303
> [fs.VolumeManagerImpl] WARN : dfs.datanode.synconclose set to false in
> hdfs-site.xml: data loss is possible on hard system reset or power loss
> 2016-04-19 17:40:43,308 [server.Accumulo] INFO : Attempting to talk to
> zookeeper 2016-04-19 17:40:43,522 [server.Accumulo] INFO : Waiting for
> accumulo to be initialized 2016-04-19 17:40:44,534 [server.Accumulo] INFO :
> Waiting for accumulo to be initialized 2016-04-19 17:40:45,536
> [server.Accumulo] INFO : Waiting for accumulo to be initialized 2016-04-19
> 17:40:46,538 [server.Accumulo] INFO : Waiting for accumulo to be
> initialized 2016-04-19 17:40:47,541 [server.Accumulo] INFO : Waiting for
> accumulo to be initialized 2016-04-19 17:40:48,543 [server.Accumulo] INFO :
> Waiting for accumulo to be initialized 2016-04-19 17:40:49,545
> [server.Accumulo] INFO : Waiting for accumulo to be initialized 2016-04-19
> 17:40:50,547 [server.Accumulo] INFO : Waiting for accumulo to be
> initialized 2016-04-19 17:40:51,549 [server.Accumulo] INFO : Waiting for
> accumulo to be initialized 2016-04-19 17:40:52,550 [server.Accumulo] INFO :
> Waiting for accumulo to be initialized Starting tablet server on localhost
> WARN : Max open files on localhost is 1024, recommend 32768 2016-04-19
> 17:40:53,551 [server.Accumulo] INFO : Waiting for accumulo to be
> initialized 2016-04-19 17:40:54,552 [server.Accumulo] INFO : Waiting for
> accumulo to be initialized 2016-04-19 17:40:55,554 [server.Accumulo] INFO :
> Waiting for accumulo to be initialized 2016-04-19 17:40:56,555
> [server.Accumulo] INFO : Waiting for accumulo to be initialized 2016-04-19
> 17:40:57,556 [server.Accumulo] INFO : Waiting for accumulo to be
> initialized 2016-04-19 17:40:58,558 [server.Accumulo] INFO : Waiting for
> accumulo to be initialized 2016-04-19 17:40:59,559 [server.Accumulo] INFO :
> Waiting for accumulo to be initialized 2016-04-19 17:41:00,561
> [server.Accumulo] INFO : Waiting for accumulo to be initialized But when I
> change the instance name in accumulo-site.xml then I can successfully start
> Accumulo. But I think to run Rya there must be a constant instance name as
> in Rya README.md. I asked help from Accumulo-dev about this problem but I'm
> unable to find a correct path to solve this.
> Any idea about this is thoroughly appriciated.
> Thank you.
>
> On Mon, May 2, 2016 at 8:39 PM, Adina Crainiceanu <ad...@usna.edu> wrote:
>
>> Hi Amila,
>>
>> Were you able to get Accumulo and Rya running on your machine? If not,
>> did you take a look at the Rya Vagrant example
>> https://github.com/apache/incubator-rya/tree/develop/extras/vagrantExample/src/main/vagrant
>> to see if it helps?
>>
>> During this community bonding period, you will need to refine the project
>> proposal and have a concrete plan that you can start implementing when the
>> coding starts. A weekly plan would be best, or at least a plan that has
>> 2-week period sprints. When making the plan, please take into consideration
>> your outside commitments, exams, etc, and include those in planning, so we
>> know what to expect. We will help with the plan, just ask.
>>
>> In order to make it easy for everyone to collaborate, I created a page on
>> the Rya Confluence for your proposal - you should be able to create a
>> Confluence account and edit the page/add pages with details.
>> https://cwiki.apache.org/confluence/display/RYA/Set-up+continuous+integration+for+Apache+Rya
>>
>> Here is an example for how a proposal and the details/planning, etc looks
>> like for a different project (not Rya) from last year GSoC:
>>
>> https://cwiki.apache.org/confluence/display/AIRAVATA/%5BGSoC+Proposal%5D+Securing+Airavata+API
>>
>> Here is a fragment from a message about the expectation for students
>> during the community bonding period April 22-May 22:
>>
>> *Community Bonding activities may involve:*
>>
>> - Becoming familiar with the community practices and processes. (This
>> often involves a mix of observation and participation.)
>> - Participating on Mailing Lists / IRC / etc. (Not just lurking.)
>> - Setting up their development environment.
>> - Small (or large) patches/bug fixes. (These do not need to be
>> directly related to their GSoC project.)
>> - Participating in code reviews for others. (Even someone who isn't
>> familiar with the project can contribute by pointing out potential
>> inefficiencies, bad error handling, etc.)
>> - Working with their mentor and other org members on refining their
>> project plan. This might include finalizing deadlines and milestones,
>> adding more detail, figuring out potential issues, etc.
>> - If the student is already familiar with the organization, they
>> could be helping others get involved in the community.
>> - Reading (and updating!) documentation they will need to understand
>> to complete their project.
>> - Reporting or replicating bugs.
>>
>>
>>
>> Looking forward to working with you,
>> Adina
>>
>>
>> --
>> Dr. Adina Crainiceanu
>> Associate Professor, Computer Science Department
>> United States Naval Academy
>> 410-293-6822
>> adina@usna.edu
>> http://www.usna.edu/Users/cs/adina/
>>
>
>
>
> --
>
> *Amila Wijayarathna*
> Undergraduate,
> Faculty of Information Technology,
> University of Moratuwa,
> Sri Lanka.
>
--
Dr. Adina Crainiceanu
Associate Professor, Computer Science Department
United States Naval Academy
410-293-6822
adina@usna.edu
http://www.usna.edu/Users/cs/adina/
Re: GSoC - community bonding period
Posted by Amila Wijayarathna <am...@gmail.com>.
Hi Adina, These days I'm trying to run Rya in my Ubuntu laptop. Therefore I
set up Hadoop, Zookeeper and Accumulo. After a shutdown, I need to restart
hadoop, zookeeper and accumulo. But when i do Hadoop and Zookeeper servers
are starting successfully but when i initialize Accumulo i get the
following, 2016-04-19 16:56:06,984 [fs.VolumeManagerImpl] WARN :
dfs.datanode.synconclose set to false in : data loss is possible on hard
system reset or power loss 2016-04-19 16:56:06,985 [init.Initialize] INFO :
Hadoop Filesystem is hdfs://localhost:9000 2016-04-19 16:56:06,986
[init.Initialize] INFO : Accumulo data dirs are
[hdfs://localhost:9000/accumulo] 2016-04-19 16:56:06,986 [init.Initialize]
INFO : Zookeeper server is localhost:2181 2016-04-19 16:56:06,986
[init.Initialize] INFO : Checking if Zookeeper is available. If this hangs,
then you need to make sure zookeeper is running 2016-04-19 16:56:07,250
[init.Initialize] FATAL: It appears the directories
[hdfs://localhost:9000/accumulo] were previously initialized. 2016-04-19
16:56:07,250 [init.Initialize] FATAL: Change the property instance.volumes
to use different filesystems, 2016-04-19 16:56:07,250 [init.Initialize]
FATAL: or change the property instance.dfs.dir to use a different
directory. 2016-04-19 16:56:07,250 [init.Initialize] FATAL: The current
value of instance.dfs.uri is || 2016-04-19 16:56:07,250 [init.Initialize]
FATAL: The current value of instance.dfs.dir is |/accumulo| 2016-04-19
16:56:07,250 [init.Initialize] FATAL: The current value of instance.volumes
is |hdfs://localhost:9000/accumulo| Then i tried to start Accumulo with
~/Installs/accumulo-1.6.4/bin/start-all.sh then i get following, WARN :
Using Zookeeper /home/amila/Installs/zookeeper-3.4.8/zookeeper-3.4.8. Use
version 3.3.0 or greater to avoid zookeeper deadlock bug. Starting monitor
on localhost WARN : Max open files on localhost is 1024, recommend 32768
Starting tablet servers .... done 2016-04-19 17:40:43,303
[fs.VolumeManagerImpl] WARN : dfs.datanode.synconclose set to false in
hdfs-site.xml: data loss is possible on hard system reset or power loss
2016-04-19 17:40:43,308 [server.Accumulo] INFO : Attempting to talk to
zookeeper 2016-04-19 17:40:43,522 [server.Accumulo] INFO : Waiting for
accumulo to be initialized 2016-04-19 17:40:44,534 [server.Accumulo] INFO :
Waiting for accumulo to be initialized 2016-04-19 17:40:45,536
[server.Accumulo] INFO : Waiting for accumulo to be initialized 2016-04-19
17:40:46,538 [server.Accumulo] INFO : Waiting for accumulo to be
initialized 2016-04-19 17:40:47,541 [server.Accumulo] INFO : Waiting for
accumulo to be initialized 2016-04-19 17:40:48,543 [server.Accumulo] INFO :
Waiting for accumulo to be initialized 2016-04-19 17:40:49,545
[server.Accumulo] INFO : Waiting for accumulo to be initialized 2016-04-19
17:40:50,547 [server.Accumulo] INFO : Waiting for accumulo to be
initialized 2016-04-19 17:40:51,549 [server.Accumulo] INFO : Waiting for
accumulo to be initialized 2016-04-19 17:40:52,550 [server.Accumulo] INFO :
Waiting for accumulo to be initialized Starting tablet server on localhost
WARN : Max open files on localhost is 1024, recommend 32768 2016-04-19
17:40:53,551 [server.Accumulo] INFO : Waiting for accumulo to be
initialized 2016-04-19 17:40:54,552 [server.Accumulo] INFO : Waiting for
accumulo to be initialized 2016-04-19 17:40:55,554 [server.Accumulo] INFO :
Waiting for accumulo to be initialized 2016-04-19 17:40:56,555
[server.Accumulo] INFO : Waiting for accumulo to be initialized 2016-04-19
17:40:57,556 [server.Accumulo] INFO : Waiting for accumulo to be
initialized 2016-04-19 17:40:58,558 [server.Accumulo] INFO : Waiting for
accumulo to be initialized 2016-04-19 17:40:59,559 [server.Accumulo] INFO :
Waiting for accumulo to be initialized 2016-04-19 17:41:00,561
[server.Accumulo] INFO : Waiting for accumulo to be initialized But when I
change the instance name in accumulo-site.xml then I can successfully start
Accumulo. But I think to run Rya there must be a constant instance name as
in Rya README.md. I asked help from Accumulo-dev about this problem but I'm
unable to find a correct path to solve this.
Any idea about this is thoroughly appriciated.
Thank you.
On Mon, May 2, 2016 at 8:39 PM, Adina Crainiceanu <ad...@usna.edu> wrote:
> Hi Amila,
>
> Were you able to get Accumulo and Rya running on your machine? If not, did
> you take a look at the Rya Vagrant example
> https://github.com/apache/incubator-rya/tree/develop/extras/vagrantExample/src/main/vagrant
> to see if it helps?
>
> During this community bonding period, you will need to refine the project
> proposal and have a concrete plan that you can start implementing when the
> coding starts. A weekly plan would be best, or at least a plan that has
> 2-week period sprints. When making the plan, please take into consideration
> your outside commitments, exams, etc, and include those in planning, so we
> know what to expect. We will help with the plan, just ask.
>
> In order to make it easy for everyone to collaborate, I created a page on
> the Rya Confluence for your proposal - you should be able to create a
> Confluence account and edit the page/add pages with details.
> https://cwiki.apache.org/confluence/display/RYA/Set-up+continuous+integration+for+Apache+Rya
>
> Here is an example for how a proposal and the details/planning, etc looks
> like for a different project (not Rya) from last year GSoC:
>
> https://cwiki.apache.org/confluence/display/AIRAVATA/%5BGSoC+Proposal%5D+Securing+Airavata+API
>
> Here is a fragment from a message about the expectation for students
> during the community bonding period April 22-May 22:
>
> *Community Bonding activities may involve:*
>
> - Becoming familiar with the community practices and processes. (This
> often involves a mix of observation and participation.)
> - Participating on Mailing Lists / IRC / etc. (Not just lurking.)
> - Setting up their development environment.
> - Small (or large) patches/bug fixes. (These do not need to be
> directly related to their GSoC project.)
> - Participating in code reviews for others. (Even someone who isn't
> familiar with the project can contribute by pointing out potential
> inefficiencies, bad error handling, etc.)
> - Working with their mentor and other org members on refining their
> project plan. This might include finalizing deadlines and milestones,
> adding more detail, figuring out potential issues, etc.
> - If the student is already familiar with the organization, they could
> be helping others get involved in the community.
> - Reading (and updating!) documentation they will need to understand
> to complete their project.
> - Reporting or replicating bugs.
>
>
>
> Looking forward to working with you,
> Adina
>
>
> --
> Dr. Adina Crainiceanu
> Associate Professor, Computer Science Department
> United States Naval Academy
> 410-293-6822
> adina@usna.edu
> http://www.usna.edu/Users/cs/adina/
>
--
*Amila Wijayarathna*
Undergraduate,
Faculty of Information Technology,
University of Moratuwa,
Sri Lanka.