You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@streampipes.apache.org by udeho <ud...@student.kit.edu> on 2020/09/18 15:12:42 UTC

Testing Current Release

Hi all,

my name is Tim and I am a master student at KIT.
I have tried to test the current release of version 0.67.0 on a Windows machine.
Running the Maven Build for streampipes and streampipes-extensions worked fine.
But when I do the docker-compose for streampipes I always get the following error:

couchdb_1 | [error] 2020-09-18T14:59:29.766699Z nonode@nohost emulator -------- Error in process <0.3402.0> with exit value:
couchdb_1 | {database_does_not_exist,[{mem3_shards,load_shards_from_db,"_users",[{file,"src/mem3_shards.erl"},{line,395}]},{mem3_shards,load_shards_from_disk,1,[{file,"src/mem3_shards.erl"},{line,370}]},{mem3_shards,load_shards_from_disk,2,[{file,"src/mem3_shards.erl"},{line,399}]},{mem3_shards,for_docid,3,[{file,"src/mem3_shards.erl"},{line,86}]},{fabric_doc_open,go,3,[{file,"src/fabric_doc_open.erl"},{line,39}]},{chttpd_auth_cache,ensure_auth_ddoc_exists,2,[{file,"src/chttpd_auth_cache.erl"},{line,195}]},{chttpd_auth_cache,listen_for_changes,1,[{file,"src/chttpd_auth_cache.erl"},{line,142}]}]}

I've already pruned all docker volumes, restarted the computer and allowed docker to use more resources, but the error is still the same.
Have any of you experienced this problem before and can you give me a hint on how to fix it?
Thanks in advance!
Best regards,
Tim


Re: Testing Current Release

Posted by udeho <ud...@student.kit.edu>.
Hi Dominik,

I followed your instructions and the docker-compose ran smoothly, so this fixed the issue.
Thank you very much!

Best regards,
Tim
On Sep. 24 2020, at 10:40 am, Dominik Riemer <ri...@apache.org> wrote:
> Hi Tim,
>
> I just tested it under Windows and it seems that this CouchDB error is not the root cause of your issue. The CouchDB databases should be created during the installation process and the message you see will disappear after that.
> It seems the problem comes from a file encoding issue under Window in the docker-entrypoint.sh file in the ui folder, which causes the UI container to crash - nothing is visible in the browser.
> Can you please try the following:
> - Open the docker-entrypoint.sh file in the ui folder with an editor of your choice (e.g., Notepad++ or IntelliJ)
> - Change the file encoding from "CRLF" to "LF" (in Notepad and Intellij, it's a small button in the bottom right corner)
> - Run docker-compose build --no-cache
> - Run docker-compose up -d
>
> Can you please tell me if this works?
> Dominik
>
>
> On 2020/09/24 07:55:44, udeho <ud...@student.kit.edu> wrote:
> > Hi Philipp,
> >
> > thank you for your help.
> > I just tried it again and I still ran into the same problem.
> > The error "database_does_not_exist" from couch_db_1 still appears.
> > However, the Docker volume seems to be created properly now:
> >
> > DRIVER VOLUME NAME
> > local incubator-streampipes_backend
> > local incubator-streampipes_consul
> > local incubator-streampipes_couchdb
> > local incubator-streampipes_files
> > local incubator-streampipes_influxdb
> > local incubator-streampipes_kafka
> > local incubator-streampipes_zookeeper
> >
> > Best regards,
> > Tim
> >
> > On Sep. 23 2020, at 10:47 pm, Philipp Zehnder <ze...@apache.org> wrote:
> > > Hi Tim,
> > >
> > > I just changed the docker-compose files for our release testing and added the docker volumes.
> > > If you have time, it would be great if you could test it again on your own computer to see if the problem still exists.
> > > Philipp
> > > > On 18. Sep 2020, at 18:35, Dominik Riemer <ri...@apache.org> wrote:
> > > >
> > > > Hi Tim,
> > > >
> > > > welcome to the list!
> > > >
> > > > Thanks for the hint that this problem only affects the docker-compose files for testing - as far as I can see, the main difference is that the development files do not declare a named volume for CouchDB - I'll have a deeper look to clarify if this breaks the installation on Windows.
> > > >
> > > > Dominik
> > > >
> > > > -----Original Message-----
> > > > From: udeho <ud...@student.kit.edu>
> > > > Sent: Friday, September 18, 2020 5:44 PM
> > > > To: dev@streampipes.apache.org
> > > > Subject: Re: Testing Current Release
> > > >
> > > > I just tried the cli installer and it works fine.
> > > > The problem only occurs with the test environment.
> > > >
> > > > Best regards,
> > > > Tim
> > > >
> > > > On Sep. 18 2020, at 5:12 pm, udeho <ud...@student.kit.edu> wrote:
> > > >> Hi all,
> > > >>
> > > >> my name is Tim and I am a master student at KIT.
> > > >> I have tried to test the current release of version 0.67.0 on a Windows machine.
> > > >> Running the Maven Build for streampipes and streampipes-extensions worked fine.
> > > >> But when I do the docker-compose for streampipes I always get the following error:
> > > >>
> > > >> couchdb_1 | [error] 2020-09-18T14:59:29.766699Z nonode@nohost emulator -------- Error in process <0.3402.0> with exit value:
> > > >> couchdb_1 | {database_does_not_exist,[{mem3_shards,load_shards_from_db,"_users",[{file,"src/mem3_shards.erl"},{line,395}]},{mem3_shards,load_shards_from_disk,1,[{file,"src/mem3_shards.erl"},{line,370}]},{mem3_shards,load_shards_from_disk,2,[{file,"src/mem3_shards.erl"},{line,399}]},{mem3_shards,for_docid,3,[{file,"src/mem3_shards.erl"},{line,86}]},{fabric_doc_open,go,3,[{file,"src/fabric_doc_open.erl"},{line,39}]},{chttpd_auth_cache,ensure_auth_ddoc_exists,2,[{file,"src/chttpd_auth_cache.erl"},{line,195}]},{chttpd_auth_cache,listen_for_changes,1,[{file,"src/chttpd_auth_cache.erl"},{line,142}]}]}
> > > >>
> > > >> I've already pruned all docker volumes, restarted the computer and allowed docker to use more resources, but the error is still the same.
> > > >> Have any of you experienced this problem before and can you give me a hint on how to fix it?
> > > >> Thanks in advance!
> > > >> Best regards,
> > > >> Tim
> > > >>
> > > >
> > > >
> > >
> >
> >
>


Re: Testing Current Release

Posted by Dominik Riemer <ri...@apache.org>.
Hi Tim,

I just tested it under Windows and it seems that this CouchDB error is not the root cause of your issue. The CouchDB databases should be created during the installation process and the message you see will disappear after that.

It seems the problem comes from a file encoding issue under Window in the docker-entrypoint.sh file in the ui folder, which causes the UI container to crash - nothing is visible in the browser.

Can you please try the following:
- Open the docker-entrypoint.sh file in the ui folder with an editor of your choice (e.g., Notepad++ or IntelliJ)
- Change the file encoding from "CRLF" to "LF" (in Notepad and Intellij, it's a small button in the bottom right corner)
- Run docker-compose build --no-cache
- Run docker-compose up -d

Can you please tell me if this works?
Dominik


On 2020/09/24 07:55:44, udeho <ud...@student.kit.edu> wrote: 
> Hi Philipp,
> 
> thank you for your help.
> I just tried it again and I still ran into the same problem.
> The error "database_does_not_exist" from couch_db_1 still appears.
> However, the Docker volume seems to be created properly now:
> 
> DRIVER VOLUME NAME
> local incubator-streampipes_backend
> local incubator-streampipes_consul
> local incubator-streampipes_couchdb
> local incubator-streampipes_files
> local incubator-streampipes_influxdb
> local incubator-streampipes_kafka
> local incubator-streampipes_zookeeper
> 
> Best regards,
> Tim
> 
> On Sep. 23 2020, at 10:47 pm, Philipp Zehnder <ze...@apache.org> wrote:
> > Hi Tim,
> >
> > I just changed the docker-compose files for our release testing and added the docker volumes.
> > If you have time, it would be great if you could test it again on your own computer to see if the problem still exists.
> > Philipp
> > > On 18. Sep 2020, at 18:35, Dominik Riemer <ri...@apache.org> wrote:
> > >
> > > Hi Tim,
> > >
> > > welcome to the list!
> > >
> > > Thanks for the hint that this problem only affects the docker-compose files for testing - as far as I can see, the main difference is that the development files do not declare a named volume for CouchDB - I'll have a deeper look to clarify if this breaks the installation on Windows.
> > >
> > > Dominik
> > >
> > > -----Original Message-----
> > > From: udeho <ud...@student.kit.edu>
> > > Sent: Friday, September 18, 2020 5:44 PM
> > > To: dev@streampipes.apache.org
> > > Subject: Re: Testing Current Release
> > >
> > > I just tried the cli installer and it works fine.
> > > The problem only occurs with the test environment.
> > >
> > > Best regards,
> > > Tim
> > >
> > > On Sep. 18 2020, at 5:12 pm, udeho <ud...@student.kit.edu> wrote:
> > >> Hi all,
> > >>
> > >> my name is Tim and I am a master student at KIT.
> > >> I have tried to test the current release of version 0.67.0 on a Windows machine.
> > >> Running the Maven Build for streampipes and streampipes-extensions worked fine.
> > >> But when I do the docker-compose for streampipes I always get the following error:
> > >>
> > >> couchdb_1 | [error] 2020-09-18T14:59:29.766699Z nonode@nohost emulator -------- Error in process <0.3402.0> with exit value:
> > >> couchdb_1 | {database_does_not_exist,[{mem3_shards,load_shards_from_db,"_users",[{file,"src/mem3_shards.erl"},{line,395}]},{mem3_shards,load_shards_from_disk,1,[{file,"src/mem3_shards.erl"},{line,370}]},{mem3_shards,load_shards_from_disk,2,[{file,"src/mem3_shards.erl"},{line,399}]},{mem3_shards,for_docid,3,[{file,"src/mem3_shards.erl"},{line,86}]},{fabric_doc_open,go,3,[{file,"src/fabric_doc_open.erl"},{line,39}]},{chttpd_auth_cache,ensure_auth_ddoc_exists,2,[{file,"src/chttpd_auth_cache.erl"},{line,195}]},{chttpd_auth_cache,listen_for_changes,1,[{file,"src/chttpd_auth_cache.erl"},{line,142}]}]}
> > >>
> > >> I've already pruned all docker volumes, restarted the computer and allowed docker to use more resources, but the error is still the same.
> > >> Have any of you experienced this problem before and can you give me a hint on how to fix it?
> > >> Thanks in advance!
> > >> Best regards,
> > >> Tim
> > >>
> > >
> > >
> >
> 
> 

Re: Testing Current Release

Posted by udeho <ud...@student.kit.edu>.
Hi Philipp,

thank you for your help.
I just tried it again and I still ran into the same problem.
The error "database_does_not_exist" from couch_db_1 still appears.
However, the Docker volume seems to be created properly now:

DRIVER VOLUME NAME
local incubator-streampipes_backend
local incubator-streampipes_consul
local incubator-streampipes_couchdb
local incubator-streampipes_files
local incubator-streampipes_influxdb
local incubator-streampipes_kafka
local incubator-streampipes_zookeeper

Best regards,
Tim

On Sep. 23 2020, at 10:47 pm, Philipp Zehnder <ze...@apache.org> wrote:
> Hi Tim,
>
> I just changed the docker-compose files for our release testing and added the docker volumes.
> If you have time, it would be great if you could test it again on your own computer to see if the problem still exists.
> Philipp
> > On 18. Sep 2020, at 18:35, Dominik Riemer <ri...@apache.org> wrote:
> >
> > Hi Tim,
> >
> > welcome to the list!
> >
> > Thanks for the hint that this problem only affects the docker-compose files for testing - as far as I can see, the main difference is that the development files do not declare a named volume for CouchDB - I'll have a deeper look to clarify if this breaks the installation on Windows.
> >
> > Dominik
> >
> > -----Original Message-----
> > From: udeho <ud...@student.kit.edu>
> > Sent: Friday, September 18, 2020 5:44 PM
> > To: dev@streampipes.apache.org
> > Subject: Re: Testing Current Release
> >
> > I just tried the cli installer and it works fine.
> > The problem only occurs with the test environment.
> >
> > Best regards,
> > Tim
> >
> > On Sep. 18 2020, at 5:12 pm, udeho <ud...@student.kit.edu> wrote:
> >> Hi all,
> >>
> >> my name is Tim and I am a master student at KIT.
> >> I have tried to test the current release of version 0.67.0 on a Windows machine.
> >> Running the Maven Build for streampipes and streampipes-extensions worked fine.
> >> But when I do the docker-compose for streampipes I always get the following error:
> >>
> >> couchdb_1 | [error] 2020-09-18T14:59:29.766699Z nonode@nohost emulator -------- Error in process <0.3402.0> with exit value:
> >> couchdb_1 | {database_does_not_exist,[{mem3_shards,load_shards_from_db,"_users",[{file,"src/mem3_shards.erl"},{line,395}]},{mem3_shards,load_shards_from_disk,1,[{file,"src/mem3_shards.erl"},{line,370}]},{mem3_shards,load_shards_from_disk,2,[{file,"src/mem3_shards.erl"},{line,399}]},{mem3_shards,for_docid,3,[{file,"src/mem3_shards.erl"},{line,86}]},{fabric_doc_open,go,3,[{file,"src/fabric_doc_open.erl"},{line,39}]},{chttpd_auth_cache,ensure_auth_ddoc_exists,2,[{file,"src/chttpd_auth_cache.erl"},{line,195}]},{chttpd_auth_cache,listen_for_changes,1,[{file,"src/chttpd_auth_cache.erl"},{line,142}]}]}
> >>
> >> I've already pruned all docker volumes, restarted the computer and allowed docker to use more resources, but the error is still the same.
> >> Have any of you experienced this problem before and can you give me a hint on how to fix it?
> >> Thanks in advance!
> >> Best regards,
> >> Tim
> >>
> >
> >
>


Re: Testing Current Release

Posted by Philipp Zehnder <ze...@apache.org>.
Hi Tim,

I just changed the docker-compose files for our release testing and added the docker volumes.

If you have time, it would be great if you could test it again on your own computer to see if the problem still exists.

Philipp

> On 18. Sep 2020, at 18:35, Dominik Riemer <ri...@apache.org> wrote:
> 
> Hi Tim,
> 
> welcome to the list!
> 
> Thanks for the hint that this problem only affects the docker-compose files for testing - as far as I can see, the main difference is that the development files do not declare a named volume for CouchDB - I'll have a deeper look to clarify if this breaks the installation on Windows.
> 
> Dominik
> 
> -----Original Message-----
> From: udeho <ud...@student.kit.edu> 
> Sent: Friday, September 18, 2020 5:44 PM
> To: dev@streampipes.apache.org
> Subject: Re: Testing Current Release
> 
> I just tried the cli installer and it works fine.
> The problem only occurs with the test environment.
> 
> Best regards,
> Tim
> 
> On Sep. 18 2020, at 5:12 pm, udeho <ud...@student.kit.edu> wrote:
>> Hi all,
>> 
>> my name is Tim and I am a master student at KIT.
>> I have tried to test the current release of version 0.67.0 on a Windows machine.
>> Running the Maven Build for streampipes and streampipes-extensions worked fine.
>> But when I do the docker-compose for streampipes I always get the following error:
>> 
>> couchdb_1 | [error] 2020-09-18T14:59:29.766699Z nonode@nohost emulator -------- Error in process <0.3402.0> with exit value:
>> couchdb_1 | {database_does_not_exist,[{mem3_shards,load_shards_from_db,"_users",[{file,"src/mem3_shards.erl"},{line,395}]},{mem3_shards,load_shards_from_disk,1,[{file,"src/mem3_shards.erl"},{line,370}]},{mem3_shards,load_shards_from_disk,2,[{file,"src/mem3_shards.erl"},{line,399}]},{mem3_shards,for_docid,3,[{file,"src/mem3_shards.erl"},{line,86}]},{fabric_doc_open,go,3,[{file,"src/fabric_doc_open.erl"},{line,39}]},{chttpd_auth_cache,ensure_auth_ddoc_exists,2,[{file,"src/chttpd_auth_cache.erl"},{line,195}]},{chttpd_auth_cache,listen_for_changes,1,[{file,"src/chttpd_auth_cache.erl"},{line,142}]}]}
>> 
>> I've already pruned all docker volumes, restarted the computer and allowed docker to use more resources, but the error is still the same.
>> Have any of you experienced this problem before and can you give me a hint on how to fix it?
>> Thanks in advance!
>> Best regards,
>> Tim
>> 
> 
> 


RE: Testing Current Release

Posted by Dominik Riemer <ri...@apache.org>.
Hi Tim,

welcome to the list!

Thanks for the hint that this problem only affects the docker-compose files for testing - as far as I can see, the main difference is that the development files do not declare a named volume for CouchDB - I'll have a deeper look to clarify if this breaks the installation on Windows.

Dominik

-----Original Message-----
From: udeho <ud...@student.kit.edu> 
Sent: Friday, September 18, 2020 5:44 PM
To: dev@streampipes.apache.org
Subject: Re: Testing Current Release

I just tried the cli installer and it works fine.
The problem only occurs with the test environment.

Best regards,
Tim

On Sep. 18 2020, at 5:12 pm, udeho <ud...@student.kit.edu> wrote:
> Hi all,
>
> my name is Tim and I am a master student at KIT.
> I have tried to test the current release of version 0.67.0 on a Windows machine.
> Running the Maven Build for streampipes and streampipes-extensions worked fine.
> But when I do the docker-compose for streampipes I always get the following error:
>
> couchdb_1 | [error] 2020-09-18T14:59:29.766699Z nonode@nohost emulator -------- Error in process <0.3402.0> with exit value:
> couchdb_1 | {database_does_not_exist,[{mem3_shards,load_shards_from_db,"_users",[{file,"src/mem3_shards.erl"},{line,395}]},{mem3_shards,load_shards_from_disk,1,[{file,"src/mem3_shards.erl"},{line,370}]},{mem3_shards,load_shards_from_disk,2,[{file,"src/mem3_shards.erl"},{line,399}]},{mem3_shards,for_docid,3,[{file,"src/mem3_shards.erl"},{line,86}]},{fabric_doc_open,go,3,[{file,"src/fabric_doc_open.erl"},{line,39}]},{chttpd_auth_cache,ensure_auth_ddoc_exists,2,[{file,"src/chttpd_auth_cache.erl"},{line,195}]},{chttpd_auth_cache,listen_for_changes,1,[{file,"src/chttpd_auth_cache.erl"},{line,142}]}]}
>
> I've already pruned all docker volumes, restarted the computer and allowed docker to use more resources, but the error is still the same.
> Have any of you experienced this problem before and can you give me a hint on how to fix it?
> Thanks in advance!
> Best regards,
> Tim
>



Re: Testing Current Release

Posted by udeho <ud...@student.kit.edu>.
I just tried the cli installer and it works fine.
The problem only occurs with the test environment.

Best regards,
Tim

On Sep. 18 2020, at 5:12 pm, udeho <ud...@student.kit.edu> wrote:
> Hi all,
>
> my name is Tim and I am a master student at KIT.
> I have tried to test the current release of version 0.67.0 on a Windows machine.
> Running the Maven Build for streampipes and streampipes-extensions worked fine.
> But when I do the docker-compose for streampipes I always get the following error:
>
> couchdb_1 | [error] 2020-09-18T14:59:29.766699Z nonode@nohost emulator -------- Error in process <0.3402.0> with exit value:
> couchdb_1 | {database_does_not_exist,[{mem3_shards,load_shards_from_db,"_users",[{file,"src/mem3_shards.erl"},{line,395}]},{mem3_shards,load_shards_from_disk,1,[{file,"src/mem3_shards.erl"},{line,370}]},{mem3_shards,load_shards_from_disk,2,[{file,"src/mem3_shards.erl"},{line,399}]},{mem3_shards,for_docid,3,[{file,"src/mem3_shards.erl"},{line,86}]},{fabric_doc_open,go,3,[{file,"src/fabric_doc_open.erl"},{line,39}]},{chttpd_auth_cache,ensure_auth_ddoc_exists,2,[{file,"src/chttpd_auth_cache.erl"},{line,195}]},{chttpd_auth_cache,listen_for_changes,1,[{file,"src/chttpd_auth_cache.erl"},{line,142}]}]}
>
> I've already pruned all docker volumes, restarted the computer and allowed docker to use more resources, but the error is still the same.
> Have any of you experienced this problem before and can you give me a hint on how to fix it?
> Thanks in advance!
> Best regards,
> Tim
>