You are viewing a plain text version of this content. The canonical link for it is here.
Posted to corpora-dev@tika.apache.org by Tim Allison <ta...@apache.org> on 2020/06/23 18:00:32 UTC
datasette is live
All,
I created one big sqlite db with tika-eval profile tables and mimes from
tika and file and loaded them into datasette run via Docker.
http://corpora.tika.apache.org:8001/
How should I document example sql...on our wiki? What queries do we
want? What do people want to know?
The creation of this db was hackish...to say the best...will try to work
out better process going forward.
Cheers,
Tim
Re: datasette is live
Posted by Tim Allison <ta...@apache.org>.
https://github.com/simonw/datasette/issues/865
On Wed, Jun 24, 2020 at 8:32 AM Tim Allison <ta...@apache.org> wrote:
> Y, that's what I'm doing.
>
> ProxyPreserveHost On
> ProxyPass /datasette http://x.y.z.q:xxxx
> ProxyPassReverse /datasette http://x.y.z.q:xxxx
>
> I start datasette with this: --config base_url:/datasette/
>
> I _think_ this is a bug in datasette because full sql queries work:
>
>
> https://corpora.tika.apache.org/datasette/corpora-metadata?sql=select+mime_string%2C+count%281%29+as+cnt%0D%0Afrom+profiles+p%0D%0Ajoin+mimes+m+on+p.mime_id%3Dm.mime_id%0D%0Agroup+by+mime_string%0D%0Aorder+by+cnt+desc
>
> What doesn't work is what Maruan pointed out: adding a criterion and then
> pressing "apply".
>
> Given that full sql queries seem to work, let's leave this up as is to
> show the datasette team what's going wrong?
>
> On Wed, Jun 24, 2020 at 7:40 AM Nick Burch <ap...@gagravarr.org> wrote:
>
>> On Wed, 24 Jun 2020, Tim Allison wrote:
>> > Thank you, Maruan!
>> >
>> > I’ll open a ticket w datasette.
>>
>> Would a ProxyPassReverse work for this?
>>
>> Nick
>
>
Re: datasette is live
Posted by Tim Allison <ta...@apache.org>.
Y, that's what I'm doing.
ProxyPreserveHost On
ProxyPass /datasette http://x.y.z.q:xxxx
ProxyPassReverse /datasette http://x.y.z.q:xxxx
I start datasette with this: --config base_url:/datasette/
I _think_ this is a bug in datasette because full sql queries work:
https://corpora.tika.apache.org/datasette/corpora-metadata?sql=select+mime_string%2C+count%281%29+as+cnt%0D%0Afrom+profiles+p%0D%0Ajoin+mimes+m+on+p.mime_id%3Dm.mime_id%0D%0Agroup+by+mime_string%0D%0Aorder+by+cnt+desc
What doesn't work is what Maruan pointed out: adding a criterion and then
pressing "apply".
Given that full sql queries seem to work, let's leave this up as is to show
the datasette team what's going wrong?
On Wed, Jun 24, 2020 at 7:40 AM Nick Burch <ap...@gagravarr.org> wrote:
> On Wed, 24 Jun 2020, Tim Allison wrote:
> > Thank you, Maruan!
> >
> > I’ll open a ticket w datasette.
>
> Would a ProxyPassReverse work for this?
>
> Nick
Re: datasette is live
Posted by Nick Burch <ap...@gagravarr.org>.
On Wed, 24 Jun 2020, Tim Allison wrote:
> Thank you, Maruan!
>
> I’ll open a ticket w datasette.
Would a ProxyPassReverse work for this?
Nick
Re: datasette is live
Posted by Tim Allison <ta...@apache.org>.
Thank you, Maruan!
I’ll open a ticket w datasette.
Is it ok if we rollback to opening a port for datasette so that it works
until we can get a fix?
On Wed, Jun 24, 2020 at 4:57 AM Maruan Sahyoun <sa...@fileaffairs.de>
wrote:
>
>
>
> > Done. Thank you!
> >
> > https://corpora.tika.apache.org/datasette
>
> thx - there is an issue if you add a query criteria and click apply as
> the url is not prepended with datasette so the request
> fails.
>
> e.g.
> https://corpora.tika.apache.org/corpora-metadata/tika_1_24_1_mimes?_sort=file&mime__exact=text%2Fpdf
>
> This should become
>
>
> https://corpora.tika.apache.org/datasette/corpora-metadata/tika_1_24_1_mimes?_sort=file&mime__exact=text%2Fplain
>
> BR
> Maruan
>
>
> >
> > On Tue, Jun 23, 2020 at 4:09 PM Maruan Sahyoun <sa...@fileaffairs.de>
> > wrote:
> >
> > > Could we propably proxy everything using apache and not expose
> additional
> > > ports? In addition use HTTPS throughout?
> > >
> > > BR
> > > Maruan
> > >
> > > > All,
> > > >
> > > > I created one big sqlite db with tika-eval profile tables and mimes
> > > from
> > > > tika and file and loaded them into datasette run via Docker.
> > > >
> > > > http://corpora.tika.apache.org:8001/
> > > >
> > > > How should I document example sql...on our wiki? What queries do
> we
> > > > want? What do people want to know?
> > > >
> > > > The creation of this db was hackish...to say the best...will try to
> > > work
> > > > out better process going forward.
> > > >
> > > > Cheers,
> > > >
> > > > Tim
> > >
> > >
> --
>
>
>
Re: datasette is live
Posted by Maruan Sahyoun <sa...@fileaffairs.de>.
> Done. Thank you!
>
> https://corpora.tika.apache.org/datasette
thx - there is an issue if you add a query criteria and click apply as the url is not prepended with datasette so the request
fails.
e.g. https://corpora.tika.apache.org/corpora-metadata/tika_1_24_1_mimes?_sort=file&mime__exact=text%2Fpdf
This should become
https://corpora.tika.apache.org/datasette/corpora-metadata/tika_1_24_1_mimes?_sort=file&mime__exact=text%2Fplain
BR
Maruan
>
> On Tue, Jun 23, 2020 at 4:09 PM Maruan Sahyoun <sa...@fileaffairs.de>
> wrote:
>
> > Could we propably proxy everything using apache and not expose additional
> > ports? In addition use HTTPS throughout?
> >
> > BR
> > Maruan
> >
> > > All,
> > >
> > > I created one big sqlite db with tika-eval profile tables and mimes
> > from
> > > tika and file and loaded them into datasette run via Docker.
> > >
> > > http://corpora.tika.apache.org:8001/
> > >
> > > How should I document example sql...on our wiki? What queries do we
> > > want? What do people want to know?
> > >
> > > The creation of this db was hackish...to say the best...will try to
> > work
> > > out better process going forward.
> > >
> > > Cheers,
> > >
> > > Tim
> >
> >
--
Re: datasette is live
Posted by Tim Allison <ta...@apache.org>.
Done. Thank you!
https://corpora.tika.apache.org/datasette
On Tue, Jun 23, 2020 at 4:09 PM Maruan Sahyoun <sa...@fileaffairs.de>
wrote:
>
> Could we propably proxy everything using apache and not expose additional
> ports? In addition use HTTPS throughout?
>
> BR
> Maruan
>
> > All,
> >
> > I created one big sqlite db with tika-eval profile tables and mimes
> from
> > tika and file and loaded them into datasette run via Docker.
> >
> > http://corpora.tika.apache.org:8001/
> >
> > How should I document example sql...on our wiki? What queries do we
> > want? What do people want to know?
> >
> > The creation of this db was hackish...to say the best...will try to
> work
> > out better process going forward.
> >
> > Cheers,
> >
> > Tim
>
>
>
Re: datasette is live
Posted by Maruan Sahyoun <sa...@fileaffairs.de>.
Could we propably proxy everything using apache and not expose additional ports? In addition use HTTPS throughout?
BR
Maruan
> All,
>
> I created one big sqlite db with tika-eval profile tables and mimes from
> tika and file and loaded them into datasette run via Docker.
>
> http://corpora.tika.apache.org:8001/
>
> How should I document example sql...on our wiki? What queries do we
> want? What do people want to know?
>
> The creation of this db was hackish...to say the best...will try to work
> out better process going forward.
>
> Cheers,
>
> Tim