You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@asterixdb.apache.org by Eugenia Gabrielova <ge...@gmail.com> on 2015/06/01 00:44:03 UTC
Re: Demo not working?
Hi Brandon,
*AsterixDB Lat/Lng: *I am pretty sure the points in AsterixDB are created
with Latitude, Longitude. Same with Google Maps API. In the Spatial docs (
http://asterix.ics.uci.edu/documentation/aql/functions.html#SpatialFunctions)
example under "point", the following example is shown, and only longitude
can scale up to magnitude 180: *use dataverse TinySocial; let $c :=
point("55.05,-138.04") return {"point": $c}. *I remember running into this
exact same thing though - perhaps it would be good to specify
latitude/longitude arguments in the docs, not just x,y.
*On recentering: * I have just pushed a change that adds home_latitude and
home_longitude as their own variables - good idea! - and resets them in the
resetMap() function. The function resetMap() has the code (~ line #1118)
that moves the map back to center. I don't think there is recentering
anywhere else in the demo.
*Los Angeles Spatial issue: *Could you give me a bit more information on
your data source?
* Are you using data from the Twitter live API, the original Tweetbook demo
dataset, or something else?
* Does your query on Los Angeles return results with the Query UI (
127.0.0.1:19001, on your local machine)?
Cheers,
Eugenia
On Sun, May 31, 2015 at 2:26 PM, Brandon Lim <br...@uci.edu> wrote:
> Hi Eugenia,
>
> This might not necessarily be a tweet book demo bug or anything, but just
> a confusion. So for the Tweets API, the coordinates are formatted as
> geoJSON (longitude first, latitude second). So for AsterixDB (the
> documentation doesn’t really say), is longitude or latitude x? (I think
> Young-Seok told me before but I can’t find the email). Also, it seems that
> Google Maps API uses latitude first, longitude second.
>
> Does the demo account for these inconsistencies? I was able to input my
> data successfully, and if I changed the coordinates in the tweetbook.js to
>
> map = new GMaps({
> div: '#map',
> lat: 34.05,//38.89,
> lng: -118.25,//-77.03,
> zoom: 4,
> draggable: false,
> });
>
> it would center it in Los Angeles like I wanted, but I wasn’t able to find
> any tweets in the area and I think it has to do with the spatial intersect.
> Also, is it better to put a global variable for latitude and longitude in
> the tweetbook.js for if we wanted to change the starting location? Because
> changing it in the code above works initially, but when you click “Clear”,
> it resets it to the original, so it must be hardcoded elsewhere.
>
> Best Regards,
> Brandon Lim
>
>
>
> On May 29, 2015, at 5:31 PM, Eugenia Gabrielova <
> genia.likes.science@gmail.com> wrote:
>
> > Hi Brandon,
> >
> > Just had a chance to add the fix to the branch with a couple commits.
> Let me know if it causes you any further issues. Thanks for making me aware
> of the issue - your feedback is really helpful for some changes to make
> this demo more usable.
> >
> > Regards,
> > Eugenia
> >
> > On Fri, May 29, 2015 at 11:07 AM, Eugenia Gabrielova <
> genia.likes.science@gmail.com> wrote:
> > Sounds like a "feature" (bug) - let me have a look and hotfix that...
> >
> > On Fri, May 29, 2015 at 10:33 AM, Brandon Lim <br...@uci.edu> wrote:
> > Hey Eugenia,
> >
> > I was able to get it to run with my new query and the dataset is inside
> AsterixDB. I was curious to how I can change the spatial intersect of the
> query. Even if I put a location in the location box for the query, once I
> submit the query, it just brings me back to the default spatial area on the
> East Coast.
> >
> > Best Regards,
> > Brandon Lim
> >
> >
> >
> > On May 28, 2015, at 6:54 PM, Eugenia Gabrielova <
> genia.likes.science@gmail.com> wrote:
> >
> > > It's all good, let me know if you have any issues or questions about
> the code (or bugs :P so I can fix them)
> > >
> > > On Thu, May 28, 2015 at 6:52 PM, Brandon Lim <br...@uci.edu> wrote:
> > > That worked. I must’ve misspelled it twice because I tried the other
> day as well. Thanks Eugenia.
> > >
> > > Also, Thanks Ian!
> > >
> > >
> > > Best Regards,
> > > Brandon Lim
> > >
> > >
> > >
> > > On May 28, 2015, at 6:44 PM, Eugenia Gabrielova <
> genia.likes.science@gmail.com> wrote:
> > >
> > > > Hi Brandon,
> > > >
> > > > Looks like you have the pathspec spelled incorrectly ("eugneia")
> > > >
> > > > Try
> > > > $ git checkout eugenia/tweetbook-demo-fixes
> > > >
> > > > On Thu, May 28, 2015 at 6:40 PM, Brandon Lim <br...@uci.edu>
> wrote:
> > > > Hey Eugenia,
> > > >
> > > > I tried that, but it says
> > > >
> > > > git checkout eugneia/tweetbook-demo-fixes
> > > > error: pathspec 'eugneia/tweetbook-demo-fixes' did not match any
> file(s) known to git.
> > > >
> > > > When I did
> > > >
> > > > git branch
> > > >
> > > > Only master showed up.
> > > >
> > > > Best Regards,
> > > > Brandon Lim
> > > >
> > > >
> > > >
> > > > On May 28, 2015, at 6:35 PM, Eugenia Gabrielova <
> genia.likes.science@gmail.com> wrote:
> > > >
> > > > > Hi Brandon!
> > > > >
> > > > > Any luck fetching the upstream branch?
> > > > >
> > > > > $ cd path/to/your/sandbox
> > > > > $ git fetch
> > > > > $ git checkout eugenia/tweetbook-demo-fixes
> > > > >
> > > > > Let me know if that works for you.
> > > > >
> > > > > On Wed, May 27, 2015 at 10:13 AM, Brandon Lim <br...@uci.edu>
> wrote:
> > > > > Hey Ian,
> > > > >
> > > > > When I clicked the download zip or download tar.gz for the branch,
> it said 404 not found. I couldn’t figure out how to checkout her specific
> branch. I was only able to checkout the master branch.
> > > > >
> > > > > Best Regards,
> > > > > Brandon Lim
> > > > >
> > > > >
> > > > >
> > > > > On May 26, 2015, at 10:42 AM, Ian Maxon <im...@uci.edu> wrote:
> > > > >
> > > > > > Hey Brandon,
> > > > > >
> > > > > > What seemed to be the issue with checking out/downloading the
> repository? It should just be a matter of checking out that branch and
> doing 'mvn clean package -DskipTests'.
> > > > > >
> > > > > > - Ian
> > > > > >
> > > > > > On Tue, May 26, 2015 at 10:02 AM, Brandon Lim <br...@uci.edu>
> wrote:
> > > > > > Hey Eugenia,
> > > > > >
> > > > > > I wasn’t able to download your up-to-date branch in the sandbox
> for some reason. Is there another way for me to get access to your most
> up-to-date TweetBook Demo?
> > > > > >
> > > > > > Best Regards,
> > > > > > Brandon Lim
> > > > > >
> > > > > >
> > > > > >
> > > > > > On May 22, 2015, at 12:17 PM, Eugenia Gabrielova <
> genia.likes.science@gmail.com> wrote:
> > > > > >
> > > > > > > Hi Brandon!
> > > > > > >
> > > > > > > As a heads up, I have a branch in sandbox with some up-to-date
> changes and fixes on the TweetbookDemo. I'll keep an eye out on this thread
> if you have any questions, or I can look through code with you on campus if
> you prefer.
> > > > > > >
> https://code.google.com/p/asterixdb-sandbox/source/browse/?name=eugenia%2Ftweetbook-demo-fixes#git%2Fasterix-examples%2Fsrc%2Fmain%2Fresources%2Ftweetbook-demo
> > > > > > >
> > > > > > > The longitude shift was just a debugging thing for me when I
> was playing with spatial queries, to match an older version of the
> geospatial demo (pre-Tweetbooks). It's not an Asterix-related thing and can
> easily be removed.
> > > > > > >
> > > > > > > On Fri, May 22, 2015 at 11:41 AM, Ian Maxon <im...@uci.edu>
> wrote:
> > > > > > > Hi Brandon,
> > > > > > > Interesting. I wasn't quite sure how to solve this initially,
> but there is a function that does the trick. (however it isn't documented
> in master!...)
> > > > > > >
> > > > > > > parse-datetime should be able to do the trick. For your
> example. " parse-datetime("Fri May 11 07:53:00 +0000 2012", "W MMM DD
> hh:mm:ss z YYYY") " will give the proper AQL object from the string. The
> first part is (obviously) the date to be parsed. The second is the
> formatting string, which is not very well documented, but appears to follow
> Java's convention (
> https://docs.oracle.com/javase/7/docs/api/java/text/SimpleDateFormat.html)
> closely.
> > > > > > >
> > > > > > > -Ian
> > > > > > >
> > > > > > > On Fri, May 22, 2015 at 11:01 AM, Brandon Lim <
> brandodl@uci.edu> wrote:
> > > > > > > Hey Ian,
> > > > > > >
> > > > > > > Quick question. So I’m trying to align my dataset or how my
> dataset is handled with the dataset that is currently in use by the
> TweetBook demo, but one thing is that the TweetBook demo allows it to query
> based on datetime.
> > > > > > >
> > > > > > > <Screen Shot 2015-05-22 at 10.58.10 AM.png>
> > > > > > > This is what the data for the TweetBook demo looks like.
> Everything is already preprocessed.
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > This is what my data looks like. Is there an easy way to
> convert this into datetime?
> > > > > > >
> > > > > > >
> > > > > > > <Screen Shot 2015-05-22 at 11.01.12 AM.png>
> > > > > > > Also, do you know why in the TweetBook demo that the longitude
> sign bit is flipped?
> > > > > > >
> > > > > > > Best Regards,
> > > > > > > Brandon Lim
> > > > > > >
> > > > > > >
> > > > > >
> > > > > > --
> > > > > > You received this message because you are subscribed to the
> Google Groups "asterixdb-users" group.
> > > > > > To unsubscribe from this group and stop receiving emails from
> it, send an email to asterixdb-users+unsubscribe@googlegroups.com.
> > > > > > For more options, visit https://groups.google.com/d/optout.
> > > > > >
> > > > > >
> > > > > > --
> > > > > > You received this message because you are subscribed to the
> Google Groups "asterixdb-users" group.
> > > > > > To unsubscribe from this group and stop receiving emails from
> it, send an email to asterixdb-users+unsubscribe@googlegroups.com.
> > > > > > For more options, visit https://groups.google.com/d/optout.
> > > > >
> > > > >
> > > >
> > > >
> > > >
> > > > --
> > > > You received this message because you are subscribed to the Google
> Groups "asterixdb-users" group.
> > > > To unsubscribe from this group and stop receiving emails from it,
> send an email to asterixdb-users+unsubscribe@googlegroups.com.
> > > > For more options, visit https://groups.google.com/d/optout.
> > >
> > >
> > >
> > > --
> > > You received this message because you are subscribed to the Google
> Groups "asterixdb-users" group.
> > > To unsubscribe from this group and stop receiving emails from it, send
> an email to asterixdb-users+unsubscribe@googlegroups.com.
> > > For more options, visit https://groups.google.com/d/optout.
> >
> >
> >
> >
> > --
> > You received this message because you are subscribed to the Google
> Groups "asterixdb-users" group.
> > To unsubscribe from this group and stop receiving emails from it, send
> an email to asterixdb-users+unsubscribe@googlegroups.com.
> > For more options, visit https://groups.google.com/d/optout.
>
>
Re: Demo not working?
Posted by Eugenia Gabrielova <ge...@gmail.com>.
Thanks, that's very informative - I'll add test cases for both...
On Mon, Jun 8, 2015 at 12:11 PM, Brandon Lim <br...@uci.edu> wrote:
> Hey Eugenia,
>
> Actually, 0.6 - 0.9 works. 0.5 and below doesn’t. I’m guessing somewhere
> it is being rounded down to 0, so nothing shows? And if it’s 0.6 - 0.9,
> it’s being rounded up to 1?
>
> Best Regards,
> Brandon Lim
>
>
>
> On Jun 8, 2015, at 12:06 PM, Brandon Lim <br...@uci.edu> wrote:
>
> > Hey Eugenia,
> >
> > I changed the minimum slider option to 0.1 for the group size, but if I
> actually do a group size less than latitude and longitude 1, say 0.5, it’ll
> show the cells and how many tweets, but if I click on the bubbles, it
> doesn’t populate the screen with the tweets. For some reason it works for
> latitude and longitude of 1 and above, but not between 0.1 and 1.
> >
> > I was wondering if you would know why is that.
> >
> > Best Regards,
> > Brandon Lim
> >
> >
> >
> > On Jun 7, 2015, at 4:09 PM, Eugenia Gabrielova <
> genia.likes.science@gmail.com> wrote:
> >
> >> Thank you for the feedback about the grid size, and awesome to hear you
> got your demo working!
> >>
> >> On Sun, Jun 7, 2015 at 3:08 PM, Brandon Lim <br...@uci.edu> wrote:
> >> Hi Eugenia,
> >>
> >> So for an update regarding the demo, I was able to get the dataset in
> and run it with the Tweetbook Demo successfully. The only thing worth
> noting regarding the larger sample size is that the parameters for the
> group size might need to be significantly smaller (instead of the smallest
> group size being 1 latitude and 1 longitude) because a larger sample size
> means it could have thousands of tweets in one area, which would be too
> much to populate on the screen at once. But overall, the demo works great.
> Thanks!
> >>
> >>
> >> Best Regards,
> >> Brandon Lim
> >>
> >>
> >>
> >> On May 31, 2015, at 5:10 PM, Brandon Lim <br...@uci.edu> wrote:
> >>
> >>> Hi Eugenia,
> >>>
> >>> My dataset is a 14 GB dataset of archived tweets that was given to me.
> A sample of it can be found here:
> >>>
> >>>
> https://drive.google.com/file/d/0B131hq-YqiMHbkNXd3NUa2xGeGc/view?usp=sharing
> >>>
> >>> I ended up changing my query (because my X coordinates were longitude
> and my Y coordinates were latitude originally) by switching the coordinates
> and the demo works fantastic now. Thanks so much for the help. I will let
> you know if I have further questions, but for now, it seems like it is
> working well.
> >>>
> >>> @Professor Carey & Ian
> >>> We should definitely add lat/long to the documentation.
> >>>
> >>> Best Regards,
> >>> Brandon Lim
> >>>
> >>> On May 31, 2015, at 3:44 PM, Eugenia Gabrielova <
> genia.likes.science@gmail.com> wrote:
> >>>
> >>>> Hi Brandon,
> >>>>
> >>>> AsterixDB Lat/Lng: I am pretty sure the points in AsterixDB are
> created with Latitude, Longitude. Same with Google Maps API. In the Spatial
> docs (
> http://asterix.ics.uci.edu/documentation/aql/functions.html#SpatialFunctions)
> example under "point", the following example is shown, and only longitude
> can scale up to magnitude 180: use dataverse TinySocial; let $c :=
> point("55.05,-138.04") return {"point": $c}. I remember running into this
> exact same thing though - perhaps it would be good to specify
> latitude/longitude arguments in the docs, not just x,y.
> >>>>
> >>>> On recentering: I have just pushed a change that adds home_latitude
> and home_longitude as their own variables - good idea! - and resets them in
> the resetMap() function. The function resetMap() has the code (~ line
> #1118) that moves the map back to center. I don't think there is
> recentering anywhere else in the demo.
> >>>>
> >>>> Los Angeles Spatial issue: Could you give me a bit more information
> on your data source?
> >>>> * Are you using data from the Twitter live API, the original
> Tweetbook demo dataset, or something else?
> >>>> * Does your query on Los Angeles return results with the Query UI (
> 127.0.0.1:19001, on your local machine)?
> >>>>
> >>>> Cheers,
> >>>> Eugenia
> >>>>
> >>>> On Sun, May 31, 2015 at 2:26 PM, Brandon Lim <br...@uci.edu>
> wrote:
> >>>> Hi Eugenia,
> >>>>
> >>>> This might not necessarily be a tweet book demo bug or anything, but
> just a confusion. So for the Tweets API, the coordinates are formatted as
> geoJSON (longitude first, latitude second). So for AsterixDB (the
> documentation doesn’t really say), is longitude or latitude x? (I think
> Young-Seok told me before but I can’t find the email). Also, it seems that
> Google Maps API uses latitude first, longitude second.
> >>>>
> >>>> Does the demo account for these inconsistencies? I was able to input
> my data successfully, and if I changed the coordinates in the tweetbook.js
> to
> >>>>
> >>>> map = new GMaps({
> >>>> div: '#map',
> >>>> lat: 34.05,//38.89,
> >>>> lng: -118.25,//-77.03,
> >>>> zoom: 4,
> >>>> draggable: false,
> >>>> });
> >>>>
> >>>> it would center it in Los Angeles like I wanted, but I wasn’t able to
> find any tweets in the area and I think it has to do with the spatial
> intersect. Also, is it better to put a global variable for latitude and
> longitude in the tweetbook.js for if we wanted to change the starting
> location? Because changing it in the code above works initially, but when
> you click “Clear”, it resets it to the original, so it must be hardcoded
> elsewhere.
> >>>>
> >>>> Best Regards,
> >>>> Brandon Lim
> >>>>
> >>>>
> >>>>
> >>>> On May 29, 2015, at 5:31 PM, Eugenia Gabrielova <
> genia.likes.science@gmail.com> wrote:
> >>>>
> >>>>> Hi Brandon,
> >>>>>
> >>>>> Just had a chance to add the fix to the branch with a couple
> commits. Let me know if it causes you any further issues. Thanks for making
> me aware of the issue - your feedback is really helpful for some changes to
> make this demo more usable.
> >>>>>
> >>>>> Regards,
> >>>>> Eugenia
> >>>>>
> >>>>> On Fri, May 29, 2015 at 11:07 AM, Eugenia Gabrielova <
> genia.likes.science@gmail.com> wrote:
> >>>>> Sounds like a "feature" (bug) - let me have a look and hotfix that...
> >>>>>
> >>>>> On Fri, May 29, 2015 at 10:33 AM, Brandon Lim <br...@uci.edu>
> wrote:
> >>>>> Hey Eugenia,
> >>>>>
> >>>>> I was able to get it to run with my new query and the dataset is
> inside AsterixDB. I was curious to how I can change the spatial intersect
> of the query. Even if I put a location in the location box for the query,
> once I submit the query, it just brings me back to the default spatial area
> on the East Coast.
> >>>>>
> >>>>> Best Regards,
> >>>>> Brandon Lim
> >>>>>
> >>>>>
> >>>>>
> >>>>> On May 28, 2015, at 6:54 PM, Eugenia Gabrielova <
> genia.likes.science@gmail.com> wrote:
> >>>>>
> >>>>>> It's all good, let me know if you have any issues or questions
> about the code (or bugs :P so I can fix them)
> >>>>>>
> >>>>>> On Thu, May 28, 2015 at 6:52 PM, Brandon Lim <br...@uci.edu>
> wrote:
> >>>>>> That worked. I must’ve misspelled it twice because I tried the
> other day as well. Thanks Eugenia.
> >>>>>>
> >>>>>> Also, Thanks Ian!
> >>>>>>
> >>>>>>
> >>>>>> Best Regards,
> >>>>>> Brandon Lim
> >>>>>>
> >>>>>>
> >>>>>>
> >>>>>> On May 28, 2015, at 6:44 PM, Eugenia Gabrielova <
> genia.likes.science@gmail.com> wrote:
> >>>>>>
> >>>>>>> Hi Brandon,
> >>>>>>>
> >>>>>>> Looks like you have the pathspec spelled incorrectly ("eugneia")
> >>>>>>>
> >>>>>>> Try
> >>>>>>> $ git checkout eugenia/tweetbook-demo-fixes
> >>>>>>>
> >>>>>>> On Thu, May 28, 2015 at 6:40 PM, Brandon Lim <br...@uci.edu>
> wrote:
> >>>>>>> Hey Eugenia,
> >>>>>>>
> >>>>>>> I tried that, but it says
> >>>>>>>
> >>>>>>> git checkout eugneia/tweetbook-demo-fixes
> >>>>>>> error: pathspec 'eugneia/tweetbook-demo-fixes' did not match any
> file(s) known to git.
> >>>>>>>
> >>>>>>> When I did
> >>>>>>>
> >>>>>>> git branch
> >>>>>>>
> >>>>>>> Only master showed up.
> >>>>>>>
> >>>>>>> Best Regards,
> >>>>>>> Brandon Lim
> >>>>>>>
> >>>>>>>
> >>>>>>>
> >>>>>>> On May 28, 2015, at 6:35 PM, Eugenia Gabrielova <
> genia.likes.science@gmail.com> wrote:
> >>>>>>>
> >>>>>>>> Hi Brandon!
> >>>>>>>>
> >>>>>>>> Any luck fetching the upstream branch?
> >>>>>>>>
> >>>>>>>> $ cd path/to/your/sandbox
> >>>>>>>> $ git fetch
> >>>>>>>> $ git checkout eugenia/tweetbook-demo-fixes
> >>>>>>>>
> >>>>>>>> Let me know if that works for you.
> >>>>>>>>
> >>>>>>>> On Wed, May 27, 2015 at 10:13 AM, Brandon Lim <br...@uci.edu>
> wrote:
> >>>>>>>> Hey Ian,
> >>>>>>>>
> >>>>>>>> When I clicked the download zip or download tar.gz for the
> branch, it said 404 not found. I couldn’t figure out how to checkout her
> specific branch. I was only able to checkout the master branch.
> >>>>>>>>
> >>>>>>>> Best Regards,
> >>>>>>>> Brandon Lim
> >>>>>>>>
> >>>>>>>>
> >>>>>>>>
> >>>>>>>> On May 26, 2015, at 10:42 AM, Ian Maxon <im...@uci.edu> wrote:
> >>>>>>>>
> >>>>>>>>> Hey Brandon,
> >>>>>>>>>
> >>>>>>>>> What seemed to be the issue with checking out/downloading the
> repository? It should just be a matter of checking out that branch and
> doing 'mvn clean package -DskipTests'.
> >>>>>>>>>
> >>>>>>>>> - Ian
> >>>>>>>>>
> >>>>>>>>> On Tue, May 26, 2015 at 10:02 AM, Brandon Lim <br...@uci.edu>
> wrote:
> >>>>>>>>> Hey Eugenia,
> >>>>>>>>>
> >>>>>>>>> I wasn’t able to download your up-to-date branch in the sandbox
> for some reason. Is there another way for me to get access to your most
> up-to-date TweetBook Demo?
> >>>>>>>>>
> >>>>>>>>> Best Regards,
> >>>>>>>>> Brandon Lim
> >>>>>>>>>
> >>>>>>>>>
> >>>>>>>>>
> >>>>>>>>> On May 22, 2015, at 12:17 PM, Eugenia Gabrielova <
> genia.likes.science@gmail.com> wrote:
> >>>>>>>>>
> >>>>>>>>>> Hi Brandon!
> >>>>>>>>>>
> >>>>>>>>>> As a heads up, I have a branch in sandbox with some up-to-date
> changes and fixes on the TweetbookDemo. I'll keep an eye out on this thread
> if you have any questions, or I can look through code with you on campus if
> you prefer.
> >>>>>>>>>>
> https://code.google.com/p/asterixdb-sandbox/source/browse/?name=eugenia%2Ftweetbook-demo-fixes#git%2Fasterix-examples%2Fsrc%2Fmain%2Fresources%2Ftweetbook-demo
> >>>>>>>>>>
> >>>>>>>>>> The longitude shift was just a debugging thing for me when I
> was playing with spatial queries, to match an older version of the
> geospatial demo (pre-Tweetbooks). It's not an Asterix-related thing and can
> easily be removed.
> >>>>>>>>>>
> >>>>>>>>>> On Fri, May 22, 2015 at 11:41 AM, Ian Maxon <im...@uci.edu>
> wrote:
> >>>>>>>>>> Hi Brandon,
> >>>>>>>>>> Interesting. I wasn't quite sure how to solve this initially,
> but there is a function that does the trick. (however it isn't documented
> in master!...)
> >>>>>>>>>>
> >>>>>>>>>> parse-datetime should be able to do the trick. For your
> example. " parse-datetime("Fri May 11 07:53:00 +0000 2012", "W MMM DD
> hh:mm:ss z YYYY") " will give the proper AQL object from the string. The
> first part is (obviously) the date to be parsed. The second is the
> formatting string, which is not very well documented, but appears to follow
> Java's convention (
> https://docs.oracle.com/javase/7/docs/api/java/text/SimpleDateFormat.html)
> closely.
> >>>>>>>>>>
> >>>>>>>>>> -Ian
> >>>>>>>>>>
> >>>>>>>>>> On Fri, May 22, 2015 at 11:01 AM, Brandon Lim <br...@uci.edu>
> wrote:
> >>>>>>>>>> Hey Ian,
> >>>>>>>>>>
> >>>>>>>>>> Quick question. So I’m trying to align my dataset or how my
> dataset is handled with the dataset that is currently in use by the
> TweetBook demo, but one thing is that the TweetBook demo allows it to query
> based on datetime.
> >>>>>>>>>>
> >>>>>>>>>> <Screen Shot 2015-05-22 at 10.58.10 AM.png>
> >>>>>>>>>> This is what the data for the TweetBook demo looks like.
> Everything is already preprocessed.
> >>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>> This is what my data looks like. Is there an easy way to
> convert this into datetime?
> >>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>> <Screen Shot 2015-05-22 at 11.01.12 AM.png>
> >>>>>>>>>> Also, do you know why in the TweetBook demo that the longitude
> sign bit is flipped?
> >>>>>>>>>>
> >>>>>>>>>> Best Regards,
> >>>>>>>>>> Brandon Lim
> >>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>
> >>>>>>>>> --
> >>>>>>>>> You received this message because you are subscribed to the
> Google Groups "asterixdb-users" group.
> >>>>>>>>> To unsubscribe from this group and stop receiving emails from
> it, send an email to asterixdb-users+unsubscribe@googlegroups.com.
> >>>>>>>>> For more options, visit https://groups.google.com/d/optout.
> >>>>>>>>>
> >>>>>>>>>
> >>>>>>>>> --
> >>>>>>>>> You received this message because you are subscribed to the
> Google Groups "asterixdb-users" group.
> >>>>>>>>> To unsubscribe from this group and stop receiving emails from
> it, send an email to asterixdb-users+unsubscribe@googlegroups.com.
> >>>>>>>>> For more options, visit https://groups.google.com/d/optout.
> >>>>>>>>
> >>>>>>>>
> >>>>>>>
> >>>>>>>
> >>>>>>>
> >>>>>>> --
> >>>>>>> You received this message because you are subscribed to the Google
> Groups "asterixdb-users" group.
> >>>>>>> To unsubscribe from this group and stop receiving emails from it,
> send an email to asterixdb-users+unsubscribe@googlegroups.com.
> >>>>>>> For more options, visit https://groups.google.com/d/optout.
> >>>>>>
> >>>>>>
> >>>>>>
> >>>>>> --
> >>>>>> You received this message because you are subscribed to the Google
> Groups "asterixdb-users" group.
> >>>>>> To unsubscribe from this group and stop receiving emails from it,
> send an email to asterixdb-users+unsubscribe@googlegroups.com.
> >>>>>> For more options, visit https://groups.google.com/d/optout.
> >>>>>
> >>>>>
> >>>>>
> >>>>>
> >>>>> --
> >>>>> You received this message because you are subscribed to the Google
> Groups "asterixdb-users" group.
> >>>>> To unsubscribe from this group and stop receiving emails from it,
> send an email to asterixdb-users+unsubscribe@googlegroups.com.
> >>>>> For more options, visit https://groups.google.com/d/optout.
> >>>>
> >>>>
> >>>
> >>> --
> >>> You received this message because you are subscribed to the Google
> Groups "asterixdb-users" group.
> >>> To unsubscribe from this group and stop receiving emails from it, send
> an email to asterixdb-users+unsubscribe@googlegroups.com.
> >>> For more options, visit https://groups.google.com/d/optout.
> >>>
> >>
> >>
> >>
> >> --
> >> You received this message because you are subscribed to the Google
> Groups "asterixdb-users" group.
> >> To unsubscribe from this group and stop receiving emails from it, send
> an email to asterixdb-users+unsubscribe@googlegroups.com.
> >> For more options, visit https://groups.google.com/d/optout.
> >
> >
>
>
Re: Demo not working?
Posted by Brandon Lim <br...@uci.edu>.
Hey Eugenia,
Actually, 0.6 - 0.9 works. 0.5 and below doesn’t. I’m guessing somewhere it is being rounded down to 0, so nothing shows? And if it’s 0.6 - 0.9, it’s being rounded up to 1?
Best Regards,
Brandon Lim
On Jun 8, 2015, at 12:06 PM, Brandon Lim <br...@uci.edu> wrote:
> Hey Eugenia,
>
> I changed the minimum slider option to 0.1 for the group size, but if I actually do a group size less than latitude and longitude 1, say 0.5, it’ll show the cells and how many tweets, but if I click on the bubbles, it doesn’t populate the screen with the tweets. For some reason it works for latitude and longitude of 1 and above, but not between 0.1 and 1.
>
> I was wondering if you would know why is that.
>
> Best Regards,
> Brandon Lim
>
>
>
> On Jun 7, 2015, at 4:09 PM, Eugenia Gabrielova <ge...@gmail.com> wrote:
>
>> Thank you for the feedback about the grid size, and awesome to hear you got your demo working!
>>
>> On Sun, Jun 7, 2015 at 3:08 PM, Brandon Lim <br...@uci.edu> wrote:
>> Hi Eugenia,
>>
>> So for an update regarding the demo, I was able to get the dataset in and run it with the Tweetbook Demo successfully. The only thing worth noting regarding the larger sample size is that the parameters for the group size might need to be significantly smaller (instead of the smallest group size being 1 latitude and 1 longitude) because a larger sample size means it could have thousands of tweets in one area, which would be too much to populate on the screen at once. But overall, the demo works great. Thanks!
>>
>>
>> Best Regards,
>> Brandon Lim
>>
>>
>>
>> On May 31, 2015, at 5:10 PM, Brandon Lim <br...@uci.edu> wrote:
>>
>>> Hi Eugenia,
>>>
>>> My dataset is a 14 GB dataset of archived tweets that was given to me. A sample of it can be found here:
>>>
>>> https://drive.google.com/file/d/0B131hq-YqiMHbkNXd3NUa2xGeGc/view?usp=sharing
>>>
>>> I ended up changing my query (because my X coordinates were longitude and my Y coordinates were latitude originally) by switching the coordinates and the demo works fantastic now. Thanks so much for the help. I will let you know if I have further questions, but for now, it seems like it is working well.
>>>
>>> @Professor Carey & Ian
>>> We should definitely add lat/long to the documentation.
>>>
>>> Best Regards,
>>> Brandon Lim
>>>
>>> On May 31, 2015, at 3:44 PM, Eugenia Gabrielova <ge...@gmail.com> wrote:
>>>
>>>> Hi Brandon,
>>>>
>>>> AsterixDB Lat/Lng: I am pretty sure the points in AsterixDB are created with Latitude, Longitude. Same with Google Maps API. In the Spatial docs (http://asterix.ics.uci.edu/documentation/aql/functions.html#SpatialFunctions) example under "point", the following example is shown, and only longitude can scale up to magnitude 180: use dataverse TinySocial; let $c := point("55.05,-138.04") return {"point": $c}. I remember running into this exact same thing though - perhaps it would be good to specify latitude/longitude arguments in the docs, not just x,y.
>>>>
>>>> On recentering: I have just pushed a change that adds home_latitude and home_longitude as their own variables - good idea! - and resets them in the resetMap() function. The function resetMap() has the code (~ line #1118) that moves the map back to center. I don't think there is recentering anywhere else in the demo.
>>>>
>>>> Los Angeles Spatial issue: Could you give me a bit more information on your data source?
>>>> * Are you using data from the Twitter live API, the original Tweetbook demo dataset, or something else?
>>>> * Does your query on Los Angeles return results with the Query UI (127.0.0.1:19001, on your local machine)?
>>>>
>>>> Cheers,
>>>> Eugenia
>>>>
>>>> On Sun, May 31, 2015 at 2:26 PM, Brandon Lim <br...@uci.edu> wrote:
>>>> Hi Eugenia,
>>>>
>>>> This might not necessarily be a tweet book demo bug or anything, but just a confusion. So for the Tweets API, the coordinates are formatted as geoJSON (longitude first, latitude second). So for AsterixDB (the documentation doesn’t really say), is longitude or latitude x? (I think Young-Seok told me before but I can’t find the email). Also, it seems that Google Maps API uses latitude first, longitude second.
>>>>
>>>> Does the demo account for these inconsistencies? I was able to input my data successfully, and if I changed the coordinates in the tweetbook.js to
>>>>
>>>> map = new GMaps({
>>>> div: '#map',
>>>> lat: 34.05,//38.89,
>>>> lng: -118.25,//-77.03,
>>>> zoom: 4,
>>>> draggable: false,
>>>> });
>>>>
>>>> it would center it in Los Angeles like I wanted, but I wasn’t able to find any tweets in the area and I think it has to do with the spatial intersect. Also, is it better to put a global variable for latitude and longitude in the tweetbook.js for if we wanted to change the starting location? Because changing it in the code above works initially, but when you click “Clear”, it resets it to the original, so it must be hardcoded elsewhere.
>>>>
>>>> Best Regards,
>>>> Brandon Lim
>>>>
>>>>
>>>>
>>>> On May 29, 2015, at 5:31 PM, Eugenia Gabrielova <ge...@gmail.com> wrote:
>>>>
>>>>> Hi Brandon,
>>>>>
>>>>> Just had a chance to add the fix to the branch with a couple commits. Let me know if it causes you any further issues. Thanks for making me aware of the issue - your feedback is really helpful for some changes to make this demo more usable.
>>>>>
>>>>> Regards,
>>>>> Eugenia
>>>>>
>>>>> On Fri, May 29, 2015 at 11:07 AM, Eugenia Gabrielova <ge...@gmail.com> wrote:
>>>>> Sounds like a "feature" (bug) - let me have a look and hotfix that...
>>>>>
>>>>> On Fri, May 29, 2015 at 10:33 AM, Brandon Lim <br...@uci.edu> wrote:
>>>>> Hey Eugenia,
>>>>>
>>>>> I was able to get it to run with my new query and the dataset is inside AsterixDB. I was curious to how I can change the spatial intersect of the query. Even if I put a location in the location box for the query, once I submit the query, it just brings me back to the default spatial area on the East Coast.
>>>>>
>>>>> Best Regards,
>>>>> Brandon Lim
>>>>>
>>>>>
>>>>>
>>>>> On May 28, 2015, at 6:54 PM, Eugenia Gabrielova <ge...@gmail.com> wrote:
>>>>>
>>>>>> It's all good, let me know if you have any issues or questions about the code (or bugs :P so I can fix them)
>>>>>>
>>>>>> On Thu, May 28, 2015 at 6:52 PM, Brandon Lim <br...@uci.edu> wrote:
>>>>>> That worked. I must’ve misspelled it twice because I tried the other day as well. Thanks Eugenia.
>>>>>>
>>>>>> Also, Thanks Ian!
>>>>>>
>>>>>>
>>>>>> Best Regards,
>>>>>> Brandon Lim
>>>>>>
>>>>>>
>>>>>>
>>>>>> On May 28, 2015, at 6:44 PM, Eugenia Gabrielova <ge...@gmail.com> wrote:
>>>>>>
>>>>>>> Hi Brandon,
>>>>>>>
>>>>>>> Looks like you have the pathspec spelled incorrectly ("eugneia")
>>>>>>>
>>>>>>> Try
>>>>>>> $ git checkout eugenia/tweetbook-demo-fixes
>>>>>>>
>>>>>>> On Thu, May 28, 2015 at 6:40 PM, Brandon Lim <br...@uci.edu> wrote:
>>>>>>> Hey Eugenia,
>>>>>>>
>>>>>>> I tried that, but it says
>>>>>>>
>>>>>>> git checkout eugneia/tweetbook-demo-fixes
>>>>>>> error: pathspec 'eugneia/tweetbook-demo-fixes' did not match any file(s) known to git.
>>>>>>>
>>>>>>> When I did
>>>>>>>
>>>>>>> git branch
>>>>>>>
>>>>>>> Only master showed up.
>>>>>>>
>>>>>>> Best Regards,
>>>>>>> Brandon Lim
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> On May 28, 2015, at 6:35 PM, Eugenia Gabrielova <ge...@gmail.com> wrote:
>>>>>>>
>>>>>>>> Hi Brandon!
>>>>>>>>
>>>>>>>> Any luck fetching the upstream branch?
>>>>>>>>
>>>>>>>> $ cd path/to/your/sandbox
>>>>>>>> $ git fetch
>>>>>>>> $ git checkout eugenia/tweetbook-demo-fixes
>>>>>>>>
>>>>>>>> Let me know if that works for you.
>>>>>>>>
>>>>>>>> On Wed, May 27, 2015 at 10:13 AM, Brandon Lim <br...@uci.edu> wrote:
>>>>>>>> Hey Ian,
>>>>>>>>
>>>>>>>> When I clicked the download zip or download tar.gz for the branch, it said 404 not found. I couldn’t figure out how to checkout her specific branch. I was only able to checkout the master branch.
>>>>>>>>
>>>>>>>> Best Regards,
>>>>>>>> Brandon Lim
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> On May 26, 2015, at 10:42 AM, Ian Maxon <im...@uci.edu> wrote:
>>>>>>>>
>>>>>>>>> Hey Brandon,
>>>>>>>>>
>>>>>>>>> What seemed to be the issue with checking out/downloading the repository? It should just be a matter of checking out that branch and doing 'mvn clean package -DskipTests'.
>>>>>>>>>
>>>>>>>>> - Ian
>>>>>>>>>
>>>>>>>>> On Tue, May 26, 2015 at 10:02 AM, Brandon Lim <br...@uci.edu> wrote:
>>>>>>>>> Hey Eugenia,
>>>>>>>>>
>>>>>>>>> I wasn’t able to download your up-to-date branch in the sandbox for some reason. Is there another way for me to get access to your most up-to-date TweetBook Demo?
>>>>>>>>>
>>>>>>>>> Best Regards,
>>>>>>>>> Brandon Lim
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> On May 22, 2015, at 12:17 PM, Eugenia Gabrielova <ge...@gmail.com> wrote:
>>>>>>>>>
>>>>>>>>>> Hi Brandon!
>>>>>>>>>>
>>>>>>>>>> As a heads up, I have a branch in sandbox with some up-to-date changes and fixes on the TweetbookDemo. I'll keep an eye out on this thread if you have any questions, or I can look through code with you on campus if you prefer.
>>>>>>>>>> https://code.google.com/p/asterixdb-sandbox/source/browse/?name=eugenia%2Ftweetbook-demo-fixes#git%2Fasterix-examples%2Fsrc%2Fmain%2Fresources%2Ftweetbook-demo
>>>>>>>>>>
>>>>>>>>>> The longitude shift was just a debugging thing for me when I was playing with spatial queries, to match an older version of the geospatial demo (pre-Tweetbooks). It's not an Asterix-related thing and can easily be removed.
>>>>>>>>>>
>>>>>>>>>> On Fri, May 22, 2015 at 11:41 AM, Ian Maxon <im...@uci.edu> wrote:
>>>>>>>>>> Hi Brandon,
>>>>>>>>>> Interesting. I wasn't quite sure how to solve this initially, but there is a function that does the trick. (however it isn't documented in master!...)
>>>>>>>>>>
>>>>>>>>>> parse-datetime should be able to do the trick. For your example. " parse-datetime("Fri May 11 07:53:00 +0000 2012", "W MMM DD hh:mm:ss z YYYY") " will give the proper AQL object from the string. The first part is (obviously) the date to be parsed. The second is the formatting string, which is not very well documented, but appears to follow Java's convention (https://docs.oracle.com/javase/7/docs/api/java/text/SimpleDateFormat.html) closely.
>>>>>>>>>>
>>>>>>>>>> -Ian
>>>>>>>>>>
>>>>>>>>>> On Fri, May 22, 2015 at 11:01 AM, Brandon Lim <br...@uci.edu> wrote:
>>>>>>>>>> Hey Ian,
>>>>>>>>>>
>>>>>>>>>> Quick question. So I’m trying to align my dataset or how my dataset is handled with the dataset that is currently in use by the TweetBook demo, but one thing is that the TweetBook demo allows it to query based on datetime.
>>>>>>>>>>
>>>>>>>>>> <Screen Shot 2015-05-22 at 10.58.10 AM.png>
>>>>>>>>>> This is what the data for the TweetBook demo looks like. Everything is already preprocessed.
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> This is what my data looks like. Is there an easy way to convert this into datetime?
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> <Screen Shot 2015-05-22 at 11.01.12 AM.png>
>>>>>>>>>> Also, do you know why in the TweetBook demo that the longitude sign bit is flipped?
>>>>>>>>>>
>>>>>>>>>> Best Regards,
>>>>>>>>>> Brandon Lim
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>> --
>>>>>>>>> You received this message because you are subscribed to the Google Groups "asterixdb-users" group.
>>>>>>>>> To unsubscribe from this group and stop receiving emails from it, send an email to asterixdb-users+unsubscribe@googlegroups.com.
>>>>>>>>> For more options, visit https://groups.google.com/d/optout.
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> --
>>>>>>>>> You received this message because you are subscribed to the Google Groups "asterixdb-users" group.
>>>>>>>>> To unsubscribe from this group and stop receiving emails from it, send an email to asterixdb-users+unsubscribe@googlegroups.com.
>>>>>>>>> For more options, visit https://groups.google.com/d/optout.
>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> --
>>>>>>> You received this message because you are subscribed to the Google Groups "asterixdb-users" group.
>>>>>>> To unsubscribe from this group and stop receiving emails from it, send an email to asterixdb-users+unsubscribe@googlegroups.com.
>>>>>>> For more options, visit https://groups.google.com/d/optout.
>>>>>>
>>>>>>
>>>>>>
>>>>>> --
>>>>>> You received this message because you are subscribed to the Google Groups "asterixdb-users" group.
>>>>>> To unsubscribe from this group and stop receiving emails from it, send an email to asterixdb-users+unsubscribe@googlegroups.com.
>>>>>> For more options, visit https://groups.google.com/d/optout.
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> You received this message because you are subscribed to the Google Groups "asterixdb-users" group.
>>>>> To unsubscribe from this group and stop receiving emails from it, send an email to asterixdb-users+unsubscribe@googlegroups.com.
>>>>> For more options, visit https://groups.google.com/d/optout.
>>>>
>>>>
>>>
>>> --
>>> You received this message because you are subscribed to the Google Groups "asterixdb-users" group.
>>> To unsubscribe from this group and stop receiving emails from it, send an email to asterixdb-users+unsubscribe@googlegroups.com.
>>> For more options, visit https://groups.google.com/d/optout.
>>>
>>
>>
>>
>> --
>> You received this message because you are subscribed to the Google Groups "asterixdb-users" group.
>> To unsubscribe from this group and stop receiving emails from it, send an email to asterixdb-users+unsubscribe@googlegroups.com.
>> For more options, visit https://groups.google.com/d/optout.
>
>
Re: Demo not working?
Posted by Eugenia Gabrielova <ge...@gmail.com>.
Hi Brandon!
Thanks for the report. The reason that happens is I did not test that
feature properly. I guess it needs some 0.1*unit tests :D.
I'll look into a fix for this now.
Eugenia
On Mon, Jun 8, 2015 at 12:06 PM, Brandon Lim <br...@uci.edu> wrote:
> Hey Eugenia,
>
> I changed the minimum slider option to 0.1 for the group size, but if I
> actually do a group size less than latitude and longitude 1, say 0.5, it’ll
> show the cells and how many tweets, but if I click on the bubbles, it
> doesn’t populate the screen with the tweets. For some reason it works for
> latitude and longitude of 1 and above, but not between 0.1 and 1.
>
> I was wondering if you would know why is that.
>
> Best Regards,
> Brandon Lim
>
>
>
> On Jun 7, 2015, at 4:09 PM, Eugenia Gabrielova <
> genia.likes.science@gmail.com> wrote:
>
> > Thank you for the feedback about the grid size, and awesome to hear you
> got your demo working!
> >
> > On Sun, Jun 7, 2015 at 3:08 PM, Brandon Lim <br...@uci.edu> wrote:
> > Hi Eugenia,
> >
> > So for an update regarding the demo, I was able to get the dataset in
> and run it with the Tweetbook Demo successfully. The only thing worth
> noting regarding the larger sample size is that the parameters for the
> group size might need to be significantly smaller (instead of the smallest
> group size being 1 latitude and 1 longitude) because a larger sample size
> means it could have thousands of tweets in one area, which would be too
> much to populate on the screen at once. But overall, the demo works great.
> Thanks!
> >
> >
> > Best Regards,
> > Brandon Lim
> >
> >
> >
> > On May 31, 2015, at 5:10 PM, Brandon Lim <br...@uci.edu> wrote:
> >
> > > Hi Eugenia,
> > >
> > > My dataset is a 14 GB dataset of archived tweets that was given to me.
> A sample of it can be found here:
> > >
> > >
> https://drive.google.com/file/d/0B131hq-YqiMHbkNXd3NUa2xGeGc/view?usp=sharing
> > >
> > > I ended up changing my query (because my X coordinates were longitude
> and my Y coordinates were latitude originally) by switching the coordinates
> and the demo works fantastic now. Thanks so much for the help. I will let
> you know if I have further questions, but for now, it seems like it is
> working well.
> > >
> > > @Professor Carey & Ian
> > > We should definitely add lat/long to the documentation.
> > >
> > > Best Regards,
> > > Brandon Lim
> > >
> > > On May 31, 2015, at 3:44 PM, Eugenia Gabrielova <
> genia.likes.science@gmail.com> wrote:
> > >
> > >> Hi Brandon,
> > >>
> > >> AsterixDB Lat/Lng: I am pretty sure the points in AsterixDB are
> created with Latitude, Longitude. Same with Google Maps API. In the Spatial
> docs (
> http://asterix.ics.uci.edu/documentation/aql/functions.html#SpatialFunctions)
> example under "point", the following example is shown, and only longitude
> can scale up to magnitude 180: use dataverse TinySocial; let $c :=
> point("55.05,-138.04") return {"point": $c}. I remember running into this
> exact same thing though - perhaps it would be good to specify
> latitude/longitude arguments in the docs, not just x,y.
> > >>
> > >> On recentering: I have just pushed a change that adds home_latitude
> and home_longitude as their own variables - good idea! - and resets them in
> the resetMap() function. The function resetMap() has the code (~ line
> #1118) that moves the map back to center. I don't think there is
> recentering anywhere else in the demo.
> > >>
> > >> Los Angeles Spatial issue: Could you give me a bit more information
> on your data source?
> > >> * Are you using data from the Twitter live API, the original
> Tweetbook demo dataset, or something else?
> > >> * Does your query on Los Angeles return results with the Query UI (
> 127.0.0.1:19001, on your local machine)?
> > >>
> > >> Cheers,
> > >> Eugenia
> > >>
> > >> On Sun, May 31, 2015 at 2:26 PM, Brandon Lim <br...@uci.edu>
> wrote:
> > >> Hi Eugenia,
> > >>
> > >> This might not necessarily be a tweet book demo bug or anything, but
> just a confusion. So for the Tweets API, the coordinates are formatted as
> geoJSON (longitude first, latitude second). So for AsterixDB (the
> documentation doesn’t really say), is longitude or latitude x? (I think
> Young-Seok told me before but I can’t find the email). Also, it seems that
> Google Maps API uses latitude first, longitude second.
> > >>
> > >> Does the demo account for these inconsistencies? I was able to input
> my data successfully, and if I changed the coordinates in the tweetbook.js
> to
> > >>
> > >> map = new GMaps({
> > >> div: '#map',
> > >> lat: 34.05,//38.89,
> > >> lng: -118.25,//-77.03,
> > >> zoom: 4,
> > >> draggable: false,
> > >> });
> > >>
> > >> it would center it in Los Angeles like I wanted, but I wasn’t able to
> find any tweets in the area and I think it has to do with the spatial
> intersect. Also, is it better to put a global variable for latitude and
> longitude in the tweetbook.js for if we wanted to change the starting
> location? Because changing it in the code above works initially, but when
> you click “Clear”, it resets it to the original, so it must be hardcoded
> elsewhere.
> > >>
> > >> Best Regards,
> > >> Brandon Lim
> > >>
> > >>
> > >>
> > >> On May 29, 2015, at 5:31 PM, Eugenia Gabrielova <
> genia.likes.science@gmail.com> wrote:
> > >>
> > >>> Hi Brandon,
> > >>>
> > >>> Just had a chance to add the fix to the branch with a couple
> commits. Let me know if it causes you any further issues. Thanks for making
> me aware of the issue - your feedback is really helpful for some changes to
> make this demo more usable.
> > >>>
> > >>> Regards,
> > >>> Eugenia
> > >>>
> > >>> On Fri, May 29, 2015 at 11:07 AM, Eugenia Gabrielova <
> genia.likes.science@gmail.com> wrote:
> > >>> Sounds like a "feature" (bug) - let me have a look and hotfix that...
> > >>>
> > >>> On Fri, May 29, 2015 at 10:33 AM, Brandon Lim <br...@uci.edu>
> wrote:
> > >>> Hey Eugenia,
> > >>>
> > >>> I was able to get it to run with my new query and the dataset is
> inside AsterixDB. I was curious to how I can change the spatial intersect
> of the query. Even if I put a location in the location box for the query,
> once I submit the query, it just brings me back to the default spatial area
> on the East Coast.
> > >>>
> > >>> Best Regards,
> > >>> Brandon Lim
> > >>>
> > >>>
> > >>>
> > >>> On May 28, 2015, at 6:54 PM, Eugenia Gabrielova <
> genia.likes.science@gmail.com> wrote:
> > >>>
> > >>>> It's all good, let me know if you have any issues or questions
> about the code (or bugs :P so I can fix them)
> > >>>>
> > >>>> On Thu, May 28, 2015 at 6:52 PM, Brandon Lim <br...@uci.edu>
> wrote:
> > >>>> That worked. I must’ve misspelled it twice because I tried the
> other day as well. Thanks Eugenia.
> > >>>>
> > >>>> Also, Thanks Ian!
> > >>>>
> > >>>>
> > >>>> Best Regards,
> > >>>> Brandon Lim
> > >>>>
> > >>>>
> > >>>>
> > >>>> On May 28, 2015, at 6:44 PM, Eugenia Gabrielova <
> genia.likes.science@gmail.com> wrote:
> > >>>>
> > >>>>> Hi Brandon,
> > >>>>>
> > >>>>> Looks like you have the pathspec spelled incorrectly ("eugneia")
> > >>>>>
> > >>>>> Try
> > >>>>> $ git checkout eugenia/tweetbook-demo-fixes
> > >>>>>
> > >>>>> On Thu, May 28, 2015 at 6:40 PM, Brandon Lim <br...@uci.edu>
> wrote:
> > >>>>> Hey Eugenia,
> > >>>>>
> > >>>>> I tried that, but it says
> > >>>>>
> > >>>>> git checkout eugneia/tweetbook-demo-fixes
> > >>>>> error: pathspec 'eugneia/tweetbook-demo-fixes' did not match any
> file(s) known to git.
> > >>>>>
> > >>>>> When I did
> > >>>>>
> > >>>>> git branch
> > >>>>>
> > >>>>> Only master showed up.
> > >>>>>
> > >>>>> Best Regards,
> > >>>>> Brandon Lim
> > >>>>>
> > >>>>>
> > >>>>>
> > >>>>> On May 28, 2015, at 6:35 PM, Eugenia Gabrielova <
> genia.likes.science@gmail.com> wrote:
> > >>>>>
> > >>>>>> Hi Brandon!
> > >>>>>>
> > >>>>>> Any luck fetching the upstream branch?
> > >>>>>>
> > >>>>>> $ cd path/to/your/sandbox
> > >>>>>> $ git fetch
> > >>>>>> $ git checkout eugenia/tweetbook-demo-fixes
> > >>>>>>
> > >>>>>> Let me know if that works for you.
> > >>>>>>
> > >>>>>> On Wed, May 27, 2015 at 10:13 AM, Brandon Lim <br...@uci.edu>
> wrote:
> > >>>>>> Hey Ian,
> > >>>>>>
> > >>>>>> When I clicked the download zip or download tar.gz for the
> branch, it said 404 not found. I couldn’t figure out how to checkout her
> specific branch. I was only able to checkout the master branch.
> > >>>>>>
> > >>>>>> Best Regards,
> > >>>>>> Brandon Lim
> > >>>>>>
> > >>>>>>
> > >>>>>>
> > >>>>>> On May 26, 2015, at 10:42 AM, Ian Maxon <im...@uci.edu> wrote:
> > >>>>>>
> > >>>>>>> Hey Brandon,
> > >>>>>>>
> > >>>>>>> What seemed to be the issue with checking out/downloading the
> repository? It should just be a matter of checking out that branch and
> doing 'mvn clean package -DskipTests'.
> > >>>>>>>
> > >>>>>>> - Ian
> > >>>>>>>
> > >>>>>>> On Tue, May 26, 2015 at 10:02 AM, Brandon Lim <br...@uci.edu>
> wrote:
> > >>>>>>> Hey Eugenia,
> > >>>>>>>
> > >>>>>>> I wasn’t able to download your up-to-date branch in the sandbox
> for some reason. Is there another way for me to get access to your most
> up-to-date TweetBook Demo?
> > >>>>>>>
> > >>>>>>> Best Regards,
> > >>>>>>> Brandon Lim
> > >>>>>>>
> > >>>>>>>
> > >>>>>>>
> > >>>>>>> On May 22, 2015, at 12:17 PM, Eugenia Gabrielova <
> genia.likes.science@gmail.com> wrote:
> > >>>>>>>
> > >>>>>>>> Hi Brandon!
> > >>>>>>>>
> > >>>>>>>> As a heads up, I have a branch in sandbox with some up-to-date
> changes and fixes on the TweetbookDemo. I'll keep an eye out on this thread
> if you have any questions, or I can look through code with you on campus if
> you prefer.
> > >>>>>>>>
> https://code.google.com/p/asterixdb-sandbox/source/browse/?name=eugenia%2Ftweetbook-demo-fixes#git%2Fasterix-examples%2Fsrc%2Fmain%2Fresources%2Ftweetbook-demo
> > >>>>>>>>
> > >>>>>>>> The longitude shift was just a debugging thing for me when I
> was playing with spatial queries, to match an older version of the
> geospatial demo (pre-Tweetbooks). It's not an Asterix-related thing and can
> easily be removed.
> > >>>>>>>>
> > >>>>>>>> On Fri, May 22, 2015 at 11:41 AM, Ian Maxon <im...@uci.edu>
> wrote:
> > >>>>>>>> Hi Brandon,
> > >>>>>>>> Interesting. I wasn't quite sure how to solve this initially,
> but there is a function that does the trick. (however it isn't documented
> in master!...)
> > >>>>>>>>
> > >>>>>>>> parse-datetime should be able to do the trick. For your
> example. " parse-datetime("Fri May 11 07:53:00 +0000 2012", "W MMM DD
> hh:mm:ss z YYYY") " will give the proper AQL object from the string. The
> first part is (obviously) the date to be parsed. The second is the
> formatting string, which is not very well documented, but appears to follow
> Java's convention (
> https://docs.oracle.com/javase/7/docs/api/java/text/SimpleDateFormat.html)
> closely.
> > >>>>>>>>
> > >>>>>>>> -Ian
> > >>>>>>>>
> > >>>>>>>> On Fri, May 22, 2015 at 11:01 AM, Brandon Lim <br...@uci.edu>
> wrote:
> > >>>>>>>> Hey Ian,
> > >>>>>>>>
> > >>>>>>>> Quick question. So I’m trying to align my dataset or how my
> dataset is handled with the dataset that is currently in use by the
> TweetBook demo, but one thing is that the TweetBook demo allows it to query
> based on datetime.
> > >>>>>>>>
> > >>>>>>>> <Screen Shot 2015-05-22 at 10.58.10 AM.png>
> > >>>>>>>> This is what the data for the TweetBook demo looks like.
> Everything is already preprocessed.
> > >>>>>>>>
> > >>>>>>>>
> > >>>>>>>>
> > >>>>>>>> This is what my data looks like. Is there an easy way to
> convert this into datetime?
> > >>>>>>>>
> > >>>>>>>>
> > >>>>>>>> <Screen Shot 2015-05-22 at 11.01.12 AM.png>
> > >>>>>>>> Also, do you know why in the TweetBook demo that the longitude
> sign bit is flipped?
> > >>>>>>>>
> > >>>>>>>> Best Regards,
> > >>>>>>>> Brandon Lim
> > >>>>>>>>
> > >>>>>>>>
> > >>>>>>>
> > >>>>>>> --
> > >>>>>>> You received this message because you are subscribed to the
> Google Groups "asterixdb-users" group.
> > >>>>>>> To unsubscribe from this group and stop receiving emails from
> it, send an email to asterixdb-users+unsubscribe@googlegroups.com.
> > >>>>>>> For more options, visit https://groups.google.com/d/optout.
> > >>>>>>>
> > >>>>>>>
> > >>>>>>> --
> > >>>>>>> You received this message because you are subscribed to the
> Google Groups "asterixdb-users" group.
> > >>>>>>> To unsubscribe from this group and stop receiving emails from
> it, send an email to asterixdb-users+unsubscribe@googlegroups.com.
> > >>>>>>> For more options, visit https://groups.google.com/d/optout.
> > >>>>>>
> > >>>>>>
> > >>>>>
> > >>>>>
> > >>>>>
> > >>>>> --
> > >>>>> You received this message because you are subscribed to the Google
> Groups "asterixdb-users" group.
> > >>>>> To unsubscribe from this group and stop receiving emails from it,
> send an email to asterixdb-users+unsubscribe@googlegroups.com.
> > >>>>> For more options, visit https://groups.google.com/d/optout.
> > >>>>
> > >>>>
> > >>>>
> > >>>> --
> > >>>> You received this message because you are subscribed to the Google
> Groups "asterixdb-users" group.
> > >>>> To unsubscribe from this group and stop receiving emails from it,
> send an email to asterixdb-users+unsubscribe@googlegroups.com.
> > >>>> For more options, visit https://groups.google.com/d/optout.
> > >>>
> > >>>
> > >>>
> > >>>
> > >>> --
> > >>> You received this message because you are subscribed to the Google
> Groups "asterixdb-users" group.
> > >>> To unsubscribe from this group and stop receiving emails from it,
> send an email to asterixdb-users+unsubscribe@googlegroups.com.
> > >>> For more options, visit https://groups.google.com/d/optout.
> > >>
> > >>
> > >
> > > --
> > > You received this message because you are subscribed to the Google
> Groups "asterixdb-users" group.
> > > To unsubscribe from this group and stop receiving emails from it, send
> an email to asterixdb-users+unsubscribe@googlegroups.com.
> > > For more options, visit https://groups.google.com/d/optout.
> > >
> >
> >
> >
> > --
> > You received this message because you are subscribed to the Google
> Groups "asterixdb-users" group.
> > To unsubscribe from this group and stop receiving emails from it, send
> an email to asterixdb-users+unsubscribe@googlegroups.com.
> > For more options, visit https://groups.google.com/d/optout.
>
>
Re: Demo not working?
Posted by Brandon Lim <br...@uci.edu>.
Hey Eugenia,
I changed the minimum slider option to 0.1 for the group size, but if I actually do a group size less than latitude and longitude 1, say 0.5, it’ll show the cells and how many tweets, but if I click on the bubbles, it doesn’t populate the screen with the tweets. For some reason it works for latitude and longitude of 1 and above, but not between 0.1 and 1.
I was wondering if you would know why is that.
Best Regards,
Brandon Lim
On Jun 7, 2015, at 4:09 PM, Eugenia Gabrielova <ge...@gmail.com> wrote:
> Thank you for the feedback about the grid size, and awesome to hear you got your demo working!
>
> On Sun, Jun 7, 2015 at 3:08 PM, Brandon Lim <br...@uci.edu> wrote:
> Hi Eugenia,
>
> So for an update regarding the demo, I was able to get the dataset in and run it with the Tweetbook Demo successfully. The only thing worth noting regarding the larger sample size is that the parameters for the group size might need to be significantly smaller (instead of the smallest group size being 1 latitude and 1 longitude) because a larger sample size means it could have thousands of tweets in one area, which would be too much to populate on the screen at once. But overall, the demo works great. Thanks!
>
>
> Best Regards,
> Brandon Lim
>
>
>
> On May 31, 2015, at 5:10 PM, Brandon Lim <br...@uci.edu> wrote:
>
> > Hi Eugenia,
> >
> > My dataset is a 14 GB dataset of archived tweets that was given to me. A sample of it can be found here:
> >
> > https://drive.google.com/file/d/0B131hq-YqiMHbkNXd3NUa2xGeGc/view?usp=sharing
> >
> > I ended up changing my query (because my X coordinates were longitude and my Y coordinates were latitude originally) by switching the coordinates and the demo works fantastic now. Thanks so much for the help. I will let you know if I have further questions, but for now, it seems like it is working well.
> >
> > @Professor Carey & Ian
> > We should definitely add lat/long to the documentation.
> >
> > Best Regards,
> > Brandon Lim
> >
> > On May 31, 2015, at 3:44 PM, Eugenia Gabrielova <ge...@gmail.com> wrote:
> >
> >> Hi Brandon,
> >>
> >> AsterixDB Lat/Lng: I am pretty sure the points in AsterixDB are created with Latitude, Longitude. Same with Google Maps API. In the Spatial docs (http://asterix.ics.uci.edu/documentation/aql/functions.html#SpatialFunctions) example under "point", the following example is shown, and only longitude can scale up to magnitude 180: use dataverse TinySocial; let $c := point("55.05,-138.04") return {"point": $c}. I remember running into this exact same thing though - perhaps it would be good to specify latitude/longitude arguments in the docs, not just x,y.
> >>
> >> On recentering: I have just pushed a change that adds home_latitude and home_longitude as their own variables - good idea! - and resets them in the resetMap() function. The function resetMap() has the code (~ line #1118) that moves the map back to center. I don't think there is recentering anywhere else in the demo.
> >>
> >> Los Angeles Spatial issue: Could you give me a bit more information on your data source?
> >> * Are you using data from the Twitter live API, the original Tweetbook demo dataset, or something else?
> >> * Does your query on Los Angeles return results with the Query UI (127.0.0.1:19001, on your local machine)?
> >>
> >> Cheers,
> >> Eugenia
> >>
> >> On Sun, May 31, 2015 at 2:26 PM, Brandon Lim <br...@uci.edu> wrote:
> >> Hi Eugenia,
> >>
> >> This might not necessarily be a tweet book demo bug or anything, but just a confusion. So for the Tweets API, the coordinates are formatted as geoJSON (longitude first, latitude second). So for AsterixDB (the documentation doesn’t really say), is longitude or latitude x? (I think Young-Seok told me before but I can’t find the email). Also, it seems that Google Maps API uses latitude first, longitude second.
> >>
> >> Does the demo account for these inconsistencies? I was able to input my data successfully, and if I changed the coordinates in the tweetbook.js to
> >>
> >> map = new GMaps({
> >> div: '#map',
> >> lat: 34.05,//38.89,
> >> lng: -118.25,//-77.03,
> >> zoom: 4,
> >> draggable: false,
> >> });
> >>
> >> it would center it in Los Angeles like I wanted, but I wasn’t able to find any tweets in the area and I think it has to do with the spatial intersect. Also, is it better to put a global variable for latitude and longitude in the tweetbook.js for if we wanted to change the starting location? Because changing it in the code above works initially, but when you click “Clear”, it resets it to the original, so it must be hardcoded elsewhere.
> >>
> >> Best Regards,
> >> Brandon Lim
> >>
> >>
> >>
> >> On May 29, 2015, at 5:31 PM, Eugenia Gabrielova <ge...@gmail.com> wrote:
> >>
> >>> Hi Brandon,
> >>>
> >>> Just had a chance to add the fix to the branch with a couple commits. Let me know if it causes you any further issues. Thanks for making me aware of the issue - your feedback is really helpful for some changes to make this demo more usable.
> >>>
> >>> Regards,
> >>> Eugenia
> >>>
> >>> On Fri, May 29, 2015 at 11:07 AM, Eugenia Gabrielova <ge...@gmail.com> wrote:
> >>> Sounds like a "feature" (bug) - let me have a look and hotfix that...
> >>>
> >>> On Fri, May 29, 2015 at 10:33 AM, Brandon Lim <br...@uci.edu> wrote:
> >>> Hey Eugenia,
> >>>
> >>> I was able to get it to run with my new query and the dataset is inside AsterixDB. I was curious to how I can change the spatial intersect of the query. Even if I put a location in the location box for the query, once I submit the query, it just brings me back to the default spatial area on the East Coast.
> >>>
> >>> Best Regards,
> >>> Brandon Lim
> >>>
> >>>
> >>>
> >>> On May 28, 2015, at 6:54 PM, Eugenia Gabrielova <ge...@gmail.com> wrote:
> >>>
> >>>> It's all good, let me know if you have any issues or questions about the code (or bugs :P so I can fix them)
> >>>>
> >>>> On Thu, May 28, 2015 at 6:52 PM, Brandon Lim <br...@uci.edu> wrote:
> >>>> That worked. I must’ve misspelled it twice because I tried the other day as well. Thanks Eugenia.
> >>>>
> >>>> Also, Thanks Ian!
> >>>>
> >>>>
> >>>> Best Regards,
> >>>> Brandon Lim
> >>>>
> >>>>
> >>>>
> >>>> On May 28, 2015, at 6:44 PM, Eugenia Gabrielova <ge...@gmail.com> wrote:
> >>>>
> >>>>> Hi Brandon,
> >>>>>
> >>>>> Looks like you have the pathspec spelled incorrectly ("eugneia")
> >>>>>
> >>>>> Try
> >>>>> $ git checkout eugenia/tweetbook-demo-fixes
> >>>>>
> >>>>> On Thu, May 28, 2015 at 6:40 PM, Brandon Lim <br...@uci.edu> wrote:
> >>>>> Hey Eugenia,
> >>>>>
> >>>>> I tried that, but it says
> >>>>>
> >>>>> git checkout eugneia/tweetbook-demo-fixes
> >>>>> error: pathspec 'eugneia/tweetbook-demo-fixes' did not match any file(s) known to git.
> >>>>>
> >>>>> When I did
> >>>>>
> >>>>> git branch
> >>>>>
> >>>>> Only master showed up.
> >>>>>
> >>>>> Best Regards,
> >>>>> Brandon Lim
> >>>>>
> >>>>>
> >>>>>
> >>>>> On May 28, 2015, at 6:35 PM, Eugenia Gabrielova <ge...@gmail.com> wrote:
> >>>>>
> >>>>>> Hi Brandon!
> >>>>>>
> >>>>>> Any luck fetching the upstream branch?
> >>>>>>
> >>>>>> $ cd path/to/your/sandbox
> >>>>>> $ git fetch
> >>>>>> $ git checkout eugenia/tweetbook-demo-fixes
> >>>>>>
> >>>>>> Let me know if that works for you.
> >>>>>>
> >>>>>> On Wed, May 27, 2015 at 10:13 AM, Brandon Lim <br...@uci.edu> wrote:
> >>>>>> Hey Ian,
> >>>>>>
> >>>>>> When I clicked the download zip or download tar.gz for the branch, it said 404 not found. I couldn’t figure out how to checkout her specific branch. I was only able to checkout the master branch.
> >>>>>>
> >>>>>> Best Regards,
> >>>>>> Brandon Lim
> >>>>>>
> >>>>>>
> >>>>>>
> >>>>>> On May 26, 2015, at 10:42 AM, Ian Maxon <im...@uci.edu> wrote:
> >>>>>>
> >>>>>>> Hey Brandon,
> >>>>>>>
> >>>>>>> What seemed to be the issue with checking out/downloading the repository? It should just be a matter of checking out that branch and doing 'mvn clean package -DskipTests'.
> >>>>>>>
> >>>>>>> - Ian
> >>>>>>>
> >>>>>>> On Tue, May 26, 2015 at 10:02 AM, Brandon Lim <br...@uci.edu> wrote:
> >>>>>>> Hey Eugenia,
> >>>>>>>
> >>>>>>> I wasn’t able to download your up-to-date branch in the sandbox for some reason. Is there another way for me to get access to your most up-to-date TweetBook Demo?
> >>>>>>>
> >>>>>>> Best Regards,
> >>>>>>> Brandon Lim
> >>>>>>>
> >>>>>>>
> >>>>>>>
> >>>>>>> On May 22, 2015, at 12:17 PM, Eugenia Gabrielova <ge...@gmail.com> wrote:
> >>>>>>>
> >>>>>>>> Hi Brandon!
> >>>>>>>>
> >>>>>>>> As a heads up, I have a branch in sandbox with some up-to-date changes and fixes on the TweetbookDemo. I'll keep an eye out on this thread if you have any questions, or I can look through code with you on campus if you prefer.
> >>>>>>>> https://code.google.com/p/asterixdb-sandbox/source/browse/?name=eugenia%2Ftweetbook-demo-fixes#git%2Fasterix-examples%2Fsrc%2Fmain%2Fresources%2Ftweetbook-demo
> >>>>>>>>
> >>>>>>>> The longitude shift was just a debugging thing for me when I was playing with spatial queries, to match an older version of the geospatial demo (pre-Tweetbooks). It's not an Asterix-related thing and can easily be removed.
> >>>>>>>>
> >>>>>>>> On Fri, May 22, 2015 at 11:41 AM, Ian Maxon <im...@uci.edu> wrote:
> >>>>>>>> Hi Brandon,
> >>>>>>>> Interesting. I wasn't quite sure how to solve this initially, but there is a function that does the trick. (however it isn't documented in master!...)
> >>>>>>>>
> >>>>>>>> parse-datetime should be able to do the trick. For your example. " parse-datetime("Fri May 11 07:53:00 +0000 2012", "W MMM DD hh:mm:ss z YYYY") " will give the proper AQL object from the string. The first part is (obviously) the date to be parsed. The second is the formatting string, which is not very well documented, but appears to follow Java's convention (https://docs.oracle.com/javase/7/docs/api/java/text/SimpleDateFormat.html) closely.
> >>>>>>>>
> >>>>>>>> -Ian
> >>>>>>>>
> >>>>>>>> On Fri, May 22, 2015 at 11:01 AM, Brandon Lim <br...@uci.edu> wrote:
> >>>>>>>> Hey Ian,
> >>>>>>>>
> >>>>>>>> Quick question. So I’m trying to align my dataset or how my dataset is handled with the dataset that is currently in use by the TweetBook demo, but one thing is that the TweetBook demo allows it to query based on datetime.
> >>>>>>>>
> >>>>>>>> <Screen Shot 2015-05-22 at 10.58.10 AM.png>
> >>>>>>>> This is what the data for the TweetBook demo looks like. Everything is already preprocessed.
> >>>>>>>>
> >>>>>>>>
> >>>>>>>>
> >>>>>>>> This is what my data looks like. Is there an easy way to convert this into datetime?
> >>>>>>>>
> >>>>>>>>
> >>>>>>>> <Screen Shot 2015-05-22 at 11.01.12 AM.png>
> >>>>>>>> Also, do you know why in the TweetBook demo that the longitude sign bit is flipped?
> >>>>>>>>
> >>>>>>>> Best Regards,
> >>>>>>>> Brandon Lim
> >>>>>>>>
> >>>>>>>>
> >>>>>>>
> >>>>>>> --
> >>>>>>> You received this message because you are subscribed to the Google Groups "asterixdb-users" group.
> >>>>>>> To unsubscribe from this group and stop receiving emails from it, send an email to asterixdb-users+unsubscribe@googlegroups.com.
> >>>>>>> For more options, visit https://groups.google.com/d/optout.
> >>>>>>>
> >>>>>>>
> >>>>>>> --
> >>>>>>> You received this message because you are subscribed to the Google Groups "asterixdb-users" group.
> >>>>>>> To unsubscribe from this group and stop receiving emails from it, send an email to asterixdb-users+unsubscribe@googlegroups.com.
> >>>>>>> For more options, visit https://groups.google.com/d/optout.
> >>>>>>
> >>>>>>
> >>>>>
> >>>>>
> >>>>>
> >>>>> --
> >>>>> You received this message because you are subscribed to the Google Groups "asterixdb-users" group.
> >>>>> To unsubscribe from this group and stop receiving emails from it, send an email to asterixdb-users+unsubscribe@googlegroups.com.
> >>>>> For more options, visit https://groups.google.com/d/optout.
> >>>>
> >>>>
> >>>>
> >>>> --
> >>>> You received this message because you are subscribed to the Google Groups "asterixdb-users" group.
> >>>> To unsubscribe from this group and stop receiving emails from it, send an email to asterixdb-users+unsubscribe@googlegroups.com.
> >>>> For more options, visit https://groups.google.com/d/optout.
> >>>
> >>>
> >>>
> >>>
> >>> --
> >>> You received this message because you are subscribed to the Google Groups "asterixdb-users" group.
> >>> To unsubscribe from this group and stop receiving emails from it, send an email to asterixdb-users+unsubscribe@googlegroups.com.
> >>> For more options, visit https://groups.google.com/d/optout.
> >>
> >>
> >
> > --
> > You received this message because you are subscribed to the Google Groups "asterixdb-users" group.
> > To unsubscribe from this group and stop receiving emails from it, send an email to asterixdb-users+unsubscribe@googlegroups.com.
> > For more options, visit https://groups.google.com/d/optout.
> >
>
>
>
> --
> You received this message because you are subscribed to the Google Groups "asterixdb-users" group.
> To unsubscribe from this group and stop receiving emails from it, send an email to asterixdb-users+unsubscribe@googlegroups.com.
> For more options, visit https://groups.google.com/d/optout.
Re: Demo not working?
Posted by Eugenia Gabrielova <ge...@gmail.com>.
Thank you for the feedback about the grid size, and awesome to hear you got
your demo working!
On Sun, Jun 7, 2015 at 3:08 PM, Brandon Lim <br...@uci.edu> wrote:
> Hi Eugenia,
>
> So for an update regarding the demo, I was able to get the dataset in and
> run it with the Tweetbook Demo successfully. The only thing worth noting
> regarding the larger sample size is that the parameters for the group size
> might need to be significantly smaller (instead of the smallest group size
> being 1 latitude and 1 longitude) because a larger sample size means it
> could have thousands of tweets in one area, which would be too much to
> populate on the screen at once. But overall, the demo works great. Thanks!
>
>
> Best Regards,
> Brandon Lim
>
>
>
> On May 31, 2015, at 5:10 PM, Brandon Lim <br...@uci.edu> wrote:
>
> > Hi Eugenia,
> >
> > My dataset is a 14 GB dataset of archived tweets that was given to me. A
> sample of it can be found here:
> >
> >
> https://drive.google.com/file/d/0B131hq-YqiMHbkNXd3NUa2xGeGc/view?usp=sharing
> >
> > I ended up changing my query (because my X coordinates were longitude
> and my Y coordinates were latitude originally) by switching the coordinates
> and the demo works fantastic now. Thanks so much for the help. I will let
> you know if I have further questions, but for now, it seems like it is
> working well.
> >
> > @Professor Carey & Ian
> > We should definitely add lat/long to the documentation.
> >
> > Best Regards,
> > Brandon Lim
> >
> > On May 31, 2015, at 3:44 PM, Eugenia Gabrielova <
> genia.likes.science@gmail.com> wrote:
> >
> >> Hi Brandon,
> >>
> >> AsterixDB Lat/Lng: I am pretty sure the points in AsterixDB are created
> with Latitude, Longitude. Same with Google Maps API. In the Spatial docs (
> http://asterix.ics.uci.edu/documentation/aql/functions.html#SpatialFunctions)
> example under "point", the following example is shown, and only longitude
> can scale up to magnitude 180: use dataverse TinySocial; let $c :=
> point("55.05,-138.04") return {"point": $c}. I remember running into this
> exact same thing though - perhaps it would be good to specify
> latitude/longitude arguments in the docs, not just x,y.
> >>
> >> On recentering: I have just pushed a change that adds home_latitude and
> home_longitude as their own variables - good idea! - and resets them in the
> resetMap() function. The function resetMap() has the code (~ line #1118)
> that moves the map back to center. I don't think there is recentering
> anywhere else in the demo.
> >>
> >> Los Angeles Spatial issue: Could you give me a bit more information on
> your data source?
> >> * Are you using data from the Twitter live API, the original Tweetbook
> demo dataset, or something else?
> >> * Does your query on Los Angeles return results with the Query UI (
> 127.0.0.1:19001, on your local machine)?
> >>
> >> Cheers,
> >> Eugenia
> >>
> >> On Sun, May 31, 2015 at 2:26 PM, Brandon Lim <br...@uci.edu> wrote:
> >> Hi Eugenia,
> >>
> >> This might not necessarily be a tweet book demo bug or anything, but
> just a confusion. So for the Tweets API, the coordinates are formatted as
> geoJSON (longitude first, latitude second). So for AsterixDB (the
> documentation doesn’t really say), is longitude or latitude x? (I think
> Young-Seok told me before but I can’t find the email). Also, it seems that
> Google Maps API uses latitude first, longitude second.
> >>
> >> Does the demo account for these inconsistencies? I was able to input my
> data successfully, and if I changed the coordinates in the tweetbook.js to
> >>
> >> map = new GMaps({
> >> div: '#map',
> >> lat: 34.05,//38.89,
> >> lng: -118.25,//-77.03,
> >> zoom: 4,
> >> draggable: false,
> >> });
> >>
> >> it would center it in Los Angeles like I wanted, but I wasn’t able to
> find any tweets in the area and I think it has to do with the spatial
> intersect. Also, is it better to put a global variable for latitude and
> longitude in the tweetbook.js for if we wanted to change the starting
> location? Because changing it in the code above works initially, but when
> you click “Clear”, it resets it to the original, so it must be hardcoded
> elsewhere.
> >>
> >> Best Regards,
> >> Brandon Lim
> >>
> >>
> >>
> >> On May 29, 2015, at 5:31 PM, Eugenia Gabrielova <
> genia.likes.science@gmail.com> wrote:
> >>
> >>> Hi Brandon,
> >>>
> >>> Just had a chance to add the fix to the branch with a couple commits.
> Let me know if it causes you any further issues. Thanks for making me aware
> of the issue - your feedback is really helpful for some changes to make
> this demo more usable.
> >>>
> >>> Regards,
> >>> Eugenia
> >>>
> >>> On Fri, May 29, 2015 at 11:07 AM, Eugenia Gabrielova <
> genia.likes.science@gmail.com> wrote:
> >>> Sounds like a "feature" (bug) - let me have a look and hotfix that...
> >>>
> >>> On Fri, May 29, 2015 at 10:33 AM, Brandon Lim <br...@uci.edu>
> wrote:
> >>> Hey Eugenia,
> >>>
> >>> I was able to get it to run with my new query and the dataset is
> inside AsterixDB. I was curious to how I can change the spatial intersect
> of the query. Even if I put a location in the location box for the query,
> once I submit the query, it just brings me back to the default spatial area
> on the East Coast.
> >>>
> >>> Best Regards,
> >>> Brandon Lim
> >>>
> >>>
> >>>
> >>> On May 28, 2015, at 6:54 PM, Eugenia Gabrielova <
> genia.likes.science@gmail.com> wrote:
> >>>
> >>>> It's all good, let me know if you have any issues or questions about
> the code (or bugs :P so I can fix them)
> >>>>
> >>>> On Thu, May 28, 2015 at 6:52 PM, Brandon Lim <br...@uci.edu>
> wrote:
> >>>> That worked. I must’ve misspelled it twice because I tried the other
> day as well. Thanks Eugenia.
> >>>>
> >>>> Also, Thanks Ian!
> >>>>
> >>>>
> >>>> Best Regards,
> >>>> Brandon Lim
> >>>>
> >>>>
> >>>>
> >>>> On May 28, 2015, at 6:44 PM, Eugenia Gabrielova <
> genia.likes.science@gmail.com> wrote:
> >>>>
> >>>>> Hi Brandon,
> >>>>>
> >>>>> Looks like you have the pathspec spelled incorrectly ("eugneia")
> >>>>>
> >>>>> Try
> >>>>> $ git checkout eugenia/tweetbook-demo-fixes
> >>>>>
> >>>>> On Thu, May 28, 2015 at 6:40 PM, Brandon Lim <br...@uci.edu>
> wrote:
> >>>>> Hey Eugenia,
> >>>>>
> >>>>> I tried that, but it says
> >>>>>
> >>>>> git checkout eugneia/tweetbook-demo-fixes
> >>>>> error: pathspec 'eugneia/tweetbook-demo-fixes' did not match any
> file(s) known to git.
> >>>>>
> >>>>> When I did
> >>>>>
> >>>>> git branch
> >>>>>
> >>>>> Only master showed up.
> >>>>>
> >>>>> Best Regards,
> >>>>> Brandon Lim
> >>>>>
> >>>>>
> >>>>>
> >>>>> On May 28, 2015, at 6:35 PM, Eugenia Gabrielova <
> genia.likes.science@gmail.com> wrote:
> >>>>>
> >>>>>> Hi Brandon!
> >>>>>>
> >>>>>> Any luck fetching the upstream branch?
> >>>>>>
> >>>>>> $ cd path/to/your/sandbox
> >>>>>> $ git fetch
> >>>>>> $ git checkout eugenia/tweetbook-demo-fixes
> >>>>>>
> >>>>>> Let me know if that works for you.
> >>>>>>
> >>>>>> On Wed, May 27, 2015 at 10:13 AM, Brandon Lim <br...@uci.edu>
> wrote:
> >>>>>> Hey Ian,
> >>>>>>
> >>>>>> When I clicked the download zip or download tar.gz for the branch,
> it said 404 not found. I couldn’t figure out how to checkout her specific
> branch. I was only able to checkout the master branch.
> >>>>>>
> >>>>>> Best Regards,
> >>>>>> Brandon Lim
> >>>>>>
> >>>>>>
> >>>>>>
> >>>>>> On May 26, 2015, at 10:42 AM, Ian Maxon <im...@uci.edu> wrote:
> >>>>>>
> >>>>>>> Hey Brandon,
> >>>>>>>
> >>>>>>> What seemed to be the issue with checking out/downloading the
> repository? It should just be a matter of checking out that branch and
> doing 'mvn clean package -DskipTests'.
> >>>>>>>
> >>>>>>> - Ian
> >>>>>>>
> >>>>>>> On Tue, May 26, 2015 at 10:02 AM, Brandon Lim <br...@uci.edu>
> wrote:
> >>>>>>> Hey Eugenia,
> >>>>>>>
> >>>>>>> I wasn’t able to download your up-to-date branch in the sandbox
> for some reason. Is there another way for me to get access to your most
> up-to-date TweetBook Demo?
> >>>>>>>
> >>>>>>> Best Regards,
> >>>>>>> Brandon Lim
> >>>>>>>
> >>>>>>>
> >>>>>>>
> >>>>>>> On May 22, 2015, at 12:17 PM, Eugenia Gabrielova <
> genia.likes.science@gmail.com> wrote:
> >>>>>>>
> >>>>>>>> Hi Brandon!
> >>>>>>>>
> >>>>>>>> As a heads up, I have a branch in sandbox with some up-to-date
> changes and fixes on the TweetbookDemo. I'll keep an eye out on this thread
> if you have any questions, or I can look through code with you on campus if
> you prefer.
> >>>>>>>>
> https://code.google.com/p/asterixdb-sandbox/source/browse/?name=eugenia%2Ftweetbook-demo-fixes#git%2Fasterix-examples%2Fsrc%2Fmain%2Fresources%2Ftweetbook-demo
> >>>>>>>>
> >>>>>>>> The longitude shift was just a debugging thing for me when I was
> playing with spatial queries, to match an older version of the geospatial
> demo (pre-Tweetbooks). It's not an Asterix-related thing and can easily be
> removed.
> >>>>>>>>
> >>>>>>>> On Fri, May 22, 2015 at 11:41 AM, Ian Maxon <im...@uci.edu>
> wrote:
> >>>>>>>> Hi Brandon,
> >>>>>>>> Interesting. I wasn't quite sure how to solve this initially, but
> there is a function that does the trick. (however it isn't documented in
> master!...)
> >>>>>>>>
> >>>>>>>> parse-datetime should be able to do the trick. For your example.
> " parse-datetime("Fri May 11 07:53:00 +0000 2012", "W MMM DD hh:mm:ss z
> YYYY") " will give the proper AQL object from the string. The first part
> is (obviously) the date to be parsed. The second is the formatting string,
> which is not very well documented, but appears to follow Java's convention (
> https://docs.oracle.com/javase/7/docs/api/java/text/SimpleDateFormat.html)
> closely.
> >>>>>>>>
> >>>>>>>> -Ian
> >>>>>>>>
> >>>>>>>> On Fri, May 22, 2015 at 11:01 AM, Brandon Lim <br...@uci.edu>
> wrote:
> >>>>>>>> Hey Ian,
> >>>>>>>>
> >>>>>>>> Quick question. So I’m trying to align my dataset or how my
> dataset is handled with the dataset that is currently in use by the
> TweetBook demo, but one thing is that the TweetBook demo allows it to query
> based on datetime.
> >>>>>>>>
> >>>>>>>> <Screen Shot 2015-05-22 at 10.58.10 AM.png>
> >>>>>>>> This is what the data for the TweetBook demo looks like.
> Everything is already preprocessed.
> >>>>>>>>
> >>>>>>>>
> >>>>>>>>
> >>>>>>>> This is what my data looks like. Is there an easy way to convert
> this into datetime?
> >>>>>>>>
> >>>>>>>>
> >>>>>>>> <Screen Shot 2015-05-22 at 11.01.12 AM.png>
> >>>>>>>> Also, do you know why in the TweetBook demo that the longitude
> sign bit is flipped?
> >>>>>>>>
> >>>>>>>> Best Regards,
> >>>>>>>> Brandon Lim
> >>>>>>>>
> >>>>>>>>
> >>>>>>>
> >>>>>>> --
> >>>>>>> You received this message because you are subscribed to the Google
> Groups "asterixdb-users" group.
> >>>>>>> To unsubscribe from this group and stop receiving emails from it,
> send an email to asterixdb-users+unsubscribe@googlegroups.com.
> >>>>>>> For more options, visit https://groups.google.com/d/optout.
> >>>>>>>
> >>>>>>>
> >>>>>>> --
> >>>>>>> You received this message because you are subscribed to the Google
> Groups "asterixdb-users" group.
> >>>>>>> To unsubscribe from this group and stop receiving emails from it,
> send an email to asterixdb-users+unsubscribe@googlegroups.com.
> >>>>>>> For more options, visit https://groups.google.com/d/optout.
> >>>>>>
> >>>>>>
> >>>>>
> >>>>>
> >>>>>
> >>>>> --
> >>>>> You received this message because you are subscribed to the Google
> Groups "asterixdb-users" group.
> >>>>> To unsubscribe from this group and stop receiving emails from it,
> send an email to asterixdb-users+unsubscribe@googlegroups.com.
> >>>>> For more options, visit https://groups.google.com/d/optout.
> >>>>
> >>>>
> >>>>
> >>>> --
> >>>> You received this message because you are subscribed to the Google
> Groups "asterixdb-users" group.
> >>>> To unsubscribe from this group and stop receiving emails from it,
> send an email to asterixdb-users+unsubscribe@googlegroups.com.
> >>>> For more options, visit https://groups.google.com/d/optout.
> >>>
> >>>
> >>>
> >>>
> >>> --
> >>> You received this message because you are subscribed to the Google
> Groups "asterixdb-users" group.
> >>> To unsubscribe from this group and stop receiving emails from it, send
> an email to asterixdb-users+unsubscribe@googlegroups.com.
> >>> For more options, visit https://groups.google.com/d/optout.
> >>
> >>
> >
> > --
> > You received this message because you are subscribed to the Google
> Groups "asterixdb-users" group.
> > To unsubscribe from this group and stop receiving emails from it, send
> an email to asterixdb-users+unsubscribe@googlegroups.com.
> > For more options, visit https://groups.google.com/d/optout.
> >
>
>
Re: Demo not working?
Posted by Brandon Lim <br...@uci.edu>.
Hi Eugenia,
So for an update regarding the demo, I was able to get the dataset in and run it with the Tweetbook Demo successfully. The only thing worth noting regarding the larger sample size is that the parameters for the group size might need to be significantly smaller (instead of the smallest group size being 1 latitude and 1 longitude) because a larger sample size means it could have thousands of tweets in one area, which would be too much to populate on the screen at once. But overall, the demo works great. Thanks!
Best Regards,
Brandon Lim
On May 31, 2015, at 5:10 PM, Brandon Lim <br...@uci.edu> wrote:
> Hi Eugenia,
>
> My dataset is a 14 GB dataset of archived tweets that was given to me. A sample of it can be found here:
>
> https://drive.google.com/file/d/0B131hq-YqiMHbkNXd3NUa2xGeGc/view?usp=sharing
>
> I ended up changing my query (because my X coordinates were longitude and my Y coordinates were latitude originally) by switching the coordinates and the demo works fantastic now. Thanks so much for the help. I will let you know if I have further questions, but for now, it seems like it is working well.
>
> @Professor Carey & Ian
> We should definitely add lat/long to the documentation.
>
> Best Regards,
> Brandon Lim
>
> On May 31, 2015, at 3:44 PM, Eugenia Gabrielova <ge...@gmail.com> wrote:
>
>> Hi Brandon,
>>
>> AsterixDB Lat/Lng: I am pretty sure the points in AsterixDB are created with Latitude, Longitude. Same with Google Maps API. In the Spatial docs (http://asterix.ics.uci.edu/documentation/aql/functions.html#SpatialFunctions) example under "point", the following example is shown, and only longitude can scale up to magnitude 180: use dataverse TinySocial; let $c := point("55.05,-138.04") return {"point": $c}. I remember running into this exact same thing though - perhaps it would be good to specify latitude/longitude arguments in the docs, not just x,y.
>>
>> On recentering: I have just pushed a change that adds home_latitude and home_longitude as their own variables - good idea! - and resets them in the resetMap() function. The function resetMap() has the code (~ line #1118) that moves the map back to center. I don't think there is recentering anywhere else in the demo.
>>
>> Los Angeles Spatial issue: Could you give me a bit more information on your data source?
>> * Are you using data from the Twitter live API, the original Tweetbook demo dataset, or something else?
>> * Does your query on Los Angeles return results with the Query UI (127.0.0.1:19001, on your local machine)?
>>
>> Cheers,
>> Eugenia
>>
>> On Sun, May 31, 2015 at 2:26 PM, Brandon Lim <br...@uci.edu> wrote:
>> Hi Eugenia,
>>
>> This might not necessarily be a tweet book demo bug or anything, but just a confusion. So for the Tweets API, the coordinates are formatted as geoJSON (longitude first, latitude second). So for AsterixDB (the documentation doesn’t really say), is longitude or latitude x? (I think Young-Seok told me before but I can’t find the email). Also, it seems that Google Maps API uses latitude first, longitude second.
>>
>> Does the demo account for these inconsistencies? I was able to input my data successfully, and if I changed the coordinates in the tweetbook.js to
>>
>> map = new GMaps({
>> div: '#map',
>> lat: 34.05,//38.89,
>> lng: -118.25,//-77.03,
>> zoom: 4,
>> draggable: false,
>> });
>>
>> it would center it in Los Angeles like I wanted, but I wasn’t able to find any tweets in the area and I think it has to do with the spatial intersect. Also, is it better to put a global variable for latitude and longitude in the tweetbook.js for if we wanted to change the starting location? Because changing it in the code above works initially, but when you click “Clear”, it resets it to the original, so it must be hardcoded elsewhere.
>>
>> Best Regards,
>> Brandon Lim
>>
>>
>>
>> On May 29, 2015, at 5:31 PM, Eugenia Gabrielova <ge...@gmail.com> wrote:
>>
>>> Hi Brandon,
>>>
>>> Just had a chance to add the fix to the branch with a couple commits. Let me know if it causes you any further issues. Thanks for making me aware of the issue - your feedback is really helpful for some changes to make this demo more usable.
>>>
>>> Regards,
>>> Eugenia
>>>
>>> On Fri, May 29, 2015 at 11:07 AM, Eugenia Gabrielova <ge...@gmail.com> wrote:
>>> Sounds like a "feature" (bug) - let me have a look and hotfix that...
>>>
>>> On Fri, May 29, 2015 at 10:33 AM, Brandon Lim <br...@uci.edu> wrote:
>>> Hey Eugenia,
>>>
>>> I was able to get it to run with my new query and the dataset is inside AsterixDB. I was curious to how I can change the spatial intersect of the query. Even if I put a location in the location box for the query, once I submit the query, it just brings me back to the default spatial area on the East Coast.
>>>
>>> Best Regards,
>>> Brandon Lim
>>>
>>>
>>>
>>> On May 28, 2015, at 6:54 PM, Eugenia Gabrielova <ge...@gmail.com> wrote:
>>>
>>>> It's all good, let me know if you have any issues or questions about the code (or bugs :P so I can fix them)
>>>>
>>>> On Thu, May 28, 2015 at 6:52 PM, Brandon Lim <br...@uci.edu> wrote:
>>>> That worked. I must’ve misspelled it twice because I tried the other day as well. Thanks Eugenia.
>>>>
>>>> Also, Thanks Ian!
>>>>
>>>>
>>>> Best Regards,
>>>> Brandon Lim
>>>>
>>>>
>>>>
>>>> On May 28, 2015, at 6:44 PM, Eugenia Gabrielova <ge...@gmail.com> wrote:
>>>>
>>>>> Hi Brandon,
>>>>>
>>>>> Looks like you have the pathspec spelled incorrectly ("eugneia")
>>>>>
>>>>> Try
>>>>> $ git checkout eugenia/tweetbook-demo-fixes
>>>>>
>>>>> On Thu, May 28, 2015 at 6:40 PM, Brandon Lim <br...@uci.edu> wrote:
>>>>> Hey Eugenia,
>>>>>
>>>>> I tried that, but it says
>>>>>
>>>>> git checkout eugneia/tweetbook-demo-fixes
>>>>> error: pathspec 'eugneia/tweetbook-demo-fixes' did not match any file(s) known to git.
>>>>>
>>>>> When I did
>>>>>
>>>>> git branch
>>>>>
>>>>> Only master showed up.
>>>>>
>>>>> Best Regards,
>>>>> Brandon Lim
>>>>>
>>>>>
>>>>>
>>>>> On May 28, 2015, at 6:35 PM, Eugenia Gabrielova <ge...@gmail.com> wrote:
>>>>>
>>>>>> Hi Brandon!
>>>>>>
>>>>>> Any luck fetching the upstream branch?
>>>>>>
>>>>>> $ cd path/to/your/sandbox
>>>>>> $ git fetch
>>>>>> $ git checkout eugenia/tweetbook-demo-fixes
>>>>>>
>>>>>> Let me know if that works for you.
>>>>>>
>>>>>> On Wed, May 27, 2015 at 10:13 AM, Brandon Lim <br...@uci.edu> wrote:
>>>>>> Hey Ian,
>>>>>>
>>>>>> When I clicked the download zip or download tar.gz for the branch, it said 404 not found. I couldn’t figure out how to checkout her specific branch. I was only able to checkout the master branch.
>>>>>>
>>>>>> Best Regards,
>>>>>> Brandon Lim
>>>>>>
>>>>>>
>>>>>>
>>>>>> On May 26, 2015, at 10:42 AM, Ian Maxon <im...@uci.edu> wrote:
>>>>>>
>>>>>>> Hey Brandon,
>>>>>>>
>>>>>>> What seemed to be the issue with checking out/downloading the repository? It should just be a matter of checking out that branch and doing 'mvn clean package -DskipTests'.
>>>>>>>
>>>>>>> - Ian
>>>>>>>
>>>>>>> On Tue, May 26, 2015 at 10:02 AM, Brandon Lim <br...@uci.edu> wrote:
>>>>>>> Hey Eugenia,
>>>>>>>
>>>>>>> I wasn’t able to download your up-to-date branch in the sandbox for some reason. Is there another way for me to get access to your most up-to-date TweetBook Demo?
>>>>>>>
>>>>>>> Best Regards,
>>>>>>> Brandon Lim
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> On May 22, 2015, at 12:17 PM, Eugenia Gabrielova <ge...@gmail.com> wrote:
>>>>>>>
>>>>>>>> Hi Brandon!
>>>>>>>>
>>>>>>>> As a heads up, I have a branch in sandbox with some up-to-date changes and fixes on the TweetbookDemo. I'll keep an eye out on this thread if you have any questions, or I can look through code with you on campus if you prefer.
>>>>>>>> https://code.google.com/p/asterixdb-sandbox/source/browse/?name=eugenia%2Ftweetbook-demo-fixes#git%2Fasterix-examples%2Fsrc%2Fmain%2Fresources%2Ftweetbook-demo
>>>>>>>>
>>>>>>>> The longitude shift was just a debugging thing for me when I was playing with spatial queries, to match an older version of the geospatial demo (pre-Tweetbooks). It's not an Asterix-related thing and can easily be removed.
>>>>>>>>
>>>>>>>> On Fri, May 22, 2015 at 11:41 AM, Ian Maxon <im...@uci.edu> wrote:
>>>>>>>> Hi Brandon,
>>>>>>>> Interesting. I wasn't quite sure how to solve this initially, but there is a function that does the trick. (however it isn't documented in master!...)
>>>>>>>>
>>>>>>>> parse-datetime should be able to do the trick. For your example. " parse-datetime("Fri May 11 07:53:00 +0000 2012", "W MMM DD hh:mm:ss z YYYY") " will give the proper AQL object from the string. The first part is (obviously) the date to be parsed. The second is the formatting string, which is not very well documented, but appears to follow Java's convention (https://docs.oracle.com/javase/7/docs/api/java/text/SimpleDateFormat.html) closely.
>>>>>>>>
>>>>>>>> -Ian
>>>>>>>>
>>>>>>>> On Fri, May 22, 2015 at 11:01 AM, Brandon Lim <br...@uci.edu> wrote:
>>>>>>>> Hey Ian,
>>>>>>>>
>>>>>>>> Quick question. So I’m trying to align my dataset or how my dataset is handled with the dataset that is currently in use by the TweetBook demo, but one thing is that the TweetBook demo allows it to query based on datetime.
>>>>>>>>
>>>>>>>> <Screen Shot 2015-05-22 at 10.58.10 AM.png>
>>>>>>>> This is what the data for the TweetBook demo looks like. Everything is already preprocessed.
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> This is what my data looks like. Is there an easy way to convert this into datetime?
>>>>>>>>
>>>>>>>>
>>>>>>>> <Screen Shot 2015-05-22 at 11.01.12 AM.png>
>>>>>>>> Also, do you know why in the TweetBook demo that the longitude sign bit is flipped?
>>>>>>>>
>>>>>>>> Best Regards,
>>>>>>>> Brandon Lim
>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>> --
>>>>>>> You received this message because you are subscribed to the Google Groups "asterixdb-users" group.
>>>>>>> To unsubscribe from this group and stop receiving emails from it, send an email to asterixdb-users+unsubscribe@googlegroups.com.
>>>>>>> For more options, visit https://groups.google.com/d/optout.
>>>>>>>
>>>>>>>
>>>>>>> --
>>>>>>> You received this message because you are subscribed to the Google Groups "asterixdb-users" group.
>>>>>>> To unsubscribe from this group and stop receiving emails from it, send an email to asterixdb-users+unsubscribe@googlegroups.com.
>>>>>>> For more options, visit https://groups.google.com/d/optout.
>>>>>>
>>>>>>
>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> You received this message because you are subscribed to the Google Groups "asterixdb-users" group.
>>>>> To unsubscribe from this group and stop receiving emails from it, send an email to asterixdb-users+unsubscribe@googlegroups.com.
>>>>> For more options, visit https://groups.google.com/d/optout.
>>>>
>>>>
>>>>
>>>> --
>>>> You received this message because you are subscribed to the Google Groups "asterixdb-users" group.
>>>> To unsubscribe from this group and stop receiving emails from it, send an email to asterixdb-users+unsubscribe@googlegroups.com.
>>>> For more options, visit https://groups.google.com/d/optout.
>>>
>>>
>>>
>>>
>>> --
>>> You received this message because you are subscribed to the Google Groups "asterixdb-users" group.
>>> To unsubscribe from this group and stop receiving emails from it, send an email to asterixdb-users+unsubscribe@googlegroups.com.
>>> For more options, visit https://groups.google.com/d/optout.
>>
>>
>
> --
> You received this message because you are subscribed to the Google Groups "asterixdb-users" group.
> To unsubscribe from this group and stop receiving emails from it, send an email to asterixdb-users+unsubscribe@googlegroups.com.
> For more options, visit https://groups.google.com/d/optout.
>
Re: Demo not working?
Posted by Brandon Lim <br...@uci.edu>.
Hi Eugenia,
My dataset is a 14 GB dataset of archived tweets that was given to me. A sample of it can be found here:
https://drive.google.com/file/d/0B131hq-YqiMHbkNXd3NUa2xGeGc/view?usp=sharing
I ended up changing my query (because my X coordinates were longitude and my Y coordinates were latitude originally) by switching the coordinates and the demo works fantastic now. Thanks so much for the help. I will let you know if I have further questions, but for now, it seems like it is working well.
@Professor Carey & Ian
We should definitely add lat/long to the documentation.
Best Regards,
Brandon Lim
On May 31, 2015, at 3:44 PM, Eugenia Gabrielova <ge...@gmail.com> wrote:
> Hi Brandon,
>
> AsterixDB Lat/Lng: I am pretty sure the points in AsterixDB are created with Latitude, Longitude. Same with Google Maps API. In the Spatial docs (http://asterix.ics.uci.edu/documentation/aql/functions.html#SpatialFunctions) example under "point", the following example is shown, and only longitude can scale up to magnitude 180: use dataverse TinySocial; let $c := point("55.05,-138.04") return {"point": $c}. I remember running into this exact same thing though - perhaps it would be good to specify latitude/longitude arguments in the docs, not just x,y.
>
> On recentering: I have just pushed a change that adds home_latitude and home_longitude as their own variables - good idea! - and resets them in the resetMap() function. The function resetMap() has the code (~ line #1118) that moves the map back to center. I don't think there is recentering anywhere else in the demo.
>
> Los Angeles Spatial issue: Could you give me a bit more information on your data source?
> * Are you using data from the Twitter live API, the original Tweetbook demo dataset, or something else?
> * Does your query on Los Angeles return results with the Query UI (127.0.0.1:19001, on your local machine)?
>
> Cheers,
> Eugenia
>
> On Sun, May 31, 2015 at 2:26 PM, Brandon Lim <br...@uci.edu> wrote:
> Hi Eugenia,
>
> This might not necessarily be a tweet book demo bug or anything, but just a confusion. So for the Tweets API, the coordinates are formatted as geoJSON (longitude first, latitude second). So for AsterixDB (the documentation doesn’t really say), is longitude or latitude x? (I think Young-Seok told me before but I can’t find the email). Also, it seems that Google Maps API uses latitude first, longitude second.
>
> Does the demo account for these inconsistencies? I was able to input my data successfully, and if I changed the coordinates in the tweetbook.js to
>
> map = new GMaps({
> div: '#map',
> lat: 34.05,//38.89,
> lng: -118.25,//-77.03,
> zoom: 4,
> draggable: false,
> });
>
> it would center it in Los Angeles like I wanted, but I wasn’t able to find any tweets in the area and I think it has to do with the spatial intersect. Also, is it better to put a global variable for latitude and longitude in the tweetbook.js for if we wanted to change the starting location? Because changing it in the code above works initially, but when you click “Clear”, it resets it to the original, so it must be hardcoded elsewhere.
>
> Best Regards,
> Brandon Lim
>
>
>
> On May 29, 2015, at 5:31 PM, Eugenia Gabrielova <ge...@gmail.com> wrote:
>
> > Hi Brandon,
> >
> > Just had a chance to add the fix to the branch with a couple commits. Let me know if it causes you any further issues. Thanks for making me aware of the issue - your feedback is really helpful for some changes to make this demo more usable.
> >
> > Regards,
> > Eugenia
> >
> > On Fri, May 29, 2015 at 11:07 AM, Eugenia Gabrielova <ge...@gmail.com> wrote:
> > Sounds like a "feature" (bug) - let me have a look and hotfix that...
> >
> > On Fri, May 29, 2015 at 10:33 AM, Brandon Lim <br...@uci.edu> wrote:
> > Hey Eugenia,
> >
> > I was able to get it to run with my new query and the dataset is inside AsterixDB. I was curious to how I can change the spatial intersect of the query. Even if I put a location in the location box for the query, once I submit the query, it just brings me back to the default spatial area on the East Coast.
> >
> > Best Regards,
> > Brandon Lim
> >
> >
> >
> > On May 28, 2015, at 6:54 PM, Eugenia Gabrielova <ge...@gmail.com> wrote:
> >
> > > It's all good, let me know if you have any issues or questions about the code (or bugs :P so I can fix them)
> > >
> > > On Thu, May 28, 2015 at 6:52 PM, Brandon Lim <br...@uci.edu> wrote:
> > > That worked. I must’ve misspelled it twice because I tried the other day as well. Thanks Eugenia.
> > >
> > > Also, Thanks Ian!
> > >
> > >
> > > Best Regards,
> > > Brandon Lim
> > >
> > >
> > >
> > > On May 28, 2015, at 6:44 PM, Eugenia Gabrielova <ge...@gmail.com> wrote:
> > >
> > > > Hi Brandon,
> > > >
> > > > Looks like you have the pathspec spelled incorrectly ("eugneia")
> > > >
> > > > Try
> > > > $ git checkout eugenia/tweetbook-demo-fixes
> > > >
> > > > On Thu, May 28, 2015 at 6:40 PM, Brandon Lim <br...@uci.edu> wrote:
> > > > Hey Eugenia,
> > > >
> > > > I tried that, but it says
> > > >
> > > > git checkout eugneia/tweetbook-demo-fixes
> > > > error: pathspec 'eugneia/tweetbook-demo-fixes' did not match any file(s) known to git.
> > > >
> > > > When I did
> > > >
> > > > git branch
> > > >
> > > > Only master showed up.
> > > >
> > > > Best Regards,
> > > > Brandon Lim
> > > >
> > > >
> > > >
> > > > On May 28, 2015, at 6:35 PM, Eugenia Gabrielova <ge...@gmail.com> wrote:
> > > >
> > > > > Hi Brandon!
> > > > >
> > > > > Any luck fetching the upstream branch?
> > > > >
> > > > > $ cd path/to/your/sandbox
> > > > > $ git fetch
> > > > > $ git checkout eugenia/tweetbook-demo-fixes
> > > > >
> > > > > Let me know if that works for you.
> > > > >
> > > > > On Wed, May 27, 2015 at 10:13 AM, Brandon Lim <br...@uci.edu> wrote:
> > > > > Hey Ian,
> > > > >
> > > > > When I clicked the download zip or download tar.gz for the branch, it said 404 not found. I couldn’t figure out how to checkout her specific branch. I was only able to checkout the master branch.
> > > > >
> > > > > Best Regards,
> > > > > Brandon Lim
> > > > >
> > > > >
> > > > >
> > > > > On May 26, 2015, at 10:42 AM, Ian Maxon <im...@uci.edu> wrote:
> > > > >
> > > > > > Hey Brandon,
> > > > > >
> > > > > > What seemed to be the issue with checking out/downloading the repository? It should just be a matter of checking out that branch and doing 'mvn clean package -DskipTests'.
> > > > > >
> > > > > > - Ian
> > > > > >
> > > > > > On Tue, May 26, 2015 at 10:02 AM, Brandon Lim <br...@uci.edu> wrote:
> > > > > > Hey Eugenia,
> > > > > >
> > > > > > I wasn’t able to download your up-to-date branch in the sandbox for some reason. Is there another way for me to get access to your most up-to-date TweetBook Demo?
> > > > > >
> > > > > > Best Regards,
> > > > > > Brandon Lim
> > > > > >
> > > > > >
> > > > > >
> > > > > > On May 22, 2015, at 12:17 PM, Eugenia Gabrielova <ge...@gmail.com> wrote:
> > > > > >
> > > > > > > Hi Brandon!
> > > > > > >
> > > > > > > As a heads up, I have a branch in sandbox with some up-to-date changes and fixes on the TweetbookDemo. I'll keep an eye out on this thread if you have any questions, or I can look through code with you on campus if you prefer.
> > > > > > > https://code.google.com/p/asterixdb-sandbox/source/browse/?name=eugenia%2Ftweetbook-demo-fixes#git%2Fasterix-examples%2Fsrc%2Fmain%2Fresources%2Ftweetbook-demo
> > > > > > >
> > > > > > > The longitude shift was just a debugging thing for me when I was playing with spatial queries, to match an older version of the geospatial demo (pre-Tweetbooks). It's not an Asterix-related thing and can easily be removed.
> > > > > > >
> > > > > > > On Fri, May 22, 2015 at 11:41 AM, Ian Maxon <im...@uci.edu> wrote:
> > > > > > > Hi Brandon,
> > > > > > > Interesting. I wasn't quite sure how to solve this initially, but there is a function that does the trick. (however it isn't documented in master!...)
> > > > > > >
> > > > > > > parse-datetime should be able to do the trick. For your example. " parse-datetime("Fri May 11 07:53:00 +0000 2012", "W MMM DD hh:mm:ss z YYYY") " will give the proper AQL object from the string. The first part is (obviously) the date to be parsed. The second is the formatting string, which is not very well documented, but appears to follow Java's convention (https://docs.oracle.com/javase/7/docs/api/java/text/SimpleDateFormat.html) closely.
> > > > > > >
> > > > > > > -Ian
> > > > > > >
> > > > > > > On Fri, May 22, 2015 at 11:01 AM, Brandon Lim <br...@uci.edu> wrote:
> > > > > > > Hey Ian,
> > > > > > >
> > > > > > > Quick question. So I’m trying to align my dataset or how my dataset is handled with the dataset that is currently in use by the TweetBook demo, but one thing is that the TweetBook demo allows it to query based on datetime.
> > > > > > >
> > > > > > > <Screen Shot 2015-05-22 at 10.58.10 AM.png>
> > > > > > > This is what the data for the TweetBook demo looks like. Everything is already preprocessed.
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > This is what my data looks like. Is there an easy way to convert this into datetime?
> > > > > > >
> > > > > > >
> > > > > > > <Screen Shot 2015-05-22 at 11.01.12 AM.png>
> > > > > > > Also, do you know why in the TweetBook demo that the longitude sign bit is flipped?
> > > > > > >
> > > > > > > Best Regards,
> > > > > > > Brandon Lim
> > > > > > >
> > > > > > >
> > > > > >
> > > > > > --
> > > > > > You received this message because you are subscribed to the Google Groups "asterixdb-users" group.
> > > > > > To unsubscribe from this group and stop receiving emails from it, send an email to asterixdb-users+unsubscribe@googlegroups.com.
> > > > > > For more options, visit https://groups.google.com/d/optout.
> > > > > >
> > > > > >
> > > > > > --
> > > > > > You received this message because you are subscribed to the Google Groups "asterixdb-users" group.
> > > > > > To unsubscribe from this group and stop receiving emails from it, send an email to asterixdb-users+unsubscribe@googlegroups.com.
> > > > > > For more options, visit https://groups.google.com/d/optout.
> > > > >
> > > > >
> > > >
> > > >
> > > >
> > > > --
> > > > You received this message because you are subscribed to the Google Groups "asterixdb-users" group.
> > > > To unsubscribe from this group and stop receiving emails from it, send an email to asterixdb-users+unsubscribe@googlegroups.com.
> > > > For more options, visit https://groups.google.com/d/optout.
> > >
> > >
> > >
> > > --
> > > You received this message because you are subscribed to the Google Groups "asterixdb-users" group.
> > > To unsubscribe from this group and stop receiving emails from it, send an email to asterixdb-users+unsubscribe@googlegroups.com.
> > > For more options, visit https://groups.google.com/d/optout.
> >
> >
> >
> >
> > --
> > You received this message because you are subscribed to the Google Groups "asterixdb-users" group.
> > To unsubscribe from this group and stop receiving emails from it, send an email to asterixdb-users+unsubscribe@googlegroups.com.
> > For more options, visit https://groups.google.com/d/optout.
>
>