You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-commits@hadoop.apache.org by Apache Wiki <wi...@apache.org> on 2007/07/02 11:00:47 UTC

[Lucene-hadoop Wiki] Trivial Update of "HbaseShell" by udanax

Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Lucene-hadoop Wiki" for change notification.

The following page has been changed by udanax:
http://wiki.apache.org/lucene-hadoop/HbaseShell

------------------------------------------------------------------------------
  
  
  ----
- = Hbase Shell Syntax Definition =
+ = Hbase Shell Client Syntax Definition =
  '''Note''' that Data should be located by their row, column, and timestamp.
  
- == Basic Commands ==
+ == Commands ==
  ||<bgcolor="#ececec">'''Command''' ||<bgcolor="#ececec">'''Explanation''' ||
  ||HELP ||<99%>'''Help''' command provides information about the use of shell script.[[BR]][[BR]]~-''HELP [function_name];''-~ ||
  ||SHOW ||<99%>'''Show''' command will list the tables.[[BR]][[BR]]~-''SHOW tables;''-~ ||
  ||DESC ||'''Desc''' command will provides information about the columnfamilies in a table.[[BR]][[BR]]~-''DESC table_name;''-~ ||
  ||CREATE ||'''Create''' command will create a new table.[[BR]][[BR]]~-''CREATE table_name[[BR]]COLUMNFAMILIES('columnfamily_name1'[, 'columnfamily_name2', ...])[[BR]][LIMIT=limitNumber_of_Version];''-~ ||
  ||DROP ||'''Drop''' command will droping columnfamilies in a table or tables.[[BR]][[BR]]~-''DROP table_name1[, table_name2, ...] or columnfamily_name1[, columnfamily_name2, ...];''-~ ||
- ||SUBSTITUTE[[BR]] || '''Substitute''' query to [A~Z][[BR]][[BR]]~-''X = MAPSET('table_name', 'columnfamily_name');''-~||
+ ||SUBSTITUTE[[BR]] || '''Substitute''' query to [A~Z][[BR]][[BR]]~-''X = Matrix(table_name, columnfamily_name);''-~||
+ ||STORE ||'''STORE''' command will store results to specified table. [[BR]][[BR]]~-''A = Table('movieLog_table'); [[BR]]B = A.Selection('length' > 100); [[BR]]STORE B TO X run_style;''-~ ||
- ||MAPSET || '''Map Set''' ||
- ||ARRAY || '''Array''' ||
- ||MATRIX || '''Matrix''' ||
- ||VECTOR || '''Vector''' ||
- ||PRINT ||'''Print''' command will print a results to the console output. [[BR]][[BR]]~-''A = ARRAY([1, 2, 3]);[[BR]]PRINT A;[[BR]]B = SELECT table_name WHERE row='row_key';[[BR]]PRINT B;''-~ ||
- ||STORE ||'''STORE''' command will store results to specified table. [[BR]][[BR]]~-''M = matrix('table_name','columnfamily_name');[[BR]]A = array([[1, 2],[3, 4]]); //In this case, Key should be an integer index. [[BR]]STORE A TO M run_style;[[BR]]B = SELECT table_name WHERE row='row_key';[[BR]]STORE B TO ('table_name','columnfamily_name1'[, 'columnfamily_name2']) run_style;''-~ ||
  ||EXIT ||<99%>'''Exit''' from the current shell script.[[BR]][[BR]]~-''EXIT;''-~ ||
  And, Commands to manually manipulate data on more detailed parts.
  ||<bgcolor="#ececec">'''Command''' ||<bgcolor="#ececec">'''Explanation''' ||
- ||INSERT ||<99%>'''Insert''' command will insert one row into the table with a value for specified column in the table.[[BR]][[BR]]~-''INSERT table_name[[BR]] VALUES('columnfamily_name:column_key','entry')[[BR]]WHERE row='row_key';''-~ ||
+ ||INSERT ||<99%>'''Insert''' command will insert one row into the table with a value for specified column in the table.[[BR]][[BR]]~-''INSERT table_name ('columnfamily_name1:column_key'[, 'columnfamily_name2:column_key', ...])[[BR]] VALUESVALUES ('entry1'[, 'entry2', ...])[[BR]]WHERE row='row_key';''-~ ||
  ||SET ||'''SET''' command will change the values. [[BR]][[BR]]~-''SET table_name[[BR]] VALUES('columnfamily_name:column_key','entry')[[BR]]WHERE row='row_key' AND time='Specified_Timestamp';''-~ ||
  ||DELETE ||'''Delete''' command will delete specified rows in table. [[BR]][[BR]]~-''DELETE table_name[[BR]]WHERE row='row_key'[[BR]][AND column='columnfamily_name:column_key'];''-~ ||
  ||SELECT ||<99%>'''Select''' command will retrieves rows from a table.[[BR]][[BR]]~-''SELECT table_name[[BR]][WHERE row='row_key'][[BR]][AND column='columnfamily_name:column_key'];[[BR]][AND time='Specified_Timestamp'];[[BR]][LIMIT=Number_of_Version];''-~ ||
  
- === Relational Algebra Operators ===
+ == Relational Operations ==
- Set Operations..
+ 
  ||<bgcolor="#ececec">'''Operators''' ||<bgcolor="#ececec">'''Explanation''' ||
+ ||PROJECTION||<99%>is defined as the set that is obtained when all tuples in ~+R+~ are restricted to the set {a,,1,,,...,a,,n,,}.||
- ||UNION||<99%>'''Union''' A∪B contains all the elements of A and it contains all the elements of B.||
- ||INTERSECTION||<99%>'''Intersection''' A∩B is a subset of A and it is a subset of B.||
- ||DIFFERENCE||<99%>'''Difference''' of A and B (A-B).||
- 
- 
- A = MAPSET(table_T, columnfamily_A);[[BR]]
- B = MAPSET(table_T, columnfamily_B);[[BR]]
- 
- C = A.Union(B);[[BR]]
- C = A.Intersection(B);[[BR]]
- C = A.Difference(B);
- 
- ||<bgcolor="#ececec">'''Operators''' ||<bgcolor="#ececec">'''Explanation''' ||
- ||PROJECTION||<99%>...||
  ||SELECTION||<99%>...||
  ||PRODUCT||<99%>...||
- ||RENAMING||<99%>...||
+ ||RENAME||<99%>'''Rename''' r to x||
- ||GROUPING||<99%>...||
+ ||GROUP||<99%>...||
  ||SORT||<99%>...||
  
  
+ ||<bgcolor="#ececec">'''Operators''' ||<bgcolor="#ececec">'''Explanation''' ||
+ ||UNION ||<99%>'''Union''' A∪B contains all the elements of A and it contains all the elements of B.||
+ ||INTERSECTION ||<99%>'''Intersection''' A∩B is a subset of A and it is a subset of B.||
+ ||DIFFERENCE ||'''Difference''' of A and B (A-B).||
- A.Projection('year','length');[[BR]]
- A.Selection('length' > 100);
- 
- 
- === Aggregation Functions ===
  
  ||<bgcolor="#ececec">'''Functions''' ||<bgcolor="#ececec">'''Explanation''' ||
  ||AVG ||<99%>...||
@@ -107, +88 @@

  ||MIN ||<99%>...||
  ||MAX ||<99%>...||
  
- The Matrix commands are used to store a 2D array of numerical data values. [[BR]]A number of routines are provided to manipulate the matrix object directly, illustrated below by simple examples.
- 
- '''Note''' that vectors should be defined as two-dimensional matrices to distinguish between row and column vectors [[BR]]in order to be able to perform matrix operations consistently.
- 
- === Matrix Construction Functions ===
- ..
- 
- === Matrix Algebra Functions ===
+ == Matrix Operations ==
- ..
  
- === Special functions ===
- ..
+ ||<bgcolor="#ececec">'''Operation''' ||<bgcolor="#ececec">'''Explanation''' ||
+ ||DOUBLEMATRIX||<99%>...||
+ ||BOOLEANMATRIX||<99%>...||
+ 
+ ||<bgcolor="#ececec">'''Functions''' ||<bgcolor="#ececec">'''Explanation''' ||
+ ||QR ||<99%>...||
+ ||LU||<99%>...||
+ ||SVD ||<99%>...||
+ 
  ----
  = Example Of Hbase Shell Use =
  == Basic Usage ==
  
- {{{
+ === Create the table in a HBase ===
+ 
- Hbase > CREATE movieLog_table 
+ ~-''CREATE movieLog_table
-     --> COLUMNFAMILIES('year','length','inColor','studioName',vote','producer') 
+ [[BR]]COLUMNFAMILIES('year', 'length', 'inColor', 'studioName', 'vote', 'producer')
-     --> limit=10;
+ [[BR]]LIMIT=1;''-~ 
  
- }}}
+ === Insert data into a table ===
+ ~-''INSERT table_name ('year:', 'length:', 'inColor:', 'studioName:', 'vote:user_1', 'producer')
+ [[BR]]VALUES ('1977', '124', 'true', 'Fox', '5', 'George Lucas')
+ [[BR]]WHERE row='Star Wars';''-~ 
  
- '''movieLog_table'''
+ === Show all data in a table ===
+ ~-''SELECT movieLog_table;''-~ 
+ 
  ||Row Key ||<-12>Column Families ||
- ||<rowbgcolor="#ececec">title   ||<-2> year ||<-2>length ||<-2>inColor ||<-2> studioName ||<-2> vote ||<-2> producer ||
+ ||<rowbgcolor="#ececec">title ||<-2> year ||<-2>length ||<-2>inColor ||<-2> studioName ||<-2> vote ||<-2> producer ||
  ||Star Wars ||year: || 1977 ||length: || 124 ||inColor: || true ||studioName: || Fox || vote:''user_1'' || 5 || producer: || George Lucas ||
  || || || || || || || || || || vote:''user_2'' || 2 || || ||
  ||Mighty Ducks ||year: || 1991 ||length: || 104 ||inColor: || true ||studioName: || Disney || vote:''user_1'' || 2 || producer: || Blair Peters ||
@@ -141, +127 @@

  || || || || || || || || || || vote:''user_3'' || 4 || || ||
  
  
- == Relation Algebra Operations ==
+ == Relation Operations ==
  
- '''Projection'''
+ === Projection ===
+ 
+ ~-''A = Table('movieLog_table');
+ [[BR]]B = A.Projection('year','length');''-~
  
  '''~+^π^+~'''~-title-~,~-year-~,~-length-~'''~+^(movieLog_table)^+~'''
  
@@ -154, +143 @@

  
  
  
- '''Selection'''
+ === Selection ===
+ 
+ ~-''A = Table('movieLog_table');
+ [[BR]]B = A.Selection('length' > 100);''-~
  
  '''~+^σ^+~'''~-length>100-~'''~+^(movieLog_table)^+~'''
  
@@ -163, +155 @@

  ||Mighty Ducks ||1991 ||104 ||true ||Disney ||67890 ||
  
  
- '''Example'''
+ === Example ===
  
+ ~-''A = Table('movieLog_table');
+ [[BR]]B = A.Selection(length > 100 AND studioName = 'Fox');
+ [[BR]]C = B.Projection('year');''-~
+ 
- '''~+^π^+~'''~-title-~,~-year-~'''~+^σ^+~'''~-length>100-~'''~+^(movieLog_table)∩σ^+~'''~-studioName='Fox'-~'''~+^(movieLog_table))^+~'''
+ '''~+^π^+~'''~-title-~,~-year-~'''~+^(σ^+~'''~-length>100-~'''~+^(movieLog_table)∩σ^+~'''~-studioName='Fox'-~'''~+^(movieLog_table))^+~'''
+ 
+ ||<rowbgcolor="#ececec">title ||year ||
+ ||Star Wars ||1977 ||
  
  == Matrix Operations ==
- {{{
- Hbase > A = matrix('movieLog_table', 'vote');
  
- Hbase > PRINT A;
- }}}
+ Lets construct a abstract sparse row-by-column matrix.
+ 
+ ~-''A = doubleMatrix('movieLog_table','vote');''-~
  
  ||<rowbgcolor="#ececec"> ||user_1 ||user_2 ||user_3 ||
- ||<bgcolor="#ececec">Star Wars || 5 || 2 || 0 ||
+ ||<bgcolor="#ececec">Star Wars || 5.0 || 2.0 ||   ||
- ||<bgcolor="#ececec">Mighty Ducks || 2 || 0 || 4 ||
+ ||<bgcolor="#ececec">Mighty Ducks || 2.0 ||   || 4.0 ||
- ||<bgcolor="#ececec">Wayne's World || 0 || 3 || 4 ||
+ ||<bgcolor="#ececec">Wayne's World ||   || 3.0 || 4.0 ||
+ 
  
  ----
  = Matrix Extension Example On Hbase Shell =
@@ -194, +193 @@

  
  
  == Scalable Collaborative Filtering With A Large User-By-Item Matrix ==
- ..
+ 
+ Title-By-Title Triangular Matrix 
+ 
+ ||<rowbgcolor="#ececec"> ||Star Wars  ||Mighty Ducks ||Wayne's World ||
+ ||<bgcolor="#ececec">Star Wars ||   || 0.415 || 0.222 ||
+ ||<bgcolor="#ececec">Mighty Ducks ||   ||   || 0.715 ||
+ ||<bgcolor="#ececec">Wayne's World ||   ||   ||   ||
+ 
  
  == Consistency Assessment Of Topological Relationship By Matrix-Union ==
  ..
+ 
+ ----
+ = Performance Reports =
+ ..
+ 
  ----
  = People Involved =