You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hive.apache.org by ypeng <yp...@t-online.de> on 2022/12/29 09:02:58 UTC
how to disable these kinds of logs in beeline output
Hello,
I issued the simple query in beeline to Hive 3.1, which always gets
multi-lines of unuseful logs such as the following.
0: jdbc:hive2://> select * from books order by price desc limit 30;
22/12/29 16:51:13 [9ae5bf2b-a684-4b3e-9dab-fd2cdc44c5e8 main]: WARN
parse.RowResolver: Found duplicate column alias in RR: books.id => {books,
id, _col0: int} adding books.id => {books, id, _col5: int}
22/12/29 16:51:13 [9ae5bf2b-a684-4b3e-9dab-fd2cdc44c5e8 main]: WARN
parse.RowResolver: Found duplicate column alias in RR: books.name =>
{books, name, _col1: string} adding books.name => {books, name, _col7:
string}
22/12/29 16:51:13 [9ae5bf2b-a684-4b3e-9dab-fd2cdc44c5e8 main]: WARN
parse.RowResolver: Found duplicate column alias in RR: books.lang =>
{books, lang, _col2: struct<eng:int,chn:int>} adding books.lang => {books,
lang, _col9: struct<eng:int,chn:int>}
22/12/29 16:51:13 [9ae5bf2b-a684-4b3e-9dab-fd2cdc44c5e8 main]: WARN
parse.RowResolver: Found duplicate column alias in RR: books.types =>
{books, types, _col3: array<string>} adding books.types => {books, types,
_col11: array<string>}
22/12/29 16:51:13 [9ae5bf2b-a684-4b3e-9dab-fd2cdc44c5e8 main]: WARN
parse.RowResolver: Found duplicate column alias in RR: books.price =>
{books, price, _col4: float} adding books.price => {books, price, _col13:
float}
22/12/29 16:51:14 [HiveServer2-Background-Pool: Thread-64]: WARN ql.Driver:
Hive-on-MR is deprecated in Hive 2 and may not be available in the future
versions. Consider using a different execution engine (i.e. spark, tez) or
using Hive 1.X releases.
Query ID = pyh_20221229165113_c8e5cbf6-6b36-46a5-bd9a-d2ed2108045d
Total jobs = 1
Launching Job 1 out of 1
Number of reduce tasks determined at compile time: 1
In order to change the average load for a reducer (in bytes):
set hive.exec.reducers.bytes.per.reducer=<number>
In order to limit the maximum number of reducers:
set hive.exec.reducers.max=<number>
In order to set a constant number of reducers:
set mapreduce.job.reduces=<number>
22/12/29 16:51:14 [HiveServer2-Background-Pool: Thread-64]: WARN
impl.MetricsSystemImpl: JobTracker metrics system already initialized!
22/12/29 16:51:14 [HiveServer2-Background-Pool: Thread-64]: WARN
mapreduce.JobResourceUploader: Hadoop command-line option parsing not
performed. Implement the Tool interface and execute your application with
ToolRunner to remedy this.
Job running in-process (local Hadoop)
22/12/29 16:51:15 [pool-20-thread-1]: WARN impl.MetricsSystemImpl:
JobTracker metrics system already initialized!
2022-12-29 16:51:16,034 Stage-1 map = 100%, reduce = 100%
Ended Job = job_local124633243_0001
MapReduce Jobs Launched:
Stage-Stage-1: HDFS Read: 54790 HDFS Write: 0 SUCCESS
Total MapReduce CPU Time Spent: 0 msec
OK
How can I disable them entirely? I am already using beeline --silent=true.
Thank you.
Re: how to disable these kinds of logs in beeline output
Posted by Sai Hemanth Gantasala <sa...@cloudera.com>.
Hi ypeng,
Have you tried --showWarnings=false argument?
On Thu, Dec 29, 2022 at 1:03 AM ypeng <yp...@t-online.de> wrote:
> Hello,
>
> I issued the simple query in beeline to Hive 3.1, which always gets
> multi-lines of unuseful logs such as the following.
>
> 0: jdbc:hive2://> select * from books order by price desc limit 30;
>
> 22/12/29 16:51:13 [9ae5bf2b-a684-4b3e-9dab-fd2cdc44c5e8 main]: WARN
> parse.RowResolver: Found duplicate column alias in RR: books.id =>
> {books, id, _col0: int} adding books.id => {books, id, _col5: int}
>
> 22/12/29 16:51:13 [9ae5bf2b-a684-4b3e-9dab-fd2cdc44c5e8 main]: WARN
> parse.RowResolver: Found duplicate column alias in RR: books.name =>
> {books, name, _col1: string} adding books.name => {books, name, _col7:
> string}
>
> 22/12/29 16:51:13 [9ae5bf2b-a684-4b3e-9dab-fd2cdc44c5e8 main]: WARN
> parse.RowResolver: Found duplicate column alias in RR: books.lang =>
> {books, lang, _col2: struct<eng:int,chn:int>} adding books.lang => {books,
> lang, _col9: struct<eng:int,chn:int>}
>
> 22/12/29 16:51:13 [9ae5bf2b-a684-4b3e-9dab-fd2cdc44c5e8 main]: WARN
> parse.RowResolver: Found duplicate column alias in RR: books.types =>
> {books, types, _col3: array<string>} adding books.types => {books, types,
> _col11: array<string>}
>
> 22/12/29 16:51:13 [9ae5bf2b-a684-4b3e-9dab-fd2cdc44c5e8 main]: WARN
> parse.RowResolver: Found duplicate column alias in RR: books.price =>
> {books, price, _col4: float} adding books.price => {books, price, _col13:
> float}
>
> 22/12/29 16:51:14 [HiveServer2-Background-Pool: Thread-64]: WARN
> ql.Driver: Hive-on-MR is deprecated in Hive 2 and may not be available in
> the future versions. Consider using a different execution engine (i.e.
> spark, tez) or using Hive 1.X releases.
>
> Query ID = pyh_20221229165113_c8e5cbf6-6b36-46a5-bd9a-d2ed2108045d
>
> Total jobs = 1
>
> Launching Job 1 out of 1
>
> Number of reduce tasks determined at compile time: 1
>
> In order to change the average load for a reducer (in bytes):
>
> set hive.exec.reducers.bytes.per.reducer=<number>
>
> In order to limit the maximum number of reducers:
>
> set hive.exec.reducers.max=<number>
>
> In order to set a constant number of reducers:
>
> set mapreduce.job.reduces=<number>
>
> 22/12/29 16:51:14 [HiveServer2-Background-Pool: Thread-64]: WARN
> impl.MetricsSystemImpl: JobTracker metrics system already initialized!
>
> 22/12/29 16:51:14 [HiveServer2-Background-Pool: Thread-64]: WARN
> mapreduce.JobResourceUploader: Hadoop command-line option parsing not
> performed. Implement the Tool interface and execute your application with
> ToolRunner to remedy this.
>
> Job running in-process (local Hadoop)
>
> 22/12/29 16:51:15 [pool-20-thread-1]: WARN impl.MetricsSystemImpl:
> JobTracker metrics system already initialized!
>
> 2022-12-29 16:51:16,034 Stage-1 map = 100%, reduce = 100%
>
> Ended Job = job_local124633243_0001
>
> MapReduce Jobs Launched:
>
> Stage-Stage-1: HDFS Read: 54790 HDFS Write: 0 SUCCESS
>
> Total MapReduce CPU Time Spent: 0 msec
>
> OK
>
>
>
>
> How can I disable them entirely? I am already using beeline --silent=true.
>
>
> Thank you.
>
>
>