HiverServer2 Logging

[Dima Machlin <Di...@pursway.com>]

Hey,
We are considering to start using HiveServer2 and its seems that the logging capabilities are really limited as the server runs on a single port.
I'll explain the problem more accurately :
Today, we are using HiveServer where each user gets a specific port (or a set of ports) then, we start X hiveservers , 1 for each port in the following manner

nohup hive --service hiveserver -p $2 -v --hiveconf hive.root.logger=INFO,console >> ~/hive.$2 2>&1 &
For example :
nohup hive --service hiveserver -p 12354 -v --hiveconf hive.root.logger=INFO,console >> ~/hive.12354 2>&1 &

This way, hiveserver runs in the background, the logging is redirected to the "console" but then its redirected to a file.
So each port has its own log file, assuming there are no concurrent executions on the same port, each file is a sequential execution log.

This is really convenient to debugging executions on the HiveServer as the full stacktrace isn't passed through the JDBC and mostly we get a "MapredTask" error
The full errors are found in the logs and debugging is easy.

Now in the HiveServer2, I couldn't find any way to separate  the logging per session.
In fact i see that there is a Jira<https://issues.apache.org/jira/browse/HIVE-5924> open for this issue.

Is there any work around for this? I want each session / connection in its own log file, higher resolution is also acceptable (like a log per session)
In fact, looking at hive-exec-log4j.properties it seems that logging is per query :
hive.log.file=${hive.query.id}.log
But this is a different log full with counter data / task progress when i'm looking for the standard logging as seem in the CLI.
I think that this is defined by hive.log.file in hive-log4j.properties which is set to :
hive.log.file=hive.log
Trying to set it also as the previous doesn't help as ${hive.query.id} resolves to nothing.

Any advice appreciated.

-----------------------------------------------
[cid:image001.jpg@01CE92B5.CB034C90]
Dima Machlin, Big Data Architect
Pursway.com<http://www.pursway.com/>