You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@linkis.apache.org by rita <ri...@163.com> on 2022/08/31 08:07:16 UTC
[DISCUSS]Separator of Hive query results
Dear:
Wechat group "Apache Linkis community Development group "chat records are as follows: 微信群"Apache Linkis 社区开发群"的聊天记录如下:
————— 2022-8-25 —————
hcl 12:08
这里的分隔符是写死的吗@Enjoyyin_尹强@WDS @peacewong@WDS
Is the delimiter here written dead @enjoyyin_Yoon Qiang@wds @peacewong@WDS
peacewong@WDS 12:28
这个是0.x的吧?
This is 0. X, right?
peacewong@WDS 12:29
hive查询的结果就是制表符分割的
Hive query results are separated by tabs
hcl 13:57
如果字段内容中包含\t呢
What if the contents of the field contain \t
r@FY2 13:58
下面抛了异常
I threw an exception down here
hcl 14:08
不能正常处理吗。。
Can't handle it properly..
hcl 14:10
jdbc查询是ok的
The JDBC query is OK
r@FY2 14:10
自己手动改一下吧[捂脸]
Change it yourself manually. [Facepalm]
hcl 14:13
外部表分隔符,用户自定义的,千奇百怪了。
External table delimiters, user - defined, all kinds of strange.
r@FY2 14:15
这个只是对result的切分吧,linkis默认是制表符,split之前把制表符去掉,sendResult不就正常了吗
Linkis is TAB by default. If TAB is removed before split, sendResult will be normal, right
peacewong@WDS 14:40
是的,这个和表分隔符没关系的。 Yes, this has nothing to do with table separators.是列数据里面如果有制表符会导致数据列异常的
Is column data if there is a TAB character will cause data column exception
hcl 15:15
ok,懂了
Ok, got it
hcl 15:37
通过修改 hive.fetch.output.serde 是不是就可以修改序列化的方式。
You can modify the serialization mode by modifying Hive.fetch.output. serde.
peacewong@WDS 15:41
是的,1.0也加了这个功能
Yes, 1.0 also added this feature
hcl 15:48
如果设置成多分隔符的话,他应该会获取表的信息,根据表的分隔符进行序列化吧。 If set to multiple delimiters, it should fetch the table's information and serialize it according to the table's delimiter.