You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@bigtop.apache.org by "Kengo Seki (Jira)" <ji...@apache.org> on 2020/11/06 01:55:00 UTC
[jira] [Updated] (BIGTOP-3441) Suppress YCSB smoke test output
[ https://issues.apache.org/jira/browse/BIGTOP-3441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Kengo Seki updated BIGTOP-3441:
-------------------------------
Description:
Currently, YCSB smoke test runs {{ycsb}} with the {{-s}} option, which outputs processing status to a file, and its size can be over 500MB.
It's not so huge for general environments, but our CI servers for x86_64 have only 8GB as a root volume.
They store test results under /home/jenkins/workspaces on the root volume for each distro, so the total size can be 3GB+. It easily runs short of their disk.
I'm planning to extend their root volume in the near future, but I'd like to suppress the output as a workaround for now.
{code:java}
[jenkins@ip-172-31-8-128 ~]$ df -h /
Filesystem Size Used Avail Use% Mounted on
/dev/xvda1 8.0G 7.2G 883M 90% /
[jenkins@ip-172-31-8-128 ~]$ find /home/jenkins/workspace -size +500M
/home/jenkins/workspace/Bigtop-trunk-smoke-tests/COMPONENTS/hdfs.hbase.hbase.ycsb@ycsb/OS/centos-8-x86_64-deploy/smoke-tests/ycsb/load_basic.dat
/home/jenkins/workspace/Bigtop-trunk-smoke-tests/COMPONENTS/hdfs.hbase.hbase.ycsb@ycsb/OS/fedora-31-x86_64-deploy/smoke-tests/ycsb/load_basic.dat
/home/jenkins/workspace/Bigtop-trunk-smoke-tests/COMPONENTS/hdfs.hbase.hbase.ycsb@ycsb/OS/ubuntu-16.04-amd64-deploy/smoke-tests/ycsb/load_basic.dat
/home/jenkins/workspace/Bigtop-trunk-smoke-tests/COMPONENTS/hdfs.hbase.hbase.ycsb@ycsb/OS/debian-9-amd64-deploy/smoke-tests/ycsb/load_basic.dat
/home/jenkins/workspace/Bigtop-trunk-smoke-tests/COMPONENTS/hdfs.hbase.hbase.ycsb@ycsb/OS/debian-10-amd64-deploy/smoke-tests/ycsb/load_basic.dat
/home/jenkins/workspace/Bigtop-trunk-smoke-tests/COMPONENTS/hdfs.hbase.hbase.ycsb@ycsb/OS/centos-7-x86_64-deploy/smoke-tests/ycsb/load_basic.dat
{code}
was:
Currently, YCSB smoke test runs {{ycsb}} with the {{-s}} option, which outputs processing status to a file, and its size can be over 500GB.
It's not so huge for general environments, but our CI servers for x86_64 have only 8GB as a root volume.
They store test results under /home/jenkins/workspaces on the root volume for each distro, so the total size can be 3GB+. It easily runs short of their disk.
I'm planning to extend their root volume in the near future, but I'd like to suppress the output as a workaround for now.
{code:java}
[jenkins@ip-172-31-8-128 ~]$ df -h /
Filesystem Size Used Avail Use% Mounted on
/dev/xvda1 8.0G 7.2G 883M 90% /
[jenkins@ip-172-31-8-128 ~]$ find /home/jenkins/workspace -size +500M
/home/jenkins/workspace/Bigtop-trunk-smoke-tests/COMPONENTS/hdfs.hbase.hbase.ycsb@ycsb/OS/centos-8-x86_64-deploy/smoke-tests/ycsb/load_basic.dat
/home/jenkins/workspace/Bigtop-trunk-smoke-tests/COMPONENTS/hdfs.hbase.hbase.ycsb@ycsb/OS/fedora-31-x86_64-deploy/smoke-tests/ycsb/load_basic.dat
/home/jenkins/workspace/Bigtop-trunk-smoke-tests/COMPONENTS/hdfs.hbase.hbase.ycsb@ycsb/OS/ubuntu-16.04-amd64-deploy/smoke-tests/ycsb/load_basic.dat
/home/jenkins/workspace/Bigtop-trunk-smoke-tests/COMPONENTS/hdfs.hbase.hbase.ycsb@ycsb/OS/debian-9-amd64-deploy/smoke-tests/ycsb/load_basic.dat
/home/jenkins/workspace/Bigtop-trunk-smoke-tests/COMPONENTS/hdfs.hbase.hbase.ycsb@ycsb/OS/debian-10-amd64-deploy/smoke-tests/ycsb/load_basic.dat
/home/jenkins/workspace/Bigtop-trunk-smoke-tests/COMPONENTS/hdfs.hbase.hbase.ycsb@ycsb/OS/centos-7-x86_64-deploy/smoke-tests/ycsb/load_basic.dat
{code}
> Suppress YCSB smoke test output
> -------------------------------
>
> Key: BIGTOP-3441
> URL: https://issues.apache.org/jira/browse/BIGTOP-3441
> Project: Bigtop
> Issue Type: Improvement
> Components: tests
> Reporter: Kengo Seki
> Assignee: Kengo Seki
> Priority: Major
> Fix For: 1.5.0
>
> Time Spent: 10m
> Remaining Estimate: 0h
>
> Currently, YCSB smoke test runs {{ycsb}} with the {{-s}} option, which outputs processing status to a file, and its size can be over 500MB.
> It's not so huge for general environments, but our CI servers for x86_64 have only 8GB as a root volume.
> They store test results under /home/jenkins/workspaces on the root volume for each distro, so the total size can be 3GB+. It easily runs short of their disk.
> I'm planning to extend their root volume in the near future, but I'd like to suppress the output as a workaround for now.
> {code:java}
> [jenkins@ip-172-31-8-128 ~]$ df -h /
> Filesystem Size Used Avail Use% Mounted on
> /dev/xvda1 8.0G 7.2G 883M 90% /
> [jenkins@ip-172-31-8-128 ~]$ find /home/jenkins/workspace -size +500M
> /home/jenkins/workspace/Bigtop-trunk-smoke-tests/COMPONENTS/hdfs.hbase.hbase.ycsb@ycsb/OS/centos-8-x86_64-deploy/smoke-tests/ycsb/load_basic.dat
> /home/jenkins/workspace/Bigtop-trunk-smoke-tests/COMPONENTS/hdfs.hbase.hbase.ycsb@ycsb/OS/fedora-31-x86_64-deploy/smoke-tests/ycsb/load_basic.dat
> /home/jenkins/workspace/Bigtop-trunk-smoke-tests/COMPONENTS/hdfs.hbase.hbase.ycsb@ycsb/OS/ubuntu-16.04-amd64-deploy/smoke-tests/ycsb/load_basic.dat
> /home/jenkins/workspace/Bigtop-trunk-smoke-tests/COMPONENTS/hdfs.hbase.hbase.ycsb@ycsb/OS/debian-9-amd64-deploy/smoke-tests/ycsb/load_basic.dat
> /home/jenkins/workspace/Bigtop-trunk-smoke-tests/COMPONENTS/hdfs.hbase.hbase.ycsb@ycsb/OS/debian-10-amd64-deploy/smoke-tests/ycsb/load_basic.dat
> /home/jenkins/workspace/Bigtop-trunk-smoke-tests/COMPONENTS/hdfs.hbase.hbase.ycsb@ycsb/OS/centos-7-x86_64-deploy/smoke-tests/ycsb/load_basic.dat
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)