You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@kvrocks.apache.org by "ltagliamonte-dd (via GitHub)" <gi...@apache.org> on 2024/08/23 16:34:54 UTC

[D] Input/output error [kvrocks]

GitHub user ltagliamonte-dd created a discussion: Input/output error

Hello Folks!
I'm recording this error in my app:
```
{
  "message":        "time=2024-08-23T12:55:29.868Z level=ERROR msg=\"Error running HSET command during batch load\" error=\"response returned from Conn: ERR IO error: While pread offset 691867648 len 16319: /data/kvrocks/db/027707.sst: Input/output error\""
}
```

the Kvrock instance seems healthy I don't see any sign of stress, would appreciate if anyone has any insight on how to troubleshoot this.

GitHub link: https://github.com/apache/kvrocks/discussions/2503

----
This is an automatically sent email for issues@kvrocks.apache.org.
To unsubscribe, please send an email to: issues-unsubscribe@kvrocks.apache.org

Re: [D] Input/output error [kvrocks]

Posted by "git-hulk (via GitHub)" <gi...@apache.org>.

GitHub user git-hulk added a comment to the discussion: Input/output error

Hi @ltagliamonte-dd, this seems a hardware issue. Could you please have a check at your system message via `dmesg`?

GitHub link: https://github.com/apache/kvrocks/discussions/2503#discussioncomment-10437369

----
This is an automatically sent email for issues@kvrocks.apache.org.
To unsubscribe, please send an email to: issues-unsubscribe@kvrocks.apache.org

Re: [D] Input/output error [kvrocks]

Posted by "ltagliamonte-dd (via GitHub)" <gi...@apache.org>.

GitHub user ltagliamonte-dd added a comment to the discussion: Input/output error

Hello @git-hulk , thanks but unfortunately this was running in a docker container in k8s and the node has been reclaimed.
Will make sure to add an alert for this and investigate further next time this happens.

GitHub link: https://github.com/apache/kvrocks/discussions/2503#discussioncomment-10438162

----
This is an automatically sent email for issues@kvrocks.apache.org.
To unsubscribe, please send an email to: issues-unsubscribe@kvrocks.apache.org

Re: [D] Input/output error [kvrocks]

Posted by "git-hulk (via GitHub)" <gi...@apache.org>.

GitHub user git-hulk added a comment to the discussion: Input/output error

Sure, you can check the Kubernetes node message if you know it's running on which one.

GitHub link: https://github.com/apache/kvrocks/discussions/2503#discussioncomment-10440668

----
This is an automatically sent email for issues@kvrocks.apache.org.
To unsubscribe, please send an email to: issues-unsubscribe@kvrocks.apache.org