You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@hop.apache.org by "Visal-Som30 (via GitHub)" <gi...@apache.org> on 2025/02/18 09:03:18 UTC
[D] Deployment Process in production in Apache Hop (hop)
GitHub user Visal-Som30 created a discussion: Deployment Process in production in Apache Hop
Hello Apache Hop team,
I'm a beginner to Apache Hop. My company wants me to deploy Apache Hop on-premise in production. Can you explain me about deployment process? (e.g. standalone or cluster, hardware requirements, configuration, ...)
Thank you in advance.
GitHub link: https://github.com/apache/hop/discussions/4919
----
This is an automatically sent email for users@hop.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@hop.apache.org
Re: [D] Deployment Process in production in Apache Hop (hop)
Posted by "bamaer (via GitHub)" <gi...@apache.org>.
GitHub user bamaer added a comment to the discussion: Deployment Process in production in Apache Hop
@Visal-Som30 deployment is a large topic, and there are a lot of factors that have an impact on what the best architectures and deployment strategies are for your particular use case.
We recently published a [white paper](https://www.know.bi/form-download-build-deploy-white-paper) that should help to get you started.
GitHub link: https://github.com/apache/hop/discussions/4919#discussioncomment-12234575
----
This is an automatically sent email for users@hop.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@hop.apache.org
Re: [D] Deployment Process in production in Apache Hop (hop)
Posted by "bamaer (via GitHub)" <gi...@apache.org>.
GitHub user bamaer added a comment to the discussion: Deployment Process in production in Apache Hop
you're right, it does depend on a lot of factors. With the default memory allocation of 2GB, you could go as low as e.g. a 2 CPU/core machine with 8GB RAM (probably even lower), but it all depends on your use cases, the volume of data you need to process and what your (workflows and) pipelines look like. What makes sense in one use case could be nonsense in another one.
GitHub link: https://github.com/apache/hop/discussions/4919#discussioncomment-12259151
----
This is an automatically sent email for users@hop.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@hop.apache.org
Re: [D] Deployment Process in production in Apache Hop (hop)
Posted by "liosc (via GitHub)" <gi...@apache.org>.
GitHub user liosc added a comment to the discussion: Deployment Process in production in Apache Hop
Hi @Visal-Som30 , first of all, as you are a beginner, welcome to Hop community. Second, I would like to share with you my personal thought: as you are a beginner and your company asked to deploy Apache Hop in production, have you already thought about getting professional support from an experienced company or consultant? Just to be sure to start in the right direction. We, as a community, are here to help each other but from being a beginner to deploy in production the leap could be dangerous. Just my personal opinion.
GitHub link: https://github.com/apache/hop/discussions/4919#discussioncomment-12234209
----
This is an automatically sent email for users@hop.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@hop.apache.org
Re: [D] Deployment Process in production in Apache Hop (hop)
Posted by "Visal-Som30 (via GitHub)" <gi...@apache.org>.
GitHub user Visal-Som30 added a comment to the discussion: Deployment Process in production in Apache Hop
Hello Sir,
I want to deploy Apache Hop Server on-premises, can you recommend hardware requirement? I know that it depends on a lot of factors, but just give a common one that most Apace Hop users use.
Best regards,
GitHub link: https://github.com/apache/hop/discussions/4919#discussioncomment-12257725
----
This is an automatically sent email for users@hop.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@hop.apache.org
Re: [D] Deployment Process in production in Apache Hop (hop)
Posted by "Visal-Som30 (via GitHub)" <gi...@apache.org>.
GitHub user Visal-Som30 added a comment to the discussion: Deployment Process in production in Apache Hop
Thank you so much for this informative answer, sir.
GitHub link: https://github.com/apache/hop/discussions/4919#discussioncomment-12259468
----
This is an automatically sent email for users@hop.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@hop.apache.org
Re: [D] Deployment Process in production in Apache Hop (hop)
Posted by "Visal-Som30 (via GitHub)" <gi...@apache.org>.
GitHub user Visal-Som30 added a comment to the discussion: Deployment Process in production in Apache Hop
Thanks for this informative answer. Anyway If I have more questions, can I ask?
GitHub link: https://github.com/apache/hop/discussions/4919#discussioncomment-12234718
----
This is an automatically sent email for users@hop.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@hop.apache.org
Re: [D] Deployment Process in production in Apache Hop (hop)
Posted by "bamaer (via GitHub)" <gi...@apache.org>.
GitHub user bamaer added a comment to the discussion: Deployment Process in production in Apache Hop
Hop Server doesn't support distributed execution. You could set up some distribution framework yourself, but for real distributed processing, you could look at the Apache Beam pipeline run configurations to run on Apache Spark or Google Dataflow. The very low machine configurations I mentioned earlier won't be enough for those clusters hosts though. It all depends on a lot of factors ;-)
GitHub link: https://github.com/apache/hop/discussions/4919#discussioncomment-12259376
----
This is an automatically sent email for users@hop.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@hop.apache.org
Re: [D] Deployment Process in production in Apache Hop (hop)
Posted by "Visal-Som30 (via GitHub)" <gi...@apache.org>.
GitHub user Visal-Som30 added a comment to the discussion: Deployment Process in production in Apache Hop
Sir, I have another question. If I deploy my Apache Hop, I need only one server and then I just change metadata environments, right? But If I deploy Apache Hop that can distribute execution so I need multiple servers, right?
GitHub link: https://github.com/apache/hop/discussions/4919#discussioncomment-12259262
----
This is an automatically sent email for users@hop.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@hop.apache.org
Re: [D] Deployment Process in production in Apache Hop (hop)
Posted by "liosc (via GitHub)" <gi...@apache.org>.
GitHub user liosc added a comment to the discussion: Deployment Process in production in Apache Hop
I am not a deployment expert, sorry. I'm more focused on process analysis and development. I just wanted to share with you my advice based on what I saw in the field. Anyway, welcome again.
GitHub link: https://github.com/apache/hop/discussions/4919#discussioncomment-12234517
----
This is an automatically sent email for users@hop.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@hop.apache.org
Re: [D] Deployment Process in production in Apache Hop (hop)
Posted by "Visal-Som30 (via GitHub)" <gi...@apache.org>.
GitHub user Visal-Som30 added a comment to the discussion: Deployment Process in production in Apache Hop
I have my technical manager for support, but he wants me to research more about this deployment, so can you explain me about it?
GitHub link: https://github.com/apache/hop/discussions/4919#discussioncomment-12234376
----
This is an automatically sent email for users@hop.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@hop.apache.org
Re: [D] Deployment Process in production in Apache Hop (hop)
Posted by "bamaer (via GitHub)" <gi...@apache.org>.
GitHub user bamaer added a comment to the discussion: Deployment Process in production in Apache Hop
of course, that's what these discussions are for.
GitHub link: https://github.com/apache/hop/discussions/4919#discussioncomment-12234937
----
This is an automatically sent email for users@hop.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@hop.apache.org