You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@sqoop.apache.org by Abraham Elmahrek <ab...@cloudera.com> on 2015/05/21 00:55:47 UTC
Review Request 34507: Sqoop2: Create annotation and base class
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/34507/
-----------------------------------------------------------
Review request for Sqoop.
Bugs: SQOOP-2365
https://issues.apache.org/jira/browse/SQOOP-2365
Repository: sqoop-sqoop2
Description
-------
commit bd1fbb96d76cea7ec1a3039b73aa9553576166f1
Author: Abraham Elmahrek <ab...@apache.org>
Date: Fri May 15 16:10:17 2015 -0700
SQOOP-2364: Sqoop2: Provide test infrastructure base class for server tests
:000000 100644 0000000... f3db7ad... A test/src/main/java/org/apache/sqoop/test/infrastructure/Infrastructure.java
:000000 100644 0000000... 6fb1eac... A test/src/main/java/org/apache/sqoop/test/infrastructure/SqoopTestCase.java
:000000 100644 0000000... 5b4f595... A test/src/main/java/org/apache/sqoop/test/infrastructure/providers/SqoopInfrastructureProvider.java
Diffs
-----
test/src/main/java/org/apache/sqoop/test/infrastructure/Infrastructure.java PRE-CREATION
test/src/main/java/org/apache/sqoop/test/infrastructure/SqoopTestCase.java PRE-CREATION
test/src/main/java/org/apache/sqoop/test/infrastructure/providers/SqoopInfrastructureProvider.java PRE-CREATION
Diff: https://reviews.apache.org/r/34507/diff/
Testing
-------
N/A
Thanks,
Abraham Elmahrek
Re: Review Request 34507: Sqoop2: Create annotation and base class
Posted by richard zhou <ri...@intel.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/34507/#review88926
-----------------------------------------------------------
Ship it!
Ship It!
- richard zhou
On May 20, 2015, 10:55 p.m., Abraham Elmahrek wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/34507/
> -----------------------------------------------------------
>
> (Updated May 20, 2015, 10:55 p.m.)
>
>
> Review request for Sqoop.
>
>
> Bugs: SQOOP-2365
> https://issues.apache.org/jira/browse/SQOOP-2365
>
>
> Repository: sqoop-sqoop2
>
>
> Description
> -------
>
> commit bd1fbb96d76cea7ec1a3039b73aa9553576166f1
> Author: Abraham Elmahrek <ab...@apache.org>
> Date: Fri May 15 16:10:17 2015 -0700
>
> SQOOP-2364: Sqoop2: Provide test infrastructure base class for server tests
>
> :000000 100644 0000000... f3db7ad... A test/src/main/java/org/apache/sqoop/test/infrastructure/Infrastructure.java
> :000000 100644 0000000... 6fb1eac... A test/src/main/java/org/apache/sqoop/test/infrastructure/SqoopTestCase.java
> :000000 100644 0000000... 5b4f595... A test/src/main/java/org/apache/sqoop/test/infrastructure/providers/SqoopInfrastructureProvider.java
>
>
> Diffs
> -----
>
> test/src/main/java/org/apache/sqoop/test/infrastructure/Infrastructure.java PRE-CREATION
> test/src/main/java/org/apache/sqoop/test/infrastructure/SqoopTestCase.java PRE-CREATION
> test/src/main/java/org/apache/sqoop/test/infrastructure/providers/SqoopInfrastructureProvider.java PRE-CREATION
>
> Diff: https://reviews.apache.org/r/34507/diff/
>
>
> Testing
> -------
>
> N/A
>
>
> Thanks,
>
> Abraham Elmahrek
>
>
Re: Review Request 34507: Sqoop2: Create annotation and base class
Posted by Abraham Elmahrek <ab...@cloudera.com>.
> On July 9, 2015, 4:13 p.m., Jarek Cecho wrote:
> > test/src/main/java/org/apache/sqoop/test/infrastructure/SqoopTestCase.java, lines 150-155
> > <https://reviews.apache.org/r/34507/diff/2/?file=1001813#file1001813line150>
> >
> > Perhaps I've missed something, but HadoopProvider doesn't seem to be added to the PROVIDERS group, so it's probably not properly stopped, right?
I believe it is added. The method `startInfrastructureProvider` adds providers to the PROVIDERS group. Here's the code that starts all providers:
// Start hadoop first.
if (providers.contains(HadoopInfrastructureProvider.class)) {
InfrastructureProvider hadoopProviderObject = startInfrastructureProvider(HadoopInfrastructureProvider.class, conf);
// Use the prepared hadoop configuration for the rest of the components.
if (hadoopProviderObject != null) {
conf = hadoopProviderObject.getHadoopConfiguration();
}
}
// Start the rest of the providers.
for (Class<? extends InfrastructureProvider> provider : providers) {
startInfrastructureProvider(provider, conf);
}
Notice how `startInfrastructureProvider` is called first on `HadoopInfrastructureProvider.class`.
I'll add some comments to clarify this. Thanks for pointing this out!
- Abraham
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/34507/#review91111
-----------------------------------------------------------
On July 7, 2015, 10:20 p.m., Abraham Elmahrek wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/34507/
> -----------------------------------------------------------
>
> (Updated July 7, 2015, 10:20 p.m.)
>
>
> Review request for Sqoop.
>
>
> Bugs: SQOOP-2365
> https://issues.apache.org/jira/browse/SQOOP-2365
>
>
> Repository: sqoop-sqoop2
>
>
> Description
> -------
>
> commit bd1fbb96d76cea7ec1a3039b73aa9553576166f1
> Author: Abraham Elmahrek <ab...@apache.org>
> Date: Fri May 15 16:10:17 2015 -0700
>
> SQOOP-2364: Sqoop2: Provide test infrastructure base class for server tests
>
> :000000 100644 0000000... f3db7ad... A test/src/main/java/org/apache/sqoop/test/infrastructure/Infrastructure.java
> :000000 100644 0000000... 6fb1eac... A test/src/main/java/org/apache/sqoop/test/infrastructure/SqoopTestCase.java
> :000000 100644 0000000... 5b4f595... A test/src/main/java/org/apache/sqoop/test/infrastructure/providers/SqoopInfrastructureProvider.java
>
>
> Diffs
> -----
>
> test/src/main/java/org/apache/sqoop/test/infrastructure/Infrastructure.java PRE-CREATION
> test/src/main/java/org/apache/sqoop/test/infrastructure/SqoopTestCase.java PRE-CREATION
>
> Diff: https://reviews.apache.org/r/34507/diff/
>
>
> Testing
> -------
>
> N/A
>
>
> Thanks,
>
> Abraham Elmahrek
>
>
Re: Review Request 34507: Sqoop2: Create annotation and base class
Posted by Jarek Cecho <ja...@apache.org>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/34507/#review91111
-----------------------------------------------------------
Overall, looks good, thank you for working on this one Abe! I have just one comment:
test/src/main/java/org/apache/sqoop/test/infrastructure/SqoopTestCase.java (lines 150 - 155)
<https://reviews.apache.org/r/34507/#comment144376>
Perhaps I've missed something, but HadoopProvider doesn't seem to be added to the PROVIDERS group, so it's probably not properly stopped, right?
Jarcec
- Jarek Cecho
On July 7, 2015, 10:20 p.m., Abraham Elmahrek wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/34507/
> -----------------------------------------------------------
>
> (Updated July 7, 2015, 10:20 p.m.)
>
>
> Review request for Sqoop.
>
>
> Bugs: SQOOP-2365
> https://issues.apache.org/jira/browse/SQOOP-2365
>
>
> Repository: sqoop-sqoop2
>
>
> Description
> -------
>
> commit bd1fbb96d76cea7ec1a3039b73aa9553576166f1
> Author: Abraham Elmahrek <ab...@apache.org>
> Date: Fri May 15 16:10:17 2015 -0700
>
> SQOOP-2364: Sqoop2: Provide test infrastructure base class for server tests
>
> :000000 100644 0000000... f3db7ad... A test/src/main/java/org/apache/sqoop/test/infrastructure/Infrastructure.java
> :000000 100644 0000000... 6fb1eac... A test/src/main/java/org/apache/sqoop/test/infrastructure/SqoopTestCase.java
> :000000 100644 0000000... 5b4f595... A test/src/main/java/org/apache/sqoop/test/infrastructure/providers/SqoopInfrastructureProvider.java
>
>
> Diffs
> -----
>
> test/src/main/java/org/apache/sqoop/test/infrastructure/Infrastructure.java PRE-CREATION
> test/src/main/java/org/apache/sqoop/test/infrastructure/SqoopTestCase.java PRE-CREATION
>
> Diff: https://reviews.apache.org/r/34507/diff/
>
>
> Testing
> -------
>
> N/A
>
>
> Thanks,
>
> Abraham Elmahrek
>
>
Re: Review Request 34507: Sqoop2: Create annotation and base class
Posted by Abraham Elmahrek <ab...@cloudera.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/34507/
-----------------------------------------------------------
(Updated July 7, 2015, 10:20 p.m.)
Review request for Sqoop.
Bugs: SQOOP-2365
https://issues.apache.org/jira/browse/SQOOP-2365
Repository: sqoop-sqoop2
Description
-------
commit bd1fbb96d76cea7ec1a3039b73aa9553576166f1
Author: Abraham Elmahrek <ab...@apache.org>
Date: Fri May 15 16:10:17 2015 -0700
SQOOP-2364: Sqoop2: Provide test infrastructure base class for server tests
:000000 100644 0000000... f3db7ad... A test/src/main/java/org/apache/sqoop/test/infrastructure/Infrastructure.java
:000000 100644 0000000... 6fb1eac... A test/src/main/java/org/apache/sqoop/test/infrastructure/SqoopTestCase.java
:000000 100644 0000000... 5b4f595... A test/src/main/java/org/apache/sqoop/test/infrastructure/providers/SqoopInfrastructureProvider.java
Diffs (updated)
-----
test/src/main/java/org/apache/sqoop/test/infrastructure/Infrastructure.java PRE-CREATION
test/src/main/java/org/apache/sqoop/test/infrastructure/SqoopTestCase.java PRE-CREATION
Diff: https://reviews.apache.org/r/34507/diff/
Testing
-------
N/A
Thanks,
Abraham Elmahrek
Re: Review Request 34507: Sqoop2: Create annotation and base class
Posted by Abraham Elmahrek <ab...@cloudera.com>.
> On June 23, 2015, 6:03 a.m., richard zhou wrote:
> > test/src/main/java/org/apache/sqoop/test/infrastructure/SqoopTestCase.java, line 25
> > <https://reviews.apache.org/r/34507/diff/1/?file=965863#file965863line25>
> >
> > There is no such class (InfrastructureProvider and HadoopInfrastructureProvider)
Pull in SQOOP-2366 first then this patch! Thanks man!
- Abraham
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/34507/#review88930
-----------------------------------------------------------
On May 20, 2015, 10:55 p.m., Abraham Elmahrek wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/34507/
> -----------------------------------------------------------
>
> (Updated May 20, 2015, 10:55 p.m.)
>
>
> Review request for Sqoop.
>
>
> Bugs: SQOOP-2365
> https://issues.apache.org/jira/browse/SQOOP-2365
>
>
> Repository: sqoop-sqoop2
>
>
> Description
> -------
>
> commit bd1fbb96d76cea7ec1a3039b73aa9553576166f1
> Author: Abraham Elmahrek <ab...@apache.org>
> Date: Fri May 15 16:10:17 2015 -0700
>
> SQOOP-2364: Sqoop2: Provide test infrastructure base class for server tests
>
> :000000 100644 0000000... f3db7ad... A test/src/main/java/org/apache/sqoop/test/infrastructure/Infrastructure.java
> :000000 100644 0000000... 6fb1eac... A test/src/main/java/org/apache/sqoop/test/infrastructure/SqoopTestCase.java
> :000000 100644 0000000... 5b4f595... A test/src/main/java/org/apache/sqoop/test/infrastructure/providers/SqoopInfrastructureProvider.java
>
>
> Diffs
> -----
>
> test/src/main/java/org/apache/sqoop/test/infrastructure/Infrastructure.java PRE-CREATION
> test/src/main/java/org/apache/sqoop/test/infrastructure/SqoopTestCase.java PRE-CREATION
> test/src/main/java/org/apache/sqoop/test/infrastructure/providers/SqoopInfrastructureProvider.java PRE-CREATION
>
> Diff: https://reviews.apache.org/r/34507/diff/
>
>
> Testing
> -------
>
> N/A
>
>
> Thanks,
>
> Abraham Elmahrek
>
>
Re: Review Request 34507: Sqoop2: Create annotation and base class
Posted by richard zhou <ri...@intel.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/34507/#review88930
-----------------------------------------------------------
test/src/main/java/org/apache/sqoop/test/infrastructure/SqoopTestCase.java (line 25)
<https://reviews.apache.org/r/34507/#comment141546>
There is no such class (InfrastructureProvider and HadoopInfrastructureProvider)
- richard zhou
On May 20, 2015, 10:55 p.m., Abraham Elmahrek wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/34507/
> -----------------------------------------------------------
>
> (Updated May 20, 2015, 10:55 p.m.)
>
>
> Review request for Sqoop.
>
>
> Bugs: SQOOP-2365
> https://issues.apache.org/jira/browse/SQOOP-2365
>
>
> Repository: sqoop-sqoop2
>
>
> Description
> -------
>
> commit bd1fbb96d76cea7ec1a3039b73aa9553576166f1
> Author: Abraham Elmahrek <ab...@apache.org>
> Date: Fri May 15 16:10:17 2015 -0700
>
> SQOOP-2364: Sqoop2: Provide test infrastructure base class for server tests
>
> :000000 100644 0000000... f3db7ad... A test/src/main/java/org/apache/sqoop/test/infrastructure/Infrastructure.java
> :000000 100644 0000000... 6fb1eac... A test/src/main/java/org/apache/sqoop/test/infrastructure/SqoopTestCase.java
> :000000 100644 0000000... 5b4f595... A test/src/main/java/org/apache/sqoop/test/infrastructure/providers/SqoopInfrastructureProvider.java
>
>
> Diffs
> -----
>
> test/src/main/java/org/apache/sqoop/test/infrastructure/Infrastructure.java PRE-CREATION
> test/src/main/java/org/apache/sqoop/test/infrastructure/SqoopTestCase.java PRE-CREATION
> test/src/main/java/org/apache/sqoop/test/infrastructure/providers/SqoopInfrastructureProvider.java PRE-CREATION
>
> Diff: https://reviews.apache.org/r/34507/diff/
>
>
> Testing
> -------
>
> N/A
>
>
> Thanks,
>
> Abraham Elmahrek
>
>
Re: Review Request 34507: Sqoop2: Create annotation and base class
Posted by Syed Hashmi <sh...@cloudera.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/34507/#review86319
-----------------------------------------------------------
Ship it!
Ship It!
- Syed Hashmi
On May 20, 2015, 10:55 p.m., Abraham Elmahrek wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/34507/
> -----------------------------------------------------------
>
> (Updated May 20, 2015, 10:55 p.m.)
>
>
> Review request for Sqoop.
>
>
> Bugs: SQOOP-2365
> https://issues.apache.org/jira/browse/SQOOP-2365
>
>
> Repository: sqoop-sqoop2
>
>
> Description
> -------
>
> commit bd1fbb96d76cea7ec1a3039b73aa9553576166f1
> Author: Abraham Elmahrek <ab...@apache.org>
> Date: Fri May 15 16:10:17 2015 -0700
>
> SQOOP-2364: Sqoop2: Provide test infrastructure base class for server tests
>
> :000000 100644 0000000... f3db7ad... A test/src/main/java/org/apache/sqoop/test/infrastructure/Infrastructure.java
> :000000 100644 0000000... 6fb1eac... A test/src/main/java/org/apache/sqoop/test/infrastructure/SqoopTestCase.java
> :000000 100644 0000000... 5b4f595... A test/src/main/java/org/apache/sqoop/test/infrastructure/providers/SqoopInfrastructureProvider.java
>
>
> Diffs
> -----
>
> test/src/main/java/org/apache/sqoop/test/infrastructure/Infrastructure.java PRE-CREATION
> test/src/main/java/org/apache/sqoop/test/infrastructure/SqoopTestCase.java PRE-CREATION
> test/src/main/java/org/apache/sqoop/test/infrastructure/providers/SqoopInfrastructureProvider.java PRE-CREATION
>
> Diff: https://reviews.apache.org/r/34507/diff/
>
>
> Testing
> -------
>
> N/A
>
>
> Thanks,
>
> Abraham Elmahrek
>
>