You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2020/07/18 20:12:42 UTC

[GitHub] [airflow] rootcss opened a new pull request #9877: [ https://github.com/apache/airflow/issues/8189 ] Add howto docs for Cassandra Operators

rootcss opened a new pull request #9877:
URL: https://github.com/apache/airflow/pull/9877


   https://github.com/apache/airflow/issues/8189 Add howto docs for Cassandra Operators
   
   ---
   Make sure to mark the boxes below before creating PR: [x]
   
   - [x] Description above provides context of the change
   - [x] Unit tests coverage for changes (not needed for documentation changes)
   - [x] Target Github ISSUE in description if exists
   - [x] Commits follow "[How to write a good git commit message](http://chris.beams.io/posts/git-commit/)"
   - [x] Relevant documentation is updated including usage instructions.
   - [x] I will engage committers as explained in [Contribution Workflow Example](https://github.com/apache/airflow/blob/master/CONTRIBUTING.rst#contribution-workflow-example).
   
   ---
   In case of fundamental code change, Airflow Improvement Proposal ([AIP](https://cwiki.apache.org/confluence/display/AIRFLOW/Airflow+Improvements+Proposals)) is needed.
   In case of a new dependency, check compliance with the [ASF 3rd Party License Policy](https://www.apache.org/legal/resolved.html#category-x).
   In case of backwards incompatible changes please leave a note in [UPDATING.md](https://github.com/apache/airflow/blob/master/UPDATING.md).
   Read the [Pull Request Guidelines](https://github.com/apache/airflow/blob/master/CONTRIBUTING.rst#pull-request-guidelines) for more information.
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] mik-laj commented on a change in pull request #9877: Add howto docs for Cassandra Operators (issues#8189)

Posted by GitBox <gi...@apache.org>.
mik-laj commented on a change in pull request #9877:
URL: https://github.com/apache/airflow/pull/9877#discussion_r456828532



##########
File path: docs/howto/operator/apache/cassandra.rst
##########
@@ -0,0 +1,71 @@
+ .. Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements.  See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership.  The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License.  You may obtain a copy of the License at
+
+ ..   http://www.apache.org/licenses/LICENSE-2.0
+
+ .. Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied.  See the License for the
+specific language governing permissions and limitations
+under the License.
+
+
+Apache Cassandra Operators
+======================
+
+.. contents::
+  :depth: 1
+  :local:
+
+Prerequisite
+------------
+
+To use ``CassandraTableSensor`` and ``CassandraRecordSensor``, you must configure a :doc:`Cassandra Connection <../../connection/cassandra>`.
+
+:ref:`howto/operator:CassandraTableSensor`
+
+CassandraTableSensor

Review comment:
       Can you use titles that are more beginner-friendly?
   Here is an example: https://airflow.readthedocs.io/en/latest/howto/operator/google/cloud/natural_language.html




----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] rootcss commented on pull request #9877: Add howto docs for Cassandra Operators (issues#8189)

Posted by GitBox <gi...@apache.org>.
rootcss commented on pull request #9877:
URL: https://github.com/apache/airflow/pull/9877#issuecomment-660692292


   One of the cassandra's loadbalancing policy is called `WhiteListRoundRobinPolicy`. The static check in CI is failing with it "Check for language that we do not accept as community.". How can we fix this?


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] mik-laj commented on a change in pull request #9877: Add howto docs for Cassandra Operators (issues#8189)

Posted by GitBox <gi...@apache.org>.
mik-laj commented on a change in pull request #9877:
URL: https://github.com/apache/airflow/pull/9877#discussion_r456828351



##########
File path: docs/howto/operator/apache/cassandra.rst
##########
@@ -0,0 +1,71 @@
+ .. Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements.  See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership.  The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License.  You may obtain a copy of the License at
+
+ ..   http://www.apache.org/licenses/LICENSE-2.0
+
+ .. Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied.  See the License for the
+specific language governing permissions and limitations
+under the License.
+
+
+Apache Cassandra Operators
+======================
+
+.. contents::
+  :depth: 1
+  :local:
+
+Prerequisite
+------------
+
+To use ``CassandraTableSensor`` and ``CassandraRecordSensor``, you must configure a :doc:`Cassandra Connection <../../connection/cassandra>`.

Review comment:
       ```suggestion
   To use operators, you must configure a :doc:`Cassandra Connection <../../connection/cassandra>`.
   ```
   We try to avoid the listings in the introduction, because we often forget to update them. However, they are of little value here.




----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] mik-laj commented on a change in pull request #9877: Add howto docs for Cassandra Operators (issues#8189)

Posted by GitBox <gi...@apache.org>.
mik-laj commented on a change in pull request #9877:
URL: https://github.com/apache/airflow/pull/9877#discussion_r456828454



##########
File path: docs/howto/operator/apache/cassandra.rst
##########
@@ -0,0 +1,71 @@
+ .. Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements.  See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership.  The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License.  You may obtain a copy of the License at
+
+ ..   http://www.apache.org/licenses/LICENSE-2.0
+
+ .. Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied.  See the License for the
+specific language governing permissions and limitations
+under the License.
+
+
+Apache Cassandra Operators
+======================
+

Review comment:
       Can you add a short introduction describing the service/product?
   Here is an example: https://airflow.readthedocs.io/en/latest/howto/operator/google/cloud/natural_language.html

##########
File path: docs/howto/operator/apache/cassandra.rst
##########
@@ -0,0 +1,71 @@
+ .. Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements.  See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership.  The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License.  You may obtain a copy of the License at
+
+ ..   http://www.apache.org/licenses/LICENSE-2.0
+
+ .. Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied.  See the License for the
+specific language governing permissions and limitations
+under the License.
+
+
+Apache Cassandra Operators
+======================
+
+.. contents::
+  :depth: 1
+  :local:
+
+Prerequisite
+------------
+
+To use ``CassandraTableSensor`` and ``CassandraRecordSensor``, you must configure a :doc:`Cassandra Connection <../../connection/cassandra>`.
+
+:ref:`howto/operator:CassandraTableSensor`
+
+CassandraTableSensor
+-----------------

Review comment:
       ```suggestion
   -------------------
   ```




----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] mik-laj commented on a change in pull request #9877: Add howto docs for Cassandra Operators (issues#8189)

Posted by GitBox <gi...@apache.org>.
mik-laj commented on a change in pull request #9877:
URL: https://github.com/apache/airflow/pull/9877#discussion_r456827624



##########
File path: docs/howto/connection/cassandra.rst
##########
@@ -0,0 +1,109 @@
+ .. Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements.  See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership.  The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License.  You may obtain a copy of the License at
+
+ ..   http://www.apache.org/licenses/LICENSE-2.0
+
+ .. Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied.  See the License for the
+specific language governing permissions and limitations
+under the License.
+
+Apache Cassandra Connection
+=======================

Review comment:
       ```suggestion
   Apache Cassandra Connection
   ==========================
   ```

##########
File path: docs/howto/connection/cassandra.rst
##########
@@ -0,0 +1,109 @@
+ .. Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements.  See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership.  The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License.  You may obtain a copy of the License at
+
+ ..   http://www.apache.org/licenses/LICENSE-2.0
+
+ .. Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied.  See the License for the
+specific language governing permissions and limitations
+under the License.
+
+Apache Cassandra Connection
+=======================

Review comment:
       ```suggestion
   Apache Cassandra Connection
   ===========================
   ```




----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] mik-laj commented on a change in pull request #9877: Add howto docs for Cassandra Operators (issues#8189)

Posted by GitBox <gi...@apache.org>.
mik-laj commented on a change in pull request #9877:
URL: https://github.com/apache/airflow/pull/9877#discussion_r456828152



##########
File path: docs/howto/connection/cassandra.rst
##########
@@ -0,0 +1,109 @@
+ .. Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements.  See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership.  The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License.  You may obtain a copy of the License at
+
+ ..   http://www.apache.org/licenses/LICENSE-2.0
+
+ .. Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied.  See the License for the
+specific language governing permissions and limitations
+under the License.
+
+Apache Cassandra Connection
+=======================
+
+The Apache Cassandra connection type enables connection to Apache Cassandra.
+
+Default Connection IDs
+----------------------
+
+Cassandra hook and Cassandra operators use ``cassandra_default`` by default.
+
+Configuring the Connection
+--------------------------
+Host (required)
+    The host to connect to. Hosts can be provided in comma-separated string values.
+
+Schema (required)
+    Specify the schema (keyspace) name to be used in the database.
+
+Login (required)
+    Specify the user name to connect.
+
+Password (required)
+    Specify the password to connect.
+
+Port (required)
+    Specify the port to connect.
+
+Extra (optional)
+    Specify the extra parameters (as json dictionary) that can be used in cassandra

Review comment:
       ```suggestion
       The extra parameters (as json dictionary) that can be used in cassandra
   ```




----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] mik-laj commented on a change in pull request #9877: Add howto docs for Cassandra Operators (issues#8189)

Posted by GitBox <gi...@apache.org>.
mik-laj commented on a change in pull request #9877:
URL: https://github.com/apache/airflow/pull/9877#discussion_r456909744



##########
File path: docs/howto/operator/apache/cassandra.rst
##########
@@ -0,0 +1,71 @@
+ .. Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements.  See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership.  The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License.  You may obtain a copy of the License at
+
+ ..   http://www.apache.org/licenses/LICENSE-2.0
+
+ .. Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied.  See the License for the
+specific language governing permissions and limitations
+under the License.
+
+
+Apache Cassandra Operators
+======================
+
+.. contents::
+  :depth: 1
+  :local:
+
+Prerequisite
+------------
+
+To use ``CassandraTableSensor`` and ``CassandraRecordSensor``, you must configure a :doc:`Cassandra Connection <../../connection/cassandra>`.
+
+:ref:`howto/operator:CassandraTableSensor`
+
+CassandraTableSensor

Review comment:
       +1




----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] mik-laj commented on a change in pull request #9877: Add howto docs for Cassandra Operators (issues#8189)

Posted by GitBox <gi...@apache.org>.
mik-laj commented on a change in pull request #9877:
URL: https://github.com/apache/airflow/pull/9877#discussion_r456828107



##########
File path: docs/howto/connection/cassandra.rst
##########
@@ -0,0 +1,109 @@
+ .. Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements.  See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership.  The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License.  You may obtain a copy of the License at
+
+ ..   http://www.apache.org/licenses/LICENSE-2.0
+
+ .. Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied.  See the License for the
+specific language governing permissions and limitations
+under the License.
+
+Apache Cassandra Connection
+=======================
+
+The Apache Cassandra connection type enables connection to Apache Cassandra.
+
+Default Connection IDs
+----------------------
+
+Cassandra hook and Cassandra operators use ``cassandra_default`` by default.
+
+Configuring the Connection
+--------------------------
+Host (required)
+    The host to connect to. Hosts can be provided in comma-separated string values.
+
+Schema (required)
+    Specify the schema (keyspace) name to be used in the database.
+
+Login (required)
+    Specify the user name to connect.

Review comment:
       ```suggestion
       The user name to connect.
   ```




----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] mik-laj commented on a change in pull request #9877: Add howto docs for Cassandra Operators (issues#8189)

Posted by GitBox <gi...@apache.org>.
mik-laj commented on a change in pull request #9877:
URL: https://github.com/apache/airflow/pull/9877#discussion_r456828101



##########
File path: docs/howto/connection/cassandra.rst
##########
@@ -0,0 +1,109 @@
+ .. Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements.  See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership.  The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License.  You may obtain a copy of the License at
+
+ ..   http://www.apache.org/licenses/LICENSE-2.0
+
+ .. Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied.  See the License for the
+specific language governing permissions and limitations
+under the License.
+
+Apache Cassandra Connection
+=======================
+
+The Apache Cassandra connection type enables connection to Apache Cassandra.
+
+Default Connection IDs
+----------------------
+
+Cassandra hook and Cassandra operators use ``cassandra_default`` by default.
+
+Configuring the Connection
+--------------------------
+Host (required)
+    The host to connect to. Hosts can be provided in comma-separated string values.
+
+Schema (required)
+    Specify the schema (keyspace) name to be used in the database.

Review comment:
       ```suggestion
       The schema (keyspace) name to be used in the database.
   ```




----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] rootcss commented on pull request #9877: Add howto docs for Cassandra Operators (issues#8189)

Posted by GitBox <gi...@apache.org>.
rootcss commented on pull request #9877:
URL: https://github.com/apache/airflow/pull/9877#issuecomment-660677040


   > I am not an expert on Cassandra, but is it possible to connect to Cassandra in any other way, eg JDBC driver? I am wondering if we should also add information about other operators in this guide.
   
   All cassandra clients require the cassandra's connector driver, there are a few "jdbc" like unofficial drivers, but they require the separate connectors, and do not support the usual jdbc.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] rootcss commented on pull request #9877: Add howto docs for Cassandra Operators (issues#8189)

Posted by GitBox <gi...@apache.org>.
rootcss commented on pull request #9877:
URL: https://github.com/apache/airflow/pull/9877#issuecomment-660690396


   > Some doc build errors :(
   
   It's passing now @potiuk. 


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] rootcss edited a comment on pull request #9877: Add howto docs for Cassandra Operators (issues#8189)

Posted by GitBox <gi...@apache.org>.
rootcss edited a comment on pull request #9877:
URL: https://github.com/apache/airflow/pull/9877#issuecomment-660692292


   One of the cassandra's loadbalancing policy is called `WhiteListRoundRobinPolicy`. The static check in CI is failing with it "Check for language that we do not accept as community.". How can we fix this?
   
   Edit: Putting this file in exclude list.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] potiuk commented on pull request #9877: Add howto docs for Cassandra Operators (issues#8189)

Posted by GitBox <gi...@apache.org>.
potiuk commented on pull request #9877:
URL: https://github.com/apache/airflow/pull/9877#issuecomment-660678831


   Some doc build errors :(


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] mik-laj commented on a change in pull request #9877: Add howto docs for Cassandra Operators (issues#8189)

Posted by GitBox <gi...@apache.org>.
mik-laj commented on a change in pull request #9877:
URL: https://github.com/apache/airflow/pull/9877#discussion_r456827706



##########
File path: docs/howto/connection/cassandra.rst
##########
@@ -0,0 +1,109 @@
+ .. Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements.  See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership.  The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License.  You may obtain a copy of the License at
+
+ ..   http://www.apache.org/licenses/LICENSE-2.0
+
+ .. Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied.  See the License for the
+specific language governing permissions and limitations
+under the License.
+
+Apache Cassandra Connection
+=======================
+
+The Apache Cassandra connection type enables connection to Apache Cassandra.

Review comment:
       ```suggestion
   The Apache Cassandra <https://cassandra.apache.org/ connection type enables connection to ``Apache Cassandra>``__.
   ```




----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] mik-laj commented on a change in pull request #9877: Add howto docs for Cassandra Operators (issues#8189)

Posted by GitBox <gi...@apache.org>.
mik-laj commented on a change in pull request #9877:
URL: https://github.com/apache/airflow/pull/9877#discussion_r456828549



##########
File path: docs/howto/operator/apache/cassandra.rst
##########
@@ -0,0 +1,71 @@
+ .. Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements.  See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership.  The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License.  You may obtain a copy of the License at
+
+ ..   http://www.apache.org/licenses/LICENSE-2.0
+
+ .. Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied.  See the License for the
+specific language governing permissions and limitations
+under the License.
+
+
+Apache Cassandra Operators
+======================
+
+.. contents::
+  :depth: 1
+  :local:
+
+Prerequisite
+------------
+
+To use ``CassandraTableSensor`` and ``CassandraRecordSensor``, you must configure a :doc:`Cassandra Connection <../../connection/cassandra>`.
+
+:ref:`howto/operator:CassandraTableSensor`
+
+CassandraTableSensor
+-----------------
+
+Checks for the existence of a table in a Cassandra cluster.
+
+For parameter definition take a look at :class:`~airflow.providers.apache.cassandra.sensors.table.CassandraTableSensor`.
+
+Use the ``table`` parameter to poke until the provided table is found. Use dot notation to target a specific keyspace.
+
+.. exampleinclude:: /../airflow/providers/apache/cassandra/example_dags/example_cassandra_dag.py
+    :language: python
+    :dedent: 4
+    :start-after: [START howto_operator_cassandra_table_sensor]
+    :end-before: [END howto_operator_cassandra_table_sensor]
+
+
+:ref:`howto/operator:CassandraRecordSensor`
+
+CassandraRecordSensor
+-----------------

Review comment:
       ```suggestion
   --------------------
   ```

##########
File path: docs/howto/operator/apache/cassandra.rst
##########
@@ -0,0 +1,71 @@
+ .. Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements.  See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership.  The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License.  You may obtain a copy of the License at
+
+ ..   http://www.apache.org/licenses/LICENSE-2.0
+
+ .. Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied.  See the License for the
+specific language governing permissions and limitations
+under the License.
+
+
+Apache Cassandra Operators
+======================
+
+.. contents::
+  :depth: 1
+  :local:
+
+Prerequisite
+------------
+
+To use ``CassandraTableSensor`` and ``CassandraRecordSensor``, you must configure a :doc:`Cassandra Connection <../../connection/cassandra>`.
+
+:ref:`howto/operator:CassandraTableSensor`
+
+CassandraTableSensor
+-----------------
+
+Checks for the existence of a table in a Cassandra cluster.
+
+For parameter definition take a look at :class:`~airflow.providers.apache.cassandra.sensors.table.CassandraTableSensor`.
+
+Use the ``table`` parameter to poke until the provided table is found. Use dot notation to target a specific keyspace.
+
+.. exampleinclude:: /../airflow/providers/apache/cassandra/example_dags/example_cassandra_dag.py
+    :language: python
+    :dedent: 4
+    :start-after: [START howto_operator_cassandra_table_sensor]
+    :end-before: [END howto_operator_cassandra_table_sensor]
+
+
+:ref:`howto/operator:CassandraRecordSensor`
+
+CassandraRecordSensor
+-----------------

Review comment:
       ```suggestion
   ---------------------
   ```




----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] mik-laj commented on a change in pull request #9877: Add howto docs for Cassandra Operators (issues#8189)

Posted by GitBox <gi...@apache.org>.
mik-laj commented on a change in pull request #9877:
URL: https://github.com/apache/airflow/pull/9877#discussion_r456828121



##########
File path: docs/howto/connection/cassandra.rst
##########
@@ -0,0 +1,109 @@
+ .. Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements.  See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership.  The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License.  You may obtain a copy of the License at
+
+ ..   http://www.apache.org/licenses/LICENSE-2.0
+
+ .. Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied.  See the License for the
+specific language governing permissions and limitations
+under the License.
+
+Apache Cassandra Connection
+=======================
+
+The Apache Cassandra connection type enables connection to Apache Cassandra.
+
+Default Connection IDs
+----------------------
+
+Cassandra hook and Cassandra operators use ``cassandra_default`` by default.
+
+Configuring the Connection
+--------------------------
+Host (required)
+    The host to connect to. Hosts can be provided in comma-separated string values.
+
+Schema (required)
+    Specify the schema (keyspace) name to be used in the database.
+
+Login (required)
+    Specify the user name to connect.
+
+Password (required)
+    Specify the password to connect.

Review comment:
       ```suggestion
       The password to connect.
   ```




----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] mik-laj commented on a change in pull request #9877: Add howto docs for Cassandra Operators (issues#8189)

Posted by GitBox <gi...@apache.org>.
mik-laj commented on a change in pull request #9877:
URL: https://github.com/apache/airflow/pull/9877#discussion_r456828135



##########
File path: docs/howto/connection/cassandra.rst
##########
@@ -0,0 +1,109 @@
+ .. Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements.  See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership.  The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License.  You may obtain a copy of the License at
+
+ ..   http://www.apache.org/licenses/LICENSE-2.0
+
+ .. Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied.  See the License for the
+specific language governing permissions and limitations
+under the License.
+
+Apache Cassandra Connection
+=======================
+
+The Apache Cassandra connection type enables connection to Apache Cassandra.
+
+Default Connection IDs
+----------------------
+
+Cassandra hook and Cassandra operators use ``cassandra_default`` by default.
+
+Configuring the Connection
+--------------------------
+Host (required)
+    The host to connect to. Hosts can be provided in comma-separated string values.
+
+Schema (required)
+    Specify the schema (keyspace) name to be used in the database.
+
+Login (required)
+    Specify the user name to connect.
+
+Password (required)
+    Specify the password to connect.
+
+Port (required)
+    Specify the port to connect.

Review comment:
       ```suggestion
       The port to connect.
   ```




----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] rootcss commented on pull request #9877: Add howto docs for Cassandra Operators (issues#8189)

Posted by GitBox <gi...@apache.org>.
rootcss commented on pull request #9877:
URL: https://github.com/apache/airflow/pull/9877#issuecomment-660679328


   > Some doc build errors :(
   
   Looking at it.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] mik-laj commented on a change in pull request #9877: Add howto docs for Cassandra Operators (issues#8189)

Posted by GitBox <gi...@apache.org>.
mik-laj commented on a change in pull request #9877:
URL: https://github.com/apache/airflow/pull/9877#discussion_r456827706



##########
File path: docs/howto/connection/cassandra.rst
##########
@@ -0,0 +1,109 @@
+ .. Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements.  See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership.  The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License.  You may obtain a copy of the License at
+
+ ..   http://www.apache.org/licenses/LICENSE-2.0
+
+ .. Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied.  See the License for the
+specific language governing permissions and limitations
+under the License.
+
+Apache Cassandra Connection
+=======================
+
+The Apache Cassandra connection type enables connection to Apache Cassandra.

Review comment:
       ```suggestion
   The Apache Cassandra connection type enables connection to ``Apache Cassandra <https://cassandra.apache.org/>``__.
   ```




----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] mik-laj merged pull request #9877: Add howto docs for Cassandra Operators (issues#8189)

Posted by GitBox <gi...@apache.org>.
mik-laj merged pull request #9877:
URL: https://github.com/apache/airflow/pull/9877


   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] rootcss commented on a change in pull request #9877: Add howto docs for Cassandra Operators (issues#8189)

Posted by GitBox <gi...@apache.org>.
rootcss commented on a change in pull request #9877:
URL: https://github.com/apache/airflow/pull/9877#discussion_r456909552



##########
File path: docs/howto/operator/apache/cassandra.rst
##########
@@ -0,0 +1,71 @@
+ .. Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements.  See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership.  The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License.  You may obtain a copy of the License at
+
+ ..   http://www.apache.org/licenses/LICENSE-2.0
+
+ .. Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied.  See the License for the
+specific language governing permissions and limitations
+under the License.
+
+
+Apache Cassandra Operators
+======================
+
+.. contents::
+  :depth: 1
+  :local:
+
+Prerequisite
+------------
+
+To use ``CassandraTableSensor`` and ``CassandraRecordSensor``, you must configure a :doc:`Cassandra Connection <../../connection/cassandra>`.
+
+:ref:`howto/operator:CassandraTableSensor`
+
+CassandraTableSensor

Review comment:
       @mik-laj  Are these titles fine? - 
   "Waiting for a Table to be created" for CassandraTableSensor
   "Waiting for a Record to be created" for CassandraRecordSensor




----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] mik-laj commented on pull request #9877: Add howto docs for Cassandra Operators (issues#8189)

Posted by GitBox <gi...@apache.org>.
mik-laj commented on pull request #9877:
URL: https://github.com/apache/airflow/pull/9877#issuecomment-660544232


   I am not an expert on Cassandra, but is it possible to connect to Cassandra in any other way, eg JDBC driver? I am wondering if we should also add information about other operators in this guide.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] mik-laj commented on a change in pull request #9877: Add howto docs for Cassandra Operators (issues#8189)

Posted by GitBox <gi...@apache.org>.
mik-laj commented on a change in pull request #9877:
URL: https://github.com/apache/airflow/pull/9877#discussion_r456828022



##########
File path: docs/howto/connection/cassandra.rst
##########
@@ -0,0 +1,109 @@
+ .. Licensed to the Apache Software Foundation (ASF) under one
+or more contributor license agreements.  See the NOTICE file
+distributed with this work for additional information
+regarding copyright ownership.  The ASF licenses this file
+to you under the Apache License, Version 2.0 (the
+"License"); you may not use this file except in compliance
+with the License.  You may obtain a copy of the License at
+
+ ..   http://www.apache.org/licenses/LICENSE-2.0
+
+ .. Unless required by applicable law or agreed to in writing,
+software distributed under the License is distributed on an
+"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+KIND, either express or implied.  See the License for the
+specific language governing permissions and limitations
+under the License.
+
+Apache Cassandra Connection
+=======================
+
+The Apache Cassandra connection type enables connection to Apache Cassandra.
+
+Default Connection IDs
+----------------------
+
+Cassandra hook and Cassandra operators use ``cassandra_default`` by default.
+
+Configuring the Connection
+--------------------------
+Host (required)
+    The host to connect to. Hosts can be provided in comma-separated string values.

Review comment:
       ```suggestion
       The host to connect to. It is possible to specify multiple hosts as a comma-separated list.
   ```
   This is not very clear since the first sentence says only one host.




----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org