You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@pulsar.apache.org by GitBox <gi...@apache.org> on 2022/07/31 01:33:15 UTC

[GitHub] [pulsar] tisonkun created a discussion: How do you develop connectors in the repo workspace?

GitHub user tisonkun created a discussion: How do you develop connectors in the repo workspace?

That said, working with Pulsar connectors is based on Pulsar functions, and in `conf/functions_worker.yml` we configure:

```yaml
connectorsDirectory: ./connectors
```

However, the bundled connectors are under `./distribution/io/target/apache-pulsar-io-connectors-<version>-bin`.

It causes when I run code snippets from our docs like:

```shell
./bin/pulsar-admin sources create --name generator --destinationTopicName generator_test --source-type data-generator
```

It complains:

```
Invalid source type 'data-generator' -- Available sources are: []
```

Creating a directory under the root path and copying connectors' NAR files works, but it's a bit clumsy:

```shell
cp distribution/io/target/apache-pulsar-io-connectors-2.11.0-SNAPSHOT-bin/*.nar connectors 
``

I want to learn how you develop connectors in the repo workspace. Is there some way better than that described above?

cc @merlimat @lhotari 

GitHub link: https://github.com/apache/pulsar/discussions/16886

----
This is an automatically sent email for dev@pulsar.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@pulsar.apache.org

[GitHub] [pulsar] tisonkun edited a discussion: How do you develop connectors in the repo workspace?

Posted by GitBox <gi...@apache.org>.

GitHub user tisonkun edited a discussion: How do you develop connectors in the repo workspace?

That said, working with Pulsar connectors is based on Pulsar functions, and in `conf/functions_worker.yml` we configure:

```yaml
connectorsDirectory: ./connectors
```

However, the bundled connectors are under `./distribution/io/target/apache-pulsar-io-connectors-<version>-bin`.

It causes when I run code snippets from our docs like:

```shell
./bin/pulsar-admin sources create --name generator --destinationTopicName generator_test --source-type data-generator
```

It complains:

```
Invalid source type 'data-generator' -- Available sources are: []
```

Creating a directory under the root path and copying connectors' NAR files works, but it's a bit clumsy:

```shell
cp distribution/io/target/apache-pulsar-io-connectors-2.11.0-SNAPSHOT-bin/*.nar connectors 
```

I want to learn how you develop connectors in the repo workspace. Is there some way better than that described above?

cc @merlimat @lhotari 

GitHub link: https://github.com/apache/pulsar/discussions/16886

----
This is an automatically sent email for dev@pulsar.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@pulsar.apache.org

[GitHub] [pulsar] nlu90 added a comment to the discussion: How do you develop connectors in the repo workspace?

Posted by GitBox <gi...@apache.org>.

GitHub user nlu90 added a comment to the discussion: How do you develop connectors in the repo workspace?

Some thoughts:
1. update the `functions_worker.yml`'s `connectorsDirectory` to point to your dev directory
2. create a soft link to your directory

GitHub link: https://github.com/apache/pulsar/discussions/16886#discussioncomment-3371195

----
This is an automatically sent email for dev@pulsar.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@pulsar.apache.org

[GitHub] [pulsar] asafm added a comment to the discussion: How do you develop connectors in the repo workspace?

Posted by GitBox <gi...@apache.org>.

GitHub user asafm added a comment to the discussion: How do you develop connectors in the repo workspace?

@nlu90 might know?

GitHub link: https://github.com/apache/pulsar/discussions/16886#discussioncomment-3367586

----
This is an automatically sent email for dev@pulsar.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@pulsar.apache.org