When I try to compile I get an error about a missing SNAPSHOT dependency.
The error looks something like this:
Failed to execute goal on project kafka-connect-hdfs: Could not resolve dependencies for project io.confluent:kafka-connect-hdfs:jar:3.1.0-SNAPSHOT: Failure to find io.confluent:kafka-connect-avro-converter:jar:3.1.0-SNAPSHOT in http://packages.confluent.io/maven/ was cached in the local repository, resolution will not be reattempted until the update interval of confluent has elapsed or updates are forced
The HDFS connector uses a few dependencies which we sometimes use SNAPSHOT versions of during development of a new release in order to build and test against new features. If you want to build a development version, you may need to build and install these dependencies to your local Maven repository in order to build the connector:
| Project | Clone | Build with |
|---|---|---|
| Kafka | https://github.com/apache/kafka/ | ./gradlew installAll |
| Confluent Common library | https://github.com/confluentinc/common | mvn clean install |
| Confluent Rest-Utils | https://github.com/confluentinc/rest-utils | mvn clean install |
| Avro Converter | https://github.com/confluentinc/schema-registry | mvn clean install |
| Common library for Storage Connectors | https://github.com/confluentinc/kafka-connect-storage-common | mvn clean install |