自定义分区器:

import org.apache.kafka.clients.producer.Partitioner;
import org.apache.kafka.common.Cluster;
import org.apache.kafka.common.PartitionInfo;
import java.util.List;
import java.util.Map;

public class SelfPartitioner implements Partitioner {
    public int partition(String topic, Object key, byte[] keyBytes,
                         Object value, byte[] valueBytes, Cluster cluster) {
        //拿到
        List<PartitionInfo> partitionInfos = cluster.partitionsForTopic(topic);
        //TODO 分区数
        int num = partitionInfos.size();
        //TODO 根据value与分区数求余的方式得到分区ID
        int parId = ((String)value).hashCode()%num;
        return parId;
    }

    public void close() {
        //do nothing
    }

    public void configure(Map<String, ?> configs) {
        //do nothing
    }

}

配置到kafka:

ProducerConfig.PARTITIONER_CLASS_CONFIG, "cn.enjoyedu.selfpartition.SelfPartitioner"

更多配置参考:《kafka2.5.0生产者与消费者配置详解

 

end.

相关文章:

  • 2021-12-11
  • 2021-10-19
  • 2022-02-09
  • 2021-06-13
  • 2020-01-12
猜你喜欢
  • 2021-07-03
  • 2022-01-30
  • 2021-12-18
  • 2020-07-21
  • 2022-12-23
  • 2021-05-17
  • 2022-02-25
相关资源
相似解决方案