PkOld Archives

kafka 发布订阅分组

发布:2018-11-27 16:52:00

惹不起的kafka

启动zookeeper


./zookeeper-server-start.sh ../config/zookeeper.pperties

启动kafka


./kafka-server-start.sh ../config/server.propertis

记得给配置文件配置分区数

代码

发布


from kafka import KafkaProducer
producer = KafkaProducer(bootstrap_servers='localhost:9092')

if __name__ == '__main__':
    for a in range(1,2):
        producer.send('chat',partition=1,value=b'some_message_bytes')
        producer.flush()

订阅分区



from kafka import KafkaConsumer

if __name__ == '__main__':

    consumer = KafkaConsumer("chat",bootstrap_servers=['localhost:9092'])
    consumer.subscribe(pattern="1")
    for msg in consumer:
        print(msg)

惹不起惹不起 rabbitMQ 的2500个队列才3g内存

kafka 一个topic （概念上的队列）分区（打的tag） 2000个竟然需要40g 储存。。。

口区。。。。

我要去试试 nsq ！！！

Friendship

Subscribe