Compare text

Find the difference between two text files

Real-time diff

Unified diff

Collapse lines

Highlight change

Syntax highlighting

Tools

kafka-python-send

Created 4 years agoDiff never expires

kafka.producer.kafka DEBUG: Starting the Kafka producer

kafka.metrics.metrics DEBUG: Added sensor with name connections-closed

kafka.metrics.metrics DEBUG: Added sensor with name connections-created

kafka.metrics.metrics DEBUG: Added sensor with name select-time

kafka.metrics.metrics DEBUG: Added sensor with name io-time

kafka.client DEBUG: Initiating connection to node bootstrap-0 at localhost:9092

kafka.metrics.metrics DEBUG: Added sensor with name bytes-sent-received

kafka.metrics.metrics DEBUG: Added sensor with name bytes-sent

kafka.metrics.metrics DEBUG: Added sensor with name bytes-received

kafka.metrics.metrics DEBUG: Added sensor with name request-latency

kafka.metrics.metrics DEBUG: Added sensor with name node-bootstrap-0.bytes-sent

kafka.metrics.metrics DEBUG: Added sensor with name node-bootstrap-0.bytes-received

kafka.metrics.metrics DEBUG: Added sensor with name node-bootstrap-0.latency

kafka.conn DEBUG: <BrokerConnection node_id=bootstrap-0 host=localhost:9092 <disconnected> [unspecified None]>: creating new socket

kafka.conn DEBUG: <BrokerConnection node_id=bootstrap-0 host=localhost:9092 <disconnected> [IPv4 ('127.0.0.1', 9092)]>: setting socket option (6, 1, 1)

kafka.conn INFO: <BrokerConnection node_id=bootstrap-0 host=localhost:9092 <connecting> [IPv4 ('127.0.0.1', 9092)]>: connecting to localhost:9092 [('127.0.0.1', 9092) IPv4]

kafka.conn INFO: Probing node bootstrap-0 broker version

kafka.conn DEBUG: <BrokerConnection node_id=bootstrap-0 host=localhost:9092 <connecting> [IPv4 ('127.0.0.1', 9092)]>: established TCP connection

kafka.conn INFO: <BrokerConnection node_id=bootstrap-0 host=localhost:9092 <connecting> [IPv4 ('127.0.0.1', 9092)]>: Connection complete.

kafka.client DEBUG: Node bootstrap-0 connected

kafka.protocol.parser DEBUG: Sending request ApiVersionRequest_v0()

kafka.conn DEBUG: <BrokerConnection node_id=bootstrap-0 host=localhost:9092 <connected> [IPv4 ('127.0.0.1', 9092)]> Request 1: ApiVersionRequest_v0()

kafka.protocol.parser DEBUG: Sending request MetadataRequest_v0(topics=[])

kafka.conn DEBUG: <BrokerConnection node_id=bootstrap-0 host=localhost:9092 <connected> [IPv4 ('127.0.0.1', 9092)]> Request 2: MetadataRequest_v0(topics=[])

kafka.protocol.parser DEBUG: Received correlation id: 1

kafka.protocol.parser DEBUG: Processing response ApiVersionResponse_v0

kafka.conn DEBUG: <BrokerConnection node_id=bootstrap-0 host=localhost:9092 <connected> [IPv4 ('127.0.0.1', 9092)]> Response 1 (103.414058685 ms): ApiVersionResponse_v0(error_code=0, api_versions=[(api_key=0, min_version=0, max_version=7), (api_key=1, min_version=0, max_version=10), (api_key=2, min_version=0, max_version=4), (api_key=3, min_version=0, max_version=7), (api_key=4, min_version=0, max_version=1), (api_key=5, min_version=0, max_version=0), (api_key=6, min_version=0, max_version=4), (api_key=7, min_version=0, max_version=1), (api_key=8, min_version=0, max_version=6), (api_key=9, min_version=0, max_version=5), (api_key=10, min_version=0, max_version=2), (api_key=11, min_version=0, max_version=3), (api_key=12, min_version=0, max_version=2), (api_key=13, min_version=0, max_version=2), (api_key=14, min_version=0, max_version=2), (api_key=15, min_version=0, max_version=2), (api_key=16, min_version=0, max_version=2), (api_key=17, min_version=0, max_version=1), (api_key=18, min_version=0, max_version=2), (api_key=19, min_version=0, max_version=3), (api_key=20, min_version=0, max_version=3), (api_key=21, min_version=0, max_version=1), (api_key=22, min_version=0, max_version=1), (api_key=23, min_version=0, max_version=2), (api_key=24, min_version=0, max_version=1), (api_key=25, min_version=0, max_version=1), (api_key=26, min_version=0, max_version=1), (api_key=27, min_version=0, max_version=0), (api_key=28, min_version=0, max_version=2), (api_key=29, min_version=0, max_version=1), (api_key=30, min_version=0, max_version=1), (api_key=31, min_version=0, max_version=1), (api_key=32, min_version=0, max_version=2), (api_key=33, min_version=0, max_version=1), (api_key=34, min_version=0, max_version=1), (api_key=35, min_version=0, max_version=1), (api_key=36, min_version=0, max_version=0), (api_key=37, min_version=0, max_version=1), (api_key=38, min_version=0, max_version=1), (api_key=39, min_version=0, max_version=1), (api_key=40, min_version=0, max_version=1), (api_key=41, min_version=0, max_version=1), (api_key=42, min_version=0, max_version=1)])

kafka.conn DEBUG: <BrokerConnection node_id=bootstrap-0 host=localhost:9092 <connected> [IPv4 ('127.0.0.1', 9092)]> Response 1 (103.10792923 ms): ApiVersionResponse_v0(error_code=0, api_versions=[(api_key=0, min_version=0, max_version=7), (api_key=1, min_version=0, max_version=10), (api_key=2, min_version=0, max_version=4), (api_key=3, min_version=0, max_version=7), (api_key=4, min_version=0, max_version=1), (api_key=5, min_version=0, max_version=0), (api_key=6, min_version=0, max_version=4), (api_key=7, min_version=0, max_version=1), (api_key=8, min_version=0, max_version=6), (api_key=9, min_version=0, max_version=5), (api_key=10, min_version=0, max_version=2), (api_key=11, min_version=0, max_version=3), (api_key=12, min_version=0, max_version=2), (api_key=13, min_version=0, max_version=2), (api_key=14, min_version=0, max_version=2), (api_key=15, min_version=0, max_version=2), (api_key=16, min_version=0, max_version=2), (api_key=17, min_version=0, max_version=1), (api_key=18, min_version=0, max_version=2), (api_key=19, min_version=0, max_version=3), (api_key=20, min_version=0, max_version=3), (api_key=21, min_version=0, max_version=1), (api_key=22, min_version=0, max_version=1), (api_key=23, min_version=0, max_version=2), (api_key=24, min_version=0, max_version=1), (api_key=25, min_version=0, max_version=1), (api_key=26, min_version=0, max_version=1), (api_key=27, min_version=0, max_version=0), (api_key=28, min_version=0, max_version=2), (api_key=29, min_version=0, max_version=1), (api_key=30, min_version=0, max_version=1), (api_key=31, min_version=0, max_version=1), (api_key=32, min_version=0, max_version=2), (api_key=33, min_version=0, max_version=1), (api_key=34, min_version=0, max_version=1), (api_key=35, min_version=0, max_version=1), (api_key=36, min_version=0, max_version=0), (api_key=37, min_version=0, max_version=1), (api_key=38, min_version=0, max_version=1), (api_key=39, min_version=0, max_version=1), (api_key=40, min_version=0, max_version=1), (api_key=41, min_version=0, max_version=1), (api_key=42, min_version=0, max_version=1)])

kafka.protocol.parser DEBUG: Received correlation id: 2

kafka.protocol.parser DEBUG: Processing response MetadataResponse_v0

kafka.conn DEBUG: <BrokerConnection node_id=bootstrap-0 host=localhost:9092 <connected> [IPv4 ('127.0.0.1', 9092)]> Response 2 (6.64901733398 ms): MetadataResponse_v0(brokers=[(node_id=0, host=u'Brahma', port=9092)], topics=[(error_code=0, topic=u'communication-uba2', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'complete_msg_topic', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'delay-hrs-1', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_rvm_preprocess', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_notification_ready', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_rvm_ready', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_preprocess', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'incomplete_msg_topic', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_transactional_ready', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'uba-p-event-communicationOpen_1', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_ready', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'jobseeker-event-notification-queue', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_notif_preprocess', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'delay-mins-10', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'__consumer_offsets', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=10, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=20, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=40, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=30, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=9, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=11, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=31, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=39, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=13, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=18, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=22, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=8, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=32, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=43, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=29, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=34, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=1, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=6, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=41, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=27, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=48, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=5, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=15, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=35, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=25, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=46, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=26, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=36, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=44, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=16, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=37, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=17, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=45, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=3, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=24, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=38, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=33, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=23, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=28, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=2, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=12, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=19, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=14, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=4, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=47, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=49, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=42, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=7, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=21, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_notification_preprocess', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_ng_ready', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_transactional_preprocess', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication-cm', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'kafka_test', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication-cm-high', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'uba-p-event-communicationSend_1', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_ng_preprocess', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_callbackstatus', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_notif_ready', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_cm_staging', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_whatsapp_incoming', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication-uba', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])])])

kafka.conn DEBUG: <BrokerConnection node_id=bootstrap-0 host=localhost:9092 <connected> [IPv4 ('127.0.0.1', 9092)]> Response 2 (6.61706924438 ms): MetadataResponse_v0(brokers=[(node_id=0, host=u'Brahma', port=9092)], topics=[(error_code=0, topic=u'communication-uba2', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'complete_msg_topic', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'delay-hrs-1', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_rvm_preprocess', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_notification_ready', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_rvm_ready', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_preprocess', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'incomplete_msg_topic', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_transactional_ready', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'uba-p-event-communicationOpen_1', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_ready', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'jobseeker-event-notification-queue', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_notif_preprocess', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'delay-mins-10', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'__consumer_offsets', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=10, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=20, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=40, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=30, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=9, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=11, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=31, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=39, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=13, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=18, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=22, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=8, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=32, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=43, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=29, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=34, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=1, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=6, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=41, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=27, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=48, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=5, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=15, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=35, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=25, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=46, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=26, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=36, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=44, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=16, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=37, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=17, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=45, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=3, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=24, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=38, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=33, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=23, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=28, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=2, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=12, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=19, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=14, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=4, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=47, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=49, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=42, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=7, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=21, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_notification_preprocess', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_ng_ready', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_transactional_preprocess', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication-cm', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'kafka_test', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication-cm-high', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'uba-p-event-communicationSend_1', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_ng_preprocess', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_callbackstatus', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_notif_ready', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_cm_staging', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_whatsapp_incoming', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication-uba', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])])])

kafka.conn INFO: Broker version identified as 1.0.0

kafka.conn INFO: Set configuration api_version=(1, 0, 0) to skip auto check_version requests on startup

kafka.metrics.metrics DEBUG: Added sensor with name bufferpool-wait-time

kafka.metrics.metrics DEBUG: Added sensor with name batch-size

kafka.metrics.metrics DEBUG: Added sensor with name compression-rate

kafka.metrics.metrics DEBUG: Added sensor with name queue-time

kafka.metrics.metrics DEBUG: Added sensor with name produce-throttle-time

kafka.metrics.metrics DEBUG: Added sensor with name records-per-request

kafka.metrics.metrics DEBUG: Added sensor with name bytes

kafka.metrics.metrics DEBUG: Added sensor with name record-retries

kafka.metrics.metrics DEBUG: Added sensor with name errors

kafka.metrics.metrics DEBUG: Added sensor with name record-size-max

kafka.producer.sender DEBUG: Starting Kafka producer I/O thread.

kafka.producer.kafka DEBUG: Kafka producer started

kafka.producer.sender DEBUG: Starting Kafka producer I/O thread.

kafka.client DEBUG: Sending metadata request MetadataRequest_v1(topics=NULL) to node bootstrap-0

kafka.protocol.parser DEBUG: Sending request MetadataRequest_v1(topics=NULL)

kafka.conn DEBUG: <BrokerConnection node_id=bootstrap-0 host=localhost:9092 <connected> [IPv4 ('127.0.0.1', 9092)]> Request 3: MetadataRequest_v1(topics=NULL)

kafka.producer.kafka DEBUG: Requesting metadata update for topic communication-cm

kafka.protocol.parser DEBUG: Received correlation id: 3

kafka.protocol.parser DEBUG: Processing response MetadataResponse_v1

kafka.conn DEBUG: <BrokerConnection node_id=bootstrap-0 host=localhost:9092 <connected> [IPv4 ('127.0.0.1', 9092)]> Response 3 (11.1081600189 ms): MetadataResponse_v1(brokers=[(node_id=0, host=u'Brahma', port=9092, rack=None)], controller_id=0, topics=[(error_code=0, topic=u'communication-uba2', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'complete_msg_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'delay-hrs-1', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_rvm_preprocess', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_notification_ready', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_rvm_ready', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_preprocess', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'incomplete_msg_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_transactional_ready', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'uba-p-event-communicationOpen_1', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_ready', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'jobseeker-event-notification-queue', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_notif_preprocess', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'delay-mins-10', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'__consumer_offsets', is_internal=True, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=10, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=20, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=40, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=30, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=9, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=11, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=31, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=39, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=13, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=18, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=22, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=8, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=32, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=43, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=29, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=34, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=1, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=6, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=41, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=27, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=48, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=5, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=15, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=35, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=25, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=46, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=26, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=36, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=44, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=16, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=37, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=17, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=45, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=3, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=24, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=38, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=33, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=23, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=28, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=2, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=12, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=19, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=14, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=4, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=47, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=49, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=42, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=7, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=21, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_notification_preprocess', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_ng_ready', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_transactional_preprocess', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication-cm', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'kafka_test', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication-cm-high', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'uba-p-event-communicationSend_1', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_ng_preprocess', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_callbackstatus', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_notif_ready', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_cm_staging', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_whatsapp_incoming', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication-uba', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])])])

kafka.conn DEBUG: <BrokerConnection node_id=bootstrap-0 host=localhost:9092 <connected> [IPv4 ('127.0.0.1', 9092)]> Response 3 (8.98408889771 ms): MetadataResponse_v1(brokers=[(node_id=0, host=u'Brahma', port=9092, rack=None)], controller_id=0, topics=[(error_code=0, topic=u'communication-uba2', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'complete_msg_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'delay-hrs-1', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_rvm_preprocess', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_notification_ready', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_rvm_ready', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_preprocess', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'incomplete_msg_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_transactional_ready', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'uba-p-event-communicationOpen_1', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_ready', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'jobseeker-event-notification-queue', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_notif_preprocess', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'delay-mins-10', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'__consumer_offsets', is_internal=True, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=10, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=20, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=40, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=30, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=9, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=11, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=31, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=39, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=13, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=18, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=22, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=8, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=32, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=43, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=29, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=34, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=1, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=6, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=41, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=27, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=48, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=5, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=15, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=35, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=25, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=46, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=26, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=36, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=44, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=16, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=37, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=17, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=45, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=3, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=24, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=38, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=33, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=23, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=28, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=2, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=12, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=19, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=14, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=4, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=47, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=49, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=42, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=7, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=21, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_notification_preprocess', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_ng_ready', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_transactional_preprocess', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication-cm', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'kafka_test', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication-cm-high', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'uba-p-event-communicationSend_1', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_ng_preprocess', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_callbackstatus', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_notif_ready', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_cm_staging', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_whatsapp_incoming', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication-uba', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])])])

kafka.cluster DEBUG: Updated cluster metadata to ClusterMetadata(brokers: 1, topics: 28, groups: 0)

kafka.producer.kafka DEBUG: _wait_on_metadata woke after 0.0251100063324 secs.

kafka.producer.kafka DEBUG: _wait_on_metadata woke after 0.0162889957428 secs.

kafka.producer.kafka DEBUG: Sending (key=None value={'headers': {'Source': 'py2-0.1', 'X-TRANSACTION-ID': '43758316004249703521', 'SystemId': 'analytics', 'AppId': 129}, 'payload': '{"to": [{"medium": "mail", "from": {"uid": "info@naukri.com", "name": "Naukri"}, "from_address": {"uid": "info@naukri.com", "name": "Naukri"}, "recipients": [{"userId": "123", "uid": "rana33@yopmail.com", "name": "rana"}]}], "eventCode": "test_email", "commId": "1234"}'} headers=[]) to TopicPartition(topic='communication-cm', partition=0)

kafka.producer.kafka DEBUG: Sending (key=None value={'headers': {'Source': 'py2-0.1', 'X-TRANSACTION-ID': '62430311064981508370', 'SystemId': 'analytics', 'AppId': 129}, 'payload': '{"to": [{"medium": "mail", "from": {"uid": "info@naukri.com", "name": "Naukri"}, "from_address": {"uid": "info@naukri.com", "name": "Naukri"}, "recipients": [{"userId": "123", "uid": "rana33@yopmail.com", "name": "rana"}]}], "eventCode": "test_email", "commId": "1234"}'} headers=[]) to TopicPartition(topic='communication-cm', partition=0)

kafka.producer.record_accumulator DEBUG: Allocating a new 16384 byte message buffer for TopicPartition(topic='communication-cm', partition=0)

kafka.producer.kafka DEBUG: Waking up the sender since TopicPartition(topic='communication-cm', partition=0) is either full or getting a new batch

ccs-python-client INFO: {'_produce_future': <kafka.producer.future.FutureProduceResult object at 0x7f3764d1f910>, '_errbacks': [], '_callbacks': [], 'args': (0, 1589032836212, None, -1, 449, -1), 'is_done': False, 'exception': None, 'value': None}

kafka.producer.kafka INFO: Closing the Kafka producer with inf secs timeout.

ccs-python-client INFO: Message sent 43758316004249703521

kafka.producer.sender DEBUG: Node 0 not ready; delaying produce of accumulated batch

kafka.producer.kafka INFO: Closing the Kafka producer with 0 secs timeout.

kafka.client DEBUG: Initiating connection to node 0 at Brahma:9092

kafka.producer.kafka INFO: Proceeding to force close the producer since pending requests could not be completed within timeout 0.

kafka.metrics.metrics DEBUG: Added sensor with name node-0.bytes-sent

kafka.producer.kafka DEBUG: The Kafka producer has closed.

kafka.metrics.metrics DEBUG: Added sensor with name node-0.bytes-received

kafka.producer.kafka INFO: Kafka producer closed

kafka.metrics.metrics DEBUG: Added sensor with name node-0.latency

kafka.conn DEBUG: <BrokerConnection node_id=0 host=Brahma:9092 <disconnected> [unspecified None]>: creating new socket

kafka.conn DEBUG: <BrokerConnection node_id=0 host=Brahma:9092 <disconnected> [IPv4 ('127.0.1.1', 9092)]>: setting socket option (6, 1, 1)

kafka.conn INFO: <BrokerConnection node_id=0 host=Brahma:9092 <connecting> [IPv4 ('127.0.1.1', 9092)]>: connecting to Brahma:9092 [('127.0.1.1', 9092) IPv4]

kafka.conn DEBUG: <BrokerConnection node_id=0 host=Brahma:9092 <connecting> [IPv4 ('127.0.1.1', 9092)]>: established TCP connection

kafka.conn INFO: <BrokerConnection node_id=0 host=Brahma:9092 <connecting> [IPv4 ('127.0.1.1', 9092)]>: Connection complete.

kafka.client DEBUG: Node 0 connected

kafka.conn INFO: <BrokerConnection node_id=bootstrap-0 host=localhost:9092 <connected> [IPv4 ('127.0.0.1', 9092)]>: Closing connection.

kafka.producer.sender DEBUG: Beginning shutdown of Kafka producer I/O thread, sending remaining records.

kafka.metrics.metrics DEBUG: Added sensor with name topic.communication-cm.records-per-batch

kafka.metrics.metrics DEBUG: Added sensor with name topic.communication-cm.bytes

kafka.metrics.metrics DEBUG: Added sensor with name topic.communication-cm.compression-rate

kafka.metrics.metrics DEBUG: Added sensor with name topic.communication-cm.record-retries

kafka.metrics.metrics DEBUG: Added sensor with name topic.communication-cm.record-errors

kafka.producer.sender DEBUG: Nodes with data ready to send: set([0])

kafka.producer.sender DEBUG: Created 1 produce requests: {0: ProduceRequest_v3(transactional_id=None, required_acks=1, timeout=2000, topics=[(topic='communication-cm', partitions=[(partition=0, messages='\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01\xfb\x00\x00\x00\x00\x02\xe1\x91\xe7\x0b\x00\x00\x00\x00\x00\x00\x00\x00\x01q\xf9\xbb\xfa\r\x00\x00\x01q\xf9\xbb\xfa\r\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\x00\x00\x00\x01\x90\x07\x00\x00\x00\x01\x82\x07{"headers": {"Source": "py2-0.1...')])])}

kafka.producer.sender DEBUG: Sending Produce Request: ProduceRequest_v3(transactional_id=None, required_acks=1, timeout=2000, topics=[(topic='communication-cm', partitions=[(partition=0, messages='\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01\xfb\x00\x00\x00\x00\x02\xe1\x91\xe7\x0b\x00\x00\x00\x00\x00\x00\x00\x00\x01q\xf9\xbb\xfa\r\x00\x00\x01q\xf9\xbb\xfa\r\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\x00\x00\x00\x01\x90\x07\x00\x00\x00\x01\x82\x07{"headers": {"Source": "py2-0.1...')])])

kafka.protocol.parser DEBUG: Sending request ProduceRequest_v3(transactional_id=None, required_acks=1, timeout=2000, topics=[(topic='communication-cm', partitions=[(partition=0, messages='\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01\xfb\x00\x00\x00\x00\x02\xe1\x91\xe7\x0b\x00\x00\x00\x00\x00\x00\x00\x00\x01q\xf9\xbb\xfa\r\x00\x00\x01q\xf9\xbb\xfa\r\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\x00\x00\x00\x01\x90\x07\x00\x00\x00\x01\x82\x07{"headers": {"Source": "py2-0.1...')])])

kafka.conn DEBUG: <BrokerConnection node_id=0 host=Brahma:9092 <connected> [IPv4 ('127.0.1.1', 9092)]> Request 1: ProduceRequest_v3(transactional_id=None, required_acks=1, timeout=2000, topics=[(topic='communication-cm', partitions=[(partition=0, messages='\

Saved diffs

Original text

Open file

kafka.producer.kafka DEBUG: Starting the Kafka producer
kafka.metrics.metrics DEBUG: Added sensor with name connections-closed
kafka.metrics.metrics DEBUG: Added sensor with name connections-created
kafka.metrics.metrics DEBUG: Added sensor with name select-time
kafka.metrics.metrics DEBUG: Added sensor with name io-time
kafka.client DEBUG: Initiating connection to node bootstrap-0 at localhost:9092
kafka.metrics.metrics DEBUG: Added sensor with name bytes-sent-received
kafka.metrics.metrics DEBUG: Added sensor with name bytes-sent
kafka.metrics.metrics DEBUG: Added sensor with name bytes-received
kafka.metrics.metrics DEBUG: Added sensor with name request-latency
kafka.metrics.metrics DEBUG: Added sensor with name node-bootstrap-0.bytes-sent
kafka.metrics.metrics DEBUG: Added sensor with name node-bootstrap-0.bytes-received
kafka.metrics.metrics DEBUG: Added sensor with name node-bootstrap-0.latency
kafka.conn DEBUG: <BrokerConnection node_id=bootstrap-0 host=localhost:9092 <disconnected> [unspecified None]>: creating new socket
kafka.conn DEBUG: <BrokerConnection node_id=bootstrap-0 host=localhost:9092 <disconnected> [IPv4 ('127.0.0.1', 9092)]>: setting socket option (6, 1, 1)
kafka.conn INFO: <BrokerConnection node_id=bootstrap-0 host=localhost:9092 <connecting> [IPv4 ('127.0.0.1', 9092)]>: connecting to localhost:9092 [('127.0.0.1', 9092) IPv4]
kafka.conn INFO: Probing node bootstrap-0 broker version
kafka.conn DEBUG: <BrokerConnection node_id=bootstrap-0 host=localhost:9092 <connecting> [IPv4 ('127.0.0.1', 9092)]>: established TCP connection
kafka.conn INFO: <BrokerConnection node_id=bootstrap-0 host=localhost:9092 <connecting> [IPv4 ('127.0.0.1', 9092)]>: Connection complete.
kafka.client DEBUG: Node bootstrap-0 connected
kafka.protocol.parser DEBUG: Sending request ApiVersionRequest_v0()
kafka.conn DEBUG: <BrokerConnection node_id=bootstrap-0 host=localhost:9092 <connected> [IPv4 ('127.0.0.1', 9092)]> Request 1: ApiVersionRequest_v0()
kafka.protocol.parser DEBUG: Sending request MetadataRequest_v0(topics=[])
kafka.conn DEBUG: <BrokerConnection node_id=bootstrap-0 host=localhost:9092 <connected> [IPv4 ('127.0.0.1', 9092)]> Request 2: MetadataRequest_v0(topics=[])
kafka.protocol.parser DEBUG: Received correlation id: 1
kafka.protocol.parser DEBUG: Processing response ApiVersionResponse_v0
kafka.conn DEBUG: <BrokerConnection node_id=bootstrap-0 host=localhost:9092 <connected> [IPv4 ('127.0.0.1', 9092)]> Response 1 (103.414058685 ms): ApiVersionResponse_v0(error_code=0, api_versions=[(api_key=0, min_version=0, max_version=7), (api_key=1, min_version=0, max_version=10), (api_key=2, min_version=0, max_version=4), (api_key=3, min_version=0, max_version=7), (api_key=4, min_version=0, max_version=1), (api_key=5, min_version=0, max_version=0), (api_key=6, min_version=0, max_version=4), (api_key=7, min_version=0, max_version=1), (api_key=8, min_version=0, max_version=6), (api_key=9, min_version=0, max_version=5), (api_key=10, min_version=0, max_version=2), (api_key=11, min_version=0, max_version=3), (api_key=12, min_version=0, max_version=2), (api_key=13, min_version=0, max_version=2), (api_key=14, min_version=0, max_version=2), (api_key=15, min_version=0, max_version=2), (api_key=16, min_version=0, max_version=2), (api_key=17, min_version=0, max_version=1), (api_key=18, min_version=0, max_version=2), (api_key=19, min_version=0, max_version=3), (api_key=20, min_version=0, max_version=3), (api_key=21, min_version=0, max_version=1), (api_key=22, min_version=0, max_version=1), (api_key=23, min_version=0, max_version=2), (api_key=24, min_version=0, max_version=1), (api_key=25, min_version=0, max_version=1), (api_key=26, min_version=0, max_version=1), (api_key=27, min_version=0, max_version=0), (api_key=28, min_version=0, max_version=2), (api_key=29, min_version=0, max_version=1), (api_key=30, min_version=0, max_version=1), (api_key=31, min_version=0, max_version=1), (api_key=32, min_version=0, max_version=2), (api_key=33, min_version=0, max_version=1), (api_key=34, min_version=0, max_version=1), (api_key=35, min_version=0, max_version=1), (api_key=36, min_version=0, max_version=0), (api_key=37, min_version=0, max_version=1), (api_key=38, min_version=0, max_version=1), (api_key=39, min_version=0, max_version=1), (api_key=40, min_version=0, max_version=1), (api_key=41, min_version=0, max_version=1), (api_key=42, min_version=0, max_version=1)])
kafka.protocol.parser DEBUG: Received correlation id: 2
kafka.protocol.parser DEBUG: Processing response MetadataResponse_v0
kafka.conn DEBUG: <BrokerConnection node_id=bootstrap-0 host=localhost:9092 <connected> [IPv4 ('127.0.0.1', 9092)]> Response 2 (6.64901733398 ms): MetadataResponse_v0(brokers=[(node_id=0, host=u'Brahma', port=9092)], topics=[(error_code=0, topic=u'communication-uba2', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'complete_msg_topic', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'delay-hrs-1', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_rvm_preprocess', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_notification_ready', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_rvm_ready', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_preprocess', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'incomplete_msg_topic', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_transactional_ready', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'uba-p-event-communicationOpen_1', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_ready', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'jobseeker-event-notification-queue', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_notif_preprocess', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'delay-mins-10', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'__consumer_offsets', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=10, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=20, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=40, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=30, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=9, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=11, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=31, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=39, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=13, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=18, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=22, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=8, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=32, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=43, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=29, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=34, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=1, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=6, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=41, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=27, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=48, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=5, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=15, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=35, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=25, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=46, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=26, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=36, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=44, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=16, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=37, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=17, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=45, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=3, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=24, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=38, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=33, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=23, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=28, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=2, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=12, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=19, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=14, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=4, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=47, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=49, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=42, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=7, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=21, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_notification_preprocess', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_ng_ready', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_transactional_preprocess', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication-cm', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'kafka_test', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication-cm-high', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'uba-p-event-communicationSend_1', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_ng_preprocess', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_callbackstatus', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_notif_ready', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_cm_staging', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_whatsapp_incoming', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication-uba', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])])])
kafka.conn INFO: Broker version identified as 1.0.0
kafka.conn INFO: Set configuration api_version=(1, 0, 0) to skip auto check_version requests on startup
kafka.metrics.metrics DEBUG: Added sensor with name bufferpool-wait-time
kafka.metrics.metrics DEBUG: Added sensor with name batch-size
kafka.metrics.metrics DEBUG: Added sensor with name compression-rate
kafka.metrics.metrics DEBUG: Added sensor with name queue-time
kafka.metrics.metrics DEBUG: Added sensor with name produce-throttle-time
kafka.metrics.metrics DEBUG: Added sensor with name records-per-request
kafka.metrics.metrics DEBUG: Added sensor with name bytes
kafka.metrics.metrics DEBUG: Added sensor with name record-retries
kafka.metrics.metrics DEBUG: Added sensor with name errors
kafka.metrics.metrics DEBUG: Added sensor with name record-size-max
kafka.producer.sender DEBUG: Starting Kafka producer I/O thread.
kafka.producer.kafka DEBUG: Kafka producer started
kafka.client DEBUG: Sending metadata request MetadataRequest_v1(topics=NULL) to node bootstrap-0
kafka.protocol.parser DEBUG: Sending request MetadataRequest_v1(topics=NULL)
kafka.conn DEBUG: <BrokerConnection node_id=bootstrap-0 host=localhost:9092 <connected> [IPv4 ('127.0.0.1', 9092)]> Request 3: MetadataRequest_v1(topics=NULL)
kafka.producer.kafka DEBUG: Requesting metadata update for topic communication-cm
kafka.protocol.parser DEBUG: Received correlation id: 3
kafka.protocol.parser DEBUG: Processing response MetadataResponse_v1
kafka.conn DEBUG: <BrokerConnection node_id=bootstrap-0 host=localhost:9092 <connected> [IPv4 ('127.0.0.1', 9092)]> Response 3 (11.1081600189 ms): MetadataResponse_v1(brokers=[(node_id=0, host=u'Brahma', port=9092, rack=None)], controller_id=0, topics=[(error_code=0, topic=u'communication-uba2', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'complete_msg_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'delay-hrs-1', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_rvm_preprocess', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_notification_ready', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_rvm_ready', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_preprocess', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'incomplete_msg_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_transactional_ready', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'uba-p-event-communicationOpen_1', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_ready', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'jobseeker-event-notification-queue', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_notif_preprocess', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'delay-mins-10', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'__consumer_offsets', is_internal=True, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=10, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=20, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=40, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=30, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=9, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=11, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=31, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=39, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=13, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=18, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=22, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=8, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=32, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=43, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=29, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=34, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=1, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=6, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=41, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=27, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=48, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=5, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=15, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=35, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=25, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=46, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=26, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=36, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=44, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=16, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=37, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=17, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=45, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=3, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=24, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=38, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=33, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=23, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=28, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=2, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=12, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=19, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=14, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=4, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=47, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=49, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=42, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=7, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=21, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_notification_preprocess', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_ng_ready', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_transactional_preprocess', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication-cm', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'kafka_test', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication-cm-high', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'uba-p-event-communicationSend_1', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_ng_preprocess', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_callbackstatus', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_notif_ready', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_cm_staging', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_whatsapp_incoming', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication-uba', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])])])
kafka.cluster DEBUG: Updated cluster metadata to ClusterMetadata(brokers: 1, topics: 28, groups: 0)
kafka.producer.kafka DEBUG: _wait_on_metadata woke after 0.0251100063324 secs.
kafka.producer.kafka DEBUG: Sending (key=None value={'headers': {'Source': 'py2-0.1', 'X-TRANSACTION-ID': '43758316004249703521', 'SystemId': 'analytics', 'AppId': 129}, 'payload': '{"to": [{"medium": "mail", "from": {"uid": "info@naukri.com", "name": "Naukri"}, "from_address": {"uid": "info@naukri.com", "name": "Naukri"}, "recipients": [{"userId": "123", "uid": "rana33@yopmail.com", "name": "rana"}]}], "eventCode": "test_email", "commId": "1234"}'} headers=[]) to TopicPartition(topic='communication-cm', partition=0)
kafka.producer.record_accumulator DEBUG: Allocating a new 16384 byte message buffer for TopicPartition(topic='communication-cm', partition=0)
kafka.producer.kafka DEBUG: Waking up the sender since TopicPartition(topic='communication-cm', partition=0) is either full or getting a new batch
ccs-python-client INFO: {'_produce_future': <kafka.producer.future.FutureProduceResult object at 0x7f3764d1f910>, '_errbacks': [], '_callbacks': [], 'args': (0, 1589032836212, None, -1, 449, -1), 'is_done': False, 'exception': None, 'value': None}
ccs-python-client INFO: Message sent 43758316004249703521
kafka.producer.sender DEBUG: Node 0 not ready; delaying produce of accumulated batch
kafka.producer.kafka INFO: Closing the Kafka producer with 0 secs timeout.
kafka.client DEBUG: Initiating connection to node 0 at Brahma:9092
kafka.producer.kafka INFO: Proceeding to force close the producer since pending requests could not be completed within timeout 0.
kafka.metrics.metrics DEBUG: Added sensor with name node-0.bytes-sent
kafka.producer.kafka DEBUG: The Kafka producer has closed.
kafka.metrics.metrics DEBUG: Added sensor with name node-0.bytes-received
kafka.producer.kafka INFO: Kafka producer closed

Changed text

Open file

kafka.producer.kafka DEBUG: Starting the Kafka producer
kafka.metrics.metrics DEBUG: Added sensor with name connections-closed
kafka.metrics.metrics DEBUG: Added sensor with name connections-created
kafka.metrics.metrics DEBUG: Added sensor with name select-time
kafka.metrics.metrics DEBUG: Added sensor with name io-time
kafka.client DEBUG: Initiating connection to node bootstrap-0 at localhost:9092
kafka.metrics.metrics DEBUG: Added sensor with name bytes-sent-received
kafka.metrics.metrics DEBUG: Added sensor with name bytes-sent
kafka.metrics.metrics DEBUG: Added sensor with name bytes-received
kafka.metrics.metrics DEBUG: Added sensor with name request-latency
kafka.metrics.metrics DEBUG: Added sensor with name node-bootstrap-0.bytes-sent
kafka.metrics.metrics DEBUG: Added sensor with name node-bootstrap-0.bytes-received
kafka.metrics.metrics DEBUG: Added sensor with name node-bootstrap-0.latency
kafka.conn DEBUG: <BrokerConnection node_id=bootstrap-0 host=localhost:9092 <disconnected> [unspecified None]>: creating new socket
kafka.conn DEBUG: <BrokerConnection node_id=bootstrap-0 host=localhost:9092 <disconnected> [IPv4 ('127.0.0.1', 9092)]>: setting socket option (6, 1, 1)
kafka.conn INFO: <BrokerConnection node_id=bootstrap-0 host=localhost:9092 <connecting> [IPv4 ('127.0.0.1', 9092)]>: connecting to localhost:9092 [('127.0.0.1', 9092) IPv4]
kafka.conn INFO: Probing node bootstrap-0 broker version
kafka.conn DEBUG: <BrokerConnection node_id=bootstrap-0 host=localhost:9092 <connecting> [IPv4 ('127.0.0.1', 9092)]>: established TCP connection
kafka.conn INFO: <BrokerConnection node_id=bootstrap-0 host=localhost:9092 <connecting> [IPv4 ('127.0.0.1', 9092)]>: Connection complete.
kafka.client DEBUG: Node bootstrap-0 connected
kafka.protocol.parser DEBUG: Sending request ApiVersionRequest_v0()
kafka.conn DEBUG: <BrokerConnection node_id=bootstrap-0 host=localhost:9092 <connected> [IPv4 ('127.0.0.1', 9092)]> Request 1: ApiVersionRequest_v0()
kafka.protocol.parser DEBUG: Sending request MetadataRequest_v0(topics=[])
kafka.conn DEBUG: <BrokerConnection node_id=bootstrap-0 host=localhost:9092 <connected> [IPv4 ('127.0.0.1', 9092)]> Request 2: MetadataRequest_v0(topics=[])
kafka.protocol.parser DEBUG: Received correlation id: 1
kafka.protocol.parser DEBUG: Processing response ApiVersionResponse_v0
kafka.conn DEBUG: <BrokerConnection node_id=bootstrap-0 host=localhost:9092 <connected> [IPv4 ('127.0.0.1', 9092)]> Response 1 (103.10792923 ms): ApiVersionResponse_v0(error_code=0, api_versions=[(api_key=0, min_version=0, max_version=7), (api_key=1, min_version=0, max_version=10), (api_key=2, min_version=0, max_version=4), (api_key=3, min_version=0, max_version=7), (api_key=4, min_version=0, max_version=1), (api_key=5, min_version=0, max_version=0), (api_key=6, min_version=0, max_version=4), (api_key=7, min_version=0, max_version=1), (api_key=8, min_version=0, max_version=6), (api_key=9, min_version=0, max_version=5), (api_key=10, min_version=0, max_version=2), (api_key=11, min_version=0, max_version=3), (api_key=12, min_version=0, max_version=2), (api_key=13, min_version=0, max_version=2), (api_key=14, min_version=0, max_version=2), (api_key=15, min_version=0, max_version=2), (api_key=16, min_version=0, max_version=2), (api_key=17, min_version=0, max_version=1), (api_key=18, min_version=0, max_version=2), (api_key=19, min_version=0, max_version=3), (api_key=20, min_version=0, max_version=3), (api_key=21, min_version=0, max_version=1), (api_key=22, min_version=0, max_version=1), (api_key=23, min_version=0, max_version=2), (api_key=24, min_version=0, max_version=1), (api_key=25, min_version=0, max_version=1), (api_key=26, min_version=0, max_version=1), (api_key=27, min_version=0, max_version=0), (api_key=28, min_version=0, max_version=2), (api_key=29, min_version=0, max_version=1), (api_key=30, min_version=0, max_version=1), (api_key=31, min_version=0, max_version=1), (api_key=32, min_version=0, max_version=2), (api_key=33, min_version=0, max_version=1), (api_key=34, min_version=0, max_version=1), (api_key=35, min_version=0, max_version=1), (api_key=36, min_version=0, max_version=0), (api_key=37, min_version=0, max_version=1), (api_key=38, min_version=0, max_version=1), (api_key=39, min_version=0, max_version=1), (api_key=40, min_version=0, max_version=1), (api_key=41, min_version=0, max_version=1), (api_key=42, min_version=0, max_version=1)])
kafka.protocol.parser DEBUG: Received correlation id: 2
kafka.protocol.parser DEBUG: Processing response MetadataResponse_v0
kafka.conn DEBUG: <BrokerConnection node_id=bootstrap-0 host=localhost:9092 <connected> [IPv4 ('127.0.0.1', 9092)]> Response 2 (6.61706924438 ms): MetadataResponse_v0(brokers=[(node_id=0, host=u'Brahma', port=9092)], topics=[(error_code=0, topic=u'communication-uba2', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'complete_msg_topic', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'delay-hrs-1', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_rvm_preprocess', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_notification_ready', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_rvm_ready', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_preprocess', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'incomplete_msg_topic', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_transactional_ready', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'uba-p-event-communicationOpen_1', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_ready', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'jobseeker-event-notification-queue', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_notif_preprocess', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'delay-mins-10', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'__consumer_offsets', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=10, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=20, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=40, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=30, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=9, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=11, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=31, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=39, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=13, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=18, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=22, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=8, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=32, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=43, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=29, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=34, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=1, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=6, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=41, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=27, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=48, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=5, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=15, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=35, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=25, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=46, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=26, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=36, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=44, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=16, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=37, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=17, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=45, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=3, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=24, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=38, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=33, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=23, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=28, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=2, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=12, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=19, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=14, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=4, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=47, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=49, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=42, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=7, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=21, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_notification_preprocess', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_ng_ready', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_transactional_preprocess', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication-cm', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'kafka_test', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication-cm-high', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'uba-p-event-communicationSend_1', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_ng_preprocess', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_callbackstatus', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_notif_ready', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_cm_staging', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_whatsapp_incoming', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication-uba', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])])])
kafka.conn INFO: Broker version identified as 1.0.0
kafka.conn INFO: Set configuration api_version=(1, 0, 0) to skip auto check_version requests on startup
kafka.metrics.metrics DEBUG: Added sensor with name bufferpool-wait-time
kafka.metrics.metrics DEBUG: Added sensor with name batch-size
kafka.metrics.metrics DEBUG: Added sensor with name compression-rate
kafka.metrics.metrics DEBUG: Added sensor with name queue-time
kafka.metrics.metrics DEBUG: Added sensor with name produce-throttle-time
kafka.metrics.metrics DEBUG: Added sensor with name records-per-request
kafka.metrics.metrics DEBUG: Added sensor with name bytes
kafka.metrics.metrics DEBUG: Added sensor with name record-retries
kafka.metrics.metrics DEBUG: Added sensor with name errors
kafka.metrics.metrics DEBUG: Added sensor with name record-size-max
kafka.producer.kafka DEBUG: Kafka producer started
kafka.producer.sender DEBUG: Starting Kafka producer I/O thread.
kafka.client DEBUG: Sending metadata request MetadataRequest_v1(topics=NULL) to node bootstrap-0
kafka.protocol.parser DEBUG: Sending request MetadataRequest_v1(topics=NULL)
kafka.conn DEBUG: <BrokerConnection node_id=bootstrap-0 host=localhost:9092 <connected> [IPv4 ('127.0.0.1', 9092)]> Request 3: MetadataRequest_v1(topics=NULL)
kafka.producer.kafka DEBUG: Requesting metadata update for topic communication-cm
kafka.protocol.parser DEBUG: Received correlation id: 3
kafka.protocol.parser DEBUG: Processing response MetadataResponse_v1
kafka.conn DEBUG: <BrokerConnection node_id=bootstrap-0 host=localhost:9092 <connected> [IPv4 ('127.0.0.1', 9092)]> Response 3 (8.98408889771 ms): MetadataResponse_v1(brokers=[(node_id=0, host=u'Brahma', port=9092, rack=None)], controller_id=0, topics=[(error_code=0, topic=u'communication-uba2', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'complete_msg_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'delay-hrs-1', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_rvm_preprocess', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_notification_ready', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_rvm_ready', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_preprocess', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'incomplete_msg_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_transactional_ready', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'uba-p-event-communicationOpen_1', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_ready', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'jobseeker-event-notification-queue', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_notif_preprocess', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'delay-mins-10', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'__consumer_offsets', is_internal=True, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=10, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=20, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=40, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=30, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=9, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=11, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=31, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=39, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=13, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=18, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=22, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=8, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=32, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=43, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=29, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=34, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=1, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=6, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=41, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=27, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=48, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=5, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=15, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=35, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=25, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=46, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=26, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=36, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=44, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=16, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=37, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=17, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=45, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=3, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=24, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=38, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=33, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=23, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=28, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=2, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=12, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=19, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=14, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=4, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=47, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=49, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=42, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=7, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=21, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_notification_preprocess', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_ng_ready', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_transactional_preprocess', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication-cm', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'kafka_test', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication-cm-high', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'uba-p-event-communicationSend_1', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_ng_preprocess', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_callbackstatus', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_notif_ready', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_cm_staging', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_whatsapp_incoming', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication-uba', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])])])
kafka.cluster DEBUG: Updated cluster metadata to ClusterMetadata(brokers: 1, topics: 28, groups: 0)
kafka.producer.kafka DEBUG: _wait_on_metadata woke after 0.0162889957428 secs.
kafka.producer.kafka DEBUG: Sending (key=None value={'headers': {'Source': 'py2-0.1', 'X-TRANSACTION-ID': '62430311064981508370', 'SystemId': 'analytics', 'AppId': 129}, 'payload': '{"to": [{"medium": "mail", "from": {"uid": "info@naukri.com", "name": "Naukri"}, "from_address": {"uid": "info@naukri.com", "name": "Naukri"}, "recipients": [{"userId": "123", "uid": "rana33@yopmail.com", "name": "rana"}]}], "eventCode": "test_email", "commId": "1234"}'} headers=[]) to TopicPartition(topic='communication-cm', partition=0)
kafka.producer.record_accumulator DEBUG: Allocating a new 16384 byte message buffer for TopicPartition(topic='communication-cm', partition=0)
kafka.producer.kafka DEBUG: Waking up the sender since TopicPartition(topic='communication-cm', partition=0) is either full or getting a new batch
kafka.producer.kafka INFO: Closing the Kafka producer with inf secs timeout.
kafka.producer.sender DEBUG: Node 0 not ready; delaying produce of accumulated batch
kafka.client DEBUG: Initiating connection to node 0 at Brahma:9092
kafka.metrics.metrics DEBUG: Added sensor with name node-0.bytes-sent
kafka.metrics.metrics DEBUG: Added sensor with name node-0.bytes-received
kafka.metrics.metrics DEBUG: Added sensor with name node-0.latency
kafka.conn DEBUG: <BrokerConnection node_id=0 host=Brahma:9092 <disconnected> [unspecified None]>: creating new socket
kafka.conn DEBUG: <BrokerConnection node_id=0 host=Brahma:9092 <disconnected> [IPv4 ('127.0.1.1', 9092)]>: setting socket option (6, 1, 1)
kafka.conn INFO: <BrokerConnection node_id=0 host=Brahma:9092 <connecting> [IPv4 ('127.0.1.1', 9092)]>: connecting to Brahma:9092 [('127.0.1.1', 9092) IPv4]
kafka.conn DEBUG: <BrokerConnection node_id=0 host=Brahma:9092 <connecting> [IPv4 ('127.0.1.1', 9092)]>: established TCP connection
kafka.conn INFO: <BrokerConnection node_id=0 host=Brahma:9092 <connecting> [IPv4 ('127.0.1.1', 9092)]>: Connection complete.
kafka.client DEBUG: Node 0 connected
kafka.conn INFO: <BrokerConnection node_id=bootstrap-0 host=localhost:9092 <connected> [IPv4 ('127.0.0.1', 9092)]>: Closing connection. 
kafka.producer.sender DEBUG: Beginning shutdown of Kafka producer I/O thread, sending remaining records.
kafka.metrics.metrics DEBUG: Added sensor with name topic.communication-cm.records-per-batch
kafka.metrics.metrics DEBUG: Added sensor with name topic.communication-cm.bytes
kafka.metrics.metrics DEBUG: Added sensor with name topic.communication-cm.compression-rate
kafka.metrics.metrics DEBUG: Added sensor with name topic.communication-cm.record-retries
kafka.metrics.metrics DEBUG: Added sensor with name topic.communication-cm.record-errors
kafka.producer.sender DEBUG: Nodes with data ready to send: set([0])
kafka.producer.sender DEBUG: Created 1 produce requests: {0: ProduceRequest_v3(transactional_id=None, required_acks=1, timeout=2000, topics=[(topic='communication-cm', partitions=[(partition=0, messages='\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01\xfb\x00\x00\x00\x00\x02\xe1\x91\xe7\x0b\x00\x00\x00\x00\x00\x00\x00\x00\x01q\xf9\xbb\xfa\r\x00\x00\x01q\xf9\xbb\xfa\r\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\x00\x00\x00\x01\x90\x07\x00\x00\x00\x01\x82\x07{"headers": {"Source": "py2-0.1...')])])}
kafka.producer.sender DEBUG: Sending Produce Request: ProduceRequest_v3(transactional_id=None, required_acks=1, timeout=2000, topics=[(topic='communication-cm', partitions=[(partition=0, messages='\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01\xfb\x00\x00\x00\x00\x02\xe1\x91\xe7\x0b\x00\x00\x00\x00\x00\x00\x00\x00\x01q\xf9\xbb\xfa\r\x00\x00\x01q\xf9\xbb\xfa\r\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\x00\x00\x00\x01\x90\x07\x00\x00\x00\x01\x82\x07{"headers": {"Source": "py2-0.1...')])])
kafka.protocol.parser DEBUG: Sending request ProduceRequest_v3(transactional_id=None, required_acks=1, timeout=2000, topics=[(topic='communication-cm', partitions=[(partition=0, messages='\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01\xfb\x00\x00\x00\x00\x02\xe1\x91\xe7\x0b\x00\x00\x00\x00\x00\x00\x00\x00\x01q\xf9\xbb\xfa\r\x00\x00\x01q\xf9\xbb\xfa\r\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\x00\x00\x00\x01\x90\x07\x00\x00\x00\x01\x82\x07{"headers": {"Source": "py2-0.1...')])])
kafka.conn DEBUG: <BrokerConnection node_id=0 host=Brahma:9092 <connected> [IPv4 ('127.0.1.1', 9092)]> Request 1: ProduceRequest_v3(transactional_id=None, required_acks=1, timeout=2000, topics=[(topic='communication-cm', partitions=[(partition=0, messages='\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01\xfb\x00\x00\x00\x00\x02\xe1\x91\xe7\x0b\x00\x00\x00\x00\x00\x00\x00\x00\x01q\xf9\xbb\xfa\r\x00\x00\x01q\xf9\xbb\xfa\r\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\x00\x00\x00\x01\x90\x07\x00\x00\x00\x01\x82\x07{"headers": {"Source": "py2-0.1...')])])
kafka.protocol.parser DEBUG: Received correlation id: 1
kafka.protocol.parser DEBUG: Processing response ProduceResponse_v3
kafka.conn DEBUG: <BrokerConnection node_id=0 host=Brahma:9092 <connected> [IPv4 ('127.0.1.1', 9092)]> Response 1 (1.69205665588 ms): ProduceResponse_v3(topics=[(topic=u'communication-cm', partitions=[(partition=0, error_code=0, offset=701, timestamp=-1)])], throttle_time_ms=0)
kafka.producer.sender DEBUG: Parsing produce response: ProduceResponse_v3(topics=[(topic=u'communication-cm', partitions=[(partition=0, error_code=0, offset=701, timestamp=-1)])], throttle_time_ms=0)
kafka.producer.record_accumulator DEBUG: Produced messages to topic-partition TopicPartition(topic='communication-cm', partition=0) with base offset 701 and error None.
kafka.conn INFO: <BrokerConnection node_id=0 host=Brahma:9092 <connected> [IPv4 ('127.0.1.1', 9092)]>: Closing connection. 
kafka.conn DEBUG: <BrokerConnection node_id=0 host=Brahma:9092 <connected> [IPv4 ('127.0.1.1', 9092)]>: reconnect backoff 0.0466699616725 after 1 failures
kafka.producer.sender DEBUG: Shutdown of Kafka producer I/O thread has completed.
kafka.producer.kafka DEBUG: The Kafka producer has closed.
ccs-python-client INFO: {'_produce_future': <kafka.producer.future.FutureProduceResult object at 0x7f627a8ed890>, '_errbacks': [], '_callbacks': [], 'args': (0, 1589032778253, None, -1, 449, -1), 'is_done': True, 'exception': None, 'value': RecordMetadata(topic='communication-cm', partition=0, topic_partition=TopicPartition(topic='communication-cm', partition=0), offset=701, timestamp=1589032778253, checksum=None, serialized_key_size=-1, serialized_value_size=449, serialized_header_size=-1)}
ccs-python-client INFO: Message sent 62430311064981508370