Diff
checker
Text
Text
Images
Documents
Excel
Folders
Legal
Enterprise
Desktop
Pricing
Sign in
Download Diffchecker Desktop
Compare text
Find the difference between two text files
Tools
History
Real-time editor
Hide whitespace changes
Hide unchanged lines
Disable line wrap
Layout
Split
Unified
Diff precision
Smart
Word
Char
Text styles
Change appearance
Syntax highlighting
Choose syntax
Ignore
Transform text
Go to first change
Edit input
Diffchecker Desktop
The most secure way to run Diffchecker. Get the Diffchecker Desktop app: your diffs never leave your computer!
Get Desktop
kafka-python-send
Created
6 years ago
Diff never expires
Clear
Export
Share
Explain
15 removals
Lines
Total
Removed
Characters
Total
Removed
To continue using this feature, upgrade to
Diff
checker
Pro
View Pricing
66 lines
Copy
29 additions
Lines
Total
Added
Characters
Total
Added
To continue using this feature, upgrade to
Diff
checker
Pro
View Pricing
80 lines
Copy
kafka.producer.kafka DEBUG: Starting the Kafka producer
kafka.producer.kafka DEBUG: Starting the Kafka producer
kafka.metrics.metrics DEBUG: Added sensor with name connections-closed
kafka.metrics.metrics DEBUG: Added sensor with name connections-closed
kafka.metrics.metrics DEBUG: Added sensor with name connections-created
kafka.metrics.metrics DEBUG: Added sensor with name connections-created
kafka.metrics.metrics DEBUG: Added sensor with name select-time
kafka.metrics.metrics DEBUG: Added sensor with name select-time
kafka.metrics.metrics DEBUG: Added sensor with name io-time
kafka.metrics.metrics DEBUG: Added sensor with name io-time
kafka.client DEBUG: Initiating connection to node bootstrap-0 at localhost:9092
kafka.client DEBUG: Initiating connection to node bootstrap-0 at localhost:9092
kafka.metrics.metrics DEBUG: Added sensor with name bytes-sent-received
kafka.metrics.metrics DEBUG: Added sensor with name bytes-sent-received
kafka.metrics.metrics DEBUG: Added sensor with name bytes-sent
kafka.metrics.metrics DEBUG: Added sensor with name bytes-sent
kafka.metrics.metrics DEBUG: Added sensor with name bytes-received
kafka.metrics.metrics DEBUG: Added sensor with name bytes-received
kafka.metrics.metrics DEBUG: Added sensor with name request-latency
kafka.metrics.metrics DEBUG: Added sensor with name request-latency
kafka.metrics.metrics DEBUG: Added sensor with name node-bootstrap-0.bytes-sent
kafka.metrics.metrics DEBUG: Added sensor with name node-bootstrap-0.bytes-sent
kafka.metrics.metrics DEBUG: Added sensor with name node-bootstrap-0.bytes-received
kafka.metrics.metrics DEBUG: Added sensor with name node-bootstrap-0.bytes-received
kafka.metrics.metrics DEBUG: Added sensor with name node-bootstrap-0.latency
kafka.metrics.metrics DEBUG: Added sensor with name node-bootstrap-0.latency
kafka.conn DEBUG: <BrokerConnection node_id=bootstrap-0 host=localhost:9092 <disconnected> [unspecified None]>: creating new socket
kafka.conn DEBUG: <BrokerConnection node_id=bootstrap-0 host=localhost:9092 <disconnected> [unspecified None]>: creating new socket
kafka.conn DEBUG: <BrokerConnection node_id=bootstrap-0 host=localhost:9092 <disconnected> [IPv4 ('127.0.0.1', 9092)]>: setting socket option (6, 1, 1)
kafka.conn DEBUG: <BrokerConnection node_id=bootstrap-0 host=localhost:9092 <disconnected> [IPv4 ('127.0.0.1', 9092)]>: setting socket option (6, 1, 1)
kafka.conn INFO: <BrokerConnection node_id=bootstrap-0 host=localhost:9092 <connecting> [IPv4 ('127.0.0.1', 9092)]>: connecting to localhost:9092 [('127.0.0.1', 9092) IPv4]
kafka.conn INFO: <BrokerConnection node_id=bootstrap-0 host=localhost:9092 <connecting> [IPv4 ('127.0.0.1', 9092)]>: connecting to localhost:9092 [('127.0.0.1', 9092) IPv4]
kafka.conn INFO: Probing node bootstrap-0 broker version
kafka.conn INFO: Probing node bootstrap-0 broker version
kafka.conn DEBUG: <BrokerConnection node_id=bootstrap-0 host=localhost:9092 <connecting> [IPv4 ('127.0.0.1', 9092)]>: established TCP connection
kafka.conn DEBUG: <BrokerConnection node_id=bootstrap-0 host=localhost:9092 <connecting> [IPv4 ('127.0.0.1', 9092)]>: established TCP connection
kafka.conn INFO: <BrokerConnection node_id=bootstrap-0 host=localhost:9092 <connecting> [IPv4 ('127.0.0.1', 9092)]>: Connection complete.
kafka.conn INFO: <BrokerConnection node_id=bootstrap-0 host=localhost:9092 <connecting> [IPv4 ('127.0.0.1', 9092)]>: Connection complete.
kafka.client DEBUG: Node bootstrap-0 connected
kafka.client DEBUG: Node bootstrap-0 connected
kafka.protocol.parser DEBUG: Sending request ApiVersionRequest_v0()
kafka.protocol.parser DEBUG: Sending request ApiVersionRequest_v0()
kafka.conn DEBUG: <BrokerConnection node_id=bootstrap-0 host=localhost:9092 <connected> [IPv4 ('127.0.0.1', 9092)]> Request 1: ApiVersionRequest_v0()
kafka.conn DEBUG: <BrokerConnection node_id=bootstrap-0 host=localhost:9092 <connected> [IPv4 ('127.0.0.1', 9092)]> Request 1: ApiVersionRequest_v0()
kafka.protocol.parser DEBUG: Sending request MetadataRequest_v0(topics=[])
kafka.protocol.parser DEBUG: Sending request MetadataRequest_v0(topics=[])
kafka.conn DEBUG: <BrokerConnection node_id=bootstrap-0 host=localhost:9092 <connected> [IPv4 ('127.0.0.1', 9092)]> Request 2: MetadataRequest_v0(topics=[])
kafka.conn DEBUG: <BrokerConnection node_id=bootstrap-0 host=localhost:9092 <connected> [IPv4 ('127.0.0.1', 9092)]> Request 2: MetadataRequest_v0(topics=[])
kafka.protocol.parser DEBUG: Received correlation id: 1
kafka.protocol.parser DEBUG: Received correlation id: 1
kafka.protocol.parser DEBUG: Processing response ApiVersionResponse_v0
kafka.protocol.parser DEBUG: Processing response ApiVersionResponse_v0
Copy
Copied
Copy
Copied
kafka.conn DEBUG: <BrokerConnection node_id=bootstrap-0 host=localhost:9092 <connected> [IPv4 ('127.0.0.1', 9092)]> Response 1 (103.
414058685
ms): ApiVersionResponse_v0(error_code=0, api_versions=[(api_key=0, min_version=0, max_version=7), (api_key=1, min_version=0, max_version=10), (api_key=2, min_version=0, max_version=4), (api_key=3, min_version=0, max_version=7), (api_key=4, min_version=0, max_version=1), (api_key=5, min_version=0, max_version=0), (api_key=6, min_version=0, max_version=4), (api_key=7, min_version=0, max_version=1), (api_key=8, min_version=0, max_version=6), (api_key=9, min_version=0, max_version=5), (api_key=10, min_version=0, max_version=2), (api_key=11, min_version=0, max_version=3), (api_key=12, min_version=0, max_version=2), (api_key=13, min_version=0, max_version=2), (api_key=14, min_version=0, max_version=2), (api_key=15, min_version=0, max_version=2), (api_key=16, min_version=0, max_version=2), (api_key=17, min_version=0, max_version=1), (api_key=18, min_version=0, max_version=2), (api_key=19, min_version=0, max_version=3), (api_key=20, min_version=0, max_version=3), (api_key=21, min_version=0, max_version=1), (api_key=22, min_version=0, max_version=1), (api_key=23, min_version=0, max_version=2), (api_key=24, min_version=0, max_version=1), (api_key=25, min_version=0, max_version=1), (api_key=26, min_version=0, max_version=1), (api_key=27, min_version=0, max_version=0), (api_key=28, min_version=0, max_version=2), (api_key=29, min_version=0, max_version=1), (api_key=30, min_version=0, max_version=1), (api_key=31, min_version=0, max_version=1), (api_key=32, min_version=0, max_version=2), (api_key=33, min_version=0, max_version=1), (api_key=34, min_version=0, max_version=1), (api_key=35, min_version=0, max_version=1), (api_key=36, min_version=0, max_version=0), (api_key=37, min_version=0, max_version=1), (api_key=38, min_version=0, max_version=1), (api_key=39, min_version=0, max_version=1), (api_key=40, min_version=0, max_version=1), (api_key=41, min_version=0, max_version=1), (api_key=42, min_version=0, max_version=1)])
kafka.conn DEBUG: <BrokerConnection node_id=bootstrap-0 host=localhost:9092 <connected> [IPv4 ('127.0.0.1', 9092)]> Response 1 (103.
10792923
ms): ApiVersionResponse_v0(error_code=0, api_versions=[(api_key=0, min_version=0, max_version=7), (api_key=1, min_version=0, max_version=10), (api_key=2, min_version=0, max_version=4), (api_key=3, min_version=0, max_version=7), (api_key=4, min_version=0, max_version=1), (api_key=5, min_version=0, max_version=0), (api_key=6, min_version=0, max_version=4), (api_key=7, min_version=0, max_version=1), (api_key=8, min_version=0, max_version=6), (api_key=9, min_version=0, max_version=5), (api_key=10, min_version=0, max_version=2), (api_key=11, min_version=0, max_version=3), (api_key=12, min_version=0, max_version=2), (api_key=13, min_version=0, max_version=2), (api_key=14, min_version=0, max_version=2), (api_key=15, min_version=0, max_version=2), (api_key=16, min_version=0, max_version=2), (api_key=17, min_version=0, max_version=1), (api_key=18, min_version=0, max_version=2), (api_key=19, min_version=0, max_version=3), (api_key=20, min_version=0, max_version=3), (api_key=21, min_version=0, max_version=1), (api_key=22, min_version=0, max_version=1), (api_key=23, min_version=0, max_version=2), (api_key=24, min_version=0, max_version=1), (api_key=25, min_version=0, max_version=1), (api_key=26, min_version=0, max_version=1), (api_key=27, min_version=0, max_version=0), (api_key=28, min_version=0, max_version=2), (api_key=29, min_version=0, max_version=1), (api_key=30, min_version=0, max_version=1), (api_key=31, min_version=0, max_version=1), (api_key=32, min_version=0, max_version=2), (api_key=33, min_version=0, max_version=1), (api_key=34, min_version=0, max_version=1), (api_key=35, min_version=0, max_version=1), (api_key=36, min_version=0, max_version=0), (api_key=37, min_version=0, max_version=1), (api_key=38, min_version=0, max_version=1), (api_key=39, min_version=0, max_version=1), (api_key=40, min_version=0, max_version=1), (api_key=41, min_version=0, max_version=1), (api_key=42, min_version=0, max_version=1)])
kafka.protocol.parser DEBUG: Received correlation id: 2
kafka.protocol.parser DEBUG: Received correlation id: 2
kafka.protocol.parser DEBUG: Processing response MetadataResponse_v0
kafka.protocol.parser DEBUG: Processing response MetadataResponse_v0
Copy
Copied
Copy
Copied
kafka.conn DEBUG: <BrokerConnection node_id=bootstrap-0 host=localhost:9092 <connected> [IPv4 ('127.0.0.1', 9092)]> Response 2 (6.
64901733398
ms): MetadataResponse_v0(brokers=[(node_id=0, host=u'Brahma', port=9092)], topics=[(error_code=0, topic=u'communication-uba2', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'complete_msg_topic', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'delay-hrs-1', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_rvm_preprocess', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_notification_ready', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_rvm_ready', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_preprocess', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'incomplete_msg_topic', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_transactional_ready', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'uba-p-event-communicationOpen_1', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_ready', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'jobseeker-event-notification-queue', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_notif_preprocess', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'delay-mins-10', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'__consumer_offsets', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=10, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=20, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=40, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=30, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=9, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=11, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=31, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=39, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=13, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=18, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=22, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=8, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=32, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=43, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=29, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=34, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=1, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=6, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=41, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=27, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=48, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=5, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=15, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=35, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=25, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=46, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=26, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=36, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=44, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=16, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=37, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=17, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=45, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=3, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=24, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=38, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=33, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=23, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=28, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=2, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=12, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=19, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=14, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=4, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=47, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=49, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=42, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=7, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=21, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_notification_preprocess', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_ng_ready', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_transactional_preprocess', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication-cm', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'kafka_test', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication-cm-high', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'uba-p-event-communicationSend_1', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_ng_preprocess', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_callbackstatus', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_notif_ready', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_cm_staging', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_whatsapp_incoming', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication-uba', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])])])
kafka.conn DEBUG: <BrokerConnection node_id=bootstrap-0 host=localhost:9092 <connected> [IPv4 ('127.0.0.1', 9092)]> Response 2 (6.
61706924438
ms): MetadataResponse_v0(brokers=[(node_id=0, host=u'Brahma', port=9092)], topics=[(error_code=0, topic=u'communication-uba2', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'complete_msg_topic', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'delay-hrs-1', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_rvm_preprocess', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_notification_ready', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_rvm_ready', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_preprocess', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'incomplete_msg_topic', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_transactional_ready', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'uba-p-event-communicationOpen_1', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_ready', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'jobseeker-event-notification-queue', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_notif_preprocess', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'delay-mins-10', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'__consumer_offsets', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=10, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=20, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=40, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=30, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=9, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=11, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=31, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=39, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=13, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=18, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=22, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=8, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=32, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=43, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=29, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=34, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=1, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=6, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=41, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=27, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=48, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=5, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=15, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=35, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=25, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=46, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=26, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=36, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=44, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=16, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=37, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=17, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=45, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=3, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=24, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=38, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=33, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=23, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=28, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=2, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=12, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=19, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=14, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=4, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=47, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=49, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=42, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=7, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=21, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_notification_preprocess', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_ng_ready', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_transactional_preprocess', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication-cm', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'kafka_test', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication-cm-high', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'uba-p-event-communicationSend_1', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_ng_preprocess', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_callbackstatus', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_notif_ready', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_cm_staging', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_whatsapp_incoming', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication-uba', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])])])
kafka.conn INFO: Broker version identified as 1.0.0
kafka.conn INFO: Broker version identified as 1.0.0
kafka.conn INFO: Set configuration api_version=(1, 0, 0) to skip auto check_version requests on startup
kafka.conn INFO: Set configuration api_version=(1, 0, 0) to skip auto check_version requests on startup
kafka.metrics.metrics DEBUG: Added sensor with name bufferpool-wait-time
kafka.metrics.metrics DEBUG: Added sensor with name bufferpool-wait-time
kafka.metrics.metrics DEBUG: Added sensor with name batch-size
kafka.metrics.metrics DEBUG: Added sensor with name batch-size
kafka.metrics.metrics DEBUG: Added sensor with name compression-rate
kafka.metrics.metrics DEBUG: Added sensor with name compression-rate
kafka.metrics.metrics DEBUG: Added sensor with name queue-time
kafka.metrics.metrics DEBUG: Added sensor with name queue-time
kafka.metrics.metrics DEBUG: Added sensor with name produce-throttle-time
kafka.metrics.metrics DEBUG: Added sensor with name produce-throttle-time
kafka.metrics.metrics DEBUG: Added sensor with name records-per-request
kafka.metrics.metrics DEBUG: Added sensor with name records-per-request
kafka.metrics.metrics DEBUG: Added sensor with name bytes
kafka.metrics.metrics DEBUG: Added sensor with name bytes
kafka.metrics.metrics DEBUG: Added sensor with name record-retries
kafka.metrics.metrics DEBUG: Added sensor with name record-retries
kafka.metrics.metrics DEBUG: Added sensor with name errors
kafka.metrics.metrics DEBUG: Added sensor with name errors
kafka.metrics.metrics DEBUG: Added sensor with name record-size-max
kafka.metrics.metrics DEBUG: Added sensor with name record-size-max
Copy
Copied
Copy
Copied
kafka.producer.kafka DEBUG: Kafka producer started
kafka.producer.sender DEBUG: Starting Kafka producer I/O thread.
kafka.producer.sender DEBUG: Starting Kafka producer I/O thread.
Copy
Copied
Copy
Copied
kafka.producer.kafka DEBUG: Kafka producer started
kafka.client DEBUG: Sending metadata request MetadataRequest_v1(topics=NULL) to node bootstrap-0
kafka.client DEBUG: Sending metadata request MetadataRequest_v1(topics=NULL) to node bootstrap-0
kafka.protocol.parser DEBUG: Sending request MetadataRequest_v1(topics=NULL)
kafka.protocol.parser DEBUG: Sending request MetadataRequest_v1(topics=NULL)
kafka.conn DEBUG: <BrokerConnection node_id=bootstrap-0 host=localhost:9092 <connected> [IPv4 ('127.0.0.1', 9092)]> Request 3: MetadataRequest_v1(topics=NULL)
kafka.conn DEBUG: <BrokerConnection node_id=bootstrap-0 host=localhost:9092 <connected> [IPv4 ('127.0.0.1', 9092)]> Request 3: MetadataRequest_v1(topics=NULL)
kafka.producer.kafka DEBUG: Requesting metadata update for topic communication-cm
kafka.producer.kafka DEBUG: Requesting metadata update for topic communication-cm
kafka.protocol.parser DEBUG: Received correlation id: 3
kafka.protocol.parser DEBUG: Received correlation id: 3
kafka.protocol.parser DEBUG: Processing response MetadataResponse_v1
kafka.protocol.parser DEBUG: Processing response MetadataResponse_v1
Copy
Copied
Copy
Copied
kafka.conn DEBUG: <BrokerConnection node_id=bootstrap-0 host=localhost:9092 <connected> [IPv4 ('127.0.0.1', 9092)]> Response 3 (
11.1081600189
ms): MetadataResponse_v1(brokers=[(node_id=0, host=u'Brahma', port=9092, rack=None)], controller_id=0, topics=[(error_code=0, topic=u'communication-uba2', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'complete_msg_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'delay-hrs-1', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_rvm_preprocess', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_notification_ready', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_rvm_ready', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_preprocess', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'incomplete_msg_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_transactional_ready', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'uba-p-event-communicationOpen_1', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_ready', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'jobseeker-event-notification-queue', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_notif_preprocess', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'delay-mins-10', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'__consumer_offsets', is_internal=True, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=10, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=20, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=40, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=30, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=9, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=11, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=31, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=39, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=13, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=18, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=22, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=8, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=32, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=43, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=29, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=34, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=1, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=6, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=41, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=27, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=48, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=5, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=15, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=35, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=25, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=46, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=26, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=36, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=44, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=16, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=37, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=17, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=45, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=3, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=24, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=38, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=33, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=23, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=28, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=2, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=12, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=19, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=14, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=4, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=47, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=49, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=42, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=7, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=21, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_notification_preprocess', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_ng_ready', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_transactional_preprocess', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication-cm', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'kafka_test', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication-cm-high', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'uba-p-event-communicationSend_1', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_ng_preprocess', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_callbackstatus', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_notif_ready', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_cm_staging', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_whatsapp_incoming', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication-uba', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])])])
kafka.conn DEBUG: <BrokerConnection node_id=bootstrap-0 host=localhost:9092 <connected> [IPv4 ('127.0.0.1', 9092)]> Response 3 (
8.98408889771
ms): MetadataResponse_v1(brokers=[(node_id=0, host=u'Brahma', port=9092, rack=None)], controller_id=0, topics=[(error_code=0, topic=u'communication-uba2', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'complete_msg_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'delay-hrs-1', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_rvm_preprocess', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_notification_ready', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_rvm_ready', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_preprocess', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'incomplete_msg_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_transactional_ready', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'uba-p-event-communicationOpen_1', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_ready', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'jobseeker-event-notification-queue', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_notif_preprocess', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'delay-mins-10', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'__consumer_offsets', is_internal=True, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=10, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=20, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=40, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=30, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=9, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=11, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=31, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=39, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=13, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=18, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=22, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=8, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=32, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=43, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=29, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=34, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=1, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=6, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=41, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=27, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=48, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=5, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=15, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=35, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=25, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=46, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=26, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=36, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=44, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=16, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=37, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=17, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=45, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=3, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=24, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=38, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=33, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=23, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=28, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=2, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=12, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=19, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=14, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=4, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=47, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=49, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=42, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=7, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=21, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_notification_preprocess', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_ng_ready', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_transactional_preprocess', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication-cm', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'kafka_test', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication-cm-high', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'uba-p-event-communicationSend_1', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_ng_preprocess', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_callbackstatus', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_notif_ready', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_cm_staging', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_whatsapp_incoming', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication-uba', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])])])
kafka.cluster DEBUG: Updated cluster metadata to ClusterMetadata(brokers: 1, topics: 28, groups: 0)
kafka.cluster DEBUG: Updated cluster metadata to ClusterMetadata(brokers: 1, topics: 28, groups: 0)
Copy
Copied
Copy
Copied
kafka.producer.kafka DEBUG: _wait_on_metadata woke after 0.
0251100063324
secs.
kafka.producer.kafka DEBUG: _wait_on_metadata woke after 0.
0162889957428
secs.
kafka.producer.kafka DEBUG: Sending (key=None value={'headers': {'Source': 'py2-0.1', 'X-TRANSACTION-ID': '
43758316004249703521
', 'SystemId': 'analytics', 'AppId': 129}, 'payload': '{"to": [{"medium": "mail", "from": {"uid": "info@naukri.com", "name": "Naukri"}, "from_address": {"uid": "info@naukri.com", "name": "Naukri"}, "recipients": [{"userId": "123", "uid": "rana33@yopmail.com", "name": "rana"}]}], "eventCode": "test_email", "commId": "1234"}'} headers=[]) to TopicPartition(topic='communication-cm', partition=0)
kafka.producer.kafka DEBUG: Sending (key=None value={'headers': {'Source': 'py2-0.1', 'X-TRANSACTION-ID': '
62430311064981508370
', 'SystemId': 'analytics', 'AppId': 129}, 'payload': '{"to": [{"medium": "mail", "from": {"uid": "info@naukri.com", "name": "Naukri"}, "from_address": {"uid": "info@naukri.com", "name": "Naukri"}, "recipients": [{"userId": "123", "uid": "rana33@yopmail.com", "name": "rana"}]}], "eventCode": "test_email", "commId": "1234"}'} headers=[]) to TopicPartition(topic='communication-cm', partition=0)
kafka.producer.record_accumulator DEBUG: Allocating a new 16384 byte message buffer for TopicPartition(topic='communication-cm', partition=0)
kafka.producer.record_accumulator DEBUG: Allocating a new 16384 byte message buffer for TopicPartition(topic='communication-cm', partition=0)
kafka.producer.kafka DEBUG: Waking up the sender since TopicPartition(topic='communication-cm', partition=0) is either full or getting a new batch
kafka.producer.kafka DEBUG: Waking up the sender since TopicPartition(topic='communication-cm', partition=0) is either full or getting a new batch
Copy
Copied
Copy
Copied
ccs-python-client INFO: {'_produce_future': <
kafka.producer.
future.FutureProduceResult object at 0x7f3764d1f910>, '_errbacks': [], '_callbacks': [], 'args': (0, 1589032836212, None, -1, 449, -1), 'is_done': False, 'exception': None, 'value': None}
kafka.producer.
kafka
INFO:
Closing the Kafka producer with inf secs timeout.
ccs-python-client
INFO:
Message sent 43758316004249703521
kafka.producer.sender DEBUG: Node 0 not ready; delaying produce of accumulated batch
kafka.producer.sender DEBUG: Node 0 not ready; delaying produce of accumulated batch
Copy
Copied
Copy
Copied
kafka.producer.kafka INFO: Closing the Kafka producer with 0 secs timeout.
kafka.client DEBUG: Initiating connection to node 0 at Brahma:9092
kafka.client DEBUG: Initiating connection to node 0 at Brahma:9092
Copy
Copied
Copy
Copied
kafka.producer.kafka INFO: Proceeding to force close the producer since pending requests could not be completed within timeout 0.
kafka.metrics.metrics DEBUG: Added sensor with name node-0.bytes-sent
kafka.metrics.metrics DEBUG: Added sensor with name node-0.bytes-sent
Copy
Copied
Copy
Copied
kafka.producer.kafka DEBUG: The Kafka producer has closed.
kafka.metrics.metrics DEBUG: Added sensor with name node-0.bytes-received
kafka.metrics.metrics DEBUG: Added sensor with name node-0.bytes-received
Copy
Copied
Copy
Copied
kafka.
producer.
kafka
INFO:
Kafka producer closed
kafka.
metrics.metrics DEBUG: Added sensor with name node-0.latency
kafka.conn DEBUG: <BrokerConnection node_id=0 host=Brahma:9092 <disconnected> [unspecified None]>: creating new socket
kafka.conn DEBUG: <BrokerConnection node_id=0 host=Brahma:9092 <disconnected> [IPv4 ('127.0.1.1', 9092)]>: setting socket option (6, 1, 1)
kafka
.conn
INFO:
<BrokerConnection node_id=0 host=Brahma:9092 <connecting> [IPv4 ('127.0.1.1', 9092)]>: connecting to Brahma:9092 [('127.0.1.1', 9092) IPv4]
kafka.conn DEBUG: <BrokerConnection node_id=0 host=Brahma:9092 <connecting> [IPv4 ('127.0.1.1', 9092)]>: established TCP connection
kafka.conn INFO: <BrokerConnection node_id=0 host=Brahma:9092 <connecting> [IPv4 ('127.0.1.1', 9092)]>: Connection complete.
kafka.client DEBUG: Node 0 connected
kafka.conn INFO: <BrokerConnection node_id=bootstrap-0 host=localhost:9092 <connected> [IPv4 ('127.0.0.1', 9092)]>: Closing connection.
kafka.producer.sender DEBUG: Beginning shutdown of Kafka producer I/O thread, sending remaining records.
kafka.metrics.metrics DEBUG: Added sensor with name topic.communication-cm.records-per-batch
kafka.metrics.metrics DEBUG: Added sensor with name topic.communication-cm.bytes
kafka.metrics.metrics DEBUG: Added sensor with name topic.communication-cm.compression-rate
kafka.metrics.metrics DEBUG: Added sensor with name topic.communication-cm.record-retries
kafka.metrics.metrics DEBUG: Added sensor with name topic.communication-cm.record-errors
kafka.producer.sender DEBUG: Nodes with data ready to send: set([0])
kafka.producer.sender DEBUG: Created 1 produce requests: {0: ProduceRequest_v3(transactional_id=None, required_acks=1, timeout=2000, topics=[(topic='communication-cm', partitions=[(partition=0, messages='\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01\xfb\x00\x00\x00\x00\x02\xe1\x91\xe7\x0b\x00\x00\x00\x00\x00\x00\x00\x00\x01q\xf9\xbb\xfa\r\x00\x00\x01q\xf9\xbb\xfa\r\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\x00\x00\x00\x01\x90\x07\x00\x00\x00\x01\x82\x07{"headers": {"Source": "py2-0.1...')])])}
kafka.producer.sender DEBUG: Sending Produce Request: ProduceRequest_v3(transactional_id=None, required_acks=1, timeout=2000, topics=[(topic='communication-cm', partitions=[(partition=0, messages='\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01\xfb\x00\x00\x00\x00\x02\xe1\x91\xe7\x0b\x00\x00\x00\x00\x00\x00\x00\x00\x01q\xf9\xbb\xfa\r\x00\x00\x01q\xf9\xbb\xfa\r\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\x00\x00\x00\x01\x90\x07\x00\x00\x00\x01\x82\x07{"headers": {"Source": "py2-0.1...')])])
kafka.protocol.parser DEBUG: Sending request ProduceRequest_v3(transactional_id=None, required_acks=1, timeout=2000, topics=[(topic='communication-cm', partitions=[(partition=0, messages='\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01\xfb\x00\x00\x00\x00\x02\xe1\x91\xe7\x0b\x00\x00\x00\x00\x00\x00\x00\x00\x01q\xf9\xbb\xfa\r\x00\x00\x01q\xf9\xbb\xfa\r\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\x00\x00\x00\x01\x90\x07\x00\x00\x00\x01\x82\x07{"headers": {"Source": "py2-0.1...')])])
kafka.conn DEBUG: <BrokerConnection node_id=0 host=Brahma:9092 <connected> [IPv4 ('127.0.1.1', 9092)]> Request 1: ProduceRequest_v3(transactional_id=None, required_acks=1, timeout=2000, topics=[(topic='communication-cm', partitions=[(partition=0, messages='\
Saved diffs
Original text
Open file
kafka.producer.kafka DEBUG: Starting the Kafka producer kafka.metrics.metrics DEBUG: Added sensor with name connections-closed kafka.metrics.metrics DEBUG: Added sensor with name connections-created kafka.metrics.metrics DEBUG: Added sensor with name select-time kafka.metrics.metrics DEBUG: Added sensor with name io-time kafka.client DEBUG: Initiating connection to node bootstrap-0 at localhost:9092 kafka.metrics.metrics DEBUG: Added sensor with name bytes-sent-received kafka.metrics.metrics DEBUG: Added sensor with name bytes-sent kafka.metrics.metrics DEBUG: Added sensor with name bytes-received kafka.metrics.metrics DEBUG: Added sensor with name request-latency kafka.metrics.metrics DEBUG: Added sensor with name node-bootstrap-0.bytes-sent kafka.metrics.metrics DEBUG: Added sensor with name node-bootstrap-0.bytes-received kafka.metrics.metrics DEBUG: Added sensor with name node-bootstrap-0.latency kafka.conn DEBUG: <BrokerConnection node_id=bootstrap-0 host=localhost:9092 <disconnected> [unspecified None]>: creating new socket kafka.conn DEBUG: <BrokerConnection node_id=bootstrap-0 host=localhost:9092 <disconnected> [IPv4 ('127.0.0.1', 9092)]>: setting socket option (6, 1, 1) kafka.conn INFO: <BrokerConnection node_id=bootstrap-0 host=localhost:9092 <connecting> [IPv4 ('127.0.0.1', 9092)]>: connecting to localhost:9092 [('127.0.0.1', 9092) IPv4] kafka.conn INFO: Probing node bootstrap-0 broker version kafka.conn DEBUG: <BrokerConnection node_id=bootstrap-0 host=localhost:9092 <connecting> [IPv4 ('127.0.0.1', 9092)]>: established TCP connection kafka.conn INFO: <BrokerConnection node_id=bootstrap-0 host=localhost:9092 <connecting> [IPv4 ('127.0.0.1', 9092)]>: Connection complete. kafka.client DEBUG: Node bootstrap-0 connected kafka.protocol.parser DEBUG: Sending request ApiVersionRequest_v0() kafka.conn DEBUG: <BrokerConnection node_id=bootstrap-0 host=localhost:9092 <connected> [IPv4 ('127.0.0.1', 9092)]> Request 1: ApiVersionRequest_v0() kafka.protocol.parser DEBUG: Sending request MetadataRequest_v0(topics=[]) kafka.conn DEBUG: <BrokerConnection node_id=bootstrap-0 host=localhost:9092 <connected> [IPv4 ('127.0.0.1', 9092)]> Request 2: MetadataRequest_v0(topics=[]) kafka.protocol.parser DEBUG: Received correlation id: 1 kafka.protocol.parser DEBUG: Processing response ApiVersionResponse_v0 kafka.conn DEBUG: <BrokerConnection node_id=bootstrap-0 host=localhost:9092 <connected> [IPv4 ('127.0.0.1', 9092)]> Response 1 (103.414058685 ms): ApiVersionResponse_v0(error_code=0, api_versions=[(api_key=0, min_version=0, max_version=7), (api_key=1, min_version=0, max_version=10), (api_key=2, min_version=0, max_version=4), (api_key=3, min_version=0, max_version=7), (api_key=4, min_version=0, max_version=1), (api_key=5, min_version=0, max_version=0), (api_key=6, min_version=0, max_version=4), (api_key=7, min_version=0, max_version=1), (api_key=8, min_version=0, max_version=6), (api_key=9, min_version=0, max_version=5), (api_key=10, min_version=0, max_version=2), (api_key=11, min_version=0, max_version=3), (api_key=12, min_version=0, max_version=2), (api_key=13, min_version=0, max_version=2), (api_key=14, min_version=0, max_version=2), (api_key=15, min_version=0, max_version=2), (api_key=16, min_version=0, max_version=2), (api_key=17, min_version=0, max_version=1), (api_key=18, min_version=0, max_version=2), (api_key=19, min_version=0, max_version=3), (api_key=20, min_version=0, max_version=3), (api_key=21, min_version=0, max_version=1), (api_key=22, min_version=0, max_version=1), (api_key=23, min_version=0, max_version=2), (api_key=24, min_version=0, max_version=1), (api_key=25, min_version=0, max_version=1), (api_key=26, min_version=0, max_version=1), (api_key=27, min_version=0, max_version=0), (api_key=28, min_version=0, max_version=2), (api_key=29, min_version=0, max_version=1), (api_key=30, min_version=0, max_version=1), (api_key=31, min_version=0, max_version=1), (api_key=32, min_version=0, max_version=2), (api_key=33, min_version=0, max_version=1), (api_key=34, min_version=0, max_version=1), (api_key=35, min_version=0, max_version=1), (api_key=36, min_version=0, max_version=0), (api_key=37, min_version=0, max_version=1), (api_key=38, min_version=0, max_version=1), (api_key=39, min_version=0, max_version=1), (api_key=40, min_version=0, max_version=1), (api_key=41, min_version=0, max_version=1), (api_key=42, min_version=0, max_version=1)]) kafka.protocol.parser DEBUG: Received correlation id: 2 kafka.protocol.parser DEBUG: Processing response MetadataResponse_v0 kafka.conn DEBUG: <BrokerConnection node_id=bootstrap-0 host=localhost:9092 <connected> [IPv4 ('127.0.0.1', 9092)]> Response 2 (6.64901733398 ms): MetadataResponse_v0(brokers=[(node_id=0, host=u'Brahma', port=9092)], topics=[(error_code=0, topic=u'communication-uba2', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'complete_msg_topic', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'delay-hrs-1', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_rvm_preprocess', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_notification_ready', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_rvm_ready', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_preprocess', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'incomplete_msg_topic', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_transactional_ready', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'uba-p-event-communicationOpen_1', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_ready', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'jobseeker-event-notification-queue', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_notif_preprocess', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'delay-mins-10', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'__consumer_offsets', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=10, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=20, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=40, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=30, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=9, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=11, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=31, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=39, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=13, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=18, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=22, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=8, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=32, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=43, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=29, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=34, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=1, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=6, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=41, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=27, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=48, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=5, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=15, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=35, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=25, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=46, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=26, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=36, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=44, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=16, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=37, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=17, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=45, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=3, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=24, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=38, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=33, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=23, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=28, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=2, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=12, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=19, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=14, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=4, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=47, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=49, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=42, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=7, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=21, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_notification_preprocess', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_ng_ready', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_transactional_preprocess', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication-cm', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'kafka_test', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication-cm-high', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'uba-p-event-communicationSend_1', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_ng_preprocess', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_callbackstatus', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_notif_ready', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_cm_staging', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_whatsapp_incoming', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication-uba', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])])]) kafka.conn INFO: Broker version identified as 1.0.0 kafka.conn INFO: Set configuration api_version=(1, 0, 0) to skip auto check_version requests on startup kafka.metrics.metrics DEBUG: Added sensor with name bufferpool-wait-time kafka.metrics.metrics DEBUG: Added sensor with name batch-size kafka.metrics.metrics DEBUG: Added sensor with name compression-rate kafka.metrics.metrics DEBUG: Added sensor with name queue-time kafka.metrics.metrics DEBUG: Added sensor with name produce-throttle-time kafka.metrics.metrics DEBUG: Added sensor with name records-per-request kafka.metrics.metrics DEBUG: Added sensor with name bytes kafka.metrics.metrics DEBUG: Added sensor with name record-retries kafka.metrics.metrics DEBUG: Added sensor with name errors kafka.metrics.metrics DEBUG: Added sensor with name record-size-max kafka.producer.sender DEBUG: Starting Kafka producer I/O thread. kafka.producer.kafka DEBUG: Kafka producer started kafka.client DEBUG: Sending metadata request MetadataRequest_v1(topics=NULL) to node bootstrap-0 kafka.protocol.parser DEBUG: Sending request MetadataRequest_v1(topics=NULL) kafka.conn DEBUG: <BrokerConnection node_id=bootstrap-0 host=localhost:9092 <connected> [IPv4 ('127.0.0.1', 9092)]> Request 3: MetadataRequest_v1(topics=NULL) kafka.producer.kafka DEBUG: Requesting metadata update for topic communication-cm kafka.protocol.parser DEBUG: Received correlation id: 3 kafka.protocol.parser DEBUG: Processing response MetadataResponse_v1 kafka.conn DEBUG: <BrokerConnection node_id=bootstrap-0 host=localhost:9092 <connected> [IPv4 ('127.0.0.1', 9092)]> Response 3 (11.1081600189 ms): MetadataResponse_v1(brokers=[(node_id=0, host=u'Brahma', port=9092, rack=None)], controller_id=0, topics=[(error_code=0, topic=u'communication-uba2', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'complete_msg_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'delay-hrs-1', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_rvm_preprocess', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_notification_ready', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_rvm_ready', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_preprocess', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'incomplete_msg_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_transactional_ready', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'uba-p-event-communicationOpen_1', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_ready', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'jobseeker-event-notification-queue', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_notif_preprocess', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'delay-mins-10', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'__consumer_offsets', is_internal=True, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=10, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=20, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=40, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=30, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=9, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=11, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=31, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=39, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=13, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=18, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=22, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=8, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=32, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=43, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=29, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=34, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=1, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=6, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=41, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=27, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=48, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=5, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=15, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=35, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=25, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=46, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=26, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=36, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=44, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=16, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=37, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=17, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=45, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=3, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=24, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=38, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=33, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=23, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=28, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=2, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=12, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=19, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=14, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=4, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=47, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=49, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=42, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=7, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=21, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_notification_preprocess', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_ng_ready', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_transactional_preprocess', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication-cm', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'kafka_test', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication-cm-high', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'uba-p-event-communicationSend_1', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_ng_preprocess', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_callbackstatus', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_notif_ready', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_cm_staging', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_whatsapp_incoming', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication-uba', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])])]) kafka.cluster DEBUG: Updated cluster metadata to ClusterMetadata(brokers: 1, topics: 28, groups: 0) kafka.producer.kafka DEBUG: _wait_on_metadata woke after 0.0251100063324 secs. kafka.producer.kafka DEBUG: Sending (key=None value={'headers': {'Source': 'py2-0.1', 'X-TRANSACTION-ID': '43758316004249703521', 'SystemId': 'analytics', 'AppId': 129}, 'payload': '{"to": [{"medium": "mail", "from": {"uid": "info@naukri.com", "name": "Naukri"}, "from_address": {"uid": "info@naukri.com", "name": "Naukri"}, "recipients": [{"userId": "123", "uid": "rana33@yopmail.com", "name": "rana"}]}], "eventCode": "test_email", "commId": "1234"}'} headers=[]) to TopicPartition(topic='communication-cm', partition=0) kafka.producer.record_accumulator DEBUG: Allocating a new 16384 byte message buffer for TopicPartition(topic='communication-cm', partition=0) kafka.producer.kafka DEBUG: Waking up the sender since TopicPartition(topic='communication-cm', partition=0) is either full or getting a new batch ccs-python-client INFO: {'_produce_future': <kafka.producer.future.FutureProduceResult object at 0x7f3764d1f910>, '_errbacks': [], '_callbacks': [], 'args': (0, 1589032836212, None, -1, 449, -1), 'is_done': False, 'exception': None, 'value': None} ccs-python-client INFO: Message sent 43758316004249703521 kafka.producer.sender DEBUG: Node 0 not ready; delaying produce of accumulated batch kafka.producer.kafka INFO: Closing the Kafka producer with 0 secs timeout. kafka.client DEBUG: Initiating connection to node 0 at Brahma:9092 kafka.producer.kafka INFO: Proceeding to force close the producer since pending requests could not be completed within timeout 0. kafka.metrics.metrics DEBUG: Added sensor with name node-0.bytes-sent kafka.producer.kafka DEBUG: The Kafka producer has closed. kafka.metrics.metrics DEBUG: Added sensor with name node-0.bytes-received kafka.producer.kafka INFO: Kafka producer closed
Changed text
Open file
kafka.producer.kafka DEBUG: Starting the Kafka producer kafka.metrics.metrics DEBUG: Added sensor with name connections-closed kafka.metrics.metrics DEBUG: Added sensor with name connections-created kafka.metrics.metrics DEBUG: Added sensor with name select-time kafka.metrics.metrics DEBUG: Added sensor with name io-time kafka.client DEBUG: Initiating connection to node bootstrap-0 at localhost:9092 kafka.metrics.metrics DEBUG: Added sensor with name bytes-sent-received kafka.metrics.metrics DEBUG: Added sensor with name bytes-sent kafka.metrics.metrics DEBUG: Added sensor with name bytes-received kafka.metrics.metrics DEBUG: Added sensor with name request-latency kafka.metrics.metrics DEBUG: Added sensor with name node-bootstrap-0.bytes-sent kafka.metrics.metrics DEBUG: Added sensor with name node-bootstrap-0.bytes-received kafka.metrics.metrics DEBUG: Added sensor with name node-bootstrap-0.latency kafka.conn DEBUG: <BrokerConnection node_id=bootstrap-0 host=localhost:9092 <disconnected> [unspecified None]>: creating new socket kafka.conn DEBUG: <BrokerConnection node_id=bootstrap-0 host=localhost:9092 <disconnected> [IPv4 ('127.0.0.1', 9092)]>: setting socket option (6, 1, 1) kafka.conn INFO: <BrokerConnection node_id=bootstrap-0 host=localhost:9092 <connecting> [IPv4 ('127.0.0.1', 9092)]>: connecting to localhost:9092 [('127.0.0.1', 9092) IPv4] kafka.conn INFO: Probing node bootstrap-0 broker version kafka.conn DEBUG: <BrokerConnection node_id=bootstrap-0 host=localhost:9092 <connecting> [IPv4 ('127.0.0.1', 9092)]>: established TCP connection kafka.conn INFO: <BrokerConnection node_id=bootstrap-0 host=localhost:9092 <connecting> [IPv4 ('127.0.0.1', 9092)]>: Connection complete. kafka.client DEBUG: Node bootstrap-0 connected kafka.protocol.parser DEBUG: Sending request ApiVersionRequest_v0() kafka.conn DEBUG: <BrokerConnection node_id=bootstrap-0 host=localhost:9092 <connected> [IPv4 ('127.0.0.1', 9092)]> Request 1: ApiVersionRequest_v0() kafka.protocol.parser DEBUG: Sending request MetadataRequest_v0(topics=[]) kafka.conn DEBUG: <BrokerConnection node_id=bootstrap-0 host=localhost:9092 <connected> [IPv4 ('127.0.0.1', 9092)]> Request 2: MetadataRequest_v0(topics=[]) kafka.protocol.parser DEBUG: Received correlation id: 1 kafka.protocol.parser DEBUG: Processing response ApiVersionResponse_v0 kafka.conn DEBUG: <BrokerConnection node_id=bootstrap-0 host=localhost:9092 <connected> [IPv4 ('127.0.0.1', 9092)]> Response 1 (103.10792923 ms): ApiVersionResponse_v0(error_code=0, api_versions=[(api_key=0, min_version=0, max_version=7), (api_key=1, min_version=0, max_version=10), (api_key=2, min_version=0, max_version=4), (api_key=3, min_version=0, max_version=7), (api_key=4, min_version=0, max_version=1), (api_key=5, min_version=0, max_version=0), (api_key=6, min_version=0, max_version=4), (api_key=7, min_version=0, max_version=1), (api_key=8, min_version=0, max_version=6), (api_key=9, min_version=0, max_version=5), (api_key=10, min_version=0, max_version=2), (api_key=11, min_version=0, max_version=3), (api_key=12, min_version=0, max_version=2), (api_key=13, min_version=0, max_version=2), (api_key=14, min_version=0, max_version=2), (api_key=15, min_version=0, max_version=2), (api_key=16, min_version=0, max_version=2), (api_key=17, min_version=0, max_version=1), (api_key=18, min_version=0, max_version=2), (api_key=19, min_version=0, max_version=3), (api_key=20, min_version=0, max_version=3), (api_key=21, min_version=0, max_version=1), (api_key=22, min_version=0, max_version=1), (api_key=23, min_version=0, max_version=2), (api_key=24, min_version=0, max_version=1), (api_key=25, min_version=0, max_version=1), (api_key=26, min_version=0, max_version=1), (api_key=27, min_version=0, max_version=0), (api_key=28, min_version=0, max_version=2), (api_key=29, min_version=0, max_version=1), (api_key=30, min_version=0, max_version=1), (api_key=31, min_version=0, max_version=1), (api_key=32, min_version=0, max_version=2), (api_key=33, min_version=0, max_version=1), (api_key=34, min_version=0, max_version=1), (api_key=35, min_version=0, max_version=1), (api_key=36, min_version=0, max_version=0), (api_key=37, min_version=0, max_version=1), (api_key=38, min_version=0, max_version=1), (api_key=39, min_version=0, max_version=1), (api_key=40, min_version=0, max_version=1), (api_key=41, min_version=0, max_version=1), (api_key=42, min_version=0, max_version=1)]) kafka.protocol.parser DEBUG: Received correlation id: 2 kafka.protocol.parser DEBUG: Processing response MetadataResponse_v0 kafka.conn DEBUG: <BrokerConnection node_id=bootstrap-0 host=localhost:9092 <connected> [IPv4 ('127.0.0.1', 9092)]> Response 2 (6.61706924438 ms): MetadataResponse_v0(brokers=[(node_id=0, host=u'Brahma', port=9092)], topics=[(error_code=0, topic=u'communication-uba2', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'complete_msg_topic', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'delay-hrs-1', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_rvm_preprocess', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_notification_ready', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_rvm_ready', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_preprocess', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'incomplete_msg_topic', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_transactional_ready', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'uba-p-event-communicationOpen_1', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_ready', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'jobseeker-event-notification-queue', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_notif_preprocess', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'delay-mins-10', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'__consumer_offsets', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=10, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=20, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=40, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=30, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=9, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=11, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=31, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=39, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=13, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=18, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=22, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=8, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=32, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=43, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=29, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=34, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=1, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=6, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=41, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=27, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=48, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=5, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=15, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=35, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=25, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=46, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=26, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=36, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=44, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=16, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=37, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=17, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=45, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=3, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=24, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=38, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=33, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=23, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=28, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=2, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=12, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=19, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=14, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=4, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=47, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=49, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=42, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=7, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=21, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_notification_preprocess', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_ng_ready', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_transactional_preprocess', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication-cm', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'kafka_test', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication-cm-high', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'uba-p-event-communicationSend_1', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_ng_preprocess', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_callbackstatus', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_notif_ready', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_cm_staging', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_whatsapp_incoming', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication-uba', partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])])]) kafka.conn INFO: Broker version identified as 1.0.0 kafka.conn INFO: Set configuration api_version=(1, 0, 0) to skip auto check_version requests on startup kafka.metrics.metrics DEBUG: Added sensor with name bufferpool-wait-time kafka.metrics.metrics DEBUG: Added sensor with name batch-size kafka.metrics.metrics DEBUG: Added sensor with name compression-rate kafka.metrics.metrics DEBUG: Added sensor with name queue-time kafka.metrics.metrics DEBUG: Added sensor with name produce-throttle-time kafka.metrics.metrics DEBUG: Added sensor with name records-per-request kafka.metrics.metrics DEBUG: Added sensor with name bytes kafka.metrics.metrics DEBUG: Added sensor with name record-retries kafka.metrics.metrics DEBUG: Added sensor with name errors kafka.metrics.metrics DEBUG: Added sensor with name record-size-max kafka.producer.kafka DEBUG: Kafka producer started kafka.producer.sender DEBUG: Starting Kafka producer I/O thread. kafka.client DEBUG: Sending metadata request MetadataRequest_v1(topics=NULL) to node bootstrap-0 kafka.protocol.parser DEBUG: Sending request MetadataRequest_v1(topics=NULL) kafka.conn DEBUG: <BrokerConnection node_id=bootstrap-0 host=localhost:9092 <connected> [IPv4 ('127.0.0.1', 9092)]> Request 3: MetadataRequest_v1(topics=NULL) kafka.producer.kafka DEBUG: Requesting metadata update for topic communication-cm kafka.protocol.parser DEBUG: Received correlation id: 3 kafka.protocol.parser DEBUG: Processing response MetadataResponse_v1 kafka.conn DEBUG: <BrokerConnection node_id=bootstrap-0 host=localhost:9092 <connected> [IPv4 ('127.0.0.1', 9092)]> Response 3 (8.98408889771 ms): MetadataResponse_v1(brokers=[(node_id=0, host=u'Brahma', port=9092, rack=None)], controller_id=0, topics=[(error_code=0, topic=u'communication-uba2', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'complete_msg_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'delay-hrs-1', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_rvm_preprocess', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_notification_ready', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_rvm_ready', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_preprocess', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'incomplete_msg_topic', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_transactional_ready', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'uba-p-event-communicationOpen_1', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_ready', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'jobseeker-event-notification-queue', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_notif_preprocess', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'delay-mins-10', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'__consumer_offsets', is_internal=True, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=10, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=20, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=40, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=30, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=9, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=11, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=31, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=39, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=13, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=18, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=22, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=8, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=32, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=43, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=29, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=34, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=1, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=6, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=41, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=27, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=48, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=5, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=15, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=35, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=25, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=46, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=26, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=36, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=44, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=16, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=37, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=17, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=45, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=3, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=24, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=38, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=33, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=23, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=28, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=2, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=12, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=19, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=14, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=4, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=47, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=49, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=42, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=7, leader=0, replicas=[0], isr=[0]), (error_code=0, partition=21, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_notification_preprocess', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_ng_ready', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_transactional_preprocess', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication-cm', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'kafka_test', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication-cm-high', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'uba-p-event-communicationSend_1', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_ng_preprocess', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_callbackstatus', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_bulk_notif_ready', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_cm_staging', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication_whatsapp_incoming', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])]), (error_code=0, topic=u'communication-uba', is_internal=False, partitions=[(error_code=0, partition=0, leader=0, replicas=[0], isr=[0])])]) kafka.cluster DEBUG: Updated cluster metadata to ClusterMetadata(brokers: 1, topics: 28, groups: 0) kafka.producer.kafka DEBUG: _wait_on_metadata woke after 0.0162889957428 secs. kafka.producer.kafka DEBUG: Sending (key=None value={'headers': {'Source': 'py2-0.1', 'X-TRANSACTION-ID': '62430311064981508370', 'SystemId': 'analytics', 'AppId': 129}, 'payload': '{"to": [{"medium": "mail", "from": {"uid": "info@naukri.com", "name": "Naukri"}, "from_address": {"uid": "info@naukri.com", "name": "Naukri"}, "recipients": [{"userId": "123", "uid": "rana33@yopmail.com", "name": "rana"}]}], "eventCode": "test_email", "commId": "1234"}'} headers=[]) to TopicPartition(topic='communication-cm', partition=0) kafka.producer.record_accumulator DEBUG: Allocating a new 16384 byte message buffer for TopicPartition(topic='communication-cm', partition=0) kafka.producer.kafka DEBUG: Waking up the sender since TopicPartition(topic='communication-cm', partition=0) is either full or getting a new batch kafka.producer.kafka INFO: Closing the Kafka producer with inf secs timeout. kafka.producer.sender DEBUG: Node 0 not ready; delaying produce of accumulated batch kafka.client DEBUG: Initiating connection to node 0 at Brahma:9092 kafka.metrics.metrics DEBUG: Added sensor with name node-0.bytes-sent kafka.metrics.metrics DEBUG: Added sensor with name node-0.bytes-received kafka.metrics.metrics DEBUG: Added sensor with name node-0.latency kafka.conn DEBUG: <BrokerConnection node_id=0 host=Brahma:9092 <disconnected> [unspecified None]>: creating new socket kafka.conn DEBUG: <BrokerConnection node_id=0 host=Brahma:9092 <disconnected> [IPv4 ('127.0.1.1', 9092)]>: setting socket option (6, 1, 1) kafka.conn INFO: <BrokerConnection node_id=0 host=Brahma:9092 <connecting> [IPv4 ('127.0.1.1', 9092)]>: connecting to Brahma:9092 [('127.0.1.1', 9092) IPv4] kafka.conn DEBUG: <BrokerConnection node_id=0 host=Brahma:9092 <connecting> [IPv4 ('127.0.1.1', 9092)]>: established TCP connection kafka.conn INFO: <BrokerConnection node_id=0 host=Brahma:9092 <connecting> [IPv4 ('127.0.1.1', 9092)]>: Connection complete. kafka.client DEBUG: Node 0 connected kafka.conn INFO: <BrokerConnection node_id=bootstrap-0 host=localhost:9092 <connected> [IPv4 ('127.0.0.1', 9092)]>: Closing connection. kafka.producer.sender DEBUG: Beginning shutdown of Kafka producer I/O thread, sending remaining records. kafka.metrics.metrics DEBUG: Added sensor with name topic.communication-cm.records-per-batch kafka.metrics.metrics DEBUG: Added sensor with name topic.communication-cm.bytes kafka.metrics.metrics DEBUG: Added sensor with name topic.communication-cm.compression-rate kafka.metrics.metrics DEBUG: Added sensor with name topic.communication-cm.record-retries kafka.metrics.metrics DEBUG: Added sensor with name topic.communication-cm.record-errors kafka.producer.sender DEBUG: Nodes with data ready to send: set([0]) kafka.producer.sender DEBUG: Created 1 produce requests: {0: ProduceRequest_v3(transactional_id=None, required_acks=1, timeout=2000, topics=[(topic='communication-cm', partitions=[(partition=0, messages='\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01\xfb\x00\x00\x00\x00\x02\xe1\x91\xe7\x0b\x00\x00\x00\x00\x00\x00\x00\x00\x01q\xf9\xbb\xfa\r\x00\x00\x01q\xf9\xbb\xfa\r\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\x00\x00\x00\x01\x90\x07\x00\x00\x00\x01\x82\x07{"headers": {"Source": "py2-0.1...')])])} kafka.producer.sender DEBUG: Sending Produce Request: ProduceRequest_v3(transactional_id=None, required_acks=1, timeout=2000, topics=[(topic='communication-cm', partitions=[(partition=0, messages='\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01\xfb\x00\x00\x00\x00\x02\xe1\x91\xe7\x0b\x00\x00\x00\x00\x00\x00\x00\x00\x01q\xf9\xbb\xfa\r\x00\x00\x01q\xf9\xbb\xfa\r\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\x00\x00\x00\x01\x90\x07\x00\x00\x00\x01\x82\x07{"headers": {"Source": "py2-0.1...')])]) kafka.protocol.parser DEBUG: Sending request ProduceRequest_v3(transactional_id=None, required_acks=1, timeout=2000, topics=[(topic='communication-cm', partitions=[(partition=0, messages='\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01\xfb\x00\x00\x00\x00\x02\xe1\x91\xe7\x0b\x00\x00\x00\x00\x00\x00\x00\x00\x01q\xf9\xbb\xfa\r\x00\x00\x01q\xf9\xbb\xfa\r\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\x00\x00\x00\x01\x90\x07\x00\x00\x00\x01\x82\x07{"headers": {"Source": "py2-0.1...')])]) kafka.conn DEBUG: <BrokerConnection node_id=0 host=Brahma:9092 <connected> [IPv4 ('127.0.1.1', 9092)]> Request 1: ProduceRequest_v3(transactional_id=None, required_acks=1, timeout=2000, topics=[(topic='communication-cm', partitions=[(partition=0, messages='\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01\xfb\x00\x00\x00\x00\x02\xe1\x91\xe7\x0b\x00\x00\x00\x00\x00\x00\x00\x00\x01q\xf9\xbb\xfa\r\x00\x00\x01q\xf9\xbb\xfa\r\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\x00\x00\x00\x01\x90\x07\x00\x00\x00\x01\x82\x07{"headers": {"Source": "py2-0.1...')])]) kafka.protocol.parser DEBUG: Received correlation id: 1 kafka.protocol.parser DEBUG: Processing response ProduceResponse_v3 kafka.conn DEBUG: <BrokerConnection node_id=0 host=Brahma:9092 <connected> [IPv4 ('127.0.1.1', 9092)]> Response 1 (1.69205665588 ms): ProduceResponse_v3(topics=[(topic=u'communication-cm', partitions=[(partition=0, error_code=0, offset=701, timestamp=-1)])], throttle_time_ms=0) kafka.producer.sender DEBUG: Parsing produce response: ProduceResponse_v3(topics=[(topic=u'communication-cm', partitions=[(partition=0, error_code=0, offset=701, timestamp=-1)])], throttle_time_ms=0) kafka.producer.record_accumulator DEBUG: Produced messages to topic-partition TopicPartition(topic='communication-cm', partition=0) with base offset 701 and error None. kafka.conn INFO: <BrokerConnection node_id=0 host=Brahma:9092 <connected> [IPv4 ('127.0.1.1', 9092)]>: Closing connection. kafka.conn DEBUG: <BrokerConnection node_id=0 host=Brahma:9092 <connected> [IPv4 ('127.0.1.1', 9092)]>: reconnect backoff 0.0466699616725 after 1 failures kafka.producer.sender DEBUG: Shutdown of Kafka producer I/O thread has completed. kafka.producer.kafka DEBUG: The Kafka producer has closed. ccs-python-client INFO: {'_produce_future': <kafka.producer.future.FutureProduceResult object at 0x7f627a8ed890>, '_errbacks': [], '_callbacks': [], 'args': (0, 1589032778253, None, -1, 449, -1), 'is_done': True, 'exception': None, 'value': RecordMetadata(topic='communication-cm', partition=0, topic_partition=TopicPartition(topic='communication-cm', partition=0), offset=701, timestamp=1589032778253, checksum=None, serialized_key_size=-1, serialized_value_size=449, serialized_header_size=-1)} ccs-python-client INFO: Message sent 62430311064981508370
Find difference