More than 3000 questions in repository. There are more than 900 unanswered questions. Click here and help us by providing the answer. Have a video suggestion. Click Correct / Improve and please let us know.
Ans. Kafka is a distributed, partitioned, replicated commit log service. It provides the functionality of a messaging system through messages being written to logs.
Help us improve. Please let us know the company, where you were asked this question :
Q4. Have you used Kafka in your project ? If Yes, for what ?
Ans. We were using Kafka as a replacement for JMS Message Queue for better throughput. We were just using a simple Java multi threaded client as order of message consumption didn't matter to us.
Help us improve. Please let us know the company, where you were asked this question :
Q8. If we have more threads than partitions in a kafka consumer, How can we model it efficiently ?
Ans. We will have to use multiple consumer groups in that case as threads will remain idle if we use single consumer group. A more sophisticated algorithm could be required with multiple groups if we have to ensure the order of consumption.
Help us improve. Please let us know the company, where you were asked this question :
Ans. Yes, it's a project by confluent that provides in built mechanism for streaming records from bigdata data source to apache kafka message queues and vice versa. It provides a variety of source and sink connectors to achieve this.
Help us improve. Please let us know the company, where you were asked this question :
Ans. Source connectors are the connectors that are used to get information from the source whereas sink connectors are used to deploy information to the destination.
Help us improve. Please let us know the company, where you were asked this question :
More than 3000 questions in repository.
Discuss 
kafka bigdata message queue 
Asked in 4 Companies
basic 
frequent