Tag Archives: Kafka

Kafka vs. RabbitMQ: Evaluating Node.js message brokers – Node Developer

Kafka vs. RabbitMQ: Evaluating Node.js message brokers Written by Knowledge Ekpot ✏️ A message dealer is a pc program that permits software program, techniques, and companies to speak with one another and alternate knowledge, taking incoming messages from functions and performing actions on them. Through the use of message brokers, producers and shoppers can talk…

Read More

Optimizing Kafka producers for latency – Python Developer

Optimizing Kafka producers for latency TL;DR Don’t neglect to set socket.nagle.disable=True to disable Nagle’s algorithm The code I’m working with makes use of Confluent Kafka Python library that calls librdkafka C++ library beneath. The code does synchronous messaging: it produces occasions one-by-one and ensures occasion is endured in Kafka subject by ready for acknowledgments from…

Read More

Constructing a realtime ticket reserving resolution with Kafka, FastAPI, and Ably – Study from Tutorial

Constructing a realtime ticket reserving resolution with Kafka, FastAPI, and Ably Because the post-pandemic world emerges, the way forward for occasions corresponding to summits, conferences or live shows is brighter than ever. Because of hybrid events, in-person occasions at the moment are doubled by on-line happenings, which permits occasion organizers to achieve a lot bigger, geographically…

Read More

Parallel, Back-pressured Kafka Consumer – Learn from Tutorial

Parallel, Back-pressured Kafka Consumer Introduction Almost every Kafka Consumer tutorial structure their code like this: KafkaConsumer<String, Payment> consumer = new KafkaConsumer<>(props) // Subscribe to Kafka topics consumer.subscribe(topics); while (true) { // Poll Kafka for new messages ConsumerRecords<String, String> records = consumer.poll(100); // Processing logic for (ConsumerRecord<String, String> record : records) { doSomething(record); } } }…

Read More

Create page view analytics system using Kafka, Go, Postgres & GraphQL in 5 steps – Developers Feed

Create page view analytics system using Kafka, Go, Postgres & GraphQL in 5 steps Apache Kafka is an open source distributed event streaming platform used for high performance data pipelines. It can be used for real-time / batch data processing. Typical kafka system looks like Why we need kafka? Note: Skip this section if you…

Read More

Beginner Kafka tutorial: Get started with distributed systems – Learn from Tutorial

Beginner Kafka tutorial: Get started with distributed systems Distributed systems are collections of computers that work together to form a single computer for end-users. They allow us to scale at exponential rates, and they can handle billions of requests and upgrades without downtime. Apache Kafka has become one of the most widely used distributed systems…

Read More

Build a event-driven app with Micronaut, Kafka and Debezium – Developers Feed

Build a event-driven app with Micronaut, Kafka and Debezium Intro In this article we’ll be building a event-driven app in Java using the Micronaut framework. A quick word on event-driven architectures For the purposes of this article, it’s fine to understand that: an event is a representation of a change in an state in a…

Read More

Deploy Kafka + Filebeat + ELK – Docker Edition – Part 2 – Developers Feed

Deploy Kafka + Filebeat + ELK – Docker Edition – Part 2 Introduction This article is the last part of a two part series where we will deploy ELK stack using docker/docker-compose.In this article, we will be configuring Logstash, Elasticsearch and Kibana. If you haven’t gone through the previous article, check out this link Logstash…

Read More