How to Purge a Running Kafka Topic ?

---

This post explains how to Purge a Kafka Topic.

Option 1:

Please follow below steps and give a try –

• Go to config/server.properties.
• Set “delete.topic.enable=true”
• This might take some time to be in actual effect.

Next go to Kafka bin directory and run the below –

bin/kafka-topics.sh --zookeeper localhost:2181 --delete --topic topic1

This will delete the queue. However upon deleting if you like to re-create the topic again go to the Kafka bin directory. And run the below –

bin/kafka-topics.sh --create --zookeeper localhost:2181 --replication-factor 1 --partitions 1 --topic topic1  

Option 2:

Decrease the Retention time of the Topic to 1 second or 2 second etc. 1. Check current Retention period of the Topic

• Go to Kafka bin directory
• Modify & Run below

kafka-configs --zookeeper :2181 --describe --entity-type topics --entity-name

2. Next change the Retention period. Use below -

kafka-configs.sh --zookeeper :2181 --entity-type topics --alter --entity-name --add-config retention.ms=1000

Give some time to take effect

3. Once the deletion is done, reset the Retention time to its original value –

bin/kafka-topics.sh --zookeeper localhost:2181 --alter --topic MyTopic --deleteConfig retention.ms

(P.S. –  Based on kafka version , deleteConfig might need to be replaced with delete-config )  

Other Interesting Reads -

• How to Send Large Messages in Kafka ?

• Fix Spark Error – “org.apache.spark.SparkException: Failed to get broadcast_0_piece0 of broadcast_0”

• How to Handle Bad or Corrupt records in Apache Spark ?

• How to use Broadcast Variable in Spark ?

• Best Practices for Dependency Problem in Spark

• Sample Code – Spark Structured Streaming vs Spark Streaming

• Sample Code for PySpark Cassandra Application

How to Purge a Running Kafka Topic, kafka remove message from topic after consume, kafka clear all data in topic, kafka topic marked for deletion but not deleted, delete messages from kafka topic java, kafka list topics, kafka topic retention, kafka delete all topics, kafka create topic, kafka topic marked for deletion but not deleting, kafka clear all data in topic, kafka delete all topics, kafka create topic, kafka list topics, kafka delete topic not working, kafka delete topic programmatically, kafka get retention time for topic, kafka list topics, kafka create topic, kafka delete topic, how to stop kafka consumer, kafka topic marked for deletion but not deleting, kafka commands cheat sheet, kafka broker kafka tutorial, kafka topic marked for deletion, kafka delete topic, kafka create topic, kafka clear all data in topic, kafka list topics, kafka delete all topics, kafka delete topic not working, confluent kafka delete topic

purge kafka topic ,purge kafka topic messages ,purge kafka topic java ,purge kafka topic docker ,python kafka purge topic ,apache kafka purge topic ,kafka topic retention period ,how to check kafka topic retention period ,remove message from kafka topic after consume ,delete kafka topic ,kafka delete all topics ,kafka delete topic not working ,delete messages from kafka topic java ,kafka delete topic programmatically ,purge kafka topic ,purge kafka topic messages ,purge kafka topic java ,purge kafka topic docker ,python kafka purge topic ,apache kafka purge topic ,kafka purge a topic ,kafka purge all topics ,purge kafka topic command ,kafka purge compacted topic ,purge kafka topic data ,purge a topic kafka ,kafka purge messages from topic ,how to purge kafka topic ,how to purge data from kafka topic ,purge topic in kafka ,purge messages in kafka topic ,purge kafka topic using java ,clean kafka topic data ,clear kafka topic data ,purge kafka topic ,kafka tool purge topic ,kafka topic purge all messages ,how to purge topic in kafka ,delete kafka topic java code ,kafka delete topic java example ,delete kafka topic from java ,kafka delete topic java.nio.file.accessdeniedexception ,delete kafka topic docker ,python kafka delete topic ,python kafka clear topic ,apache kafka delete topic ,apache kafka clear topic messages ,apache kafka delete topic messages ,apache kafka delete topic marked for deletion ,apache kafka delete.topic.enable ,apache kafka delete topic java ,apache kafka delete all topics ,apache kafka clear topic ,kafka delete a topic ,kafka purge topic messages ,kafka purge topic java ,kafka force delete a topic ,kafka delete.topic.enable ,kafka delete topic not working ,kafka remove topic from consumer group ,kafka delete topic and data ,kafka delete all topic ,kafka delete topic and recreate ,kafka delete topic api ,kafka delete topic acl ,kafka auto delete topic ,kafka adminclient delete topic ,kafka delete topic bootstrap server ,kafka delete topics by prefix ,kafka delete topic command ,kafka delete topic content ,kafka remove topic command ,kafka delete topic \_\_consumer\_offsets ,kafka delete topic config ,kafka delete topic confluent ,kafka purge topic data ,kafka delete topic data ,kafka delete topic docker ,kafka delete topic does not work ,delete kafka topic directory ,kafka delete.topic.enable is not set to true ,kafka delete.topic.enable environment variable ,kafka delete topic example ,kafka delete topic error ,kafka delete topic force ,kafka delete topic from zookeeper ,kafka delete topic from java ,kafka remove topic from group ,kafka delete topic failed ,kafka delete a message from topic ,kafka delete topic group ,kafka how to purge a topic ,kafka delete topic immediately ,kafka delete internal topic ,delete kafka topic in java ,how to purge a topic in kafka ,kafka delete topic java ,kafka delete topic java api , , ,apache kafka purge topic ,confluent kafka purge topic ,docker kafka purge topic ,how to purge data from kafka topic ,

how to purge kafka topic ,how to purge messages from kafka topic ,how to purge topic in kafka ,java purge kafka topic ,kafka command line purge topic ,kafka console purge topic ,kafka purge a topic ,kafka purge all topics ,kafka purge compacted topic ,kafka purge messages from topic ,kafka tool purge topic ,kafka topic purge all messages ,purge a kafka topic ,purge kafka topic ,purge kafka topic android ,purge kafka topic bootstrap ,purge kafka topic browser ,purge kafka topic command ,purge kafka topic data ,purge kafka topic docker ,purge kafka topic error ,purge kafka topic example ,purge kafka topic generator ,purge kafka topic github ,purge kafka topic group ,purge kafka topic guide ,purge kafka topic java ,purge kafka topic key ,purge kafka topic kotlin ,purge kafka topic kubernetes ,purge kafka topic list ,purge kafka topic messages ,purge kafka topic name ,purge kafka topic offset ,purge kafka topic online ,purge kafka topic query ,purge kafka topic questions ,purge kafka topic quotes ,purge kafka topic react ,purge kafka topic using java ,purge kafka topic value ,purge kafka topic viewer ,purge kafka topic wildcard ,purge kafka topic with example ,purge kafka topic xcode ,purge kafka topic xml ,purge kafka topic xpath ,purge kafka topic yaml ,purge kafka topic yes or no ,purge kafka topic yield ,purge kafka topic youtube ,purge kafka topic zero ,purge kafka topic zerodha ,purge kafka topic zip ,purge messages in kafka topic ,purge topic in kafka ,python kafka purge topic ,spring kafka purge topic