DevOps | Cloud | Analytics | Open Source | Programming

How To Fix Kafka Error - " Map failed"

In this post , we will see How to Fix Kafka Error - " Map failed" while starting the Kafka server. At times , while starting the Kafka server , it throws the below error - Map failed

This issue is mainly due to the memory threshold in the Kafka Brokers. There are are couple of possible fixes , you could try for this -

  • You might try to increase the Java heap memory allocation pool to some upper value from the available memory. By default , Kafka takes the default values from /bin/ .
    • You could change\edit the value either in the same script - /bin/ or use the below command
    • Or you could change the value in /bin/

KAFKA_JVM_PERFORMANCE_OPTS="-server -XX:+UseCompressedOops -XX:+UseParNewGC -XX:+UseConcMarkSweepGC -XX:+CMSClassUnloadingEnabled -XX:+CMSScavengeBeforeRemark -XX:+DisableExplicitGC -Djava.awt.headless=true"

  • Or use the below command

export KAFKA_HEAP_OPTS="-Xmx10G -Xms512M"

  • -Xms set initial Java heap size

  • -Xmx set maximum Java heap size Note this value must be a multiple of 1024 and greater than 2MB. You need to use the letter k or K to for kilobytes, or m or M for megabytes , g or G for gigabytes. The default value is 64MB.  

  • You could also try increasing the vm.max_map_count from default 65536 to a higher no. We have already written a detailed post as regards to how to increase this value . You can read it here -  Fix Kafka Error – “Memory Allocation Error”

  Hope this helps to solve your the error. kafka error, kafka error handling, kafka streams error handling, kafka out of memory, Kafka start error  

Other Interesting Reads -