Yarn Frequently Asked Questions
(Doc ID 1910068.1)
Last updated on APRIL 08, 2020
Applies to:Big Data Appliance Integrated Software - Version 2.5.0 and later
This document provides answers to frequently asked questions about Yarn installed on Oracle Big Data Appliance (BDA).
To view full details, sign in with your My Oracle Support account.
Don't have a My Oracle Support account? Click to get started!
In this Document
|Questions and Answers|
|What is Yarn?|
|Will I need to make changes to my code or scripts when using Yarn instead of MapReduce?|
|Is there anyway to calculate how many containers (2 MB / 1 CPU) that particular user might consume when we migrate to CDH 5 / YARN?|
|Does it mean, it will use both memory and cpu in the calculation if we use FIFO scheduler; but use memory only if we use Fair scheduler? Since we are using Fair scheduler, then I assume cores will be ignored in the calculation. Is that right?|
|The fair scheduler allocation is different in CDH 5.0.1. We can't migrate automatically the allocation file from cdh 4 to cdh 5. It has to be done manually. How can we set up the same in CDH 5 as we had in CDH 4?|
|Do Hue users need to have an account on all BDA nodes or on the Resource Manager (RM) nodes to avoid getting "Failed to run job : Error assigning app to queue default" when running a job?|
|We set the yarn.nodemanager.resource.memory-mb in CM, but the job.xml file is still showing the default 8GB. Why isn't this setting taking place?|
|What is this "Java Heap Size of NodeManager" and how is it related to Container memory given by yarn.nodemanager.resource.memory-mb?|
|Is there any way to exclude one rack completely (18 nodes) for just one user? Can I use yarn.resourcemanager.nodes.exclude-path parameter somehow on the server where the user is running the job so we can exclude the rack 4 nodes from consideration?|