Page 1 of 1

Hadoop Resource management

Posted: Fri Aug 19, 2022 7:06 am
by DougReimers
I have a 12 node cluster and I am running a yarn architecture. It seems that my nodes are busy most of the time and many times job fails. How can I check the usage of the resources at any point of time? Also is there any method to set a limited resource to a user for eg: if a user submits a job he should be given only 25gb of memory omeglz echat and 12 cores.