ccah-500 第57题 Which two best describes how FIFO Scheduler arbitrates the cluster resources for job
来源:互联网 发布:sql存储过程怎么写 编辑:程序博客网 时间:2024/06/10 17:20
57.You have a cluster running with a FIFO scheduler enabled. You submit a large job A to the cluster, which you expect to run for one hour. Then, you submit job B to the cluster, which you expect to run a couple of minutes only.You submit both jobs with the same priority.
Which two best describes how FIFO Scheduler arbitrates the cluster resources for job and its tasks?(Choose two)
A. Because there is a more than a single job on the cluster, the FIFO Scheduler will enforce a limit on the percentage of resources allocated to a particular job at any given time
B. Tasks are scheduled on the order of their job submission
C. The order of execution of job may vary
D. Given job A and submitted in that order, all tasks from job A are guaranteed to finish before all tasks from job B
E. The FIFO Scheduler will give, on average, and equal share of the cluster resources over the job lifecycle
F. The FIFO Scheduler will pass an exception back to the client when Job B is submitted, since all slots on the cluster are use
Answer: A,D -->B D
reference:
http://stackoverflow.com/questions/7483624/running-jobs-parallely-in-hadoop
http://www.aiotestking.com/cloudera/which-two-best-describes-how-fifo-scheduler-arbitrates-the-cluster-resources-for-job-and-its-tasks-2/
oreily:
Three schedulers are available in YARN: the FIFO, Capacity, and Fair Schedulers. The
FIFO Scheduler places applications in a queue and runs them in the order of submission
(first in, first out). Requests for the first application in the queue are allocated first; once
its requests have been satisfied, the next application in the queue is served, and so on.
The FIFO Scheduler has the merit of being simple to understand and not needing any
configuration, but it's not suitable for shared clusters. Large applications will use all the
resources in a cluster, so each application has to wait its turn. On a shared cluster it is
better to use the Capacity Scheduler or the Fair Scheduler. Both of these allow long-
running jobs to complete in a timely manner, while still allowing users who are running
concurrent smaller ad hoc queries to get results back in a reasonable time.
With the Capacity Scheduler (ii in Figure 4-3), a separate dedicated queue allows the small
job to start as soon as it is submitted, although this is at the cost of overall cluster
utilization since the queue capacity is reserved for jobs in that queue. This means that the
large job finishes later than when using the FIFO Scheduler.
With the Fair Scheduler (iii in Figure 4-3), there is no need to reserve a set amount of
capacity, since it will dynamically balance resources between all running jobs. Just after
the first (large) job starts, it is the only job running, so it gets all the resources in the
cluster. When the second (small) job starts, it is allocated half of the cluster resources so
that each job is using its fair share of resources.
Note that there is a lag between the time the second job starts and when it receives its fair
share, since it has to wait for resources to free up as containers used by the first job
complete. After the small job completes and no longer requires resources, the large job
goes back to using the full cluster capacity again. The overall effect is both high cluster
utilization and timely small job completion
- ccah-500 第57题 Which two best describes how FIFO Scheduler arbitrates the cluster resources for job
- ccah-500 第10题 Which best describes how you determine when the last checkpoint happened
- ccah-500 第5题 How will the Fair Scheduler handle these two jobs?
- ccah-500 第24题 Which two features does Kerberos security add to a Hadoop cluster
- ccah-500 第22题 Which process instantiates user code, and executes map and reduce tasks on a cluster r
- ccah-500 第31题 Which workloads benefit the most from faster network fabric
- ccah-500 第42题 want to set and enforce a block size of 128MB for all new files written to the cluster
- ccah-500 第46题 Which scenario will go undetected
- How to Find the Best Person for the Job
- ccah-500 第32题 a new user on the cluster can submit jobs into their own queue application submission
- ccah-500 第43题 file read process when a client application connects into the cluster and requests a
- ccah-500 第35题 What do you have to do on the cluster to allow the worker node to join
- ccah-500 第13题Which three basic configuration parameters must you set to migrate
- ccah-500 第28题 Which Linux commands help you to identify whether swapping is occurring
- ccah-500 第45题 You want to minimize the chance of data loss in your cluster. What should you do
- The best resources for learning exploit development
- 173.Which statement describes the effect on an index, when the indexed column for the rows is update
- ccah-500 第39题 How must you format underlying file system of each DataNode
- 广东海洋大学 电子1151 孔yanfei python语言程序设计 第二周
- Java中的线程执行器总结
- 网络编程---UDP
- 新浪云SAE---git配置
- 使用Cognos 构建IT驱动的自助式分析
- ccah-500 第57题 Which two best describes how FIFO Scheduler arbitrates the cluster resources for job
- 反射
- CSS隐藏元素的五种方法
- mycat 的简单介绍之liunx安装 ---wanzuwodou
- CSS Margin(外边距)和Padding(填充)
- 第十四周项目:阅读程序(一)
- 小飞的电梯调度算法
- linux小组分享会_遗传算法
- 对文件夹中所文件(csv)进行读写操作