Skip to content
This repository has been archived by the owner on May 28, 2019. It is now read-only.

优先级抢占调度设计 #260

Open
imotai opened this issue Dec 8, 2015 · 0 comments
Open

优先级抢占调度设计 #260

imotai opened this issue Dec 8, 2015 · 0 comments

Comments

@imotai
Copy link
Collaborator

imotai commented Dec 8, 2015

背景

目前在galaxy 调度器 采用FCFS(First come ,First served)策略,当chunkserver,tabletserver 出现故障或者升级时释放出资源,此时上层计算任务先到达调度器,可用占用释放出的资源,而后到的chunkserver,tabletserver无法重新部署到以前的机器上面,会导致chunkserver丢副本,tabletserver丢ssd cache

优先级分类

对galaxy服务的应用可以大致抽象3个优先级层次出来

  • 对硬件资源有需要的chunkserver,tabletserver storage_service 100
  • 常驻内存只对cpu 内存有需求的 normal_service 70
  • 只运行一段时间的 batch_task 20

抢占策略

采用悲观抢占方式,每次抢占都要全局最优,同一类优先级服务不抢占,只抢占下一层级资源,但享受优先调度,

实现

目前只实现对批处理任务抢占#262

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant