Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

实现海狗的实时数据源(重点) #63

Open
muyannian opened this issue May 2, 2013 · 3 comments
Open

实现海狗的实时数据源(重点) #63

muyannian opened this issue May 2, 2013 · 3 comments

Comments

@muyannian
Copy link
Owner

目前海狗的数据为T+1的
创建索引本身就有实时性的方案,考虑性能,第一期考虑全内存的模式。

@muyannian
Copy link
Owner Author

读写锁使用ReentrantReadWriteLock

@muyannian muyannian reopened this May 15, 2013
@muyannian
Copy link
Owner Author

收到消息后,将消息保存在binlog里,同时写入本地的内存队列(queue)
读取的时候先从binlog恢复(用于宕机的情况),然后从本地内存队列中取

@muyannian
Copy link
Owner Author

binlog要有一个可靠的binlog(目前还没有实现),当前的实现仅仅使用本地文件系统,如果当前机器宕机,任务迁移到了其他机器上,那么数据就会丢失。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant