forked from eventql/eventql
-
Notifications
You must be signed in to change notification settings - Fork 0
/
Copy pathCHANGELOG
218 lines (155 loc) · 8.23 KB
/
CHANGELOG
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
EventQL v0.4.1 beta;
* Fixed a potential modulo by zero errror in server allocator
EventQL v0.4.0 (v0.4.0-rc0, git267e851) beta; 2016-12-20 13:43:47 +0000
* Changed the parallel GROUP BY operation to use the new native protocol and
to schedule all remote partial group bys from a a single thread using
asynchronous I/O (currently via poll()).
* Changed the evql client to use the new native protocol
* Changed the connection acceptor code to read the first byte of an incoming
connection and switch protocols (currently HTTP and native) based on this
first byte
* Changed the http server code to execute incoming requests from within a
database thread (previously this was a generic thread pool)
* Changed the internal cluster auth to require all internal hosts to be
whitelisted using the cluster.allowed_hosts option. In standalone mode,
the whitelist is defaulted to 0.0.0.0/0
* Changed the HTTP transport to run fully within the database thread (i.e.
removed the dependency on an external event loop) and added http timeouts
* Changed the SQL engine to use the new native transport
* Changed the zookeeper backend to explicitly reconnect on session timeouts
and not rely on the built-in reconnect mechanism
* Changed the DESCRIBE TABLE statement to return a new "encoding" column that
contains information about the column's encoding settings
* Changed the server allocator to assign new partitions to servers using
a weighted random scheme, taking into a account the load facotr and the
number of available bytes on disk for each server
* Changed all metadata operations to use the native protocol
* Removed the obsolete "sha1_tokens" field from the cluster/server config
* Removed the PCRE dependency
* Added a native transport layer (a framed TCP-based protocol). See
doc/internals/protocol.txt for the specification
* Added a c client driver library (libevqlclient)
* Added a new table config option that allows to set a finite partition size
(called a "partition size hint" in the user facing documentation). A table
with a finite partition size will initially have zero partitions but
instead add (finite) partitions as it receives inserts for the respective
chunks of the keyspace (without splitting the new partition from a larger
partition)
* Added the DROP TABLE statement
* Added a thread-local storage and retrieval mechanism for the current
session. This also adds a new requirement that all operations must be
executed from within a valid database thread.
* Added support for loading configuration files using the '-c' flag and for
setting/overring individual configuration parameters using the '-C' flags
in the EventQL client (evql) binary
* Added the following new configuration options: server.c2s_io_timeout,
server.c2s_idle_timeout, server.s2s_io_timeout, server.s2s_idle_timeout,
server.heartbeat_interval, cluster.allowed_hosts, server.http_io_timeout,
server.query_progress_rate_limit, cluster.allow_anonymous,
cluster.allow_drop_table, server.query_max_concurrent_shards,
server.query_max_concurrent_shards_per_host,
server.query_failed_shard_policy, client.timeout, server.disk_capacity,
server.load_limit_{soft,hard}, server.partitions_loading_limit_{soft,hard},
server.loadinfo_publish_interval, server.noalloc,
server.s2s_pool_max_connections, server.s2s_pool_max_connections_per_host,
server.s2s_pool_linger_timeout, cluster.allow_create_database,
server.replication_threads_max
* Added the evqlslap benchmark and load testing tool
* Added caching for metadata lookups
* Added internal (server-to-server) connection pooling for native TCP
connections
* Added a new "user defined partitioning" mode that can be enabled by setting
user_defined_partitioning=true on a table and allows to explicitly specify
the partition key for each row
* Added a new monitor thread that publishes disk usage and other load
information to the coordination service
* Added new frames to native protocol: ACK, INSERT, REPL_INSERT,
META_GETFILE{_RESULT}, META_CREATEFILE, META_PERFORMOP{_RESULT},
META_DISCOVER{_RESULT}, META_LISTPARTITIONS{_RESULT},
META_FINDPARTITION{_RESULT}
* Added the DESCRIBE PARTITIONS table statement to obtain information about
the partitions of a table
* Added the USE statement to switch databases
* Added new sql functions: usleep, fnv32
* Added the CREATE DATABASE statement
* Added the CLUSTER SHOW SERVERS statement and the cluster-list command to
obtain information about the servers of the current cluster.
* Added the table-import command to the evqlctl util
* Added a basic ruby driver (drivers/ruby)
EventQL v0.3.2 (v0.3.2, gitb0ea6bc) beta; 2016-09-13 15:23:08 +0000
* Fixed a bug in the eventql client (evql) where missing HOME and USER
env variables would lead to an assertion on some libc++ implementations
* Added the client.history_file and client.history_maxlen options to the
eventql client (evql)
EventQL v0.3.1 (v0.3.1, git2da7f66) beta; 2016-09-04 16:11:19 +0000
* Fixed a bug in the standalone backend where any ALTER TABLE statements
would fail with "table already exists"
* Changed the mapreduce reduce shard allocation so that (in most cases)
repeated executions of the same job will result in (unchanged) reduce
shards being scheduled on the same machines as before to improve cache
hit rates.
* Changed the default policy for handling failed mapreduce shards from ERROR
(return an error to the user) to IGNORE (ignore the missing shard and
continue without it)
* Changed kDefaultMaxConcurrentTasks (the default maximum number of threads
to be started for a single sql query) from 32 to 64
* Added a new execution step to the mapreduce scheduler where, before running
a given map task on any of the candidate servers, we try to retrieve it
from cache on each of the candidate servers (and bail early if we find it).
* Added verbose debug-logging to the MapReduce scheduler.
* Added many documentation improvements, dockerfiles, examples, etc
EventQL v0.3.0 (v0.3.0-rc0, gita2fa235) beta; 2016-07-25 22:53:29 +0000
* Renamed the project to EventQL (the previous name was ZenDB Z1)
* Removed the old web interface and all non-core services such as the logfile
service
* Changed the sql query execution code to use and return result cursors (as
opposed to non-interruptable result streams)
v0.2.4 (2016-02-24)
===================
- improved SValue interface and numeric/time handling
- new functions: now(), z1_version()
v0.2.3 (2016-02-04)
===================
- MR: support column projection in mapreduces
- BUG: fix minor bugs in constant folding and constraint resolution
v0.2.2 (2015-12-30)
===================
- CORE: select TSDB partitions from tablescan constraints (deprecates .lastNdays)
- SQL: implemented JOIN
- SQL: implemented table subqueries
- SQL: implemented constant folding
- SQL: implemented scan constraint extraction
- SQL: improved column name resolution and group by select list rewriting
- SQL: implemented WHERE pushdown (predicate pruning/rewriting)
- SQL: implemented to_{string,int,float,bool} conversion functions
- SQL: implemented time_at function
- WEBUI: new table management UI
v0.2.1 (2015-12-16)
===================
- CORE: removed COLSM v0.2.0 upgrade code
- API: drilldown query API
- API: metrics support
- API: http/mapreduce error handling improvements
- API: javascript utf8 fixes
- WEBUI: stats on /zstatus/
v0.2.0 (2015-12-09)
===================
- CORE: upgrade to COLSM v0.2.0 storage engine (enables true LSM with UPDATEs)
- WEBUI: UI fixes
v0.1.2 (2015-12-06)
===================
- CORE: TimeWindowPartitioner::partitionKeysFor one-off fix
- WEBUI: UI refresh
v0.1.1 (2015-12-04)
===================
- CORE: z1d daemonization
v0.1.0 (2015-11-26)
===================
- CORE: timeseries and static partitioned tables
- CORE: DHT based replication and sharding
- CORE: COLSM v0.1.0 storage (append only)
- CORE: basic zmaster
- SQL: basic SQL engine
- API: basic javascript (spidermonkey) integration, MR framework
- API: basic HTTP API
- WEBUI: sql editor, table management UI