RudderStack v0.1.10 Release Notes
Release Date: 2022-06-14 // almost 2 years ago-
🔋 Features
- calculate aggregated pending_events_count metrics for all workspaces (#1858) (f16a239)
- 👷 capture rudder-sources job statistics (#1949) (d14deba)
- Checks checksum written to the destination ssl folder, rewrite only if checksum changes (214e774)
- Checks checksum written to the destination ssl folder, rewrite only if checksum changes (57f73e8)
- core: add support for transient sources (#1869) (049b015)
- core: default rsources.JobService implementation (#1938) (b08bdee)
- core: updating enterprise commit with changes related reporting service (#2035) (e94d313)
- enable timeouts for google destinations (#1857) (31b64d7)
- gateway back pressure mechanism implementation (#1847) (c9b6f02)
- gateway: introduce /job-status endpoint (#1917) (688cf1e)
- 👍 google sheets batching support (#1764) (497b1d9)
- 👷 jobsdb: made backup related config hot-reloadable (#1844) (5f69442)
- 👷 jobsdb: support limiting jobs' pickup based on total payload size (#1884) (699727f)
- kafka client (#1875) (f900211)
- kafka publishTime stat (#2008) (01454ad)
- more kafka stats (#2013) (c2379c1)
- multi-tenant: add mode provider in docker-compose file (#1931) (a81bb0a)
- multi-tenant: cluster manager gateway int (#1943) (1f2ca4d)
- multi-tenant: etcd provider and config backend updates (#1839) (6985721)
- multi-tenant: introduce deployment types, enabling multitenant with etcd (#1882) (6c04f99)
- multi-tenant: multitenant support for embedded app (#2018) (8ea4ff6)
- multi-tenant: use cached backend config (#1996) (8f1cc8b)
- router: enable batching config at destType level. (#1902) (d69d489)
- router: use a circuit breaker while producing custom destination clients (#2016) (235f3c2)
- stats for skipped messages on kafka destinations (#1934) (b58c7e9)
- 👉 use new client for kafkamanager to support timeouts (#1920) (82db596)
- warehouse: added metrics for capturing stats in warehouse scheduling (d2868c7)
- warehouse: added support for deltalake partition and external location support. (#1914) (7d85221)
- warehouse: added support for multi retry admin api (#1889) (230473b)
- warehouse: configurable timewindow layout for gcs datalake (#2015) (931c5fc)
- warehouse: json column support for warehouse destinations bq,postgres,snowlake,rs (#1897) (2f877f7)
🐛 Bug Fixes
pre_drop
table pileup issue (#1799) (e301b56)- ➕ added http client timeout (#1873) (83f8041)
- ➕ added http client timeout in processor transformer (#1887) (7028f15)
- admin status handlers data race (#1838) (d4bdb5c)
- 0️⃣ disable bq dedup by default (#1855) (8c05b37)
- disable creation of views when dedup is enabled in BQ (#1885) (414551d)
- disable stash backup if master Backup is disabled. (#1874) (ea9921d)
- 👍 disable support for Google Developers Console client_credentials.json file (#2001) (ef83509)
- 👷 do not skip stash aborting jobs if backup is disabled (#2003) (498bd93)
- enabling earlier usage of stats in other components (#1937) (b71c93d)
- EventBus memory issue with slow subscribers (#1802) (d6b85c1)
- 👷 execute ANALYZE after completing batch jobsdb operations (#1800) (db951aa)
- 🛠 fix repetitive bugsnag alert for a single crash (#1928) (0653956)
- 👮 Force set lower version during pg notifier sql migration (#1907) (151e308)
- 👮 Force set lower version during pg notifier sql migration (#1907) (#1908) (a54bc45)
- gateway: getUsersPayload optimizations (#2040) (f48693e)
- install ginkgo V2 cli (ee904a4)
- 👷 Jobsdb migration bug (#1785) (b091116)
- 👷 jobsdb: mark MIGRATE_COPY done and POST_MIGRATE_DS_OP start atomically (#1999) (0ef882f)
- 👷 jobsdb: sanitize jsonb values before inserting them to the database (#1963) (c74df14)
- 🔒 lock by value (#1842) (777541c)
- 👉 Makefile: Keep separate cover profiles (823ab85)
- 🚚 move initialisation to setup (23445a4)
- multi-tenant: etcd Key case fix (#1954) (304a0b7)
- multi-tenant: multitenanat backend config (#1930) (1ed73fa)
- ovverride arm64 check (#1936) (e887e23)
- rateLimit: Moving Rate Limit Block post Validations (4720e6b)
- readme: update developer machine setup link (#1843) (cd32fb7)
- ✂ remove ginkgo version (87c3d89)
- ✂ Remove unused Setup and Finish methods (0149a18)
- reporting the drained events to the reports table (#1982) (b40dabe)
- reporting: gateway events are not reported when source is connected to no destination(or device mode destination) (#1822) (2962bd6)
- router: Added/Modified Stats for assistance in debugging for transformerProxy (#1979) (b79d9d9)
- router: panic sources grouped together (#1846) (69344c6)
- safe concurrent access of metric registry's index values (#1805) (7e672e6)
- 💾 Save responses from the destinations with odd content-type header (#1749) (67c1f59)
- 👌 support multiple configvars registration (#1878) (e1ece33)
- take care of nullable columns when retrieving dangling connections (#1801) (099b3c0)
- ✅ tests.yaml: remove go get ginkgo (5ad45bc)
- ✅ tests.yaml: remove go get ginkgo open source (bac703c)
- tooling: add prometheus endpoints for OSS users (867c9c3)
- ⚡️ update enterprise commit (ad3dc56)
- ⚡️ Update enterprise commit (55a0f83)
- 👉 use the correct measurement name and tags for aggregated pending events metrics (#1891) (5f45c1f)
- warehouse: Add explicit migration for pg notifier priority column (#1898) (224038d)
- warehouse: add support for multiline in deltalake. (#1872) (ecace44)
- warehouse: added ability to test destination credentials once the upload gets aborted (#1890) (fbc862d)
- warehouse: closing file while creating load file for warehouse configuration test (#1919) (8d71648)
- warehouse: columns need to be provided during copy command for deltalake (#2033) (75d15c6)
- warehouse: deltalake users table getting populated corruptly. (#1976) (#1977) (8ba4182)
- warehouse: dsiable reporting setup for slave (#2037) (983338a)
- warehouse: fix s3 manager for aws glue region (#1951) (539c0c9)
- warehouse: fixing timeout issue for snowflake (#1945) (c82428a)
- warehouse: skip backendConfig check for slave (#2034) (e513501)
- warehouse: skipping bigquery integration test for now (4bae57b)
- warehouse: updated reserved keywords for warehouse mssql and azure destination (#1932) (928d3d4)
- warehouse: use correct locks for dateformat in processor (#2020) (972577a)
- warehouse: warehouse schema int to float schema fix (#1974) (bf46c85)
- wrong routing of warehouse crash alerts (#1926) (e77dc83)
Miscellaneous Chores
- 🆕 new release 0.1.10 (e8fc750)