Commit Graph

296 Commits

Author SHA1 Message Date
Kanthi Subramanian
9a5db02a49 Added support for remote debugging Kafka connector and entrypoint db to load data to msysql and clickhouse. 2022-04-05 11:03:49 -04:00
Vladislav Klimenko
fb91365c4e dev: dedup based on key map and queue 2022-04-05 17:15:49 +03:00
Vladislav Klimenko
371c52f491 env: name connector properly 2022-04-05 17:15:24 +03:00
Vladislav Klimenko
c85cef8da7 env: add docker-compose run scripts 2022-04-05 17:15:10 +03:00
Vladislav Klimenko
fdc80e8e92 dev: dedup 2022-04-05 12:27:11 +03:00
Vladislav Klimenko
89048000d4 dev: use logger everywhere, simplify code 2022-04-05 01:55:05 +03:00
Vladislav Klimenko
edb6cf93e3 dev: merge 2022-04-04 18:18:07 +03:00
Vladislav Klimenko
99c479f1f3 dev: workflow 2022-04-04 17:41:07 +03:00
Kanthi Subramanian
2a0431614d Added logic to create a new thread to handle flushing of records to Clickhouse 2022-04-04 09:41:54 -04:00
Vladislav Klimenko
245d80ebb6 doc: glosasry 2022-04-04 12:28:35 +03:00
Vladislav Klimenko
c8bf0b308c doc: index 2022-04-04 12:27:21 +03:00
Vladislav Klimenko
92c232811b doc: pipeline clarification 2022-04-04 12:18:18 +03:00
Vladislav Klimenko
a11442bc4a env: move config files 2022-04-04 11:34:53 +03:00
Vladislav Klimenko
3badc0d9bc env: deploy script 2022-04-04 11:34:35 +03:00
Vladislav Klimenko
f042addb95 envL deploy sink 2022-04-04 11:34:08 +03:00
Vladislav Klimenko
5a66084276 env: deploy debezium scripts 2022-04-04 11:33:49 +03:00
Vladislav Klimenko
561aec61a2 env: docker imagee buildedr 2022-04-04 11:33:07 +03:00
Vladislav Klimenko
d0560cb133 env: Connector Dockerfile 2022-04-04 11:32:39 +03:00
Vladislav Klimenko
6737d6bba8 env: sql deploy scripts 2022-04-04 11:31:59 +03:00
Vladislav Klimenko
96303ca6c7 env: move sql files 2022-04-04 11:31:38 +03:00
Vladislav Klimenko
01ffaf47fc docs: deploy 2022-04-04 11:08:15 +03:00
Vladislav Klimenko
391dcb331e end: k8s redpanda internal and external deploy 2022-04-04 11:08:00 +03:00
Vladislav Klimenko
64cc301824 env: k8s basic deploy 2022-04-04 11:07:34 +03:00
Vladislav Klimenko
302942e623 env: docker-compose deploy for the whole pipleline 2022-04-04 11:06:54 +03:00
Vladislav Klimenko
d5893bd291 doc: setup 2022-04-04 11:06:17 +03:00
Vladislav Klimenko
724aaa2877 env: readme for img 2022-04-04 11:05:49 +03:00
Vladislav Klimenko
c80ba86cb7 env: move config files outside of sources 2022-04-04 11:05:04 +03:00
Vladislav Klimenko
67a0b40ff0 env: make yanml multi-document and start file 2022-04-02 00:13:23 +03:00
Vladislav Klimenko
20ba705676 Merge remote-tracking branch 'altinity/mysql_json_converter' into main 2022-04-01 23:14:44 +03:00
Vladislav Klimenko
0b0aa0fd08 arch and pipeline docs 2022-04-01 23:12:51 +03:00
Kanthi Subramanian
5077fe1efa Added logic to use Clickhouse JDBC connector, convert the debezium data types and perform a batch insert. 2022-04-01 10:19:15 -04:00
Vladislav Klimenko
108b32f180 env: introduce dedploy 2022-04-01 15:02:30 +03:00
Vladislav Klimenko
f16d7a4069 docs: skeleton 2022-04-01 15:00:03 +03:00
Vladislav Klimenko
95ec8e1401 adoption 2022-04-01 14:16:13 +03:00
Vladislav Klimenko
ba49e3642f formatter 2022-04-01 12:34:21 +03:00
Vladislav Klimenko
12b1f95b24 dev: validators 2022-04-01 12:28:16 +03:00
Vladislav Klimenko
d68cd9d5ec clarify task 2022-04-01 12:09:52 +03:00
Vladislav Klimenko
643b092193 preCommit 2022-03-30 17:59:21 +03:00
Vladislav Klimenko
cadf0a2a15 dev: group connector configuration variables 2022-03-30 17:51:00 +03:00
Vladislav Klimenko
7ec8056e4e dev: clarify connector 2022-03-30 15:25:30 +03:00
Vladislav Klimenko
f465e6e311 dev: merge conflicts 2022-03-30 15:12:50 +03:00
Kanthi Subramanian
40a781d3a9 Added initial commit of files from the original repo 2022-03-28 09:16:31 -04:00
Vladislav Klimenko
0a8e5c21e1 clean and log errors 2022-03-25 16:37:05 +03:00
Vladislav Klimenko
87a5f3d22a package ClickHOuse client 2022-03-25 15:57:32 +03:00
Vladislav Klimenko
07a655491e dev: start 2022-03-22 17:18:10 +03:00
alex-zaitsev
505f622b91
Initial commit 2022-03-21 11:32:45 +03:00