valitydev/clickhouse-sink-connector
14
0
Fork 0
mirror of https://github.com/valitydev/clickhouse-sink-connector.git synced 2024-11-06 18:45:27 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity
231 Commits 8 Branches 0 Tags 202 MiB
29f2454106
Commit Graph

231 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Vladislav Klimenko
29f2454106 polish pipeline 2022-05-12 17:09:38 +03:00
Vladislav Klimenko
ebb0af59b9 adjust port forwarder 2022-05-12 17:06:20 +03:00
Vladislav Klimenko
7e2c18f134 extract port forward 2022-05-12 16:57:17 +03:00
Vladislav Klimenko
d2c8f37270 load to local registry 2022-05-12 16:57:05 +03:00
Vladislav Klimenko
ad29db6c2b use localhost for altinity connectora 2022-05-12 16:56:49 +03:00
Vladislav Klimenko
b539882ad1 move unused files 2022-05-12 16:56:23 +03:00
Vladislav Klimenko
d059502963 docs: do not pull altinity images yet 2022-05-12 11:17:10 +03:00
Vladislav Klimenko
7510697231 use altinity image directly 2022-05-12 11:16:44 +03:00
Kanthi Subramanian
ed53f84626 Fixed image name in github action for building docker images. 2022-05-11 21:09:38 -04:00
Kanthi Subramanian
b2989fee91 Add mysql master/slave replication setup for docker-compose. Updated debezium source connector config to connect to mysql slave. 2022-05-11 21:01:12 -04:00
Vladislav Klimenko
6c39b8e78c use graalvm image 2022-05-11 15:05:55 +03:00
Vladislav Klimenko
3a4bb90362 image name 2022-05-11 15:05:43 +03:00
Vladislav Klimenko
df1835c6f3 make image names for readbale 2022-05-11 15:03:51 +03:00
Vladislav Klimenko
4061fc7607 add graalvm builder 2022-05-11 14:56:04 +03:00
Vladislav Klimenko
d5036b4d26 use proper files 2022-05-11 14:55:52 +03:00
Vladislav Klimenko
538b407322 unify naming and base image 2022-05-11 14:55:16 +03:00
Kanthi Subramanian
63252d82d4 Enable transactions metadata support in config. 2022-05-10 17:54:28 -04:00
Kanthi Subramanian
ff71203377 Fixed bug with kafka metadata columns not added when there is a source, CH columns mismatch. Added unittest for QueryFormatter class. 2022-05-10 15:59:53 -04:00
Kanthi Subramanian
b0f440ab2d Added more source kafka metadata columns(binlog pos, server id, thread, source ts_ms). 2022-05-10 12:58:54 -04:00
Kanthi Subramanian
82b23f2e5d Added test data for all blob types. 2022-05-09 13:58:02 -04:00
Kanthi Subramanian
7648df357d Added test data for all blob types. Changed input function query to support cases when there are more MySQL columns compared to Clickhouse columns. 2022-05-09 13:56:11 -04:00
Kanthi Subramanian
96dc94367a Added GraalVM kafka connect image. 2022-05-08 09:28:05 -04:00
Kanthi Subramanian
bf8604d04b Added task id to prometheus metrics. 2022-05-07 17:20:15 -04:00
Kanthi Subramanian
995f1a14d0 Merge remote-tracking branch 'origin/main' 2022-05-06 14:21:23 -04:00
Kanthi Subramanian
a7a97df488 Fixed logic with storing min offsets. 2022-05-06 14:21:16 -04:00
Vladislav Klimenko
2b01571692 split commands for copy+paste 2022-05-06 20:39:59 +03:00
Vladislav Klimenko
0a57412780 delete duplicates 2022-05-06 20:35:43 +03:00
Vladislav Klimenko
a38506654b Merge remote-tracking branch 'altinity/main' into main 2022-05-06 20:34:53 +03:00
Vladislav Klimenko
2641af59af no need to keep artefacts any more - will be built from sources 2022-05-06 20:34:28 +03:00
Vladislav Klimenko
a9d8a18b33 build images from sources 2022-05-06 20:33:43 +03:00
Vladislav Klimenko
cd9a12cfd2 do not keep libs, use them during docker build process 2022-05-06 20:33:09 +03:00
Vladislav Klimenko
f5c1bf066a use debezium-base suffix 2022-05-06 20:32:22 +03:00
Kanthi Subramanian
ae08242ec8 Added logic to also include partition in bulk metrics as one task could handle multiple partitions. 2022-05-06 12:25:33 -04:00
Kanthi Subramanian
f51591c63b Added config variables to enable metrics and to pass the metrics endpoint port. Refactor metrics class. 2022-05-06 11:41:31 -04:00
Kanthi Subramanian
b2eb67d2c0 Fix github runner for building docker images. 2022-05-06 10:01:35 -04:00
Kanthi Subramanian
06ed8b180f Added logic to record min and max offset of the bulk message in prometheus. 2022-05-06 09:57:30 -04:00
Kanthi Subramanian
3c8394ff07 Added test for spoofing sink records(From Bigquery), Fixed build script for docker-compose. 2022-05-06 09:17:52 -04:00
Vladislav Klimenko
ff4d1043d1 redpanda condition 2022-05-06 15:38:01 +03:00
Vladislav Klimenko
5d59cdb4db doc: move k8s docs to main folder 2022-05-06 15:14:20 +03:00
Vladislav Klimenko
fd67311834 doc: pipeline 2022-05-06 15:13:16 +03:00
Vladislav Klimenko
fb6a8e7db9 doc: add pipeline tools 2022-05-06 15:13:00 +03:00
Vladislav Klimenko
c05f512057 doc: extract build conneecto images 2022-05-06 15:12:42 +03:00
Vladislav Klimenko
94cca466a5 doc files 2022-05-06 15:12:16 +03:00
Vladislav Klimenko
e15cbcd559 add topic checker and registry scheker 2022-05-06 14:27:13 +03:00
Vladislav Klimenko
e63a800633 add rollouts for mysql + CH clusters 2022-05-06 14:21:16 +03:00
Vladislav Klimenko
28871da86a manual 2022-05-06 14:08:41 +03:00
Vladislav Klimenko
57520b3852 adapt connectors 2022-05-06 14:08:33 +03:00
Vladislav Klimenko
5b30446d61 extract minikube pre-load 2022-05-06 14:08:06 +03:00
Vladislav Klimenko
d87f3bee4a use strimzi-recommended build processes 2022-05-06 14:07:41 +03:00
Vladislav Klimenko
97495268ab adapt builder scripts 2022-05-06 14:07:20 +03:00