Commit Graph

26 Commits

Author SHA1 Message Date
Kanthi Subramanian
9b1c1a0ff1 Fixed bug with CREATE TABLE with enum values. 2023-05-17 10:00:46 -04:00
Kanthi Subramanian
4ab5ea59cf Fix Integration tests. 2023-04-04 17:23:37 -04:00
Kanthi Subramanian
9915d22800 Merge lightweight connector 2023-04-04 13:29:46 -04:00
Kanthi Subramanian
b6f3aba78d Fixed DBKafkaOffsetWriterTest using TestContainers. Added logic to create kafka offset table. 2022-11-28 14:17:38 -05:00
Kanthi Subramanian
e8c97d40f1 Updated debezium to 2.1 Final 2022-11-17 17:33:52 -05:00
Kanthi Subramanian
320775f166 Set java version to 11 in github action. 2022-10-18 15:47:35 -04:00
Kanthi Subramanian
e6803c7d92 Fixed TIME range 2022-10-08 12:44:33 -04:00
Kanthi Subramanian
4e967a8c6d Fixed unit tests and pom file for maven surefile plugin 2022-09-08 15:44:18 -04:00
Kanthi Subramanian
8d7e85243e Fixed unit tests and pom file for maven surefile plugin 2022-09-08 13:56:21 -04:00
Kanthi Subramanian
074d16b5d0 Support for JSON data type.
Both MySQL/Postgres JSON types map to String with io.debezium.data.JSON name
2022-08-02 10:51:13 -04:00
Kanthi Subramanian
0d24b902e3 Refactor logic to buffer records and flush. 2022-07-21 19:27:00 -04:00
Kanthi Subramanian
3bd0c4fb42 Move flush timeout as a configuration variable. Change docker-compose to use environment variable for sink docker version. 2022-07-19 14:07:02 -04:00
Kanthi Subramanian
d623cb5937 Added unit test directory to pom.xml 2022-07-03 19:22:14 -04:00
Kanthi Subramanian
06ed8b180f Added logic to record min and max offset of the bulk message in prometheus. 2022-05-06 09:57:30 -04:00
Kanthi Subramanian
4451438f71 Added logic to check if the column data type is DateTime64 for limiting the range. 2022-05-05 18:01:20 -04:00
Kanthi Subramanian
d84198609b Added logic to use micrometer library and expose prometheus port for writing metrics. Added test case for deduplication. 2022-05-03 22:26:57 -04:00
Kanthi Subramanian
e3e15fb238 Set java version to 9 in github runner. 2022-04-22 10:05:58 -04:00
Kanthi Subramanian
cd9ca53d54 Added dropwizard metrics library to track memory usage and timers. 2022-04-20 12:27:53 -04:00
Kanthi Subramanian
19555ea05b Added logic to persist kafka metadata to Clickhouse(topic, partition, offset and timestamp) 2022-04-12 09:47:14 -04:00
Kanthi Subramanian
48de47adee Replaced HashMap to LinkedHashMap to preserve insertion order. Updated JUnit to 5. 2022-04-10 12:25:13 -04:00
Kanthi Subramanian
3dc71af131 Added support for creating clickhouse connection from kafka connect sink config variables. 2022-04-05 16:23:25 -04:00
Kanthi Subramanian
9a5db02a49 Added support for remote debugging Kafka connector and entrypoint db to load data to msysql and clickhouse. 2022-04-05 11:03:49 -04:00
Kanthi Subramanian
5077fe1efa Added logic to use Clickhouse JDBC connector, convert the debezium data types and perform a batch insert. 2022-04-01 10:19:15 -04:00
Kanthi Subramanian
40a781d3a9 Added initial commit of files from the original repo 2022-03-28 09:16:31 -04:00
Vladislav Klimenko
87a5f3d22a package ClickHOuse client 2022-03-25 15:57:32 +03:00
Vladislav Klimenko
07a655491e dev: start 2022-03-22 17:18:10 +03:00