[destination-clickhouse] sync completes successfully but no tables are created.

[MeisterLone]

Connector Name

destination-clickhouse

Connector Version

1.0.0

What step the error happened?

During the sync

Relevant information

The sync completes successfully, however when inspecting the target database there are no tables.
Internal tables seem to have all the data.

Airbyte Cloud connector description indicates that the destination is supported with 'deduped' functionality.

This does not seem to be the case.

Relevant log output

No response

Contribute

• Yes, I want to contribute

[marcosmarxm]

Thanks for reporting the issue @MeisterLone Destination Clickhouse is a community connector and it isn’t in the current roadmap for improvements. If you want to contribute fixing the issue please reach me out in Slack so I can provide you instructions to make the contribution.

[MeisterLone]

I am in no position to assist with this currently, but I'll share another insight here for when clickhouse gets some attention- currently even the internal tables do not append properly. I have had a test connection between stripe and clickhouse set up for several days now as well as the same connection with same schema set up between stripe and redshift. It seems that after sync'ing every 5 minutes for 5 days, the clickhouse internal raw tables plainly are missing some updates where the redshift matches stripe dashboard records perfectly. So just using JSONExtract functions on the clickhouse internal tables airbyte generates, is not going to be accurate.

[prakashbalaji]

We are having the same issue with intermediate raw tables being created but the final destination database is empty. Could this issue be priortized or if Clickhouse connectors are not mature, what alternatives exists for us to extract and load to Clickhouse, Any suggestion of using some intermediate source like Postgres, S3 ? Do you see some risk with the approach of intermediate data load with some stable connectors?

[MeisterLone]

@prakashbalaji some users have reported downgrading the clickhouse connector version to an older version worked for them.

[prakashbalaji]

@MeisterLone - We were using Airbyte cloud, is downgrade even an option with cloud?