[destination-GCS] Overwrite does not work properly using variables in GCS Bucket Path #28528
Labels
area/connectors
Connector related issues
autoteam
community
connectors/destination/gcs
team/use
type/bug
Something isn't working
Connector Name
destination-google-cloud-storage
Connector Version
0.4.4
What step the error happened?
During the sync
Revelant information
Hello,
The GCS destination does not properly apply the
Overwrite
strategy in certain circumstances.I mean the existing files are not removed from GCS path before the sync, leading to duplicates files after the sync.
In GCS destination configuration settings, while filling
GCS Bucket Path
value:my_folder/my_subfolder
:Overwrite
strategy works as expectedmy_folder/${STREAM_NAME}
:Overwrite
strategy does not work as expected as explained above.Reproducibility is really simple:
GCS Bucket Path
valueOverwrite
strategyGCS Bucket Path
value with a dynamic pathThank you for your help 👍
Relevant log output
No response
Contribute
The text was updated successfully, but these errors were encountered: