Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Unable to receive message on pulsar topic in case of delete on table having composite primary key #111

Open
rakulkar-tibco opened this issue Feb 17, 2023 · 0 comments

Comments

@rakulkar-tibco
Copy link

rakulkar-tibco commented Feb 17, 2023

I am using Cassandra 4 and cdc-apache-cassandra 2.2.3.

Consider below table.

cqlsh:ks1> DESC foo_comp ;

CREATE TABLE ks1.foo_comp (
    a int,
    b text,
    c text,
    PRIMARY KEY (a, b)
) WITH CLUSTERING ORDER BY (b ASC)
    AND additional_write_policy = '99p'
    AND bloom_filter_fp_chance = 0.01
    AND caching = {'keys': 'ALL', 'rows_per_partition': 'NONE'}
    AND cdc = true
    AND comment = ''
    AND compaction = {'class': 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy', 'max_threshold': '32', 'min_threshold': '4'}
    AND compression = {'chunk_length_in_kb': '16', 'class': 'org.apache.cassandra.io.compress.LZ4Compressor'}
    AND crc_check_chance = 1.0
    AND default_time_to_live = 0
    AND extensions = {}
    AND gc_grace_seconds = 864000
    AND max_index_interval = 2048
    AND memtable_flush_period_in_ms = 0
    AND min_index_interval = 128
    AND read_repair = 'BLOCKING'
    AND speculative_retry = '99p';

With all correct configuration - I am able to receive insert/update events on pulsar data topic.

Now if we delete using following CQL statement :
delete from foo_comp where a=3 and b='B4'; - Able to receive delete event on pulsar data topic.

But if we delete using the following CQL statement :
delete from foo_comp where a=3;
Data gets deleted from the table but no event is received on the pulsar data topic.

And no events were received for any further insert/update operations.

To get it working again, we need to restart Cassandra and Pulsar clusters and reconfigure them.

Please suggest.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant