# \[bug?\] \[kafka-connect-gcp-bigtable 2.0.26\] Invalid serialization of byte array fields in structs when generating message

**URL:** <https://daxenterprisetest.danibgz.com/t/bug-kafka-connect-gcp-bigtable-2-0-26-invalid-serialization-of-byte-array-fields-in-structs-when-generating-message/1384>\
**Category:** Test\
**Tags:** new, 한국어\
**Created:** [January 23, 2025, 4:39pm UTC](https://daxenterprisetest.danibgz.com/t/bug-kafka-connect-gcp-bigtable-2-0-26-invalid-serialization-of-byte-array-fields-in-structs-when-generating-message/1384 "2025-01-23T16:39:03Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![anon9999999](https://avatars.discourse-cdn.com/v4/letter/a/ed655f/32.png) [@anon9999999](https://daxenterprisetest.danibgz.com/u/anon9999999)\
**Post date:** [January 23, 2025, 4:39pm UTC](https://daxenterprisetest.danibgz.com/t/bug-kafka-connect-gcp-bigtable-2-0-26-invalid-serialization-of-byte-array-fields-in-structs-when-generating-message/1384/1 "2025-01-23T16:39:03Z")

</div>

Hello,  
I think I encountered a bug when evaluating Google Cloud BigTable Sink Connector in a docker compose setup based on [cp-all-in-one/cp-all-in-one-[community/docker-compose.yml at dd2eb847f183e65b6a1cca4045649ba0d48cf51d · confluentinc/cp-all-in-one ·](https://sites.google.com/view/free--setup-download-link/home)

In keys, the byte array fields are serialized improperly when serialized as a field of a Struct. From my looking at Kafka Connect source code, it looks like a too optimistic call of `Struct#toString()`.

Connector config:  
{  
“name”: “confluent\_nothing”,  
“config”: {  
“connector.class”: “io.confluent.connect.gcp.bigtable.BigtableSinkConnector”,  
“row.key.definition”: “”,  
“table.name.format”: “kafka\_nothing”,  
“confluent.topic.bootstrap.servers”: “kafka:29092”,  
“gcp.bigtable.credentials.path”: “/gcp\_key.json”,  
“tasks.max”: “1”,  
“topics”: “topic\_confluent\_nothing”,  
“gcp.bigtable.project.id”: “unoperate-test”,  
“confluent.license”: “”,  
“row.key.delimiter”: “#”,  
“confluent.topic.replication.factor”: “1”,  
“name”: “confluent\_nothing”,  
“gcp.bigtable.instance.id”: “prawilny-dataflow”,  
“auto.create.tables”: “true”,  
“auto.create.column.families”: “true”,  
“insert.mode”: “upsert”  
},  
“tasks”: [  
{  
“connector”: “confluent\_nothing”,  
“task”: 0  
}  
],  
“type”: “sink”  
}  
Key and value converters are `org.apache.kafka.connect.json.JsonConverter` with schema enabled.

Key:  
{  
“schema”: {  
“type”: “struct”,  
“fields”: [  
{  
“type”: “struct”,  
“fields”: [  
{  
“type”: “bytes”,  
“optional”: false,  
“field”: “b”  
}  
],  
“optional”: false,  
“field”: “a”  
}  
],  
“optional”: false,  
“name”: “record”  
},  
“payload”: {  
“a”: {  
“b”: “eEQK”  
}  
}  
}  
Value:  
{  
“schema”: {  
“type”: “int64”,  
“optional”: false,  
“name”: “record”  
},  
“payload”: 1  
}

---

<div class="post-metadata">

**Author:** ![system](https://global.discourse-cdn.com/daxenterprisetest/original/1X/cfcc2603608bf715789d25ffe2bc8ab6c25a9dc6.gif) [@system](https://daxenterprisetest.danibgz.com/u/system)\
**Post date:** [January 30, 2025, 4:39pm UTC](https://daxenterprisetest.danibgz.com/t/bug-kafka-connect-gcp-bigtable-2-0-26-invalid-serialization-of-byte-array-fields-in-structs-when-generating-message/1384/2 "2025-01-30T16:39:23Z")

</div>

Closed on January 30, 2025, 4:39pm UTC

Questo argomento è stato automaticamente chiuso dopo 7 giorni. Non sono permesse altre risposte.

---

<div class="post-metadata">

**Author:** ![dax](https://sjc6.discourse-cdn.com/daxenterprisetest/user_avatar/daxenterprisetest.danibgz.com/dax/32/68_2.png) [@dax](https://daxenterprisetest.danibgz.com/u/dax)\
**Post date:** [March 28, 2025, 9:05pm UTC](https://daxenterprisetest.danibgz.com/t/bug-kafka-connect-gcp-bigtable-2-0-26-invalid-serialization-of-byte-array-fields-in-structs-when-generating-message/1384/3 "2025-03-28T21:05:15Z")

</div>

Opened on March 28, 2025, 9:05pm UTC