Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Exception when reading Decimal types written by connector #611

Open
maver1ck opened this issue Mar 28, 2022 · 0 comments
Open

Exception when reading Decimal types written by connector #611

maver1ck opened this issue Mar 28, 2022 · 0 comments

Comments

@maver1ck
Copy link

maver1ck commented Mar 28, 2022

I'm using Kafka Connect HDFS Connector to write Avro topics with Decimal fields.
I'm using integration with Hive.
When reading data I'm getting following exception:
Error: java.io.IOException: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassCastException: org.apache.hadoop.hive.serde2.io.HiveDecimalWritable cannot be cast to org.apache.hadoop.io.BytesWritable (state=,code=0)

I think the reason of the problem is that connector is creating fields with binary data_type in Hive (instead of Decimal)

+---------------------------------+------------+----------+
|            col_name             | data_type  | comment  |
+---------------------------------+------------+----------+
| abc                             | binary     |          |
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant