Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Bulk Load CDK: fix airbytevalue serialize #51044

Open
wants to merge 2 commits into
base: master
Choose a base branch
from

Conversation

edgao
Copy link
Contributor

@edgao edgao commented Jan 10, 2025

fixes https://airbytehq-team.slack.com/archives/C03AS1GAQV6/p1736536510756639 and https://airbytehq-team.slack.com/archives/C081G34EA21/p1736538877457769

turns out we have a number of types that don't serialize how you'd expect, though null+object are the most egregious. Fix all of them.

@edgao edgao requested a review from a team as a code owner January 10, 2025 21:06
Copy link

vercel bot commented Jan 10, 2025

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Comments Updated (UTC)
airbyte-docs ✅ Ready (Inspect) Visit Preview 💬 Add feedback Jan 10, 2025 10:28pm

@octavia-squidington-iii octavia-squidington-iii added the CDK Connector Development Kit label Jan 10, 2025
@edgao edgao marked this pull request as draft January 10, 2025 21:20
is NullValue -> return "null"
// no idea why this is necessary, but jackson throws an exception if you try to serialize
// the ObjectValue directly
is ObjectValue -> return Jsons.writeValueAsString(this.values)
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ugh, this doesn't even work b/c ObjectValue could contain a nested ObjectValue

@edgao edgao force-pushed the edgao/fix_airbyte_value_serialize branch from c524258 to 87a250a Compare January 10, 2025 22:06
@edgao edgao marked this pull request as ready for review January 10, 2025 22:07
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CDK Connector Development Kit
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants