Hey everyone π
I'd love to connect with anyone using Olake to replicate CDC from Postgres to Iceberg/Snowflake.
Feel free to send me a DM, I'd really appreciate hearing your feedback on the tool.
Thanks so much!
Hello OLake superstars! π
I'm Advaita, the latest addition to the Datazip crew. I've been in the tech space for about 5 years now and I'm going to be managing marketing for OLake with Harsha! So you'll be seeing a lot of me around here π
Outside of work, I recently learnt to play tennis πΎ so if anyone in the Bangalore community is up for a sesh, hit me up!
Feel free to introduce yourself here and also, if you're on LinkedIn, let's connect π€
Hello my fellow fisher people! π£olake (forgive me, I'm still looking for the right name for us)
We'd like to get to know you all a little better! If you have some time, please fill out this reallllllyyyy short survey and in return you will get a $10 (or equivalent) Amazon gift card in your mailbox!
In case you want your gc on an ID that isn't the same as your Slack, please DM me with your preferred email ID and I will send it to you on there.
Here's another link to the form - forms.gle/β¦
Hey everyone! π
Our G2 page is finally live!
π We'd love to hear what you think: g2.com/products/olake/reviews
If you've used OLake whether in production, for a POC, or even just played around with it, we'd really appreciate it if you could take a couple of minutes to leave us a review on G2.
It genuinely helps us get OLake in front of more people and gives us valuable feedback on what's working and what we can do better.
Thanks so much for being part of the OLake community! π
Hey everyone! I'm Krishna, a backend dev student and current GSoC intern with Apache.
I've been checking out Olake recently and I absolutely love the vision and the tech stack. I spend a lot of my time doing open-source work in the Java, Go, and cloud ecosystems (like Mifos ,Hyperledger and the Linux Foundation), and I'm super excited to start contributing here!
Hey OLake fam!
We're kicking off a new weekly tradition: every Tuesday, we drop a quick poll right here to pick your brain on all things Iceberg, CDC, lakehouses, and the occasional hot takes.
Think of this as your weekly excuse to procrastinate productively. β
"Why join?" you ask:
SlackAction(SlackButton(Open))
SlackAction(SlackButton(Add option))
Created by @Anshika Gautam with /poll
We noticed our co-founders made it into the top reactions (love the enthusiasm π), but since the rewards are intended for our community members, they wonβt be included in the prize count.
That means there are still 2 $10 Amazon giftcards up for grabs! If you havenβt voted yet, thereβs still time to jump in and secure a spot.
Shoutout to our first poll participants.
Big thanks to @Shiv Kumar and @Siddhant Rai for being first to jump in on the very first community poll.
Your $10 Amazon gift cards are on the way
We are back tomorrow with poll #2, and the giveaway is still on. See you in the thread.
Happy Tuesday, everyone π
We're always curious how different teams approach this, so this week's poll:
SlackAction(SlackButton(Open))
SlackAction(SlackButton(Add option))
Created by @Anshika Gautam with /poll
Huge shoutout to everyone who jumped into Poll #2!
Thanks @Shiv Kumar, @Karthik Balasubramanian, and @Kim Tore Jensen for taking the time to vote and share your pick on whether Merge-on-Read is worth the trade-off.
Before we wrap up, a quick reminder: the $10 gift card giveaway is still on. Keep voting early to snag a spot in the next poll!
See you tomorrow for Poll #3
Guys, something is wrong with the docs site PTAL
@Karthik Balasubramanian thanks for reporting this , we are checking this will fix it soon
@Karthik Balasubramanian, thanks for reporting this! Itβs working now. The docs are back up, so you can use them now.
Tuesday poll time.
Iceberg lets you widen a column in place. int to bigint, float to double, decimal precision up. No rewrite, no backfill, just a metadata change. On paper it is one of the friendlier parts of the spec.
In practice it depends a lot on what is reading the table on the other side.
SlackAction(SlackButton(Open))
SlackAction(SlackButton(Add option))
Created by @Anshika Gautam with /poll
I haven't worked much with Iceberg yet. I just read about this column widening. its so cool.
I came across this while testing Postgres β Iceberg with OLake. Changed an ID from INT to BIGINT and the sync handled it fine, but my downstream query was still expecting INT and broke. So yeah, neat but risky π
Hi everyone
Iβm a 4th-year student at IIIT Lucknow. Iβve been going through the OLake codebase and found it genuinely interesting, and Iβd love to start contributing.
To begin with, Iβd like to pick up #659 (unit tests for types/state.go): github.com/datazip-inc/olake/issues/659
The previous PR for this issue (#994) was closed due to inactivity, so I believe the issue is available again. @Nayan Joshi Iβve already gone through state.go, set up the project locally, and left a comment on the issue outlining my planned test coverage.
Could someone let me know the process for getting this issue assigned to me?
Happy to pick up more issues and contribute further after this one. π
Thanks to @Shiv Kumar, @Karthik Balasubramanian, and @Siddhant Rai for jumping in and sharing where you land on the Iceberg type-promotion question π
Stay tuned for this week's poll, going live tomorrow.
Hi everyone! Poll day is here, and this one's for anyone running Iceberg upserts across more than one engine.
SlackAction(SlackButton(Open))
SlackAction(SlackButton(Add option))
Created by @Anshika Gautam with /poll
the tool should infer the right format based on the configured engines, with an override for advanced use cases.
picked 1. i'd rather declare the engines once and let the replication tool choose a compatible format, or fail early if there isnβt one
Thanks to all who voted in last week's poll; great to see the responses. So here's this week's, and we'd love to hear your take again.
SlackAction(SlackButton(Open))
SlackAction(SlackButton(Add option))
Created by @Anshika Gautam with /poll
Hello to all the new members on the community! Welcome to OLake! It was great meeting you all in Hyderabad! I'm thinking out loud here but if we get enough people to say yes I'm sure we can host a work-along sort of thing so everyone can see what they can do with OLake instead of just listening to us talk on and on. Cast your vote below and lmk π€
Hello everyone, A feature request came in from the community. OLake has no way to type cast a column at the destination today, so casting happens downstream or at the source. The request is to set a destination type per column and have OLake cast during replication: Feature : Enable Column-Level Data Type Transformations During Replication Β· Issue #1185 Β· datazip-iβ¦
SlackAction(SlackButton(Open))
SlackAction(SlackButton(Add option))
Created by @Anshika Gautam with /poll
SlackAction(SlackButton(Open))
SlackAction(SlackButton(Add option))
Created by @Anshika Gautam with /poll
Reply in the thread with what you do today when a run cannot wait. Upvote Fusion #30 if this is a yes.
OLake currently supports Clear Destination at the job level, which wipes data for every stream in the job.
SlackAction(SlackButton(Open))
SlackAction(SlackButton(Add option))
Created by @Anshika Gautam with /poll