Trigger GitHub’s “Repository Dispatch” Event From ServiceNowConfluent allows users to perform various resource deployment and access provisioning tasks manually from the online portal. Our priority…Sep 27Sep 27
Confluent Cloud Kafka Metrics API and BigQuery to track cluster usageMonitoring the usage of clusters on the Confluent Cloud Kafka platform is crucial from a FinOps perspective. It’s not just about tracking…May 17May 17
Data Governance for Topics in Confluent Cloud KafkaWhen it comes to managing topics in Confluent Cloud Kafka, one aspect stands out for its crucial role in ensuring the accuracy…May 5May 5
Self-service capability for requesting BigQuery dataset creation — part2In part1, I provided details about the self-service capability I built for the creation of BigQuery datasets through Internal Developer…Dec 27, 2023Dec 27, 2023
Self-service capability for requesting BigQuery dataset creation — part1In my previous blog posts, I have explained the scale of the data platform my team owns and manages on GCP. We manage almost all GCP data…Dec 4, 2023Dec 4, 2023
Tracking the status of GCP Service Accounts to avoid failure in terraform deploymentsAs the owner of the data platform on GCP, my team provides access to various Service Accounts on different services (e.g., BigQuery…Nov 28, 2023Nov 28, 2023
Storing GCP IAM policy bindings from many projects in a single data storeIn my previous blog post, I provided the details about the current inventory of projects we are managing as part of owning a data platform…Jul 27, 2023Jul 27, 2023
GitHub Deployment Report for changes applied to GCP data productI’m part of a team that owns & manages the platform for an in-house built GCP native data product. This data product is designed based on…Jul 3, 2023Jul 3, 2023
Pro-active monitoring of IAM policies provisioned through TerraformWe provision access to GCP services (like GCS buckets, BigQuery datasets) through Terraform very frequently. Access is provisioned to both…May 7, 2023May 7, 2023
