Posts

Showing posts from June, 2024

Writing a simple Pulumi provider for Airbyte

pulumi Writing a Pulumi provider for Airbyte In this quick tutorial I will go over Pulumi by writing a very simple Provider for Airbyte . The simplified use case is. I want to programatically (infrastructure as code) create, update and delete Sources , Destinations and Connections in Airbyte instead of using the UI. Airbyte has its own Terraform Provider however, at the time of writing, it is somewhat not entirely mature and dificult to debug, particularly if you are not used to writing your own terraform providers Airbyte offers a great and simple REST API which in fact is what is used under the hood by the Terraform provider. Instead of using the Terraform provider I was planning to use the API directly, as it is easier to try, configure, and debug in case of getting errors. You simply use any REST or HTTP client (I was planning on using requests ) and invoke the different API endpoints. For example for creating a BigQuery Destination you woul...