Continuous Parquet Sync to Amazon S3

Rob Galanakis on March 27, 2023

apache parquet logo

WebhookDB can currently sync data from its central storage (PostgreSQL or DynamoDB) to another Postgres database, SnowflakeDB, or an arbitrary HTTP endpoint.

Today we are opening a waitlist for syncing data to Apache Parquet files stored in Amazon S3, which is probably the most common setup for data analytics tooling.

This uses WebhookDB's Change Data Capture concept and the the webhookdb dbsync command to automatically write changes to Parquet files stored in S3.

This setup, especially combined with serverless central storage like Amazon Aurora Serverless or DynamoDB, creates exceptionally low operational cost and complexity for WebhookDB.

If you're interested in syncing your data to Parquet files in Amazon S3, please let us know so we can get you on the waitlist.

Recent Blog Posts

open lock hanging from a door
Securing API keys

May 11, 2023

Learn about securing API keys when using React or building any client software.

Read More →
checklist written in a notebook
API Integration Checklist

May 4, 2023

Ensure a smooth launch of your integrations with 3rd party APIs using our checklist.

Read More →
water falling into tiers of pools
New Pricing Structure

April 17, 2023

Learn about our new transparent and affordable pricing tiers.

Read More →
protesters in the occupy wall street movement
Building for the API 99%

April 10, 2023

Most APIs we use every day are not your Stripes or Shopifys. These are the API 99%.

Read More →