Sync Apify Dataset data into Snowflake with Jitsu
Jitsu.Cloud is the easiest way to try out Jitsu. Pricing is volume based
Jitsu Open-Source edition is free and can be deployed with any infrastructure provider
About Apify Dataset integration
Apify is a web scraping and web automation platform providing both ready-made and custom solutions, an open-source SDK for web scraping, proxies, and many other tools to help you build and run web automation jobs at scale. The results of a scraping job are usually stored in Apify Dataset. This connector allows you to automatically sync the contents of a dataset to your chosen destination. To sync data from a dataset, all you need to know is its ID. You will find it in Apify console under storages.
Snowflake is a fast and scalable data warehouse. Jitsu can works with Snowflake both in stream and batch modes. For batching, you'll need to provide an access either to Amazon S3 or to Google's Cloud storage bucket