Singer Reviews and details

Social recommendations and mentions

• Why do companies still build data ingestion tooling instead of using a third-party tool like Airbyte?

  Coincidently, I saw a presentation today on a nice half-way-house solution: using embeddable Python libraries like Sling and dlt - both open-source. See https://www.youtube.com/watch?v=gAqOLgG2iYY There is also singer.io which is more of a protocol than a library, but can also be installed although it looks like it is a true community effort and not so well maintained. Source: 3 months ago

• Data sources episode 2: AWS S3 to Postgres Data Sync using Singer

  Singer is an open-source framework for data ingestion, which provides a standardized way to move data between various data sources and destinations (such as databases, APIs, and data warehouses). Singer offers a modular approach to data extraction and loading by leveraging two main components: Taps (data extractors) and Targets (data loaders). This design makes it an attractive option for data ingestion for... - Source: dev.to / 10 months ago

• CDC (Change Data Capture) with 3rd party APIs

  Or you could build your own such system and run it on Airflow, Prefect, Dagster, etc. Check out the Singer project for a suite of Python packages designed for such a task. Quality varies greatly, though. Source: over 1 year ago

• Looking to build a database for BI reports

  This is good advice and I think Airbyte created a great product here. I tried singer.io and pipewise but Airbyte is much better in my opinion and I love the UI. Source: over 2 years ago

• Recommendation for approach for populating and refreshing new data lake

  Suspect my question should have been regarding FREE systems, rather than BUYING a system. Sounds like singer.io will do what I need. Source: almost 3 years ago

• Recommendation for approach for populating and refreshing new data lake

  If you can't use Stitch, you can still develop with the singer.io library which is the basis for Stitch. Source: almost 3 years ago

• Datajob: Build and deploy a serverless data pipeline on AWS with no effort.

  If I'm not mistaken, singer.io are scripts that move data around. Datajob can help you deploy and orchestrate these singer.io scripts to AWS Glue. Source: almost 3 years ago