Posts

All the articles I've posted.

• Introduction to Dagster

  Dagster is a data orchestrator that simplifies and optimizes data processing workflows for machine learning and analytics. It introduces concepts such as software-designed assets, Ops, Graphs, Jobs, Repositories, Workspaces, Materialization, Schedules, Sensors, and Backfills. These components work together to provide a flexible and intuitive framework for defining, executing, and monitoring complex data pipelines, enabling data engineers and analysts to efficiently manage and orchestrate their workflows.

• The Modern Data Stack: Empowering Data-Driven Organizations with Dagster, dbt, Great Expectations, Superset, and DataHub

  The modern data stack, combining tools like Dagster, dbt, Great Expectations, Superset, and DataHub, empowers organizations to efficiently manage, transform, and derive insights from their data. By adopting these best-in-class tools, data teams can streamline workflows, improve data quality, and drive data-driven decision-making.

• Chart Libraries

  Interesting chart libraries

• No tool - Low code platform

  No tool - Low code platform

• ChatGPT thoughts on Dependency Injection

  This answer from ChatGPT, whether or not Direct Injection is a good pattern to adopt in any project, is spot on. Go for it if you are ready to embrace the associated complexity. Don't go for it, if you lean toward simplicity.