Industry collection

🗄️ Data Platform & Analytics Engineering

Data engineering and analytics operations workflows for SQL, dbt, Airflow, warehouses, Postgres, CSV cleanup, schema quality, retrieval indexes, data catalogs, dashboards, and query tuning.

Who this is for

  • Data engineers, analytics engineers, data platform teams, BI operators, and database reliability owners.
  • Teams managing dbt projects, SQL quality, warehouse performance, CSV cleanup, pipeline orchestration, schema review, dashboards, and database operations.

Jobs covered

  • Operate Airflow and dbt context for pipeline orchestration, lineage, and transformation review.
  • Lint, format, and validate SQL, dbt, CSV, and schema changes before they break downstream consumers.
  • Profile local files and query structured exports before loading them into warehouses or dashboards.
  • Tune PostgreSQL and Snowflake performance while preserving backup and restore readiness.
  • Build and evaluate retrieval, vector, and catalog context before agents consume data assets.

Workflow Stacks

  • Agent-safe data operations: Inspect database or DAG context → Review permissions and query scope → Run controlled analysis → Record evidence for the operator
  • Analytics engineering change review: Plan dbt or SQL model change → Lint and validate SQL → Compare model or relation parity → Preview rollout impact
  • Warehouse and database performance: Inspect schema and execution plans → Tune query, index, or RLS behavior → Document risky migrations → Hand off a review packet
  • Tabular intake and cleanup: Inspect large CSV or messy tables → Profile schema and anomalies → Normalize for downstream transforms → Validate quality before ingestion

Curated Skills (38)

Apache Airflow MCP

Connects agents to Airflow DAG context and orchestration workflows for platform-owned pipelines.

Data platform engineerHigh install45k stars
dbt Cloud MCP

Lets agents inspect and operate dbt Cloud context without treating the warehouse as a black box.

Analytics engineerMedium install12.6k stars
dbt Data Transform Orchestrator

Frames dbt model runs and transformation orchestration as a repeatable analytics engineering workflow.

Analytics engineerMedium install12.6k stars
dbt Model Lineage Extractor

Extracts model lineage so teams can reason about downstream impact before changing data assets.

Analytics platform ownerMedium install12.6k stars
DuckDB SQL Analytics Agent

Runs local analytics over structured files for fast investigation without provisioning a warehouse.

Data analyst / analytics engineerLow install37.1k stars
Build local vector retrieval indexes with Faiss

Adds a local vector-indexing layer for retrieval and RAG experiments before teams adopt heavier managed vector infrastructure.

Data platform engineer / retrieval engineerMedium install40.2k stars
Serve production agentic RAG through R2R

Provides production hybrid retrieval and agentic RAG APIs with citations and reviewable document operations.

Retrieval engineer / data platform leadHigh install7.9k stars
Parse multi-format RAG inputs with OmniParse

Converts PDFs, tables, images, audio, video, and web pages into structured text/markdown so RAG pipelines receive reviewable multi-format inputs.

Retrieval engineer / data ingestion platform ownerHigh install7.6k stars
Scale agent retrieval workloads with Milvus

Adds a scalable vector database path for filtered similarity search across RAG and agent retrieval workloads.

Vector database operator / data platform engineerHigh install44.7k stars
SkillWhat it does herePersonaInstallStars
Query and inspect Postgres databases through MCP with pgEdge Postgres MCPGives agents a controlled Postgres inspection path for schema, table, and query context without turning database access into ad hoc shell work.Postgres operator / data platform engineerMedium165
Query cross-connector business data for agents with DinobaseLets data teams query business context across connectors when analytics questions span tools rather than one warehouse table.Analytics platform engineerMedium252
Review SQL Server execution plans through an MCP-compatible analysis workflow with Performance StudioAdds SQL Server execution-plan review to the workflow for query tuning and database performance investigations.Database performance engineerMedium175
Run deterministic SQL and dbt analysis under coding agents with Altimate CodeKeeps SQL and dbt analysis deterministic under coding agents, which matters when agents review warehouse changes.Analytics engineering leadMedium552
Operate Airflow and warehouse workflows through agent-safe data engineering skills with Astronomer AgentsConnects Airflow and warehouse operations through agent-safe data engineering workflows instead of unbounded DAG manipulation.Data platform engineerHigh337
Tune Supabase Postgres queries, indexing, and RLS with Supabase Postgres Best PracticesCovers Supabase/Postgres query, index, and RLS tuning where app data teams need database advice tied to production constraints.Supabase/Postgres engineerMedium0
Compare dbt models and warehouse relations before trusting migration parity with dbt-audit-helperChecks dbt model and warehouse parity before migrations or refactors are trusted.Data quality leadMedium402
Translate and validate SQL across dialects with SQLGlotTranslates and validates SQL across dialects so warehouse migrations and multi-engine analytics work stay reviewable.Data engineer / migration reviewerLow9.1k
Lint PostgreSQL migrations and SQL changes before irreversible schema mistakes land with SquawkCatches risky PostgreSQL migration patterns before irreversible schema mistakes land.Database operatorLow1.1k
Inspect large CSV files interactively before cleanup, mapping, or downstream transforms with csvlensProvides interactive inspection of large CSV files before teams map, clean, or ingest messy tabular data.Data operations analystLow3.7k
Profile and triage messy tabular files from the terminal with VisiDataHelps analysts profile and triage messy tabular files quickly before building downstream transforms.Data analyst / data wranglerLow9k
Plan and preview warehouse SQL model changes before rollout with SQLMeshAdds plan-and-preview discipline for warehouse SQL model changes before rollout.Analytics engineer / warehouse reviewerMedium3k
Apache Airflow MCPConnects agents to Airflow DAG context and orchestration workflows for platform-owned pipelines.Data platform engineerHigh45k
dbt Cloud MCPLets agents inspect and operate dbt Cloud context without treating the warehouse as a black box.Analytics engineerMedium12.6k
dbt Data Transform OrchestratorFrames dbt model runs and transformation orchestration as a repeatable analytics engineering workflow.Analytics engineerMedium12.6k
dbt Model Lineage ExtractorExtracts model lineage so teams can reason about downstream impact before changing data assets.Analytics platform ownerMedium12.6k
Gate dbt projects with pre-commit checks from dbt-checkpointAdds pre-commit gates for dbt projects before style, tests, or docs drift.Analytics engineering reviewerLow738
SQLFluff SQL Linter and Auto-FormatterLints and formats SQL so warehouse changes are reviewable and consistent.Data engineerLow9.6k
sqruff High-Performance SQL Linter and FormatterProvides a fast SQL lint/format path for teams that need lightweight query quality checks.Analytics engineerLow1.3k
DuckDB SQL Analytics AgentRuns local analytics over structured files for fast investigation without provisioning a warehouse.Data analyst / analytics engineerLow37.1k
trdsql SQL Query Engine for CSV JSON and YAML FilesQueries CSV, JSON, and YAML exports with SQL before loading them into a larger system.Data operations analystLow2.2k
Anyquery Universal SQL Engine with MCP IntegrationTurns many APIs and files into SQL-queryable surfaces for agents and data operators.Data platform engineerMedium1.7k
Great Expectations Data Validation PipelineCreates explicit data quality expectations and validation artifacts for pipelines.Data quality engineerMedium11.3k
Inventory live database schemas and generate reviewable docs before risky SQL changes with SchemaCrawlerInventories live schemas and produces reviewable docs before risky SQL or database changes.Database platform engineerMedium1.8k
Build local vector retrieval indexes with FaissAdds a local vector-indexing layer for retrieval and RAG experiments before teams adopt heavier managed vector infrastructure.Data platform engineer / retrieval engineerMedium40.2k
Expose data catalog context to AI workflows with DataHubGrounds agent-assisted data discovery in catalog metadata, ownership, schema, and lineage context.Data governance lead / analytics platform engineerHigh12.1k
Query ClickHouse analytics safely from MCP clientsGives agents bounded, schema-aware ClickHouse analytics access without handing them ad hoc database credentials.Analytics platform engineer / ClickHouse operatorMedium801
Serve production agentic RAG through R2RProvides production hybrid retrieval and agentic RAG APIs with citations and reviewable document operations.Retrieval engineer / data platform leadHigh7.9k
Build document search layers for AI apps with MorphikAdds document ingestion and search quality tuning before AI apps or agents consume retrieval context.Retrieval engineer / AI data platform builderHigh3.6k
Parse multi-format RAG inputs with OmniParseConverts PDFs, tables, images, audio, video, and web pages into structured text/markdown so RAG pipelines receive reviewable multi-format inputs.Retrieval engineer / data ingestion platform ownerHigh7.6k
Convert mixed documents into agent-ready Markdown and JSON with DocStrangeAdds a mixed-document normalization step for analytics and RAG ingestion pipelines that need Markdown, JSON, CSV, or HTML before downstream processing.Data platform engineer / document ingestion ownerMedium1.5k
Add Postgres-native vector retrieval to agent and RAG workflows with pgvectorStores embeddings beside application data in Postgres for semantic search, RAG, recommendations, and agent memory retrieval.Postgres data platform engineer / retrieval engineerMedium21.7k
Generate and evaluate retrieval embeddings with FlagEmbeddingHelps teams choose, evaluate, and rerank retrieval embeddings before feeding context into RAG workflows.Retrieval engineer / ML platform engineerMedium11.8k
Scale agent retrieval workloads with MilvusAdds a scalable vector database path for filtered similarity search across RAG and agent retrieval workloads.Vector database operator / data platform engineerHigh44.7k
Build enterprise RAG and agent workflows with BishengAssembles and evaluates enterprise RAG workflows across internal data, models, and business users.Enterprise AI platform lead / retrieval workflow ownerHigh11.4k
Build portable single-file agent memory with MemvidGives analytics teams a portable context layer for packaging large reference sets without standing up a full service.Analytics engineer / data platform operatorMedium15.7k
Build graph-based retrieval workflows with GraphRAGAdds a graph retrieval option for analytics teams working with relationship-heavy corpora and entity context.Data platform engineer / retrieval architectHigh33.4k
Query Neo4j graph data from agent workflows through MCPLets agents inspect governed Neo4j graph data through MCP instead of copying graph context into prompts.Graph data engineer / analytics platform ownerMedium947

Editorial Notes

  • This collection spans Data Extraction, Code Quality, Runbooks, and dashboarding because data platform work is both engineering and operations.
  • Several dbt picks are included, but each covers a different job: orchestration, parity, lineage, pre-commit gates, and formatting.
  • Listed SchemaCrawler is included because live schema inventory is a distinct database-operations gap not covered by the security-reviewed data picks.
  • Recent RAG and vector-database picks are included when they serve data-platform ownership: retrieval quality, catalog grounding, and production data access.
  • Keep this centered on data platform and analytics engineering workflows; do not turn it into a generic Data Extraction category page.

Adjacent Collections