CI jobs procedure:

Continuous Integration (CI) Jobs in Dataopsly

CI (Continuous Integration) Jobs in Dataopsly help ensure the accuracy, reliability, and efficiency of your data transformation workflows before deploying them to production.

---

What Are CI Jobs in Dataopsly?

You can set up continuous integration (CI) jobs to run when someone opens a new pull request (PR) in your dataopsly Git repository. By running and testing only modified models, dataopsly ensures these jobs are as efficient and resource conscientious as possible on your data platform.

---

How CI Works in Dataopsly

graph TD
A[CI job] --> B(Create CI job);
B --> C(dataopsly by default proceeds with default command);
C --> D(command: dbt build --select state:modified+);
D --> E(Job Created);
E --> |git remote repo| F;
F[Raise PR from remote git repo] --> G(dataopsly triggers the CI job);

---

Setting Up CI Jobs in Dataopsly

1️⃣ Enable CI for Your Project

Go to Dataopsly UI → Go to Jobs → Select CI Jobs.

2️⃣ Create a CI Job

1. Configuration:
   • No Scheduler: CI Jobs do not require a scheduler.
   • Predefined Command: dbt build --select state:modified+ is automatically set.
   • Notification Settings (e.g., Slack, Email).

---

🔔 Notifications & Alerts

Dataopsly supports:

• Slack Integration – Get notified when a CI Job fails.
• Email Alerts – Receive job failure notifications.