Pipeline Monitoring

Pipeline Status

Pipeline Status

Unknown

Last Run

Checking...

Schedule

Every 15 minutes

Apache Airflow Dashboard

Full pipeline monitoring, DAG execution, logs, and scheduling

Open Airflow

Pipeline Stages

RSS Collection

Collects articles from 141 RSS feeds every 15 minutes

View in Airflow

Entity Extraction

Extracts companies, people, products using GPT-4o-mini

View in Airflow

Observation Analysis

Extracts business intelligence and insights

View in Airflow

Signal Detection

Identifies patterns across observations

View in Airflow

Insight Generation

Creates actionable business insights

View in Airflow

Main DAG

brandtrackers_pipeline

Monitoring DAG

brandtrackers_monitoring

Tasks

5 stages

Workers

10 parallel

Note: This page shows a simplified overview. For detailed monitoring, logs, and DAG management, use the Airflow dashboard. The pipeline runs automatically every 15 minutes to process new content.