SmartFlow: Adaptive AI Traffic Optimization, Computer Vision Vehicle Tracking (YOLO11 + ByteTrack), Priority Emergency Clearance, and SUMO Controller Integration.
Traffic Video
│
▼
┌─────────────────────────────────┐
│ Member 2 │
│ Computer Vision Engineer │
│ YOLO11 + ByteTrack │
└─────────────────────────────────┘
│
▼
Vehicle Count • Queue Length • Speed
│
▼
┌─────────────────────────────────┐
│ Member 1 │
│ AI Lead & System Integration │
└─────────────────────────────────┘
│
▼
Traffic State Information
│
▼
┌─────────────────────────────────┐
│ Member 3 │
│ Traffic Control Engineer (SUMO) │
└─────────────────────────────────┘
│
▼
Waiting Time • Delay • Throughput
│
▼
┌─────────────────────────────────┐
│ Member 4 │
│ Dashboard & Documentation │
└─────────────────────────────────┘
│
▼
Final Software Prototype & Demo
- Traffic Video Collection & Processing: Support MP4, AVI, and MOV traffic video sources.
-
YOLO11 Object Detection: Multi-class vehicle detection (
Car,Truck,Bus,Emergency Ambulance). - ByteTrack Multi-Object Tracking: Unique persistent ID assignment across video frames.
- Vehicle Density & Count Extraction: Frame-by-frame vehicle counts per corridor (North, South, East, West).
- Queue Length Estimation: Meter-based queue occupancy calculation.
-
Speed Estimation: Centroid displacement velocity tracking (
$\text{km/h}$ ). - Perception Telemetry Export: Export structured CSV files for Member 1 (AI Lead) and Member 3 (Traffic Control Engineer).
Trafficflow/
│
├── datasets/ # Member 2: Labeled traffic dataset images/labels
├── videos/ # Member 2: Input traffic videos (MP4, AVI, MOV)
├── notebooks/ # Member 2: Jupyter / Colab notebooks
│ └── Member2_YOLO11_ByteTrack_Pipeline.ipynb
├── models/ # Member 2: Trained YOLO11 weights (yolo11n.pt, yolo11s.pt)
├── outputs/ # Member 2: Tracked videos & perception CSVs
│ ├── tracked_traffic_video.mp4
│ └── traffic_perception_metrics.csv
│
├── detection/ # Member 2: Vision & Tracking Engine
│ └── yolo11_bytetrack_pipeline.py
├── tracking/ # Member 2: ByteTrack configuration
├── feature_engine/ # Member 1: Traffic State Generator
├── controller/ # Member 3: Adaptive Max-Pressure Logic
├── sumo/ # Member 3: SUMO Simulation network
├── src/ # Member 4: React Web Dashboard & Canvas
├── requirements.txt # Dependencies
└── README.md # Documentation
-
Install Dependencies:
pip install -r requirements.txt
-
Execute YOLO11 + ByteTrack Pipeline:
python detection/yolo11_bytetrack_pipeline.py --input videos/traffic.mp4 --output outputs/tracked_traffic_video.mp4 --csv outputs/traffic_perception_metrics.csv
Open notebooks/Member2_YOLO11_ByteTrack_Pipeline.ipynb in Google Colab to run GPU-accelerated YOLO11 inference and download traffic_perception_metrics.csv.
The vision pipeline outputs outputs/traffic_perception_metrics.csv containing:
frame_id |
timestamp_sec |
corridor_lane |
vehicle_count |
queue_length_m |
average_speed_kmh |
emergency_detected |
|---|---|---|---|---|---|---|
| 30 | 1.0 | NORTH 4-LANE | 12 | 132m | 28.5 km/h | 0 |
| 30 | 1.0 | SOUTH 4-LANE | 14 | 154m | 36.2 km/h | 1 (AMBULANCE) |
| 30 | 1.0 | EAST 4-LANE | 10 | 110m | 30.0 km/h | 0 |
| 30 | 1.0 | WEST 4-LANE | 6 | 66m | 44.1 km/h | 0 |
-
Install Node Dependencies:
npm install
-
Start Local Server:
npm run dev
Open
http://localhost:5173in your browser.