PhD Candidate · Systems & Controls · UTK × ORNL
Abu Jafar
Md Muzahid
Autonomous Systems · Hierarchical Reinforcement Learning · Optimal Control
▸
PhD Candidate, Mechanical & Aerospace Engineering (Systems & Controls), University of Tennessee, Knoxville — exp. May 2027
▸
Graduate Research & Teaching Assistant · Proposal defended April 2026
▸
Collaborator, Applied Research for Mobility Systems Group · Oak Ridge National Laboratory (U.S. DOE)
▸
NSF CAREER Award No. 2237215 (RISE-AAM) contributor
I develop hierarchical AI frameworks that integrate deep and multi-agent reinforcement learning with model predictive control and convex optimization — enabling connected and automated vehicles (CAVs) to coordinate safely and efficiently in mixed-traffic highway environments. My work spans algorithm design, SUMO/CARLA simulation, and collaboration with ORNL toward real-world validation of autonomous mobility systems.
Published result (Control Engineering Practice, Elsevier 2025):
Hierarchical DRL + optimal control framework for CAV on-ramp merging: +12.5% mainline throughput, −28% emergency braking events, −31.66% fuel consumption versus baseline.
I hold an M.S. in Mechanical Engineering from UTK (2025) and an M.S. in Soft Computing from Universiti Malaysia Pahang (2022), where I earned the 1st Place Excellent Publication Award and a Gold Medal at Malaysia Technology Expo. With 886 Google Scholar citations (h-index 14) and a 4.9/5.0 teaching effectiveness rating, I am actively seeking tenure-track faculty and research scientist positions beginning Spring 2027.
What I work on
Research Interests
Hierarchical RL & Temporal Abstraction
Options framework and hierarchical DRL architectures for multi-level vehicle decision-making; improved sample efficiency and interpretability over flat RL.
CAV On-Ramp Merging
Solving highway on-ramp merging — a primary congestion and fuel-waste source — through three simulation phases: single-ramp, mixed autonomy, and corridor-wide control.
Multi-Agent RL & Cooperative Control
MARL controllers for CAV platoons to coordinate across successive highway sections under mixed autonomy, toward ORNL real-world validation.
Optimal Control & MPC
Integrating model predictive control and pseudospectral convex optimization with learning-based methods to guarantee safety-constrained, dynamically feasible trajectories.
Human–Autonomy Interaction
Human–vehicle interaction and AI teaming for automated driving and advanced air mobility (NSF CAREER RISE-AAM, Award No. 2237215).
Energy-Efficient ITS
U.S. DOE-funded collaboration with ORNL on the CAV–energy nexus; hierarchical intelligent control achieving 31.66% fleet-level fuel reduction vs. baseline.
Peer-reviewed work
Publications
886
Citations
14
h-index
20
i10-index
17
Journal Papers
9
Conference
4
Under Review
Journal
Hierarchical Approach for On-Ramp Merging Control of Connected Vehicles in Mixed Traffic Environment
Control Engineering Practice (Elsevier) · Revision submitted, 2026
Under Review
Journal
Under Review Paper — Intelligent Transportation Systems
Target: IEEE TITS / Transportation Research Part C · 2026
Under Review
Journal
Optimizing On-Ramp Merging for Connected and Automated Vehicles: A Hierarchical Approach Using Deep Reinforcement Learning and Optimal Control
Control Engineering Practice (Elsevier) · 2025 · WoS Q1
New · 2025
Journal
Optimization-Based Approaches to Control of Connected and Automated Vehicles: Principles, Complexities, Applications, Challenges, and Outlook
Journal of Systems Architecture (Elsevier) · 2026 · WoS Q1
New · 2026
Full list → Google Scholar · ResearchGate · ORCID 0000-0003-2344-7027 · Scopus
Academic background
Education
2023 – Present
(exp. May 2027)
(exp. May 2027)
Doctor of Philosophy
Mechanical & Aerospace Engineering · Concentration: Systems & Controls
University of Tennessee, Knoxville, USA
Dissertation: Hierarchical AI for Connected and Automated Vehicle On-Ramp Merging Control
Advisor: Dr. Zhenbo Wang · Committee: Dr. Omer San (UTK), Dr. Chieh (Ross) Wang (ORNL)
Proposal defended: April 2026 · GPA: 3.83/4.0
PhD Candidate
Proposal Defended Apr 2026
Advisor: Dr. Zhenbo Wang · Committee: Dr. Omer San (UTK), Dr. Chieh (Ross) Wang (ORNL)
Proposal defended: April 2026 · GPA: 3.83/4.0
2023 – 2025
Master of Science (Concurrent)
Mechanical Engineering
University of Tennessee, Knoxville, USA
Earned concurrently during PhD study · GPA: 3.83/4.0 · Awarded August 2025
Focus: Control systems, optimization, vehicle dynamics, advanced air mobility
Completed Aug 2025
Focus: Control systems, optimization, vehicle dynamics, advanced air mobility
2021 – 2022
Master of Science
Soft Computing & Intelligent Systems
Universiti Malaysia Pahang Al-Sultan Abdullah (UMPSA), Malaysia
Thesis: Deep Reinforcement Learning for Multiple Vehicle Collision Avoidance
Research Fellowship recipient · 1st Place Excellent Publication Award · Gold Medal, Malaysia Technology Expo 2022
Completed 2022
Research Fellowship recipient · 1st Place Excellent Publication Award · Gold Medal, Malaysia Technology Expo 2022
2005 – 2009
Bachelor of Science
Electrical & Electronic Engineering
Shahjalal University of Science & Technology (SUST), Bangladesh
Foundation in signal processing, control theory, electronics, and embedded systems
Completed 2009
Positions held
Research & Teaching Experience
Jan 2026 –
Present
Present
Graduate Research & Teaching Assistant (GRA + GTA)
Dept. of Mechanical & Aerospace Engineering · University of Tennessee, Knoxville
- Developing MARL-based corridor-wide CAV coordination framework for multi-ramp highway merging (Phase 3 of dissertation).
- Teaching ME 391 (Engineering Analysis) and AE 424 (Aerospace Structures); 4.9/5.0 student effectiveness rating.
- Mentoring 9 junior undergraduate and graduate researchers on RL and simulation methods.
- Leading weekly research meetings and co-supervising undergraduate capstone projects.
Aug 2023 –
Dec 2025
Dec 2025
Graduate Research Assistant (GRA)
Dept. of Mechanical & Aerospace Engineering · University of Tennessee, Knoxville
- Designed and implemented hierarchical DRL + convex optimization framework for single-ramp CAV merging; published in Control Engineering Practice (Elsevier, 2025).
- Completed review paper on optimization-based CAV control; published in Journal of Systems Architecture (Elsevier, 2026).
- Contributed to NSF CAREER RISE-AAM (Award No. 2237215) on human–autonomy teaming in advanced air mobility.
- Defended PhD dissertation proposal: April 2026.
2023 – Present
(ongoing)
(ongoing)
Research Collaborator — Applied Research for Mobility Systems
Oak Ridge National Laboratory (ORNL) · U.S. Department of Energy
- Collaborating on U.S. DOE-funded CAV energy efficiency research under the Applied Research for Mobility Systems group.
- Coordinating with Dr. Chieh (Ross) Wang on simulation-to-reality validation and energy modeling for autonomous vehicle control.
- Preparing for real-world testbed experiments at ORNL infrastructure.
2009 – 2020
(~11 years)
(~11 years)
Lecturer / Science & Technology Educator
Various institutions · Bangladesh
- Taught undergraduate-level courses in electronics, mathematics, computer science, and engineering fundamentals.
- Developed curriculum materials and assessment frameworks for 300+ students per year.
- Built strong foundation in pedagogy, technical communication, and mentorship that informs current 4.9/5.0 UTK teaching rating.
Technical expertise
Skills & Tools
| RL / AI Frameworks | Deep Reinforcement Learning (DRL) · Multi-Agent RL (MARL) · Hierarchical RL · Options Framework · Stable-Baselines3 · Ray RLlib · OpenAI Gymnasium · PPO · SAC · DDPG · PyTorch · TensorFlow / Keras |
| Control & Optimization | Model Predictive Control (MPC) · Convex Optimization · Pseudospectral Methods · Trajectory Optimization · Safety-Constrained Control · MATLAB / Simulink · Linear Quadratic Regulator (LQR) |
| Simulation Platforms | SUMO (Simulation of Urban MObility) · CARLA Simulator · HighwayEnv · Unity3D · Vehicle Dynamics Simulation · ITS Evaluation & Benchmarking |
| Programming & Dev | Python · MATLAB · C++ · R · SQL · Git / GitHub · LaTeX (Overleaf) · Jupyter Notebook · Google Colab · AWS |
| Research & Soft Skills | Scientific Writing (17 Q1 journals) · Peer Review · Graduate Teaching (ME 391, AE 424) · Mentorship (9 junior researchers) · Grant Writing · Technical Presentations · Cross-disciplinary Collaboration (ORNL) |
Recognition
Awards & Honors
Fully Funded Doctoral Scholarship & GRA — University of Tennessee, Knoxville
Competitive fully funded PhD scholarship and Graduate Research Assistantship, supporting Systems & Controls research with ORNL collaboration.
2023
Best Paper Incentive Award — Universiti Malaysia Pahang Al-Sultan Abdullah (UMPSA)
Awarded by UMPSA for outstanding research publication impact and productivity during postgraduate study.
2023
Gold Medal — Malaysia Technology Expo™ (MTE)
International gold medal for innovation in autonomous vehicle research and AI-enabled collision avoidance systems.
2022 · KL, Malaysia
1st Place — Excellent Publication Award, UMPSA Research & Postgraduate Award Ceremony
First place recognition for top publication output from Master's research at UMPSA.
2022 · Malaysia
Special Award — EURO BUSINESS-HALLER (Poland) at Malaysia Technology Expo 2022
International recognition from Poland for innovation in intelligent and autonomous systems research.
2022 · Poland / Malaysia
Best Innovation in Manufacturing — CITREX Exhibition, UMPSA
Recognized for best innovation in manufacturing at UMPSA's annual research and innovation showcase.
2021 · Malaysia
FRGS Research Grant — Ministry of Higher Education Malaysia
Fundamental Research Grant Scheme supporting autonomous vehicle control research. PI: Dr. S. F. Kamarulzaman · RM 54,000.
2020 · RM 54,000
Master Research Scheme (MRS) Fellowship — UMPSA
Competitive graduate research fellowship for full-time Master's research in intelligent and autonomous systems · RM 21,600.
2021 · RM 21,600
PhD Dissertation Proposal Successfully Defended
Advanced to full PhD candidacy after defending proposal on hierarchical traffic coordination for CAV on-ramp merging to committee including ORNL collaborator.
Apr 2026 · UTK