Haytham

Artificial Intelligence / Machine Learning Research / Science.
Senior Lecturer, School of Computing Technologies,
Royal Melbourne Institute of Technology (RMIT University).
Alumnus, Meta/Facebook Research, Oculus Research, & WorleyParsons.
SMIEEE, MACM, MIEAust.
Scholar | Github | LinkedIn | X | ORCID


Recent



Nov 2024: Paper: Interference localization and mitigation in synthetic aperture radars using variable space-frequency filter, accepted in IEEE GRSL.
Sep 2024: Paper: SEMUS - An Open-Source RF-Level SAR Emulator for Interference Modelling in Spaceborne Applications, accepted in IEEE TAES.
Aug 2024: Paper: Comparing Subjective Measures of Workload in Video Game Play: Evaluating the Test-Retest Reliability of the VGDS and NASA-TLX, accepted at ICMI’24.
Jul 2024: Teaching COSC2960 Foundations of Artificial Intelligence, Jul’24.
Jun 2024: Congratulations to Dr Yameng Peng for completing his Ph.D.
Jun 2024: Paper: Application of Natural Language Processing for Aircraft Defect Tracking in Maintenance Operations, accepted at ICAS’24.
May 2024: Book: Towards Human Brain Inspired Lifelong Learning, out now.
May 2024: Paper: Multimodal Measurement of Cognitive Load in a Video Game Context: A Comparative Study Between Subjective and Objective Metrics, accepted in IEEE Transactions on Games.
May 2024: Paper: Interference localization and mitigation in synthetic aperture radars using variable space-frequency filter, posted on TechRxiv.
May 2024: At ICLR’24, Vienna, to present SWAP-NAS: Sample-Wise Activation Patterns for Ultra-fast NAS.
Apr 2024: Paper: Optimising Fatigue Crack Growth Predictions for Small Cracks Under Variable Amplitude Loading, accepted in International Journal of Fatigue.
Mar 2024: Teaching COSC2960 Foundations of Artificial Intelligence, Mar’24.
Jan 2024: Paper: Bias in Opinion Summarisation from Pre-training to Adaptation: A Case Study in Political Bias, accepted at EACL’24.
Jan 2024: Paper: SWAP-NAS: Sample-Wise Activation Patterns for Ultra-fast NAS, accepted at ICLR’24 (Spotlight).
Nov 2023: Paper: SEMUS - An Open-Source RF-Level SAR Emulator for Interference Modelling in Spaceborne Applications, posted on TechRxiv.
Sep 2023: Awarded STEM Early-Career Research Excellence Award at RMIT.

Show/Hide Previous News


About



I am a Senior Lecturer in the Data Science and Artificial Intelligence Discipline in the School of Computing Technologies at the Royal Melbourne Institute of Technology (RMIT University) in Melbourne, VIC, where I lead the machine learning and intelligence group and affiliate with the Evolutionary Computing and Machine Learning (ECML) Group, the AI Innovation Lab, and the Centre for Industrial AI Research & Innovation (CIARI).

I was a Postdoctoral Research Scientist at Meta/Facebook Research in Seattle, WA, from August 2018 to January 2020. Prior, I received a PhD from RMIT in 2019. My PhD thesis is titled, Continual Deep Learning via Progressive Learning. During my PhD, I was a Research Intern at Facebook with Facebook Reality Labs (Oculus VR Research) and Facebook AI Research (FAIR). Formerly, I received an MSc (Research) and a BEng (Hons) in Electrical and Electronics Engineering, and worked as an Electrical/Electronics Engineer in the engineering consulting industry for three years.


Research



My research interests are broadly in artificial intelligence, machine learning, deep learning, and machine perception.

I am primarily interested in learning systems that systematically generalize from limited labelled data. This includes learning algorithms that can learn from a limited number of samples by drawing on prior experiences in other tasks and those that can learn despite limitations in labels in uni-modal and multi-modal data.


Selected Publications (Full List)



Yameng Peng, Andy Song, Haytham M. Fayek, Vic Ciesielski, and Xiaojun Chang.
SWAP-NAS: Sample-Wise Activation Patterns for Ultra-fast NAS.
In International Conference on Learning Representations (ICLR), Vienna, Austria, May 2024.
link bib
Spotlight.

Nannan Huang, Haytham M. Fayek, and Xiuzhen Zhang.
Bias in Opinion Summarisation from Pre-training to Adaptation: A Case Study in Political Bias.
In European Chapter of the Association for Computational Linguistics (EACL), Malta, Mar 2024.
pdf arXiv bib

Jarry Chen and Haytham M. Fayek.
The Structurally Complex with Additive Parent Causality (SCARY) Dataset.
In 2nd Conference on Causal Learning and Reasoning (CLeaR), 2023.
pdf bib

Haytham M. Fayek and Justin Johnson.
Temporal reasoning via audio question answering.
IEEE/ACM Transactions on Audio, Speech, and Language Processing, Jul 2020.
link arXiv code bib

Haytham M. Fayek and Anurag Kumar.
Large scale audiovisual learning of sounds with weakly labeled data.
In 29th International Joint Conference on Artificial Intelligence (IJCAI), Yokohama, Japan, Jul 2020.
link pdf arXiv bib

Haytham M. Fayek, Lawrence Cavedon, and Hong Ren Wu.
Progressive learning: A deep learning framework for continual learning.
Neural Networks, vol. 128, pp. 345–357, May 2020.
link bib

Full list of publications


Selected Talks



From First Principles to ChatGPT.
Centre for Higher Education Studies (CHES).
Australia, Jul 2023.

Beyond Supervised Deep Learning.
Centre for Industrial AI Research & Innovation (CIARI), RMIT.
Australia, Apr 2022.
link recording

Will Deep Learning Lead to AI?
Melbourne Machine Learning & AI Meetup.
Melbourne, Australia, Aug 2017.
link slides

On the Transferability of Representations in Neural Networks Between Datasets and Tasks.
Continual Learning Workshop, 32nd Neural Information Processing Systems (NeurIPS 2018).
Montréal, Canada, Dec 2018.
poster

On the Correlation and Transferability of Features between Automatic Speech Recognition and Speech Emotion Recognition.
17th Annual Conference of the International Speech Communication Association (Interspeech).
San Francisco, USA, Sep 2016.
slides


Research Students



Current

Emma Pretty, Ph.D. Student, RMIT, 2021–Present.
Nermine Hendy, Ph.D. Student, RMIT, 2021–Present.
Halide Göknur Aydoğan, Ph.D. Student, RMIT, 2021–Present.
Sitthichart (Mark) Tohmuang, Ph.D. Student, 2022-Present.
Nannan (Amber) Huang, Ph.D. Student, 2022–Present.
Parin Sanpetchnarong, M.Sc. Student, 2023–Present.
Rinaldo Gagiano, Ph.D. Student, 2023–Present.
Jing Ren, Ph.D. Student, 2024–Present.
Arturo Sandoval Rodríguez, Ph.D. Student, 2024–Present.

Alumni

Yameng Peng, Ph.D., RMIT, 2024. (Research Fellow, RMIT)
Kathiravan Thangavel, Ph.D., RMIT, 2023. (Postdoc, Khalifa University)
Jarry Chen, M.Sc., RMIT, 2023. (IBM)
Fitrio Pakana, M.Sc., RMIT, 2021. (Ph.D., RMIT)
Lior Madmoni, Research Intern, Facebook Reality Labs, 2019. (Ben-Gurion University)
Shengjie Bi, Research Intern, Facebook Reality Labs, 2019. (Dartmouth College)
Sharath Adavanne, Research Intern, Facebook Reality Labs, 2018. (Tampere University)


Teaching



Courses

COSC2959/COSC2960 Foundations of Artificial Intelligence.
RMIT, Australia, July 2021, March 2022, July 2022, March 2023, July 2023, March 2024, July 2024.

COSC2676/COSC2752 Programming Fundamentals for Scientists.
RMIT, Australia, March 2020, July 2020, March 2021.

Guest Lectures

Digital Image Watermarking.
EEET2169/EEE1255 Image Processing / Image Systems Engineering.
RMIT, Australia, April 2018.

Sampling and Reconstruction.
EEET2113 Signals and Systems II.
RMIT, Australia, March 2016.

Signals in Noise.
EEET2113 Digital Signal Processing.
RMIT, Australia, April 2015.


Contact



Dr Haytham Fayek
School of Computing Technologies
Royal Melbourne Institute of Technology (RMIT University)
Building 14, Level 11, Room 03
124 La Trobe Street, Melbourne VIC 3000
Australia

Email:
Phone:
Postal: