Ziad El Sayed

Projects

Flow diagram: an input circuit netlist is converted to a graph, passed through GNN layers to produce an embedding, then through linear layers to downstream EDA, hardware reliability and hardware security tasks.

Graph Neural Networks for Integrated Circuit Design, Reliability, and Security: Survey and Platform

2025

Graph neural networks (GNNs) have excelled in learning tasks for graph-structured data, including social networks, biology, and circuits. Their success in circuit-related tasks has fueled growing interest in applying GNNs to IC design. This project presents the first comprehensive survey of GNN applications in IC design, covering electronic design automation (EDA), reliability, and security. It introduces a generic GNN application flow spanning graph conversion, feature extraction, architecture selection, and task formulation, along with GNN4CIRCUITS, a customizable Python tool for researchers. The paper also explores open challenges and future research directions. Published in ACM Computing Surveys.

Two chat transcripts side by side. Without persistent memory the assistant forgets a stated celiac diagnosis and later suggests a tortilla. With persistent memory it recalls the constraint and suggests a gluten-free tortilla.

OMem: Dynamic Hybrid Retrieval for Long-Term Memory in LLM-Based Agentic Systems

2025

For my MSc thesis, I developed OMem, which combines dense and sparse retrieval with fusion and reranking techniques to deliver (at the time) state-of-the-art memory retrieval in real-time, agentic systems. This research advances memory-augmented AI by improving factual consistency, adaptability, and persistent reasoning across extended interactions. Conducted with Oxtractor.

Grouped bar chart of fake feature ratio across seven language models, from GPT2-small to LLaMA 8B, comparing sparse autoencoders trained on the Faithful, Pile and Fineweb datasets.

FaithfulSAE: Towards Capturing Faithful Features with Sparse Autoencoders without External Dataset Dependencies

2025

Sparse Autoencoders (SAEs) have been used to break down LLM representations into human-readable features, but they suffer from two key issues: variability across different random seeds and a failure to recover genuine model-internal patterns. We believe these problems arise because SAEs are typically trained on external data, either scraped from the web or generated by another model, which can lie outside the LLM’s training distribution and produce “Fake Features” that don’t actually reflect its activations. To fix this, we introduce FaithfulSAE, which trains SAEs using data synthesized directly by the target model. By using its own, less out-of-distribution instruction outputs, FaithfulSAE yields far more consistent features across seeds, performs well on standard SAE probing benchmarks, and cuts the Fake Feature Ratio in 5 of 7 evaluated models, without relying on external datasets.

Two rows of photographs from the MMBias dataset: the African target group above, the South Asian target group below.

Bias Mitigation using Functional Inequalities for Regularization

2024

In this paper, I introduce a bias mitigation framework for multimodal machine learning that leverages k-nearest-neighbors perturbations and multi-hyperparameter regularization using statistical entropy. By allocating separate regularization weights to each modality rather than relying on a single scalar, the approach affords finer control over fairness constraints compared to previous works. Empirical results on the Colored MNIST benchmark demonstrate that this method achieves 97.65% accuracy, an improvement of 1.4% over prior state of the art. The paper also extends the MMBias dataset to include additional demographic groups and a bias evaluation is performed on these groups using OpenAI’s CLIP model.

Three screens from the Spotify redesign prototype: a library of playlists, a playlist with its track list and playback bar, and a podcast page showing episodes by season.

Spotify Reimagined

2022

Redesigned Spotify to be more user-centered and accessible, implementing various human computer interaction principles. Conducted user experience research and used it to create a UI wireframe and prototype using Figma.

The qSa’id team in front of the NYUAD International Hackathon for Social Good sign.

qSa’id: Quantum-ML-Assisted Diagnostic and Treatment Access Platform for Autism

2022

The main aim of qSa’id is to cater to the needs of people with autism by providing a quantum approach for early screening and allocating resources efficiently among those who require them. qSa’id involves an efficient hybrid quantum-classical ML approach towards improving automated screening, and a parallel solution using QUBO to optimize placements of specialized treatment centers in a health system. Winner of Best Application of Social Good as part of NYUAD’s 2022 Hackathon for Social Good.