f.mireshghallah@gmail.com


About Me!

I like mysteries and puzzles a lot, that is why I enjoy watching police mystery TV series or medical mysteries. I have lately been binge-watching National Geographic docuseries, I also do clothes designing in my free time, a refreshing activity that helps me focus and clear my mind.

Books I Like!

  • Indistractable by Nir Eyal
  • Sapiens: A Brief History of Humankind by Yuval Noah Harari
  • The Martian by Andy Weir
  • The Solitaire Mystery by Jostein Gaarder
  • The Orange Girl by Jostein Gaarder
  • Life is Short: A Letter to St Augustine by Jostein Gaarder
  • The Alchemist by Paulo Coelho
  • The Art of Thinking Clearly by Rolf Dobelli


  • Fatemehsadat Mireshghallah

    I'm a third year CS Ph.D. student at University of California, San Diego and I'm advised by Taylor Berg-Kirkpatrick. I am also a research scientist at OpenMined. My research interests are privacy-preserving ML, natural language processing and fairnessL. I am open to collaborations, so if you have a cool idea and you'd like to discuss it, feel free to email me!
    Google Scholar | CV | GitHub | Twitter
      News
  • July 2021: Join us at our break out session titled Machine Learning for Privacy: An Information Theoretic Perspective, at the 2021 WiML un-workshop.

  • June 2021: I started my internship at Microsoft Research AI, with the Language and Intelligent Assistance (LIA) group, where I am working on federated learning for language models.

  • May 2021: Our paper "U-Noise: Learnable Noise Masks for Interpretable Image Segmentation" has been accepted in the 2021 IEEE International Conference on Image Processing (ICIP 2021). You can find the paper here.

  • March 2021: My MSR AI summer 2020 internship paper, "Privacy Regularization: Joint Privacy-Utility Optimization in Language Models" has been accepted in the 2021 Annual Conference of the North American Chapter of the Association for Computational Linguistics (NAACL 2021). You can find the paper here.

  • March 2021: I gave an invited talk on our paper Shredder: Learning Noise Distributions to Protect Inference Privacy at the Split Learning Workshop. You can find the talk here.

  • February 2021: I gave an invited talk on Introduction to NLP and Career Prospects (slides) at the University Institute Of Engineering and Technology.

  • January 2021: Our paper "Not All Features Are Equal: Discovering Essential Features for Preserving Prediction Privacy" has been accepted in the 30th Web Conference (WWW 2021). You can find the paper here and the code here.

  • January 2021: I am co-organizing the Distributed and Private Machine Learning (DPML) Workshop at ICLR 2021. Consider submitting your work, or dropping by!

  • December 2020: I present my MSR AI intenrship work, "Privacy Regularization: Joint Privacy-Utility Optimization in Language Models", at the Privacy-Preserving Machin Learning Workshop (PPML) at NeurIPS 2020. We present privacy-preserving mitigations for text-generation language models and evaluate them with existing and proposed attacks.
    BibTex and abstract

  • October 2020: I am giving an invited talk on privacy and fairness in deep neural network inference at the Machine Learning and Friends Lunch at Umass Amherst. You can find my slides here and the talk recording here.

  • September 2020: I am giving an invited talk on Privacy-Preserving NLP at the 2020 Privacy Conference (PriCon). Checkout the talk here. You can find my slides for the talk here.

  • July 2020: I am co-leading a break out session titled Feminist Perspectives for ML & CV at the WiML 2020 Un-workshop. The reading list and the discussed material is available here.

  • June 2020: I started my internship at Microsoft Research AI, with the Knowledge Technologies and Intelligent Experiences (KTX) group, where I am working on private and ethical text generation.

  • May 2020: Our paper "Divide and Conquer: Leveraging Intermediate Feature Representations for Quantized Training of Neural Networks" got accepted at the Thirty-seventh International Conference on Machine Learning (ICML 2020).

  • May 2020: Join us at OpenMined virtual Ask Me Anything (AMA) session, where I answer questions about privacy, machine learning, research and PhD life! You can find the recording here.

  • April 2020: Join us at the "Learning Representation for Cybersecurity" social, where we will be discussing Cybersecurity, ML-Based intrusion and malware detection, privacy-preserving ML and other interesting topics! You can find slides for my talk here. You can also find a reading list of papers here.

  • April 2020: I was chosen as a winner of NCWIT (National Center for Women and IT)'s AiC Collegiate award!

  • March 2020: I virtually presented my paper Shredder in ASPLOS 2020. You can find my presentation video here.

  • December 2019: I was chosen as an NCWIT (National Center for Women and IT) collegiate award finalist!

  • December 2019: Join us in Vancouver for the WiMLDS [NeurIPS Special] Talks + Panel Discussion where I'll be giving a talk on Privacy in Mahcine Learning! You can find my slides for this talk here.

  • November 2019: Our paper Shredder: Learning Noise Distributions to Protect Inference Privacy got into the 25th International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS 20) with less than 18% acceptance rate!

  • October 2019: Our paper Shredder got into NeurIPS19's Privacy in ML workshop!

  • June 2019: I am joining Western Digital's research department as a RAMP Next Generation Platform Technologies Intern.

  • June 2019: Our paper Shredder got into ICML's SPML workshop, let's meet up if you are attending ICML19!

  • April 2019: I am attending ASPLOS19, let me know if you are there!
  • Keep up with me on Twitter for more news!
      Internships
    Summer 2021
    Research Intern
    Microsoft Research AI, Language and Intelligent Assistance group, Redmond Lab
    Manager: Dimitrios Dimitriadis
    Summer 2020
    Research Intern
    Microsoft Research AI, Knowledge Technologies and Intelligent Experiences (KTX) group, Redmond Lab
    Manager: Robert Sim
    Summer 2019
    Research Intern
    Western Digital Co. Research and Development
    Manager: Anand Kulkarni
      Publications

    [For the full list, please refer to my Google Scholar page.]

  • Privacy Regularization: Joint Privacy-Utility Optimization in Language Models, 2021 Annual Conference of the North American Chapter of the Association for Computational Linguistics (NAACL 2021).

  • Not All Features Are Equal: Discovering Essential Features for Preserving Prediction Privacy, 30th Web Conference (WWW 2021).

  • Privacy in Deep Learning: A survey. Please let me know if there is any related work that is missing!

  • Neither Private Nor Fair: Impact of Data Imbalance on Utility and Fairness in Differential Privacy , 2020 CCS Privacy-Preserving Machine Learning in Practice (PPMLP) workshop (PPMLP 2020).

  • Shredder: Learning Noise Distributions to Protect Inference Privacy, 25th International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS 20).

  • Shredder: Learning Noise Distributions to Protect Inference Privacy with a Self-Supervised Learning Approach, Thirty-fourth Annual Conference on Neural Information Processing Systems (NeurIPS19), Privacy in Machin Learning Workshop (PriML19).
    Code available at shredder-v2-self-supervised

  • Shredder: Learning Noise to Protect Privacy with Partial DNN Inference on the Edge Thirty-sixth International Conference on Machine Learning (ICML19), Security and Privacy of Machin Learning Workshop (SPML19).
    Code available at shredder-v1

  • Energy-Efficient Permanent Fault Tolerance in Hard Real-Time Systems, IEEE Transactions on Computers, March 2019

  • ReLeQ: An Automatic Reinforcement Learning Approach for Deep Quantization of Neural Networks, NeurIPS ML for systems workshop, December 2018
  •   Invited Talks

  • Low-overhead Techniques for Privacy and Fairness of DNNs (slides) at the Alan Turning Institue's Privacy-preserving Data Analysis Seminar Series, June 2021. Recording here.
  • Shredder: Learning Noise Distributions to Protect Inference Privacy (slides) at the Split Learning Workshop, March 2021. Recording here.
  • Introduction to NLP and Career Prospects (slides) at the University Institute Of Engineering and Technology, February 2021.
  • Privacy and Fairness in Deep Neural Network Inference (slides) at Machine Learning and Friends Lunch at UMass Amherst, October 2020. Recording here.
  • Privacy-Preserving Natural Language Processing (slides) at the OpenMined Privacy Conference, September 2020. Recording here.
  • Invited poster session at the Microsoft Research AI Breakthroughs Workshop, September 2020
  •   Diversity, Inclusion & Mentorship

  • Mentor for the Graduate Women in Computing (GradWIC) AT UCSD
  • Mentor for the UC Sand Diego Women Organization for Research Mentoring (WORM) in STEM
  • Co-leader for the "Feminist Perspectives for Machine Learning & Computer Vision" Break-out session at the Women in Machine Learning (WiML) 2020 Un-workshop Held at ICML 2020
  • Mentor for the USENIX Security 2020 Undergraduate Mentorship Program
  • Volunteer at the Women in Machine Learning 2019 Workshop Held at NeurIPS 2019
  • Invited Speaker at the Women in Machine Learning and Data Science (WiMLDS) NeurIPS 2019 Meetup
  • Mentor for the UCSD CSE Early Research Scholars Program (CSE-ERSP) in 2018
  •   Professional Services

  • Reviewer for ICLR 2022
  • Reviewer for NeurIPS 2021
  • Reviewer for ICML 2021
  • Shadow PC member for IEEE Security and Privacy Conference Winter 2021
  • Artifact Evaluation Program Committee Member for USENIX Security 2021
  • Reviewer for ICLR 2021 Conference
  • Program Committee member for the LatinX in AI Research Workshop at ICML 2020 (LXAI)
  • Reviewer for the 2020 Workshop on Human Interpretability in Machine Learning (WHI) at ICML 2020
  • Program Committee member for the MLArchSys workshop at ISCA 2020
  • Security & Privacy Committee Member and Session Chair for Grace Hopper Celebration (GHC) 2020
  • GHC (Grace Hopper Celebrateion) 2020 Privacy and Security Committer Member
  • Reviewer for ICML 2020 Conference
  • Artifact Evaluation Program Committee Member for ASPLOS 2020
  • Reviewer for IEEE TC Journal
  • Reviewer for ACM TACO Journal
  •   TA Experiences, UC San Diego
    Fall 2020

  • TA of CSE 276C: Mathematics for Robotics, Graduate Level, Instructor: Dr. Henrik I. Christensen
  • Winter and Fall 2019

  • TA of CSE 240D: Accelerator Design for Deep Learning, Graduate Level, Instructor: Dr. Hadi Esmaeilzadeh
  •   Volunteer TA Experiences, Sharif University of Technology
    Fall 2017

  • Head TA of Digital Electronics
  • Head TA of Probability and Statistics
  • Spring 2017

  • TA of Computer Architecture
  • TA of Signals and Systems
  • Head TA of Probability and Statistics
  • Fall 2016

  • TA of Advanced Programming
  • Head TA of Numerical Methods