Sam Foreman 2024-11-08

👋 Hi, I’m Sam!

🧑🏻‍💻 About

• Computational scientist @ Argonne National Laboratory (ALCF)
• Working on:
  • 🧪 {AI, HPC} for science
  • 🚀 training large models on supercomputers

[!TIP]

🎤   Recent Talks

📊 here ( + how I make them! )

[!TIP]

<img src="./assets/spotify-green.svg" class="inline-icon"

style="height:1.33rem; vertical-align: text-bottom;" /> Now Playing

[!TIP]

<script> /** Developed by Prashant Shrestha + https://prashant.me */ var lastfmData = { baseURL: "https://ws.audioscrobbler.com/2.0/?method=user.getrecenttracks&user=", // Your Last.fm Username user: "saforem2", // Your API key api_key: "1dbc15037c1fe71ce06acbb3f73adc75", additional: "&format=json&limit=1" }; var getSetLastFM = function() { $.ajax({ type: "GET", url: lastfmData.baseURL + lastfmData.user + "&api_key=" + lastfmData.api_key + lastfmData.additional, dataType: "json", success: function(resp) { var recentTrack = resp.recenttracks.track[0]; var formatted = // "" + recentTrack.name; "🎶 " + recentTrack.name; $("a#tracktitle") .html(formatted) .attr("href", recentTrack.url) .attr("title", recentTrack.name + " by " + recentTrack.artist["#text"]) .attr("target", "_blank"); var artistFormatted = // "" + recentTrack.artist["#text"]; "🗣️ " + recentTrack.artist["#text"]; $("a#trackartist") .html(artistFormatted) .attr("title", "Artist : " + recentTrack.artist["#text"]); $("img#trackart").attr("src", recentTrack.image[2]["#text"]); }, error: function(resp) { $("a#tracktitle").html( "" + "Silence!" ); $("img#trackart").attr("src", "🧑🏻‍💻"); var artistFormatted = "Sam Foreman"; $("a#trackartist") .html(artistFormatted) .attr("href", "https://samforeman.me"); } }); }; // Get the new one. getSetLastFM(); // Start the countdown. setInterval(getSetLastFM, 10 * 5000); </script>

• 👀 If you’re curious

  • 🔥 What I work on

    As a member of the AI / ML Group at ALCF, I work on:

    • 🤖 🧪 AI + Science

    • 🎲 Building better sampling methods for Lattice QCD

    • 🧬 Genome-Scale Language Models

      • GenSLM

      • 🥇 ACM Gordon Bell Special Prize

    • 🌍 Foundation models for long term climate forecasting

    • 🏃‍♂️ Scaling Large Language Models

    • 🏎️ Distributed training across thousands of GPUs

  • 📍 How I got here

    My current research focuses on using deep generative modeling to help build better sampling algorithms in lattice gauge theory. In particular, I’m interested in building gauge equivariant neural network architectures and using inductive priors to incorporate physical symmetries into machine learning models.

    I received my PhD in Physics from the University of Iowa in 2019 and my thesis was on Learning Better Physics: A Machine Learning Approach to Lattice Gauge Theory.

    Prior to this, I completed two bachelors degrees (Engineering Physics and Applied Mathematics, 2015) at The University of Illinois at Urbana-Champaign. My undergraduate dissertation was titled Energy Storage in Quantum Resonators and was supervised by Professor Alfred Hübler within the Center for Complex Systems Research at UIUC.

    This work ultimately resulted in a patent !!

[!TIP]

❤️‍🩹 Status

yellow pink green blue circle

import datetime
from rich import print
now = datetime.datetime.now()
day = now.strftime("%Y-%m-%d")
time = now.strftime("%H:%M:%S")
print(' '.join([
    "[#838383]Last Updated[/]:",
    f"[#E599F7]{day}[/]",
    "[#838383]@[/]",
    f"[#00CCFF]{time}[/]"
]))

Last Updated: 2024-11-08 @ 13:46:11

© Copyright Sam Foreman

📝 Work

[!NOTE]

You can find a full list of my publications on my Google Scholar

• Intro to HPC Bootcamp: Engaging New Communities Through Energy Justice Projects
  Journal of Computational Science, 2024

• Thorough Characterization and Analysis of Large Transformer Model Training At-Scale
  Proc. ACM Meas. Anal. Comput. Syst. 03/2024

• MLMC: Machine Learning Monte Carlo for Lattice Gauge Theory
  S. Foreman et al. Lattice, 2023 (Proceedings), 12/2023

• Protein Generation via Genome-scale Language Models with Bio-physical Scoring
  @ SC’23, 11/2023

• DeepSpeed4Science Initiative: Enabling Large-Scale Scientific Discovery […]
  @ NeurIPS 2023 AI For Science Workshop, 10/2023

• DeepSpeed4Science.ai Blog Post

• Loooooooong Sequence Lengths

• Comprehensive Performance Study of LLMs on Novel AI Accelerators
  M. Emani, S. Foreman, et al., IPDPS 2024, 10/2023

• Exploratory Analysis of Climate Data with ClimRR
  S. Foreman, Intro to HPC Bootcamp @ NERSC, 08/2023

• 🏆 GenSLMs: Genome-scale language models reveal SARS-Cov-2 evolutionary dynamics
  @ SC’22 10/2022

  • 🥇 ACM Gordon Bell Special Prize

• Lattice QCD and Particle Physics
  A.S. Kronfeld et al., 07/2022

• Applications of ML to Lattice QFT
  D. Boyda, S. Calí, S. Foreman, et al., [arXiv:2202.05838], 02/2022

• LeapFrogLayers: Trainable Framework for Effective Sampling
  S. Foreman, X.Y. Jin, J.C. Osborn, Lattice, 2021

• HMC with Normalizing Flows [slides]
  S. Foreman et al., Lattice, 2021

• Deep Learning Hamiltonian Monte Carlo [+ poster]
  S. Foreman, X.Y. Jin, & J.C. Osborn, @ SimDL Workshop @ ICLR, 2021

• Machine Learning and Neural Networks for Field Theory
  S. Foreman, X.Y. Jin, & J.C. Osborn, SnowMass, 2020

• Examples of renormalization group transformations for image sets
  S. Foreman et al., Physical Review E., 2018

• RG inspired Machine Learning for lattice field theory
  S. Foreman et al., arXiv:1710.02079, 2017

• Large Energy Density in Three-Plate Nanocapacitors due to Coulomb Blockade
  S. Foreman et al., J. Appl. Phys, 2018

🦜 Talks

[!TIP]

See full list of Recent Talks

📬 Posts

📦 Projects

[!TIP]

📊 GitHub Stats

Even More !!

Wakatime

[!TIP]

📂 saforem2/

🪖 Experience

🎪 Events

• Organizer for:

  • SC24 Workshop: High Performance Python for Science at Scale (HPPSS), November 2024

  • SC23 Workshop: High Performance Python for Science at Scale (HPPSS), November 2023

  • Machine Learning and Quantum Computing for Earth Sciences at 17th U. S. National Congress on Computational Mechanics, July 2023

👔 Employment

Table 1: 📟 Experience

Position	@	Start	End
Assistant Computational Scientist	ALCF	2022	–
Postdoc	ALCF	2019	2022
Graduate Researcher	ANL	2018	2019

🍎 School

Table 2: 🎓 Education

Degree	In	@	End
PhD	Physics	University of Iowa	2019
B.Sc	Physics	UIUC	2015
B.Sc	Math	UIUC	2015

🎶 Music

[!TIP]

<script> /** Developed by Prashant Shrestha + https://prashant.me */ var lastfmData = { baseURL: "https://ws.audioscrobbler.com/2.0/?method=user.getrecenttracks&user=", // Your Last.fm Username user: "saforem2", // Your API key api_key: "1dbc15037c1fe71ce06acbb3f73adc75", additional: "&format=json&limit=1" }; var getSetLastFM = function() { $.ajax({ type: "GET", url: lastfmData.baseURL + lastfmData.user + "&api_key=" + lastfmData.api_key + lastfmData.additional, dataType: "json", success: function(resp) { var recentTrack = resp.recenttracks.track[0]; var formatted = // "" + recentTrack.name; "🎶 " + recentTrack.name; $("a#tracktitle") .html(formatted) .attr("href", recentTrack.url) .attr("title", recentTrack.name + " by " + recentTrack.artist["#text"]) .attr("target", "_blank"); var artistFormatted = // "" + recentTrack.artist["#text"]; "🗣️ " + recentTrack.artist["#text"]; $("a#trackartist") .html(artistFormatted) .attr("title", "Artist : " + recentTrack.artist["#text"]); $("img#trackart").attr("src", recentTrack.image[2]["#text"]); }, error: function(resp) { $("a#tracktitle").html( "" + "Silence!" ); $("img#trackart").attr("src", "🧑🏻‍💻"); var artistFormatted = "Sam Foreman"; $("a#trackartist") .html(artistFormatted) .attr("href", "https://samforeman.me"); } }); }; // Get the new one. getSetLastFM(); // Start the countdown. setInterval(getSetLastFM, 10 * 5000); </script>