For almost all of 2022 I have been reading a paper a day, not necessarily Machine Learning or even Computer Science. This year being motivated by Lex Fridman I will be maintaining my reading list.

Jan 1: Set Transformer: A Framework for Attention-based Permutation-Invariant Neural Networks (

Jan 2:  A Generalization of ViT/MLP-Mixer to Graphs (

Jan 3: ConvNeXt V2: Co-designing and Scaling ConvNets with Masked Autoencoders (

Jan 4: Muse: Text-To-Image Generation via Masked Generative Transformers (

Jan 5: PHANGS-JWST First Results: Variations in PAH Fraction as a Function of ISM Phase and Metallicity (

Jan 6: Learning One Abstract Bit at a Time Through Self-Invented Experiments Encoded as Neural Networks (

Jan 7: Rethinking Mobile Block for Efficient Neural Models (

Jan 8: Multi-Rate VAE: Train Once, Get the Full Rate-Distortion Curve (

Jan 9: The Forward-Forward Algorithm: Some Preliminary Investigations (

Jan 10-12: Highly accurate protein structure prediction with AlphaFold, Supplementary (

Jan 13: Scalable Diffusion Models with Transformers (

Jan 14: WIRE: Wavelet Implicit Neural Representations (

Jan 15: SemPPL: Predicting pseudo-labels for better contrastive representations (

Jan 16: Tracr: Compiled Transformers as a Laboratory for Interpretability (

Jan 17: Guiding Text-to-Image Diffusion Model Towards Grounded Generation (

Jan 18: Domain Generalization using Causal Matching (

Jan19: Fast Jacobian-Vector Product for Deep Networks (

Jan 20: On the Continuity of Rotation Representations in Neural Networks (

February 8-11: Causal Effect Inference with Deep Latent-Variable Models (

February 12: A Critical Look at the Consistency of Causal Estimation with Deep Latent Variable Models (

February 12-13: Do learned representations respect causal relationships? (

February 14-16: Scaling Vision Transformers to 22 Billion Parameters (

February 17: Denoising Diffusion Probabilistic Models for Robust Image Super-Resolution in the Wild (

February 18: Big Little Transformer Decoder (

February19: Energy Transformer (