Blog | Ethansmith2000

How absurd it is, that anything is at all.

Art from "In the Aeroplane over the Sea" by Neutral Milk Hotel There are several dimensions by which we may feel small. You may feel...

Ethan Smith

Jan 1210 min read

AI should help humans understand each other.

Empathy through technology

Ethan Smith

Oct 18, 202410 min read

Why are Modern Neural Nets the way they are? And Hidden Hypernetworks.

https://sweet-hall-e72.notion.site/Why-are-Modern-Neural-Nets-the-way-they-are-And-Hidden-Hypernetworks-6c7195709e7b4abbada921875a951c54

Ethan Smith

Oct 6, 20241 min read

Do Diffusion Transformers Deserve The Hype?

https://sweet-hall-e72.notion.site/Do-Diffusion-Transformers-Deserve-The-Hype-9b9ca7bead374b47aac96558714c203b

Ethan Smith

Jul 28, 20241 min read

Automated LoRA Discovery and Teaching Neural Networks to make Neural Networks

https://sweet-hall-e72.notion.site/Automated-LoRA-Discovery-and-Teaching-Neural-Networks-to-make-Neural-Networks-22aa3b5ad66e4bc985ff2c93...

Ethan Smith

May 26, 20241 min read

Diffusion and Autoregressive Models for Learning to Solve Mazes

https://sweet-hall-e72.notion.site/Diffusion-and-Autoregressive-Models-for-Learning-to-Solve-Mazes-c3bc4bcdfa304ecd9531ee5445a4da66

Ethan Smith

May 21, 20241 min read

I Learn to Diffuse, or Data Alchemy 101: a Mnemonic Manifesto

https://arxiv.org/pdf/2208.03998

Ethan Smith

May 12, 20241 min read

Traversing through CLIP Space, PCA and Latent Directions

https://sweet-hall-e72.notion.site/Traversing-through-CLIP-Space-PCA-and-Latent-Directions-b898932e13684d58957405b4a2747a79

Ethan Smith

May 6, 20241 min read

LoraNorm

https://sweet-hall-e72.notion.site/LoraNorm-91f5927c7c3a48f9beeec7c2910c82ad?pvs=4

Ethan Smith

Apr 14, 20241 min read

2 UNet Classifier Free Guidance

https://sweet-hall-e72.notion.site/2-UNet-Classifier-Free-Guidance-e2eb8833d01e4e77869a2eff4631ebbc?pvs=4

Ethan Smith

Apr 14, 20241 min read

SGDImagePrompt and QuickEmbedding

https://sweet-hall-e72.notion.site/SGDImagePrompt-and-QuickEmbedding-502cf95e48ff4a4db44823e117b7f779?pvs=4

Ethan Smith

Apr 14, 20241 min read

Learning Space Filling Curves with Autoencoders

https://sweet-hall-e72.notion.site/Learning-Space-Filling-Curves-with-Autoencoders-e39e41ce75894c3a8fecfee0f3bbfb23?pvs=4

Ethan Smith

Apr 14, 20241 min read

Mimicking Diffusion Models by Sequencing Frequency Coefficients

https://sweet-hall-e72.notion.site/Mimicking-Diffusion-Models-by-Sequencing-Frequency-Coefficients-8e5a60e876d640c390369627d55330b1

Ethan Smith

Mar 13, 20241 min read

ContrastiveDPO for Diffusion, Generalizing DPO to multiple items

https://sweet-hall-e72.notion.site/ContrastiveDPO-for-Diffusion-Generalizing-DPO-to-multiple-items-PART1-226b3746aa4d4ff9995d1e26b38a9674

Ethan Smith

Mar 8, 20241 min read

Dipole Attention: Opposites May Be Deep Connections

Image from: https://twitter.com/toshi2fly/status/911306344376012800 Post: https://sweet-hall-e72.notion.site/Dipole-Attention-Opposites-M...

Ethan Smith

Mar 5, 20241 min read

Speeding up Diffusion: Reviewing DiffusionGANs, Consistency Models, and Flow Models

https://sweet-hall-e72.notion.site/Speeding-up-Diffusion-Reviewing-DiffusionGANs-Consistency-Models-and-Flow-Models-80b985120b8f472094cdc...

Ethan Smith

Mar 4, 20241 min read

Exploring Cross Attention maps in Diffusion Models

https://sweet-hall-e72.notion.site/Exploring-Cross-Attention-maps-in-Diffusion-Models-98a85f552fbe4e62887b896b756177f4?pvs=4

Ethan Smith

Feb 25, 20241 min read

CLIP vs T5 as a text encoder for diffusion models

https://sweet-hall-e72.notion.site/CLIP-vs-T5-as-a-text-encoder-for-diffusion-models-df76bf09cacb425797640da86131267f?pvs=4

Ethan Smith

Feb 25, 20241 min read

Response to the broken VAE claim

https://sweet-hall-e72.notion.site/Followup-to-the-broken-VAE-claim-f8e154081cc74b49b81172d4b84af4aa?pvs=4

Ethan Smith

Feb 23, 20241 min read

ToDo: Token Downsampling for Efficient Generation of High-Resolution Images

On Notion!: https://www.notion.so/ToDo-Token-Downsampling-for-Efficient-Generation-of-High-Resolution-Images-b41be1ac8ddc46be8cd687e67dee...

Ethan Smith

Feb 23, 20241 min read