Thonk From First Principles

Why PyTorch is an amazing place to work... and Why I'm Joining Thinking Machines

In which I convince to you to join either PyTorch or Thinking Machines!

Mar 4 • 

Horace He

73

7

5

August 2024

FlexAttention: The Flexibility of PyTorch with the Performance of FlashAttention [external]

Freeing users from the software lottery tyranny of fused attention implementations.

Aug 7, 2024 • 

Horace He

18

2

2

April 2024

Strangely, Matrix Multiplications on GPUs Run Faster When Given "Predictable" Data! [short]

Great minds discuss flops per watt.

Apr 29, 2024 • 

Horace He

132

22

8

Solutions: What Shapes Do Matrix Multiplications Like?

Companion to https://www.thonking.ai/p/what-shapes-do-matrix-multiplications

Apr 8, 2024 • 

Horace He

10

1

What Shapes Do Matrix Multiplications Like? [medium]

Divining order from the chaos

Apr 1, 2024 • 

Horace He

88

2

3

February 2024

Supporting Mixtral in gpt-fast through torch.compile [short]

Long-form version of this tweet thread: https://twitter.com/cHHillee/status/1762269069351461196

Feb 26, 2024 • 

Horace He

 and 

Yanbo Liang

10

4