Episode 58: PyTorch and Dex with Adam Paszke

Notes

PyTorch and Dex with Adam Paszke. A view from inside the production team. Can the Array languages learn anything from the ascendency of PyTorch and Dex?

Host: Conor Hoekstra

Guest: Adam Paszke

Panel: Marshall Lochbaum, Stephen Taylor and Bob Therriault

---

Original episode on ArrayCast

Show Notes

Array Cast - July 21, 2023

Thanks to Bob Therriault, Conor Hoekstra, and Adam Paszke for gathering these links:

[01] 00:01:49

• J on AWS
• KXcon ‘23 videos
• KXcon ‘23 ArrayCast review episode

[02] 00:04:10

• PyTorch
• Dex Programming Language
• Coursera

[03] 00:07:48

• Torch7
• Torch
• Lua Programming Language
• Python Programming Language
• Alpha Go documentary
• Tensorflow Programming Language
• LuaJIT interpreter

[04] 00:15:43

• Automatic differention

[05] 00:18:25

• GPU
• TPU

[06] 00:20:56

• Machine Learning

[07] 00:29:30

• AutoGrad Library
• JAX
• Vectorization

[08] 00:33:10

• Dex White Paper 4 pages
• Dex White Paper 20 pages
• Dex Tutorial
• MatLab Programming Language

[09] 00:35:40

• Rank Polymorphism

[10] 00:37:42

• Futhark Programming Language
• Dex and Futhark
• blog/2020-12-28-futhark-and-dex.htmlArrayCast Episode with Troels Henriksen

[11] 00:39:00

• Haskell Programming Language

[12] 00:40:30

• Ad Hoc Polymorphism
• Parametric Polymorphism
• NumPy Python Library

[13] 00:46:15

• CUDA GPU Language

[14] 00:53:13

• XLA JAX compiler

[15] 00:56:57

• Triton OpenAI

[17] 01:01:44

• Languish language tracker
• LLMs

[18] 01:05:43

• github/google/Jaxgithub/google-research/dex-lang

[19] 01:08:00

• Nix
• -

[20] 01:09:25

• Adam’s secret project - TBA

[21] 01:10:28

• Contact AT ArrayCast DOT com