Keyboard shortcuts

/ or ⌘/Ctrl K
Find a note
j / k
Next / previous section or linked note
h / l
Collapse or go to parent / expand or enter
e or Alt-click
Read a linked note here
o
Open focused note on its own
g g / G
First / last section or linked note
g h / g a
Home / all notes
g b / g t
Backlinks / table of contents
t
Cycle System, Light, Dark
? / Esc
Show / close this reference

Search: ↑/↓ or Ctrl N/P, Enter to open. Shortcuts pause while typing.

Sutton: The Bitter Lesson [1a1f511e]

Tags: articles, hardware, ml

1. Responses

2. Discussion

  • Role of open source

  • Rise of intermediate representation

    • abstract interpretation?
  • active learning and weak supervision

  • malloc and fpga

    • performance constraints of cache misses?
    • cache analysis?

  • compilers

    • text/stack/heap
    • isa maps to blocks of code
    • profile guided optimizations to burn in your hot spots

  • what other types of machine learning are being foreclosed because we don't have the hardware?

    • what can we do?

      • can we invest in IR's?

        • FPGA's, ML IR, compiler IR's
      • reconfigurable network in datacenters
  • capsul neural networks
  • log file system (ssds)
  • polynomial error correction -> needs eponetnial speedup