here's a recording of big ol' lecture I wrote & delivered for BMOLab and Vector Institute last month, entitled "Language Models and Poetics," in which I claim that computers not only *can* generate poetry, but in fact they can *only* generate poetry.
the discussion touches on GPT-n (of course), speech act theory, William Carlos Williams' _Spring and All_, Frank Lantz (twice), and more 🎶
(the audio didn't come out great, happy to supply text/slides to interested folks)
@aparrish just watched this and it's great! am wondering if there's a distinction between speech acts generated by a statistical model, and those that arise from something more simulation-based. is it really empty and void when dwarf fortress tells me my dwarf has died? that's a fact about the (a?) world, not a mere citation
@aparrish yeah, I think I'm less interested in the fiction/non-fiction distinction than the second question - it feels to me like purely statistical manipulation of language tokens is qualitatively different to language being used as a way of relaying information, even if it's coming out of a machine. your argument makes perfect sense in terms of language models, but those aren't the only way that computers generate language (even if they are the flavour of the month)
@mewo2 yeah, you may be right. on the one hand I want this argument to apply across all techniques, but on the other hand I wish I'd thought of this because then I'd have had a way to make the talk be more specific to language models, haha
@aparrish yeah, I think if you take this too far you end up in chinese room territory, and it definitely feels like humans and speedometers are not doing the same thing, but the distinction is not quite the same as the one you're drawing
Hometown is adapted from Mastodon, a decentralized social network with no ads, no corporate surveillance, and ethical design.